March 2024 Performance Issues

M
Matt_K
Posts: 4809
Joined: Mar 21, 2018

by Matt_K »

Received some reports of sluggishness today. There was a memory leak in the database that I just fixed which should address the issue. Let me know here if anyone is sitll having issues and I'll take a closer look into it today.
M
mgladdish
Posts: 155
Joined: Oct 10, 2021

by mgladdish »

I literally got a CloudFlare error when trying to view this thread :biggrin:

Also been having intermittent errors connecting to MySQL over the course of the day.
B
bitbckt
Posts: 298
Joined: Aug 19, 2020

by bitbckt »

Much improved, particularly jumping to the latest posts on longer threads. Thanks!
G
ghmerrill
Posts: 2193
Joined: Apr 02, 2018

by ghmerrill »

Some of the "issue" may not be with this site. I was having very sluggish network performance (via our supposedly 40M DSL line) this morning for about half an hour and then it improved. But I'm currently getting half the download speed that we're supposed to -- 25Mbps vs. 40Mbps. How local that is, I haven't looked into -- because life is too short.
B
BGuttman
Posts: 7368
Joined: Mar 22, 2018

by BGuttman »

I had noticed a bunch of duplicate posts (more than normal) today. Probably because the posters experienced the delay and thought it had not posted.

Note that if you double post and I catch it, I'll remove one. If one of the posts has more comment I'll keep that one.
H
hyperbolica
Posts: 3990
Joined: Mar 23, 2018

by hyperbolica »

It was bad, then it improved, and now it's bad again. I think it's larger than just this site. There was a cable break of a major line in the middle east. That may be causing traffic to re-route and disrupting us here.
G
ghmerrill
Posts: 2193
Joined: Apr 02, 2018

by ghmerrill »

There appear to be jagged spikes in "bandwidth outages" and DNS server issues beginning this morning. The graphs are saw-toothed. Up and down, up and down, ...
S
Slidingmyway
Posts: 2
Joined: Mar 06, 2024

by Slidingmyway »

[quote="BGuttman"]I had noticed a bunch of duplicate posts (more than normal) today. Probably because the posters experienced the delay and thought it had not posted.

Note that if you double post and I catch it, I'll remove one. If one of the posts has more comment I'll keep that one.[/quote]

That happened to me. I accidentally posted the same thread 5 times. My apologies to whomever had to clean up my mess.
P
Posaunus
Posts: 5018
Joined: Mar 23, 2018

by Posaunus »

Response speed briefly improved this morning (I think). Now again very slow. :frown:
E
EriKon
Posts: 636
Joined: Apr 03, 2022

by EriKon »

Yeah, takes quite long to load everything since one or two days. For me it's just on this page.
P
Posaunus
Posts: 5018
Joined: Mar 23, 2018

by Posaunus »

Just 5 minutes ago, Website speed magically improved. Almost immediate response! :good:

(Let's hope it remains so!)
E
EriKon
Posts: 636
Joined: Apr 03, 2022

by EriKon »

Yes, over here as well!
M
Matt_K
Posts: 4809
Joined: Mar 21, 2018

by Matt_K »

Hmmmm interesting. I have a family issue today that cropped up so I haven’t had a chance to look into it. I think the connection stuff is definitely partially to blame. It may not have been a memory leak but if the connections are slow then it’ll leave handles to the DB open which would look like a memory leak.

It’s still a little slow for me as I type. I’ll keep my eye on it as my family stuff hopefully resolves today and see if I can (ideally) permanently fix tomorrow if there are any issues that are fixable by me
E
EriKon
Posts: 636
Joined: Apr 03, 2022

by EriKon »

Seems like it's not a constant thing over here. Sometimes it works super fast for a few minutes and then again it takes a minute to load everything (sometimes with error pop-up)
M
mgladdish
Posts: 155
Joined: Oct 10, 2021

by mgladdish »

Yeah, still very bad. Just got this when loading a topic:

User image

If I can be any help on the tech side, give me a shout. Techie creds: https://www.linkedin.com/in/mgladdish/
P
Posaunus
Posts: 5018
Joined: Mar 23, 2018

by Posaunus »

STILL ... ... VERY ... ... SLOW

[color=#FF0000]General Error

[color=#0000BF]SQL ERROR [ mysqli ]

Lock wait timeout exceeded; try restarting transaction [1205]

An SQL error occurred while fetching this page. Please contact the Board Administrator if this problem persists.

Please notify the board administrator or webmaster: <EMAIL email="trombonechat@mailfence.com">trombonechat@mailfence.com</EMAIL>

S
slideandtraps
Posts: 26
Joined: Dec 14, 2023

by slideandtraps »

Experienced above SQL error this evening and personal total posts dropped to 1

with "800%" and "300%" of total posted in other topics.
M
Matt_K
Posts: 4809
Joined: Mar 21, 2018

by Matt_K »

Okay, think I found the culprit. Everything all good with my family too, one of my relatives had a minor surgery last night but all is good today. I'm going to keep my eye on it today and will need to put a more permanent fix in this weekend.
E
EriKon
Posts: 636
Joined: Apr 03, 2022

by EriKon »

Seems to work fine now. Thanks Matt for taking care of that! Much appreciated!
S
sacfxdx
Posts: 406
Joined: Apr 11, 2018

by sacfxdx »

Where's that AI when you need it? It should have fixed it automatically. I guess it's too busy faking nude pictures. :o

Good job Matt. Thanks for taking care of this.
M
Matt_K
Posts: 4809
Joined: Mar 21, 2018

by Matt_K »

[quote="sacfxdx"]Where's that AI when you need it? It should have fixed it automatically. I guess it's too busy faking nude pictures. :o

Good job Matt. Thanks for taking care of this.[/quote]

Welllllll about that. Turns out the script I’ve been using to capture spam, bots, and AI has became quite expensive computationally because of some automatic rules compounded with an enormous amount of AI generated garbage. The solution is actually not a big deal, just didn’t expect to have it come to a head this quickly. I was hoping to hold off until the next LTS of Ubuntu came out and switch over to that and fix a bunch of stuff at the same time (next LTS drops in April)
G
ghmerrill
Posts: 2193
Joined: Apr 02, 2018

by ghmerrill »

[quote="Matt K"]... enormous amount of AI generated garbage.[/quote]

Dumb AI. :( Well (in virtue of my 10 years in a previous life as a commercial compiler writer), It takes a very well designed automated code generator (and read that as "often very expensive") to generate optimal code or anything approximating it. And if you're doing some or all of that on the fly at run time, then there's an added efficiency cost as well (in optimizing the optimizer). Other than that, you can only do your best with what you can get. :good:
P
Posaunus
Posts: 5018
Joined: Mar 23, 2018

by Posaunus »

Matt,

All good this morning.

Thanks for your efforts on our behalf. :good:
M
Matt_K
Posts: 4809
Joined: Mar 21, 2018

by Matt_K »

I think I have the spam busting script back in place more efficiently now. It just ran and spike performance for a few seconds but it shouldn't be much more noticeable than typical usage and runs every few minutes, but only if there have been posts. LMK if anyone has issues tonight/into tomorrow.
I
ithinknot
Posts: 1339
Joined: Jul 24, 2020

by ithinknot »

Have you noticed that user post counts are displaying weird numbers? Sometimes it's just a bit wrong, in other cases longtime users are showing as 1...

At the time of writing this, mine says 1010 next to a post or when you open my profile, but if you click through to 'Search user's posts' it finds all 1173.

Must be indicative of something.
M
Matt_K
Posts: 4809
Joined: Mar 21, 2018

by Matt_K »

I reset one of the sites indexes the other day which has the side effect of recalculating the number of posts. I’m not sure why it thinks you have fewer posts than you do, unless the search results show duplicates for some reason
H
harrisonreed
Posts: 6479
Joined: Aug 17, 2018

by harrisonreed »

It might be counting quoted snippets as posts.