Page 6 of 6
Re: ClaudeBot server attack.
Posted: 17 May 2024 12:04
by exxos
@HigashiJun
I do see that there was connections been limited for the store. But the connection requests don't currently hit the targets anyway. At least not in yesterday's log.
It could possibly be that I had failtoban look back 10 days in the log, so i've changed that to 2 days now. I can only assume it was seeing "all" your requests which added up over the past few days.
You mention the problem only happens on your home IP address.. Are you clearing your browser cache at home ? Something like 90% of the requests should be cached content anyway. If for some reason your home browser is having to download everything every single time you visit the page then that could theoretically push things over the edge.
Re: ClaudeBot server attack.
Posted: 17 May 2024 12:23
by HigashiJun
@exxos
Thanks for your feedback.
Back to normal now, but I'm afraid of visiting the store again...
I am not clearing the cache at home at all.
I have just noticed something weird before this issue arises: when I was on the store page, not all the pictures were displayed and I had a lot of blanks.
The same happens at work, but without giving me a black page and being banned though.
Re: ClaudeBot server attack.
Posted: 17 May 2024 12:56
by exxos
HigashiJun wrote: 17 May 2024 12:23
I have just noticed something weird before this issue arises: when I was on the store page, not all the pictures were displayed and I had a lot of blanks.
Yeah, you hit the rate limits and connections were dropped. But the store needs about 250 requests, and the limit is about 500. You did not hit that limit yesterday. So I think fail2ban is counting previous days as well. It was looking back 10 days, so I changed it to 2 days which should help alleviate that problem. I may need to adjust the limits again.
I suggest not visit the store until monday, then try again. It will allow 2 days for your IP to "disappear" from the logs.
Don't lose hope, we will solve it :)
Re: ClaudeBot server attack.
Posted: 17 May 2024 13:01
by HigashiJun
exxos wrote: 17 May 2024 12:56
Don't lose hope, we will solve it :)
:cheers:
Thanks for your patience !
Re: ClaudeBot server attack.
Posted: 20 May 2024 12:58
by HigashiJun
OK, I managed to visit the store today without being banned !
:D
The only problem now is the lack of pictures:
Screenshot 2024-05-20 at 20-50-26 exxos Atari ST addon kits store.png
Note that 5 or 6 pictures are still visible though.
Better than nothing but would be more peachy with images...
8-)
Re: ClaudeBot server attack.
Posted: 20 May 2024 13:18
by exxos
HigashiJun wrote: 20 May 2024 12:58
Note that 5 or 6 pictures are still visible though.
It is rather puzzling because the store itself does not hit the rate limits, images stop loading when the rate limits are hit. But it's set to 600 connections, and the store uses about 250...
According to the error log though, there was probably about 20 images which didn't load.. So that doesn't make sense either if your not getting *all* images.
What browser are you actually using ?
Maybe you could open up a console and see what all the connection requests are on the page.
Re: ClaudeBot server attack.
Posted: 20 May 2024 13:35
by exxos
@HigashiJun I have split the nginx limits individually between the forum and the store.. The store has more multiple connection requests now, the forum has a few less.
Re: ClaudeBot server attack.
Posted: 20 May 2024 23:05
by HigashiJun
@exxos
Thank you !
Everything is OK at my workplace and I can see all the pictures again in the store.
Will check later at home.
Re: ClaudeBot server attack.
Posted: 21 May 2024 07:32
by HigashiJun
And everything seems to be back to normal at home too !
:D
Thank you exxos.
Re: ClaudeBot server attack.
Posted: 21 May 2024 14:10
by exxos
:bravo: :2k2: :girldance: :girldance: