| Pages:
1
2
3
4 |
j_sum1
Administrator
Posts: 6478
Registered: 4-10-2014
Location: Limbo
Member Is Offline
Mood: Just got through yet another "take this job and shove it" moment.
|
|
Well, this is excellent news.
Thanks, Polverone.
|
|
|
chempyre235
Hazard to Others
Posts: 219
Registered: 21-10-2024
Location: Between Nb and Tc
Member Is Offline
Mood: Quite distracted
|
|
Yes, thank you. I agree, it's not ideal to block all of the bots, since they help to increase access to this forum's content, but the forum host and
members also shouldn't be paying to support the bandwidth either.
"However beautiful the strategy, you should occasionally look at the results." -Winston Churchill
"I weep at the sight of flaming acetic anhydride." -@Madscientist
"...the elements shall melt with fervent heat..." -2 Peter 3:10
|
|
|
Belowzero
Hazard to Others
Posts: 189
Registered: 6-5-2020
Location: Member Is Offline
Member Is Offline
|
|
I have the exact same experience with the servers I host. Its mainly AI bot scraping traffic. 'Naked' webservers with modest amounts of resources are
just not plausible anymore. The amount of garbage traffic is sometimes more than 80% of all incoming traffic!
|
|
|
BromicAcid
International Hazard
Posts: 3324
Registered: 13-7-2003
Location: Wisconsin
Member Is Offline
Mood: Rock n' Roll
|
|
The amount of AI scraping traffic is crazy. My websites that I host on my server are pretty niche and used to only get 40-100 hits a month and now
they routinely get 1000+.
|
|
|
Sir_Gawain
National Hazard
Posts: 530
Registered: 12-10-2022
Location: southeast
Member Is Offline
|
|
I have noticed the site has been down a lot less recently, thanks Polverone!
|
|
|
Polverone
Now celebrating 23 years of madness
Posts: 3190
Registered: 19-5-2002
Location: The Sunny Pacific Northwest
Member Is Offline
Mood: Chastened
|
|
I haven't actually activated Cloudflare yet. The scrapers must just be backing off temporarily. I didn't realize that this week is Spring Break.
That's probably why the university help desk isn't responding. I'll try contacting them again next week.
|
|
|
mackolol
Hazard to Others
Posts: 460
Registered: 26-10-2017
Member Is Offline
Mood: Funky
|
|
Well, idk if there is any backup of the site more recent than that from 2017, but maybe if it was shared publicly, there wouldn't be so many scraping
attempts...?
I myself would love to have an SM backup on my hard drive.
Please let me know if there is any.
|
|
|
bnull
National Hazard
Posts: 998
Registered: 15-1-2024
Location: East Woods
Member Is Offline
Mood: Fecking annoyed
|
|
2021: http://www.sciencemadness.org/talk/viewthread.php?tid=12051&...
|
|
|
Belowzero
Hazard to Others
Posts: 189
Registered: 6-5-2020
Location: Member Is Offline
Member Is Offline
|
|
Quote: Originally posted by mackolol  | Well, idk if there is any backup of the site more recent than that from 2017, but maybe if it was shared publicly, there wouldn't be so many scraping
attempts...?
I myself would love to have an SM backup on my hard drive.
Please let me know if there is any. |
Bots will scrape anything that remotely looks like a website.
This is the new norm for the internet now.
There is no clever logic behind it, the AI machine is hungry.
|
|
|
| Pages:
1
2
3
4 |
![[*]](images/xpblue/default_icon.gif){kind=icon}
