Not logged in [Login - Register]
 Sciencemadness Discussion Board » Non-chemistry » Forum Matters » What in the Holy FAK is with this new SPAM issue!? Select A Forum Fundamentals   » Chemistry in General   » Organic Chemistry   » Reagents and Apparatus Acquisition   » Beginnings   » Miscellaneous   » The Wiki Special topics   » Technochemistry   » Energetic Materials   » Biochemistry   » Radiochemistry   » Computational Models and Techniques   » Prepublication Non-chemistry   » Forum Matters   » Legal and Societal Issues   » Detritus   » Test Forum

Author: Subject: What in the Holy FAK is with this new SPAM issue!?
RogueRose
International Hazard

Posts: 1220
Registered: 16-6-2014
Member Is Offline

What in the Holy FAK is with this new SPAM issue!?

So what, did Melgar do such a good job that the doosh bag spammers are taking revenge now? This is totally out of hand. I reported about 40-50 posts today and was only online for about 20 mins.

WTF is going on!?
RogueRose
International Hazard

Posts: 1220
Registered: 16-6-2014
Member Is Offline

20 mins after reporting ~25 different posts and they are still there.
Pumukli
National Hazard

Posts: 280
Registered: 2-3-2014
Location: EU
Member Is Offline

Mood: No Mood

Spam on the rise

Dear Moderators,

Unfortunately it seems that the noise level on SM board is still rising. Be it the most sophisticated spam filtering efforts of Melgar the new (at least for me) spam posts seem to be changed.
They no longer contain links, they are simply just malicious "noise". Spammers no longer want to sell us anything, they want to undermine this forum and let us drown in the elevated noise level.

My sincere question is would it be possible to refuse all new subscriptions from would-be SM members and spammers for a while (maybe for a clearly stated predetermined time period) altogether, let the "sleeping cells" already in reactivate, get rid of them, then reopen the board with a different subscription policy?
Different would mean "supervised first n posts", or mandatory "n days silence after subscription", etc. ?

We may loose a few legitimate users but would save those already in and would restore the "morale" on the board. Which is I feel is in danger now. Maybe it is just for me today but with time more will be fed up.

It is now Chemistry in general which gets the most spam - tomorrow maybe other subsections will get their "fair" share of dirt as well. That will be the time I will less frequently visit SM I feel.

By the way if anyone thinks seriously about amateur chemistry and love his/her hobby then would compose even a 1000 word long original "application letter to the mods" if wants to get in! I'm sure I would have done it when subscribed and you can check that for the first few days I was silent and read the old threads carefully before started to post my silly questions.

I would not mind loosing even dozens of one-time posters if I could introduce a new X, X being any name of our respected old and current members with hundreds of deep, meaningful, accurate posts in their stats.

Quality and not quantity should be first and it would surely rise the "prestige" of the board too. Now with the spam I simply don't see it. I see a sinking ship instead.
j_sum1

Posts: 4429
Registered: 4-10-2014
Location: Oz
Member Is Offline

Mood: Metastable, and that's good enough.

I came back after a couple of days away to the joy of 250 spam reports and the front page chocker with rubbish.
It must have been a frustrating couple of days. And teh botkila must be down for some reason.

I will do a manual clean up in an hour or two when I have a spot of spare time.
j_sum1
10-11-2018 at 01:15
RogueRose
International Hazard

Posts: 1220
Registered: 16-6-2014
Member Is Offline

If we merge a thread, how about a link to which the thread is merged! Almost NO forum does this and I can NEVER find the thread it is merged to. WTF is up with that?

I checked the Whimsy section and didn't see it, i thought we were keeping the SPAM stuff there so Spammers can't read it.
fusso
International Hazard

Posts: 1202
Registered: 23-6-2017
Location: Toaru city, Toaru nation, Asia, Earth, ∥ universe
Member Is Offline

Mood: You, a degenerate: OWO Me, an intellectual: tungsten dioxide

 Quote: Originally posted by RogueRose If we merge a thread, how about a link to which the thread is merged! Almost NO forum does this and I can NEVER find the thread it is merged to. WTF is up with that? I checked the Whimsy section and didn't see it, i thought we were keeping the SPAM stuff there so Spammers can't read it.
I agree. There are quite some antispam ideas in the "Tired of..." thread. We should move them here ASAP otherwise they'll indirectly become agent provocateurs of more ingenious spams.

Useful sites:
Balance Chemical Equation: http://www.webqc.org/balance.php
Molecular mass and elemental composition calculator: https://www.webqc.org/mmcalc.php
Solubility table: https://en.wikipedia.org/wiki/Solubility_table
It's not crime if noone finds out - Nyaruko
unionised
International Hazard

Posts: 3928
Registered: 1-11-2003
Location: UK
Member Is Offline

Mood: No Mood

I don't know a lot about the subject, but could we automatically kill anyone who posts a thread called
Mature purlieus
or Full-grown galleries
etc?

Amos
International Hazard

Posts: 1171
Registered: 25-3-2014
Location: Yes
Member Is Offline

Mood: No

I'd like to offer up my services to become a moderator or just be given deletion permissions, especially given that I've got a lot of free time which is not something common among our staff at present. I moderate a few facebook groups and a discord server if that counts for anything, I'm extremely easy to contact by anyone active in the SM skype group, and yes, I promise to use my powers only for anti-spam activity. I'm going to send a copy of this post to a few admins to see what they say.

I'm sick of the spam. This is sociopathic behavior and I intend to do whatever I can about it as soon as I'm allowed to.
RogueRose
International Hazard

Posts: 1220
Registered: 16-6-2014
Member Is Offline

Quote: Originally posted by fusso
 Quote: Originally posted by RogueRose If we merge a thread, how about a link to which the thread is merged! Almost NO forum does this and I can NEVER find the thread it is merged to. WTF is up with that? I checked the Whimsy section and didn't see it, i thought we were keeping the SPAM stuff there so Spammers can't read it.
I agree. There are quite some antispam ideas in the "Tired of..." thread. We should move them here ASAP otherwise they'll indirectly become agent provocateurs of more ingenious spams.

R u mocking me or being sarcastic about moving to Whimsy? I only suggested that b/c it had been suggested many times in other threads, and I thought I had seen the SPAM thread here, but not it ain't so I was confused where it went.
RogueRose
International Hazard

Posts: 1220
Registered: 16-6-2014
Member Is Offline

I have a feeling that this isn't natural spam behavior. I am about 99% certain this board is being targeted by someone, maybe someone in politics who doesn't like people talking about this stuff. I see no other reason for 90% of these spam posts b/c they are not links to anything (and many links aren't even active!).

Would it not make sense that if you can't legally shut down a forum due to free speech laws, then just try to make it unuseable? Sounds like a Communist type of attack - or could be capitalist based IF we were providing information that was making them loose  which I kind of doubt we are.
j_sum1

Posts: 4429
Registered: 4-10-2014
Location: Oz
Member Is Offline

Mood: Metastable, and that's good enough.

Whoa. Calm down.

If anyone is at fault here, it is me. I merged two threads since they were bith resoonding to the same issue. I did not notice one was in whimsy. Apologies for the confusion that caused.

We have old software and need to work within its constraints. If I move a thread then there is the option to leave a redirect. If I merge a thread, there is no such option.

We were moving some spam threads to detritus as a means of collecting information on spammer tactics. But, such threads often got wiped by being reported. Also Melgar was collecting spammer info through other means as he developed his filters.

The current issue seems to be that Melgar's script has crashed. Melgar is aware of the things that cause this. But at present it seems to have not restarted.

If you are noticing a subtle difference between the current state of the board and what it eas a week ago (sarcasm intended), then that is testament to the awesome job that Melgar has done and the effectiveness of the code he has written. He really does deserve our thanks.

The long-term solution is migration to another platform. Melgar has also done a lot of work on this. The stalling factor at this stage is Polverone's input.

Frustrating as the present status is, this is not the time to bite one another's heads off. I'm off to delete another 60 spam posts.

Edit: responding to RR's last post
The spam strategy is simply to use SM's status on search engines to lend legitimacy to the sites they are promoting. It is largely automated and probably not that effective. But the tactic relies on volume rather than efficiency. There is no conspiracy here.

[Edited on 11-11-2018 by j_sum1]
fusso
International Hazard

Posts: 1202
Registered: 23-6-2017
Location: Toaru city, Toaru nation, Asia, Earth, ∥ universe
Member Is Offline

Mood: You, a degenerate: OWO Me, an intellectual: tungsten dioxide

@RR sorry for any misunderstandings. No, I'm not mocking you or what. And I also shouldn't have quoted you and made that post.

Useful sites:
Balance Chemical Equation: http://www.webqc.org/balance.php
Molecular mass and elemental composition calculator: https://www.webqc.org/mmcalc.php
Solubility table: https://en.wikipedia.org/wiki/Solubility_table
It's not crime if noone finds out - Nyaruko
j_sum1
11-11-2018 at 05:16
Elrik
Hazard to Self

Posts: 52
Registered: 1-9-2018
Member Is Offline

 Quote: Originally posted by RogueRose I have a feeling that this isn't natural spam behavior. I am about 99% certain this board is being targeted by someone, maybe someone in politics who doesn't like people talking about this stuff..
This is normal spam behavior. Perhaps his bot malfunctions at times but this is a simple money making google exploit. I've seen malicious bot attacks and they look nothing like this.
The reason this forum is being targeted is simple: there is nothing stopping him. When I joined I accidentally used a email address thats no longer valid, I tried to log in and to my surprise the log in worked and I could change my settings to use my current email. There isn't even automated email verification on this board and that's the very first step in forum security, it takes more than that to keep bots away. These bots go after the low hanging fruit, then when security is finally implemented the coder tries to adapt a few times before giving up and moving on to the new low hanging fruit. If you want the bots gone several registration verification measures need to be implemented one by one to annoy and impede the bot owner.
The bot owner just wants to make money with little effort, you have to make it too much effort.

Its funny, there was a time people around the world fought for capitalism in russia.
Welcome to russian capitalism LOL
diddi
International Hazard

Posts: 685
Registered: 23-9-2014
Location: Victoria, Australia
Member Is Offline

Mood: Fluorescent

 Quote: Originally posted by Amos I'd like to offer up my services to become a moderator or just be given deletion permissions, .

i offered a while back and i know of others also. -declined-

Beginning construction of periodic table display
Texium (zts16)

Posts: 3007
Registered: 11-1-2014
Location: San Marcos, TX
Member Is Offline

Mood: Organiking

Alright, here's the deal:

1. These spam posts are not getting past Melgar's script, Melgar's script is just not currently running. I'm sure he will be turning it back on soon, but if you haven't noticed, he hasn't been around for a few days. Then most of the spam will once again be taken care of.

2. We don't need more moderators. This is a very temporary state of affairs and soon the script will be up and running again. Plus even if you were made a moderator all you could do would be manually deleting threads one at a time since Polverone isn't here to add you to the spam report super power list, so you couldn't take out a tower of posts by the same spammer in one go like I can. That's the unfortunate state that j_sum is in.

3. All of this is a temporary fix. If you have another idea it's probably been said before and either already implemented or dismissed for some reason. The only real solution is migration to a newer platform.

4. Please stop talking about spam, theorizing about spam, and starting new threads about spam. It isn't going to change anything at this point. There is a plan in place.

morganbw
National Hazard

Posts: 332
Registered: 23-11-2014
Member Is Offline

Mood: No Mood

Thank you @Texium(zts16).
You seem to be able to state the obvious. Much needed in this world.
Melgar
Anti-Spam Agent

Posts: 2002
Registered: 23-2-2010
Location: NYC
Member Is Offline

Mood: Aromatic

Sorry, I was sick for the last 3-4 days, and haven't been online hardly at all.

Script is back up and running again. There were some issues with a certain new user getting false positives, since that user was starting new threads containing a bunch of links to foreign patent sites and sci-hub mirrors right of the bat. I first noticed this was happening by reading the logs, incidentally. AFAIK, this has been the first incident of an actual user getting posts deleted when the script was working as intended. I've made a few minor changes to the algorithm, but there's still the issue of what to do if something like that happens in the future and I'm unavailable to fix it.

Possibilities:

• Posting mostly whitelisted links (eg, hosted at en.wikipedia.org, orgsyn.org, www.sciencedirect.com) with 1-2 not on the whitelist, adds very little to the spam score. The only two whitelisted domains that spambots have posted links to have been linkedin.com and youtube.com. These could easily be made to just not count either way. I don't know how well this would work, and it might be complicated to implement.
• Have the script read through my U2U inbox and store the list of members who sent me messages. Exempt this list from deletion.
• Set up a thread that anyone can post to, that gets scanned periodically. Have some syntax set up for username mentions, like notbot=(fusso,diddi,jsum_1,Elrik) so that usernames in that syntax in that thread are automatically exempted from getting extra scrutiny for being new. (Note that because none of the users in the aforementioned list ARE new, that wouldn't actually do anything)

Something similar could be done to add safe domains to the whitelist. I could also just exempt any domains that fit the regex 'sci-hub\.??' so that we don't have to get dragged into playing sci-hub whack-a-mole alongside the copyright police.

But I guess the more important issue is how to restart it when it crashes. In that case, I have to come up with a solution that keeps me logged in, since starting it going requires me to type in my password. This is because botkilla needs to log in as me in order to be able to delete spam, and I obviously have to be somewhat careful in how that gets done. I'll try to think about possible ways I can preserve the session/cookie information in a crash, and then resume in some capacity without me needing to type in my password again.

The first step in the process of learning something is admitting that you don't know it already.

I'm givin' the spam shields max power at full warp, but they just dinna have the power! We're gonna have to evacuate to new forum software!
streety
Hazard to Others

Posts: 105
Registered: 14-5-2018
Member Is Offline

I hope you're feeling better.

 Quote: Originally posted by Melgar But I guess the more important issue is how to restart it when it crashes. In that case, I have to come up with a solution that keeps me logged in, since starting it going requires me to type in my password. This is because botkilla needs to log in as me in order to be able to delete spam, and I obviously have to be somewhat careful in how that gets done. I'll try to think about possible ways I can preserve the session/cookie information in a crash, and then resume in some capacity without me needing to type in my password again.

Melgar
Anti-Spam Agent

Posts: 2002
Registered: 23-2-2010
Location: NYC
Member Is Offline

Mood: Aromatic

I ended up going a different route though, and have it so that when it crashes, it keeps all the session data in global variables. That way, the only part that crashes is a console command, so an error just takes it right back to the console prompt, with all data still in memory. Sometimes, it's an actual post that's causing the problem, and so a person has to manually remove the post before it can start operating normally again, so whatever ends up being the solution, there should be some recognition that obstacles will eventually be removed by human moderators.

That said, could some people PLEASE test out the new test site I've been working on? I just added two new bbcode tags, [molecule] and [ce]. (Both have end tags, btw.) The first inserts a molecular diagram using PubChem, and you can use just about any string that might identify that molecule. Like, [molecule]THC[/molecule]. [ce] uses the mhchem library for LaTeX, so you can write chemical equations in a really simple syntax. Like [ce]Fe0 + H2SO4 -> H2 + FeSO4 + FeS + H2O + SO2[/ce]. I used [ce] because that's the same abbreviation mhchem uses, but if anyone thinks there's a potentially more-intuitive tag to use for molecular diagrams, I'm open to feedback. Thanks!

Take a look at this thread: