Robots.txt

Inane baanter or words of wisdom - you decide...
Post Reply
User avatar
Firefox
Sheepie Whore
Sheepie Whore
Posts: 11412
Joined: Fri Apr 26, 2002 6:15 pm 0
Location: Sheffield

Re: Robots.txt

Post by Firefox »

All we are is dust in the wind, dude.
"I am a very considerate person. If I want to go out all night on my miniature golf course and shoot lizards, well, no reason to keep the neighbours awake..."
User avatar
moosedude
Baaaaaaa!
Baaaaaaa!
Posts: 6209
Joined: Fri Nov 19, 2004 1:19 pm 0
Location: Craggy Island
Contact:

Re: Robots.txt

Post by moosedude »

Spoiler: show
DUST
Image

WIND
Image

DUDE
Image

01000101 01000100 01000111 01000101

http://www.redbubble.com/people/fotofill/ buy my photos!
User avatar
Alarm
Baaaaaaa!
Baaaaaaa!
Posts: 9046
Joined: Sat May 21, 2005 10:45 pm 0
Location: Welsh Wales
Contact:

Re: Robots.txt

Post by Alarm »

We're just humans surrounded by bots in spam-world, my friends.
User avatar
disciple
Sheepie Whore
Sheepie Whore
Posts: 13941
Joined: Mon Oct 27, 2003 11:33 pm 0
XBL Gamertag: LiberMentis
PSN: Prime_Heretic
Location: Greenfield
Contact:

Re: Robots.txt

Post by disciple »

gravy wrote:And we've had a marked increase in spammers.

Great!
Arse, any idea if they're human or bot spammers?

Is it possible to stick a second captcha in? Or swap the one out we have, it's really un-user-friendly anyway.

How about an ip blocklist, probably adding in the bogon and Hijacked lists from here http://blocklistpro.com/faqs/biss-ip-bl ... s-faq.html. If you chuck us the ip addresses of some of these spammers I'll check if they would have been blocked if you want.

Or possibly think about bringing the board up to the current version 3.0.6, that appears to have lots of new spam prevention facilities in there, that would also probably patch some security holes and "add value" via new board features. It also has the benefit of keeping things standard which sidesteps Rik's issues. Never done an upgrade myself though so dunno how tricky it is.

Maybe add in some custom profile fields: http://www.phpbb.com/kb/article/custom- ... mmer-tool/ an easy implementation might be a simple dropdown box where the default value doesn't allow registration or a blank text field were the user has to type "I am not a cunting spambot"

How do they find the registration link? Is it directly or do they hop around a few yakyak urls first. If direct maybe make so it can only be accessed if the referrer is yakyak.org? Or possibly masquerade the URL to something non-standard via rewrites so it can only be found via button click rather than direct url access?
Last edited by disciple on Sat Jan 23, 2010 1:47 pm 0, edited 1 time in total.
PS4 : Prime_Heretic
Steam: bitstorm
Elite Dangerous: Cmdr Britain
User avatar
Darkflame
Sheepie Whore
Sheepie Whore
Posts: 18236
Joined: Mon Mar 31, 2003 11:06 am 0
Location: Not the UK

Re: Robots.txt

Post by Darkflame »

custom profile fields worked wonders when I had a spam problem.
Piss-easy to get around, but only if they specifically target your forum.
User avatar
gravy
Sheepie Whore
Sheepie Whore
Posts: 19572
Joined: Wed May 01, 2002 1:28 pm 0
Location: The Other Place

Re: Robots.txt

Post by gravy »

disciple wrote:
gravy wrote:And we've had a marked increase in spammers.

Great!
Arse, any idea if they're human or bot spammers?

Is it possible to stick a second captcha in? Or swap the one out we have, it's really un-user-friendly anyway.

How about an ip blocklist, probably adding in the bogon and Hijacked lists from here http://blocklistpro.com/faqs/biss-ip-bl ... s-faq.html. If you chuck us the ip addresses of some of these spammers I'll check if they would have been blocked if you want.

Or possibly think about bringing the board up to the current version 3.0.6, that appears to have lots of new spam prevention facilities in there, that would also probably patch some security holes and "add value" via new board features. It also has the benefit of keeping things standard which sidesteps Rik's issues. Never done an upgrade myself though so dunno how tricky it is.

Maybe add in some custom profile fields: http://www.phpbb.com/kb/article/custom- ... mmer-tool/ an easy implementation might be a simple dropdown box where the default value doesn't allow registration or a blank text field were the user has to type "I am not a cunting spambot"

How do they find the registration link? Is it directly or do they hop around a few yakyak urls first. If direct maybe make so it can only be accessed if the referrer is yakyak.org? Or possibly masquerade the URL to something non-standard via rewrites so it can only be found via button click rather than direct url access?
Upgraded. This version has Q&A captcha now so we can add some questions which may well help.

The other option is to ban registrations with a gmail address, every single spammer has come in via gmail

As for the other stuff, try it out on your own install
User avatar
Jedburgh
Baaaaaaa!
Baaaaaaa!
Posts: 5904
Joined: Mon Apr 22, 2002 5:50 pm 0
Yahoo Messenger: dariusjedburgh23
Location: Uncanny Valley

Re: Robots.txt

Post by Jedburgh »

To be precise, *most* spammers are coming in from gmail addresses. Any other domains get block-banned as a rule. Had a rash of AOLs the other day so that's gone again.

Any and all captcha questions gratefully received.
Jedburgh

It's all about trying to work out what the fuck is going on.
User avatar
disciple
Sheepie Whore
Sheepie Whore
Posts: 13941
Joined: Mon Oct 27, 2003 11:33 pm 0
XBL Gamertag: LiberMentis
PSN: Prime_Heretic
Location: Greenfield
Contact:

Re: Robots.txt

Post by disciple »

gravy wrote:Upgraded.
Bloomin' marvellous. :D

Definitely worth doin' I reckon. Not sure what new features there are but that captcha certainly looks a lot better than the last.
Jedburgh wrote:Any and all captcha questions gratefully received.
Are you a cunting spambot? Answer yes or no.

What colour is an orange?

What letter's to the left of w on a qwerty keyboard?

2 plus 2=?
PS4 : Prime_Heretic
Steam: bitstorm
Elite Dangerous: Cmdr Britain
User avatar
Darkflame
Sheepie Whore
Sheepie Whore
Posts: 18236
Joined: Mon Mar 31, 2003 11:06 am 0
Location: Not the UK

Re: Robots.txt

Post by Darkflame »

I dought YakYak will be specifically targeted, so any single non-standard question field will probably do.

Also, banning any public/free email from registering is effectively telling 90% of legitimate people to fuck-off too. Its a very blunt tool.
adam
Baaaaaa!
Baaaaaa!
Posts: 4418
Joined: Sat Jun 24, 2006 9:15 pm 0

Re: Robots.txt

Post by adam »

i think someone did an authentication page where you had to click pics of kittens in sequence, could possibly do something similar
User avatar
disciple
Sheepie Whore
Sheepie Whore
Posts: 13941
Joined: Mon Oct 27, 2003 11:33 pm 0
XBL Gamertag: LiberMentis
PSN: Prime_Heretic
Location: Greenfield
Contact:

Re: Robots.txt

Post by disciple »

Searches engines are blocked again aren't they?

Any chance we could sort it out? New joins have been gradually dropping since mid 2007 and are now pretty much the lowest they've ever been.

Yakyak's dying a slow death and no-one really seems to give a fuck. :?
PS4 : Prime_Heretic
Steam: bitstorm
Elite Dangerous: Cmdr Britain
User avatar
OX mkII
Baaaaa!
Baaaaa!
Posts: 1548
Joined: Sun Jan 25, 2009 3:53 pm 0

Re: Robots.txt

Post by OX mkII »

Fuck the shareholders
User avatar
disciple
Sheepie Whore
Sheepie Whore
Posts: 13941
Joined: Mon Oct 27, 2003 11:33 pm 0
XBL Gamertag: LiberMentis
PSN: Prime_Heretic
Location: Greenfield
Contact:

Re: Robots.txt

Post by disciple »

Sorry no idea, stick it in the youtube thread or something.
PS4 : Prime_Heretic
Steam: bitstorm
Elite Dangerous: Cmdr Britain
User avatar
OX mkII
Baaaaa!
Baaaaa!
Posts: 1548
Joined: Sun Jan 25, 2009 3:53 pm 0

Re: Robots.txt

Post by OX mkII »

disciple wrote:Sorry no idea, stick it in the youtube thread or something.
born yesterday?
Fuck the shareholders
User avatar
disciple
Sheepie Whore
Sheepie Whore
Posts: 13941
Joined: Mon Oct 27, 2003 11:33 pm 0
XBL Gamertag: LiberMentis
PSN: Prime_Heretic
Location: Greenfield
Contact:

Re: Robots.txt

Post by disciple »

Elucidate.
PS4 : Prime_Heretic
Steam: bitstorm
Elite Dangerous: Cmdr Britain
Post Reply