Robots.txt

Inane baanter or words of wisdom - you decide...
Post Reply
User avatar
gravy
Sheepie Whore
Sheepie Whore
Posts: 19572
Joined: Wed May 01, 2002 1:28 pm 0
Location: The Other Place

Robots.txt

Post by gravy »

After our flood by google and yahoo indexers I've added a robots.txt that prevents any indexing by any search engine

Code: Select all

User-agent: *
Disallow: /
User avatar
Dio
Sheepie Whore
Sheepie Whore
Posts: 18887
Joined: Mon May 31, 2004 1:08 pm 0
Location: Newcastle UK

Post by Dio »

Would be nice to fix the Search function then.
User avatar
Jedburgh
Baaaaaaa!
Baaaaaaa!
Posts: 5904
Joined: Mon Apr 22, 2002 5:50 pm 0
Yahoo Messenger: dariusjedburgh23
Location: Uncanny Valley

Post by Jedburgh »

YOU'RE KILLING THE RAINFOREST!
Jedburgh

It's all about trying to work out what the fuck is going on.
User avatar
Baggypants
Baaaaaaa!
Baaaaaaa!
Posts: 5328
Joined: Sun Mar 19, 2006 12:54 pm 0
Location: Salford(UK);
Contact:

Post by Baggypants »

balls, theres then end of my site: searches then. How am I supposed to bump four year old threads to postwhore in dammit.
"The eggs, get them!"
User avatar
gravy
Sheepie Whore
Sheepie Whore
Posts: 19572
Joined: Wed May 01, 2002 1:28 pm 0
Location: The Other Place

Post by gravy »

Dio wrote:Would be nice to fix the Search function then.
Have you been taking whinge pills?
User avatar
Dio
Sheepie Whore
Sheepie Whore
Posts: 18887
Joined: Mon May 31, 2004 1:08 pm 0
Location: Newcastle UK

Post by Dio »

It was more sarcasm than whinge.
User avatar
HGFB
Sheepie Whore
Sheepie Whore
Posts: 23575
Joined: Sat Apr 27, 2002 8:51 pm 0
Location: At my desk. Tap tap tapping.

Post by HGFB »

The search function seems to work in phpBB3.
My bag is called Mr Shitface
User avatar
gravy
Sheepie Whore
Sheepie Whore
Posts: 19572
Joined: Wed May 01, 2002 1:28 pm 0
Location: The Other Place

Post by gravy »

HGFB wrote:The search function seems to work in phpBB3.
Yes it does :) More news soon
User avatar
Gorecki
Baaaaaaa!
Baaaaaaa!
Posts: 5962
Joined: Sat Aug 31, 2002 1:39 am 0
Location: Essex, home of the Boy Racer

Post by Gorecki »

Dio wrote:It was more sarcasm than whinge.
Well Duh!
Tang Sou!
User avatar
RageMatrix
Baaaaaaa!
Baaaaaaa!
Posts: 5515
Joined: Fri May 10, 2002 12:52 pm 0
XBL Gamertag: Jon256
Location: East Sussex

Post by RageMatrix »

Gorecki wrote:
Dio wrote:It was more sarcasm than whinge.
Well Duh!
:lol:
XBox Gamertag: Jon256
Wii Code: 4849 1090 9042 6725
"Wrapped in metal, wrapped in ivy"
The Official UNIX/Linux Thread
User avatar
Stone
Sheepie Whore
Sheepie Whore
Posts: 14497
Joined: Thu Jun 26, 2003 6:49 pm 0
XBL Gamertag: thestony1
Location: Harpenden

Post by Stone »

Dio wrote:It was more sarcasm than whinge.
Serious question; what's wrong with it? :? Always works for me...

Stone
User avatar
benedictw
Baaaaaaa!
Baaaaaaa!
Posts: 6012
Joined: Thu Mar 25, 2004 3:44 pm 0
XBL Gamertag: CoderBen
Location: Poole, UK
Contact:

Post by benedictw »

Stone wrote:
Dio wrote:It was more sarcasm than whinge.
Serious question; what's wrong with it? :? Always works for me...
Quite often you just want to match the subject - you KNOW the thread exists - somewhere!
Gamertag\PSN: CoderBen
User avatar
Stone
Sheepie Whore
Sheepie Whore
Posts: 14497
Joined: Thu Jun 26, 2003 6:49 pm 0
XBL Gamertag: thestony1
Location: Harpenden

Post by Stone »

Also, how come we never had a robots.txt before? I thought it was standard these days...

Stone
User avatar
piku
Sheepie Whore
Sheepie Whore
Posts: 20960
Joined: Wed Apr 24, 2002 10:44 am 0
Website: Http://Www.ncot.uk
Location: Wakefield
Contact:

Post by piku »

gravy wrote:
HGFB wrote:The search function seems to work in phpBB3.
Yes it does :) More news soon
Most interesting news I've heard all week.
return (0);
User avatar
stx
Baaa!
Baaa!
Posts: 405
Joined: Sat Jan 25, 2003 7:37 pm 0
Location: Switzerland

Post by stx »

C3PO
Orac
Zen
KITT
Data
Rosie
Metal Mickey
Brassneck
Robbie
ASIMO
Metal Mickey
K9
Cylons
Dr Theopolis
Kamelion
BOB
Vincent
Johnny 5
Kryten
Down with news! Where is Dance Energy House Party?
Post Reply