What the hell?
What the hell?
Keep your headphones on.
no one joins us because we are too cliquey apparently
I've got amnesia.. I can't remember..
we're clique-y? No way... We don't have any inside jokes or pull practical jokes on eachother. Ever.
there we go, just right. keep walking...
most of the guests are actually yahoo and google spiders, scanning the site.
The yahoo, google and msnbot spiders are usually the greatest number of users on the forum, at any given time.
Which is why I feel they need to block the spiders/search engine scanners. Every thing you are posting on this forum is being indexed, databased, and searchable.
"...Because all you of Earth are idiots!" - Eros, "Plan 9 from Outer Space"
robots.txt
User-agent: *
Disallow: /
Does that repel spiders?
"What, Wheeljak? You fell in that open manhole?
How is that possible?
I posted 'CAUTION: OPEN MANHOLE' on my Facebook page!"
Yes. place the robots.txt file containing those two lines into the root of the website's server, and the robots will read it and follow the rules set within it. The lines there will tell all robots ("*") that they are not allowed to scan anything below the root ("/"), effectively stopping them from scraping the site completely.
The amount of robots trawling the site is getting ridiculous (currently there's one member -- myself -- and 19 robots on here).
This morning (8:25AM PDT):
2 members, 38 guests
38 guests = 1 actual guest,1 Google Spider & 36 Yahoo! Slurp Spiders!
That's just ridiculous. Somebody got a can of bug spray?
"...Because all you of Earth are idiots!" - Eros, "Plan 9 from Outer Space"
slurp. mmmm, yummy...
there we go, just right. keep walking...
i Am Sick And Tired Of The Guest Thing!!! I Say Block The Insects, And Make Them Show Themselves, I'm Personally Tired Of People Who Scan The Sight To Find Phone Numbers Or How To Manipulate Conversations(like Canadien Stalkers Of Mine)
either Way We Gotta Make Changes!!!
I STOLE THE PM DAWN NAME FROM PRINCE BE'S WIFE AND KIDS,
WHILE PRINCE BE WAS FIGHTING FOR HIS LIFE IN THE HOSPITAL ON LIFE SUPPORT!!!!!!
I'M DOO-DOO HEAD!!!!!!!!!