What the hell?
Printable View
What the hell?
no one joins us because we are too cliquey apparently :(
we're clique-y? No way... We don't have any inside jokes or pull practical jokes on eachother. Ever.
Quote:
Originally Posted by Harmeister
That would be completely juvenile. The whole reason I'm part of this forum is because we're above all that.
Pinkies out, boys, pinkies out.
Who's cliquey?
most of the guests are actually yahoo and google spiders, scanning the site.
The yahoo, google and msnbot spiders are usually the greatest number of users on the forum, at any given time.
Which is why I feel they need to block the spiders/search engine scanners. Every thing you are posting on this forum is being indexed, databased, and searchable.
robots.txt
User-agent: *
Disallow: /
Does that repel spiders?
Yes. place the robots.txt file containing those two lines into the root of the website's server, and the robots will read it and follow the rules set within it. The lines there will tell all robots ("*") that they are not allowed to scan anything below the root ("/"), effectively stopping them from scraping the site completely.Quote:
Originally Posted by Wheeljak
The amount of robots trawling the site is getting ridiculous (currently there's one member -- myself -- and 19 robots on here).
This morning (8:25AM PDT):
2 members, 38 guests
38 guests = 1 actual guest,1 Google Spider & 36 Yahoo! Slurp Spiders!
That's just ridiculous. Somebody got a can of bug spray?
slurp. mmmm, yummy...
i Am Sick And Tired Of The Guest Thing!!! I Say Block The Insects, And Make Them Show Themselves, I'm Personally Tired Of People Who Scan The Sight To Find Phone Numbers Or How To Manipulate Conversations(like Canadien Stalkers Of Mine)
either Way We Gotta Make Changes!!!