RF Generation Message Board

Other => Idle Chatter => Topic started by: TraderJake on August 20, 2006, 12:20:57 AM



Title: Spiders
Post by: TraderJake on August 20, 2006, 12:20:57 AM
A lot of people seemed to be intrigued by the spiders in the Who's Online list, so here is an explanation of what spiders are and what they do.

The spiders that you see in the Who's online list are bots that search engine companies use to index sites and add them to their search database. They crawl millions of pages a day indexing pages so that John Q User can do a search for it. So, when you see Yahoo Spider or Googlebot in the who's online list that just means that those search engines are indexing our pages.

Hopefully that alleviates some of the confusion on the spiders.


Title: Re: Spiders
Post by: The Metamorphosing Leon on August 20, 2006, 12:46:47 AM
Well now that you told me about them I noticed them. I think you should ban em.


Title: Re: Spiders
Post by: TraderJake on August 20, 2006, 01:03:36 AM
Haha... no.


Title: Re: Spiders
Post by: captain_nintendo on August 20, 2006, 10:07:10 AM
Thanks for the explanation Dave.


Title: Re: Spiders
Post by: Tynstar on August 20, 2006, 12:41:55 PM
I have a shoe if they need banning.


Title: Re: Spiders
Post by: shaggy on August 20, 2006, 12:54:26 PM
*stomp* *splat*


Title: Re: Spiders
Post by: captain_nintendo on August 21, 2006, 11:51:27 AM
Samuel L. Jackson in "Spiders on a boat"

Coming to a theater near you in 2007.


Title: Re: Spiders
Post by: Izret101 on August 24, 2006, 06:33:44 PM
There is a GIGABOT!!!1!!!!

WHats that from?

Gigabot is cool :D


Title: Re: Spiders
Post by: atari_wizard on August 24, 2006, 06:36:16 PM
Samuel L. Jackson in "Spiders on a boat"

Coming to a theater near you in 2007.

Sweet. =)

I didn't even notice the spiders, I'm sure I'll see them for now on.


Title: Re: Spiders
Post by: Izret101 on August 24, 2006, 10:10:21 PM
OMG Another gigabot!!!!!!!!!!!!!!!


Title: Re: Spiders
Post by: ganonbanned on August 24, 2006, 10:42:40 PM
wow, I didnt notice them until now.