Spider

A spider is small script or program that is designed to go to web sites and collect information. The information that the spider looks for is dependent on what the spider was designed to do.

The most common type of spider is a search engine spider. These are also knows as bots or robots. Search engine spiders collect information about a web site in order to index the web site in its search engine results pages (SERPs). Probably the most well known and popular spider is Googlebot.

Related web hosting dictionary terms:
googlebot
search engine
SERPs

Glossary Definition by WebhostingGPS.com