Discussion in 'Technical Discussions' started by samayaranjan, Nov 12, 2012.
A “spider” is a software program ?
A “spider” is a software program that travels the web examining websites in order to add them to a search engine
database and rank them according to the specific ranking criteria for that search engine. Most search engines use
spiders to quickly and efficiently canvas the web for information.
The more common term for such program is web crawler.
Note generally they are considered a good thing as they make searching and retrieving information on the Internet much much quicker.
Separate names with a comma.