Crawler Definition
SEO Glossary September 26th, 2010
Batch check keyword rankings on Google, Yahoo, Bing, Freeware, Download Now! |
Also known as Spider or Robot, a crawler is a search engine program that “crawls” the web, collecting data, following links, making copies of new and updated sites, and storing URLs in the search engine’s Index. This allows search engines to provide faster and more up-to-date listings.
Click Here to Download Free Rank Checker
|