What is “Robots.txt”? A Simple Definition
SEO Glossary November 17th, 2010
Batch check keyword rankings on Google, Yahoo, Bing, Freeware, Download Now! |
Also known as robots exclusion protocol, Robots.txt is a text file stored in a site’s root directory that tells a search engine Crawler which site pages and sub-folders should not be included in the search engine Index. However, there is no guarantee that a Crawler will comply with this request. Robots.txt is an alternative to a Meta Robots Tag or password protection.
Click Here to Download Free Rank Checker
|