Agent Name is the name of the Crawler/spider that is currently visiting a page. Spider is a robot sent out by search engines to catalogue websites on the internet. When a spider indexes a particular website, this is known as ‘being spidered’.
Agent Name is the name of the Crawler/spider that is currently visiting a page. Spider is a robot sent out by search engines to catalogue websites on the internet. When a spider indexes a particular website, this is known as ‘being spidered’.