Google Web site Verifier Person Agent Added To Google Crawlers

Google has added a brand new Google crawler, a brand new consumer agent, to the Google spider listing. Its title is Google Web site Verifier Person Agent. This consumer agent ignores robots.txt guidelines, by the way in which, and I assume it’s used for verifying websites with Search Console and different Google instruments and companies.

Google posted the brand new consumer agent over right here within the Google Crawlers assist documentation.

The consumer agent token is: Google-Web site-Verification

The total consumer agent string is: Mozilla/5.0 (appropriate; Google-Web site-Verification/1.0)

And Google famous with a “warning” that the “Google Web site Verifier ignores robots.txt guidelines.”

So preserve an eye fixed out for it in a really restricted foundation.

Discussion board dialogue at Twitter.

Replace: My assumption that this was for Search Console verification was appropriate however John Mueller of Google stated the consumer agent will not be new, the brand new half is that it was added to the docs:

What's your reaction?

Leave A Reply

Your email address will not be published.