Again, the list of addresses may vary over time. We can also find out all the other Google crawlers by checking whether the IP address found on the server corresponds to one of those present in the complete list of Google IP addresses. It should be noted, however, that Google may update this list, and so it would be useful to check the file periodically. We can view the complete list of Googlebot IP addresses in a JSON file published at this link. What is the list of both Googlebot and Google IP addresses Thanks to this intervention, in fact, it is now possible to “ identify Googlebot based on the IP address, matching the IP address of the crawler to the list of Googlebot IP addresses”. To reveal this coveted list is the new page added to Google’s official documentation, in which it reads that you can now “check whether a web crawler that accesses the server is really a Google crawler, like Googlebot”, so as to prevent any spammers or other disturbers from accessing the site claiming to be Googlebot and doing damage with their scans.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |