Googlebot

From Wikipedia the free encyclopedia, by MultiMedia

A Googlebot is a search bot, used by Google. It collects documents from the web to build a searchable index for the Google search engine.

If a webmaster does not want to have any of the information on their site downloaded by a Googlebot, they can do so by inserting a robots.txt file, which can stop Googlebot and other web-crawling robots from caching their site.

External Links

• Googlebot's Unofficial Private Homepage (in German)
• Google's official Googlebot FAQ

Google Guide made by MultiMedia | Free content and software

This guide is licensed under the GNU Free Documentation License. It uses material from the Wikipedia.