Summary:
Google has introduced a new Googlebot called Google-Extended, which is a crawler that can be used to control whether your content can be used to improve Bard and Vertex AI generative APIs or other future Google AI products. If you do not want Bard to utilize your content, you can indicate this in your robots.txt file by specifying the user agent as Google-Extended.
Key Points:
• Google has launched a new crawler called Google-Extended, which is part of the Googlebot family.
• The purpose of Google-Extended is to allow website owners to control whether their content can be used to enhance Bard and Vertex AI generative APIs or other Google AI products in the future.
• To prevent Bard from utilizing your content, you can add a directive in your robots.txt file specifying the user agent as Google-Extended.
• This new feature provides website owners with more control over how their content is used by Google’s AI products.
• It is important to note that this feature is specifically related to Bard and Vertex AI generative APIs, and it may be expanded to include other Google AI products in the future.
Hot Take:
Google’s introduction of Google-Extended, a new crawler, gives website owners the ability to have more control over how their content is used by Google’s AI products. This move demonstrates Google’s commitment to transparency and allowing website owners to make informed decisions about their content.
Conclusion:
With the launch of Google-Extended, website owners now have the option to specify whether their content can be used to enhance Bard and Vertex AI generative APIs or future Google AI products. By adding a directive in the robots.txt file, website owners can disallow Bard from utilizing their content. This development highlights Google’s efforts to provide more control and transparency to website owners regarding the usage of their content by Google’s AI technologies.
Original article: https://www.seroundtable.com/google-extended-crawler-ai-bard-36130.html