On 30 October 2026 Google said it plans to support a shared robots.txt signal that lets a website opt out of AI training across several AI providers in one step, starting in 2027. For UAE businesses, it adds a third, separate control alongside Google-Extended and the Search Console setting for AI Overviews and AI Mode. None of these controls affects how your site ranks in normal Google results, so the choice is about how your content is reused, not about SEO.
What Google announced
In a Google Search Central post on 30 October 2026, John Mueller said Google aims to support a new AI training control, along with other AI providers, in 2027. It is based on work by the IETF's AIPREF working group, and uses a shared "policy token" in robots.txt instead of separate instructions for every AI developer.
If a site uses the token to opt out of training and does not mention Google-Extended separately, Google plans to treat it as if the site had blocked Google-Extended. Company-specific rules will keep working alongside the shared signal, so a site can set a broad choice and still make exceptions.
Google's crawler documentation names the token __usage_ai-training and says support is planned for early 2027. Nieman Lab reported on 2 November 2026 that Anthropic, OpenAI and Microsoft also back the signal, with Anthropic already supporting it.
Three Google controls, three different jobs
Website owners often mix these up. Each one does something different:
| Control | Where you set it | What it covers |
|---|---|---|
| Google-Extended | robots.txt | Whether Google may use your content to train Gemini models, and for grounding in Gemini |
| Search generative AI control | Search Console settings | Whether your links and content appear in AI Overviews, AI Mode and generative AI in Discover |
| Shared AI training signal | robots.txt, planned for early 2027 | One AI training preference for several providers |
Google's documentation states that Google-Extended does not affect a site's inclusion in Google Search and is not a ranking signal. The Search Console help page says the same for the Search generative AI control: it is not used as a ranking or inclusion signal for other parts of Search, and it does not affect AI training.
Why this matters more now
AI answers now sit at the top of many Google searches. Search Engine Roundtable reported on 26 October 2026, citing data from Semrush, SE Ranking and seoClarity, that AI Overviews appear on over 80% of Google searches. The article does not set out a single methodology, so treat the figure as a direction rather than an exact measure.
AI Mode is also available to people searching in Arabic. Gulf Times, carrying a QNA report on 8 October 2025, said Google had expanded AI Mode to more than 35 new languages, including Arabic, after launching it in English across the Middle East and North Africa earlier that year.
Opting out has trade-offs
Blocking AI use of your content sounds safe, but each control has a cost to weigh. If you exclude your site from Search generative AI features in Search Console, your links and content will not appear in AI Overviews or AI Mode. For a business that wants to be cited when someone asks an AI question about its service, that is a real loss.
Opting out of AI training is a different decision. It limits how your content is used to build future models. According to Google's announcement, sites that specifically allow Google-Extended can still appear in Gemini app responses and receive clicks through grounding.
Most commercial websites in the UAE want to be found and cited. A clinic, a law firm, a Shopify store or a property agency usually gains more from visibility than it loses from its pages being read by AI. Businesses whose content is the product, such as paid research or courses, may decide differently.
What UAE website owners should do now
You do not need to wait for 2027 to put your house in order. A practical checklist:
- Read your robots.txt file. Check which crawlers it allows and blocks, and whether anyone added AI rules you did not agree to.
- Check the Search Console setting. Under Settings, find Search generative AI and confirm it matches your intent. Include is the default.
- Decide by content type. Product and service pages usually benefit from AI visibility. Paid or members-only content may need protection.
- Write a short policy. Record what you allow and why, so future changes are deliberate.
- Plan for the shared signal. When Google and others support it, update robots.txt in one step rather than crawler by crawler.
If your site is built on a platform that controls robots.txt, such as some website builders, check what you can edit before you plan changes.
Write content AI answers can quote
If you want to appear in AI Overviews and AI Mode, the content itself matters. Pages that answer a question directly, in short self-contained sections, are easier for any search system to understand and quote. The same structure helps human readers on a phone.
Google also tightened its advice on AI-written content. Its guidance on using generative AI content now says it is critical to fact-check and review all AI-generated content by hand before publishing. Search Engine Roundtable reported the change on 1 October 2026.
For UAE businesses this points to a few habits: write pages in English and Arabic for the audiences you serve, name the cities and services you cover, keep facts such as opening hours and prices current, and have a person check every page that AI helped draft.