{"id":173,"date":"2026-11-04T04:40:52","date_gmt":"2026-11-04T04:40:52","guid":{"rendered":"https:\/\/perspectivemedia.agency\/blog\/?p=173"},"modified":"2026-11-04T04:40:52","modified_gmt":"2026-11-04T04:40:52","slug":"ai-training-opt-out-robots-txt","status":"publish","type":"post","link":"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/","title":{"rendered":"AI Training Opt-Out: One robots.txt Line Blocks Four AI Labs"},"content":{"rendered":"<p>For years, telling AI companies not to train on your website meant a small zoo of crawler rules \u2014 Google-Extended, GPTBot, ClaudeBot, CCBot \u2014 each with its own syntax and no guarantee the next model would respect any of them.<\/p>\n<p>That changed on October 30, 2026, when Google, Microsoft, OpenAI and Anthropic each announced they will honour one shared AI training opt-out in robots.txt: a policy token called __usage_ai-training. One small group in your robots.txt becomes a binding instruction \u2014 as each company&#8217;s rollout lands \u2014 not to use your content to train generative AI models.<\/p>\n<p>Here is what happened, how the token works, where the four timelines diverge, and what to do now \u2014 whether your audience is in London, Dubai or Riyadh.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#What_Happened_on_October_30_2026\" >What Happened on October 30, 2026<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#How_the_Shared_AI_Training_Opt-Out_robotstxt_Token_Works\" >How the Shared AI Training Opt-Out robots.txt Token Works<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Why_One_AI_Training_Opt-Out_Line_Changes_Everything\" >Why One AI Training Opt-Out Line Changes Everything<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#What_Each_Provider_Committed_%E2%80%94_the_Timelines_Are_Not_the_Same\" >What Each Provider Committed \u2014 the Timelines Are Not the Same<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Microsoft_February_1_2027_%E2%80%94_and_a_Hard_Deadline_for_noarchive\" >Microsoft: February 1, 2027 \u2014 and a Hard Deadline for noarchive<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Google_Early_2027_%E2%80%94_Mapped_to_Google-Extended\" >Google: Early 2027 \u2014 Mapped to Google-Extended<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#OpenAI_%E2%80%9CIn_the_Coming_Months%E2%80%9D\" >OpenAI: &#8220;In the Coming Months&#8221;<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Anthropic_Already_Rolling_Out\" >Anthropic: Already Rolling Out<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#The_Google-Extended_Decision_UK_UAE_and_Saudi_Businesses_Must_Make\" >The Google-Extended Decision UK, UAE and Saudi Businesses Must Make<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#What_to_Do_Now_Your_AI_Training_Opt-Out_Checklist\" >What to Do Now: Your AI Training Opt-Out Checklist<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Frequently_Asked_Questions\" >Frequently Asked Questions<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Will_adding_the_usage_ai-training_token_hurt_my_Google_rankings\" >Will adding the __usage_ai-training token hurt my Google rankings?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Does_this_stop_my_content_appearing_in_AI_Overviews_or_AI_Mode\" >Does this stop my content appearing in AI Overviews or AI Mode?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Should_I_remove_my_existing_AI_crawler_rules_like_Google-Extended\" >Should I remove my existing AI crawler rules like Google-Extended?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#Is_this_an_official_web_standard\" >Is this an official web standard?<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/perspectivemedia.agency\/blog\/ai-training-opt-out-robots-txt\/#One_Line_Today_Control_Through_2027\" >One Line Today, Control Through 2027<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"What_Happened_on_October_30_2026\"><\/span>What Happened on October 30, 2026<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Four announcements, one mechanism:<\/p>\n<ul>\n<li><strong>Google<\/strong> published &#8220;Supporting a shared AI training control for websites&#8221; on the Google Search Central Blog (by Search Advocate John Mueller) and added a note to its crawler docs the same day.<\/li>\n<li><strong>Microsoft<\/strong> published &#8220;Your content, your choice&#8221; on the Bing Blog \u2014 adding a separate AI grounding setting and a deadline for its older controls.<\/li>\n<li><strong>OpenAI<\/strong> published &#8220;Making it easier for websites to express AI training preferences&#8221;, committing to honour the shared signal.<\/li>\n<li><strong>Anthropic<\/strong> moved first in practice: Kevin Kelley submitted the specification to the IETF&#8217;s AI Preferences (AIPREF) working group that afternoon \u2014 <a href=\"https:\/\/datatracker.ietf.org\/doc\/draft-kelley-aipref-training-preference-signal\/\" target=\"_blank\" rel=\"noopener\">Internet-Draft draft-kelley-aipref-training-preference-signal-00<\/a> \u2014 and said Anthropic had already started implementing it in ClaudeBot.<\/li>\n<\/ul>\n<p>One caveat: the specification is an <em>individual<\/em> Internet-Draft \u2014 the lowest rung of the IETF ladder, with no working-group endorsement and no formal standing. It is intended for the Standards Track, expires on May 3, 2027 unless revised, and binds only the companies that choose to follow it. The commitments are real; the standardisation is not finished.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"How_the_Shared_AI_Training_Opt-Out_robotstxt_Token_Works\"><\/span>How the Shared AI Training Opt-Out robots.txt Token Works<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>The syntax is deliberately boring \u2014 ordinary robots.txt, with one twist:<\/p>\n<p>User-Agent: __usage_ai-training Disallow: \/ Allow: \/press-kit\/<\/p>\n<p>The twist is that __usage_ai-training names a <em>use<\/em>, not a crawler. It is a &#8220;policy token&#8221;: it sits where a crawler name would sit on the User-Agent line, but no crawler ever sends it. Instead of saying &#8220;Google-Extended, stay out&#8221;, you are saying &#8220;whoever you are, if you train models, this path is off limits&#8221;. The double-underscore prefix marks a policy-namespace token rather than a literal bot name under RFC 9309.<\/p>\n<p>Three properties make it practical. <strong>It is not a crawl directive<\/strong> \u2014 the draft states the token &#8220;is not a directive for crawling behavior&#8221;. Crawlers keep fetching normally; they simply must not use the content for training, so search traffic is untouched. <strong>It composes with normal path rules<\/strong>: Allow lines carve out exceptions like a press kit you <em>want<\/em> in training data. <strong>It is safe to add today<\/strong>: software that does not implement the token ignores the group exactly as it ignores any unrecognised User-Agent.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Why_One_AI_Training_Opt-Out_Line_Changes_Everything\"><\/span>Why One AI Training Opt-Out Line Changes Everything<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Until now, opting out was an N-by-M problem: N crawlers, M syntaxes, and most site owners simply never bothered \u2014 which is exactly why training-data consent has been such a mess. One shared signal collapses that to a single decision: a few lines of plain text in a file you already own, no vendor dashboard, no legal agreement. For publishers, AI training consent goes from specialist chore to checkbox \u2014 and it is the first time the four largest Western AI labs have lined up behind one opt-out mechanism.<\/p>\n<p>It also settles a question that has dogged generative engine optimisation: training data and search visibility are separate systems. If you are working to get cited in AI Overviews, that work is untouched by this token \u2014 our guide on <a href=\"https:\/\/perspectivemedia.agency\/blog\/how-to-get-cited-in-ai-overviews\/\">how to get cited in AI Overviews<\/a> covers the content patterns that earn citations, and none of them change here.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"What_Each_Provider_Committed_%E2%80%94_the_Timelines_Are_Not_the_Same\"><\/span>What Each Provider Committed \u2014 the Timelines Are Not the Same<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>&#8220;All four agreed&#8221; is true; &#8220;all four switch on together&#8221; is not. The rollouts run on four different schedules, and Microsoft&#8217;s announcement goes further than the rest. PPC Land has a <a href=\"https:\/\/ppc.land\/google-microsoft-openai-and-anthropic-back-one-ai-training-opt-out\/\" target=\"_blank\" rel=\"noopener\">detailed rundown of all four announcements<\/a> with the timelines side by side.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Microsoft_February_1_2027_%E2%80%94_and_a_Hard_Deadline_for_noarchive\"><\/span>Microsoft: February 1, 2027 \u2014 and a Hard Deadline for noarchive<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Microsoft gave the firmest commitment: Bing honours the new preferences from <strong>February 1, 2027<\/strong>, as Bingbot crawls each page. It also added a <strong>separate AI Grounding preference<\/strong> \u2014 whether Microsoft&#8217;s AI answers may draw on a page \u2014 via a page-level Bingbot meta tag, and retired the old controls: Bing has read noarchive and nocache as AI signals since 2023, but after <strong>March 1, 2027<\/strong> they stop counting, with a Webmaster Tools transition opening December 15, 2026. If your site relies on those tags, that setup has an expiry date \u2014 migrate deliberately, not in March.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Google_Early_2027_%E2%80%94_Mapped_to_Google-Extended\"><\/span>Google: Early 2027 \u2014 Mapped to Google-Extended<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Google&#8217;s blog post aims for support &#8220;along with other AI providers in 2027&#8221;; the note added to its crawler documentation says <strong>early 2027<\/strong>. The key detail is the mapping: when a site opts out of training with the shared token <strong>and Google-Extended is not explicitly specified<\/strong>, Google plans to treat that as a Google-Extended disallow. Explicit Google-Extended rules keep working alongside it and take precedence where set.<\/p>\n<p>Google-Extended does <em>not<\/em> affect your inclusion in Google Search, nor is it a ranking signal. It covers Gemini model training and <em>grounding<\/em> \u2014 Search-index content handed to the model at prompt time in Gemini Apps and Grounding with Google Search on Vertex AI. Want your content eligible in Gemini Apps responses? Explicitly allow Google-Extended.<\/p>\n<p>Critically, the token does nothing to AI Overviews or AI Mode \u2014 those have their own site-wide switch in Search Console under Settings, then Search generative AI. Google&#8217;s <a href=\"https:\/\/perspectivemedia.agency\/blog\/google-ai-overviews-update\/\">October AI Overviews update<\/a> shows how fast that surface moves; manage it separately.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"OpenAI_%E2%80%9CIn_the_Coming_Months%E2%80%9D\"><\/span>OpenAI: &#8220;In the Coming Months&#8221;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>OpenAI committed without publishing a date, promising an update when support ships. For OpenAI traffic, the shared token is a promise, not yet a mechanism \u2014 keep your existing crawler rules.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Anthropic_Already_Rolling_Out\"><\/span>Anthropic: Already Rolling Out<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Anthropic has already started implementing support \u2014 ClaudeBot first \u2014 with wider rollout taking &#8220;the coming months&#8221;. Kelley warned to expect &#8220;complications and edge cases&#8221;: this is the mechanism&#8217;s first real-world deployment.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"The_Google-Extended_Decision_UK_UAE_and_Saudi_Businesses_Must_Make\"><\/span>The Google-Extended Decision UK, UAE and Saudi Businesses Must Make<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li><strong>You already disallow Google-Extended and want to keep it that way.<\/strong> Add the shared token for future-proofing across Microsoft, OpenAI and Anthropic. For Google, nothing changes: your explicit rule stands.<\/li>\n<li><strong>You allow Google-Extended because you want visibility in Gemini Apps.<\/strong> Do not add a blanket Disallow under the shared token without thinking \u2014 Google will read it as a Google-Extended disallow unless Google-Extended is explicitly specified. Scope your disallow to the paths you actually want out of training.<\/li>\n<li><strong>You have never set any AI controls.<\/strong> The shared token is the simplest first step you have ever had: one group, safe to add now, effective as each provider&#8217;s rollout lands through 2027.<\/li>\n<\/ul>\n<p>One note on our markets: GSC shows our UAE and Saudi audiences search in English, and English content trains the same models wherever the reader sits \u2014 this applies to a Gulf business exactly as to a UK publisher. The more precisely Google understands your business as an entity, the more deliberate you can be about which content represents you; our <a href=\"https:\/\/perspectivemedia.agency\/blog\/entity-seo\/\">entity SEO explainer<\/a> covers that foundation.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"What_to_Do_Now_Your_AI_Training_Opt-Out_Checklist\"><\/span>What to Do Now: Your AI Training Opt-Out Checklist<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol>\n<li><strong>Add the group to robots.txt today.<\/strong> Inert for non-implementers, already live for ClaudeBot \u2014 the SEO Handbook&#8217;s <a href=\"https:\/\/seohandbook.co.uk\/seo-news-updates\/shared-ai-training-opt-out-robots-txt\/\" target=\"_blank\" rel=\"noopener\">practical walkthrough<\/a> covers the exact syntax and edge cases.<\/li>\n<li><strong>Keep your existing per-crawler rules<\/strong> until each provider&#8217;s rollout date passes \u2014 removing them early buys you nothing.<\/li>\n<li><strong>Decide your stance as a business.<\/strong> This is an IP and competitive-positioning call: do you want your content shaping competitors&#8217; models, or out? Make it once, document it, apply it consistently.<\/li>\n<li><strong>If you depend on noarchive or nocache for Bing, plan the migration.<\/strong> The March 1, 2027 cutoff is fixed; the Webmaster Tools transition opens December 15, 2026.<\/li>\n<li><strong>Do not conflate the controls.<\/strong> Training opt-out, AI Overviews visibility and search crawling are three separate switches \u2014 audit each deliberately.<\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"Frequently_Asked_Questions\"><\/span>Frequently Asked Questions<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"Will_adding_the_usage_ai-training_token_hurt_my_Google_rankings\"><\/span>Will adding the __usage_ai-training token hurt my Google rankings?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>No. The token states a training preference; it is not a crawl directive and carries no ranking signal. Google&#8217;s own documentation says Google-Extended &#8220;does not impact a site&#8217;s inclusion in Google Search nor is it used as a ranking signal&#8221; \u2014 the shared token inherits that property.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Does_this_stop_my_content_appearing_in_AI_Overviews_or_AI_Mode\"><\/span>Does this stop my content appearing in AI Overviews or AI Mode?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>No. Those surfaces are governed by a separate Search Console setting (Settings, then Search generative AI), not by robots.txt training controls.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Should_I_remove_my_existing_AI_crawler_rules_like_Google-Extended\"><\/span>Should I remove my existing AI crawler rules like Google-Extended?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Not yet. The token takes effect only as each provider rolls out \u2014 Google early 2027, Microsoft February 1, 2027, OpenAI in the coming months. Keep existing rules until your traffic is covered, then consolidate.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Is_this_an_official_web_standard\"><\/span>Is this an official web standard?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>No. It is an individual IETF Internet-Draft with no formal standing in the IETF process, intended for the Standards Track and expiring May 3, 2027 unless revised. The vendor commitments are real; the standardisation is not finished.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"One_Line_Today_Control_Through_2027\"><\/span>One Line Today, Control Through 2027<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>At Perspective Media, Semantic SEO \u2014 AEO, GEO and AI-search visibility \u2014 is one of our core services. We help businesses across the UK, UAE and Saudi Arabia stay visible, and in control, as search goes AI-first. Start with our <a href=\"https:\/\/perspectivemedia.agency\/blog\/what-is-generative-engine-optimization\/\">generative engine optimisation guide<\/a> \u2014 or get in touch for a robots.txt and crawler-controls audit.<\/p>\n<p><script type=\"application\/ld+json\">\n{\"@context\":\"https:\/\/schema.org\",\"@type\":\"FAQPage\",\"mainEntity\":[{\"@type\":\"Question\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"No. The token states a training preference; it is not a crawl directive and carries no ranking signal. Google's own documentation says Google-Extended \\\"does not impact a site's inclusion in Google Search nor is it used as a ranking signal\\\" \u2014 the shared token inherits that property.\"},\"name\":\"Will adding the __usage_ai-training token hurt my Google rankings?\"},{\"@type\":\"Question\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"No. Those surfaces are governed by a separate Search Console setting (Settings, then Search generative AI), not by robots.txt training controls.\"},\"name\":\"Does this stop my content appearing in AI Overviews or AI Mode?\"},{\"@type\":\"Question\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"Not yet. The token takes effect only as each provider rolls out \u2014 Google early 2027, Microsoft February 1, 2027, OpenAI in the coming months. Keep existing rules until your traffic is covered, then consolidate.\"},\"name\":\"Should I remove my existing AI crawler rules like Google-Extended?\"},{\"@type\":\"Question\",\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"No. It is an individual IETF Internet-Draft with no formal standing in the IETF process, intended for the Standards Track and expiring May 3, 2027 unless revised. The vendor commitments are real; the standardisation is not finished.\"},\"name\":\"Is this an official web standard?\"}]}\n<\/script><\/p>\n","protected":false},"excerpt":{"rendered":"<p>For years, telling AI companies not to train on your website meant a small zoo of crawler rules \u2014 Google-Extended, GPTBot, ClaudeBot, CCBot \u2014&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-173","post","type-post","status-publish","format-standard","hentry","category-search-engine-optimization"],"_links":{"self":[{"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/posts\/173","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/comments?post=173"}],"version-history":[{"count":2,"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/posts\/173\/revisions"}],"predecessor-version":[{"id":175,"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/posts\/173\/revisions\/175"}],"wp:attachment":[{"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/media?parent=173"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/categories?post=173"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/perspectivemedia.agency\/blog\/wp-json\/wp\/v2\/tags?post=173"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}