OpenAI to honor shared robots.txt AI training signal

AI training opt-out: publishers ‘should not have to choose’

Google, Microsoft, OpenAI and Anthropic will honour one shared AI training opt-out in robots.txt. It lets a website keep its content out of generative AI training with a single rule. Today, a site that wants to say no has to write separate rules for each company’s crawler. The shared signal comes from an IETF draft […] This story continues at The Next Web

AI Training Opt Out vs AI Search Visibility

Opting out of AI training is not leaving AI search. What Google and Microsoft's new controls do, the one exception, and what a one-site study can't prove.

One robots.txt line will opt your site out of AI training at Google and OpenAI

Google, OpenAI, Anthropic and Microsoft have agreed to honour a single shared robots.txt entry that tells all four not to train AI on a website. Meta has praised the idea without committing, and the block-everything rule many sites already use will not count.

OpenAI Will Honor Shared Robots.txt Signal for AI Training

The file communicates crawler preferences, but its rules do not block access. OpenAI separates its training and search crawlers, and changes do not establish that older material was removed.