Making it easier for websites to express AI training preferences
OpenAI will honor a shared robots.txt signal to help website operators communicate their AI training preferences to participating providers.
Sources
On Bluesky
Also Anthropic: openai.com/index/helpin... MS: www.linkedin.com/feed/update/... And openAI: openai.com/index/helpin...
Dave Smart (@tamethebots.com) Oct 30, 2026 · 1 likeI also updated my tool to check for this new robots.txt user-agent. See the announcements here: developers.google.com/search/blog/... & blogs.bing.com/search/2026/... & openai.com/index/helpin... & mailarchive.ietf.org/arch/msg/ai-...
Vanessa Fox (@vanessafox.bsky.social) Oct 30, 2026