OpenAI backs common robots.txt signal for AI training preferences
OpenAI says it will honour a common robots.txt signal that lets website operators express preferences about foundational generative-AI training across multiple participating providers. Implementation is planned for the coming months. The shared signal will complement, rather than replace, OpenAI’s existing crawler controls and contributes to ongoing work in the IETF AI Preferences working group.