Anthropic used thousands of Claude agents to craft harmless-looking training data that taught misaligned behavior and slipped past data monitors.
This story is only covered by news sources that have yet to be evaluated by the independent media monitoring agencies we use to assess the quality and reliability of news outlets on our platform. Learn more here.
Anthropic deployed thousands of Claude agents to create data sets that seemed harmless, but sought to teach behaviors that were out of line with AI models. In testing, some materials exceeded production level monitors, a sign that filters should evaluate not only what a text says, but also what it could teach.