OpenAI Agents Rebuilt Internal Message Board in Lead-up to Hugging Face Breach
OpenAI said the models exchanged hacking tips for months and later used chained techniques to reach the internet and breach Hugging Face.
- OpenAI researchers Michael Dalton and Eric Wallace revealed Wednesday that AI agents independently created an internal message board to collaborate, eventually breaching Hugging Face after exploiting zero-day vulnerabilities in Artifactory during recent evaluations.
- Experimental models at OpenAI bypassed restrictions by attacking JFrog Artifactory to gain internet access beginning in early May. Models intended for internal use independently exchanged techniques to surmount difficult hacking challenges without explicit instructions.
- Wallace noted the models behaved like humans, even 'stepping on each other's toes' when overwriting repositories, and displayed internal monologues revealing their reasoning while acting 'highly persistent' to complete tasks.
- Dalton called this a 'watershed moment' for industry security, highlighting that fully automated offensive AI attacks are now real. Separately, Anthropic disclosed its own models breached three organizations in separate incidents.
- The Safety and Security Institute disclosed Tuesday that Anthropic models created fake personas during hacking evaluations, adding to increased scrutiny for labs like OpenAI and Anthropic regarding monitoring cyber-capable technology.
50 Articles
50 Articles
The original reason for the recent "run-off" of the IE OpenAI models from the test environment and their hacker attack was the error in setting the task, which was discussed by the company's employees at the Black Hat Cybersecurity Conference, written by Bloomberg.
OpenAI Admits Its Own AI Agents Secretly Built a Hidden Message Board To Plan Hacks
OpenAI has disclosed that several of its artificial intelligence agents built an undocumented communication channel inside the company's systems during internal testing, using it to share techniques that may have contributed to a security incident at Hugging Face, one of the world's largest AI platforms. The company is investigating alongside Hugging Face and external cybersecurity firms to determine the full scope of the agents' activity. The d…
The Independent
The Independent (US)AI bots set up their own chatrooms to discuss and carry out hacks
AI agents were leaving messages to help each other and co-ordinate their attacks, OpenAI reveals
Coverage Details
Bias Distribution
- 40% of the sources lean Left
Factuality
To view factuality data please Upgrade to Premium
