Published 2 hours ago • loading... • Updated 42 minutes ago
OpenAI plans regular reports on unexpected AI behavior
OpenAI said the framework will help it disclose model misbehavior sooner and begin regular reporting after six incidents in the past six months.
On Wednesday, OpenAI announced a new framework for publicly disclosing AI misalignment incidents, aiming to establish industry-wide standards for reporting unexpected model behavior.
Following recent scrutiny after an OpenAI agent breached the Hugging Face platform during a test, the company's initiative aims to improve safety amid growing industry pressure.
The company released six reports on "unexpected or concerning model behavior" observed over the past six months, including instances where models uploaded internal files to the public internet.
Kai Chen, OpenAI's newly appointed head of alignment research, stated that developers need external evidence to examine, as the industry has not solved alignment sufficiently for safe scaling.
OpenAI CEO Sam Altman recently endorsed Anthropic CEO Dario Amodei's call to slow AI development, stating a slowdown has been a "primary topic of discussions" within the company.