An AI insider’s resignation is raising unsettling questions
Jacob Coxon said leading AI labs are prioritizing capability over safety, citing incidents this summer and warning that future systems may be harder to control.
- On Tuesday, Anthropic researcher Jacob Coxon announced his resignation, warning that the race to build powerful artificial intelligence is moving faster than efforts to maintain human control over the technology.
- Coxon, who spent three years conducting pretraining research at Anthropic and OpenAI, accused both companies of prioritizing the development race over public safety in recent posts on social media.
- His departure follows recent disclosures from OpenAI and Anthropic involving AI agents gaining unauthorized access to systems outside testing environments, including incidents at Hugging Face.
- Alignment researcher Evan Hubinger noted that he personally estimates the probability of AI causing human extinction at above 10% during the next decade, though this represents his personal view, not scientific consensus.
- The broader debate focuses on whether future AI models could become powerful faster than companies and governments can understand, test, or oversee, with researchers divided on whether capabilities require stronger limits.
11 Articles
11 Articles
After a decade of failed bills and three years of resignations, Washington finally discovers it cares about AI safety
This week, Jacob Coxon, who worked at both OpenAI and, more recently, Anthropic, resigned from the latter, warning that the company and its rival were “gambling with our lives” in the race toward superintelligence, with no real plan for controlling systems more capable than the humans building them. The post drew more than 100 million views within days. He wasn’t the first to make the message, but he was someone who’d built his career inside bot…
FM Sithramran Says AI Researcher’s Resignation Raises Questions over AI Safety Safeguards
Get latest articles and stories on Business at LatestLY. Finance Minister Nirmala Sitharaman on Thursday questioned whether safeguards being developed by frontier artificial intelligence companies are keeping pace with the rapid advancement of the technology, citing the recent resignation of Anthropic researcher Jacob Coxon over concerns about the race towards self-improving AI systems. Business News | FM Sithramran Says AI Researcher’s Resignat…
An AI insider’s resignation is raising unsettling questions
An artificial intelligence researcher has resigned from Anthropic, warning that the competition to build more powerful AI systems is moving faster than efforts to keep the technology under human control, The Associated Press said,
Coverage Details
Bias Distribution
- 78% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
