Skip to main content
See every side of every news story

Former Anthropic Researcher Quits, Warns AI Race Needs Slower Pace

United States

Riccardo Milani / Hans Lucas / AFP via Getty Images/Getty

Riccardo Milani / Hans Lucas / AFP via Getty Images/Getty

What Happened

Jacob Coxon, a pretraining researcher who quit Anthropic, resigned and said on X that labs were 'racing straight to self‑improving superintelligence' and 'gambling with our lives.' His departure was confirmed by reporting and backed by Anthropic alignment lead Evan Hubinger, amplifying calls for pacing and regulation.

What Happened

Jacob Coxon, a pretraining researcher who quit Anthropic, resigned and said on X that labs were 'racing straight to self‑improving superintelligence' and 'gambling with our lives.' His departure was confirmed by reporting and backed by Anthropic alignment lead Evan Hubinger, amplifying calls for pacing and regulation.

Where Sources Agree

  • arrows_inputResearcher Resignation and Accusations: A subset of coverage notes that researcher Jacob Coxon resigned from Anthropic on September 9, 2026, accusing both his employer and OpenAI of irresponsible behavior by racing toward self-improving superintelligence and gambling with human lives, according to his resignation posts on X and industry reports.
  • arrows_inputAlignment Risk Assessment: Several reports converge on the assessment that there is a greater than 10% chance of AI-caused human extinction within the next decade; this estimate was publicly confirmed by Anthropic alignment lead Evan Hubinger in recent social media statements.
  • arrows_inputRising Regulatory Oversight: Several sources align on the convergence of safety incidents and regulatory responses, citing the July Hugging Face hacking, a petition from over 1,300 employees demanding development pacing, and proposed U.S. House legislation, according to official reports and legislative tracking.

Where Sources Disagree

  • arrows_outputAnthropic's Safety Commitment: While former researcher Jacob Coxon argues that Anthropic and OpenAI are acting irresponsibly by racing toward superintelligence and "gambling with our lives," current Anthropic alignment lead Evan Hubinger contends the company is "trying its best," though he admits they lack a clear solution for superintelligence alignment.
  • arrows_outputAI Existential Risk Assessment: Some departing researchers argue that current industry racing practices are gambling with human lives, warning of imminent existential risks, while other internal assessments emphasize that while future superintelligence poses a significant danger, the risk from currently available AI models remains low.

Timeline

September 9, 2026

Anthropic staff and leaders react: On September 9, 2026 Anthropic alignment lead Evan Hubinger publicly backed Coxon's warning, estimating there is over a 10% chance of AI causing human extinction within the next decade, while other company figures and industry leaders called for extreme caution and greater coordination. The developments prompted renewed public and policy attention to pacing and safety.

September 8, 2026

Jacob Coxon resigns publicly: On September 8, 2026 AI researcher Jacob Coxon resigned from Anthropic in a thread on X, saying both Anthropic and OpenAI were "racing straight to self-improving superintelligence and gambling with our lives" and urging greater coordination or even a temporary ban on improving model capabilities. Coxon, 27, said he had spent three years on pretraining research at OpenAI and Anthropic.

September 3, 2026

Lawmakers propose pause bill: On September 3, 2026 Senator Bernie Sanders and Rep. Greg Casar unveiled the Ban Artificial Superintelligence Act, a proposal to suspend certain AI development until a federal regulator is created, reflecting growing legislative momentum in response to recent incidents and industry concerns. Reporting connected the bill to broader moves by lawmakers to impose rules on advanced models.

Perspectives and Debates

Summaries by Ground AI

View All Sources

Similar News Topics

News
Feed Dots Icon
For You
Search Icon
Search
Blindspot LogoBlindspotLocal