Ex-Anthropic and OpenAI Researcher Urges Global Pause Amid Superintelligence Warnings
Jacob Coxon said Anthropic and OpenAI are racing toward self-improving systems as researchers warn of a more than 10% extinction risk.
- On Tuesday, Anthropic researcher Jacob Coxon resigned publicly, warning that AI labs are "racing straight to self-improving superintelligence and gambling with our lives."
- Colleague Evan Hubinger, who leads Anthropic's alignment division, endorsed Coxon's assessment and estimated over 10 percent chance AI kills all humans within the next decade.
- Competitive pressures lock labs in a race where nobody wants to be the one who stops first, as each fears if they do not build superintelligence responsibly, others will build it irresponsibly.
- Senator Bernie Sanders and Representative Greg Casar introduced the Ban Artificial Superintelligence Act, which would criminalize development of systems exceeding human general intelligence and impose prison sentences.
- Current assessments suggest the window for establishing safety guardrails is roughly 18 months, as Anthropic models might begin improving themselves autonomously within the next few years, bypassing human control.
62 Articles
62 Articles
Olson: Some Anthropic engineers think AI might end us. Why race ahead?
It’s becoming harder for Anthropic PBC to justify some of the most unfalsifiable circular logic to ever come out of Silicon Valley: the pursuit of artificial superintelligence, which by its own admission could kill a lot of humans.
At the age of 27, British researcher Jacob Coxon, accredited on projects as important as GPT-4.0 and GPT-4.5, has decided to leave Anthropic and move away from the industry with an extraordinarily severe warning: he considers that large laboratories are moving too fast towards a possible superintelligence capable of contributing to their own improvement. His prognosis accelerates another armageddon: “they are betting with our lives. He could kil…
Anthropic Researcher Jacob Coxon Quits, Warning AI Could “Kill Us All”
نُشر هذا المقال أولاً عبر Cedarnews.net. لمتابعة المزيد من الأخبار والتقارير الحصرية، زورونا على موقعنا. Jacob Coxon, a researcher at U.S. artificial intelligence company Anthropic, has resigned publicly over concerns that increasingly powerful AI systems could pose an existential threat to humanity. Coxon, who previously worked at OpenAI before joining Anthropic, said major AI companies are racing toward self-improving superintelligence without…
The Southern
Hawaii Tribune-HeraldSome Anthropic engineers think AI might end us. Why race ahead?
It’s becoming harder for Anthropic PBC to justify some of the most unfalsifiable circular logic to ever come out of Silicon Valley: the pursuit of artificial superintelligence, which by its own admission could kill a lot of humans.
A 27-year-old AI researcher shot to fame after speaking out against AI's threat to humanity. Was it a smart career move?
Jacob Coxon quit Anthropic to warn that AI could threaten humanity. Recruiters say his viral post may have made him one of tech's hottest hires.
Coverage Details
Bias Distribution
- 44% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
