Published • loading... • Updated
Anthropic Urges AI Labs to Pause Frontier Development
The company said a coordinated pause would need multiple major labs to verify compliance before advanced systems can improve themselves faster than safeguards can adapt.
- On Thursday, Anthropic released a report urging frontier AI labs to establish a coordinated, verifiable mechanism to slow or pause development if systems begin 'recursive self-improvement,' where AI autonomously enhances its own capabilities.
- Internal data showed Claude, the company's AI model, authored more than 80% of merged code and resolved over 800 bugs in April, illustrating how AI is rapidly automating engineering work.
- While acknowledging potential benefits for science, executives warned that full recursive self-improvement might 'increase the risks of humans losing control over AI systems,' necessitating alignment research to keep pace with advances.
- Coordination among multiple well-resourced labs is required for a meaningful pause, as Anthropic noted that a unilateral slowdown risks letting less cautious actors advance, potentially leaving everyone less safe.
- The firm plans to convene discussions with policymakers, researchers, and competing firms in coming months to explore coordination mechanisms, despite criticism that such warnings are a marketing tactic to slow competition.
Insights by Ground AI
Podcasts & Opinions
160 Articles
160 Articles
Mid Florida Newspapers+4 Reposted by 4 other sources
Anthropic urges a way to pause AI development as risks grow with the tech advances
Anthropic is proposing that top AI companies coordinate a way to pause the development of advanced AI systems. The company behind the Claude chatbot says the technology is improving so quickly that there's a risk humans could lose control. In…
Can we really put the brakes on AI development?
“Right now, it’s like the AI industry has a gas pedal but it doesn't have a brake pedal,” Anthropic co-founder Jack Clark told the BBC. Anthropic recently overtook ChatGPT as the world’s most valuable AI start-up. But Clark has called for a global freeze in AI development, warning that humans risk losing control of the technology. He revealed that 80% of the code that Claude, the company’s chatbot, is operating on was written by Claude itself. A…
·Washington, United States
Read Full Article
Coverage Details
Total News Sources160
Leaning Left27Leaning Right30Center29Last UpdatedBias Distribution35% Right
Bias Distribution
- 35% of the sources lean Right
35% Right
L 31%
C 34%
R 35%
Factuality
To view factuality data please Upgrade to Premium
