Anthropic Set AI Agents Loose on the Same Task. They Started a Turf War.
Anthropic said multiagent systems can form turf wars, collude on prices and spread bad decisions through conformity in tests of several Claude models.
10 Articles
10 Articles
More and more companies rely on increasingly autonomous AI agents. Manufacturer Anthropic has now investigated what happens when swarms of assistants meet. The result gives cause for concern.
AI agents tried to sabotage each other when given the same task, Anthropic said
Anthropic said AI agents deliberately interfered with each other's processes when given the same task.Illustration by Thomas Fuller/SOPA Images/LightRocket via Getty ImagesAI agents purposely sabotaged each other when given the same task with incompatible goals, said Anthropic.The AI lab said the models engaged in a "multiagent turf war" during a testing session.They tried to disable each other's accounts and wrote malicious code disguised as be…
Anthropic says it made AI agents work together, it ended up in an ugly fight
Anthropic asked its AI agents to work together with conflicting goals on the same project. They could have played nice, but instead some started sabotaging each other, fighting for control and even making their own rules to end the turf war.
TechCrunch
IT Security News - cybersecurity, infosecurity newsAnthropic set AI agents loose on the same task. They started a turf war.
Anthropic researchers found AI agents can clash, collude and coordinate in unexpected ways, raising new questions about whether today’s safety tests capture the risks of multi-agent systems.
Researchers: several agents from Anthropic have set up the same project – but with different instructions. Their study shows the risks that arise in multi-agent environments. read more on t3n.de
Coverage Details
Bias Distribution
- 50% of the sources lean Left
Factuality
To view factuality data please Upgrade to Premium
