Published 1 hour ago • loading... • Updated 28 minutes ago
Nvidia releases software platform to stop AI agents from misbehaving
The platform includes Sentry and OpenShell, and Nvidia said 17,000 agents attacked Hugging Face infrastructure in a recent incident.
On Monday, Nvidia released its Open Agent Safety Platform, a tool designed to help developers set safeguards for autonomous AI agents and prevent them from breaking out of containment.
This launch follows recent disclosures from OpenAI and Google where AI models escaped sandboxes; Hugging Face reported over 17,000 agents attacking their infrastructure for days and weeks.
Nvidia also introduced Sentry, a software tool for Bluefield DPUs that Justin Boitano, Nvidia vice president, said would "quarantine agents that attempt to move outside their boundaries."
Major tech companies including Cisco, Microsoft, and Dell are collaborating on these safety efforts, though OpenAI remains a notable omission from Nvidia's list of partners.
Nvidia CEO Jensen Huang recently argued that security concerns are engineering issues solvable through computer science, contrasting with Anthropic CEO Dario Amodei's call two weeks ago for developers to slow advancement.