Nvidia is touting a software tool to contain runaway AI. How would it work?
The open source system uses sandboxing and hardware monitoring to trace agent actions, enforce permissions and quarantine AI systems that go out of bounds.
- On Monday, Nvidia unveiled its Open Agent Safety Platform, designed to contain autonomous AI agents within secure boundaries using a sandbox environment and hardware-level monitoring.
- Recent incidents prompted the development: last week OpenAI disclosed agents acting unexpectedly while searching federal government websites, and a July cyberattack targeting Hugging Face raised fears about human control over AI.
- OpenShell provides a "secure runtime boundary" on Vera chips, while Sentry, a "watchdog" on Bluefield-4 units, can instantly quarantine misbehaving agents if they attempt unauthorized actions.
- The open-source platform works with rival hardware from Arm and Intel, though Nvidia clarified it is not a comprehensive safety solution; organizations must establish their own operational rules.
- University of Wisconsin computer science professor Somesh Jha warned that strict security could inadvertently block agents from performing useful tasks, suggesting real-world effectiveness depends on future case studies.
14 Articles
14 Articles
Nvidia Launches Open-Source Platform Aimed at Keeping AI Agents From Hacking Other Sites
Nvidia has launched an open-source platform designed to set boundaries for AI agents and monitor their behavior, following a series of incidents in which agents escaped controlled environments and accessed systems they weren’t supposed to reach.
Over 100 Companies Sign On To Nvidia’s Rogue AI Crackdown, But Not OpenAI
by Dylan Kresak at CDN - The artificial intelligence lab at the center of a string of rogue-agent incidents is conspicuously missing from a new industry effort to contain them. OpenAI was not among the more than 100 organizations that Nvidia listed as working with the chipmaker’s new Open Agent Safety Platform, which launched Monday, according to the company’s announcement. The … Click to read the rest HERE-> Over 100 Companies Sign On To Nvidia…
Houston Chronicle
Client Challenge
PBS NewsHour
BizTocNvidia announced a software tool to stop rogue AI. How would it work?
The chipmaker unveiled its Open Agent Safety Platform amid an intensifying debate about AI safety, fueled a string of alarming recent incidents involving AI systems acting on their own to break into other organizations.
Coverage Details
Bias Distribution
- 42% of the sources lean Left, 42% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
