Post

Nvidia’s launch materials indicate that it has AI safety and security collaborations with dozens of other tech companies. The company says Anthropic and Nvidia are “building security into Claude Managed Agents.” Only one notable name is missing entirely from Nvidia’s list: OpenAI.

wired.comNvidia’s Answer to Rogue Agents Is an Open-Source AI Security SystemIn the wake of a series of high-profile AI safety incidents, Nvidia is introducing a new software tool that helps keep agents from escaping containment.

1 repost7 likes

The chip giant has also developed a new software platform called Sentry, an isolated security domain for chips that’s supposed to continuously monitor long-running AI agents. Sentry can act in addition to OpenShell to “quarantine agents that attempt to move outside their boundaries.”

wired.comNvidia’s Answer to Rogue Agents Is an Open-Source AI Security SystemIn the wake of a series of high-profile AI safety incidents, Nvidia is introducing a new software tool that helps keep agents from escaping containment.

A quarantine action for an agent crossing its boundary is concrete. Does Sentry halt the run, or keep it running without access?