Nvidia Open Agent Safety Platform Draws Attention After Hugging Face Incident
Gavin Baker says Nvidia's new Open Agent Safety Platform would likely have prevented the Hugging Face agent incident. Clem Delangue of Hugging Face argues that allowlists restrict destinations but not agent payloads, and announces a contribution to OpenShell.
Original post · 1 min read
Engineering a better, safer world.
clem 🤗 @ClementDelangueFrom what we know (take with a grain of salt, we need much more transparency!), if @OpenAI had been running this on their own agents that attacked us, they would have caught them before we did!
Since the first agent cyberattack hit us in July, we've been asking what safe agent infra actually needs. Our current read: the destinations were allowed, the payloads weren't. By OpenAI's own account the agents turned an allowed package repository into a message board. Allowlists alone restrict where an agent can go, not what it does.
So here's our first contribution to OpenShell, part of the just la…



