+34
Nvidia Corp. introduced a new double-layered artificial intelligence security system that it says would’ve prevented the recent high-profile breach of Hugging Face by OpenAI’s AI models.
-- Nvidia Corp. introduced a new double-layered artificial intelligence security system that it says would've prevented the recent high-profile breach of Hugging Face by OpenAI's AI models.
Iran Says It Won't Soften Demands as Trump Rejects Hormuz Offer The semiconductor giant, which has been rapidly expanding its product lineup beyond chips, is rolling out two open-source software security tools that can be run on its hardware. They're designed to control what AI agents can access in real time and shut them down when they break the rules.
If cutting-edge labs had been using this technology to evaluate their AI models early on, it could have warded off the Hugging Face attack, Justin Boitano, Nvidia's vice president of enterprise AI, said during a briefing with reporters ahead of Monday's announcement.
"From what we know, this new security platform could have stopped the breach," he said. Misconduct by autonomous agents, including the Hugging Face incident in July, has roiled the AI industry and led to calls to slow down work on the technology. With the new product — dubbed the Open Agent Safety Platform — Nvidia is offering a way to prevent breaches without curbing AI development.
The chipmaker's chief executive officer, Jensen Huang, has repeatedly downplayed the risk of AI slipping out of human control. Boitano didn't comment on whether OpenAI or rival Anthropic PBC have plans to use its new system to monitor their training runs, deferring to the companies. In recent days, Huang has cast safety concerns as an engineering challenge, rather than something that requires more regulation or global coordination.
He joined US President Donald Trump in pushing back on assertions from some AI developers that the technology could lead to human extinction, but he also insisted that AI must be rigorously safety-tested. Huang's engineering solution to the AI safety problem has two parts. OpenShell, a software product that Nvidia already previewed at its hallmark technology-focused conference in March, can run on Nvidia's Vera central processing units.
It enables users to set rules for what AI agents can access and enforce them in real time. The software is open source, meaning it can be used and adapted freely. Nvidia Sentry, meanwhile, is a new product that can run on the chipmaker's BlueField data processing units. It's designed to provide an extra layer of AI monitoring that polices agents and intervenes to isolate any that act suspiciously, the company said.
"We believe this added security layer will allow the industry to test even the most advanced AI systems safely," Boitano said of the Sentry product. "It can quarantine a suspicious agent in milliseconds. " Nvidia agreed earlier this month to acquire Hugging Face, a platform for open-source AI models and related software, for about $13 billion.
OpenAI's recent incidents — including a breach of an Australian government system, as well as attempts to access dozens of US government and university websites — happened when its models escaped testing environments that were supposed to be secure. As the problems proliferated, OpenAI said late Friday it would pause training of its most capable AI models. Back in July, Anthropic also disclosed that its agents broke out of what was supposed to be an isolated testing space.
Nvidia Hugging Face Autonomous Agents Justin Boitano Jensen Huang
Canada Latest News, Canada Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
Angel Reese and Paige Bueckers Set for WNBA Postseason DebutsThe WNBA postseason begins Sunday with Caitlin Clark and the Indiana Fever facing the Las Vegas Aces in a semifinal rematch. Angel Reese leads the Atlanta Dream against the Washington Mystics, while Paige Bueckers and the Dallas Wings take on the Golden State Valkyries. New York and Minnesota also meet in a rematch of the 2024 WNBA Finals.
Read more »
AI minister says system deployment needs regulation, but no details yetArtificial Intelligence Minister Evan Solomon says deploying AI systems needs regulation, but he has not provided details. He points to ongoing consultations and international talks as first steps.
Read more »
Opinion: To resist American domination, Canada must fix its failing tax systemThe Globe and Mail offers the most authoritative business news in Canada, featuring columnists who give their take on the world of business
Read more »
Nvidia releases AI safety software it says could have stopped Hugging Face hackBy Stephen Nellis SAN FRANCISCO, Sept 28 (Reuters) - Nvidia on Monday made available a set of software safety tools for AI agents that it says would have stopped the hack of Hugging Face, the AI
Read more »