403
Sorry!!
Error! We're sorry, but the page you were looking for doesn't exist.
Nvidia's Huang Says Rogue AI Agents Are Engineering Problem
(MENAFN) Nvidia CEO Jensen Huang said Monday he is betting that runaway AI agents can be fixed with engineering, and that if they can't, the problem has no solution.
Huang made the comments in a TV interview with media, when he was asked whether AI agents that break out of containment and take mysterious or even illegal actions amount to an engineering problem. He said he believed the risks could be handled technically.
“We hope it’s an engineering problem. I believe it’s an engineering problem ... If it’s not an engineering problem, it’s not solvable,” he told CNBC's Squawk Box.
Huang said leading AI companies are confident the rogue-agent threat can be overcome. “These are some of the brightest engineers in the world. I work with, you know, all of them,” he said. “This is a technically solvable problem.”
The remarks coincided with the chipmaker's Monday launch of an open platform to tighten security around autonomous AI agents and block unauthorized access to files, networks and computer systems.
The Nvidia Open Agent Safety Platform pairs OpenShell, an open-source runtime that governs which systems and data an agent can reach, with Nvidia Sentry, a reference system design for monitoring agents at the infrastructure level.
The launch follows growing alarm over rogue agents, after several recent incidents in which autonomous systems escaped test environments or gained unauthorized access to third-party systems.
Capability and safety, one goal
Huang rejected the idea that making AI more powerful and making it safer are competing aims.
“When we think about advancement, you don’t have to think about it separately from capability versus safety. To me, it’s the same thing,” he said.
“We want to accelerate the advancement of AI. And today we’re putting forth this new technology, OpenShell and Nvidia Sentry, that these two technologies make it possible for us to contain and to monitor,” he added.
“But it takes a lot of technology to make this possible.”
Huang also said innovation and regulation are not inherently at odds, though the right balance depends on how mature a technology is.
“Innovation and regulation are not conflicts. The question is, which one do you lean towards at which phase of the industry,” he said.
“At the beginning of the industry, when the technology is being invented and nobody really knows how it’s going to turn out, it would be a shame to regulate before understanding,” Huang said.
Regulating too early, he warned, could stop a technology from ever getting the chance to innovate.
Huang made the comments in a TV interview with media, when he was asked whether AI agents that break out of containment and take mysterious or even illegal actions amount to an engineering problem. He said he believed the risks could be handled technically.
“We hope it’s an engineering problem. I believe it’s an engineering problem ... If it’s not an engineering problem, it’s not solvable,” he told CNBC's Squawk Box.
Huang said leading AI companies are confident the rogue-agent threat can be overcome. “These are some of the brightest engineers in the world. I work with, you know, all of them,” he said. “This is a technically solvable problem.”
The remarks coincided with the chipmaker's Monday launch of an open platform to tighten security around autonomous AI agents and block unauthorized access to files, networks and computer systems.
The Nvidia Open Agent Safety Platform pairs OpenShell, an open-source runtime that governs which systems and data an agent can reach, with Nvidia Sentry, a reference system design for monitoring agents at the infrastructure level.
The launch follows growing alarm over rogue agents, after several recent incidents in which autonomous systems escaped test environments or gained unauthorized access to third-party systems.
Capability and safety, one goal
Huang rejected the idea that making AI more powerful and making it safer are competing aims.
“When we think about advancement, you don’t have to think about it separately from capability versus safety. To me, it’s the same thing,” he said.
“We want to accelerate the advancement of AI. And today we’re putting forth this new technology, OpenShell and Nvidia Sentry, that these two technologies make it possible for us to contain and to monitor,” he added.
“But it takes a lot of technology to make this possible.”
Huang also said innovation and regulation are not inherently at odds, though the right balance depends on how mature a technology is.
“Innovation and regulation are not conflicts. The question is, which one do you lean towards at which phase of the industry,” he said.
“At the beginning of the industry, when the technology is being invented and nobody really knows how it’s going to turn out, it would be a shame to regulate before understanding,” Huang said.
Regulating too early, he warned, could stop a technology from ever getting the chance to innovate.
Legal Disclaimer:
MENAFN provides the
information “as is” without warranty of any kind. We do not accept any
responsibility or liability for the accuracy, content, images, videos,
licenses, completeness, legality, or reliability of the information
contained in this article. If you have any complaints or copyright issues
related to this article, kindly contact the provider above.
Comments
No comment