Nvidia CEO Jensen Huang says AI labs that cannot control their own systems should shut down rather than ship products they know are dangerous.

Huang made the comment in a September 23 interview on The Ezra Klein Show. If they say the alternative, which is: There is no way to contain our experiments, there’s just no way; when we test our AI models, it will get out, and it will damage the world, then I think the answer is that we have to shut the labs down, he said.

He framed the issue as corporate accountability, not regulation. If we’re going to build a car, a self-driving car, and we have no idea how to align them to the safety standards, he said. What’s the answer? Don’t ship it.

The remarks are striking given Nvidia’s business: OpenAI and Anthropic are among its biggest chip customers. Huang has normally opposed AI regulation.

Microsoft President Brad Smith separately called for an AI kill switch at a UN panel the same week, while OpenAI’s Sam Altman and Anthropic’s Dario Amodei asked world leaders for safeguards.