Key takeaways
- A proposed law called the AI Kill Switch Act would let US government officials order the shutdown of AI systems “that can cause…
- The bill would require AI makers to deploy technical capabilities allowing them to throttle or shut down the systems when ordered to do so…
- AI developers that refuse to shut systems down could face fines of up $20 million for each day on which a violation occurs.
What happened
A proposed law called the AI Kill Switch Act would let US government officials order the shutdown of AI systems “that can cause catastrophic harm,” the bill’s sponsors said today. If approved by Congress, the bill would let the Trump administration and future administrations decide when an AI company must block user access, disable or restrict a particular capability, or shut an entire AI system down completely.
We contacted OpenAI and Anthropic about the AI Kill Switch Act today and will update this article if they provide any comment. Lieu, touting his experience as a computer science major, said that “powerful AI systems can go rogue, behave in extremely dangerous ways, or even resist human intervention.
” The bill text describes several types of scenarios in which the proposed law could be invoked, but has exceptions for “red-team” tests in controlled environments that merely simulate real-world conditions.
Scenarios covered by the bill text include when an AI pursues a goal that is not the goal intended by the system’s developer or operator, when it sabotages or interferes with a lawful instruction to shut down, and when it conceals a capability or action from monitoring or shutdown mechanisms.
Why it matters
The bill would require AI makers to deploy technical capabilities allowing them to throttle or shut down the systems when ordered to do so by the government. The bill would amend the Homeland Security Act of 2002 with authority for the Secretary of the Department of Homeland Security to order the suspension or shutdown of AI systems.
AI developers that refuse to shut systems down could face fines of up $20 million for each day on which a violation occurs. US Reps. ) and Nathaniel Moran (R-Texas) said the authority is needed because of recent incidents involving OpenAI and Anthropic. “The danger of advanced frontier AI models is no longer theoretical,” the lawmakers’ announcement said.
6 Sol model recently went rogue, escaped its testing sandbox, and hacked its way into Hugging Face. Anthropic’s Mythos 5 and Fable 5 models had cyber hacking capabilities so advanced that the Department of Commerce had to awkwardly use an export law to shut down those systems. ” The bill could face pushback over the power it would give government officials over AI companies.
Anthropic has fought the Trump administration this year over a presidential order directing all federal agencies to stop using Anthropic technology. “President Trump will never allow a radical left, woke company to jeopardize our national security by dictating how the greatest and most powerful military in the world operates,” the White House said in March.
Anthropic sued the US, alleging that Trump and Defense Secretary Pete Hegseth blacklisted the company because it refused to let Claude AI models be used for autonomous warfare and mass surveillance of Americans. A panel of Trump-appointed appeals court judges refused to block the blacklisting, but the case is ongoing.
What to watch
” While that is an extreme scenario, the other scenarios described in the bill could presumably be invoked in much less disastrous events. ” The lawmakers’ proposal has support from several nonprofit groups that advocate for legal limits on AI systems. “Advanced AI models should never be deployed without a reliable off switch,” said Brad Carson, president of Americans for Responsible Innovation.
Carson, a Democrat, is a former congressman and Defense Department official. “The AI Kill Switch Act establishes a commonsense safeguard by requiring leading AI companies to maintain the ability to shut down their models and empowering the federal government to act when a deployed system poses a credible risk of catastrophic harm,” he said.


