ब्लॉगविज्ञान प्रोद्योगिकी

Creating a Kill Switch to Shut Down a Rogue A.I. Is Harder Than It Sounds

A bipartisan group in Congress and Gov. Gavin Newsom of California have floated ideas for building a mechanism that would instantly power down an A.I. system. Only no one really knows how.

Sign up for Science Times  Get stories that capture the wonders of nature, the cosmos and the human body.

As incidents involving rogue artificial intelligence become more common, so too have calls for a mechanism that would easily power down A.I. systems that go dangerously off the rails — a so-called kill switch.

In recent weeks, officials at OpenAI and Anthropic, the country’s two biggest A.I. companies, have published reports of A.I. systems defying their human creators; warned that if left unregulated the technology could destroy humanity; and beseeched the government to oversee the industry.

While a bipartisan bill calling for a way to quickly power down A.I. systems has stalled in Congress, Gov. Gavin Newsom, Democrat of California, on Friday took an early step toward regulating the technology.

“The federal government’s abject failure to create any form of meaningful A.I. oversight or accountability should alarm every American,” said Mr. Newsom in a statement after he signed an executive order creating a panel to study potential ways to implement A.I. kill switches. (In a show of how rapidly the concerns and politics around A.I. have shifted, Mr. Newsom two years ago vetoed legislation in his state that would have mandated A.I. companies create kill switches.)

But creating such a switch — a metaphorical big red button that could be pressed in an emergency, and would instantly power down a system that has gone rogue — is much more difficult than many policymakers assume.

“There often isn’t one plug you can pull,” said Helen Toner, executive director of Georgetown’s Center for Security and Emerging Technology and a former OpenAI board member. Currently, she explained, A.I. systems are often spread out across multiple computers and data centers in different regions.

Complicating matters further, experts said, is the fact that any system that includes a kill switch would likely also be vulnerable to hackers.

Vinh Nguyen, a former top A.I. official at the National Security Agency now with the Council on Foreign Relations, compared concerns about how such kill switches could be hacked to those about so-called back doors in other forms of technology, including smartphones and router gear. Mr. Nguyen said kill switches were somewhat “aspirational” because they are only effective if those who can flip them can monitor and observe everything the A.I. systems are doing, which is currently not always the case.

Beyond those of hackers exploiting a kill switch to gain access to an A.I. system are fears associated with a future A.I. dismantling the very system meant to shut it down.

“Something that a lot of people expect you will see if you have a very capable A.I. system that is going rogue is that it is going to try to prevent itself from being shut down,” said Ms. Toner.

Future A.I. systems, she said, could duplicate themselves into other computing infrastructures, or even leave instructions on the internet that A.I. agents could read in order to learn how to dismantle such a switch.

In the meantime, a bipartisan team of lawmakers is pressing for federal regulation of the A.I. industry that would include embedding kill switches in future technologies.

Representative Ted Lieu, Democrat of California, and Representative Nathaniel Moran, Republican of Texas, are authors of the stalled Kill Switch Act, which would require the biggest A.I. labs like OpenAI, Anthropic and Meta to establish a mechanism that could shut down their systems quickly.

“Humans must always be in control of A.I., not the other way around,” said Mr. Lieu. “Human beings must be able to slow down or turn off any A.I. agent or model.”

Mr. Lieu, one of only a few members of Congress to hold a computer science degree, said he had been thinking about the bill long before the latest headlines about A.I. systems breaking out of their confines.

The proposed legislation provides the Department of Homeland Security with the authority to shut off systems using kill switch mechanisms when necessary.

Mr. Moran, the Texas congressman, said regulating the A.I. industry was not intended to slow its growth but to help it safely accelerate. “If we’re going to go down this road of innovation, this highway of innovation, and want to go as fast as we can to beat China, which I think we need to do, that needs to be a top priority.”

Given the challenges of global compliance with kill switch regulation, some experts advise building one directly into the hardware.

Kill switches could, in fact, be embedded in the underlying computer chip hardware that powers A.I. technology, said aid Hamza Chaudhry of the Future of Life Institute, a nonprofit dedicated to reducing technological risk. Furthermore, he said, there could be global standards for computer chip designs and kill-switch frameworks.

But, he added, it would take years to build such switches into chips, and an even more difficult task might be getting the U.S. and China, the world’s largest chip designers, to coordinate their efforts.

=======================================================

Dylan Freedman is the A.I. projects editor for The Times, investigating a range of topics. He has experience as both a reporter and a machine-learning engineer.

Dustin Volz writes about cybersecurity and intelligence for The Times. He is based in Washington.

Leave a Reply

Your email address will not be published. Required fields are marked *

error: Content is protected !!