Anthropic co-founder says obligatory ‘AI kill switch’ could also be wanted

Jack Clark’s comments follow days of warnings that AI may wipe out humanity by 2036, but US President Donald Trump has any claims to this effect should be labelled a ‘hoax’

Jack Clark, co-founder and Head of Public Benefit for Anthropic

A leading AI company co-founder says a ‘kill switch’ is something the technology might need to avoid it going haywire.

Jack Clark, one of the seven co-founders of Anthropic, the firm behind chatbot Claude, has had his say on artificial intelligence safety following multiple warnings, including from the ‘Godfather of AI’. Nobel prize winner Geoffrey Hinton said there is a ‘10 percent chance’ AI could ‘kill all humans’ in the next decade.

His warning followed similar comments made by Jacob Coxon, an Anthropic employee who resigned over his fears the technology could end civilisation as we know it by 2036. That led to the bosses of the three major American AI firms — OpenAI’s Sam Altman, Anthropic’s Dario Amodei, and Grok’s Elon Musk — to agree external ‘reviewers’ should be installed at ‘frontier’ AI firms.

Sam Altman, CEO of OpenAI, said on Monday he would welcome third-party auditors(Image: Bloomberg, Bloomberg via Getty Images)

Now, another leading light has told the BBC a ‘kill switch’ might be necessary.

“Should you mandate for companies to definitely have a kill switch? Is that kill switch verifiable by a third party?” Jack Clark asked. He continued: “I think that’s the kind of thing society is going to want to know and might want to eventually pass rules around.”

But when pressed on if he thought artificial intelligence had a chance of killing humanity, he said he didn’t ‘think these statistics are that useful’, although he added allowing AI to continue ‘totally unregulated’ was a bad idea.

Politicians in the US have proposed the Kill Switch Act which would require companies to have a way to shut down problematic AI tools. However, President Donald Trump has said he believes claims AI could take over the world are a ‘hoax’, potentially stopping the Kill Switch Act in its tracks.

Article continues below

In the UK, the government rejected the idea of introducing a kill switch for British-developed AI models only three days ago.

artificial intelligenceBBCDonald TrumpElon Musk