
UK MPs want a watchdog with the power to pull the plug on dangerous AI models, rather than leave the likes of OpenAI and Anthropic to decide when they've gone too far.
In a report shared with ahead of publication on Wednesday, a parliamentary committee is calling for an AI Safety and Security Bill that would give a watchdog powers to intervene while models are still being developed.
It could halt high-risk training and testing, block deployments, or suspend AI services if the risks can't be contained. LLMs are trained on billions of learned parameters and so developers can't always predict what a model will do in every situation.
The recommendations come from Parliament's Business, Innovation, Science and Trade Committee, which questioned researchers, former AI employees, and representatives from OpenAI, Google DeepMind, Anthropic, and Meta.
All four companies assured MPs they wouldn't release models they considered unsafe. The trouble is, they don't use the same yardstick for safety, and UK law doesn't generally require them to get an independent opinion before releasing anything.
"We cannot give today’s AI leaders unfettered freedom to behave like modern-day Dr Frankensteins, creating dangers beyond anyone’s control," said committee chair Liam Byrne MP.
Just as with aviation, pharma or nuclear safety, UK government want to rely on manufacturers' assurance alone, and want regulation.
"Our hearings exposed gaps in independent scrutiny, incident reporting and powers to stop unsafe systems. Once some models are released, they cannot reliably be recalled," added Byrne. "Protection must begin while systems are being built and tested."
The committee's report, Guardrails for Growth: Making AI Safe, identifies ten holes in Britain's approach to AI safety, including the lack of mandatory incident reporting, limited access for independent testers, and inadequate protections for whistleblowers.
The UK already has an AI Security Institute (AISI), which has made a name for itself testing some of the world's most powerful models, but its work depends on voluntary cooperation, and it has no authority to stop a company releasing a model that raises safety concerns.
MPs want AISI to continue its testing work while a separate regulator takes responsibility for enforcement. Developers of designated high-risk systems would have to provide evidence supporting their safety claims and give independent researchers access to examine them. Significant changes to a model's capabilities or safeguards would trigger further scrutiny.
Former AI employees also told MPs that raising safety concerns can come at a price. Restrictive contracts, commercial pressures, and financial disincentives can all discourage staff from speaking out, the committee heard. MPs want stronger legal protections for whistleblowers and compulsory reporting of AI incidents and near misses.
There's a fair bit of money riding on this, too. Using OECD productivity estimates, the committee calculates that AI could leave Britain's economy up to £400 billion larger over the next decade. It also sees an opportunity for the UK to make money from independently testing AI models, building on the expertise already established at AISI. MPs argue that stronger safeguards could encourage businesses, particularly smaller firms, to adopt the technology.
"AI firms must be required to substantiate their safety claims, independent experts must be able to scrutinize them, and a regulator must have the power to intervene when risks cannot be controlled," Byrne said. "Ministers, accountable to Parliament, must decide what risks the public should be asked to bear."
MPs want the new laws on the books in the next parliamentary session, and say Britain should use its turn at the G20 helm in 2027 to get other countries on board with tougher rules for AI testing, incident reporting, and risky model releases.
Whether ministers are prepared to hand a watchdog the power to stop AI development is another matter. The committee's recommendations aren't binding, and the government has yet to commit to the proposed legislation. ®