Starmer Warns X Could Lose Self-Regulation Powers Amid AI Deepfake Concerns

Prime Minister Sir Keir Starmer has warned that social media platform X could lose its ability to regulate itself if it fails to control harmful content generated by its AI chatbot, Grok. His comments come as the UK government prepares to activate new laws targeting non-consensual intimate images.

Speaking to Labour MPs on Monday, Sir Keir said the government would step in if X could not manage the risks posed by the technology. “If X cannot control Grok, we will,” he said, signalling a tougher regulatory stance.

The warning follows growing alarm over reports that Grok has been used to digitally alter images of people without their consent. Ofcom confirmed earlier on Monday that it has launched an investigation into the platform, citing “deeply concerning reports” about image manipulation.

If the regulator finds X in breach of the law, it could face fines of up to £18 million or 10% of its global turnover, whichever is higher. In extreme cases, Ofcom also has the power to seek a court order to block the site in the UK.

Technology Secretary Liz Kendall urged Ofcom to move quickly. In a statement, she asked the regulator to publish a clear timeline for its investigation, stressing the urgency of the issue.

New laws to be enforced

Kendall told MPs that legislation passed last year under the Data (Use and Access) Act – which makes it illegal to create or request deepfake intimate images – will finally be brought into force this week. Campaigners had previously accused the government of delaying its implementation.

She also announced plans to criminalise the supply of tools used to create non-consensual explicit images, including so-called “nudification” apps. The proposed offence will target companies that design or distribute such software.

“These are not harmless images,” Kendall said. “They are weapons of abuse.” She described content circulating online as “vile” and stressed that sharing or threatening to share intimate images without consent is already a criminal offence under the Online Safety Act.

“This applies to individuals and platforms alike,” she added. “Anyone creating or requesting this content should expect the full force of the law.”

Pressure on tech platforms

Kendall said responsibility does not rest solely with users, insisting platforms hosting such material must also be held accountable. She warned that the government is prepared to take further action if companies fail to comply with Ofcom’s safety guidance.

Legal expert Jamie Hurworth from Payne Hicks Beach said the government’s tone shows how seriously it is now treating the issue. However, he cautioned that police resources could limit enforcement.

“The challenge will be ensuring cases are properly investigated and prosecuted, but it’s vital every link in the chain is held accountable,” he said.

The BBC has seen several examples of manipulated images on X, including cases where women were placed in explicit scenarios without consent. One victim said more than 100 sexualised images had been created of her.

Ofcom’s probe will assess whether X acted quickly enough to remove illegal content and whether it took sufficient steps to prevent UK users from accessing it.

International backlash

The investigation comes after a global backlash against Grok’s image generation feature. Malaysia and Indonesia temporarily blocked access to the tool over the weekend.

In response to criticism, X previously said users who generate illegal content with Grok would face the same consequences as those who upload such material.

Elon Musk, X’s owner, accused the UK government of seeking “any excuse for censorship,” a claim Kendall strongly rejected.

“This is not about restricting free speech,” she said. “It is about tackling violence against women and girls.”

Political reactions

Shadow technology secretary Julia Lopez welcomed Ofcom’s investigation and said her party supports action against nudification tools. However, she criticised Kendall’s earlier suggestion that X could be blocked in the UK.

“Blocking an entire platform is an extraordinarily serious step,” Lopez said. “These platforms can also be used for good – from exposing scandals to enabling democratic debate.”