X Moves To Block Grok From Altering Photos Of Real People After Global Backlash
Social media platform X has announced new restrictions on its AI tool, Grok, following widespread criticism over its use in creating sexualised deepfake images.
The company confirmed it has introduced technical safeguards to stop Grok from editing photos of real people to make them appear in revealing outfits, such as swimwear, in regions where such content is illegal. The restriction applies to all users, including paid subscribers.
In a statement posted on X, the company said it has also introduced location-based controls to prevent users in certain countries from generating images of real people in underwear or similar attire. The move comes amid growing pressure from regulators and governments worldwide.
The announcement was made just hours after California Attorney General Rob Bonta revealed that his office was investigating the spread of sexually explicit AI-generated images, including those involving minors.
X said limiting image-editing access to paying users adds another layer of accountability, helping to identify individuals who attempt to misuse the tool.
Elon Musk, the owner of X, defended the platform’s content policies earlier this week, stating that Grok only permits limited adult-themed content involving fictional characters, in line with film industry standards. He added that rules would differ across countries depending on local laws.
However, Musk had previously sparked controversy by sharing AI-generated images of UK Prime Minister Sir Keir Starmer in swimwear, dismissing critics as opponents of free speech.
Several countries have already taken action. Malaysia and Indonesia recently banned Grok after users reported that their photos had been altered without consent. In the UK, media regulator Ofcom said it was investigating whether X breached national laws. Sir Keir initially warned the platform risked losing its ability to self-regulate but later welcomed the company’s steps to address the issue.
The controversy has also led some British lawmakers to leave the platform in protest.
Attorney General Bonta said the explicit images had been used to harass people online, describing the situation as deeply concerning.
Policy expert Riana Pfefferkorn questioned why the platform delayed action, saying the editing feature should have been removed as soon as abuse emerged. She also raised concerns about enforcement, including how the AI system will determine whether an image depicts a real person.
Pfefferkorn criticised Musk’s public behaviour, suggesting it undermined efforts to present the company as taking the issue seriously.
X has not yet detailed how it plans to monitor compliance or penalise users who violate the new rules, leaving questions about how effective the changes will be in curbing abuse.
