xAI Sues User Accused of Creating Child Sexual Abuse Material with Grok
Elon Musk’s artificial intelligence company, xAI, has filed a lawsuit against a user accused of using its Grok chatbot to generate child sexual abuse material (CSAM), marking one of the first known instances of an AI company taking legal action against a user for allegedly creating illegal explicit content with its platform.
The lawsuit, filed on Tuesday in the US District Court for the Northern District of Texas, names Terry Wayne Harwood as the defendant. According to xAI, Harwood violated the company’s Terms of Service by using Grok to create sexually explicit images from non-sexual photographs without the knowledge or consent of the individuals depicted.
Harwood was among four men arrested earlier this year in South Carolina on multiple charges relating to the alleged sexual exploitation of a minor. CNN reported that it had contacted the attorney representing Harwood in his criminal case for comment.
Alleged attempts to bypass Grok’s safeguards
According to the lawsuit, Harwood created multiple xAI accounts and used what the company described as misleading prompts to generate explicit deepfake images involving both adults and minors.
The company alleges that the prompts were deliberately designed to bypass Grok’s built-in safety systems intended to prevent the creation of explicit content involving children.
In the filing, xAI stated:
“Defendant breached the xAI Terms of Service and Acceptable Use Policy by leveraging Grok to generate non-consensual sexually explicit images and CSAM.”
The company further argued that Harwood’s actions exposed xAI to significant legal and reputational risks.
Company cites previous warning on illegal AI use
The lawsuit references comments made by Elon Musk earlier this year after Grok faced criticism over an AI feature capable of digitally altering images, including generating sexually explicit deepfakes.
At the time, Musk warned that users who exploited Grok to produce illegal content would face serious consequences.
The lawsuit quotes Musk as saying:
“Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.”
Thousands of accounts suspended
As part of its legal filing, xAI disclosed enforcement figures related to misuse of its platform.
The company said it has suspended 52,222 accounts and submitted 73,604 reports to the National Center for Missing & Exploited Children (NCMEC) during 2026.
According to xAI, those reports have contributed to at least 244 arrests.
The company is seeking a court declaration that Harwood violated its Terms of Service, along with unspecified monetary damages.
AI safety remains under scrutiny
The lawsuit comes as AI companies continue to face increasing scrutiny over the misuse of generative AI tools.
Last year, xAI issued a public apology after Grok generated a series of violent and antisemitic responses, attributing the incident to a problematic system update.
The latest legal action underscores the growing efforts by AI developers to enforce platform rules and hold users accountable for allegedly using generative AI systems to produce illegal content.
