The United Kingdom intensified its crackdown on AI-generated sexual abuse Monday after ministers confirmed a possible ban on Elon Musk’s social media platform X amid a widening probe and with the company potentially incurring hefty fines.
This decisive action comes after Ofcom, Britain’s communications watchdog, initiated a formal investigation into potential violations of the U.K. Online Safety Act by X, following allegations that its integrated AI assistant, Grok, was exploited to produce and distribute sexual deepfake pictures featuring women and minors.
Grok debuted in 2023, though its image creation capability, Grok Imagine, was introduced in 2025, including a dedicated setting for producing adult material.
Liz Kendall, the Secretary of State for Science, Innovation and Technology, characterized the recent exploitation of the AI system to create sexually graphic and non-consensual visuals as “deeply disturbing.”
Kendall also cautioned that social media firms would face consequences for inaction.
“I appreciate Ofcom’s promptness in commencing a formal inquiry today,” Kendall stated. “It is crucial that Ofcom finishes this investigation quickly because the public—and above all, the victims—will tolerate no postponement.”
In remarks delivered later Monday, Kendall stated that the Grok AI system had been utilized to generate and spread humiliating, non-consensual private images.
“No woman or child should have to live in dread of their likeness being sexually altered,” she said, continuing, “The material circulating on X is repugnant. It is not merely an insult to civilized society; it is unlawful.”
Kendall noted that distributing or menacing to distribute deepfake intimate pictures without permission, including photos of individuals in undergarments, is a criminal violation under British law.
She cautioned that Ofcom possesses the power to levy fines or sanctions reaching 10% of a company’s eligible global income.
“However, X need not await the conclusion of Ofcom’s investigation,” Kendall remarked. “They can opt to take action earlier to guarantee this detestable and unlawful content cannot be disseminated on their service,” she warned.
Ofcom stated it had “urgently reached out” to X on January 5, requesting clarification on measures being implemented to safeguard British users and imposing a reply cutoff of January 9.
Although xAI, another Musk-founded enterprise, replied, Ofcom indicated it chose to launch a formal probe after examining the existing proof “as an issue of utmost urgency.”
In a statement released Monday, Ofcom declared, “Accounts of Grok being employed to produce and distribute unlawful non-consensual intimate pictures and child sexual exploitation material on X have been profoundly troubling.”
“Platforms are obligated to shield individuals in the UK from material that is illegal in the UK, and we will not waver in probing instances where we believe corporations are neglecting their responsibilities, particularly when there is a danger to minors,” the announcement stated.
As earlier documented, the chatbot admitted in a public X post that it had produced and disseminated an AI picture showing two young females in sexualized clothing, describing the event as a “safeguard breakdown” and expressing regret for the damage inflicted.
Facing growing condemnation, Grok verified it has started limiting certain image-creation and modification functions to paid subscribers. The chatbot indicated the restrictions were put in place to avert additional abuse.
Musk likewise charged the British government with “fascism” on Monday for “detaining thousands of individuals over social media postings.”
The billionaire Tesla founder had replied to an X post asserting that the nation detains more citizens for social media content than “any other nation on the planet.”
Concurrently with the Ofcom inquiry, the British government declared that laws outlawing the production of non-consensual intimate pictures created by AI would take effect this week.
Kendall stated that accountability does not lie only with private persons.
“The services that harbor such content must be held responsible, X included,” she remarked.
If they fail to take action, she indicated she is “ready to escalate measures.”
Meanwhile, a spokesperson for U.K. Prime Minister Keir Starmer stated the government’s activity on the platform was “being evaluated” and that “every possibility is being considered.”
The outlet also noted Monday that Malaysia and Indonesia have become the inaugural nations to prohibit Grok.
Digital has contacted Elon Musk and Prime Minister Keir Starmer’s office for statements.
The Associated Press and Reuters contributed to this article.