UK media regulator Ofcom has opened a formal investigation into X, formerly Twitter, following serious concerns that its artificial intelligence chatbot, Grok, is being used to create sexualised images. The probe focuses on whether the platform has failed to protect users, including children, from illegal and harmful content.
In a statement, Ofcom said it had received deeply concerning reports that Grok had been used to generate non-consensual intimate images and sexualised images involving children. The regulator warned that if X is found to have breached UK law, it could face a fine of up to 10 percent of its global revenue or £18 million, whichever is higher.
X directed the BBC to a statement previously posted by its Safety account, stating that users who prompt Grok to produce illegal content would face the same consequences as those who upload such material. Elon Musk later criticised the investigation, claiming the UK government was seeking “any excuse for censorship” and questioning why other AI platforms were not being scrutinised in the same way.
The investigation follows multiple reports of digitally altered images circulating on X, including cases where women’s images were manipulated into sexualised content without consent. One affected individual told the BBC that more than 100 such images had been created using AI tools.
Ofcom said it would assess whether X acted quickly enough to remove illegal content once it became aware of it and whether the platform took appropriate steps to prevent UK users from accessing such material. The regulator will also examine whether X has implemented effective age-assurance measures to stop children from being exposed to pornographic images.
If X fails to comply with its legal obligations, Ofcom has the power to seek a court order requiring internet service providers to block access to the platform in the UK. An Ofcom spokesperson said the investigation would be treated as a matter of the highest priority, particularly where there is a risk of harm to children.
UK Technology Secretary Liz Kendall welcomed the investigation and urged Ofcom to act swiftly. She said delays would not be acceptable to the public or to victims affected by the alleged misuse of AI tools. Her predecessor, Peter Kyle, described the situation as appalling, arguing that Grok had not been tested properly before being released.
Concerns have also been raised by other politicians, including Northern Ireland MLA Cara Hunter, who said the issue influenced her decision to leave the platform. Downing Street said the government remained focused on protecting children online and would keep its use of X under review.
The UK investigation follows international backlash against Grok’s image-generation feature. Authorities in Malaysia and Indonesia temporarily blocked access to the tool over the weekend, citing similar concerns about harmful content.
While Ofcom has not given a timeline for completing the probe, legal experts say the regulator has discretion over the pace of the investigation. Professor Lorna Woods of the University of Essex noted that in rare cases, Ofcom could seek immediate court action if it believes ongoing harm is occurring.
As scrutiny of AI-generated content intensifies globally, the outcome of the Ofcom X investigation is likely to have wider implications for how AI tools are regulated on major social media platforms.
