UK Threatens Action Against X Over Sexualised AI Images of Women and Children

The UK government has expressed serious concerns about Elon Musk's social media platform X, accusing it of failing to adequately protect users from the proliferation of sexualised AI-generated images, particularly those depicting women and children. Business Secretary Peter Kyle highlighted that the platform’s built-in AI tool, Grok, has been used to create manipulated images often showing individuals in minimal clothing or sexualised poses. This issue has prompted a fast-tracked investigation by Ofcom, the UK’s media regulator, which has already requested and received information from X regarding the use of Grok. Kyle emphasized that X is "not doing enough to keep its customers safe online," signaling strong governmental support for any regulatory action Ofcom might take, including the extreme measure of blocking the platform in the UK.

The gravity of the situation was underscored by Kyle’s personal account of meeting a Jewish woman who discovered AI-generated images of herself in a bikini outside Auschwitz circulating online. Such instances highlight the disturbing potential impact of Grok’s image manipulation capabilities on individuals and society. Technology Secretary Liz Kendall has indicated that Ofcom’s response is imminent, with a statement expected shortly in the House of Commons. The government’s stance is clear: it fully backs Ofcom’s powers, which include imposing heavy fines or even enforcing a ban on X if deemed necessary to protect users and uphold online safety standards.

Ofcom’s authority stems from the Online Safety Act, which empowers the regulator to compel platforms to remove harmful content and penalize non-compliance with multimillion-pound fines. The ultimate sanction is a court order requiring internet providers to block access to offending sites or apps. This regulatory framework places significant pressure on X to address the misuse of its AI tools. In response to the controversy, X announced that image generation and editing features would be restricted to paying subscribers, a move Downing Street criticized as unacceptable. The government argued that this change merely transforms a problematic AI feature into a premium service rather than resolving the underlying safety concerns.

The potential blocking of X in the UK would likely provoke a strong reaction from Elon Musk and political figures aligned with him, including former US President Donald Trump’s administration. Musk has a history of posting far-right and ethno-nationalist content and has previously encouraged resistance against the UK government, which he accuses of suppressing free speech. US officials have also weighed in, with Sarah Rogers, the US undersecretary for public diplomacy, comparing the UK’s contemplated actions to censorship practices in Russia under Vladimir Putin. This international dimension adds complexity to the regulatory challenge, highlighting tensions between free speech advocacy and the need to curb harmful online content.

The situation with X and Grok reflects broader concerns about the unchecked use of AI technologies on social media platforms. As AI tools become more sophisticated and accessible, the risk of misuse—such as generating sexualised or otherwise harmful images—grows. The UK government’s firm stance and Ofcom’s expedited inquiry signal a willingness to enforce stringent regulations to protect vulnerable groups and maintain online safety. This case may set a precedent for how AI-generated content is managed on social media globally, balancing innovation with ethical responsibility and user protection.