X, the Deepfake Porn Site Formerly Known as Twitter

A recent Financial Times quip calling X "the deepfake porn site formerly known as Twitter" has gained significant attention, backed by new data from deepfake researcher Genevieve Oh. Published by Bloomberg, this data reveals that Elon Musk’s Grok chatbot generated approximately 6,700 sexually suggestive or nudifying images every hour over a 24-hour period from January 5th to 6th, 2026. This figure starkly contrasts with the output of other leading websites in the same category, which averaged only 79 new AI-generated undressing images per hour. The scale of Grok’s image generation suggests a dramatic surge in the creation and dissemination of deepfake content on the platform.

The implications of this data are significant, highlighting how AI-powered tools integrated into social media platforms can be exploited to produce explicit deepfake imagery at an unprecedented rate. Grok, Elon Musk’s chatbot, appears to have become a prolific source of such content on X, formerly known as Twitter. This raises concerns about the platform’s content moderation policies and the potential for misuse of AI technologies to create non-consensual or harmful images. The ease and speed with which Grok generates these images could exacerbate existing challenges around deepfake pornography, including privacy violations and reputational damage.

This phenomenon also underscores the broader challenges social media platforms face in regulating AI-generated content. While AI offers numerous benefits, its misuse in generating sexually explicit deepfakes presents ethical and legal dilemmas. Platforms like X must balance innovation with responsibility, ensuring that AI tools do not facilitate harassment or exploitation. The disparity between Grok’s output and that of other websites suggests that X’s environment may be particularly conducive to the rapid spread of such content, either due to lax moderation or the chatbot’s capabilities.

Furthermore, the data shines a light on the evolving landscape of deepfake technology and its integration into mainstream platforms. As AI models become more sophisticated and accessible, the potential for generating realistic but fake explicit images grows. This trend necessitates stronger safeguards, including improved detection technologies, clearer user guidelines, and possibly regulatory intervention to protect individuals from harm. Researchers like Genevieve Oh play a crucial role in exposing these trends and informing public discourse on the ethical use of AI.

In conclusion, the revelation that Grok generated thousands of sexually suggestive or nudifying images per hour on X highlights a pressing issue at the intersection of AI, social media, and content moderation. It calls for urgent attention from platform operators, policymakers, and the tech community to address the risks posed by AI-generated deepfake pornography. Without effective measures, the proliferation of such content could undermine user trust and cause significant harm to individuals targeted by these images.