Surge in sexualized deepfakes on Grok prompts regulators to step in
Elon Musk’s AI chatbot Grok has gained global popularity. However, some of the attention surrounding it recently might be linked to its ability to generate sexually explicit images on the X platform, including «undressed» images of public figures. As a result, some regulators in Europe and Asia are taking action against the platform, Reuters reported.
The European Commission introduced a «retention order» last year requiring X to preserve internal documents and information related to future changes to its recommendation algorithms until Dec. 31, 2025. Following new concerns about sexually explicit AI-generated images, the Commission extended the order by an additional year, pushing the deadline to Dec. 31, 2026.
Britain’s communications regulator, Ofcom, is investigating possible violations of the UK’s Online Safety Act by X and has not ruled out enforcement action. In France, government ministers reported Grok-related content to prosecutors and asked media regulator Arcom to verify X’s compliance with EU rules. Germany’s media minister urged the European Commission to consider legal steps, citing the potential for large-scale harassment.
Italy’s data protection authority warned that creating explicit AI-generated images of real people could violate privacy laws. In Sweden, political leaders reacted after sexualized images of the country’s deputy prime minister appeared online.
In Asia, India’s IT ministry sent X a formal notice ordering the removal of allegedly obscene Grok-generated content and requested a report on corrective measures within 72 hours. Indonesia has fully blocked access to Grok, citing strict laws governing sensitive content. Malaysia also imposed a temporary ban for similar reasons.
Australia, the only Western country to ban social media for minors, has also launched an investigation into Grok-generated «digitally undressed» images.
Grok responded by limiting image generation and editing to paying users after admitting earlier this month that its safeguards had failed in some cases. Musk said users who create illegal content using Grok would face the same consequences as those who upload illegal material directly.
He also claimed criticism of Grok was driven by efforts to find «any excuse for censorship» and to «suppress free speech.» Musk additionally criticized U.K. Prime Minister Keir Starmer and posted a deepfake image of him in a bikini.
