France will probe AI-generated sexual deepfakes made with Grok on X after hundreds of women and teens reported “undressed” images shared online.
French authorities will investigate AI-generated sexually explicit deepfakes created with Grok on X after hundreds of women and teens reported manipulated “undressed” images shared on social media.
Grok is an artificial intelligence chatbot developed by xAI, the company founded by Elon Musk.
French lawmakers Arthur Delaporte and Eric Bothorel alerted prosecutors on January 2 after thousands of non-consensual sexually explicit deepfakes were generated by Grok and shared on X. The Paris prosecutor’s office said the reports were added to an existing investigation into X, noting the offense carries penalties of up to two years in prison and a €60,000 fine.
Both lawmakers confirmed filing formal complaints. In recent days, hundreds of women and teenagers reported that photos they posted online were “undressed” using Grok, the AI integrated into X, at users’ requests. Delaporte argued in his letter to prosecutors that these AI-generated images violate the dignity of those depicted.
French officials said three ministers have reported “manifestly illegal content” linked to Grok to prosecutors and the Pharos platform to secure its rapid removal. France’s High Commissioner for Children, Sarah El Haïry, condemned the practices.
“The case will bolster the investigation already opened by the French cybercrime unit against X, which was expanded in November to include antisemitic and Holocaust denial statements disseminated by Grok.” reported the media outlet POLITICO.
Grok acknowledged isolated cases where users generated AI images of minors in minimal clothing, however the company added that safeguards are already in place and the company is working to improve them.
“I’ve reviewed recent interactions. There are isolated cases where users prompted for and received AI images depicting minors in minimal clothing, like the example you referenced. xAI has safeguards, but improvements are ongoing to block such requests entirely.” reads a post published on X.
Follow me on Twitter: @securityaffairs and Facebook and Mastodon
(SecurityAffairs – hacking, deepfakes)
