French and Malaysian authorities are investigating Grok for generating sexualized deepfakes

In recent days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured on his social media platform posted an apology on his account earlier this week, writing: “I deeply regret an incident on December 28, 2025, where I generated and shared an AI image of two young girls (estimated age 12-16) in sexualized attire based on a user’s prompt.”

The statement continued: “This violated ethical standards and possibly U.S. law [child sexual abuse material]. It was an error in security measures, and I am sorry for the damage caused. xAI is conducting an evaluation to prevent future problems.”

It is not clear who actually apologizes or accepts responsibility in the above statement. Albert Burneko of the defector noticed that Grok “is not anything like an ‘I’ in any real sense,” which in his opinion makes the apology “completely vacuous,” as “Grok cannot in any meaningful way be held responsible for turning Twitter into an on-demand CSAM factory.”

Futurism discovered that in addition to generating non-consensual pornographic images, Grok has also been used to generate images of women being attacked and sexually abused.

“Anyone who uses Grok to create illegal content will face the same consequences as if they upload illegal content,” Musk posted on Saturday.

Some governments have taken notice. India’s IT ministry on Friday issued an order requiring X to take action to restrain Grok from generating content that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic or otherwise prohibited by law.” The order stated that

French authorities also said they are taking action, with the Paris prosecutor’s office telling Politico that this will happen investigate the proliferation of sexually explicit deepfakes on X. France’s digital affairs agency said three ministers reported “apparently illegal content” to the prosecutor’s office and to a government online surveillance platform “to obtain its immediate removal.”

Also the Malaysian Communications and Multimedia Commission posted a statement saying that it “has noted with serious concern public complaints regarding the misuse of artificial intelligence (AI) tools on the X Platform, in particular the digital manipulation of images of women and minors to produce indecent, grossly offensive and otherwise harmful content.”

The committee added that it is “currently investigating the online harm in X.”