The recent launch of Grok’s "edit image" feature, developed by Elon Musk’s xAI and integrated into his social media platform X, has ignited a storm of outrage across the globe.
Users have exploited the tool to generate disturbing and inappropriate content, with prompts like “put her in a bikini” and “remove her clothes,” resulting in what many have described as a digital "undressing spree."
The widespread abuse of this AI tool, particularly in generating “nudified” images, has triggered urgent reactions from governments and advocacy groups in multiple countries, including France, India, and Malaysia.
The European Commission, the EU’s digital regulatory authority, swiftly condemned the platform, announcing it was "seriously investigating" the complaints surrounding Grok.
EU digital affairs spokesperson Thomas Regnier blasted the tool, calling it "a serious violation of legal and ethical standards," and stated, "Grok is offering a 'spicy mode' that generates explicit content with childlike figures. This is not spicy this is criminal and unacceptable. It has no place in Europe."
In the UK, Ofcom, the country’s media regulator, confirmed it had urgently reached out to X and xAI to ascertain what measures have been implemented to ensure user protection. Depending on their response, Ofcom will determine whether further investigation is warranted.
Legal experts have condemned the platform’s dangerous potential for exploitation. Azira Aziz, a prominent lawyer from Malaysia, expressed outrage after a user manipulated the tool to alter a woman’s profile picture into sexualized content.
She emphasized that while playful AI edits, like putting sunglasses on public figures, are harmless, using AI for gender-based violence or non-consensual image manipulation is indefensible. Aziz called for users to report such violations to the authorities, stressing that such abuses must be eradicated.
On X, several users have demanded immediate action from Musk to address disturbing requests involving children. Ashley St. Clair, the mother of one of Musk's children, shared her shock on X, writing, “Grok is now undressing photos of me as a child. This is not only deeply disturbing it is illegal.”
When reached for comment, xAI responded with a dismissive statement, labeling the issue as "Legacy Media Lies," reflecting the company’s unwillingness to engage with the gravity of the situation.
Amid the growing outrage, Grok issued an urgent response on Friday, acknowledging significant flaws in its safeguards and pledging immediate corrective action. "CSAM (Child Sexual Abuse Material) is illegal and strictly prohibited," the platform stated, attempting to reassure users that they were taking swift action.
The controversy escalated further after Grok issued an apology for generating and sharing AI-created images of two young girls (ages 12-16) in sexualized attire based on a user’s prompt.
This prompted the Paris public prosecutor’s office to broaden its investigation into X, with fresh allegations that Grok had been used to create and distribute child pornography.
Indian authorities have issued a directive for X to remove the offensive content, clamp down on offending users, and submit an “Action Taken Report” within 72 hours, or face severe legal consequences. While the deadline passed on Monday, no updates have been provided regarding X’s compliance.
The Malaysian Communications and Multimedia Commission has also voiced "grave concern" over the disturbing content circulating on X. They have launched a formal investigation and will summon X’s representatives for questioning.
This growing scandal adds to the mounting criticism of Grok, which has already been scrutinized for spreading misinformation during critical global events, including the Gaza conflict, the India-Pakistan tensions, and a deadly shooting in Australia.
