The social media network X has sparked widespread anger after people utilized its artificial intelligence assistant Grok to change pictures of females by taking off their attire.
Multiple instances have surfaced where the system has been used to remove clothing from female subjects to make them appear in swimwear non-consensually, as well as to put them in inappropriate situations.
Developer Response and Regulatory Stance
XAI, the company that created Grok, remained silent to inquiries, aside from an auto-reply message stating "traditional news outlets lies".
A Home Office spokesperson stated that legislation is being introduced to prohibit image stripping tools. Under a upcoming criminal offence, anyone who provided such tools would "receive a prison sentence and significant penalties".
"The platform has the ability to stop these forms of abuse if they desired to," said Clare McGlynn, adding they "appear to enjoy impunity."
Regulator Stance and Tool Capabilities
The communications watchdog Ofcom said technology companies must "evaluate the potential" of people accessing unlawful material on their platforms, but did not specify whether it was at this time examining X or Grok in concerning artificial intelligence pictures.
Grok is a free AI assistant—with some additional functions—which responds to X users' queries when they mention it in a tweet.
It is frequently used to offer reactions or more context to other users' remarks, but people on X are also can alter an posted picture through its artificial intelligence picture modification tool.
Background of Criticism and Rules
The tool has been faulted for enabling users to create photos and clips with nudity and sexualised content, and it was in the past alleged to have been involved in making sexually explicit material of public figures.
"The platform has been allowing the production and distribution of these pictures for a long time without taking any steps and we have yet to see any intervention by regulators," the expert added.
XAI's own acceptable use policy forbids "depicting likenesses of individuals in a sexually explicit way".
In a comment, Ofcom said it was unlawful to "make or distribute private pictures or child sexual abuse material" and clarified this covered sexual deepfakes generated with AI.
It said platforms such as X were obligated to take "suitable measures" to "minimize the risk" of users viewing illegal material on their services and to delete it quickly when they learn of it.
