Elon Musk’s platform X has announced new restrictions on its AI chatbot Grok, following mounting criticism and regulatory investigations over the creation of sexualized deepfake images of real people, including children.
X’s safety team said Grok will now “geoblock” users from generating or editing images of people in bikinis, underwear, or similar attire, and only paid subscribers will retain limited image-editing capabilities. The company pledged “zero tolerance” for child sexual exploitation and non-consensual nudity but did not provide details on enforcement mechanisms.
The move comes after regulators in California, the UK, France, Indonesia, and Malaysia launched investigations or imposed bans, citing Grok’s “spicy mode,” which allowed prompts such as “remove her clothes.” California Attorney General Rob Bonta announced a probe into whether xAI violated laws by facilitating large-scale production of deepfakes used to harass women and girls.
Indonesia and Malaysia have already blocked Grok, while the UK’s Ofcom and France’s Arcom are investigating. The European Commission has ordered X to preserve all Grok-related documents until the end of 2026.
Musk denied knowledge of Grok producing sexualized images of minors, insisting the chatbot only responds to user requests. However, watchdogs argue the safeguards remain insufficient, as sexualized content has continued to appear despite earlier restrictions.
The controversy underscores growing global concern over AI misuse, with governments warning of human rights violations, online harassment, and risks to children’s safety.
