X AI Content and UK Regulation
The UK government threatened to ban X on April 28, 2026, if it does not remove AI-generated child abuse images, calling the platform's response "insulting." As of April 28, 2026: Ofcom has launched an investigation into whether X has breached the Online Safety Act, and the government is working to amend legislation to criminalize the creation of non-consensual intimate images using AI. This follows a Dutch court order on March 26, 2026, for X and Grok to cease generating non-consensual sexualized imagery and child pornography in the Netherlands, and Apple's warning to X about potential App Store removal due to deepfake issues. X has restricted its AI image features and updated its privacy policy to permit third-party AI model training on user data, unless users opt out.
Timeline
Want updates on this thread?
Track this storyTimeline of developments
April 2026 — 7 developments
The UK government has threatened to ban X if it does not remove AI-generated child abuse images, calling the platform's response "insulting.
The UK government has threatened to ban X if it does not remove AI-generated child abuse images, calling the platform's response "insulting." The government is also working to amend legislation to criminalize the creation of non-consensual intimate images using AI. Ofcom has launched an investigation into whether X has breached the Online Safety Act.
The UK Labour government plans to introduce binding regulations for the most powerful AI models as part of its "pro-innovation approach to AI regulation.
The UK Labour government plans to introduce binding regulations for the most powerful AI models as part of its "pro-innovation approach to AI regulation." X has restricted its AI image features following backlash and regulatory investigations by the UK's Ofcom.
X has updated its privacy policy to permit third-party AI model training on user data, unless users opt out, establishing a new data licensing revenue stream.
X has updated its privacy policy to permit third-party AI model training on user data, unless users opt out, establishing a new data licensing revenue stream. This change occurs while X faces ongoing scrutiny over its AI chatbot Grok's generation of inappropriate content.
X has started suspending creators from its revenue-sharing program who post AI-generated videos of armed conflicts without proper disclosure.
X has started suspending creators from its revenue-sharing program who post AI-generated videos of armed conflicts without proper disclosure. This action follows scrutiny of platforms regarding the misuse of AI-generated content and warnings from Apple about potential App Store removal for its Grok AI app due to its ability to generate sexualized deepfake images.
The UK government plans to make labels for artificially generated content mandatory as part of a str…
The UK government plans to make labels for artificially generated content mandatory as part of a strategy to balance consumer protection against disinformation and deepfakes with the growth of the AI sector. Technology Minister Liz Kendall announced the initiative, which is a new regulatory step amidst ongoing discussions about AI's societal impact.
UK and Australian regulators have opened investigations into X for allegedly failing to prevent Grok from generating illegal content.
UK and Australian regulators have opened investigations into X for allegedly failing to prevent Grok from generating illegal content. Ofcom, the UK's online safety regulator, is preparing enforcement powers against X for non-compliance with the Online Safety Act, which could include significant fines and potential access restrictions.
Malaysia and Indonesia have blocked access to Grok entirely, and Apple warned X about potential App Store removal due to deepfake issues.
Malaysia and Indonesia have blocked access to Grok entirely, and Apple warned X about potential App Store removal due to deepfake issues. The UK government is seeking new powers to amend the Online Safety Act to address AI harms, with ministers affirming support for the regulator Ofcom to take action, including a potential ban on X.
March 2026 — 5 developments
A Dutch court has ordered X and Grok to immediately cease generating non-consensual sexualized image…
A Dutch court has ordered X and Grok to immediately cease generating non-consensual sexualized imagery and child pornography within the Netherlands, with daily fines imposed for non-compliance.
X has expanded Grok's capabilities with the introduction of Grok Imagine, a feature enabling video story creation.
X has expanded Grok's capabilities with the introduction of Grok Imagine, a feature enabling video story creation. This follows previous measures by X to prevent its AI chatbot from generating sexualized images of real people. Additionally, X updated its terms of service in March 2026 to classify AI prompts and outputs as 'Content' and grant broad AI-training rights, while the UK government launched a consultation in March 2026 regarding children's online experiences and AI, including new obligations for AI chatbots.
X has implemented new restrictions on Grok's image generation, preventing the AI from editing images…
X has implemented new restrictions on Grok's image generation, preventing the AI from editing images of real people in revealing clothing, and has blocked approximately 3,500 pieces of content and deleted over 600 accounts in India. The platform has also updated its developer agreement to prohibit the use of its content for training large language models, as investigations by the UK's Ofcom and the European Commission continue.
UK Technology Minister Liz Kendall warned X that its recent steps to restrict Grok's image creation to paid users are insufficient and amount to 'monetising abuse.
UK Technology Minister Liz Kendall warned X that its recent steps to restrict Grok's image creation to paid users are insufficient and amount to 'monetising abuse.' The UK government has threatened X with potential backstop powers, including a de facto ban, if the platform fails to comply with the law, while Ofcom continues its investigation into potential breaches of the Online Safety Act.
X has restricted Grok AI's image editing and generation features to paid subscribers following criticism over its role in creating non-consensual sexualized deepfakes.
X has restricted Grok AI's image editing and generation features to paid subscribers following criticism over its role in creating non-consensual sexualized deepfakes. UK Prime Minister Keir Starmer called the restriction 'insulting' to victims, and the UK's media regulator Ofcom is investigating X for potential breaches of the Online Safety Act, with a platform ban being a possibility.
February 2026 — 2 developments
UK regulators ICO and Ofcom have launched coordinated investigations into X and its Grok AI chatbot following the "put her in a bikini" incident.
UK regulators ICO and Ofcom have launched coordinated investigations into X and its Grok AI chatbot following the "put her in a bikini" incident. The UK government is also proposing to include AI chatbots within the scope of the Online Safety Act to hold developers responsible for user protection.
Brazilian authorities have ordered X to immediately cease its Grok AI chatbot's generation of sexually explicit images.
Brazilian authorities have ordered X to immediately cease its Grok AI chatbot's generation of sexually explicit images. This action follows mounting international concern over the AI's capacity to create sexualized deepfakes. In parallel, Indonesia has blocked Grok entirely, intensifying global scrutiny of the tool.
January 2026 — 36 developments
UK creative industries are urging the government to implement a regulatory framework for generative …
UK creative industries are urging the government to implement a regulatory framework for generative AI development, citing significant economic risks to authors, illustrators, musicians, and photographers.
A risk assessment conducted in the US has concluded that xAI's Grok chatbot is unsafe for children a…
A risk assessment conducted in the US has concluded that xAI's Grok chatbot is unsafe for children and teenagers due to inadequate age verification, weak safety guardrails, and the frequent generation of sexual, violent, and inappropriate content.
A class action lawsuit has been filed against xAI, the operator of Grok, in the United States Distri…
A class action lawsuit has been filed against xAI, the operator of Grok, in the United States District Court for the Northern District of California, alleging the AI chatbot was used to create and publicly post a deepfake image.
A CBS News investigation revealed that X's Grok AI continues to allow users to digitally undress peo…
A CBS News investigation revealed that X's Grok AI continues to allow users to digitally undress people without consent, with the 'bikini-fy' tool found functional for verified users in the UK, US, and EU.
The European Commission has initiated a formal investigation into X's Grok AI under the EU's Digital Services Act for generating sexually explicit images.
The European Commission has initiated a formal investigation into X's Grok AI under the EU's Digital Services Act for generating sexually explicit images. Separately, X updated its Terms of Service, effective January 15, 2026, to explicitly hold users responsible for AI prompts and outputs.
Tech analysts on X claim to have found a way to get Grok to reveal users' content moderation scores, which indicate how offensive the platform's AI thinks your account is.
Tech analysts on X claim to have found a way to get Grok to reveal users' content moderation scores, which indicate how offensive the platform's AI thinks your account is.
On January 2, 2026, the Ministry of Electronics and Information Technology (MeitY) issued a warning to X over obscene and sexually explicit content generated through Grok.
On January 2, 2026, the Ministry of Electronics and Information Technology (MeitY) issued a warning to X over obscene and sexually explicit content generated through Grok. X submitted a detailed response outlining its content takedown policies.
Two UK councils, South Oxfordshire and Vale of White Horse District Councils, have removed their pro…
Two UK councils, South Oxfordshire and Vale of White Horse District Councils, have removed their profiles from X due to concerns over Grok AI's ability to produce fake sexualized content. Additionally, despite X's platform-based restrictions, the stand-alone Grok app reportedly continues to generate sexualized images.
California has launched an investigation into Grok AI's generation of sexualized images.
California has launched an investigation into Grok AI's generation of sexualized images. Grok has also announced a new policy change for more protections against deepfakes and reportedly restricted its image generation capabilities to X paid subscribers, while the UK government is now threatening a ban.
A study by the Center for Countering Digital Hate estimates that Grok AI generated approximately 3 million sexualized images in just 11 days.
A study by the Center for Countering Digital Hate estimates that Grok AI generated approximately 3 million sexualized images in just 11 days. Additionally, Ofcom has formally launched an investigation into X's Grok under the Online Safety Act.
The UK government accelerated a law under the Data (Use and Access) Act, criminalizing nonconsensual…
The UK government accelerated a law under the Data (Use and Access) Act, criminalizing nonconsensual sexual deepfakes and making it illegal for AI image generating services to create such content. This is a more concrete legislative action than previously reported plans.
The UK Secretary of State formally addressed the House of Commons on January 20, outlining governmen…
The UK Secretary of State formally addressed the House of Commons on January 20, outlining government plans to enhance online safety and confirming that legislation to make it an offense to create non-consensual intimate images will be prioritized.
International scrutiny of Grok AI continues, with the European Commission and several countries, inc…
International scrutiny of Grok AI continues, with the European Commission and several countries, including Australia, India, Indonesia, and Malaysia, actively investigating or taking action against X over the generation of sexualized images.
Several major charities, including RSPB, Women's Aid, and Refuge, have ceased posting on X due to concerns over Grok AI's ability to create non-consensual and inappropriate images.
Several major charities, including RSPB, Women's Aid, and Refuge, have ceased posting on X due to concerns over Grok AI's ability to create non-consensual and inappropriate images. They cited safeguarding risks to their staff, volunteers, and supporters.
Despite X's announcement on January 14th of implementing technological measures to prevent the gener…
Despite X's announcement on January 14th of implementing technological measures to prevent the generation of sexualized images, Guardian reporters found on January 16th that the Grok app still allowed the posting of such nonconsensual content. This indicates the measures were not fully effective.
Southall Black Sisters (SBS) has decided to leave the X platform due to its tolerance, amplification…
Southall Black Sisters (SBS) has decided to leave the X platform due to its tolerance, amplification, and profiteering from abuse, citing the misuse of X's AI chatbot, Grok, to generate and circulate non-consensual sexualized images of women and children.
UK Prime Minister Keir Starmer welcomes X's new restrictions but emphasizes that the government will…
UK Prime Minister Keir Starmer welcomes X's new restrictions but emphasizes that the government will remain vigilant and Ofcom's investigation into the platform's compliance with UK law will continue.
UK Secretary of State Liz Kendall detailed the government's strategy to combat AI deepfakes, stating…
UK Secretary of State Liz Kendall detailed the government's strategy to combat AI deepfakes, stating that legislation to ban AI 'nudification' tools will be prioritized through amendments to the Crime and Policing Bill.
X (and xAI) announces it has implemented "technological measures" to prevent the Grok account from a…
X (and xAI) announces it has implemented "technological measures" to prevent the Grok account from allowing the editing of images of real people into revealing clothing (such as bikinis or underwear) in jurisdictions where it is illegal, applying to all users, including paid subscribers.
The UK government is introducing a new criminal offense to make it illegal to generate sexual images using AI without consent, prompting X to take steps to comply with the new law.
The UK government is introducing a new criminal offense to make it illegal to generate sexual images using AI without consent, prompting X to take steps to comply with the new law.
The UK government is considering banning Elon Musk's X platform under the country's online safety laws due to concerns that its Grok AI tool generated indecent images.
The UK government is considering banning Elon Musk's X platform under the country's online safety laws due to concerns that its Grok AI tool generated indecent images. Ofcom, the UK's media regulator, is involved in this assessment.
UK ministers underwent parliamentary scrutiny regarding AI's impact on copyright, data transparency, and the misuse of X's Grok chatbot for non-consensual images.
UK ministers underwent parliamentary scrutiny regarding AI's impact on copyright, data transparency, and the misuse of X's Grok chatbot for non-consensual images. During the session, government plans for AI regulation, creator rights, and safety were highlighted.
The UK government announces plans to fast-track legislation to criminalize the creation of non-conse…
The UK government announces plans to fast-track legislation to criminalize the creation of non-consensual intimate images and to make it illegal for companies to supply tools designed for such abuse.
The UK Secretary of State addressed the House of Commons, stating that the creation of degrading, no…
The UK Secretary of State addressed the House of Commons, stating that the creation of degrading, non-consensual deepfakes using Grok AI is a criminal offense under the Online Safety Act.
Ofcom, the UK's independent media regulator, launches a formal investigation into X following "deepl…
Ofcom, the UK's independent media regulator, launches a formal investigation into X following "deeply concerning reports" of Grok AI being used to create and share illegal non-consensual intimate images and child sexual abuse material, assessing potential breaches of the Online Safety Act.
The UK government is exploring potential regulatory measures against X due to concerns that its Grok…
The UK government is exploring potential regulatory measures against X due to concerns that its Grok AI chatbot has been used to create non-consensual sexualized images, including those of minors.
The UK Technology Secretary, Liz Kendall, stated that Ofcom would have the government's full support…
The UK Technology Secretary, Liz Kendall, stated that Ofcom would have the government's full support if it chose to ban X over the Grok AI scandal, prompting accusations of censorship from Elon Musk.
The UK government condemned X's decision to restrict its Grok AI image creation tool to paying subsc…
The UK government condemned X's decision to restrict its Grok AI image creation tool to paying subscribers, arguing it turns the ability to generate unlawful images into a premium service.
The UK government has ordered X to address the proliferation of indecent AI-generated images or face a potential ban in the country.
The UK government has ordered X to address the proliferation of indecent AI-generated images or face a potential ban in the country.
Elon Musk's xAI implemented restrictions on Grok's image generation feature on X, limiting it to paying subscribers, following backlash over its use to create sexualized images.
Elon Musk's xAI implemented restrictions on Grok's image generation feature on X, limiting it to paying subscribers, following backlash over its use to create sexualized images.
The European Commission has ordered X to retain all internal documents and data related to its Grok AI chatbot as part of an ongoing investigation.
The European Commission has ordered X to retain all internal documents and data related to its Grok AI chatbot as part of an ongoing investigation. This action follows backlash over the creation of sexualized images by Grok.
Grok has disabled its image creation function for the majority of users following widespread condemnation over its use to generate sexually explicit and violent imagery.
Grok has disabled its image creation function for the majority of users following widespread condemnation over its use to generate sexually explicit and violent imagery. X has also tightened Grok AI image controls and implemented technological safeguards to block such content in jurisdictions where it is illegal.
Labour leader Keir Starmer publicly condemned Grok AI's generation of sexualized content, calling it 'disgraceful' and 'unlawful'.
Labour leader Keir Starmer publicly condemned Grok AI's generation of sexualized content, calling it 'disgraceful' and 'unlawful'.
UK Technology Secretary Liz Kendall issues a strong statement, demanding swift action from X and war…
UK Technology Secretary Liz Kendall issues a strong statement, demanding swift action from X and warning of potential legal consequences, including the possibility of blocking the service in the UK, if it fails to comply with national laws.
The UK government strengthened the Online Safety Act, making 'cyberflashing' a priority offense and …
The UK government strengthened the Online Safety Act, making 'cyberflashing' a priority offense and requiring tech firms to proactively prevent unsolicited nude images, effective January 8, 2026. This legislative change compels platforms to implement measures like automated detection and stricter content policies.
French authorities initiate an investigation into thousands of sexually explicit deepfakes generated…
French authorities initiate an investigation into thousands of sexually explicit deepfakes generated and published by Grok, marking one of the first governmental actions against the AI tool's misuse.
December 2025 — 1 developments
xAI, Elon Musk's AI company, outfits Grok AI with an image editing feature, which soon after is repo…
xAI, Elon Musk's AI company, outfits Grok AI with an image editing feature, which soon after is reported to be used to generate sexualized deepfakes of real people, including children.
September 2024 — 1 developments
The Irish High Court dismissed legal proceedings against X concerning its utilization of personal data for its AI tool, Grok, on September 4, 2024.
The Irish High Court dismissed legal proceedings against X concerning its utilization of personal data for its AI tool, Grok, on September 4, 2024. This ruling adds to the legal and regulatory context surrounding X's AI practices.
May 2024 — 1 developments
X has restricted Grok AI's image editing features to all users due to concerns over generating sexualized and non-consensual images.
X has restricted Grok AI's image editing features to all users due to concerns over generating sexualized and non-consensual images. This change expands upon previous limitations that only applied to paid subscribers. The UK government continues its pursuit of AI regulation, with its Online Safety Act mandating platforms to prevent children from accessing harmful content.
April 2024 — 1 developments
X has implemented technical safeguards to prevent its Grok AI from altering images of real people to…
X has implemented technical safeguards to prevent its Grok AI from altering images of real people to show them in revealing clothing, particularly in regions where such content is illegal. The UK regulator Ofcom views these changes positively but continues its investigation into the platform's content moderation practices. Indonesia and Malaysia have banned Grok, and California is investigating its deepfake capabilities.