X (Twitter) AI Content and Data Policies
The UK government is implementing new AI regulations, including transparency obligations for AI-generated content from August 2, 2026, watermarking rules from December 2, 2026, and a new law effective February 2026 mandating tech companies to remove non-consensual intimate images within 48 hours. These measures address concerns over X (Twitter) and its Grok AI chatbot, which faced regulatory investigations and public backlash in early 2026 for generating non-consensual sexualized images. As of July 29, 2026, X has updated its terms of service to include AI prompts and outputs as user "Content" and restricted Grok's image features to paying subscribers, while Britain's data watchdog launched a wider investigation into X and xAI regarding personal data law compliance related to Grok's deepfake generation.
Timeline
Want updates on this thread?
Track this storyTimeline of developments
July 2026 — 4 developments
UK Enacts Law Against Non-Consensual Intimate Images, Effective February 2026
A new UK law, effective February 2026, mandates tech companies to remove non-consensual intimate images within 48 hours or face substantial fines. This legislation aims to protect women and girls from image-based abuse and is part of the UK's evolving AI regulation approach.
UK Sets AI Content Rules; X Updates Deepfake Policy with Provenance Labels
The UK government is set to implement transparency obligations for AI-generated content from August 2, 2026, and watermarking rules from December 2, 2026, as part of its AI regulation. X (Grok) has also introduced incremental safety updates to its deepfake policy, including mandatory provenance labels for AI-generated audio and video that could influence public opinion.
UK Government Engages X on AI Policies Amidst Departmental Boycott and FCA Review
The UK's Financial Conduct Authority has published a review proposing recommendations for regulating AI's impact on financial decision-making. Additionally, UK government departments have stopped using X due to abuse and misinformation, and the government is engaging with X regarding its AI content policies, particularly concerning the Grok AI chatbot's image generation features.
UK to Implement Prohibition on AI-Generated Non-Consensual Intimate Imagery in December 2026
A new prohibition targeting AI systems that generate non-consensual intimate imagery and CSAM will take effect in the UK on December 2, 2026. This follows controversies in early 2026 where X's AI chatbot Grok generated non-consensual sexualized images, leading to regulatory investigations and X implementing stricter content moderation and updating its terms of service.
May 2026 — 5 developments
UK Data Watchdog Investigates X and xAI Over Grok Deepfake Generation
Britain's data watchdog has launched a wider investigation into X and xAI concerning compliance with personal data law related to Grok's deepfake generation. This follows public backlash and scrutiny from the UK government over harmful AI-generated content.
X Admits Grok Content Review System is 'Broken' Amidst AI Moderation Issues
X's head of product admitted that the platform's automated Grok content review system is "broken" due to an influx of harmless posts being incorrectly flagged as sensitive content. X has also updated its terms of service to include AI prompts and outputs as user "Content," granting X a license for AI training.
X Restricts Grok AI Image Features Amid Deepfake Surge, IPO Filing Flags Risks
SpaceX's IPO filing disclosed risks associated with Grok's NSFW AI features, including the potential generation of explicit imagery, due to a surge in "nudified" deepfakes. X has restricted these image features to paying subscribers. The company has also agreed to a crackdown on illegal hate speech and terrorist content in the UK.
UK Government Shifts AI Data Policy; X Restricts Grok AI Features
The UK government has shifted its AI policy, moving from an 'opt-out' to a mandatory licensing model for AI training data. X has also restricted its Grok AI image features and implemented geoblocking to combat misuse.
X Prohibits Use of Content for AI Training Without Licensing Agreement
X updated its developer agreement effective January 15, 2026, prohibiting the use of its content and API data for training large language models without a formal licensing agreement. This policy change aims to prevent AI firms from using X's user-generated content without compensation.
April 2026 — 7 developments
UK government threatens to ban X over AI-generated child abuse images
The UK government has threatened to ban X if it does not remove AI-generated child abuse images, calling the platform's response "insulting." The government is also working to amend legislation to criminalize the creation of non-consensual intimate images using AI. Ofcom has launched an investigation into whether X has breached the Online Safety Act.
UK Government to Introduce Binding Regulations for Top AI Models
The UK Labour government plans to introduce binding regulations for the most powerful AI models as part of its "pro-innovation approach to AI regulation." X has restricted its AI image features following backlash and regulatory investigations by the UK's Ofcom.
X updates privacy policy to allow third-party AI training on user data, enabling new revenue stream
X has updated its privacy policy to permit third-party AI model training on user data, unless users opt out, establishing a new data licensing revenue stream. This change occurs while X faces ongoing scrutiny over its AI chatbot Grok's generation of inappropriate content.
X suspends creators from revenue-sharing program for undisclosed AI-generated conflict videos
X has started suspending creators from its revenue-sharing program who post AI-generated videos of armed conflicts without proper disclosure. This action follows scrutiny of platforms regarding the misuse of AI-generated content and warnings from Apple about potential App Store removal for its Grok AI app due to its ability to generate sexualized deepfake images.
UK Government Plans Mandatory Labels for AI-Generated Content
The UK government plans to make labels for artificially generated content mandatory as part of a strategy to balance consumer protection against disinformation and deepfakes with the growth of the AI sector. Technology Minister Liz Kendall announced the initiative, which is a new regulatory step amidst ongoing discussions about AI's societal impact.
UK and Australian Regulators Investigate X Over Grok's Alleged Illegal Content Generation
UK and Australian regulators have opened investigations into X for allegedly failing to prevent Grok from generating illegal content. Ofcom, the UK's online safety regulator, is preparing enforcement powers against X for non-compliance with the Online Safety Act, which could include significant fines and potential access restrictions.
Malaysia and Indonesia block Grok; Apple warns X; UK seeks new AI powers
Malaysia and Indonesia have blocked access to Grok entirely, and Apple warned X about potential App Store removal due to deepfake issues. The UK government is seeking new powers to amend the Online Safety Act to address AI harms, with ministers affirming support for the regulator Ofcom to take action, including a potential ban on X.
March 2026 — 5 developments
Dutch Court Orders X and Grok to Cease Generating Non-Consensual Sexualized Imagery
A Dutch court has ordered X and Grok to immediately cease generating non-consensual sexualized imagery and child pornography within the Netherlands, with daily fines imposed for non-compliance.
X expands Grok's capabilities with Grok Imagine for video story creation
X has expanded Grok's capabilities with the introduction of Grok Imagine, a feature enabling video story creation. This follows previous measures by X to prevent its AI chatbot from generating sexualized images of real people. Additionally, X updated its terms of service in March 2026 to classify AI prompts and outputs as 'Content' and grant broad AI-training rights, while the UK government launched a consultation in March 2026 regarding children's online experiences and AI, including new obligations for AI chatbots.
X restricts Grok's image generation, blocks content, and updates developer agreement
X has implemented new restrictions on Grok's image generation, preventing the AI from editing images of real people in revealing clothing, and has blocked approximately 3,500 pieces of content and deleted over 600 accounts in India. The platform has also updated its developer agreement to prohibit the use of its content for training large language models, as investigations by the UK's Ofcom and the European Commission continue.
UK Technology Minister Liz Kendall warns X over 'monetising abuse' with Grok image restrictions
UK Technology Minister Liz Kendall warned X that its recent steps to restrict Grok's image creation to paid users are insufficient and amount to 'monetising abuse.' The UK government has threatened X with potential backstop powers, including a de facto ban, if the platform fails to comply with the law, while Ofcom continues its investigation into potential breaches of the Online Safety Act.
X restricts Grok AI image features to paid subscribers after deepfake criticism
X has restricted Grok AI's image editing and generation features to paid subscribers following criticism over its role in creating non-consensual sexualized deepfakes. UK Prime Minister Keir Starmer called the restriction 'insulting' to victims, and the UK's media regulator Ofcom is investigating X for potential breaches of the Online Safety Act, with a platform ban being a possibility.
February 2026 — 2 developments
UK Regulators ICO and Ofcom Investigate X and Grok AI Over 'Bikini' Incident
UK regulators ICO and Ofcom have launched coordinated investigations into X and its Grok AI chatbot following the "put her in a bikini" incident. The UK government is also proposing to include AI chatbots within the scope of the Online Safety Act to hold developers responsible for user protection.
Brazil orders X to halt Grok AI's sexually explicit image generation; Indonesia blocks Grok
Brazilian authorities have ordered X to immediately cease its Grok AI chatbot's generation of sexually explicit images. This action follows mounting international concern over the AI's capacity to create sexualized deepfakes. In parallel, Indonesia has blocked Grok entirely, intensifying global scrutiny of the tool.
January 2026 — 36 developments
UK Creative Industries Urge Government to Regulate Generative AI Development
UK creative industries are urging the government to implement a regulatory framework for generative AI development, citing significant economic risks to authors, illustrators, musicians, and photographers.
US Risk Assessment Finds xAI's Grok Chatbot Unsafe for Children and Teenagers
A risk assessment conducted in the US has concluded that xAI's Grok chatbot is unsafe for children and teenagers due to inadequate age verification, weak safety guardrails, and the frequent generation of sexual, violent, and inappropriate content.
xAI Sued for Alleged Deepfake Creation by Grok AI Chatbot
A class action lawsuit has been filed against xAI, the operator of Grok, in the United States District Court for the Northern District of California, alleging the AI chatbot was used to create and publicly post a deepfake image.
CBS News investigation finds X's Grok AI still allows non-consensual digital undressing
A CBS News investigation revealed that X's Grok AI continues to allow users to digitally undress people without consent, with the 'bikini-fy' tool found functional for verified users in the UK, US, and EU.
European Commission investigates X's Grok AI over explicit images; X updates user terms
The European Commission has initiated a formal investigation into X's Grok AI under the EU's Digital Services Act for generating sexually explicit images. Separately, X updated its Terms of Service, effective January 15, 2026, to explicitly hold users responsible for AI prompts and outputs.
Tech Analysts Claim to Uncover Method for Grok to Reveal User Content Moderation Scores
Tech analysts on X claim to have found a way to get Grok to reveal users' content moderation scores, which indicate how offensive the platform's AI thinks your account is.
MeitY warns X over obscene content generated via Grok; X responds with takedown policies
On January 2, 2026, the Ministry of Electronics and Information Technology (MeitY) issued a warning to X over obscene and sexually explicit content generated through Grok. X submitted a detailed response outlining its content takedown policies.
UK Councils Remove X Profiles Over Grok AI Sexualized Content Concerns
Two UK councils, South Oxfordshire and Vale of White Horse District Councils, have removed their profiles from X due to concerns over Grok AI's ability to produce fake sexualized content. Additionally, despite X's platform-based restrictions, the stand-alone Grok app reportedly continues to generate sexualized images.
California investigates Grok AI for sexualized images; Grok restricts image generation, UK threatens ban
California has launched an investigation into Grok AI's generation of sexualized images. Grok has also announced a new policy change for more protections against deepfakes and reportedly restricted its image generation capabilities to X paid subscribers, while the UK government is now threatening a ban.
Ofcom Investigates X's Grok AI After Study Estimates 3 Million Sexualized Images Generated
A study by the Center for Countering Digital Hate estimates that Grok AI generated approximately 3 million sexualized images in just 11 days. Additionally, Ofcom has formally launched an investigation into X's Grok under the Online Safety Act.
UK government criminalizes nonconsensual sexual deepfakes under new law
The UK government accelerated a law under the Data (Use and Access) Act, criminalizing nonconsensual sexual deepfakes and making it illegal for AI image generating services to create such content. This is a more concrete legislative action than previously reported plans.
UK Secretary of State Outlines Online Safety Plans, Prioritizes Non-Consensual Image Legislation
The UK Secretary of State formally addressed the House of Commons on January 20, outlining government plans to enhance online safety and confirming that legislation to make it an offense to create non-consensual intimate images will be prioritized.
European Commission, Australia, India, Indonesia, and Malaysia investigate X over Grok AI sexualized images
International scrutiny of Grok AI continues, with the European Commission and several countries, including Australia, India, Indonesia, and Malaysia, actively investigating or taking action against X over the generation of sexualized images.
Major Charities Cease Posting on X Over Grok AI's Inappropriate Image Concerns
Several major charities, including RSPB, Women's Aid, and Refuge, have ceased posting on X due to concerns over Grok AI's ability to create non-consensual and inappropriate images. They cited safeguarding risks to their staff, volunteers, and supporters.
Guardian Reporters Find Grok App Still Allows Sexualized Images Despite X's Prevention Measures
Despite X's announcement on January 14th of implementing technological measures to prevent the generation of sexualized images, Guardian reporters found on January 16th that the Grok app still allowed the posting of such nonconsensual content. This indicates the measures were not fully effective.
Southall Black Sisters leaves X platform over abuse tolerance and Grok misuse for non-consensual images
Southall Black Sisters (SBS) has decided to leave the X platform due to its tolerance, amplification, and profiteering from abuse, citing the misuse of X's AI chatbot, Grok, to generate and circulate non-consensual sexualized images of women and children.
UK Prime Minister Keir Starmer welcomes X's new restrictions, emphasizes continued vigilance
UK Prime Minister Keir Starmer welcomes X's new restrictions but emphasizes that the government will remain vigilant and Ofcom's investigation into the platform's compliance with UK law will continue.
UK Secretary Liz Kendall announces prioritization of AI 'nudification' tool ban through Crime and Policing Bill amendments
UK Secretary of State Liz Kendall detailed the government's strategy to combat AI deepfakes, stating that legislation to ban AI 'nudification' tools will be prioritized through amendments to the Crime and Policing Bill.
X and xAI implement measures to prevent Grok from editing images into revealing clothing
X (and xAI) announces it has implemented "technological measures" to prevent the Grok account from allowing the editing of images of real people into revealing clothing (such as bikinis or underwear) in jurisdictions where it is illegal, applying to all users, including paid subscribers.
UK government introduces new criminal offense for AI-generated sexual images without consent
The UK government is introducing a new criminal offense to make it illegal to generate sexual images using AI without consent, prompting X to take steps to comply with the new law.
UK government considers banning Elon Musk's X platform over Grok AI indecent image concerns
The UK government is considering banning Elon Musk's X platform under the country's online safety laws due to concerns that its Grok AI tool generated indecent images. Ofcom, the UK's media regulator, is involved in this assessment.
UK ministers face scrutiny on AI's impact on copyright, data, and Grok misuse
UK ministers underwent parliamentary scrutiny regarding AI's impact on copyright, data transparency, and the misuse of X's Grok chatbot for non-consensual images. During the session, government plans for AI regulation, creator rights, and safety were highlighted.
UK Government Announces Plans to Criminalize Non-Consensual Intimate Images
The UK government announces plans to fast-track legislation to criminalize the creation of non-consensual intimate images and to make it illegal for companies to supply tools designed for such abuse.
UK Secretary of State: Grok AI deepfakes are criminal under Online Safety Act
The UK Secretary of State addressed the House of Commons, stating that the creation of degrading, non-consensual deepfakes using Grok AI is a criminal offense under the Online Safety Act.
Ofcom launches formal investigation into X over Grok AI's alleged role in illegal content
Ofcom, the UK's independent media regulator, launches a formal investigation into X following "deeply concerning reports" of Grok AI being used to create and share illegal non-consensual intimate images and child sexual abuse material, assessing potential breaches of the Online Safety Act.
UK government explores regulatory action against X over Grok AI's non-consensual image generation
The UK government is exploring potential regulatory measures against X due to concerns that its Grok AI chatbot has been used to create non-consensual sexualized images, including those of minors.
UK Technology Secretary Liz Kendall offers Ofcom full support to ban X over Grok AI scandal
The UK Technology Secretary, Liz Kendall, stated that Ofcom would have the government's full support if it chose to ban X over the Grok AI scandal, prompting accusations of censorship from Elon Musk.
UK government condemns X's decision to restrict Grok AI image creation to paying subscribers
The UK government condemned X's decision to restrict its Grok AI image creation tool to paying subscribers, arguing it turns the ability to generate unlawful images into a premium service.
UK Government Orders X to Address AI-Generated Indecent Images or Face Ban
The UK government has ordered X to address the proliferation of indecent AI-generated images or face a potential ban in the country.
xAI restricts Grok image generation to paying X subscribers after sexualized image backlash
Elon Musk's xAI implemented restrictions on Grok's image generation feature on X, limiting it to paying subscribers, following backlash over its use to create sexualized images.
European Commission orders X to retain Grok AI data amid investigation into sexualized image creation
The European Commission has ordered X to retain all internal documents and data related to its Grok AI chatbot as part of an ongoing investigation. This action follows backlash over the creation of sexualized images by Grok.
Grok disables image creation for most users after explicit and violent imagery generation
Grok has disabled its image creation function for the majority of users following widespread condemnation over its use to generate sexually explicit and violent imagery. X has also tightened Grok AI image controls and implemented technological safeguards to block such content in jurisdictions where it is illegal.
Keir Starmer condemns Grok AI's generation of sexualized content as 'disgraceful' and 'unlawful'
Labour leader Keir Starmer publicly condemned Grok AI's generation of sexualized content, calling it 'disgraceful' and 'unlawful'.
UK Technology Secretary Liz Kendall warns X of potential ban over non-compliance with national laws
UK Technology Secretary Liz Kendall issues a strong statement, demanding swift action from X and warning of potential legal consequences, including the possibility of blocking the service in the UK, if it fails to comply with national laws.
UK Government Strengthens Online Safety Act, Prioritizing Cyberflashing Prevention by 2026
The UK government strengthened the Online Safety Act, making 'cyberflashing' a priority offense and requiring tech firms to proactively prevent unsolicited nude images, effective January 8, 2026. This legislative change compels platforms to implement measures like automated detection and stricter content policies.
French Authorities Investigate Grok Over Thousands of Sexually Explicit Deepfakes
French authorities initiate an investigation into thousands of sexually explicit deepfakes generated and published by Grok, marking one of the first governmental actions against the AI tool's misuse.
December 2025 — 1 developments
xAI's Grok AI generates sexualized deepfakes of real people, including children
xAI, Elon Musk's AI company, outfits Grok AI with an image editing feature, which soon after is reported to be used to generate sexualized deepfakes of real people, including children.
September 2024 — 1 developments
Irish High Court dismisses legal challenge against X over Grok AI data use
The Irish High Court dismissed legal proceedings against X concerning its utilization of personal data for its AI tool, Grok, on September 4, 2024. This ruling adds to the legal and regulatory context surrounding X's AI practices.
May 2024 — 1 developments
X restricts Grok AI image editing features for all users due to harmful content concerns
X has restricted Grok AI's image editing features to all users due to concerns over generating sexualized and non-consensual images. This change expands upon previous limitations that only applied to paid subscribers. The UK government continues its pursuit of AI regulation, with its Online Safety Act mandating platforms to prevent children from accessing harmful content.
April 2024 — 1 developments
X implements AI image safeguards amid UK regulatory pressure over deepfakes
X has implemented technical safeguards to prevent its Grok AI from altering images of real people to show them in revealing clothing, particularly in regions where such content is illegal. The UK regulator Ofcom views these changes positively but continues its investigation into the platform's content moderation practices. Indonesia and Malaysia have banned Grok, and California is investigating its deepfake capabilities.