X (Twitter) — Enforcement
Executive Summary
California Attorney General Rob Bonta issued a cease-and-desist letter to xAI over Grok's generation of deepfake images and child sexual abuse material (CSAM). The letter cited violations of California law and demanded that xAI implement safeguards to prevent the generation of non-consensual intimate imagery and CSAM within 30 days.
What Happened
On January 16, 2026, California Attorney General Rob Bonta sent a cease-and-desist letter to xAI demanding the company immediately stop the creation and distribution of deepfake nonconsensual intimate images and child sexual abuse material (CSAM) generated by its AI chatbot Grok. The letter cited violations of multiple California laws including Civil Code section 1708.86 and Penal Code sections 311 and 647(j)(4), and required xAI to demonstrate compliance steps within five days and implement safeguards within thirty days. The action followed an investigation announced earlier that week into reports that Grok's "spicy" mode feature was being used to create nonconsensual sexual imagery of women and minors that was being used to harass victims across the internet, including on the social m...
Who Is Affected
Women and girls, including minors, are the primary victims affected by the nonconsensual sexually explicit material and CSAM being generated through Grok and distributed across the internet to harass them. Users of xAI's Grok service who create such illegal content face consequences equivalent to uploading illegal content directly, according to X's safety account. The enforcement action directly impacts xAI as a company operating in California, and similar investigations have been opened by authorities in Japan, Canada, and Britain, while Malaysia and Indonesia have temporarily blocked the platform.
Why It Matters
This represents state-level law enforcement action against an AI company for facilitating what authorities describe as "large-scale production" of illegal sexually explicit content, highlighting how generative AI tools have created a surge in nonconsensual sexual material across platforms. The enforcement demonstrates that AI companies can be held legally accountable not just for content they directly create but also for facilitating and aiding users in creating illegal content. The issue has drawn attention from multiple countries and prompted Congressional inquiry, with lawmakers sending letters to major tech companies including X, Reddit, Snap, TikTok, Alphabet, and Meta asking how they plan to address sexualized deepfakes.
What You Should Do
If you are a victim of nonconsensual intimate imagery or deepfakes created through Grok or other AI tools, you can report the content to the platform where it appears and may have legal recourse under California Civil Code section 1708.86 and similar laws in other jurisdictions. Users should avoid using AI image generation tools to create nonconsensual sexual content, as doing so violates criminal and civil laws and can result in serious legal consequences. If you use Grok or similar AI services, be aware that creating illegal content will result in enforcement action equivalent to directly uploading such material.
AI-Assisted
Event summaries are generated by Claude AI from verified sources and reviewed by humans before publication.
Sources