NEWS  /  Brief News

California Attorney General Orders xAI to Stop Generating Deepfake Content

Jan 19, 2026, 2:29 a.m. ET

The office of California Attorney General Rob Bonta has issued a “cease and desist” letter to xAI, demanding the company immediately stop generating and distributing deepfake content through its chatbot Grok, following repeated allegations that the AI produces unauthorized sexually explicit material.

The letter specifies that xAI must prevent Grok from creating any harmful images without consent, including content involving minors. Continued generation or distribution of such material would violate multiple California laws, including those covering deepfake pornography, child sexual abuse imagery, illegal recordings, and unfair business practices. xAI has been ordered to comply by 5 p.m. on Jan 20.

Earlier this week, X platform said it had restricted Grok’s functionality, though reports indicate that inappropriate content can still be generated via X and Grok apps. The attorney general had previously announced an investigation into xAI for producing and publishing explicit content without consent.

Please sign in and then enter your comment