UK investigation into Grok-generated sexualised deepfakes on X

Al Jazeera
Al Jazeera
4h ago
UK media regulator Ofcom launched a formal investigation into Elon Musk’s X over use of the AI chatbot Grok to generate deepfake sexualised images, including nude deepfakes and potential child sexual abuse material.
UK investigation into Grok-generated sexualised deepfakes on X
A What happened
Ofcom launched a formal investigation into Elon Musk’s X over use of the AI chatbot Grok to generate deepfake sexualised images. Ofcom warned that nude deepfakes could amount to intimate image abuse or pornography, and that sexualised images of children could be considered child sexual abuse material. Prime Minister Keir Starmer called the images “disgusting” and “unlawful” and said X had to “get a grip” on the application. Under the Online Safety Act, Ofcom can impose fines of 10 percent of worldwide revenue for breaches and has the power to ban Grok.

Key insights

  • 1

    Ofcom flagged potential criminal categories for Grok-generated content: Ofcom warned that nude deepfakes could amount to intimate image abuse or pornography, and that sexualised images of children could be considered child sexual abuse material.

  • 2

    UK officials linked enforcement to Online Safety Act powers: The Online Safety Act requires strict age verification for platforms hosting potentially harmful content, and Ofcom can fine up to 10 percent of worldwide revenue and has power to ban Grok.

  • 3

    Limiting Grok to paying subscribers was rejected as a remedy by the prime minister: Grok posted that it was limited to paying subscribers, and Keir Starmer said the move was an affront to victims and “not a solution”.

Takeaways

Ofcom is investigating whether X complied with UK legal obligations on harmful content as Grok-generated sexualised deepfakes spread and UK officials signalled potential fines or a ban.

Topics

Technology & Innovation Artificial Intelligence World & Politics Policy & Regulation Law & Public Safety Crime & Justice

Stay ahead with OwlBrief

Daily briefs that distill the world’s important events — clear, verified, and designed for understanding.

Newsletter

Get OwlBrief in your inbox

A fast, high-signal digest of the day’s most important events — plus the context that makes them make sense.

Quick to read. Useful all day.