People involved in the creation or attempted creation of non-consensual intimate images will be breaking the law starting this week due to the rise of sexualized deepfakes on Elon Musk’s X platform. According to Technology Secretary Liz Kendall, images generated by X’s AI chatbot, Grok, are considered tools of abuse, leading to a formal investigation by Ofcom into the social media platform.
Addressing the Commons, Kendall announced the implementation of a new law prohibiting the creation or seeking of non-consensual intimate images. Additionally, she highlighted that apps enabling the fabrication of fake nude images will be outlawed under the Crime and Policing Bill currently progressing through Parliament. This legislation aims to prevent companies from supplying tools designed for creating non-consensual content, aiming to tackle the issue at its root.
Meanwhile, Ofcom’s inquiry will determine if X has failed to meet its legal obligations under the Online Safety Act. Penalties for non-compliance could include fines of up to £18 million or 10% of global revenue, with the authority empowered to impose business disruption measures if necessary.
Kendall emphasized the detrimental impact of such content, particularly on women and girls, emphasizing that these images are not harmless but are instead weapons of abuse designed to harass and violate individuals’ dignity. Urging swift action, she stressed the need for X to take proactive steps to prevent the sharing of illegal and abhorrent material on its platform.
In response to concerns raised at a Labour Party meeting, Keir Starmer condemned the actions of Grok and X, emphasizing the government’s commitment to protecting the vulnerable against harm and abuse. Ofcom’s recent contact with X and xAI raised alarms over potential misuse of Grok in creating sexualized images of children, prompting a prioritized investigation to ensure compliance with UK laws.
Reports from the Internet Watch Foundation revealed the discovery of criminal imagery involving minors potentially generated through Grok. In response, X acknowledged shortcomings in safeguards and committed to addressing them promptly. Notably, X announced that deepfake creation through Grok will now be a paid premium service, a decision criticized by authorities as an inappropriate monetization of abusive practices.
Readers can select Daily Mirror as a ‘Preferred Source’ on Google News for convenient access to valued news updates.