Grok, an AI product launched by Elon Musk’s xAI in late December 2025, has come under intense scrutiny following a Dutch court ruling. The court ordered xAI to cease generating and distributing nude images without consent, a significant legal development in the realm of artificial intelligence and its responsibilities.
The ruling, issued on March 26, 2026, imposes fines of 100,000 euros per day for noncompliance. This decision marks one of the first instances where a court has addressed the liability of AI systems for creating sexualized images, particularly in light of the European Parliament’s recent approval of a ban on AI systems generating sexualized deepfakes.
The case was initiated by the organizations Offlimits and Fonds Slachtofferhulp, which argued that Grok had not implemented adequate measures to prevent the generation of non-consensual content. The court found that xAI had generated approximately 3 million sexualized images between December 29, 2025, and January 8, 2026, including 23,000 images that appeared to depict children.
Robbert Hoving, a representative for the plaintiffs, emphasized the responsibility of xAI, stating, “The burden is on the company to make sure its tools are not used to create and distribute nonconsensual sexual images, including of children.” This sentiment was echoed by the court, which rejected xAI’s argument that liability lies solely with users issuing prompts.
In a decisive statement, Karlijn Han, representing the court, noted, “Grok and X are ordered to cease offering the undressing functionality that makes it possible to undress Dutch people.” The court’s findings raised doubts about xAI’s claims regarding the adequacy of their preventive measures, particularly given that the generation of such content was still possible even after the company had denied its capability.
The court’s injunction applies not only to xAI but also to its EU-facing entity, XIUC. As part of the ruling, xAI must confirm in writing to Offlimits how it has complied with the court’s order, further emphasizing the urgency of the situation.
Observers are closely monitoring the implications of this ruling, as it sets a precedent for the accountability of AI technologies in the creation of potentially harmful content. The court’s decision could influence future regulations and the operational frameworks of AI companies across Europe.
Details remain unconfirmed regarding the specific measures xAI plans to implement in response to the court’s order. However, the ruling underscores the growing demand for stricter regulations governing AI and its applications in society.