Dutch Court Halts Grok's AI-Generated Nudity, Imposes Heavy Fines

A Dutch court has handed down a landmark injunction against Elon Musk's xAI, formally prohibiting its Grok chatbot from producing non-consensual, sexually explicit imagery. The Amsterdam District Court order specifically bans the generation or distribution of images that strip people, including children, of their clothing without explicit permission.

The ruling, sought by the Dutch non-profit Offlimits, carries immediate financial teeth. xAI faces daily penalties of 100,000 euros for non-compliance, capped at 10 million euros. The company must also pay over 2 million euros in legal costs to the group. As a result, the social platform X can no longer offer Grok's functionality in the region.

This legal action adds to a mounting pile of troubles for xAI. Independent research from the Center for Countering Digital Hate indicated Grok produced millions of sexualized images in a short period last December, with thousands appearing to depict minors. While xAI instituted blocks in January, the court found those measures inadequate and easily circumvented.

The Dutch case is not isolated. Baltimore recently became the first major U.S. city to sue xAI, alleging deceptive marketing about Grok's safety. Separate lawsuits have been filed by teenagers in Tennessee. In Europe, regulators have opened a formal investigation under the Digital Services Act, and authorities in the UK are conducting their own probes. The legal and regulatory scrutiny presents a significant challenge for xAI's operations and public trust.

Source: CNBC