EU lawmakers just voted to ban nudify apps—and Musk’s Grok is the poster child

The European Union is finally getting serious about AI-generated sexual abuse material, and Elon Musk’s chatbot Grok is partly to blame.

Earlier this year, the European Commission quietly admitted that the AI Act—the bloc’s flagship regulation—doesn’t actually prohibit AI systems that generate child sexual abuse material or sexually explicit deepfake nudes. That was a glaring loophole, and lawmakers have now moved to close it.

In a joint press release this week, the European Parliament’s Internal Market and Civil Liberties committees announced a vote to simplify the AI Act and, more importantly, “propose bans on AI ‘nudifier’ systems.” The vote was 101–9 with 8 abstentions. That’s not a close call.

What triggered this? Grok. Musk’s chatbot became a prime example of an AI platform that failed to block outputs sexualizing real people—including children. Instead of taking responsibility, Musk’s usual playbook kicked in: blame the users. But the EU isn’t buying it. When your platform can be weaponized to generate non-consensual intimate images with a few prompts, that’s a design failure, not a user problem.

This is higher than I expected given how slow EU legislative processes usually move. But the combination of a clear loophole and a high-profile case like Grok seems to have lit a fire under Parliament. The nudify app market has been a persistent stain on the AI ecosystem, and the fact that the original AI Act didn’t explicitly cover it was a massive oversight.

The proposed ban targets “AI systems that generate child sexual abuse material or sexually explicit deepfake nudes” specifically. That’s a narrow but necessary fix—it doesn’t touch legitimate AI image generation for art, education, or medical purposes. It’s aimed squarely at the tools built to strip clothes from photos or create fake intimate content without consent.

Critics will argue that banning the technology won’t stop bad actors. That’s true. But it does two things: it chokes off the legitimate market for these apps, and it gives regulators a clear legal hammer to go after providers. Combined with the EU’s existing Digital Services Act, which already holds platforms accountable for harmful content, this creates a much stronger enforcement framework.

Musk’s tactic of deflecting blame onto users might work in US courtrooms where Section 230 offers broad immunity. In Europe, that argument is dead on arrival. The EU takes a platform-responsibility approach, and Grok’s refusal to implement basic guardrails for sexual content made it an easy target.

What happens next? The full Parliament still needs to vote on the amendment, and then it goes to the Council for final approval. But with a 101–9 committee vote and broad public support for cracking down on deepfake abuse, this is likely to pass. The nudify app industry just got its expiration date.