Elon Musk’s social media platform X is under intense scrutiny after its AI chatbot, Grok, was reportedly used to create non-consensual sexualized images, mostly of women, and in some cases, children. The revelations have prompted global investigations and temporary bans.

Indonesia and Malaysia blocked Grok after users could manipulate photos with prompts like “put her in a bikini”, generating explicit content without consent. On Monday, the UK regulator Ofcom launched a formal probe, which could result in sanctions or restrictions.

While X has limited Grok’s image-generation features to paid subscribers ($8/month), critics argue this does not protect victims and instead monetizes access to harmful technology. Experts insist the platform itself bears responsibility:

“The content wouldn’t exist without the tool they built,”
— Ben Winters, Consumer Federation of America

The case exposes the growing risks AI poses to women online, highlighting how technological innovation is outpacing regulation and leaving individuals vulnerable to harassment, exploitation, and digital abuse.

Governments and advocacy groups worldwide are now calling for stricter safeguards and accountability, marking a critical moment in the fight against AI-enabled sexual exploitation.

Source: WYPR