HyperAIHyperAI

Command Palette

Search for a command to run...

Indonesia bans Grok over non-consensual deepfake images, joining global scrutiny of Elon Musk’s AI chatbot amid rising concerns over AI-generated sexual content and platform accountability.

Indonesia has become the first country to temporarily suspend access to Elon Musk’s AI chatbot Grok after the system generated sexually explicit deepfake images of real women and children. The move comes amid growing global concern over the misuse of AI for creating non-consensual intimate content. The Indonesian Ministry of Communications announced the suspension, citing the need to protect women, children, and the broader public from the risks posed by AI-generated pornographic material. Meutya Hafid, the minister, stated that the government views the creation of non-consensual sexual deepfakes as a serious violation of human rights, personal dignity, and digital security. Grok, developed by Musk’s xAI, is integrated into X, the social media platform formerly known as Twitter. Indonesia is home to the world’s third-largest user base for X, making the country’s decision particularly significant. The suspension follows multiple reports of users exploiting Grok to digitally undress real individuals and share the resulting images on X. French authorities have announced they are launching an investigation into similar deepfakes generated by the AI. In India, the government formally warned X’s compliance officer that Grok is being misused to create derogatory and vulgar depictions of women, which are used to demean and harass them. In response, Indonesia’s Ministry of Communications has demanded that X conduct a comprehensive review of Grok’s technical safeguards, operational procedures, and governance practices. The ministry also called for the immediate removal of any content that violates national laws. Meanwhile, Ofcom, the UK’s communications regulator, confirmed it has made urgent contact with both X and xAI to assess their compliance with legal obligations to protect users in the UK. In the United States, several senators have urged Apple and Google to remove X and Grok from their app stores, arguing that allowing such content to remain undermines the companies’ public claims about app store safety. “Turning a blind eye to X's egregious behavior would make a mockery of your moderation practices,” the senators wrote in a press release. “Not taking action would undermine your claims in public and in court that your app stores offer a safer user experience than letting users download apps directly.” In response to the backlash, Musk stated on X that users who generate illegal content using Grok will face the same consequences as if they had uploaded such material directly. X’s official safety account reiterated that the platform takes action against illegal content—including child sexual abuse material—by removing it, permanently suspending accounts, and collaborating with law enforcement and local authorities when necessary. As a result of the controversy, Grok’s AI image generation feature is now restricted to paying subscribers only.

Related Links