The two Southeast Asian countries became the first in the world to ban access to Elon Musk's Grok over the weekend after the AI chatbot was used to produce sexually explicit and non-consensual images.
Indonesian regulators temporarily blocked the bot on Saturday, with Malaysia following suit on Sunday.
Some images also involved children.
"The government sees non-consensual sexual deepfakes as a serious violation of human rights, dignity and the safety of citizens in the digital space," Indonesia's Communication and Digital Affairs Minister Meutya Hafid said in a statement Saturday.
The Communications and Multimedia Commission (MCMC) issued a statement on Sunday saying it was blocking access to Grok after it was repeatedly used "to generate obscene, sexually explicit, indecent, grossly offensive, and non-consensual manipulated images, including content involving women and minors."
The MCMC said it had contacted Musk's X and xAI — the AI company behind Grok — demanding effective safeguards.
According to MCMC, the responses failed to address the risk posed by the AI tools, instead referring to user-initiated reporting mechanisms.
"MCMC considers this insufficient to prevent harm or ensure legal compliance," it said.
It added that the AI bot would remain blocked until effective safeguards were implemented.
Grok is just one of the contestants in the AI race that includes offerings from Google and Microsoft, among others.
AI tools have repeatedly sparked questions over a lack of regulations, with regulators struggling to keep up with the abilities of the new technology in some cases, and in other cases being explicitly told to limit regulation, as in the US under the Trump administration.
Musk, who has been a close ally of President Trump, launched Grok in 2023 with free access given to users on X.
In summer 2025, the company then launched Grok Imagine, an image generation feature, with a so-called "spicy mode" that permitted the creation of adult content.
Complaints over Grok's image generation have come from the EU, the UK, India and France. In reponse, the image generation feature was limited to paying X users only, but critics say this did little to resolve the issue.
Editorial Context & Insight
Original analysis and synthesis with multi-source verification
Methodology
This article includes original analysis and synthesis from our editorial team, cross-referenced with multiple primary sources to ensure depth, accuracy, and balanced perspective. All claims are fact-checked and verified before publication.
Primary Source
Verified Source
Deutsche Welle
Editorial Team
Senior Editor
Sofia Andersson
Specializes in World coverage
Quality Assurance
Associate Editor
Fact-checking and editorial standards compliance
