Malaysia to Pursue Legal Action Against X and xAI Over Grok AI Concerns

Malaysian authorities have announced that they will initiate legal action against Elon Musk’s social media platform X and its affiliated company xAI due to serious concerns about user safety stemming from their AI chatbot, Grok.

The regulatory move comes amid mounting criticism over Grok, which has been reportedly misused to generate and share sexualized imagery of women and children through simple text prompts. Such actions have sparked global outrage and raised significant ethical and legal questions regarding AI content moderation.

The Malaysian Communications and Multimedia Commission (MCMC) initially suspended access to Grok on Sunday, citing potential violations of Malaysian law. According to the regulator, solicitors have now been engaged to formally commence legal proceedings against X and xAI, although the exact nature of the proceedings has not been disclosed. Grok is embedded into both X and xAI platforms, which are widely used across Malaysia and beyond.

“This legal action is related to the failure of X and xAI to ensure the safety of users in Malaysia when interacting with Grok,” the MCMC said in an official statement. Authorities noted that they had identified the misuse of Grok to create and disseminate content considered obscene, sexually explicit, and non-consensually manipulated, with material involving women and minors being of particular concern.

The regulator further highlighted that X and xAI had previously received formal notices on January 3 and January 8, requesting the removal of harmful content generated via Grok. However, the companies reportedly failed to take any corrective measures. The MCMC also criticized both companies for not enforcing their internal policies on harmful content, emphasizing that they could still be held legally responsible even if the offensive material was user-generated.

Malaysia’s action follows Indonesia, which became the first country to block Grok completely on Saturday. Meanwhile, in other regions, Grok’s image-generation functionality has been restricted to paying subscribers only. However, this measure has faced criticism from European regulators and digital rights advocates, who argue that restricting access for non-paying users does not adequately prevent the creation of sexualized deepfakes or safeguard vulnerable populations.

The growing international concern over Grok underscores the challenges of regulating AI-powered tools while balancing innovation with user safety. Experts have warned that without stringent oversight, AI platforms risk becoming channels for harmful, illegal, and non-consensual content, raising questions about global governance and corporate accountability in the tech space.