Global Regulators Crack Down on Grok AI Amid Surge in Non-Consensual…

Team S · 2026-01-12T15:37:12.000Z

Authorities in multiple countries are intensifying scrutiny and taking action against Grok, the artificial intelligence chatbot developed by xAI and integrated into Elon Musk’s social media platform X, amid concerns it has been used to generate non-consensual, sexually explicit and manipulated images including deepfakes involving women and minors. The backlash reflects growing unease over how generative AI tools can be misused without robust safety safeguards and highlights emerging debates on legal accountability, digital safety and ethical AI deployment worldwide. In Southeast Asia, Malaysia and Indonesia have become the first countries to block access to Grok after regulators concluded that the tool’s image generation features were being exploited to create obscene and non-consensual content. Authorities cited repeated misuse and inadequate safeguards to prevent the spread of manipulated sexual imagery, particularly involving women and minors prompting temporary bans until effective protective measures are implemented. India’s Ministry of Electronics and Information Technology (MeitY) has issued formal notices to X Corp (the owner of X) demanding steps to prevent the creation and circulation of obscene and harmful AI-generated content linked to Grok, warning that continued non-compliance could trigger legal action under national digital safety laws. Regulators in Europe are also closely examining Grok’s operations. The European Commission has ordered X to retain all documents and data relating to Grok until the end of 2026 as part of ongoing oversight under the region’s Digital Services Act, ensuring authorities can assess the platform’s compliance with content safety rules. Meanwhile, the UK’s communications regulator, Ofcom, has launched a formal investigation into potential violations of online safety legislation, including privacy protections and safeguards against sexualised or abusive content. In response to mounting criticism, xAI and X have restricted Grok’s image generation and editing features to paying subscribers a move intended to limit wide-scale misuse of its visual models and removed thousands of harmful content pieces while disabling accounts linked to violations. However, critics argue that these measures do not fully address the underlying lack of proactive moderation and fail-safe AI controls necessary to prevent illegal or abusive outputs. Industry and legal experts say the situation highlights how regulators are rapidly adapting to the challenges posed by generative AI platforms and deepfakes, particularly where they intersect with privacy rights, child protection laws and consent frameworks. Across jurisdictions, the push for clearer governance structures, accountability mechanisms and built-in content safeguards signals a broader shift toward responsible AI deployment as technologies become increasingly capable and potentially harmful in the absence of robust controls. #GrokAI, #AIRegulation, #Deepfakes, #DigitalSafety, #xAI, #GenerativeAI, #AIethics, #ContentModeration, #AIBacklash, #Malaysia, #Indonesia, #India, #EU, #UK, #OnlineSafety, #TechPolicy, #RegulatoryAction

Member Login Get Access

Global Regulators Crack Down on Grok AI Amid Surge in Non-Consensual… | Newnex