In a forceful move underscoring rising global concerns over artificial intelligence (AI) safety and digital rights, the Indian government has delivered a 72‑hour ultimatum to Elon Musk’s social media platform X (formerly Twitter) to address widespread misuse of its Grok AI chatbot for generating objectionable, sexually explicit, and non‑consensual deepfake images — particularly targeting women and, in some reports, minors.
The Ministry of Electronics and Information Technology (MeitY) has formally issued the notice, demanding that X immediately remove all such content from the platform and submit a comprehensive Action Taken Report (ATR) within three days. The government’s directive follows mounting complaints that Grok’s image-editing and generation capabilities are being exploited by users to create and disseminate defamatory, obscene, and invasive AI-generated visuals without consent, causing serious concerns over privacy, dignity, and legal violations.
Heightened AI Misuse Fuels Government Action
According to the MeitY notice, Grok is being misused to produce sexually explicit and “derogatory or vulgar” images of individuals — particularly women — by leveraging prompts that manipulate photographs into suggestive forms. Instances cited include altering ordinary profile photos into bikini or minimal‑clothing images and circulating them across X, often without the subjects’ knowledge or consent.
The government characterises this trend as a serious failure of platform‑level safeguards and a gross misuse of artificial intelligence technologies that could undermine legal protections aimed at preventing harassment, exploitation, and violation of personal dignity.
Legal Framework and Compliance Pressures
In its ultimatum, MeitY has framed its concerns within India’s robust digital regulatory landscape. The notice highlights potential breaches of the Information Technology Act, 2000, the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, and provisions of the Indecent Representation of Women (Prohibition) Act and the Protection of Children from Sexual Offences (POCSO) Act.
Crucially, the government warned that failure to comply within 72 hours could lead to severe ramifications for X, including the loss of safe harbour protections under Section 79 of the IT Act — legal safeguards that currently shield intermediaries from liability for user-generated content if they demonstrate statutory “due diligence.” Non-compliance could also expose X and its responsible officers to prosecution under applicable criminal and civil statutes.
Government Directives to X: Technical and Governance Overhaul
The ultimatum mandates a multi-pronged response from X, including:
- Immediate removal or disabling of all identified obscene and unlawful content.
- A full technical and procedural review of Grok’s prompt-processing, output generation, image handling, and safety guardrail mechanisms.
- Strengthening enforcement of platform terms, including suspension and termination of violating user accounts.
- Detailed elucidation of the role and oversight exercised by X’s Chief Compliance Officer in India.
Copies of the MeitY notice have also been circulated to relevant ministries — including Home Affairs, Women and Child Development, and Information & Broadcasting — as well as key statutory bodies such as the National Commission for Women and the National Commission for Protection of Child Rights, signalling a coordinated enforcement posture across government agencies.
Broader Implications for AI Regulation and Digital Safety
India’s ultimatum arrives amid intensifying global scrutiny over AI’s rapid integration into everyday platforms and the ethical ramifications of its misuse. Digital rights advocates have long warned that unchecked AI image manipulation tools can enable non‑consensual deepfakes, defamation, harassment, and exploitation, particularly of women and vulnerable populations.
Experts believe that the government’s decisive stance could set a precedent for AI governance both domestically and internationally, emphasizing that technological innovation must be balanced with robust protections for privacy, consent, and public safety. Continued regulatory engagement — including potential updates to AI-specific compliance frameworks — may emerge as lawmakers grapple with preventing harm while not stifling innovation.
As the 72-hour deadline approaches, all eyes will be on X’s response and whether the platform’s corrective measures satisfy India’s stringent digital safety and legal requirements — a test case in the ongoing global debate over AI accountability.
