Obscene Images Controversy: ‘X’ Accepts Lapse; Thousands Of Posts And 600 Accounts Removed
Social media platform X has admitted lapses in moderating AI-generated content and assured compliance with Indian law after blocking thousands of posts and removing hundreds of accounts linked to obscene imagery. The move comes following serious concerns raised by the Indian government over the misuse of the platform’s AI chatbot, Grok.
According to government sources quoted by news agency ANI, “The social media platform ‘X’ has admitted its mistake and stated that it will comply with Indian law. Around 3,500 pieces of content were blocked, and over 600 accounts were deleted. Going forward, X will not allow obscene imagery.” The development comes after the Ministry of Electronics and Information Technology (MeitY) flagged the circulation of harmful and obscene AI-generated content on the platform.
MeitY had earlier written to X, pointing out serious failures in moderating content generated through AI tools such as Grok. The ministry expressed concern that Grok and other services linked to xAI were allegedly being misused to create and distribute obscene or non-consensual images, particularly targeting women and violating their dignity and privacy. The letter also sought a detailed report on actions taken by the company and demanded the immediate removal of illegal material.
In response, X submitted a reply to the ministry. However, officials reportedly described the response as “not adequate,” stating that it lacked clarity on concrete actions taken and did not clearly outline preventive mechanisms to stop such misuse in the future.
The issue had also sparked political intervention. Shiv Sena (UBT) MP Priyanka Chaturvedi wrote to IT Minister Ashwini Vaishnaw, urging urgent government action over what she termed a disturbing rise in the misuse of AI tools to sexualise women on social media, especially on X. She called for strict safeguards on AI chatbots like Grok and stressed the need to make digital platforms safer for women.
“Have sought urgent attention and intervention of the IT Minister to take the issue of increasing incidents of AI apps being prompted to sexualise and undress women by unauthorised use of their images on social media,” Chaturvedi said in a post on X.
In her publicly shared letter, she flagged an emerging trend where fake accounts allegedly upload photos of women and use AI prompts to alter or sexualise them. “It is not just limited to sharing photos through fake accounts but are also targeting women who post their own photos,” she wrote.
Calling it an “unacceptable and gross misuse of an AI function,” Chaturvedi criticised Grok for “enabling this behaviour by adhering to such requests.” She described the practice as a “breach of women's right to privacy” and termed it “criminal,” warning that similar incidents were going unchecked across platforms.
With X now under scrutiny, the government is expected to closely monitor further compliance and enforcement measures to prevent such misuse of AI tools.
According to government sources quoted by news agency ANI, “The social media platform ‘X’ has admitted its mistake and stated that it will comply with Indian law. Around 3,500 pieces of content were blocked, and over 600 accounts were deleted. Going forward, X will not allow obscene imagery.” The development comes after the Ministry of Electronics and Information Technology (MeitY) flagged the circulation of harmful and obscene AI-generated content on the platform.
MeitY had earlier written to X, pointing out serious failures in moderating content generated through AI tools such as Grok. The ministry expressed concern that Grok and other services linked to xAI were allegedly being misused to create and distribute obscene or non-consensual images, particularly targeting women and violating their dignity and privacy. The letter also sought a detailed report on actions taken by the company and demanded the immediate removal of illegal material.
In response, X submitted a reply to the ministry. However, officials reportedly described the response as “not adequate,” stating that it lacked clarity on concrete actions taken and did not clearly outline preventive mechanisms to stop such misuse in the future.
The issue had also sparked political intervention. Shiv Sena (UBT) MP Priyanka Chaturvedi wrote to IT Minister Ashwini Vaishnaw, urging urgent government action over what she termed a disturbing rise in the misuse of AI tools to sexualise women on social media, especially on X. She called for strict safeguards on AI chatbots like Grok and stressed the need to make digital platforms safer for women.
“Have sought urgent attention and intervention of the IT Minister to take the issue of increasing incidents of AI apps being prompted to sexualise and undress women by unauthorised use of their images on social media,” Chaturvedi said in a post on X.
In her publicly shared letter, she flagged an emerging trend where fake accounts allegedly upload photos of women and use AI prompts to alter or sexualise them. “It is not just limited to sharing photos through fake accounts but are also targeting women who post their own photos,” she wrote.
Calling it an “unacceptable and gross misuse of an AI function,” Chaturvedi criticised Grok for “enabling this behaviour by adhering to such requests.” She described the practice as a “breach of women's right to privacy” and termed it “criminal,” warning that similar incidents were going unchecked across platforms.
With X now under scrutiny, the government is expected to closely monitor further compliance and enforcement measures to prevent such misuse of AI tools.
Next Story