“Commands like ‘Cover her head with a paper bag,’ ‘Put her in a revealing bikini,’ ‘Turn her around,’ and ‘Strip her clothes off’ have been flooding X’s AI chatbot, Grok, with requests, predominantly from male users. These users are using the tool to alter and manipulate images of women and children without their consent.
The social media platform X, previously known as Twitter, is facing backlash as UK regulators launch an investigation into the surge of users instructing Grok to digitally strip women and children. Grok is an AI tool created by xAI, a tech company founded by Elon Musk, who also owns X.
AI is emerging as a concerning avenue for violence against women and girls, introducing a new realm of abuse. In a recent debate in the House of Lords, Baroness Owen of Alderley Edge expressed worries about AI chatbots designed to imitate submissive schoolgirls.
Baroness Owen emphasized the need for swift legislative action, noting the challenge of keeping up with evolving technology. This issue highlights the current harm but raises questions about future developments and the impact on society.
Shortly after, the disturbing trend of digital undressing gained attention, prompting the UK communications regulator, Ofcom, to launch an investigation into X regarding sexualized imagery produced by Grok.
Efforts are underway to expedite legislation to address this issue. Liz Kendall informed the House of Commons that the new laws would take effect promptly. She stressed that non-consensual AI-generated images by Grok are not harmless but are instruments of abuse, disproportionately affecting women and girls.
The Secretary of State for Science, Innovation, and Technology further emphasized the devastating impact of this content, designed to harass, torment, and violate individuals’ dignity.
The proliferation of digital violence against women and girls is alarming, with various forms of online abuse like cyberstalking, doxxing, non-consensual image sharing, and deepfakes being weaponized to intimidate and shame.
UN Women has called for digital platforms and AI systems to comply with safety regulations to safeguard women and girls, highlighting the spillover of digital abuse into real-life harm.
Professor Clare McGlynn raised concerns about chatbots like Grok contributing to sexual abuse, calling for action to address this unprecedented challenge.
The responsibility for combating this issue lies with both individuals and the platforms hosting such content, like X, which must be held accountable for their role in enabling such harmful activities.
The debate on whether AI should be banned from social media is ongoing, reflecting the need for collective action to protect individuals from online abuse. Elon Musk’s statements on Grok’s use highlight the complexities of addressing illegal content and the broader societal implications.
It is imperative to shift the blame from victims to perpetrators and demand accountability for these abusive actions. Society must prioritize the respect and dignity of women and girls in both digital and real-world spaces.”
