Surge in Online Racism Linked to New AI Software, Experts Warn
A troubling rise in online racism has emerged following the recent updates to X's AI software, Grok, according to experts in online abuse. Signify, an organization that monitors hate speech, noted an increase in incidents of racist abuse since the introduction of Grok's new photorealistic image feature, Aurora, which utilizes generative artificial intelligence to create realistic images based on user prompts.
Experts have issued warnings that the current situation may only be the beginning, predicting that online racism will worsen over the next year as these technologies become more widely adopted. Grok, launched by Elon Musk in 2023, has faced criticism for its ability to bypass traditional content guidelines, allowing users to create offensive and harmful imagery. Reports have surfaced detailing the generation of racist images targeting football players and managers, including depictions that employ offensive stereotypes.
Callum Hood from the Center for Countering Digital Hate highlighted that X has incentivized the spread of hate through revenue-sharing models. The ease of prompting Grok to create hateful content—sometimes even circumventing safeguards—has raised significant concerns among advocacy groups.
The Premier League is aware of the uptick in racist imagery and has bolstered its efforts to report such abuse, having received over 1,500 reports last year alone. They are also employing filters for players to help mitigate exposure to online hate. The Football Association (FA) emphasized that discrimination is unacceptable in football and in society, calling for stronger actions from tech companies against online abuse.
Both X and Grok have been approached for comment on the growing concern over their AI technologies.
Weekly Newsletter
News summary by melangenews