AI Music Generators Hate Speech: Spiteful Actors Exploit AI Music Generators
Some mean actors have found a new opportunity for spreading hate and that is generative AI music tools. According to ActiveFence, there has been a gush in discussions within “hate speech-related” communities about misusing AI music creation tools to produce offensive songs targeting minority groups. ActiveFence is a service specializing in trust and safety operations on online platforms. These AI-generated songs aim to rouse hatred toward ethnic, gender, racial, and religious troops while glorifying acts of martyrdom, self-harm, and terrorism.
While hateful and harmful songs are not new, the concern lies in the availability of free music-generating tools. Individuals who previously were short of the means or know-how can now create such content at scale. Just as image, voice, video, and text generators have facilitated the spread of misinformation and hate speech, generative AI music tools are now being exploited for similar purposes.
The platforms Udio and Suno allow users to add custom lyrics to generated songs. Even though safeguards filter out common insults and offensive terms, users have discovered workarounds. For example, white supremacist forums shared phonetic spellings of minorities and offensive terms to bypass content filters. Some users even altered spacings and spellings to refer to acts of violence. While Udio blocked some offensive homophones, Suno allowed all of them through.
In these communities, AI-generated songs reverberate conspiracy theories about Jewish people, advocate for mass murder, and glorify sexual violence against women. The emotional influence of songs makes them a powerful force for hate speech groups and political warfare.
As technology evolves, so do the challenges in combating misuse. Threat actors continue to exploit specific vulnerabilities, emphasizing the need for responsible AI development and vigilant moderation of online platforms.
Read More: Spotify AI Personalized Playlists: Personalizing Music Through Prompts
Read More: OpenAI News Corp Partnership: Generative AI Models to Train on Leading Publications
