Hatescape: An In-Depth Analysis of Extremism and Hate Speech on TikTok

Authors: Ciaran O’Connor

Published: 24 August 2021

This report aims to provide an in-depth analysis on the state of extremism and hate on TikTok. It is the culmination of three months of research on a sample of 1,030 videos, equivalent to just over eight hours of content, posted on the social media platform. These videos were used to promote hatred, as well as glorify extremism and terrorism.

ISD set out to examine the state of hate and extremism on TikTok in two ways. The first objective involved analysing how individuals or groups promote hateful ideologies and target people on the platform based on numerous protected attributes such as ethnicity, religion, gender or others. Second, using the same framework, ISD investigated how features on TikTok like profiles, hashtags, share functions, video effects and music are used to spread hate.

This report seeks to start a conversation around how platforms like TikTok can improve their own practices to protect users from harm. Additionally, it underscores the clear need for independent oversight of such platforms, which currently leave users and the wider public open to significant risks to their health, security and rights.

Download Report

Digitale Gewalt und Desinformation gegen spitzenkandidat:innen vor der Bundestagswahl 2021

Regelmäßig werden Politiker:innen zu Zielscheiben von systematischen Desinformationskampagnen, erhalten Hassnachrichten, Bedrohungen und Beleidigungen in sozialen Netzwerken. Ziel dieser Analyse war es indessen, Umfang und Formen von digitaler Gewalt sowie der Verbreitung von Desinformationen gegen Spitzenkanidat:innen der drei populärsten Parteien in Deutschland - CDU, SPD und Bündnis 90/Die Grünen) - vor der Bundestagswahl zu untersuchen.

Gaming and Extremism: The Extreme Right on Twitch

ISD discovered that content which expresses support for extreme right wing ideologies can be discovered on Twitch with relative ease, for example, through the practice of “Omegle Redpilling.” However, these videos are probably better considered as sporadic examples rather than representative of the systemic use of Twitch by the extreme right for radicalisation and coordination.