For 20 years, ISD has delivered field-leading threat detection, analysis and real-world strategies to combat terrorism, extremism and authoritarianism - in all their ideological forms.

Home / Media mentions / AI falling short in moderating extremist content on Facebook

Media Mentions

July 31, 2022

Facebook building

AI falling short in moderating extremist content on Facebook

ISD’s Executive Director for Asia, the Middle East and Africa, Moustafa Ayad, spoke to the Washington Post about the problem of extremist and terrorist content on Facebook in Kenya.
Referring to ISD’s report Under-Moderated, Unhinged and Ubiquitous: Al-Shabaab and the Islamic State Networks on Facebook  on content thriving and persisting on Meta’s platform, Moustafa told the Post that Facebook’s reliance on AI for moderation is a core problem. What’s more, is bad actors have learned how to game the system. Moustafa also spoke to POLITICO about this issue, highlighted by the Facebook Papers, in October 2021.

While most of the accounts flagged by ISD’s report have since been removed, similar content has been removed, highlighting the whack-a-mole nature of a moderation strategy that is inconsistently enforced and insufficient to deal with whole systems of problematic content. In response to our report, Amnesty International released a statement expressing “deep concern” over the platform’s failure to stop terrorist content online.

Featured publication

Generative AI and the German Far Right: Narratives, Tactics and Digital Strategies

ISD Contributors

Moustafa Ayad
Research Chair in Global Islamism & Counter-Terrorism