Cognitive assemblages: The entangled nature of algorithmic content moderation

Big Data and Society 9 (2) (2022)
  Copy   BIBTEX

Abstract

This article examines algorithmic content moderation, using the moderation of violent extremist content as a specific case. In recent years, algorithms have increasingly been mobilized to perform essential moderation functions for online social media platforms such as Facebook, YouTube, and Twitter, including limiting the proliferation of extremist speech. Drawing on Katherine Hayles’ concept of “cognitive assemblages” and the Critical Security Studies literature, we show how algorithmic regulation operates within larger assemblages of humans and non-humans to influence the surveillance and regulation of information flows. We argue that the dynamics of algorithmic regulation are more liquid, cobbled together and distributed than it appears. It is characterized by a set of shifting human and machine entities, which mix traditional surveillance methods with more sophisticated tools, and whose linkages and interactions are transient. The processes that enable the consolidation of knowledge about risky profiles and contents are, therefore, collective and distributed among humans and machines. This allows us to argue that the cognitive assemblages involved in content moderation become a cobbled space of preemptive calculation.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 91,610

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Content moderation, AI, and the question of scale.Tarleton Gillespie - 2020 - Big Data and Society 7 (2):2053951720943234.
Detecting Fake News: Two Problems for Content Moderation.Elizabeth Stewart - 2021 - Philosophy and Technology 34 (4):923-940.

Analytics

Added to PP
2022-12-28

Downloads
6 (#1,454,899)

6 months
3 (#962,966)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

No references found.

Add more references