Excavating AI: the politics of images in machine learning training sets

AI and Society:1-12 (forthcoming)
  Copy   BIBTEX


By looking at the politics of classification within machine learning systems, this article demonstrates why the automated interpretation of images is an inherently social and political project. We begin by asking what work images do in computer vision systems, and what is meant by the claim that computers can “recognize” an image? Next, we look at the method for introducing images into computer systems and look at how taxonomies order the foundational concepts that will determine how a system interprets the world. Then we turn to the question of labeling: how humans tell computers which words will relate to a given image. What is at stake in the way AI systems use these labels to classify humans, including by race, gender, emotions, ability, sexuality, and personality? Finally, we turn to the purposes that computer vision is meant to serve in our society—the judgments, choices, and consequences of providing computers with these capacities. Methodologically, we call this an archeology of datasets: studying the material layers of training images and labels, cataloguing the principles and values by which taxonomies are constructed, and analyzing how these taxonomies create the parameters of intelligibility for an AI system. By doing this, we can critically engage with the underlying politics and values of a system, and analyze which normative patterns of life are assumed, supported, and reproduced.



    Upload a copy of this work     Papers currently archived: 92,813

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Archaeologists of the Off-Screen: Harun Farocki and Trevor Paglen.Henrik Gustafsson - 2019 - In Asbjørn Grønstad & Øyvind Vågnes (eds.), Invisibility in Visual and Material Culture. Springer Verlag. pp. 17-45.
A Neutrosophic Image Retrieval Classifier.A. A. Salama, Eisa Mohamed & A. E. Fawzy - 2017 - International Journal of Computer Applications 170 (9):1-6.
On the data set’s ruins.Nicolas Malevé - forthcoming - AI and Society.
What is computer science about?Oron Shagrir - 1999 - The Monist 82 (1):131-149.
Imaginal politics.Chiara Bottici - 2011 - Thesis Eleven 106 (1):56-72.
Psychophysical discrimination of spatial structure in natural images.P. Carlin & R. Watt - 1996 - In Enrique Villanueva (ed.), Perception. Ridgeview. pp. 43-44.


Added to PP

304 (#69,006)

6 months
44 (#95,642)

Historical graph of downloads
How can I increase my downloads?