Ethics and Information Technology 23 (3):419-433 (2021)

This article probes the practical ethical implications of AI system design by reconsidering the important topic of bias in the datasets used to train autonomous intelligent systems. The discussion draws on recent work concerning behaviour-guiding technologies, and it adopts a cautious form of technological utopianism by assuming it is potentially beneficial for society at large if AI systems are designed to be comparatively free from the biases that characterise human behaviour. However, the argument presented here critiques the common well-intentioned requirement that, in order to achieve this, all such datasets must be debiased prior to training. By focusing specifically on gender-bias in Neural Machine Translation systems, three automated strategies for the removal of bias are considered – downsampling, upsampling, and counterfactual augmentation – and it is shown that systems trained on datasets debiased using these approaches all achieve general translation performance that is much worse than a baseline system. In addition, most of them also achieve worse performance in relation to metrics that quantify the degree of gender bias in the system outputs. By contrast, it is shown that the technique of domain adaptation can be effectively deployed to debias existing NMT systems after they have been fully trained. This enables them to produce translations that are quantitatively far less biased when analysed using gender-based metrics, but which also achieve state-of-the-art general performance. It is hoped that the discussion presented here will reinvigorate ongoing debates about how and why bias can be most effectively reduced in state-of-the-art AI systems.
Keywords No keywords specified (fix it)
Categories (categorize this paper)
DOI 10.1007/s10676-021-09583-1
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

Upload a copy of this paper     Check publisher's policy     Papers currently archived: 69,066
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Practical Ethics.Peter Singer - 1979 - Cambridge University Press.
Practical Ethics.Peter Singer - 1979 - Philosophy 56 (216):267-268.
Materializing Morality: Design Ethics and Technological Mediation.Peter-Paul Verbeek - 2006 - Science, Technology, and Human Values 31 (3):361-380.
Vorträge und Aufsätze.MARTIN HEIDEGGER - 1954 - Zeitschrift für Philosophische Forschung 10 (4):645-646.
Catastrophic Forgetting in Connectionist Networks.R. French - 1999 - Trends in Cognitive Sciences 3 (4):128-135.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Neural Machine Translation for Indian Languages.Amarnath Pathak & Partha Pakray - 2019 - Journal of Intelligent Systems 28 (3):465-477.
Ethics of Artificial Intelligence.Vincent C. Müller - 2021 - In Anthony Elliott (ed.), The Routledge social science handbook of AI. London: Routledge. pp. 122-137.


Added to PP index

Total views
14 ( #728,702 of 2,498,767 )

Recent downloads (6 months)
1 ( #422,193 of 2,498,767 )

How can I increase my downloads?


My notes