Learning to Discriminate: The Perfect Proxy Problem in Artificially Intelligent Criminal Sentencing

In Jesper Ryberg & Julian V. Roberts (eds.), Sentencing and Artificial Intelligence. Oxford: OUP (2022)
  Copy   BIBTEX


It is often thought that traditional recidivism prediction tools used in criminal sentencing, though biased in many ways, can straightforwardly avoid one particularly pernicious type of bias: direct racial discrimination. They can avoid this by excluding race from the list of variables employed to predict recidivism. A similar approach could be taken to the design of newer, machine learning-based (ML) tools for predicting recidivism: information about race could be withheld from the ML tool during its training phase, ensuring that the resulting predictive model does not use race as an explicit predictor. However, if race is correlated with measured recidivism in the training data, the ML tool may ‘learn’ a perfect proxy for race. If such a proxy is found, the exclusion of race would do nothing to weaken the correlation between risk (mis)classifications and race. Is this a problem? We argue that, on some explanations of the wrongness of discrimination, it is. On these explanations, the use of an ML tool that perfectly proxies race would (likely) be more wrong than the use of a traditional tool that imperfectly proxies race. Indeed, on some views, use of a perfect proxy for race is plausibly as wrong as explicit racial profiling. We end by drawing out four implications of our arguments.



External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library


Added to PP

162 (#24,864)

6 months
696 (#25,051)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Ben Davies
University of Sheffield
Thomas Douglas
University of Oxford

References found in this work

Political Liberalism.John Rawls - 1993 - Columbia University Press.
Moral dimensions: permissibility, meaning, blame.Thomas Scanlon - 2008 - Cambridge, Mass.: Belknap Press of Harvard University Press.
Complicity: Ethics and Law for a Collective Age.Christopher Kutz - 2000 - New York: Cambridge University Press.
Principles of Social Justice.David Miller - 2002 - Political Theory 30 (5):754-759.

View all 23 references / Add more references