Algorithmic Bias and Risk Assessments: Lessons from Practice

Digital Society 1 (1):1-15 (2022)
  Copy   BIBTEX


In this paper, we distinguish between different sorts of assessments of algorithmic systems, describe our process of assessing such systems for ethical risk, and share some key challenges and lessons for future algorithm assessments and audits. Given the distinctive nature and function of a third-party audit, and the uncertain and shifting regulatory landscape, we suggest that second-party assessments are currently the primary mechanisms for analyzing the social impacts of systems that incorporate artificial intelligence. We then discuss two kinds of as-sessments: an ethical risk assessment and a narrower, technical algo-rithmic bias assessment. We explain how the two assessments depend on each other, highlight the importance of situating the algorithm within its particular socio-technical context, and discuss a number of lessons and challenges for algorithm assessments and, potentially, for algorithm audits. The discussion builds on our team’s experience of advising and conducting ethical risk assessments for clients across dif-ferent industries in the last four years. Our main goal is to reflect on the key factors that are potentially ethically relevant in the use of algo-rithms, and draw lessons for the nascent algorithm assessment and audit industry, in the hope of helping all parties minimize the risk of harm from their use.



External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Influences on toxicological risk assessments.Birgitte Wandall - 2007 - Dissertation, Royal Institute of Technology, Stockholm
Identity and the Limits of Fair Assessment.Rush T. Stewart - forthcoming - Journal of Theoretical Politics.
Suicide Risk Assessments: A Scientific and Ethical Critique.Mike Smith - 2022 - Journal of Bioethical Inquiry 19 (3):481-493.
Communicating Science-Based Information about Risk: How Ethics Can Help.Paul B. Thompson - 2018 - In Ethics and Practice in Science Communication. Chicago: pp. 33-54.
On algorithmic fairness in medical practice.Thomas Grote & Geoff Keeling - 2022 - Cambridge Quarterly of Healthcare Ethics 31 (1):83-94.
Editor’s Note, December 2021.Quill Kukla - 2021 - Kennedy Institute of Ethics Journal 31 (4):vii-ix.
Participation Grades.Elizabeth Bell - 2021 - Teaching Philosophy 44 (4):449-485.
Toward a More Objective Understanding of the Evidence of Carcinogenic Risk.Deborah G. Mayo - 1988 - PSA: Proceedings of the Biennial Meeting of the Philosophy of Science Association 1988:489 - 503.


Added to PP

681 (#20,787)

6 months
304 (#5,221)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Ali Hasan
University of Iowa
Benjamin Lange
Ludwig Maximilians Universität, München
Jovana Davidovic
University of Iowa

Citations of this work

No citations found.

Add more citations

References found in this work

No references found.

Add more references