Algorithmic Bias and Risk Assessments: Lessons from Practice

Digital Society 1 (1):1-15 (2022)
  Copy   BIBTEX

Abstract

In this paper, we distinguish between different sorts of assessments of algorithmic systems, describe our process of assessing such systems for ethical risk, and share some key challenges and lessons for future algorithm assessments and audits. Given the distinctive nature and function of a third-party audit, and the uncertain and shifting regulatory landscape, we suggest that second-party assessments are currently the primary mechanisms for analyzing the social impacts of systems that incorporate artificial intelligence. We then discuss two kinds of as-sessments: an ethical risk assessment and a narrower, technical algo-rithmic bias assessment. We explain how the two assessments depend on each other, highlight the importance of situating the algorithm within its particular socio-technical context, and discuss a number of lessons and challenges for algorithm assessments and, potentially, for algorithm audits. The discussion builds on our team’s experience of advising and conducting ethical risk assessments for clients across dif-ferent industries in the last four years. Our main goal is to reflect on the key factors that are potentially ethically relevant in the use of algo-rithms, and draw lessons for the nascent algorithm assessment and audit industry, in the hope of helping all parties minimize the risk of harm from their use.

Other Versions

No versions found

Links

PhilArchive

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Ethical considerations in Risk management of autonomous and intelligent systems.Anetta Jedličková - 2024 - Ethics and Bioethics (in Central Europe) 14 (1-2):80-95.
Influences on toxicological risk assessments.Birgitte Wandall - 2007 - Dissertation, Royal Institute of Technology, Stockholm
Suicide Risk Assessments: A Scientific and Ethical Critique.Mike Smith - 2022 - Journal of Bioethical Inquiry 19 (3):481-493.
A Framework for Assurance Audits of Algorithmic Systems.Benjamin Lange, Khoa Lam, Borhane Hamelin, Davidovic Jovana, Shea Brown & Ali Hasan - forthcoming - Proceedings of the 2024 Acm Conference on Fairness, Accountability, and Transparency.
Risk, Morality, and Child Protection: Risk Calculation as Guides to Practice.Gerald Cradock - 2004 - Science, Technology, and Human Values 29 (3):314-331.

Analytics

Added to PP
2022-08-19

Downloads
1,410 (#11,976)

6 months
363 (#5,303)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Ali Hasan
University of Iowa
Milton Regan
Georgetown University
1 more

Citations of this work

A Framework for Assurance Audits of Algorithmic Systems.Benjamin Lange, Khoa Lam, Borhane Hamelin, Davidovic Jovana, Shea Brown & Ali Hasan - forthcoming - Proceedings of the 2024 Acm Conference on Fairness, Accountability, and Transparency.

Add more citations

References found in this work

No references found.

Add more references