The algorithm audit: Scoring the algorithms that score us

Big Data and Society 8 (1) (2021)
  Copy   BIBTEX

Abstract

In recent years, the ethical impact of AI has been increasingly scrutinized, with public scandals emerging over biased outcomes, lack of transparency, and the misuse of data. This has led to a growing mistrust of AI and increased calls for mandated ethical audits of algorithms. Current proposals for ethical assessment of algorithms are either too high level to be put into practice without further guidance, or they focus on very specific and technical notions of fairness or transparency that do not consider multiple stakeholders or the broader social context. In this article, we present an auditing framework to guide the ethical assessment of an algorithm. The audit instrument itself is comprised of three elements: a list of possible interests of stakeholders affected by the algorithm, an assessment of metrics that describe key ethically salient features of the algorithm, and a relevancy matrix that connects the assessed metrics to stakeholder interests. The proposed audit instrument yields an ethical evaluation of an algorithm that could be used by regulators and others interested in doing due diligence, while paying careful attention to the complex societal context within which the algorithm is deployed.

Links

PhilArchive

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Ethical Implications and Accountability of Algorithms.Kirsten Martin - 2018 - Journal of Business Ethics 160 (4):835-850.
Is there an ethics of algorithms?Martin Peterson - 2011 - Ethics and Information Technology 13 (3):251-260.
Overlapping Community Detection in Dynamic Networks.Nathan Aston - 2014 - Journal of Software Engineering and Applications 7:872-882.
Weakening faithfulness : some heuristic causal discovery algorithms. Zhalama, Jiji Zhang & Wolfgang Mayer - 2017 - International Journal of Data Science and Analytics 3 (2):93-104.
Algorithms for computing minimal conflicts.S. Luan, L. Magnani & G. Dai - 2006 - Logic Journal of the IGPL 14 (2):391--406.
What an Algorithm Is.Robin K. Hill - 2016 - Philosophy and Technology 29 (1):35-59.

Analytics

Added to PP
2020-12-05

Downloads
908 (#13,384)

6 months
301 (#5,304)

Historical graph of downloads
How can I increase my downloads?

Author Profiles

Jovana Davidovic
University of Iowa
Ali Hasan
University of Iowa