Are Algorithmic Decisions Legitimate? The Effect of Process and Outcomes on Perceptions of Legitimacy of AI Decisions

Journal of Business Ethics 183 (3):653-670 (2022)
  Copy   BIBTEX

Abstract

Firms use algorithms to make important business decisions. To date, the algorithmic accountability literature has elided a fundamentally empirical question important to business ethics and management: Under what circumstances, if any, are algorithmic decision-making systems considered legitimate? The present study begins to answer this question. Using factorial vignette survey methodology, we explore the impact of decision importance, governance, outcomes, and data inputs on perceptions of the legitimacy of algorithmic decisions made by firms. We find that many of the procedural governance mechanisms in practice today, such as notices and impact statements, do not lead to algorithmic decisions being perceived as more legitimate in general, and, consistent with legitimacy theory, that algorithmic decisions with good outcomes are perceived as more legitimate than bad outcomes. Yet, robust governance, such as offering an appeal process, can create a legitimacy dividend for decisions with bad outcomes. However, when arbitrary or morally dubious factors are used to make decisions, most legitimacy dividends are erased. In other words, companies cannot overcome the legitimacy penalty of using arbitrary or morally dubious factors, such as race or the day of the week, with a good outcome or an appeal process for individuals. These findings add new perspectives to both the literature on legitimacy and policy discussions on algorithmic decision-making in firms.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 94,549

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Analytics

Added to PP
2022-02-10

Downloads
34 (#467,267)

6 months
20 (#173,391)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

References found in this work

Anarchy, State, and Utopia.Robert Nozick - 1974 - New York: Basic Books.
Spheres of Justice: A Defense of Pluralism and Equality.Michael Walzer - 1983 - Journal of Business Ethics 4 (1):63-64.
The Politics of Stakeholder Theory.R. Edward Freeman - 1994 - Business Ethics Quarterly 4 (4):409-421.

View all 42 references / Add more references