Misplaced Trust and Distrust: How Not to Engage with Medical Artificial Intelligence

Cambridge Quarterly of Healthcare Ethics:1-10 (forthcoming)
  Copy   BIBTEX

Abstract

Artificial intelligence (AI) plays a rapidly increasing role in clinical care. Many of these systems, for instance, deep learning-based applications using multilayered Artificial Neural Nets, exhibit epistemic opacity in the sense that they preclude comprehensive human understanding. In consequence, voices from industry, policymakers, and research have suggested trust as an attitude for engaging with clinical AI systems. Yet, in the philosophical and ethical literature on medical AI, the notion of trust remains fiercely debated. Trust skeptics hold that talking about trust in nonhuman agents constitutes a category error and worry about the concept being misused for ethics washing. Proponents of trust have responded to these worries from various angles, disentangling different concepts and aspects of trust in AI, potentially organized in layers or dimensions. Given the substantial disagreements across these accounts of trust and the important worries about ethics washing, we embrace a diverging strategy here. Instead of aiming for a positive definition of the elements and nature of trust in AI, we proceed ex negativo, that is we look at cases where trust or distrust are misplaced. Comparing these instances with trust expedited in doctor–patient relationships, we systematize these instances and propose a taxonomy of both misplaced trust and distrust. By inverting the perspective and focusing on negative examples, we develop an account that provides useful ethical constraints for decisions in clinical as well as regulatory contexts and that highlights how we should not engage with medical AI.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 76,168

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Is there a moral duty for doctors to trust patients?W. A. Rogers - 2002 - Journal of Medical Ethics 28 (2):77-80.
Commitment in cases of trust and distrust.Jonathan Tallant - 2017 - Thought: Fordham University Quarterly (4):261-267.
Trust, distrust, and affective looping.Karen Jones - 2019 - Philosophical Studies 176 (4):955-968.
Humble trust.Jason D’Cruz - 2019 - Philosophical Studies 176 (4):933-953.
Trust in Medical Artificial Intelligence: A Discretionary Account.Philip J. Nickel - 2022 - Ethics and Information Technology 24 (1):1-10.
Commitment in Cases of Trust and Distrust.Jonathan Tallant - 2017 - Thought: A Journal of Philosophy 6 (4):261-267.
Dilemmas of Trust.Trudy Govier - 1998 - Carleton University Press.

Analytics

Added to PP
2022-10-21

Downloads
7 (#1,044,287)

6 months
7 (#116,740)

Historical graph of downloads
How can I increase my downloads?