Levels of explicability for medical artificial intelligence: What do we normatively need and what can we technically reach?

Ethik in der Medizin 35 (2):173-199 (2023)
  Copy   BIBTEX


Definition of the problem The umbrella term “explicability” refers to the reduction of opacity of artificial intelligence (AI) systems. These efforts are challenging for medical AI applications because higher accuracy often comes at the cost of increased opacity. This entails ethical tensions because physicians and patients desire to trace how results are produced without compromising the performance of AI systems. The centrality of explicability within the informed consent process for medical AI systems compels an ethical reflection on the trade-offs. Which levels of explicability are needed to obtain informed consent when utilizing medical AI? Arguments We proceed in five steps: First, we map the terms commonly associated with explicability as described in the ethics and computer science literature, i.e., disclosure, intelligibility, interpretability, and explainability. Second, we conduct a conceptual analysis of the ethical requirements for explicability when it comes to informed consent. Third, we distinguish hurdles for explicability in terms of epistemic and explanatory opacity. Fourth, this then allows to conclude the level of explicability physicians must reach and what patients can expect. In a final step, we show how the identified levels of explicability can technically be met from the perspective of computer science. Throughout our work, we take diagnostic AI systems in radiology as an example. Conclusion We determined four levels of explicability that need to be distinguished for ethically defensible informed consent processes and showed how developers of medical AI can technically meet these requirements.

Similar books and articles

Applying a Principle of Explicability to AI Research in Africa: Should We Do It?Mary Carman & Benjamin Rosman - 2023 - In Aribiah David Attoe, Segun Samuel Temitope, Victor Nweke, John Umezurike & Jonathan Okeke Chimakonam (eds.), Conversations on African Philosophy of Mind, Consciousness and Artificial Intelligence. Springer Verlag. pp. 183-201.


Added to PP

217 (#96,625)

6 months
142 (#28,099)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Cristian Timmermann
Universität Augsburg