Realising Meaningful Human Control Over Automated Driving Systems: A Multidisciplinary Approach

Minds and Machines 33 (4):587-611 (2023)
  Copy   BIBTEX

Abstract

The paper presents a framework to realise “meaningful human control” over Automated Driving Systems. The framework is based on an original synthesis of the results of the multidisciplinary research project “Meaningful Human Control over Automated Driving Systems” lead by a team of engineers, philosophers, and psychologists at Delft University of the Technology from 2017 to 2021. Meaningful human control aims at protecting safety and reducing responsibility gaps. The framework is based on the core assumption that human persons and institutions, not hardware and software and their algorithms, should remain ultimately—though not necessarily directly—in control of, and thus morally responsible for, the potentially dangerous operation of driving in mixed traffic. We propose an Automated Driving System to be under meaningful human control if it behaves according to the relevant reasons of the relevant human actors (tracking), and that any potentially dangerous event can be related to a human actor (tracing). We operationalise the requirements for meaningful human control through multidisciplinary work in philosophy, behavioural psychology and traffic engineering. The tracking condition is operationalised via a proximal scale of reasons and the tracing condition via an evaluation cascade table. We review the implications and requirements for the behaviour and skills of human actors, in particular related to supervisory control and driver education. We show how the evaluation cascade table can be applied in concrete engineering use cases in combination with the definition of core components to expose deficiencies in traceability, thereby avoiding so-called responsibility gaps. Future research directions are proposed to expand the philosophical framework and use cases, supervisory control and driver education, real-world pilots and institutional embedding.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,227

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Mind the Gap: A Theory Is Needed to Bridge the Gap Between the Human Skills and Self-driving Cars.Endre E. Kadar - 2019 - In Maria Isabel Aldinhas Ferreira, João Silva Sequeira, Gurvinder Singh Virk, Mohammad Osman Tokhi & Endre E. Kadar (eds.), Robotics and Well-Being. Springer Verlag. pp. 55-65.
Meaningful Human Control Over Smart Home Systems: A Value Sensitive Design Approach.Steven Umbrello - 2020 - Humana.Mente Journal of Philosophical Studies 13 (37):40-65.
Meaningful Human Control over Smart Home Systems: A Value Sensitive Design Approach.Steven Umbrello - 2020 - Humana.Mente Journal of Philosophical Studies 13 (37):40-65.

Analytics

Added to PP
2022-07-28

Downloads
33 (#487,172)

6 months
24 (#118,310)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

Intention.G. E. M. Anscombe - 1957 - Cambridge, Mass.: Harvard University Press.
Intention, plans, and practical reason.Michael Bratman - 1987 - Cambridge: Cambridge, MA: Harvard University Press.
Responsibility and Control: A Theory of Moral Responsibility.John Martin Fischer & Mark Ravizza - 1998 - New York: Cambridge University Press. Edited by Mark Ravizza.
Superintelligence: paths, dangers, strategies.Nick Bostrom (ed.) - 2014 - Oxford University Press.

View all 25 references / Add more references