A Conceptual and Computational Model of Moral Decision Making in Human and Artificial Agents

Topics in Cognitive Science 2 (3):454-485 (2010)

Authors
Colin Allen
University of Pittsburgh
Abstract
Recently, there has been a resurgence of interest in general, comprehensive models of human cognition. Such models aim to explain higher-order cognitive faculties, such as deliberation and planning. Given a computational representation, the validity of these models can be tested in computer simulations such as software agents or embodied robots. The push to implement computational models of this kind has created the field of artificial general intelligence (AGI). Moral decision making is arguably one of the most challenging tasks for computational approaches to higher-order cognition. The need for increasingly autonomous artificial agents to factor moral considerations into their choices and actions has given rise to another new field of inquiry variously known as Machine Morality, Machine Ethics, Roboethics, or Friendly AI. In this study, we discuss how LIDA, an AGI model of human cognition, can be adapted to model both affective and rational features of moral decision making. Using the LIDA model, we will demonstrate how moral decisions can be made in many domains using the same mechanisms that enable general decision making. Comprehensive models of human cognition typically aim for compatibility with recent research in the cognitive and neural sciences. Global workspace theory, proposed by the neuropsychologist Bernard Baars (1988), is a highly regarded model of human cognition that is currently being computationally instantiated in several software implementations. LIDA (Franklin, Baars, Ramamurthy, & Ventura, 2005) is one such computational implementation. LIDA is both a set of computational tools and an underlying model of human cognition, which provides mechanisms that are capable of explaining how an agent’s selection of its next action arises from bottom-up collection of sensory data and top-down processes for making sense of its current situation. We will describe how the LIDA model helps integrate emotions into the human decision-making process, and we will elucidate a process whereby an agent can work through an ethical problem to reach a solution that takes account of ethically relevant factors.
Keywords Global workspace theory  Machine ethics  Artificial general intelligence  Artificial intelligence  Machine morality  Moral decision making
Categories (categorize this paper)
DOI 10.1111/j.1756-8765.2010.01095.x
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 43,822
Through your library

References found in this work BETA

Elements of Episodic Memory.Endel Tulving - 1985 - Oxford University Press.
Principles of Biomedical Ethics.Tom L. Beauchamp - 1979 - Oxford University Press.
A Cognitive Theory of Consciousness.Bernard J. Baars - 1988 - Cambridge University Press.

View all 50 references / Add more references

Citations of this work BETA

Consciousness and Ethics: Artificially Conscious Moral Agents.Wendell Wallach, Colin Allen & Stan Franklin - 2011 - International Journal of Machine Consciousness 3 (01):177-192.

View all 8 citations / Add more citations

Similar books and articles

Analytics

Added to PP index
2010-08-11

Total views
149 ( #51,069 of 2,265,166 )

Recent downloads (6 months)
12 ( #72,654 of 2,265,166 )

How can I increase my downloads?

Downloads

My notes

Sign in to use this feature