Prolegomena to any future artificial moral agent


Authors
Colin Allen
University of Pittsburgh
Gary Varner
Texas A&M University
Abstract
As arti® cial intelligence moves ever closer to the goal of producing fully autonomous agents, the question of how to design and implement an arti® cial moral agent (AMA) becomes increasingly pressing. Robots possessing autonomous capacities to do things that are useful to humans will also have the capacity to do things that are harmful to humans and other sentient beings. Theoretical challenges to developing arti® cial moral agents result both from controversies among ethicists about moral theory itself, and from computational limits to the implementation of such theories. In this paper the ethical disputes are surveyed, the possibility of a `moral Turing Test ’ is considered and the computational di culties accompanying the diŒerent types of approach are assessed. Human-like performance, which is prone to include immoral actions, may not be acceptable in machines, but moral perfection may be computationally unattainable. The risks posed by autonomous machines ignorantly or deliberately harming people and other sentient beings are great. The development of machines with enough intelligence to assess the eŒects of their actions on sentient beings and act accordingly may ultimately be the most important task faced by the designers of arti® cially intelligent automata.
Keywords No keywords specified (fix it)
Categories (categorize this paper)
Reprint years 2000
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 64,077
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

Ethics of Artificial Intelligence and Robotics.Vincent C. Müller - 2020 - In Edward Zalta (ed.), Stanford Encyclopedia of Philosophy. Palo Alto, Cal.: CSLI, Stanford University. pp. 1-70.
On the Morality of Artificial Agents.Luciano Floridi & J. W. Sanders - 2004 - Minds and Machines 14 (3):349-379.
Corporate Crocodile Tears? On the Reactive Attitudes of Corporate Agents.Gunnar Björnsson & Kendy Hess - 2017 - Philosophy and Phenomenological Research 94 (2):273–298.

View all 65 citations / Add more citations

Similar books and articles

Out of Character: On the Creation of Virtuous Machines. [REVIEW]Ryan Tonkens - 2012 - Ethics and Information Technology 14 (2):137-149.
Moral Machines?Michael S. Pritchard - 2012 - Science and Engineering Ethics 18 (2):411-417.
A Challenge for Machine Ethics.Ryan Tonkens - 2009 - Minds and Machines 19 (3):421-438.
Nano-Enabled AI: Some Philosophical Issues.J. Storrs Hall - 2006 - International Journal of Applied Philosophy 20 (2):247-261.

Analytics

Added to PP index
2010-12-22

Total views
533 ( #14,192 of 2,454,544 )

Recent downloads (6 months)
1 ( #449,188 of 2,454,544 )

How can I increase my downloads?

Downloads

My notes