Prolegomena to any future arti® cial moral agent

Abstract
As arti® cial intelligence moves ever closer to the goal of producing fully autonomous agents, the question of how to design and implement an arti® cial moral agent (AMA) becomes increasingly pressing. Robots possessing autonomous capacities to do things that are useful to humans will also have the capacity to do things that are harmful to humans and other sentient beings. Theoretical challenges to developing arti® cial moral agents result both from controversies among ethicists about moral theory itself, and from computational limits to the implementation of such theories. In this paper the ethical disputes are surveyed, the possibility of a `moral Turing Test ’ is considered and the computational di culties accompanying the diŒerent types of approach are assessed. Human-like performance, which is prone to include immoral actions, may not be acceptable in machines, but moral perfection may be computationally unattainable. The risks posed by autonomous machines ignorantly or deliberately harming people and other sentient beings are great. The development of machines with enough intelligence to assess the eŒects of their actions on sentient beings and act accordingly may ultimately be the most important task faced by the designers of arti® cially intelligent automata.
Keywords No keywords specified (fix it)
Categories No categories specified
(categorize this paper)
Options
 Save to my reading list
Follow the author(s)
My bibliography
Export citation
Find it on Scholar
Edit this record
Mark as duplicate
Revision history Request removal from index Translate to english
 
Download options
PhilPapers Archive


Upload a copy of this paper     Check publisher's policy on self-archival     Papers currently archived: 9,351
External links
  •   Try with proxy.
  • Through your library Only published papers are available at libraries
    References found in this work BETA

    No references found.

    Citations of this work BETA
    Ryan Tonkens (2009). A Challenge for Machine Ethics. Minds and Machines 19 (3):421-438.
    Marcus Schulzke (2011). Robots as Weapons in Just Wars. Philosophy and Technology 24 (3):293-306.

    View all 11 citations

    Similar books and articles
    Michael S. Pritchard (2012). Moral Machines? Science and Engineering Ethics 18 (2):411-417.
    Ryan Tonkens (2009). A Challenge for Machine Ethics. Minds and Machines 19 (3):421-438.
    J. Storrs Hall (2006). Nano-Enabled AI. International Journal of Applied Philosophy 20 (2):247-261.
    Analytics

    Monthly downloads

    Added to index

    2010-12-22

    Total downloads

    12 ( #106,398 of 1,088,398 )

    Recent downloads (6 months)

    1 ( #69,601 of 1,088,398 )

    How can I increase my downloads?

    My notes
    Sign in to use this feature


    Discussion
    Start a new thread
    Order:
    There  are no threads in this forum
    Nothing in this forum yet.