Safety Engineering for Artificial General Intelligence

Topoi 32 (2):217-226 (2013)
Abstract
Machine ethics and robot rights are quickly becoming hot topics in artificial intelligence and robotics communities. We will argue that attempts to attribute moral agency and assign rights to all intelligent machines are misguided, whether applied to infrahuman or superhuman AIs, as are proposals to limit the negative effects of AIs by constraining their behavior. As an alternative, we propose a new science of safety engineering for intelligent artificial agents based on maximizing for what humans value. In particular, we challenge the scientific community to develop intelligent systems that have human-friendly values that they provably retain, even under recursive self-improvement.
Keywords AI safety  AI confinement  Machine ethics  Robot rights  Intelligence explosion  Friendly artificial intelligence
Categories (categorize this paper)
DOI 10.1007/s11245-012-9128-9
Options
 Save to my reading list
Follow the author(s)
Edit this record
My bibliography
Export citation
Find it on Scholar
Mark as duplicate
Request removal from index
Revision history
Download options
Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 31,317
Through your library
References found in this work BETA
Morals by Agreement.David Gauthier - 1986 - Oxford University Press.
Killer Robots.Robert Sparrow - 2007 - Journal of Applied Philosophy 24 (1):62–77.

View all 27 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles
Artificial Intelligence and Wittgenstein.Gerard Casey - 1988 - Philosophical Studies 32:156-175.
Consciousness, Intentionality, and Intelligence: Some Foundational Issues for Artificial Intelligence.Murat Aydede & Guven Guzeldere - 2000 - Journal of Experimental and Theoretical Artificial Intelligence 12 (3):263-277.
Ethical Life Cycle of an Innovation.Mari Meel & Maksim Saat - 2002 - Journal of Business Ethics 39 (1-2):21 - 27.
A Wittgensteinian View of Artificial Intelligence.Otto Neumaier - 1987 - In Rainer P. Born (ed.), Artificial Intelligence. St Martin's Press. pp. 132--174.
Natural Problems and Artificial Intelligence.Tracy B. Henley - 1990 - Behavior and Philosophy 18 (2):43-55.
The Philosophy of Artificial Intelligence.Margaret A. Boden (ed.) - 1990 - Oxford University Press.
Comments on Can Intelligence Be Artificial?Paul McNamara - 1993 - Philosophical Studies 71 (2):217-222.
Experience, Memory and Intelligence.John T. Sanders - 1985 - The Monist 68 (4):507-521.
Added to PP index
2012-08-23

Total downloads
571 ( #3,460 of 2,224,469 )

Recent downloads (6 months)
29 ( #13,581 of 2,224,469 )

How can I increase my downloads?

Monthly downloads
My notes
Sign in to use this feature