Safety Engineering for Artificial General Intelligence

Topoi 32 (2):217-226 (2013)
Authors
Roman Yampolskiy
University of Louisville
Abstract
Machine ethics and robot rights are quickly becoming hot topics in artificial intelligence and robotics communities. We will argue that attempts to attribute moral agency and assign rights to all intelligent machines are misguided, whether applied to infrahuman or superhuman AIs, as are proposals to limit the negative effects of AIs by constraining their behavior. As an alternative, we propose a new science of safety engineering for intelligent artificial agents based on maximizing for what humans value. In particular, we challenge the scientific community to develop intelligent systems that have human-friendly values that they provably retain, even under recursive self-improvement.
Keywords AI safety  AI confinement  Machine ethics  Robot rights  Intelligence explosion  Friendly artificial intelligence
Categories (categorize this paper)
DOI 10.1007/s11245-012-9128-9
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 33,167
Through your library

References found in this work BETA

Morals by Agreement.David Gauthier - 1986 - Oxford University Press.
Leviathan.Thomas Hobbes - 1651 - Harmondsworth, Penguin.
Killer Robots.Robert Sparrow - 2007 - Journal of Applied Philosophy 24 (1):62–77.

View all 28 references / Add more references

Citations of this work BETA

Add more citations

Similar books and articles

Artificial Intelligence and Wittgenstein.Gerard Casey - 1988 - Philosophical Studies 32:156-175.
Consciousness, Intentionality, and Intelligence: Some Foundational Issues for Artificial Intelligence.Murat Aydede & Guven Guzeldere - 2000 - Journal of Experimental and Theoretical Artificial Intelligence 12 (3):263-277.
Ethical Life Cycle of an Innovation.Mari Meel & Maksim Saat - 2002 - Journal of Business Ethics 39 (1-2):21 - 27.
A Wittgensteinian View of Artificial Intelligence.Otto Neumaier - 1987 - In Rainer P. Born (ed.), Artificial Intelligence. St Martin's Press. pp. 132--174.
Natural Problems and Artificial Intelligence.Tracy B. Henley - 1990 - Behavior and Philosophy 18 (2):43-55.
The Philosophy of Artificial Intelligence.Margaret A. Boden (ed.) - 1990 - Oxford University Press.
Comments on Can Intelligence Be Artificial?Paul McNamara - 1993 - Philosophical Studies 71 (2):217-222.
Experience, Memory and Intelligence.John T. Sanders - 1985 - The Monist 68 (4):507-521.

Analytics

Added to PP index
2012-08-23

Total downloads
579 ( #3,751 of 2,242,260 )

Recent downloads (6 months)
26 ( #15,506 of 2,242,260 )

How can I increase my downloads?

Monthly downloads

My notes

Sign in to use this feature