(ed.)
Oxford University Press (2014)

Authors
Nick Bostrom
Oxford University
Abstract
The human brain has some capabilities that the brains of other animals lack. It is to these distinctive capabilities that our species owes its dominant position. Other animals have stronger muscles or sharper claws, but we have cleverer brains. If machine brains one day come to surpass human brains in general intelligence, then this new superintelligence could become very powerful. As the fate of the gorillas now depends more on us humans than on the gorillas themselves, so the fate of our species then would come to depend on the actions of the machine superintelligence. But we have one advantage: we get to make the first move. Will it be possible to construct a seed AI or otherwise to engineer initial conditions so as to make an intelligence explosion survivable? How could one achieve a controlled detonation? To get closer to an answer to this question, we must make our way through a fascinating landscape of topics and considerations. Read the book and learn about oracles, genies, singletons; about boxing methods, tripwires, and mind crime; about humanity's cosmic endowment and differential technological development; indirect normativity, instrumental convergence, whole brain emulation and technology couplings; Malthusian economics and dystopian evolution; artificial intelligence, and biological cognitive enhancement, and collective intelligence.
Keywords Artificial Intelligence   Existential Risk
Categories (categorize this paper)
Reprint years 2003, 2014, 2016
Buy this book $9.29 used (42% off)   $10.69 new (33% off)   $14.36 from Amazon (10% off)   Amazon page
ISBN(s) 0198739834   9780198739838   0199678111
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 63,417
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

Ethics of Artificial Intelligence and Robotics.Vincent C. Müller - 2020 - In Edward Zalta (ed.), Stanford Encyclopedia of Philosophy. Palo Alto, Cal.: CSLI, Stanford University. pp. 1-70.
The Threat of Algocracy: Reality, Resistance and Accommodation.John Danaher - 2016 - Philosophy and Technology 29 (3):245-268.
Robot Betrayal: A Guide to the Ethics of Robotic Deception.John Danaher - 2020 - Ethics and Information Technology 22 (2):117-128.

View all 182 citations / Add more citations

Similar books and articles

How Long Before Superintelligence?Nick Bostrom - 1998 - International Journal of Futures Studies 2.
The Singularity: A Reply to Commentators.David J. Chalmers - 2012 - Journal of Consciousness Studies (7-8):141-167.
Brains-in-Vats, Giant Brains and World Brains: The Brain as Metaphor in Digital Culture.Charlie Gere - 2004 - Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences 35 (2):351-366.
Will Robots Inherit the Earth?Marvin L. Minsky - 1994 - Scientific American (Oct).
Brains.Eric Olson - 2007 - In Eric T. Olson (ed.), What Are We? Oxford University Press.
The Future of Humanity.Nick Bostrom - 2009 - In Jan Kyrre Berg Olsen Friis, Evan Selinger & Søren Riis (eds.), New Waves in Philosophy of Technology. Palgrave-Macmillan.
Subversive Rationalization: Technology, Power, and Democracy.Andrew Feenberg - 1992 - Inquiry: An Interdisciplinary Journal of Philosophy 35 (3-4):301 – 322.
Misbehaving Machines: The Emulated Brains of Transhumanist Dreams.Corry Shores - 2011 - Journal of Evolution and Technology 22 (1):10-22.

Analytics

Added to PP index
2012-03-18

Total views
183 ( #57,512 of 2,449,040 )

Recent downloads (6 months)
18 ( #37,544 of 2,449,040 )

How can I increase my downloads?

Downloads

My notes