AI and Society 34 (4):907-920 (2019)

Authors
Wolfhart Totschnig
Universidad Diego Portales
Abstract
The thinkers who have reflected on the problem of a coming superintelligence have generally seen the issue as a technological problem, a problem of how to control what the superintelligence will do. I argue that this approach is probably mistaken because it is based on questionable assumptions about the behavior of intelligent agents and, moreover, potentially counterproductive because it might, in the end, bring about the existential catastrophe that it is meant to prevent. I contend that the problem posed by a future superintelligence will likely be a political problem, that is, one of establishing a peaceful form of coexistence with other intelligent agents in a situation of mutual vulnerability, and not a technological problem of control.
Keywords superintelligence  existential risk  source of normativity
Categories (categorize this paper)
DOI 10.1007/s00146-017-0753-0
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 58,321
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Minds, Brains, and Programs.John R. Searle - 1980 - Behavioral and Brain Sciences 3 (3):417-57.
Computing Machinery and Intelligence.Alan M. Turing - 1950 - Mind 59 (October):433-60.
Minds, Machines and Gödel.J. R. Lucas - 2003 - Etica E Politica 5 (1):1.
How Long Before Superintelligence?Nick Bostrom - 1998 - International Journal of Futures Studies 2.

View all 11 references / Add more references

Citations of this work BETA

Fully Autonomous AI.Wolfhart Totschnig - 2020 - Science and Engineering Ethics 26 (5):2473-2485.

Add more citations

Similar books and articles

Leakproofing the Singularity.Roman V. Yampolskiy - 2012 - Journal of Consciousness Studies 19 (1-2):194-214.
Leakproofing the Singularity Artificial Intelligence Confinement Problem.Roman Yampolskiy - 2012 - Journal of Consciousness Studies 19 (1-2):194-214.
Superintelligence: Paths, Dangers, Strategies.Nick Bostrom (ed.) - 2014 - Oxford University Press.
Knowing How, Knowing That, Knowing Technology.Per Norström - 2015 - Philosophy and Technology 28 (4):553-565.
The Problem of the Problem of Akrasia.Stephen Cohen - 1986 - Pacific Philosophical Quarterly 67 (1):62.
Political Participation in a Technological Society.Andrew Richard Mcnall - 1998 - Dissertation, The University of Wisconsin - Madison

Analytics

Added to PP index
2017-09-16

Total views
93 ( #108,862 of 2,419,781 )

Recent downloads (6 months)
5 ( #152,293 of 2,419,781 )

How can I increase my downloads?

Downloads

My notes