Ethical issues in advanced artificial intelligence

Authors
Nick Bostrom
Oxford University
Abstract
The ethical issues related to the possible future creation of machines with general intellectual capabilities far outstripping those of humans are quite distinct from any ethical problems arising in current automation and information systems. Such superintelligence would not be just another technological development; it would be the most important invention ever made, and would lead to explosive progress in all scientific and technological fields, as the superintelligence would conduct research with superhuman efficiency. To the extent that ethics is a cognitive pursuit, a superintelligence could also easily surpass humans in the quality of its moral thinking. However, it would be up to the designers of the superintelligence to specify its original motivations. Since the superintelligence may become unstoppably powerful because of its intellectual superiority and the technologies it could develop, it is crucial that it be provided with human-friendly motivations. This paper surveys some of the unique ethical issues in creating superintelligence, and discusses what motivations we ought to give a superintelligence, and introduces some cost-benefit considerations relating to whether the development of superintelligent machines ought to be accelerated or retarded.
Keywords No keywords specified (fix it)
Categories (categorize this paper)
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive


Upload a copy of this paper     Check publisher's policy     Papers currently archived: 35,898
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

Self-Improving AI: An Analysis. [REVIEW]John Storrs Hall - 2007 - Minds and Machines 17 (3):249-259.
Computing Machinery and Morality.Blay Whitby - 2008 - AI and Society 22 (4):551-563.

Add more citations

Similar books and articles

Analytics

Added to PP index
2009-01-28

Total downloads
419 ( #8,543 of 2,293,852 )

Recent downloads (6 months)
69 ( #4,957 of 2,293,852 )

How can I increase my downloads?

Monthly downloads

My notes

Sign in to use this feature