Abstract: This article presents a model of self-improving AI in which improvement could happen on several levels: hardware, learning, code and goals system, each of which has several sublevels. We demonstrate that despite diminishing returns at each level and some intrinsic difficulties of recursive self-improvement—like the intelligence-measuring problem, testing problem, parent-child problem and halting risks—even non-recursive self-improvement could produce a mild form of superintelligence by combining small optimizations on different levels and the power of learning. Based on this, we analyze how self-improvement could happen on different stages of the development of AI, including the stages at which AI is boxed or hiding in the internet.
Keywords recursive self-improvement  artificial intelligence  existential risks
Categories (categorize this paper)
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Translate to english
Revision history

Download options

PhilArchive copy

 PhilArchive page | Other versions
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Risks of Artificial General Intelligence.Vincent C. Müller (ed.) - 2014 - Taylor & Francis (JETAI).
Risks of Artificial Intelligence.Vincent C. Müller (ed.) - 2016 - CRC Press - Chapman & Hall.
Climate Change, Justice and the Right to Development.Lars Löfquist - 2011 - Journal of Global Ethics 7 (3):251-260.
Advantages of Artificial Intelligences, Uploads, and Digital Minds.Kaj Sotala - 2012 - International Journal of Machine Consciousness 4 (01):275-291.
On Human Improvement.Asher Seidel - 1999 - International Journal of Applied Philosophy 13 (2):209-222.
School Improvement: Reality and Illusion.Robert Coe - 2009 - British Journal of Educational Studies 57 (4):363-379.


Added to PP index

Total views
274 ( #38,577 of 2,498,521 )

Recent downloads (6 months)
26 ( #33,629 of 2,498,521 )

How can I increase my downloads?


My notes