Superintelligence as a Cause or Cure for Risks of Astronomical Suffering


Authors
Kaj Sotala
Foundational Research Institute
Abstract
Discussions about the possible consequences of creating superintelligence have included the possibility of existential risk, often understood mainly as the risk of human extinction. We argue that suffering risks (s-risks) , where an adverse outcome would bring about severe suffering on an astronomical scale, are risks of a comparable severity and probability as risks of extinction. Preventing them is the common interest of many different value systems. Furthermore, we argue that in the same way as superintelligent AI both contributes to existential risk but can also help prevent it, superintelligent AI can both be a suffering risk or help avoid it. Some types of work aimed at making superintelligent AI safe will also help prevent suffering risks, and there may also be a class of safeguards for AI that helps specifically against s-risks.
Keywords existential risk  suffering risk  superintelligence  ai alignment problem  suffering-focused ethics  population ethics
Categories (categorize this paper)
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

Our Archive
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

No references found.

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Existential Risks: Exploring a Robust Risk Reduction Strategy.Karim Jebari - 2015 - Science and Engineering Ethics 21 (3):541-554.
Levinas on Suffering and Solidarity.Y. A. Kang - 1997 - Tijdschrift Voor Filosofie 59 (3):482 - 504.
Levinas on Suffering and Solidarity. Y. Kang - 1997 - Tijdschrift Voor Filosofie 59 (3):482-504.
When the Risk of Harm Harms.Adriana Placani - 2017 - Law and Philosophy 36 (1):77-100.
On the Suffering of Compassion.Peter Nilsson - 2011 - Philosophia 39 (1):125-144.
Stakeholder Risk as Experienced by Non-Shareholder Stakeholders.Whitney Davis & Harry J. van Buren Iii - 2007 - Proceedings of the International Association for Business and Society 18:431-436.
Suffering, Euthanasia and Professional Expertise.Symons Xavier - 2016 - Solidarity: The Journal of Catholic Social Thought and Secular Ethics 6 (1):Article 5.
Editorial: Risks of General Artificial Intelligence.Vincent C. Müller - 2014 - Journal of Experimental and Theoretical Artificial Intelligence 26 (3):297-301.

Analytics

Added to PP index
2018-01-11

Total views
122 ( #55,367 of 2,318,487 )

Recent downloads (6 months)
34 ( #15,173 of 2,318,487 )

How can I increase my downloads?

Monthly downloads

My notes

Sign in to use this feature