Informatica: An International Journal of Computing and Informatics 41 (4):389-400 (2017)
Authors |
|
Abstract |
Discussions about the possible consequences of creating superintelligence have included the possibility of existential risk, often understood mainly as the risk of human extinction. We argue that suffering risks (s-risks) , where an adverse outcome would bring about severe suffering on an astronomical scale, are risks of a comparable severity and probability as risks of extinction. Preventing them is the common interest of many different value systems. Furthermore, we argue that in the same way as superintelligent AI both contributes to existential risk but can also help prevent it, superintelligent AI can both be a suffering risk or help avoid it. Some types of work aimed at making superintelligent AI safe will also help prevent suffering risks, and there may also be a class of safeguards for AI that helps specifically against s-risks.
|
Keywords | existential risk suffering risk superintelligence ai alignment problem suffering-focused ethics population ethics |
Categories | (categorize this paper) |
Options |
![]() ![]() ![]() ![]() |
Download options
References found in this work BETA
Moral Tribes: Emotion, Reason, and the Gap Between Us and Them.Joshua Greene - 2013 - Penguin Press.
Unfit for the Future: The Need for Moral Enhancement.Ingmar Persson & Julian Savulescu - 2012 - Oxford University Press UK.
Better Never to Have Been: The Harm of Coming Into Existence.David Benatar - 2006 - New York ;Oxford University Press.
Equality or Priority?Derek Parfit - 2002 - In Matthew Clayton & Andrew Williams (eds.), The Ideal of Equality. New York: Palgrave Macmillan. pp. 81-125.
View all 26 references / Add more references
Citations of this work BETA
Long-Term Trajectories of Human Civilization.Seth D. Baum, Stuart Armstrong, Timoteus Ekenstedt, Olle Häggström, Robin Hanson, Karin Kuhlemann, Matthijs M. Maas, James D. Miller, Markus Salmela, Anders Sandberg, Kaj Sotala, Phil Torres, Alexey Turchin & Roman V. Yampolskiy - 2019 - Foresight 21 (1):53-83.
Do No Harm Policy for Minds in Other Substrates.Soenke Ziesche & Roman V. Yampolskiy - 2019 - Journal of Ethics and Emerging Technologies 29 (2):1-11.
AAAI: An Argument Against Artificial Intelligence.Sander Beckers - 2017 - In Vincent Müller (ed.), Philosophy and theory of artificial intelligence 2017. Berlin: Springer. pp. 235-247.
Nonconscious Cognitive Suffering: Considering Suffering Risks of Embodied Artificial Intelligence.Steven Umbrello & Stefan Lorenz Sorgner - 2019 - Philosophies 4 (2):24.
The Moral Consideration of Artificial Entities: A Literature Review.Jamie Harris & Jacy Reese Anthis - 2021 - Science and Engineering Ethics 27 (4):1-95.
View all 8 citations / Add more citations
Similar books and articles
Why AI Doomsayers Are Like Sceptical Theists and Why It Matters.John Danaher - 2015 - Minds and Machines 25 (3):231-246.
Existential Risks: Exploring a Robust Risk Reduction Strategy.Karim Jebari - 2015 - Science and Engineering Ethics 21 (3):541-554.
A Conceptual and Moral Analysis of Suffering.Franco A. Carnevale - 2009 - Nursing Ethics 16 (2):173-183.
Levinas on Suffering and Solidarity.Y. A. Kang - 1997 - Tijdschrift Voor Filosofie 59 (3):482 - 504.
The Problem of Superintelligence: Political, Not Technological.Wolfhart Totschnig - 2019 - AI and Society 34 (4):907-920.
Stakeholder Risk as Experienced by Non-Shareholder Stakeholders.Whitney Davis & Harry J. van Buren Iii - 2007 - Proceedings of the International Association for Business and Society 18:431-436.
Suffering, Euthanasia and Professional Expertise.Symons Xavier - 2016 - Solidarity: The Journal of Catholic Social Thought and Secular Ethics 6 (1):Article 5.
Perceptions of Risk, Fear, and Community Suffering.L. Ware & L. J. Whittington - forthcoming - In C. Gerrard (ed.), Waiting for the End of the World: Interdisciplinary Perspectives on Risk. Oxford, U.K.: Oxbow Books.
Stakeholder Risk as Experienced by Non-Shareholder Stakeholders: An Ethical Analysis and Risk Magnitude Model.Whitney Davis & Harry J. Van Buren Iii - 2007 - Proceedings of the International Association for Business and Society 18:431-436.
Editorial: Risks of General Artificial Intelligence.Vincent C. Müller - 2014 - Journal of Experimental and Theoretical Artificial Intelligence 26 (3):297-301.
Nurses' Perspectives on the Suffering of Preterm Infants.Anne Korhonen, Annu Haho & Tarja Pölkki - 2013 - Nursing Ethics 20 (7):0969733012475251.
Analytics
Added to PP index
2018-01-11
Total views
287 ( #36,406 of 2,498,126 )
Recent downloads (6 months)
34 ( #25,647 of 2,498,126 )
2018-01-11
Total views
287 ( #36,406 of 2,498,126 )
Recent downloads (6 months)
34 ( #25,647 of 2,498,126 )
How can I increase my downloads?
Downloads