iScience 24 (6):102679 (2021)

Authors
Jurgis Karpus
King's College London
Abstract
We cooperate with other people despite the risk of being exploited or hurt. If future artificial intelligence (AI) systems are benevolent and cooperative toward us, what will we do in return? Here we show that our cooperative dispositions are weaker when we interact with AI. In nine experiments, humans interacted with either another human or an AI agent in four classic social dilemma economic games and a newly designed game of Reciprocity that we introduce here. Contrary to the hypothesis that people mistrust algorithms, participants trusted their AI partners to be as cooperative as humans. However, they did not return AI's benevolence as much and exploited the AI more than humans. These findings warn that future self-driving cars or co-working robots, whose success depends on humans' returning their cooperativeness, run the risk of being exploited. This vulnerability calls not just for smarter machines but also better human-centered policies.
Keywords human-AI interaction  human-computer interaction  behavioural game theory  cooperation  algorithm exploitation
Categories (categorize this paper)
Options
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

 PhilArchive page | Other versions
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Team Reasoning and Intentional Cooperation for Mutual Benefit.Robert Sugden - 2015 - Journal of Social Ontology 1 (1):143–166.
Social Norms or Social Preferences?Ken Binmore - 2010 - Mind and Society 9 (2):139-157.

View all 7 references / Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

What Niche Did Human Cooperativeness Evolve In?Hannes Rusch - 2013 - Ethics and Politics 15 (2):82-100.
The Evolution and Development of Human Cooperation.Federica Amici - 2015 - Interaction Studies 16 (3):383-418.
Cooperative Gazing Behaviors in Human Multi-Robot Interaction.Tian Xu, Hui Zhang & Chen Yu - 2013 - Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies / Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies 14 (3):390-418.
What Niche Did Human Cooperativeness Evolve In?Hannes Rusch - 2013 - Etica E Politica 15 (2):82-100.
Our Deepest Sympathy: An Essay on Computer Crashes, Grief, and Loss.Constance M. Ruzich - 2008 - Interaction Studiesinteraction Studies Social Behaviour and Communication in Biological and Artificial Systems 9 (3):504-517.
The Carrot and the Stick.Christoph Bartneck, Juliane Reichenbach & Julie Carpenter - 2008 - Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies / Social Behaviour and Communication in Biological and Artificial Systemsinteraction Studies 9 (2):179-203.

Analytics

Added to PP index
2021-06-23

Total views
30 ( #370,107 of 2,462,427 )

Recent downloads (6 months)
18 ( #43,532 of 2,462,427 )

How can I increase my downloads?

Downloads

My notes