Off-campus access
Using PhilPapers from home?
Click here to configure this browser for off-campus access.
- Rob Boyd, Evolutionary Dynamics of the Continuous Iterated Prisoner's Dilemma.The iterated prisoner’s dilemma (IPD) has been widely used in the biological and social sciences to model dyadic cooperation. While most of this work has focused on the discrete prisoner’s dilemma, in which actors choose between cooperation and defection, there has been some analysis of the continuous IPD, in which actors can choose any level of cooperation from zero to one. Here, we analyse a model of the continuous IPD with a limited strategy set, and show that a generous strategy achieves the maximum possible payoff against its own type. While this strategy is stable in a neighborhood of the equilibrium point, the equilibrium point itself is always vulnerable to invasion by uncooperative strategies, and hence subject to eventual destabilization. The presence of noise or errors has no effect on this result. Instead, generosity is favored because of its role in increasing contributions to the most efficient level, rather than in counteracting the corrosiveness of noise. Computer simulation using a single-locus infinite alleles Gaussian mutation model suggest that outcomes ranging from a stable cooperative polymorphism to complete collapse of cooperation are possible depending on the magnitude of the mutational variance. Also, making the cost of helping a convex function of the amount of help provided makes it more difficult for cooperative strategies to invade a non-cooperative equilibrium, and for the cooperative equilibrium to resist destabilization by noncooperative strategies.
Similar books and articles
The Prisoner’s Dilemma is a popular device used by researchers to analyze such institutions as business and the modem corporation. This popularity is not deserved under a certain condition that is widespread in college education. If we, as management educators, take seriouslyour parts in preparing our students to participate in the institutions of a democratic society, then the Prisoner’s Dilemma-as clever a rhetoricaldevice as it is-is an unacceptable means to that end. By posing certain questions about the prisoners in the Prisoner’s Dilemma, I show that management educators have created a Prisoners Dilemma, whereby they intellectually imprison themselves and their students by continuingto appeal to the Prisoner’s Dilemma. These questions are not encouraged by the advocates of the Prisoner’s Dilemma.
According to the so-called “Folk Theorem” for repeated games, stable cooperative relations can be sustained in a Prisoner’s Dilemma if the game
is repeated an indefinite number of times. This result depends on the possibility of applying strategies that are based on reciprocity, i.e., strategies that reward cooperation with subsequent cooperation and punish defectionwith subsequent defection. If future interactions are sufficiently important, i.e., if the discount rate is relatively small, each agent may be motivated to cooperate by fear of retaliation in the future.
For finite games, however, where the number of plays is known beforehand,
there is a backward induction argument showing that rational agents
will not be able to achieve cooperation.
On behalf of the Hobbesian “Foole”, who cannot see any advantage
in cooperation, Gregory Kavka (1983, 1986) has presented an argument
that significantly extends the range of the backward induction argument.
He shows that, for the backward induction argument to be effective, it is
not necessary that the precise number of future interactions be known. It
is sufficient that there is a known definite upper bound on the number of
interactions. A similar argument is developed by John W. Carroll (1987).
We will here question the assumption of a known upper bound. When
the assumption is made precise in the way needed for the argument to go
through, its apparent plausibility evaporates. We then offer a reformulation of the argument, based on weaker, and more plausible, assumptions.
Experiments in which subjects play simultaneously several finite two-person prisoner's dilemma supergames with and without an outside option reveal that: (i) an attractive outside option enhances cooperation in the prisoner's dilemma game, (ii) if the payoff for mutual defection is negative, subjects' tendency to avoid losses leads them to cooperate; while this tendency makes them stick to mutual defection if its payoff is positive, (iii) subjects use probabilistic start and endeffect behavior.
In the spatialized Prisoner's Dilemma, players compete against their immediate neighbors and adopt a neighbor's strategy should it prove locally superior. Fields of strategies evolve in the manner of cellular automata (Nowak and May, 1993; Mar and St. Denis, 1993a,b; Grim 1995, 1996). Often a question arises as to what the eventual outcome of an initial spatial configuration of strategies will be: Will a single strategy prove triumphant in the sense of progressively conquering more and more territory without opposition, or will an equilibrium of some small number of strategies emerge? Here it is shown, for finite configurations of Prisoner's Dilemma strategies embedded in a given infinite background, that such questions are formally undecidable: there is no algorithm or effective procedure which, given a specification of a finite configuration, will in all cases tell us whether that configuration will or will not result in progressive conquest by a single strategy when embedded in the given field. The proof introduces undecidability into decision theory in three steps: by (1) outlining a class of abstract machines with familiar undecidability results, by (2) modelling these machines within a particular family of cellular automata, carrying over undecidability results for these, and finally by (3) showing that spatial configurations of Prisoner's Dilemma strategies will take the form of such cellular automata.
Hamilton games-theoretic conflict model, which applies Maynard Smith's concept of evolutionarily stable strategy to the Prisoner's Dilemma, gives rise to an inconsistency between theoretical prescription and empirical results. Proposed resolutions of thisproblem are incongruent with the tenets of the models involved. The independent consistency of each model is restored, and the anomaly thereby circumvented, by a proof that no evolutionarily stable strategy exists in the Prisoner's Dilemma.
We consider the Stag Hunt in terms of Maynard Smith’s famous Haystack model. In the Stag Hunt, contrary to the Prisoner’s Dilemma, there is a cooperative equilibrium besides the equilibrium where every player defects. This implies that in the Haystack model, where a population is partitioned into groups, groups playing the cooperative equilibrium tend to grow faster than those at the non-cooperative equilibrium. We determine under what conditions this leads to the takeover of the population by cooperators. Moreover, we compare our results to the case of an unstructured population and to the case of the Prisoner’s Dilemma. Finally, we point to some implications our findings have for three distinct ideas: Ken Binmore’s group selection argument in favor of the evolution of efficient social contracts, Sewall Wright’s Shifting Balance theory, and the equilibrium selection problem of game theory.
Biologists rely extensively on the iterated Prisoner's Dilemma game to model reciprocal altruism. After examining the informal conditions necessary for reciprocal altruism, I argue that formal games besides the standard iterated Prisoner's Dilemma meet these conditions. One alternate representation, the modified Prisoner's Dilemma game, removes a standard but unnecessary condition; the other game is what I call a Cook's Dilemma. We should explore these new models of reciprocal altruism because they predict different stability characteristics for various strategies; for instance, I show that strategies such as Tit-for-Tat have different stability dynamics in these alternate models.
– We present a new paradigm extending the Iterated Prisoner's Dilemma to multiple players. Our model is unique in granting players information about past interactions between all pairs of players – allowing for much more sophisticated social behaviour. We provide an overview of preliminary results and discuss the implications in terms of the evolutionary dynamics of strategies.
The paper is essentially a short version Spohn "Strategic Rationality" which emphasizes in particular how the ideas developed there may be used to shed new light on the iterated prisoner's dilemma (and on iterated Newcomb's problem).
The computer simulation study explores the impact of the duration of social impact on the generation and stabilization of cooperative strategies. Rather than seeding the simulations with a finite set of strategies, a continuous distribution of strategies is being defined. Members of heterogeneous populations were characterized by a pair of probabilistic reactive strategies: the probability to respond to cooperation by cooperation and the probability to respond to defection by cooperation. This generalized reactive strategy yields the standard TFT mechanism, the All-Cooperate, All-Defect and Bully strategies as special cases. Pairs of strategies interacted through a Prisoner's Dilemma game and exerted social influence on all other members. Manipulating: (i) the initial distribution of populations' strategies, and (ii) the duration of social influence, we monitored the conditions leading to the emergence and stabilization of cooperative strategies. Results show that: (1) The duration of interactions between pairs of strategies constitutes a crucial factor for the emergence and stabilization of cooperative strategies, (2) Unless sufficient learning intervals are provided, initializing the simulations with cooperative populations does not guarantee that cooperation will sustain.
Discussion of Rob Boyd, Evolutionary dynamics of the continuous iterated prisoner's dilemma
|
|
There are no threads in this forum |
Nothing in this forum yet.

