Direct reciprocity with costly punishment: Generous tit-for-tat prevails
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
The standard model for direct reciprocity is the repeated Prisoner’s Dilemma, where in each round players choose between cooperation and defection. Here we extend the standard framework to include costly punishment. Now players have a choice between cooperation, defection and costly punishment. We study the set of all reactive strategies, where the behavior depends on what the other player has done in the previous round. We find all cooperative strategies that are Nash equilibria. If the cost of cooperation is greater than the cost of punishment, then the only cooperative Nash equilibrium is generous-tit-for-tat (GTFT), which does not use costly punishment. If the cost of cooperation is less than the cost of punishment, then there are infinitely many cooperative Nash equilibria and the response to defection can include costly punishment. We also perform computer simulations of evolutionary dynamics in populations of finite size. These simulations show that in the context of direct reciprocity, (i) natural selection prefers generous tit-for-tat over strategies that use costly punishment, and (ii) that costly punishment does not promote the evolution of cooperation. We find quantitative agreement between our simulation results and data from experimental observations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
The Evolution of Reciprocal Altruism
Trivers, R. L. (1971) · The Quarterly Review of Biology · doi:10.1086/406755 · Cited by 11,010
Five Rules for the Evolution of Cooperation
Nowak, M. A. (2006) · Science · doi:10.1126/science.1133755 · Cited by 5,894 · cited 1×
“Therefore, even if we think of group selection as a mechanism for the evolution of cooperation among humans (Wynne-Edwards, 1962; Wilson, 1975; Boyd and Richerson, 1990; Wilson and Sober, 1994; Bowles, 2001; Nowak, 2006; Traulsen and Nowak, 2006) this could only occur in combination with direct and indirect reciprocit…”
BackgroundSelf-citationAltruistic punishment in humans
Fehr, E., & Gächter, S. (2002) · Nature · doi:10.1038/415137a · Cited by 5,616
Cooperation and Punishment in Public Goods Experiments
Fehr, E., & Gächter, S. (2000) · American Economic Review · doi:10.1257/aer.90.4.980 · Cited by 4,547
Evolution of indirect reciprocity by image scoring
Nowak, M. A., & Sigmund, K. (1998) · Nature · doi:10.1038/31225 · Cited by 3,064 · cited 1×
“For indirect reciprocity, see (Sugden, 1986; Alexander, 1987; Kandori, 1992; Nowak and Sigmund, 1998, 2005; Lotem et al., 1999; Ohtsuki and Iwasa, 2004, 2005; Panchanathan and Boyd, 2005; Brandt and Sigmund, 2006; Pacheco et al., 2006a).”
BackgroundSelf-citationEvolution of indirect reciprocity
Nowak, M. A., & Sigmund, K. (2005) · Nature · doi:10.1038/nature04131 · Cited by 2,762
Self-citationAntisocial Punishment Across Societies
Herrmann, B., Thöni, C., & Gächter, S. (2008) · Science · doi:10.1126/science.1153808 · Cited by 2,038
A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game
Nowak, M., & Sigmund, K. (1993) · Nature · doi:10.1038/364056a0 · Cited by 1,797
Self-citationThe evolution of altruistic punishment
Boyd, R., Gintis, H., Bowles, S., & Richerson, P. J. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0630443100 · Cited by 1,748
Social Norms and Community Enforcement
Kandori, M. (1992) · The Review of Economic Studies · doi:10.2307/2297925 · Cited by 1,574 · cited 1×
“For indirect reciprocity, see (Sugden, 1986; Alexander, 1987; Kandori, 1992; Nowak and Sigmund, 1998, 2005; Lotem et al., 1999; Ohtsuki and Iwasa, 2004, 2005; Panchanathan and Boyd, 2005; Brandt and Sigmund, 2006; Pacheco et al., 2006a).”
BackgroundPunishment allows the evolution of cooperation (or anything else) in sizable groups
Boyd, R., & Richerson, P. J. (1992) · Ethology and Sociobiology · doi:10.1016/0162-3095(92)90032-y · Cited by 1,482 · cited 1×
“Therefore most models of costly punishment that have been studied so far (Boyd and Richerson, 1992; Sigmund et al., 2001; Boyd et al., 2003; Brandt et al., 2003; Fowler, 2005; Nakamaru and Iwasa, 2006; Hauert et al., 2007) tacitly use direct or indirect reciprocity.”
BackgroundThe provision of a sanctioning system as a public good.
Yamagishi, T. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.1.110 · Cited by 1,359
Wilson, D. S. (1975) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.72.1.143 · Cited by 1,259 · cited 1×
“Therefore, even if we think of group selection as a mechanism for the evolution of cooperation among humans (Wynne-Edwards, 1962; Wilson, 1975; Boyd and Richerson, 1990; Wilson and Sober, 1994; Bowles, 2001; Nowak, 2006; Traulsen and Nowak, 2006) this could only occur in combination with direct and indirect reciprocit…”
BackgroundPunishment in animal societies
Clutton-Brock, T. H., & Parker, G. A. (1995) · Nature · doi:10.1038/373209a0 · Cited by 1,043
Tit for tat in heterogeneous populations
Nowak, M. A., & Sigmund, K. (1992) · Nature · doi:10.1038/355250a0 · Cited by 1,029
Self-citationThe Competitive Advantage of Sanctioning Institutions
Gürerk, O., Irlenbusch, B., & Rockenbach, B. (2006) · Science · doi:10.1126/science.1123633 · Cited by 997
Dreber, A., Rand, D. G., Fudenberg, D., & Nowak, M. A. (2008) · Nature · doi:10.1038/nature06723 · Cited by 718 · cited 9×
“The simulation uses the Dreber et al. (2008) payoff values b ¼ 3; c ¼ 1; d ¼ e ¼ 1; a ¼ 1, and b ¼ 4, and temperature t ¼ 0:8.”
BackgroundMethodResultInfluentialSelf-citationHow should we define goodness?—reputation dynamics in indirect reciprocity
Ohtsuki, H., & Iwasa, Y. (2004) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2004.06.005 · Cited by 497
Self-citationThe leading eight: Social norms that can maintain cooperation by indirect reciprocity
Ohtsuki, H., & Iwasa, Y. (2006) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2005.08.008 · Cited by 491 · cited 1×
“For indirect reciprocity, see (Sugden, 1986; Alexander, 1987; Kandori, 1992; Nowak and Sigmund, 1998, 2005; Lotem et al., 1999; Ohtsuki and Iwasa, 2004, 2005; Panchanathan and Boyd, 2005; Brandt and Sigmund, 2006; Pacheco et al., 2006a).”
BackgroundSelf-citationAltruistic punishment and the origin of cooperation
Fowler, J. H. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500938102 · Cited by 473 · cited 2×
“…is well-known that errors play an important role in the analysis of repeated games (Molander, 1985; May, 1987; Nowak and Sigmund, 1989, 1992, 1993; Fudenberg and Maskin, 1990; Fudenberg and Tirole, 1991; Lindgren, 1991; Lindgren and Nordahl, 1994; Boerlijst et al., 1997; Wahl and Nowak, 1999a, b).”
BackgroundA tale of two defectors: the importance of standing for evolution of indirect reciprocity
Panchanathan, K., & Boyd, R. (2003) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(03)00154-1 · Cited by 388
Evolutionary cycles of cooperation and defection
Imhof, L. A., Fudenberg, D., & Nowak, M. A. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0502589102 · Cited by 381
Self-citationThe Biological and Evolutionary Logic of Human Cooperation
Burnham, T. C., & Johnson, D. D. P. (2005) · Analyse & Kritik · doi:10.1515/auk-2005-0107 · Cited by 231 · cited 1×
“It is more likely that punishers are motivated by internal anger (Kahneman et al., 1998; Carlsmith et al., 2002; Sanfey et al., 2003) rather than by the noble incentive to do what is best for the community.”
BackgroundEvolution of cooperation between individuals
Lotem, A., Fishman, M. A., & Stone, L. (1999) · Nature · doi:10.1038/22247 · Cited by 142
Cited by
Rand, D. G., & Nowak, M. A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.06.003 · Cited by 1,308
Self-citationRand, D. G. (2012) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2011.03.004 · Cited by 683
Self-citationUniversal scaling for the dilemma strength in evolutionary games
Wang, Z., Kokubo, S., Jusup, M., & Tanimoto, J. (2015) · Physics of Life Reviews · doi:10.1016/j.plrev.2015.04.033 · Cited by 586
Cognitive systems for revenge and forgiveness
McCullough, M. E., Kurzban, R., & Tabak, B. A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x11002160 · Cited by 481
Humans display a ‘cooperative phenotype’ that is domain general and temporally stable
Peysakhovich, A., Nowak, M. A., & Rand, D. G. (2014) · Nature Communications · doi:10.1038/ncomms5939 · Cited by 426
Self-citation
Metadata
- Authors
- Rand, D. G., Ohtsuki, H., & Nowak, M. A.
- Venue
- Journal of Theoretical Biology
- Publisher
- Elsevier BV
- Published
- 2009-01
- Volume
- 256
- Issue
- 1
- Pages
- 45-57
- ISSN
- 0022-5193 (ISSN-L)
- OpenAlex
- W1995714727
- Cited by
- 153
- References
- 25
- FWCI
- 25.55
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.