The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Cooperation in alternating interactions with memory constraints
Open accessAbstract
In repeated social interactions, individuals often employ reciprocal strategies to maintain cooperation. To explore the emergence of reciprocity, many theoretical models assume synchronized decision making. In each round, individuals decide simultaneously whether to cooperate or not. Yet many manifestations of reciprocity in nature are asynchronous. Individuals provide help at one time and receive help at another. Here, we explore such alternating games in which players take turns. We mathematically characterize all Nash equilibria among memory-one strategies. Moreover, we use evolutionary simulations to explore various model extensions, exploring the effect of discounted games, irregular alternation patterns, and higher memory. In all cases, we observe that mutual cooperation still evolves for a wide range of parameter values. However, compared to simultaneous games, alternating games require different strategies to maintain cooperation in noisy environments. Moreover, none of the respective strategies are evolutionarily stable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
This correlation aids the evolution of cooperative behaviors.
“which in turn, aids the evolution of cooperative behaviors [Park et al. , 2022].”
From Enhancing Cooperation through Selective Interaction and Long-term Experiences in Multi-Agent Reinforcement Learning (2024) · cites this paper as Park et al., 2022
The Introduction (page unavailable) says cooperation can evolve through repeated interactions, and the Discussion (page unavailable) says reciprocity can maintain cooperation. Neither passage identifies the correlation referred to as “this correlation” or shows that it aids cooperation’s evolution, so the specific causal claim is unsupported. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Five Rules for the Evolution of Cooperation
Nowak, M. A. (2006) · Science · doi:10.1126/science.1133755 · Cited by 5,894
Self-citationSigmund, K. (2010) · doi:10.1515/9781400832255 · Cited by 570
Flagged first, then by citations
Research works printed but not linked: 64
- Trivers, R. L. The evolution of reciprocal altruism. Q. Rev. Biol. 46, 35–57 (1971). · DOI · Paper page
- Rapoport, A. & Chammah, A. M. Prisoner’s Dilemma (University of Michigan Press, Ann Arbor, 1965). · DOI
- Nowak, M. A. & Sigmund, K. Tit for tat in heterogeneous populations. Nature 355, 250–253 (1992). · DOI · Paper page
- Szabó, G., Antal, T., Szabó, P. & Droz, M. Spatial evolutionary prisoner’s dilemma game with three strategies and external constraints. Phys. Rev. E 62, 1095–1103 (2000). · DOI
- Killingback, T. & Doebeli, M. The continuous Prisoner’s Dilemma and the evolution of cooperation through reciprocal altruism with variable investment. Am. Nat. 160, 421–438 (2002). · DOI
- Nowak, M. A., Sasaki, A., Taylor, C. & Fudenberg, D. Emergence of cooperation and evolutionary stability in finite populations. Nature 428, 646–650 (2004). · DOI
- Doebeli, M. & Hauert, C. Models of cooperation based on the prisoner’s dilemma and the snowdrift game. Ecol. Lett. 8, 748–766 (2005). · DOI
- Szolnoki, A., Perc, M. & Szabó, G. Phase diagrams for three-strategy evolutionary prisoner’s dilemma games on regular graphs. Phys. Rev. E 80, 056104 (2009). · DOI
- García, J. & Traulsen, A. The structure of mutations and the evolution of cooperation. PLoS ONE 7, e35287 (2012). · DOI
- Grujic, J. et al. A comparative analysis of spatial prisoner’s dilemma experiments: conditional cooperation and payoff irrelevance. Sci. Rep. 4, 4615 (2014). · DOI
- Hilbe, C., Hagel, K. & Milinski, M. Asymmetric power boosts extortion in an economic experiment. PLoS ONE 11, e0163867 (2016). · DOI
- Reiter, J. G., Hilbe, C., Rand, D. G., Chatterjee, K. & Nowak, M. A. Crosstalk in concurrent repeated games impedes direct reciprocity and requires stronger levels of forgiveness. Nat. Commun. 9, 555 (2018). · DOI
- Glynatsi, N. & Knight, V. A bibliometric study of research topics, collaboration and centrality in the field of the Iterated Prisoner’s Dilemma. Humanit. Soc. Sci. Commun. 8, 45 (2021). · DOI
- Schmid, L., Chatterjee, K., Hilbe, C. & Nowak, M. A unified framework of direct and indirect reciprocity. Nat. Hum. Behav. 5, 1292–1302 (2021). · DOI · Paper page
- Hilbe, C., Chatterjee, K. & Nowak, M. A. Partners and rivals in direct reciprocity. Nat. Hum. Behav. 2, 469–477 (2018). · DOI
- Melis, A. P. & Semmann, D. How is human cooperation different? Philos. Trans. R. Soc. B 365, 2663–2674 (2010). · DOI
- Wilkinson, G. S. Reciprocal food-sharing in the vampire bat. Nature 308, 181–184 (1984). · DOI
- Bernheim, D. & Whinston, M. D. Multimarket contact and collusive behavior. RAND J. Econ. 21, 1–26 (1990). · DOI
- Jackson, M. O., Rodriguez-Barraquer, T. & Tan, X. Social capital and social quilts: network patterns of favor exchange. Am. Econ. Rev. 102, 1857–1897 (2012). · DOI
- Milinski, M. Tit For Tat in sticklebacks and the evolution of cooperation. Nature 325, 433–435 (1987). · DOI
- Voelkl, B. et al. Matching times of leading and following suggest cooperation through direct reciprocity during V-formation flight in ibis. Proc. Natl Acad. Sci. USA 112, 2115–2120 (2015). · DOI
- Nowak, M. A. & Sigmund, K. The alternating prisoner’s dilemma. J. Theor. Biol. 168, 219–226 (1994). · DOI
- Frean, M. R. The prisoner’s dilemma without synchrony. Proc. R. Soc. B 257, 75–79 (1994). · DOI
- Zagorsky, B. M., Reiter, J. G., Chatterjee, K. & Nowak, M. A. Forgiver triumphs in alternating prisoner’s dilemma. PLoS ONE 8, e80814 (2013). · DOI
- McAvoy, A. & Hauert, C. Autocratic strategies for alternating games. Theor. Popul. Biol. 113, 13–22 (2016). · DOI
- Wedekind, C. & Milinski, M. Human cooperation in the simultaneous and the alternating prisoner’s dilemma: pavlov versus generous tit-for-tat. Proc. Natl Acad. Sci. USA 93, 2686–2689 (1996). · DOI
- Stewart, A. J. & Plotkin, J. B. From extortion to generosity, evolution in the iterated prisoner’s dilemma. Proc. Natl Acad. Sci. USA 110, 15348–15353 (2013). · DOI · Paper page
- Stewart, A. J. & Plotkin, J. B. Collapse of cooperation in evolving games. Proc. Natl Acad. Sci. USA 111, 17558 – 17563 (2014). · DOI
- Hilbe, C., Traulsen, A. & Sigmund, K. Partners or rivals? Strategies for the iterated prisoner’s dilemma. Games Econ. Behav. 92, 41–52 (2015). · DOI
- Donahue, K., Hauser, O., Nowak, M. & Hilbe, C. Evolving cooperation in multichannel games. Nat. Commun. 11, 3885 (2020). · DOI
- Akin, E. What you gotta know to play good in the iterated prisoner’s dilemma. Games 6, 175–190 (2015). · DOI
- Akin, E. The iterated prisoner’s dilemma: Good strategies and their dynamics. in (ed Assani, I.) Ergodic Theory, Advances in Dynamics, 77–107 (de Gruyter, Berlin, 2016). · DOI
- Akin, E. Good strategies for the iterated prisoner’s dilemma: Smale vs. Markov. J. Dyn. Games 4, 217–253 (2017). · DOI
- McAvoy, A. & Nowak, M. A. Reactive learning strategies for iterated games. Proc. R. Soc. A 475, 20180819 (2019). · DOI
- Glynatsi, N. & Knight, V. Using a theory of mind to find best responses to memory-one strategies. Sci. Rep. 10, 1–9 (2020). · DOI
- Press, W. H. & Dyson, F. D. Iterated prisoner’s dilemma contains strategies that dominate any evolutionary opponent. Proc. Natl Acad. Sci. USA 109, 10409–10413 (2012). · DOI
- Lorberbaum, J. P., Bohning, D. E., Shastri, A. & Sine, L. E. Are there really no evolutionarily stable strategies in the iterated prisoner’s dilemma? J. Theor. Biol. 214, 155–169 (2002). · DOI
- Hilbe, C., Martinez-Vaquero, L. A., Chatterjee, K. & Nowak, M. A. Memory-n strategies of direct reciprocity. Proc. Natl Acad. Sci. USA 114, 4715–4720 (2017). · DOI
- Nowak, M. A. & Sigmund, K. A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner’s Dilemma game. Nature 364, 56–58 (1993). · DOI · Paper page
- Boerlijst, M. C., Nowak, M. A. & Sigmund, K. Equal pay for all prisoners. Am. Math. Mon. 104, 303–307 (1997). · DOI
- Hilbe, C., Nowak, M. A. & Sigmund, K. The evolution of extortion in iterated prisoner’s dilemma games. Proc. Natl Acad. Sci. USA 110, 6913–6918 (2013). · DOI · Paper page
- Hao, D., Rong, Z. & Zhou, T. Extortion under uncertainty: zero-determinant strategies in noisy games. Phys. Rev. E 91, 052803 (2015). · DOI
- McAvoy, A. & Hauert, C. Autocratic strategies for iterated games with arbitrary action spaces. Proc. Natl Acad. Sci. USA 113, 3573–3578 (2016). · DOI
- Ichinose, G. & Masuda, N. Zero-determinant strategies in finitely repeated games. J. Theor. Biol. 438, 61–77 (2018). · DOI
- Mamiya, A. & Ichinose, G. Zero-determinant strategies under observation errors in repeated games. Phys. Rev. E 102, 032115 (2020). · DOI
- Molander, P. The optimal level of generosity in a selfish, uncertain environment. J. Confl. Resolut. 29, 611–618 (1985). · DOI
- Traulsen, A., Pacheco, J. M. & Nowak, M. A. Pairwise comparison and selection temperature in evolutionary game dynamics. J. Theor. Biol. 246, 522–529 (2007). · DOI
- Wu, B., Bauer, B., Galla, T. & Traulsen, A. Fitness-based models and pairwise comparison models of evolutionary games are typically different—even in unstructured populations. N. J. Phys. 17, 023043 (2015). · DOI
- Brauchli, K., Killingback, T. & Doebeli, M. Evolution of cooperation in spatially structured populations. J. Theor. Biol. 200, 405–417 (1999). · DOI
- Kraines, D. P. & Kraines, V. Y. Pavlov and the prisoner’s dilemma. Theory Decis. 26, 47–79 (1989). · DOI
- Zhang, H. Errors can increase cooperation in finite populations. Games Econ. Behav. 107, 203–219 (2018). · DOI
- Boyd, R. & Lorberbaum, J. No pure strategy is evolutionary stable in the iterated prisoner’s dilemma game. Nature 327, 58–59 (1987). · DOI
- Boyd, R. Mistakes allow evolutionary stability in the repeated prisoner’s dilemma game. J. Theor. Biol. 136, 47–56 (1989). · DOI
- Lorberbaum, J. M. D. No strategy is evolutionary stable in the repeated prisoner’s dilemma. J. Theor. Biol. 168, 117–130 (1994). · DOI
- García, J. & van Veelen, M. In and out of equilibrium I: evolution of strategies in repeated games with discounting. J. Econ. Theory 161, 161–189 (2016). · DOI
- García, J. & van Veelen, M. No strategy can win in the repeated prisoner’s dilemma: linking game theory and computer simulations. Front. Robot. AI 5, 102 (2018). · DOI
- Stewart, A. J. & Plotkin, J. B. The evolvability of cooperation under local and non-local mutations. Games 6, 231–250 (2015). · DOI
- Lombardo, M. P. Mutual restraint in tree swallows: a test of the tit for tat model of reciprocity. Science 227, 1363–1365 (1985). · DOI
- Muroyama, Y. Mutual reciprocity of grooming in female japanese macaques (Macaca fuscata). Behaviour 119, 161–170 (1991). · DOI
- Szabó, G. & Tőke, C. Evolutionary prisoner’s dilemma game on a square lattice. Phys. Rev. E 58, 69–73 (1998). · DOI
- Wu, B., Gokhale, C. S., Wang, L. & Traulsen, A. How small are small mutation rates? J. Math. Biol. 64, 803–827 (2012). · DOI
- Fudenberg, D. & Imhof, L. A. Imitation processes with small mutations. J. Econ. Theory 131, 251–262 (2006). · DOI · Paper page
- Imhof, L. A. & Nowak, M. A. Stochastic evolutionary dynamics of direct reciprocity. Proc. R. Soc. B 277, 463–468 (2010). · DOI
- Park, P. S., Nowak, M. A. & Hilbe, C. Cooperation in alternating interactions with memory constraints—source code and data. OSF https://doi.org/10.17605/osf.io/v5hgd (2022). · DOI
Cited by
Sorted by citations
Ren, T., & Zeng, X.-J. (2024) · Proceedings of the Thirty-ThirdInternational Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2024/22 · Cited by 8
“Additionally, we confirm a positive correlation between agent memory length and the effectiveness of interaction selection, which in turn, aids the evolution of cooperative behaviors [Park et al. , 2022].”
Background
Metadata
- Authors
- Park, P. S., Nowak, M. A., & Hilbe, C.
- Affiliations
- Harvard University (US)
- Max Planck Institute for Evolutionary Biology (DE)
- Corresponding author
- Hilbe, Christian
- Venue
- Nature Communications
- Published
- 2022-02-08
- Volume
- 13
- Issue
- 1
- Pages
- 737-737
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC8825791
- OpenAlex
- W4210886181
- Cited by
- 50
- References
- 2
- Citations by year
- 2026: 9 · 2025: 12 · 2024: 17 · 2023: 9 · 2022: 3
- FWCI
- 14.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Nature Communications (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (DGE1745303)
- European Research Council Starting Grant E-DIRECT
- Topics
- Social Sciences › Sociology and Political Science › Evolutionary Game Theory and Cooperation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Game Theory and Applications
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Keywords
- cooperation, Nash equilibrium, evolution of cooperation, evolutionary stability, discounted games, noisy environments
- MeSH terms
- Cooperative Behavior, Decision Making, Game Theory, Humans, Memory, Models, Psychological
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review