The DOI matches its OpenAlex record; 37 of the 37 references it cites were found in a registry or an index.
Multi-agent Reinforcement Learning in Sequential Social Dilemmas
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Axelrod, R., & Hamilton, W. D. (1981) · Science · doi:10.1126/science.7466396 · Cited by 20,065
The Evolution of Reciprocal Altruism
Trivers, R. L. (1971) · The Quarterly Review of Biology · doi:10.1086/406755 · Cited by 11,010
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Evolutionary games and spatial chaos
Nowak, M. A., & May, R. M. (1992) · Nature · doi:10.1038/359826a0 · Cited by 4,463
Micromotives and Macrobehavior
Eaton, B. C., & Schelling, T. C. (1981) · The Canadian Journal of Economics · doi:10.2307/134812 · Cited by 3,758
Evolution of indirect reciprocity by image scoring
Nowak, M. A., & Sigmund, K. (1998) · Nature · doi:10.1038/31225 · Cited by 2,700
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,614
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
A simple rule for the evolution of cooperation on graphs and social networks
Ohtsuki, H., Hauert, C., Lieberman, E., & Nowak, M. A. (2006) · Nature · doi:10.1038/nature04605 · Cited by 2,208 · cited 1×
“, direct reciprocity [4, 5, 6, 7], indirect reciprocity [8], norm enforcement [9, 10], simple reinforcement learning variants [3], multiagent reinforcement learning [11, 12, 13, 14, 15], spatial structure [16], emotions [17], and social network effects [18, 19].”
BackgroundAn Evolutionary Approach to Norms
Axelrod, R. (1986) · American Political Science Review · doi:10.1017/s0003055400185016 · Cited by 2,205
A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game
Nowak, M., & Sigmund, K. (1993) · Nature · doi:10.1038/364056a0 · Cited by 1,797
Tit for tat in heterogeneous populations
Nowak, M. A., & Sigmund, K. (1992) · Nature · doi:10.1038/355250a0 · Cited by 1,029
Multiagent Reinforcement Learning: Theoretical Framework and an Algorithm
Hu, J., & Wellman, M. P. (1998) · Cited by 776
Reinforcement learning in the brain
Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 717
Learning dynamics in social dilemmas
Macy, M. W., & Flache, A. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.092080099 · Cited by 625
Friend-or-Foe Q-learning in General-Sum Games
Littman, M. L. (2001) · International Conference on Machine Learning · Cited by 427
If multi-agent learning is the answer, what is the question?
Shoham, Y., Powers, R., & Grenager, T. (2007) · Artificial Intelligence · doi:10.1016/j.artint.2006.02.006 · Cited by 410
Greenwald, A., & Hall, K. (2003) · Cited by 380
Lange, S., Gabel, T., & Riedmiller, M. (2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3_2 · Cited by 370
Reinforcement learning improves behaviour from evaluative feedback
Littman, M. L. (2015) · Nature · doi:10.1038/nature14540 · Cited by 368
Multiagent reinforcement learning in the Iterated Prisoner's Dilemma
Sandholm, T. W., & Crites, R. H. (1996) · Biosystems · doi:10.1016/0303-2647(95)01551-5 · Cited by 332
Evolutionary Dynamics of Multi-Agent Learning: A Survey
Bloembergen, D., Tuyls, K., Hennes, D., & Kaisers, M. (2015) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4818 · Cited by 295
A new route to the evolution of cooperation
Santos, F. C., & Pacheco, J. M. (2006) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2005.01063.x · Cited by 248
Solving transition independent decentralized Markov decision processes
Becker, R., Shlomo Zilberstein, B., Lesser, V., & Goldman, C. V. (2004) · doi:10.5555/1622487.1622500 · Cited by 226
Analyzing Complex Strategic Interactions in Multi-Agent Systems
Walsh, W. E., Das, R., Tesauro, G. J., & Kephart, J. O. (2002) · Cited by 120
Classes of Multiagent Q-learning Dynamics with epsilon-greedy Exploration
Wunder, M. B., Littman, M. L., & Babes, M. (2010) · International Conference on Machine Learning · Cited by 117
Emotional Multiagent Reinforcement Learning in Spatial Social Dilemmas
Yu, C., Zhang, M., Ren, F., & Tan, G. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2403394 · Cited by 85
Coordinate to cooperate or compete: Abstract goals and joint intentions in social interaction
Max Kleiman-weiner, A., Ho, M. K., Austerweil, J. L., Littman, M. L., & Tenenbaum, J. B. (2016) · eScholarship (California Digital Library) · Cited by 83
Approximate dynamic programming for two-player zero-sum Markov games
Pérolat, J., Scherrer, B., Piot, B., & Pietquin, O. (2015) · HAL · Cited by 63
Value Function Approximation in Zero-Sum Markov GamesPreprint
Lagoudakis, M. G., & Parr, R. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.0580 · Cited by 60
Cyclic Equilibria in Markov Games
Zinkevich, M., Greenwald, A., & Littman, M. L. (2005) · Cited by 53
Learning to cooperate in multi-agent social dilemmas
de Cote, E. M., Lazaric, A., & Restelli, M. (2006) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1160633.1160770 · Cited by 51
Algorithms for computing strategies in two-player simultaneous move games
Bošanský, B., Lisý, V., Lanctot, M., Čermák, J., & Winands, M. H. M. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.03.005 · Cited by 32
Self-citationCooperation Emergence under Resource-Constrained Peer Punishment
Mahmoud, S., Miles, S., & Luck, M. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/asot5388 · Cited by 22
On the Use of Non-Stationary Strategies for Solving Two-Player Zero-Sum Markov Games
Pérolat, J., Piot, B., Scherrer, B., & Pietquin, O. (2016) · HAL · Cited by 17
Cited by
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
“Other DRL works of note in MARL investigate the effects of learning and sequential decision making in game theory [38, 60].”
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Counterfactual Multi-Agent Policy Gradients
Foerster, J., Farquhar, G., Afouras, T., Nardelli, N., & Whiteson, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11794 · Cited by 1,873
Nguyen, T. T., Nguyen, N. D., & Nahavandi, S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977374 · Cited by 1,306
Metadata
- Authors
- Leibo, J. Z., Zambaldi, V., Lanctot, M., Marecki, J., & Graepel, T.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2017-02-10
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1702.03037
- OpenAlex
- W2594794854
- Cited by
- 263
- References
- 37
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.