The DOI matches its Crossref record; 324 of the 327 references it cites were found in a registry or an index.
Cooperative Multi-Agent Learning: The State of the Art
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Integration ensures that machine outputs are used to challenge humans, and human inputs to challenge machines (Hoc, 2001), allowing for mutual learning (Panait & Luke, 2005) and debiasing (Larrick, 2004).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Panait & Luke, 2005
In the citing paper
“For example, AI is often applied in open systems, blurring organizational boundaries (Panait & Luke, 2005).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Panait & Luke, 2005
In the citing paper
“Multi-agent RL can also be applied to understand the behavior of groups of agents who need to cooperate; see [607] for an overview and [385,475] for recent examples.”
From Tackling climate change with machine learning (2023) · cites this paper as [607]
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002 · cited 1×
“There are many sources of additional information on EC; good choices include [6, 63, 64, 81, 87, 114, 141, 164].”
BackgroundReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 2×
“Other games have included Tic-Tac-Toe [4], Mancala [61], Othello [241], Go [149], Chess [138, 269], Poker [139], Blackjack [261], Nim and 3D Tic-TacToe [219], and Tag [215].”
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Axelrod, R., & Hamilton, W. D. (1981) · Science · doi:10.1126/science.7466396 · Cited by 20,065
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Genetic Algorithms + Data Structures = Evolution Programs
Michalewicz, Z. (1992) · Artificial Intelligence · doi:10.1007/978-3-662-02830-8 · Cited by 11,553
Goldberg, D. E. (1989) · Medical Entomology and Zoology · Cited by 10,109
Research works printed but not linked: 36
- W. Arthur, 1994, Complex. Econ. Theory, 84, 406
- B. Banerjee, R. Mukherjee, and S. Sen. “Learning mutual trust,” in Working Notes of AGENTS-00 Workshop on Deception, Fraud and Trust in Agent Societies, pp. 9–14, 2000.
- J. K. Bassett, 2002, A study of generalization techniques in evolutionary rule learning
- D. Bernstein, S. Zilberstein, and N. Immerman, “The complexity of decentralized control of MDPs,” in Proceedings of UAI-2000: The Sixteenth Conference on Uncertainty in Artificial Intelligence, 2000.
- L. Bull and O. Holland, “Evolutionary computing in multiagent environments: Eusociality”, in Proceedings of Seventh Annual Conference on Genetic Algorithms, 1997.
- M.R. Cutkosky, 1997, Readings in Agents, 46
- F. Fernandez, 2001, Int. J. Robot. Autom., 16, 217
- B. M. Good, Evolving multi-agent systems: Comparing existing approaches and suggesting new directions, Master’s thesis, University of Sussex, 2000
- D. L. Grecu, Using Learning to Improve Multi-Agent Systems for Design. PhD thesis, Worcester Polytechnic Institute, 1997
- J. Grefenstette, 1990, Machine Learn., 5, 355
- S.M. Gustafson, 2000, Layered learning in genetic programming for a co-operative robot soccer problem
- Haynes T., 1995, Adaptation and Learning in Multiagent Systems, Lecture Notes in Artificial Intelligence
- T. Haynes and S. Sen, “Crossover operators for evolving a team,” in J. R. Koza, K. Deb, M. Dorigo, D. B. Fogel, M. Garzon, H. Iba, and R. L. Riolo, (eds.), Genetic Programming 1997: Proceedings of the Second Annual Conference, Morgan Kaufmann: Stanford University, CA, USA, pp. 162–167, 13–16 July 1997
- D. Hillis, 1991, Artif. Life II, SFI Stud. Sci. Complex., 10, 313
- J. Holland, 1975, Adaptation in Natural and Artificial Systems
- J. Hu, 2003, J. Machine Learn. Res., 4, 1039
- M. Huhns and M. Singh, “Agents and multiagent systems: Themes, approaches and challenges,” in’M. Huhns and M. Singh, (eds.), Readings in Agents, Morgan Kaufmann, pp. 1–23, 1998
- I. Imam, (ed.), Intelligent Adaptive Agents. Papers from the 1996 AAAI Workshop. Technical Report WS-96-04, AAAI Press, 1996
- A. Ito, “How do selfish agents learn to cooperate?,” in Artificial Life V: Proceedings of the Fifth International Workshop on the Synthesis and Simulation of Living Systems, MIT Press, pp. 185–192, 1997
- L. R. Leerink, S. R. Schultz, and M. A. Jabri, “A reinforcement learning exploration strategy based on ant foraging mechanisms,” in Proceedings of the Sixth Australian Conference on Neural Networks, Sydney, Australia, 1995
- S. Luke, “Genetic programming produced competitive soccer softbot teams for RoboCup97,” in J. R. Koza et al, (ed.), Genetic Programming 1998: Proceedings of the Third Annual Conference, Morgan Kaufmann, pp. 214–222, 1998
- M. Mitchell, J. Crutchfield, and R. Das, “Evolving cellular automata with genetic algorithms: A’review of recent work,” in Proceedings of the First International Conference on Evolutionary Computation and its Applications (EvCA’96), 1996
- N. D. Monekosso, P. Remagnino, and A. Szarowicz, “An improved Q-learning algorithm using synthetic pheromones,” in Proceedings of the Second Workshop of Central and Eastern Europe on Multi-Agent Systems CEEMAS-01, pp. 197–206, 2001 · DOI
- J. Pollack, 1997, Artificial Life V: Proc. of the Fifth Int. Workshop on the Synthesis and Simulation of Living Systems, 92
- J. Schmidhuber, “Realistic multi-agent reinforcement learning,” in Learning in Distributed Artificial Intelligence Systems, Working Notes of the 1996 ECAI Workshop, 1996
- A. Schultz, J. Grefenstette, and W. Adams, “Robo-shepherd: Learning complex robotic behaviors,” in Robotics and Manufacturing: Recent Trends in Research and Applications. Vol. 6, ASME Press, pp. 763–768, 1996
- M. Sekaran and S. Sen, “To help or not to help”, in Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society, Pittsburgh, PA, pp. 736–741, 1995
- L. Spector and J. Klein, “Evolutionary dynamics discovered via visualization in the breve simulation environment,” in Workshop Proceedings of the 8th International Conference on the Simulation and Synthesis of Living Systems, pp. 163–170, 2002
- L. Steels, 1996, Machine Intelligence 15
- P. Stone, “Layered learning in multiagent systems,” in Proceedings of National Conference on Artificial Intelligence AAAI/IAAI, 1997
- P. Stone, “Layered Learning in Multi-Agent Systems,” PhD thesis, Carnegie Mellon University, 1998
- R. Sutton, 1998, Machine Learn., 3, 9
- P. ’t Hoen and K. Tuyls, “Analyzing multi-agent reinforcement learning using evolutionary dynamics,” in Proceedings of the 15th European Conference on Machine Learning (ECML), 2004
- M. Tan, 1993, Readings in Agents, 487
- J. Werfel, November 2000, IEEE Trans. Evol. Comput., 4, 388
- T. White, 1998, Genetic Programming 1998: Proceedings of the Third Annual Conference, 22
Cited by
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
“For example, AI is often applied in open systems, blurring organizational boundaries (Panait & Luke, 2005).”
BackgroundA Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
“wise solutions in the context of the dynamic task is currently unclear [14], [17].”
Swarm robotics: a review from the swarm engineering perspective
Brambilla, M., Ferrante, E., Birattari, M., & Dorigo, M. (2013) · Swarm Intelligence · doi:10.1007/s11721-012-0075-2 · Cited by 1,762
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
“The rapid progress in recent years of machine learning, and deep learning in particular, opens the door to a new perspective on this debate.”
BackgroundLarge scale evolutionary optimization using cooperative coevolution
Yang, Z., Tang, K., & Yao, X. (2008) · Information Sciences · doi:10.1016/j.ins.2008.02.017 · Cited by 1,026
“In the domain of learning multiagent behaviors, CC represents a natural approach to applying traditional evolutionary computation [7,8].”
BackgroundMulti-agent deep reinforcement learning: a survey
Gronauer, S., & Diepold, K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09996-w · Cited by 957
Cooperative Multi-agent Control Using Deep Reinforcement Learning
Gupta, J. K., Egorov, M., & Kochenderfer, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71682-4_5 · Cited by 874
“Multi-agent reinforcement learning has a rich literature [8, 30].”
BackgroundReinforcement Learning and Dynamic Programming Using Function Approximators
Busoniu, L., Babuska, R., De Schutter, B., & Ernst, D. (2017) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919
How can primary school students learn self-regulated learning strategies most effectively?
Dignath, C., Buettner, G., & Langfeldt, H.-P. (2008) · Educational Research Review · doi:10.1016/j.edurev.2008.02.003 · Cited by 903
“It can be broadly refer to team learning ( Panait and Luke, 2003 ) involves a single learner to carry out the learning behaviors of all the agents (Zuga, 2004).”
BackgroundValue-Decomposition Networks For Cooperative Multi-Agent Learning Based On Team Reward
Sunehag, P., Lever, G., Gruslys, A., Czarnecki, W. M., Zambaldi, V., Jaderberg, M., Lanctot, M., Sonnerat, N., Leibo, J. Z., Tuyls, K., et al. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/jsrc7365 · Cited by 618
“We consider the cooperative multi-agent reinforcement learning (MARL) problem [4, 17, 25], in which a system of several learning agents must jointly optimize a single reward signal – the team reward – accumulated over time.”
BackgroundMulti-agent Reinforcement Learning: An Overview
Buşoniu, L., Babuška, R., & De Schutter, B. (2010) · Studies in Computational Intelligence · doi:10.1007/978-3-642-14435-6_7 · Cited by 741
“However, the suitability of such state-wise solutions in the context of the dynamic task is not always clear [86,108].”
BackgroundA survey and critique of multiagent deep reinforcement learning
Hernandez-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 671
Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles
Aradi, S. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3024655 · Cited by 639
Cooperative Control and Potential Games
Marden, J. R., Arslan, G., & Shamma, J. S. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2009.2017273 · Cited by 544
“Surprisingly, there has been relatively little research that explicitly links cooperative control problems to the very relevant branches of learning in game literature [13] or multiagent system literature [14], [15] that address coordination problems.”
BackgroundDeep Co-Training for Semi-Supervised Image Recognition
Qiao, S., Shen, W., Zhang, Z., Wang, B., & Yuille, A. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01267-0_9 · Cited by 507
Lu, Y., Xu, X., & Wang, L. (2020) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.06.010 · Cited by 528
Cooperative Intersection Management: A Survey
Chen, L., & Englund, C. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2471812 · Cited by 488
Learning a Generic Value-Selection Heuristic Inside a Constraint Programming Solver
Sunehag, P., Lever, G., Gruslys, A., Czarnecki, W. M., Zambaldi, V., Jaderberg, M., Lanctot, M., Sonnerat, N., Leibo, J. Z., Tuyls, K., et al. (2017) · arXiv (Cornell University) · doi:10.4230/lipics.cp.2023.25 · Cited by 491
“We consider the cooperative multi-agent reinforcement learning (MARL) problem (Panait and Luke, 2005; Busoniu et al., 2008; Tuyls and Weiss, 2012), in which a system of several learning agents must jointly optimize a single reward signal – the team reward – accumulated over time.”
BackgroundMean Field Multi-Agent Reinforcement Learning
Yang, Y., Luo, R., Li, M., Zhou, M. Q., Zhang, W., & Wang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05438 · Cited by 286
“Studies show that an agent who learns the effect of joint actions has better performance than those who do not in many scenarios, including cooperative games (Panait & Luke, 2005), zero-sum stochastic games (Littman, 1994), and general-sum stochastic games (Littman, 2001; Hu & Wellman, 2003).”
BackgroundMetaheuristics in large-scale global continues optimization: A survey
Mahdavi, S., Shiri, M. E., & Rahnamayan, S. (2015) · Information Sciences · doi:10.1016/j.ins.2014.10.042 · Cited by 465
Cooperative Heterogeneous Multi-Robot Systems: A Survey
Rizk, Y., Awad, M., & Tunstel, E. W. (2020) · ACM Computing Surveys · doi:10.1145/3303848 · Cited by 449
“Other surveys had a narrower scope than our work and focused on a specific research area such as cooperative MAS planning and control models and algorithms [155] and distributed consensus in MAS [235].”
BackgroundA Survey of Embodied AI: From Simulators to Research Tasks
Duan, J., Yu, S., Tan, H. L., Zhu, H., & Tan, C. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3141105 · Cited by 420
Autonomous agents modelling other agents: A comprehensive survey and open problems
Albrecht, S. V., & Stone, P. (2018) · Artificial Intelligence · doi:10.1016/j.artint.2018.01.002 · Cited by 417
“In addition to the above surveys, there are also a number of surveys on the topic of multiagent learning (Hernandez-Leal et al., 2017; Bloembergen et al., 2015; Tuyls and Weiss, 2012; Busoniu et al., 2008; Panait and Luke, 2005; Alonso et al., 2001; Stone and Veloso, 2000; Sen and Weiss, 1999).”
BackgroundOptimization of global production scheduling with deep reinforcement learning
Waschneck, B., Reichstaller, A., Belzner, L., Altenmüller, T., Bauernhansl, T., Knapp, A., & Kyek, A. (2018) · Procedia CIRP · doi:10.1016/j.procir.2018.03.212 · Cited by 366
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Multilevel cooperative coevolution for large scale optimization
Yang, Z., Tang, K., & Yao, X. (2008) · 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) · doi:10.1109/cec.2008.4631014 · Cited by 322
“In the domain of learning multiagent behaviors, CC represents a natural approach to applying traditional evolutionary computation [11], [12].”
BackgroundAd Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination
Stone, P., Kaminka, G., Kraus, S., & Rosenschein, J. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7529 · Cited by 323
“This work is one of many approaches for cooperative multiagent learning (see surveys at (Stone & Veloso 2000; Panait & Luke 2005)).”
BackgroundMastering Complex Control in MOBA Games with Deep Reinforcement Learning
Ye, D., Liu, Z., Sun, M., Shi, B., Zhao, P., Wu, H., Yu, H., Yang, S., Wu, X., Guo, Q., et al. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6144 · Cited by 284
Evolutionary Dynamics of Multi-Agent Learning: A Survey
Bloembergen, D., Tuyls, K., Hennes, D., & Kaisers, M. (2015) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4818 · Cited by 295
Bui, Y.-H., Hussain, A., & Kim, H.-M. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2924025 · Cited by 282
“This method drives the learning process on the basis of penalties or rewards assessed on a sequence of actions taken in response to the environment dynamics [13], [14].”
MethodEmergence of norms through social learning
Sen, S., & Airiau, S. (2007) · International Joint Conference on Artificial Intelligence · Cited by 286
Reinforcement learning for microgrid energy management
Kuznetsova, E., Li, Y.-F., Ruiz, C., Zio, E., Ault, G., & Bell, K. (2013) · Energy · doi:10.1016/j.energy.2013.05.060 · Cited by 274
Agent-Based Modeling in Economics and Finance: Past, Present, and Future
Axtell, R. L., & Farmer, J. D. (2025) · Journal of Economic Literature · doi:10.1257/jel.20221319 · Cited by 240
A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Silva, F. L. D., & Costa, A. H. R. (2019) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11396 · Cited by 273
Du, W., & Ding, S. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09938-y · Cited by 270
Payoff-Based Dynamics for Multiplayer Weakly Acyclic Games
Marden, J. R., Young, H. P., Arslan, G., & Shamma, J. S. (2009) · SIAM Journal on Control and Optimization · doi:10.1137/070680199 · Cited by 264
“See also the recent special issue containing [22] or survey article [ 18 ] for perspectives from machine learning.) Unlike most of the learning rules in this literature, which assume that agents adjust their behavior based on the observed behavior of other agents, we shall assume that agents know only their own past a…”
BackgroundOpportunities for multiagent systems and multiagent reinforcement learning in traffic control
Bazzan, A. L. C. (2009) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-008-9062-9 · Cited by 235
“For a more comprehensive description of general approaches, we refer the reader to [58,70] and references therein.”
BackgroundThe Hanabi challenge: A new frontier for AI research
Bard, N., Foerster, J. N., Chandar, S., Burch, N., Lanctot, M., Song, H. F., Parisotto, E., Dumoulin, V., Moitra, S., Hughes, E., et al. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2019.103216 · Cited by 235
“Several years of work on MARL gave rise to many algorithms, extensions, and analyses [59, 60, 61, 62, 63].”
BackgroundDistributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks
Galindo-Serrano, A., & Giupponi, L. (2010) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2010.2043124 · Cited by 226
“model has successfully been applied in multiple cases [16], so that we propose it for our scenario.”
MethodYan, Y., Chow, A. H. F., Ho, C. P., Kuo, Y.-H., Wu, Q., & Ying, C. (2022) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2022.102712 · Cited by 214
Decision Making in Multiagent Systems: A Survey
Rizk, Y., Awad, M., & Tunstel, E. W. (2018) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2018.2840971 · Cited by 219
“Reference [5] used the terms team learning and concurrent”
BackgroundMethodFrom 4G to 5G: Self-organized network management meets machine learning
Moysen, J., & Giupponi, L. (2018) · Computer Communications · doi:10.1016/j.comcom.2018.07.015 · Cited by 198
Who2com: Collaborative Perception via Learnable Handshake Communication
Liu, Y.-C., Tian, J., Ma, C.-Y., Glaser, N., Kuo, C.-W., & Kira, Z. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197364 · Cited by 187
“Existing works on MARL demonstrated the effectiveness of communication for various tasks, applying the models on simplistic 2D grid environments where the observation of each agent is low-dimensional.”
BackgroundCollaborative Unsupervised Domain Adaptation for Medical Image Diagnosis
Zhang, Y., Wei, Y., Wu, Q., Zhao, P., Niu, S., Huang, J., & Tan, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3006377 · Cited by 185
“unsupervised learning [42], semi-supervised learning [43], [44], weakly-supervised learning [21] and multi-agent learning [45].”
BackgroundIs Independent Learning All You Need in the StarCraft Multi-Agent Challenge?
de Witt, C. S., Gupta, T., Makoviichuk, D., Makoviychuk, V., Torr, P. H. S., Sun, M., & Whiteson, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09533 · Cited by 183
“…(MARL) has shown considerable promise in solving tasks that can be described as a Dec-POMDP [17], i.e., where agents optimise a single scalar team reward signal in a partially observable environment while choosing actions based only on their own local action-observation histories [18, 2, 29].”
BackgroundMultiagent Learning: Basics, Challenges, and Prospects
Tuyls, K., & Weiss, G. (2012) · AI Magazine · doi:10.1609/aimag.v33i3.2426 · Cited by 179
“For the sake of completeness, there are several recent articles available that do an excellent job on surveying MAL; see, for example, Busoniu, Babuska, and De Schutter (2008); Panait and Luke (2005); Yang and Gu (2009).”
BackgroundMachine learning and multi-agent systems in oil and gas industry applications: A survey
Hanga, K. M., & Kovalchuk, Y. (2019) · Computer Science Review · doi:10.1016/j.cosrev.2019.08.002 · Cited by 187
AutoMoDe: A novel approach to the automatic design of control software for robot swarms
Francesca, G., Brambilla, M., Brutschy, A., Trianni, V., & Birattari, M. (2014) · Swarm Intelligence · doi:10.1007/s11721-014-0092-4 · Cited by 171
“See Panait and Luke (2005) for a review.”
BackgroundIoT-aided robotics applications: Technological implications, target domains and open issues
Grieco, L. A., Rizzo, A., Colucci, S., Sicari, S., Piro, G., Di Paola, D., & Boggia, G. (2014) · Computer Communications · doi:10.1016/j.comcom.2014.07.013 · Cited by 169
“In particular, a huge interest has been given to the application of machine-learning methods to cooperative MAS (see [153] for a comprehensive review), which continues to be investigated in artificial intelligence [154], still in synergy with game theory [155].”
BackgroundA survey of multi-agent deep reinforcement learning with communication
Zhu, C., Dastani, M. M., & Wang, S. (2024) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-023-09633-6 · Cited by 390
“Early surveys consider the role of communication in MARL but assume it to be predefined rather than a subject of learning [13, 14, 15].”
Wang, Y., Xu, T., Niu, X., Tan, C., Chen, E., & Xiong, H. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3033782 · Cited by 163
Deep-Learned Collision Avoidance Policy for Distributed Multiagent Navigation
Long, P., Liu, W., & Pan, J. (2017) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2017.2651371 · Cited by 159
“Reinforcement learning has been widely used for the multiagent decision making [13]–[16], which is formulated as a multiagent Markov Decision Processes (MDP) problem.”
BackgroundChang, Z., Deng, H., You, L., Min, G., Garg, S., & Kaddoum, G. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3171600 · Cited by 155
Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learning
Palanisamy, P. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207663 · Cited by 211
“c) Communicating: Actors that are capable of communicating (through direct or indirect channels [23] with other actors through Vehicle-to-Vehicle (V2V) communication channels can help to increase information availability in partiallyobservable environments.”
BackgroundFederated Multiagent Actor–Critic Learning for Age Sensitive Mobile-Edge Computing
Zhu, Z., Wan, S., Fan, P., & Letaief, K. B. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078514 · Cited by 154
“Moreover, in multi-agent scenes, the single learning agent mode or centralized RL requests a large neural network with a complex structure and massive model parameters, which may suffer from some difficulties on training convergence and model generalization [52], [53].”
Game-Theoretic Multiagent Reinforcement LearningPreprint
Yang, Y., Ma, C., Ding, Z., McAleer, S., Jin, C., Wang, J., & Sandholm, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00583 · Cited by 351
Incremental Social Learning in Particle Swarms
de, M. A. M., Stützle, T., den Enden, K. V., & Dorigo, M. (2010) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2010.2055848 · Cited by 137
A reinforcement learning approach for optimizing multiple traveling salesman problems over graphs
Hu, Y., Yao, Y., & Lee, W. S. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106244 · Cited by 156
Coordinated Multi-Agent Imitation LearningPreprint
Le, H. M., Yue, Y., Carr, P., & Lucey, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03121 · Cited by 220
“From the learning perspective, (cooperative) multi-agent learning is not a new area of research (Stone & Veloso, 2000; Panait & Luke, 2005).”
BackgroundMulti-Agent Reinforcement Learning: A Survey
Buşoniu, L., Babuška, R., & Schutter, B. D. (2006) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv.2006.345353 · Cited by 130
“However, the suitability of such state-wise solutions in the context of the dynamic task is currently unclear [2], [6].”
Genetic Team Composition and Level of Selection in the Evolution of Cooperation
Waibel, M., Keller, L., & Floreano, D. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2008.2011741 · Cited by 126
“This corresponded to a situation where the individual contributions to team performance were not known, i.e., a situation with credit assignment problems [70], [71], which is the case for many cooperative multiagent tasks [ 72 ].”
BackgroundGu, Z., Yin, T., & Ding, Z. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3056764 · Cited by 125
Metahuman systems = humans + machines that learn
Lyytinen, K., Nickerson, J. V., & King, J. L. (2020) · Journal of Information Technology · doi:10.1177/0268396220915917 · Cited by 187
“More generally, new models of agent behavior and learning patterns will be necessary to build machines that learn for tasks where learning takes place in a context of many human and machine agents interacting, cooperating, and competing, as with driving (Lowe et al., 2017; Panait and Luke, 2005).”
BackgroundReinforcement Learning Methods for Computation Offloading: A Systematic Review
Zabihi, Z., Moghadam, A. M. E., & Rezvani, M. H. (2023) · ACM Computing Surveys · doi:10.1145/3603703 · Cited by 157
“913919 [67] Liviu Panait and Sean Luke.”
A Cell Outage Management Framework for Dense Heterogeneous Networks
Onireti, O., Zoha, A., Moysen, J., Imran, A., Giupponi, L., Imran, M. A., & Abu‐Dayya, A. (2015) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2015.2431371 · Cited by 124
“they have been shown to provide successful results also in multiagent scenarios [44].”
BackgroundA Survey on Applications of Agent Technology in Industrial Process Control
Metzger, M., & Polaków, G. (2011) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2011.2166781 · Cited by 122
“A discussion on the challenges and directions of development of agent-based software engineering was later presented in [6], and a comprehensive review of cooperative multiagent learning problems—in [7].”
BackgroundOn Generative Agents in Recommendation
Zhang, A., Chen, Y., Sheng, L., Wang, X., & Chua, T. (2024) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3626772.3657844 · Cited by 410
“Humans have long been pursuing intelligent agents to handle various tasks [8, 21, 41].”
BackgroundThe Surprising Effectiveness of MAPPO in Cooperative, Multi-Agent GamesPreprint
Yu, C., Velu, A., Vinitsky, E., Wang, Y., Bayen, A. M., & Wu, Y. (2021) · arXiv (Cornell University) · Cited by 121
Game Plan: What AI can do for Football, and What Football can do for AI
Tuyls, K., Omidshafiei, S., Müller, P. F., Wang, Z., Connor, J. T., Hennes, D., Graham, I., Spearman, W., Waskett, T., Steele, D., et al. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12505 · Cited by 176
Park, J., Mei, Y., Nguyen, S., Chen, G., & Zhang, M. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.11.020 · Cited by 114
“In cooperative coevolution, multiple interacting subcomponents are evolved that can be combined together to form a rule [28].”
BackgroundReaching Consensus in the Byzantine Empire: A Comprehensive Review of BFT Consensus Algorithms
Zhang, G., Pan, F., Mao, Y., Tijanic, S., Dang’ana, M., Motepalli, S., Zhang, S., & Jacobsen, H. (2023) · ACM Computing Surveys · doi:10.1145/3636553 · Cited by 165
“Moreover, multi-agent machine learning adds further layers of complexity to the training process [73].”
BackgroundMulti-Agent Imitation Learning for Driving Simulation
Bhattacharyya, R., Phillips, D. J., Wulfe, B., Morton, J., Kuefler, A., & Kochenderfer, M. J. (2018) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593758 · Cited by 153
A Collaborative Reinforcement Learning Approach to Urban Traffic Control Optimization
Salkham, A., Cunningham, R., Garg, A., & Cahill, V. (2008) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wiiat.2008.88 · Cited by 109
“(Multi)-Agent Systems (MAS) [ 25 ], RL and numerous decentralized RL methods are being customized for UTC.”
BackgroundMultiagent Reinforcement Learning: Rollout and Policy Iteration
Bertsekas, D. P. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1003814 · Cited by 113
“Works of this type also have a long history, and they have been surveyed over time by Sycara [41], Stone and Veloso [42], Panait and Luke [43], Busoniu, Babuska, and De Schutter [44], [45], Matignon, Laurent, and Le Fort-Piat [46], HernandezLeal, Kartal, and Taylor [47], OroojlooyJadid and Hajinezhad [48], Zhang, Yang…”
BackgroundChen, H., Li, X., & Zhao, F. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2517084 · Cited by 105
Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey
Majid, A. Y., Saaybi, S., van Rietbergen, T., François-Lavet, V., Prasad, R. R. V., & Verhoeven, C. J. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264540 · Cited by 141
“…approach has been proposed [142], [143], [144], [145]. b) Credit assignment: One of the main challenges of learning in a cooperative setting is termed a “multiagent credit assignment problem,” which refers to how to divide a reward obtained on a team level amongst individual learners [146].”
BackgroundAge of Information Aware VNF Scheduling in Industrial IoT Using Deep Reinforcement Learning
Akbari, M., Abedi, M. R., Joda, R., Pourghasemian, M., Mokari, N., & Erol‐Kantarci, M. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3087264 · Cited by 108
“However, in some environments like the proposed one in this paper, using multiple copies of the same agents while cooperating with each other to solve the shared problem may lead to get better results since each SA has limited capacity to learn [12], [13].”
BackgroundLearning to Communicate to Solve Riddles with Deep Distributed Recurrent Q-NetworksPreprint
Foerster, J., Assael, Y., de Freitas, N., & Whiteson, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02672 · Cited by 175
“There has been a plethora of work on multi-agent reinforcement learning with communication, e.g., (Tan, 1993; Melo et al., 2011; Panait & Luke, 2005; Zhang & Lesser, 2013; Maravall et al., 2013).”
BackgroundCollective learning modeling based on the kinetic theory of active particles
Burini, D., Lillo, S. D., & Gibelli, L. (2015) · Physics of Life Reviews · doi:10.1016/j.plrev.2015.10.008 · Cited by 100
Simultaneously Learning and Advising in Multiagent Reinforcement Learning
da Silva, F. L., Glatt, R., & Costa, A. H. R. (2017) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/3091125.3091280 · Cited by 101
Deep Neural Architectures for Mapping Scalp to Intracranial EEG
Antoniades, A., Spyrou, L., Martín-López, D., Valentín, A., Alarcón, G., Sanei, S., & Took, C. C. (2018) · International Journal of Neural Systems · doi:10.1142/s0129065718500090 · Cited by 108
Model‐based vs data‐driven adaptive control: An overview
Benosman, M. (2018) · International Journal of Adaptive Control and Signal Processing · doi:10.1002/acs.2862 · Cited by 119
Generative encoding for multiagent learning
D’Ambrosio, D. B., & Stanley, K. O. (2008) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1389095.1389256 · Cited by 101
“An alternative approach, cooperative coevolution, is an established evolutionary method for training teams of agents that must work together [16, 17, 18].”
BackgroundMethodInfluentialAn evolving research agenda for human–coastal systems
Lazarus, E. D., Ellis, M. A., Murray, A. B., & Hall, D. M. (2015) · Geomorphology · doi:10.1016/j.geomorph.2015.07.043 · Cited by 112
“lem (Axelrod, 1997; Parker et al., 2003; Panait and Luke, 2005), the crux of which lies in themodeler's rationale for howmodel agents function (Tesfatsion, 2003, p.”
BackgroundThe world of independent learners is not markovian
Laurent, G. J., Matignon, L., & Fort-Piat, N. L. (2011) · International Journal of Knowledge-based and Intelligent Engineering Systems · doi:10.3233/kes-2010-0206 · Cited by 105
“The loss of environmental stationarity is a commonly cited cause of difficulties in multi-agent learning systems [5,10,24,26,35].”
BackgroundDistributed Q-Learning for Interference Control in OFDMA-Based Femtocell Networks
Galindo‐Serrano, A., & Giupponi, L. (2010) · IEEE Vehicular Technology Conference · doi:10.1109/vetecs.2010.5493950 · Cited by 98
“In this case, the convergence to optimality proof does not hold strictly, but this independent learning approach has been shown to correctly converge in multiple applications [8].”
BackgroundEmergent Communication through NegotiationPreprint
Cao, K., Lazaridou, A., Lanctot, M., Leibo, J. Z., Tuyls, K., & Clark, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03980 · Cited by 141
“Recent work on deep multi-agent reinforcement learning (MARL) has shown great success in teaching agents complex behaviour without a complex environment simulator or demonstration data (Panait & Luke, 2005; Busoniu et al., 2008; Tuyls & Weiss, 2012; Silver et al., 2017; Leibo et al., 2017).”
BackgroundOpen Problems in Cooperative AI
Dafoe, A., Hughes, E., Bachrach, Y., Collins, T., McKee, K. R., Leibo, J. Z., Larson, K., & Graepel, T. (2020) · arXiv · doi:10.48550/arxiv.2012.08630 · Cited by 93
“rwords):the degreeofcommoninterest;theopportunityforbuildinginstitutions;thenumberofagents;thekindsof agents(machines,humans);andthecostsandcapabilitiesofbothcommunicationandcomputation. PanaitandLuke[PL05]reviewworkonmachinelearninginmulti-agentcooperation,thoughmostly limitedtosettingsofpurecommoninterest.Theydiscus…”
Autonomous task sequencing in a robot swarm
Garattoni, L., & Birattari, M. (2018) · Science Robotics · doi:10.1126/scirobotics.aat0430 · Cited by 99
“In this sense, we can qualify the learning process of TS-Swarm as team learning (58, 59).”
MethodRen, Q., Abbasi, O., Kurt, G. K., Yanıkömeroğlu, H., & Chen, J. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3171824 · Cited by 115
“In this article, we consider the proposed architecture as a cooperative MARL problem where agents are independent decision-makers who coordinate their actions and work together to achieve a shared team reward accumulated over time [32].”
BackgroundEmergent Multi-Agent Communication in the Deep Learning EraPreprint
Lazaridou, A., & Baroni, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02419 · Cited by 318
“Pre-deep-learning work on multi-agent communication for coordination ([86]) used to hard-code communication, e.”
BackgroundTriguero, I., Molina, D., Poyatos, J., Del Ser, J., & Herrera, F. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102135 · Cited by 90
A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks
Wang, W., Kwasinski, A., Niyato, D. T., & Han, Z. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2539923 · Cited by 91
“tive decision-making domain [52], [53].”
do Nascimento, N. M., & de Lucena, C. J. P. (2016) · Information Sciences · doi:10.1016/j.ins.2016.10.031 · Cited by 93
“Some researchers [13,47,59,42,11,43] have investigated the emergence of cooperative or competitive self-organizing MAS.”
BackgroundLiang, X., Tao, Y., Hong, J., & Shen, Q. (2018) · Energy Policy · doi:10.1016/j.enpol.2018.11.029 · Cited by 90
From motor control to team play in simulated humanoid football
Liu, S., Lever, G., Wang, Z., Merel, J., Eslami, S. M. A., Hennes, D., Czarnecki, W. M., Tassa, Y., Omidshafiei, S., Abdolmaleki, A., et al. (2022) · Science Robotics · doi:10.1126/scirobotics.abo0235 · Cited by 88
Dynamic analysis of multiagent Q -learning with ε-greedy exploration
Gomes, E. R., & Kowalczyk, R. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553422 · Cited by 87
“All these features make it especially dif.cult to predict and to model the learning behaviour (Panait & Luke, 2005).”
BackgroundMethodBiasing Coevolutionary Search for Optimal Multiagent Behaviors
Panait, L., Luke, S., & Wiegand, R. P. (2006) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.880330 · Cited by 106
“A large portion of multiagent research may be divided neatly according to whether or not it involves multiple learners [4].”
BackgroundSelf-citationThe principles of whole-cell modeling
Karr, J. R., Takahashi, K., & Funahashi, A. (2015) · Current Opinion in Microbiology · doi:10.1016/j.mib.2015.06.004 · Cited by 86
“Faster, parallelized simulation engines and distributed optimization procedures should be applied to explore parameters more quickly [64,65].”
Method
Metadata
- Authors
- Panait, L., & Luke, S.
- Affiliations
- George Mason University (US)
- Corresponding author
- Panait, Liviu
- ORCID
- Luke, Sean
- Venue
- Autonomous Agents and Multi-Agent Systems
- Published
- 2005-11
- Volume
- 11
- Issue
- 3
- Pages
- 387-434
- ISSN
- 1387-2532 (ISSN-L)
- 1573-7454
- OpenAlex
- W2107544712
- Cited by
- 1,237
- References
- 327
- Citations by year
- 2026: 39 · 2025: 42 · 2024: 39 · 2023: 67 · 2022: 48 · 2021: 69 · 2020: 78 · 2019: 80 · 2018: 74 · 2017: 64 · 2016: 58 · 2015: 72 · 2014: 74 · 2013: 89 · 2012: 66
- FWCI
- 32.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Autonomous Agents and Multi-Agent Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- cooperative multi-agent learning, multi-agent systems, team learning, concurrent learning, direct communication, indirect communication, task decomposition, scalability, adaptive dynamics, evolutionary computation, game theory, reinforcement learning, agent-based modeling, robotics, complex systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.