The DOI matches its Crossref record; 324 of the 327 references it cites were found in a registry or an index.
Cooperative Multi-Agent Learning: The State of the Art
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Integration ensures that machine outputs are used to challenge humans, and human inputs to challenge machines (Hoc, 2001), allowing for mutual learning (Panait & Luke, 2005) and debiasing (Larrick, 2004).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Panait & Luke, 2005
In the citing paper
“For example, AI is often applied in open systems, blurring organizational boundaries (Panait & Luke, 2005).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Panait & Luke, 2005
In the citing paper
“Multi-agent RL can also be applied to understand the behavior of groups of agents who need to cooperate; see [607] for an overview and [385,475] for recent examples.”
From Tackling climate change with machine learning (2023) · cites this paper as [607]
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002 · cited 1×
“There are many sources of additional information on EC; good choices include [6, 63, 64, 81, 87, 114, 141, 164].”
BackgroundReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · cited 2×
“Other games have included Tic-Tac-Toe [4], Mancala [61], Othello [241], Go [149], Chess [138, 269], Poker [139], Blackjack [261], Nim and 3D Tic-TacToe [219], and Tag [215].”
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Axelrod, R., & Hamilton, W. D. (1981) · Science · doi:10.1126/science.7466396 · Cited by 20,065
Genetic Algorithms in Search, Optimization and Machine Learning
Goldberg, D. E., & Robson, D. (1988) · Cited by 18,391
Goldberg, D. E., & Shakespeare, W. (2002) · Cited by 16,088
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Genetic Algorithms + Data Structures = Evolution Programs
Michalewicz, Z. (1992) · Artificial Intelligence · doi:10.1007/978-3-662-02830-8 · Cited by 11,553
Goldberg, D. E. (1989) · Medical Entomology and Zoology · Cited by 10,109
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972 · cited 1×
“For more information on reinforcement learning techniques, [230, 14, 118] are good starting points.”
BackgroundFlocks, herds and schools: A distributed behavioral model
Reynolds, C. W. (1987) · Proceedings of the 14th annual conference on Computer graphics and interactive techniques · doi:10.1145/37401.37406 · Cited by 7,714
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Intelligent agents: theory and practice
Wooldridge, M., & Jennings, N. R. (1995) · The Knowledge Engineering Review · doi:10.1017/s0269888900008122 · Cited by 6,810 · cited 2×
“According to Wooldridge and Jennings [267], there are two general usages of the term agent: weak agents , which often exhibit autonomy, social ability, reactivity, inter action via a communication language, pro-activeness, and the ability to perceive the environment and respond to it accordingly; andstrong agents , wh…”
BackgroundSwarm Intelligence: From Natural to Artificial Systems
Bonabeau, E., Dorigo, M., & Theraulaz, G. (1999) · Oxford University Press eBooks · doi:10.1093/oso/9780195131581.001.0001 · Cited by 6,435
Sociobiology: The New Synthesis.
Lenski, G., & Wilson, E. O. (1976) · Social Forces · doi:10.2307/2576242 · Cited by 6,271
Hölldobler, B., & Wilson, E. O. (1990) · Springer eBooks · doi:10.1007/978-3-662-10306-7 · Cited by 5,438
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Flocks, herds and schools: A distributed behavioral model
Reynolds, C. W. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37406 · Cited by 5,148
Bäck, T. (1996) · Oxford University Press eBooks · doi:10.1093/oso/9780195099713.001.0001 · Cited by 5,113
Genetic Algorithms + Data Structures = Evolution Programs
Michalewicz, Z. (1996) · Springer eBooks · doi:10.1007/978-3-662-03315-9 · Cited by 5,095 · cited 1×
“There are many sources of additional information on EC; good choices include [99, 77, 124, 9, 144, 74, 58, 59].”
BackgroundSome Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443 · cited 2×
“[194] A.”
BackgroundMultiagent Systems : A Modern Approach to Distributed Artificial Intelligence
Weiß, G. (2000) · Medical Entomology and Zoology · Cited by 3,458
Evolution of indirect reciprocity by image scoring
Nowak, M. A., & Sigmund, K. (1998) · Nature · doi:10.1038/31225 · Cited by 2,700
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,614 · cited 5×
“Littman [148] introduces the Friend-or-Foe Q-learning algorithm to find either a coordination equilibrium (with cooperative agents) or an adversarial one (with competitive agents).”
BackgroundInfluentialThe Theory of Learning in Games
Drew Fudenberg, B., & Levine, D. K. (1998) · MIT Press Books · Cited by 2,455
A Roadmap of Agent Research and Development
Jennings, N. R., Sycara, K., & Wooldridge, M. (1998) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/a:1010090405266 · Cited by 2,161
Inductive Reasoning and Bounded Rationality
Arthur, W. B. (1994) · American Economic Review · Cited by 2,102
Multi-Agent Reinforcement Learning: Independent vs. Cooperative Agents
Tan, M. (1993) · Machine Learning Proceedings 1993 · doi:10.1016/b978-1-55860-307-3.50049-6 · Cited by 1,810
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
A cooperative coevolutionary approach to function optimization
Potter, M. A., & Jong, K. A. (1994) · Lecture Notes in Computer Science · doi:10.1007/3-540-58484-6_269 · Cited by 1,510 · cited 1×
“A standard approach to applying cooperative coevolutionary algorithms (or CCEAs) to an optimization problem starts by decomposing the problem representation into subcomponents, then assigning each subcomponent to a separate population of individuals [181, 178, 177, 179].”
MethodSome studies in machine learning using the game of checkers
Samuel, A. L. (2000) · IBM Journal of Research and Development · doi:10.1147/rd.441.0206 · Cited by 1,439
The Complexity of Markov Decision Processes
Papadimitriou, C. H., & Tsitsiklis, J. N. (1987) · Mathematics of Operations Research · doi:10.1287/moor.12.3.441 · Cited by 1,329
An Analysis Of The Behavior Of A Class Of Genetic Adaptive Systems.
Jong, K. A. D. (1975) · Deep Blue (University of Michigan) · doi:10.7302/10966 · Cited by 1,290
Cooperative Mobile Robotics: Antecedents and Directions
Cao, Y. U., Fukunaga, A. S., & Kahng, A. (1997) · Autonomous Robots · doi:10.1023/a:1008855018923 · Cited by 1,240
Multiagent systems: A survey from a machine learning perspective
Stone, P., & Veloso, M. (2000) · Autonomous Robots · doi:10.1023/a:1008942012299 · Cited by 1,218 · cited 11×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
BackgroundInfluentialCooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents
Potter, M. A., & Jong, K. A. D. (2000) · Evolutionary Computation · doi:10.1162/106365600568086 · Cited by 1,196
The dynamics of reinforcement learning in cooperative multiagent systems
Claus, C., & Boutilier, C. E. (1998) · Cited by 1,089
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
The Dynamics of Collective Sorting: Robot-Like Ants and Ant-Like Robots
Deneubourg, J. L., Goss, S., Franks, N., Sendova-Franks, A., Detrain, C., & Chrétien, L. (1991) · From Animals to Animats · doi:10.7551/mitpress/3115.003.0048 · Cited by 889 · cited 1×
“In a related problem domain, clustering, the agents have no pre-specified drop locations; rather, they only need to pile all the items together [17], or sort them by class into separate piles [62].”
BackgroundProceedings of the fourth international conference on Genetic algorithms
Belew, R. K., & Booker, L. B. (1991) · Cited by 822
Evolutionary computation: a unified approach
De Jong, K. (2007) · Proceedings of the 9th annual conference companion on Genetic and evolutionary computation · doi:10.1145/1274000.1274109 · Cited by 790
Co-evolving parasites improve simulated evolution as an optimization procedure
Hillis, W. D. (1990) · Physica D: Nonlinear Phenomena · doi:10.1016/0167-2789(90)90076-2 · Cited by 780 · cited 1×
“Examples include sorting networks [113] and predator–prey scenarios [52, 102].”
BackgroundMultiagent Reinforcement Learning: Theoretical Framework and an Algorithm
Hu, J., & Wellman, M. P. (1998) · Cited by 776
RoboCup: The Robot World Cup Initiative
Kitano, H., Asada, M., Kuniyoshi, Y., Noda, I., & Osawa, E. (1997) · Proceedings of the first international conference on Autonomous agents - AGENTS '97 · doi:10.1145/267658.267738 · Cited by 776 · cited 1×
“Soccer The game of soccer, both in simulation and with real robots, is one of the most widely used domains for research in multi-agent systems [123].”
BackgroundMultiagent learning using a variable learning rate
Bowling, M., & Veloso, M. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00121-2 · Cited by 775 · cited 8×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
MethodInfluentialTemporal Difference Learning and TD-Gammon
Tesauro, G. (1995) · ICGA Journal · doi:10.3233/icg-1995-18207 · Cited by 764
Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach
Boyan, J. A., & Littman, M. L. (1994) · Cited by 738
Langton, C. G., Taylor, C., Farmer, D., & Rasmussen, S. (1991) · Cited by 706
The Evolution of Strategies in the Iterated Prisoner's Dilemma
Axelrod, R. (2001) · Cited by 672
Automatic programming of behavior-based robots using reinforcement learning
Mahadevan, S., & Connell, J. (1992) · Artificial Intelligence · doi:10.1016/0004-3702(92)90058-6 · Cited by 591 · cited 1×
“Sometimes a robot is capable of pushing one box by itself (see for example the single-agent experiments reported in [136, 35]).”
BackgroundNew Methods for Competitive Coevolution
Rosin, C. D., & Belew, R. K. (1997) · Evolutionary Computation · doi:10.1162/evco.1997.5.1.1 · Cited by 578 · cited 2×
“[191] C.”
BackgroundGenetic algorithms + data structures = evolution programs (3rd ed.)
Michalewicz, Z. (1996) · Springer eBooks · Cited by 553
PACT: an experiment in integrating concurrent engineering systems
Cutkosky, M. R., Engelmore, R. S., Fikes, R. E., Genesereth, M. R., Gruber, T. R., Mark, W. S., Tenenbaum, J. M., & Weber, J. C. (1993) · Computer · doi:10.1109/2.179153 · Cited by 547 · cited 1×
“Other multi-agent systems domains investigated include particle accelerator control [115], intelligent doc ument retrieval [153], spacecraft control [202], and concurrent engineering [53].”
BackgroundOsthaus, K. E. (1920) · doi:10.5479/sil.182252.39088008237430 · Cited by 493
Multiagent Traffic Management: A Reservation-Based Intersection Control Mechanism
Dresner, K., & Stone, P. (2004) · doi:10.1109/aamas.2004.190 · Cited by 461 · cited 5×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
BackgroundInfluentialFom Local Actions to Global Tasks: Stigmergy and Collective Robotics
Beckers, R., Holland, O. E., & Deneubourg, J.-L. (2000) · Studies in Cognitive Systems · doi:10.1007/978-94-010-0870-9_63 · Cited by 451 · cited 2×
“In a related problem domain, clustering, the agents have no pre-specified drop locations; rather, they only need to pile all the items together [17], or sort them by class into separate piles [62].”
BackgroundCo-evolving parasites improve simulated evolution as an optimization procedure
Hillis, W. D. (1991) · Cited by 447
Cooperative mobile robotics: antecedents and directions
Cao, Y. U., Fukunaga, A. S., Kahng, A. B., & Meng, F. (2002) · Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots · doi:10.1109/iros.1995.525801 · Cited by 444 · cited 2×
“Other surveys of existing work in multi-agent learning and related domains include [61, 68, 33, 67, 244, 171, 43, 205, 132, 249, 60, 127, 225, 169].”
BackgroundTrends in cooperative distributed problem solving
Durfee, E. H., Lesser, V. R., & Corkill, D. D. (1989) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.43404 · Cited by 444 · cited 1×
“Other surveys of existing work in multi-agent learning and related domains include [61, 68, 33, 67, 244, 171, 43, 205, 132, 249, 60, 127, 225, 169].”
BackgroundFriend-or-Foe Q-learning in General-Sum Games
Littman, M. L. (2001) · International Conference on Machine Learning · Cited by 427
A Self-Organizing Spatial Vocabulary
Steels, L. (1995) · Artificial Life · doi:10.1162/artl.1995.2.3.319 · Cited by 422 · cited 1×
“Similar approaches to evolving communication languages are presented in [215, 217, 218, 195, 57, 219, 220, 42].”
BackgroundAn Algorithm for Distributed Reinforcement Learning in Cooperative Multi-Agent Systems
Lauer, M., & Riedmiller, M. (2000) · Cited by 412
Emergent Actors in World Politics: How States and Nations Develop and Dissolve
Cederman, L.-E. (1997) · Princeton University Press eBooks · doi:10.1515/9780691218038 · Cited by 411
Reinforcement Learning in the Multi-Robot Domain
Matarić, M. J. (1997) · Autonomous Robots · doi:10.1023/a:1008819414322 · Cited by 408 · cited 6×
“Balch [9] uses a shaped reinforcement reward function (earlier suggested by Mataric [161]) which depends on the number of partial steps fulfilled towards accomplishing the joint task.”
MethodInfluentialReward Functions for Accelerated Learning
Mataric, M. J. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50030-1 · Cited by 398 · cited 6×
“For example, Mataric [162, 160] applies Q learning to select from hand-coded reactive behaviors such as avoid, head-home, search or disperse for robot foraging tasks.”
BackgroundInfluentialTaming Decentralized POMDPs: Towards Efficient Policy Computation for
Nair, R., Nair, R., Tambe, M., Tambe, M., Marsella, S., Yokoo, M., Pynadath, D. V., & Marsella, S. (2003) · Cited by 393
The design and analysis of a computational model of cooperative coevolution
Potter, M. A. (1997) · Cited by 393
Planning, Learning and Coordination in Multiagent Decision Processes
Boutilier, C. E. (1996) · Cited by 392
Interaction and Intelligent Behavior.
Mataric, M. J. (1994) · doi:10.21236/ada290049 · Cited by 388 · cited 2×
“The efficiency of an approach may be defined by how quickly it completes the foraging task [142, 54], or by the number of items collected in a fixed amount of time.”
BackgroundLayered Learning in Multiagent Systems: A Winning Approach to Robotic Soccer
Stone, P. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/4151.001.0001 · Cited by 380 · cited 7×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
BackgroundMethodInfluentialGreenwald, A., & Hall, K. (2003) · Cited by 380
Cooperative multi-robot box-pushing
Mataric, M. J., Nilsson, M., & Simsarin, K. T. (2002) · Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots · doi:10.1109/iros.1995.525940 · Cited by 367 · cited 1×
“A more complicated version requires two or more agents to cooperate in order to move a single box in simulation [271], or on real robots [141, 140].”
BackgroundLearning and Sequential Decision Making
Barto, A. G., Sutton, R. S., & Watkins, C. (1989) · Cited by 357
Multiagent traffic management: an improved intersection control mechanism
Dresner, K., & Stone, P. (2005) · Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems · doi:10.1145/1082473.1082545 · Cited by 352
Coordinated Reinforcement Learning
Guestrin, C., Lagoudakis, M. G., & Parr, R. (2002) · Cited by 323
Learning to coordinate without sharing information
Sen, S., Sekaran, M., & Hale, J. C. (1994) · Cited by 314
Competitive Environments Evolve Better Solutions for Complex Tasks
Angeline, P. J., & Pollack, J. B. (1993) · international conference on Genetic algorithms · Cited by 310
The spontaneous self-organization of an adaptive language
Steels, L. (2000) · Machine Intelligence 15 · doi:10.1093/oso/9780198538677.003.0011 · Cited by 301
Rational and convergent learning in stochastic games
Bowling, M., & Veloso, M. (2001) · Cited by 285
From Local Actions to Global Tasks: Stigmergy and Collective Robotics
Beckers, R., Holland, O. E., & Deneubourg, J. L. (1994) · Artificial Life IV · doi:10.7551/mitpress/1428.003.0022 · Cited by 282
Current State of the Art in Distributed Autonomous Mobile Robotics
Parker, L. E. (2000) · Distributed Autonomous Robotic Systems 4 · doi:10.1007/978-4-431-67919-6_1 · Cited by 276 · cited 1×
“Other surveys of existing work in multi-agent learning and related domains include [61, 68, 33, 67, 244, 171, 43, 205, 132, 249, 60, 127, 225, 169].”
BackgroundCoherent Cooperation Among Communicating Problem Solvers
Durfee, E. H., Lesser, V. R., & Corkill, D. D. (1987) · IEEE Transactions on Computers · doi:10.1109/tc.1987.5009468 · Cited by 276 · cited 1×
“As noted in [66], this increase in search space can hamper learning an optimal behavior by more than communication itself may help.”
BackgroundGenetic Programming 1998: Proceedings of the Third Annual Conference
Koza, J. R., Banzhaf, W., Kumar Chellapilla, A., Deb, K., Dorigo, M., Fogel, D. B., Garzón, M., Goldberg, D. E., Iba, H., & Riolo, R. (1999) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.1999.771172 · Cited by 275
An analysis of cooperative coevolutionary algorithms
Wiegand, R. P., & Jong, K. A. D. (2004) · Cited by 275
Learning sequential decision rules using simulation models and competition
Grefenstette, J. J., Ramsey, C. L., & Schultz, A. C. (1990) · Machine Learning · doi:10.1007/bf00116876 · Cited by 271
Intelligence Through Simulated Evolution: Forty Years of Evolutionary Programming
Fogel, L. J. (1999) · Medical Entomology and Zoology · Cited by 262
Cooperative multiagent systems: a personal view of the state of the art
Lesser, V. (1999) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.755622 · Cited by 262 · cited 1×
“Other surveys of existing work in multi-agent learning and related domains include [61, 68, 33, 67, 244, 171, 43, 205, 132, 249, 60, 127, 225, 169].”
BackgroundEvolutionary robotics: the Sussex approach
Harvey, I., Husbands, P., Cliff, D., Thompson, A., & Jakobi, N. (1997) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(96)00067-x · Cited by 252 · cited 1×
“Other investigations concerned games such as Tic-TacToe [5], Backgammon [175, 174], Mancala [56], Othello [211], pursuit-evasion [48, 88], Go [131], Chess [234, 121], Poker [122], Blackjack [229] and Tag [187].”
Reinforcement Learning to Play an Optimal Nash Equilibrium in Team Markov Games
Wang, X., & Sandholm, T. (2002) · Cited by 251
Distributed Algorithms for Multi-Robot Observation of Multiple Moving Targets
Parker, L. E. (2002) · Autonomous Robots · doi:10.1023/a:1015256330750 · Cited by 249 · cited 1×
“Additional research using this domain includes [76, 154, 196, 197].”
(1996) · University of Michigan Press eBooks · doi:10.3998/mpub.13808 · Cited by 248 · cited 4×
“This is reminiscent of social scientists’ notion of being in the individual interest of none, but in the collective interest of all [146].”
BackgroundInfluentialThe Complexity of Decentralized Control of Markov Decision Processes
Bernstein, D. S., Shlomo Zilberstein, B., & Immerman, N. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3836 · Cited by 232
Ants and reinforcement learning: a case study in routing in dynamic networks
Subramanian, D., Druschel, P., & Chen, J. (1997) · Cited by 227
An empirical analysis of collaboration methods in cooperative coevolutionary algorithms
Wiegand, R. P., Liles, W. C., & Jong, K. A. D. (2001) · Genetic and Evolutionary Computation Conference (GECCO) · Cited by 225
Tracking the red queen: Measurements of adaptive progress in co-evolutionary simulations
Cliff, D., & Miller, G. F. (1995) · Lecture notes in computer science · doi:10.1007/3-540-59496-5_300 · Cited by 221 · cited 3×
“If a multi-agent environment is fraught with such non-transitive cycles, competing agents may be caught in them, rather than building the desired arms race [52, 77, 219, 280].”
BackgroundBlondie24: Playing at the Edge of AI
Fogel, D. B. (2001) · Cited by 218
Learning to Cooperate via Policy Search
Peshkin, L., Kim, K.-E., Meuleau, N., & Kaelbling, L. P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.1484 · Cited by 217 · cited 1×
“[173] investigate a distributed reinforcement learning approach to partially observable stochastic games with identical reinforcement to each agent, and show that their algorithm converges to local optima.”
BackgroundThe Dynamics of Social Dilemmas
Glance, N. S., & Huberman, B. A. (1994) · Scientific American · doi:10.1038/scientificamerican0394-76 · Cited by 210 · cited 2×
“Social Dilemmas These problems concern the individual decisions of several agents, all of which receive a joint reward [75].”
BackgroundCo-Evolution in the Successful Learning of Backgammon Strategy
Pollack, J. B., & Blair, A. D. (1998) · Machine Learning · doi:10.1023/a:1007417214905 · Cited by 207
OPTIMAL PAYOFF FUNCTIONS FOR MEMBERS OF COLLECTIVES
WOLPERT, D. H., & TUMER, K. (2001) · Advances in Complex Systems · doi:10.1142/s0219525901000188 · Cited by 206
Reinforcement learning of coordination in cooperative multi-agent systems
Kapetanakis, S., & Kudenko⋆, D. (2002) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.5555/777092.777145 · Cited by 192
Evolving behavioral strategies in predators and prey
Haynes, T. D., & Sen, S. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_22 · Cited by 186 · cited 2×
“[96, 95, 97], Haynes and Sen [90], Haynes et al.”
BackgroundLearning to Play the Game of Chess
Thrun, S. (1994) · neural information processing systems · Cited by 177
Coevolutionary dynamics in a minimal substrate
Watson, R. A. R., & Pollack, J. B. (2001) · ePrints Soton (University of Southampton) · Cited by 175
Evolving Teamwork and Coordination with Genetic Programming
(1996) · The MIT Press eBooks · doi:10.7551/mitpress/3242.003.0021 · Cited by 171 · cited 7×
“cessful crossover operator (TeamUniform) allows arbitrary crossover operations between behaviors for different agents, a result contradicting Luke and Spector [135] and Andre and Teller [4].”
BackgroundResultInfluentialApplications of distributed artificial intelligence in industry
Parunak, H. V. D. (1996) · Cited by 170
Coordination in multiagent reinforcement learning: a Bayesian approach
Chalkiadakis, G., & Boutilier, C. E. (2003) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/860575.860689 · Cited by 158 · cited 5×
“Such an approach is used by Boutilier [22] and Chalkiadakis and Boutilier [47], who employ a Bayesian learning method for updating models of other agents.”
BackgroundInfluentialAdaption and Learning in Multi-Agent Systems
(1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7 · Cited by 156
Schneider, J., Wong, W., Moore, A., et al. (2018) · doi:10.1184/r1/6554609.v1 · Cited by 156
Hierarchical multi-agent reinforcement learning
Makar, R., Mahadevan, S., & Ghavamzadeh, M. (2001) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/375735.376302 · Cited by 155
An Evolved, Vision-Based Behavioral Model of Coordinated Group Motion
Reynolds, C. W. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/3116.003.0052 · Cited by 154 · cited 1×
“Examples of work in this area include hard-coded and learned collective behaviors such as flocking [188, 186, 212, 213], learning of dispersion and aggregation [270], learning social behaviors in virtual worlds [80, 81], and the modeling of the formation of early countries [45].”
BackgroundSchneider, J., Wong, W.-K., Moore, A., & Riedmiller, M. (2018) · doi:10.1184/r1/6554609 · Cited by 153
A Coevolutionary Approach to Learning Sequential Decision Rules
Potter, M. A., Jong, K. A. D., & Grefenstette, J. J. (1995) · international conference on Genetic algorithms · Cited by 152
Advances in Genetic Programming
(1999) · The MIT Press eBooks · doi:10.7551/mitpress/1110.001.0001 · Cited by 152
A genetic algorithm discovers particle-based computation in cellular automata
Das, R., Mitchell, M., & Crutchfield, J. P. (1994) · Lecture notes in computer science · doi:10.1007/3-540-58484-6_278 · Cited by 149
Co-evolving Soccer Softbot team coordination with genetic programming
Luke, S., Hohn, C., Farris, J., Jackson, G., & Hendler, J. (1998) · Lecture notes in computer science · doi:10.1007/3-540-64473-3_76 · Cited by 149 · cited 4×
“For example, a team of eleven soccer-playing robots might be grouped into squads of forwards, midfielders, attackers, and a goalie [133, 134].”
BackgroundInfluentialSelf-citationBehavioral diversity in learning robot teams
Balch, T. R., & Arkin, R. C. (1998) · SMARTech Repository (Georgia Institute of Technology) · Cited by 147
A Distributed Reinforcement Learning Scheme for Network Routing
(2013) · Psychology Press eBooks · doi:10.4324/9780203773826-9 · Cited by 146 · cited 2×
“Boyan and Littman [30], Subramanian et al. [257], Wolpert et al. [305], Chang et al. [50] introduce various learning approaches to route packets in static and ad-hoc networks.”
Dudek, G., Jenkin, M. R. M., Milios, E., & Wilkes, D. R. (2002) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.1993.583135 · Cited by 142 · cited 1×
“[65] classify swarm robotics applications according to team size, range, communication topology and bandwidth, team composition and reconfigurability, and the processing ability of individual agents.”
BackgroundPricing in Agent Economies Using Multi-Agent Q-Learning
Tesauro, G. J., & Kephart, J. O. (2002) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/a:1015504423309 · Cited by 139 · cited 1×
“Some work has applied Q-learning to extensive-form games [268] where players alternate in performing actions; but most work in the area has instead been in normal-form games where players act simultaneously.”
BackgroundCompetition, Coevolution and the Game of Tag
Reynolds, C. W. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/1428.003.0010 · Cited by 136 · cited 2×
“Other games have included Tic-Tac-Toe [4], Mancala [61], Othello [241], Go [149], Chess [138, 269], Poker [139], Blackjack [261], Nim and 3D Tic-TacToe [219], and Tag [215].”
Evolving Communication without Dedicated Communication Channels
Quinn, M. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44811-x_38 · Cited by 132 · cited 2×
“Quinn [184] investigates the evolution of strategies in a two-agent collaborative-movement domain and reports that robots were able to coordinate by communicating their adopted roles of leader or follower via sequences of moves.”
BackgroundAn Analysis of Stochastic Game Theory for Multiagent Reinforcement Learning
Bowling, M., & Veloso, M. (2000) · Cited by 132
Ficici, S. G., & Pollack, J. B. (1998) · Cited by 131
A selection-mutation model for q-learning in multi-agent systems
Tuyls, K., Verbeeck, K., & Lenaerts, T. (2003) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/860575.860687 · Cited by 131 · cited 1×
“…is the main tool in this second category, and it was successfully used to study the properties of cooperative coevolution [78, 296], to visualize basins of attraction to Nash equilibria for cooperative coevolution [191], and to study trajectories of concurrent Q-learning processes [271, 263].”
MethodAll Learning is Local: Multi-agent learning in global reward games
Chang, Y.-H., Ho, T., & Kaelbling, L. P. (2003) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 131
Using communication to reduce locality in distributed multiagent learning
Matarić, M. J. (1998) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/095281398146806 · Cited by 129 · cited 3×
“For example, Mataric [143, 140] applies Q learning to select from hand-coded reactive behaviors such as avoid, head-home, search or disperse for robot foraging tasks.”
BackgroundProperties of the Bucket Brigade
Holland, J. H. (1985) · international conference on Genetic algorithms · Cited by 127
Evolution of communication and language using signals, symbols, and words
Cangelosi, A. (2001) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.918429 · Cited by 125 · cited 1×
“Similar approaches to evolving communication languages are presented in [215, 217, 218, 195, 57, 219, 220, 42].”
BackgroundMultiagentsystems - A Modern Approach to Distributed Artificial Intelligence.
Funk, P. (2000) · Künstliche Intell. · Cited by 120
Lamarckian Learning in Multi-Agent Environments.
Grefenstette, J. J. (1991) · Cited by 120
Multi-Agent Patrolling with Reinforcement Learning
Santana, H., Ramalho, G. L., Corruble, V., & Ratitch, B. (2004) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/mphg3605 · Cited by 119
An Adaptive Communication Protocol for Cooperating Mobile Robots
Yanco, H. A., & Stein, L. A. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/3116.003.0064 · Cited by 113
A polynomial-time nash equilibrium algorithm for repeated games
Littman, M. L., & Stone, P. (2003) · ACM Conference on Electronic Commerce (EC) · doi:10.1145/779928.779935 · Cited by 113 · cited 6×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
BackgroundInfluentialAndré, D., Bennett, F. H., III, & Koza, J. R. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3242.003.0004 · Cited by 112 · cited 1×
“Much better results have been produced with evolutionary computation methods: Andre et al. [2] report a rule with accuracy 82 .”
BackgroundMatarić, M. J. (1994) · Simulation of Adaptive Behavior · Cited by 111
Using Collective Intelligence to Route Internet TrafficPreprint
Wolpert, D. H., Tumer, K., & Frank, J. E. (1999) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/9905004 · Cited by 111
Steels, L. (1996) · Cited by 110
Strongly Typed Genetic Programming in Evolving Cooperation Strategies
Haynes, T. D., Wainwright, R. L., Sen, S., & Schoenefeld, D. A. (1995) · Cited by 106
Steels, L. (1998) · VUBIR (Vrije Universiteit Brussel) · Cited by 106
Creatures: artificial life autonomous software agents for home entertainment
Grand, S., Cliff, D., & Malhotra, A. (1997) · doi:10.1145/267658.267663 · Cited by 104 · cited 1×
“Examples of work in this area include hard-coded and learned collective behaviors such as flocking [216, 214, 242, 243], learning of dispersion and aggregation [310], learning social behaviors in virtual worlds [92, 91], and the modeling of the formation of early countries [46].”
BackgroundA Game-Theoretic Approach to the Simple Coevolutionary Algorithm
Ficici, S. G., & Pollack, J. B. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45356-3_46 · Cited by 103 · cited 1×
“Evolutionary game theory is the main tool in this second category, and it was successfully used to study the properties of cooperative coevolution [78, 296], to visualize basins of attraction to Nash equilibria for cooperative coevolution [191], and to study trajectories of concurrent Q-learning processes [263, 271].”
MethodEmergence of Collective Behavior in Evolving Populations of Flying Agents
Spector, L. C., Klein, J., Perry, C., & Feinstein, M. (2005) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-005-7620-3 · Cited by 103 · cited 1×
“Examples of work in this area include hard-coded and learned collective behaviors such as flocking [216, 214, 242, 243], learning of dispersion and aggregation [310], learning social behaviors in virtual worlds [92, 91], and the modeling of the formation of early countries [46].”
BackgroundA Pheromone-Based Utility Model for Collaborative Foraging
Panait, L., & Luke, S. (2004) · Adaptive Agents and Multi-Agents Systems · doi:10.1109/aamas.2004.25 · Cited by 99 · cited 1×
“A variation of the problem allows agents to communicate by depositing pheromones in the environment tomark trails connecting rich pick-up and drop-off areas [20, 189].”
BackgroundSelf-citationCoevolution of A Backgammon Player
Pollack, J. B., Blair, A., & Land, M. (1996) · Cited by 91
Heterogeneity in the coevolved behaviors of mobile robots: the emergence of specialists
Potter, M. A., Meeden, L., & Schultz, A. C. (2001) · Cited by 89
André, D., & Teller, A. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48422-1_28 · Cited by 88 · cited 5×
“Similarly, Andre and Teller [4] apply genetic programming to develop a team of soccer playing agents for the RoboCup simulator.”
ResultInfluentialBest-Response Multiagent Learning in Non-Stationary Environments
Weinberg, M. C., & Rosenschein, J. S. (2004) · doi:10.1109/aamas.2004.75 · Cited by 86 · cited 1×
“Things change with multiple learners: as the agents learn, they modify their behaviors, which in turn can ruin other agents’ learned behaviors by making obsolete the assumptions on which they are based [223, 282].”
BackgroundEvolving adaptive pheromone path planning mechanisms
Sauter, J., Matthews, R., Parunak, H. V. D., & Brueckner, S. (2002) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/544741.544841 · Cited by 86 · cited 1×
“[197, 196] show how EC can be used to tune an agent policy in an application involving multiple digital pheromones.”
BackgroundOnline learning about other agents in a dynamic multiagent system
Hu, J., & Wellman, M. P. (1998) · Proceedings of the second international conference on Autonomous agents - AGENTS '98 · doi:10.1145/280765.280839 · Cited by 84 · cited 5×
“Hu and Wellman [118], Wellman and Hu [290] suggest that when learning models of other agents in a multi-agent learning scenario, the resulting behaviors are highly sensitive to the agents’ initial beliefs.”
ResultInfluentialOn multiagent Q-learning in a semi-competitive domain
Sandholm, T., & Crites, R. H. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_28 · Cited by 83 · cited 1×
“Things change with multiple learners: as the agents learn, they modify their behaviors, which in turn can ruin other agents’ learned behaviors by making obsolete the assumptions on which they are based [223, 282].”
BackgroundA COMPARISON OF EVOLUTIONARY AND COEVOLUTIONARY SEARCH
Pagie, L., & Mitchell, M. (2002) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026802000427 · Cited by 81
An evolutionary approach for the tuning of a chess evaluation function using population dynamics
Kendall, G., & Whitwell, G. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2001.934299 · Cited by 80 · cited 2×
“Other games have included Tic-Tac-Toe [4], Mancala [61], Othello [241], Go [149], Chess [138, 269], Poker [139], Blackjack [261], Nim and 3D Tic-TacToe [219], and Tag [215].”
Co-Evolving a Go-Playing Neural network
Miikkulainen, A. L. A. R. (2001) · Cited by 79
Learning to Share Meaning in a Multi-Agent System
Williams, A. B. (2004) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/b:agnt.0000011160.45980.4b · Cited by 78
Talking Helps: Evolving Communicating Agents for the Predator-Prey Pursuit Problem
Jim, K.-C., & Giles, C. L. (2000) · Artificial Life · doi:10.1162/106454600568861 · Cited by 78 · cited 1×
“A similar approach is reported in [133] to learn a language for communication in a predator-prey domain.”
BackgroundCreatures: Entertainment Software Agents with Artificial Life
Grand, S., & Cliff, D. (1998) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/a:1010042522104 · Cited by 77
Distributed Intelligence for Air Fleet Control
Steeb, R., Cammarata, S. J., Hayes-Roth, F. A., Thorndyke, P. W., & Wesson, R. B. (1988) · Elsevier eBooks · doi:10.1016/b978-0-934613-63-7.50011-5 · Cited by 77 · cited 1×
“A multi-agent approach for this domain is reported in [244].”
BackgroundReinforcement Learning in the Multi-Robot Domain
Matarić, M. J. (1997) · Springer eBooks · doi:10.1007/978-1-4757-6451-2_4 · Cited by 76
Ostergaard, E. H., Sukhatme, G. S., & Matari, M. J. (2001) · doi:10.1145/375735.375825 · Cited by 76
General principles of learning-based multi-agent systems
Wolpert, D. H., Wheeler, K., & Tumer, K. (1999) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/301136.301167 · Cited by 76
Conjectural Equilibrium in Multiagent Learning
Wellman, M. P., & Hu, J. (1998) · Machine Learning · doi:10.1023/a:1007514623589 · Cited by 75 · cited 2×
“Hu and Wellman [102], Wellman and Hu [251] suggest that, when learning models of other agents in a multi-agent learning scenario, the resulting behaviors are highly sensitive to the agents’ initial beliefs,.”
BackgroundLearning Models of Other Agents Using Influence Diagrams
Suryadi, D., & Gmytrasiewicz, P. J. (1999) · Courses and lectures · doi:10.1007/978-3-7091-2490-1_22 · Cited by 75 · cited 1×
“Suryadi and Gmytrasiewicz [259] present a similar agent modeling approach consisting of learning the beliefs, capabilities and preferences of teammates.”
BackgroundTransforming standalone expert systems into a community of cooperating agents
Jennings, N. R., Varga, L. Z., Aarnts, R. P., Fuchs, J., & Skarek, P. (1993) · Engineering Applications of Artificial Intelligence · doi:10.1016/0952-1976(93)90016-q · Cited by 75
Learning sequences of actions in collectives of autonomous agents
Tumer, K., Agogino, A., & Wolpert, D. H. (2002) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/544741.544832 · Cited by 74
Evolutionary computing in multi-agent environments: Partners
Bull, L. (1997) · UWE Research Repository (UWE Bristol) · Cited by 71
Integrating intelligent systems into a cooperating community for electricity distribution management
Varga, L. Z., Jennings, N. R., & Cockburn, D. (1994) · Expert Systems with Applications · doi:10.1016/0957-4174(94)90080-9 · Cited by 70
Multi-Robot Learning in a Cooperative Observation Task
Parker, L. E., & Touzet, C. F. (2000) · Springer eBooks · doi:10.1007/978-4-431-67919-6_37 · Cited by 69 · cited 1×
“Cooperative Target Observation Introduced in [167], this domain involves a two dimensional bounded area in which a number of robots have to keep several moving targets under observation.”
BackgroundOn Behavior Classification in Adversarial Environments
Riley, P. F., & Veloso, M. (2000) · Springer eBooks · doi:10.1007/978-4-431-67919-6_35 · Cited by 69 · cited 1×
“Successful applications of learning techniques to this domain are reported in [134, 222, 11, 225, 189].”
BackgroundLayered Learning in Genetic Programming for a Cooperative Robot Soccer Problem
Gustafson, S., & Hsu, W. H. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45355-5_23 · Cited by 68
Multiagent coordination with learning classifier systems
Sen, S., & Sekaran, M. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_30 · Cited by 68 · cited 1×
“This explosion in the state space size can be overwhelming for learning methods that explore the space of state utilities (such as reinforcement learning), but it may not so drastically affect techniques that explore the space of behaviors (such as evolutionary computation) [127, 220, 221, 237].”
BackgroundOn Pruning Techniques for Multi-Player Games
Sturtevant, N., & Korf, R. E. (2000) · National Conference on Artificial Intelligence · Cited by 66
Evolution and learning in multiagent systems
Sen, S. (1998) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1997.0157 · Cited by 66
Matarić, M. J. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/3117.003.0065 · Cited by 66
Multi-agent reinforcement learning: an approach based on the other agent's internal model
Nagayuki, Y., Ishii, S., & Doya, K. (2000) · International Conference on Multi Agent Systems · doi:10.1109/icmas.2000.858456 · Cited by 66 · cited 1×
“[157] present an alternative approach where agents approximate the policies, rather than the tables of Q-values, of the other agents.”
BackgroundTunably decentralized algorithms for cooperative target observation
Luke, S., Sullivan, K. M., Panait, L., & Balan, G. (2005) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1082473.1082611 · Cited by 66 · cited 1×
“Additional research using this domain includes [76, 154, 196, 197].”
Self-citationAnalyzing cooperative coevolution with evolutionary game theory
Wiegand, R. P., Liles, W. C., & Jong, K. A. D. (2003) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2002.1004481 · Cited by 64
Haynes, T. D., Sen, S., Schoenefeld, D. A., & Wainwright, R. L. (1995) · Cited by 64
Evolution of Herding Behavior in Artificial Animals
Werner, G. M., & Dyer, M. G. (1993) · The MIT Press eBooks · doi:10.7551/mitpress/3116.003.0053 · Cited by 62 · cited 1×
“Another application of learning techniques to a herding domain is presented in [293].”
BackgroundEvolving control for distributed micro air vehicles
Wu, A. S., Schultz, A. C., & Agah, A. (2003) · IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) · doi:10.1109/cira.1999.810045 · Cited by 62
Emergent cooperation for multiple agents using genetic programming
Iba, H. (1996) · Lecture notes in computer science · doi:10.1007/3-540-61723-x_967 · Cited by 62 · cited 1×
“Some research has presented domains where concurrent learning outperforms both homogeneous and heterogeneous team learning [40, 108, 109].”
BackgroundEvolution of Indirect Reciprocity by Image Scoring / The Dynamics of Indirect ReciprocityPreprint
Nowak, & Sigmund, K. (1998) · RePEc: Research Papers in Economics · Cited by 61
Convergence Problems of General-Sum Multiagent Reinforcement Learning
Bowling, M. (2000) · Cited by 60
Resource sharing and coevolution in evolving cellular automata
Crutchfield, J. P., Mitchell, M., & Werfel, J. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.887238 · Cited by 60 · cited 1×
“[252], Pagie and Mitchell [163], Juille and Pollack [117], suggest that coevolution8 might perform well in this problem domain; at present the best known result, with accuracy 86.”
BackgroundExperiments in learning prototypical situations for variants of the pursuit game
Denzinger, J., & Fuchs, M. (1999) · Cited by 59
(Not) Evolving Collective Behaviours in Synthetic Fish
Zaera, N., Cliff, D., & Bruten, J. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3118.003.0076 · Cited by 59
Electric Elves: Agent Technology for Supporting Human Organizations
Chalupsky, H., Gil, Y., Knoblock, C. A., Lerman, K., Oh, J., Pynadath, D. V., Russ, T. A., & Tambe, M. (2002) · Cited by 58
Genetic programming and multi-agent layered learning by reinforcements
Hsu, W. H., & Gustafson, S. (2002) · Cited by 56
Learning Team Strategies: Soccer Case Studies
Sałustowicz, R., Wiering, M., & Schmidhuber, J. (1998) · Machine Learning · doi:10.1023/a:1007570708568 · Cited by 56
Individual learning of coordination knowledge
Sen, S., & Sekaran, M. (1998) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/095281398146798 · Cited by 56
Model-based learning of interaction strategies in multi-agent systems
Carmel, D., & Markovitch, S. (1998) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/095281398146789 · Cited by 55
Learning Roles: Behavioral Diversity in Robot Teams
Balch, T. R. (1997) · Cited by 54
Whiteson, S., & Stone, P. (2003) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/860575.860607 · Cited by 53 · cited 6×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
MethodInfluentialDistributed Artificial Intelligence Meets Machine Learning Learning in Multi-Agent Environments
Weiß, G. (1997) · Lecture notes in computer science · doi:10.1007/3-540-62934-3 · Cited by 51 · cited 1×
“If”
Emergence of Collective Behavior in Evolving Populations of Flying Agents
Spector, L. C., Klein, J., Perry, C., & Feinstein, M. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45105-6_6 · Cited by 51
An agent architecture for distributed medical care
Huang, J. G., Jennings, N. R., & Fox, J. (1995) · Lecture notes in computer science · doi:10.1007/3-540-58855-8_14 · Cited by 51 · cited 1×
“Distributed Medical Care This domain applies AI to assist clinical staff in making diagnoses, decide on therapy and tests, determine prescriptions, and perform other health care tasks [105].”
BackgroundElectric Elves: Agent Technology for Supporting Human Organizations
Chalupsky, H., Gil, Y., Knoblock, C. A., Lerman, K., Oh, J., Pynadath, D. V., Russ, T. A., & Tambe, M. (2002) · doi:10.21236/ada459956 · Cited by 50
Evaluating Research in Cooperative Distributed Problem Solving
Decker, K., Durfee, E. H., & Lesser, V. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-092-8.50023-x · Cited by 49 · cited 1×
“Other surveys of existing work in multi-agent learning and related domains include [61, 68, 33, 67, 244, 171, 43, 205, 132, 249, 60, 127, 225, 169].”
Background
Research works printed but not linked: 36
- W. Arthur, 1994, Complex. Econ. Theory, 84, 406
- B. Banerjee, R. Mukherjee, and S. Sen. “Learning mutual trust,” in Working Notes of AGENTS-00 Workshop on Deception, Fraud and Trust in Agent Societies, pp. 9–14, 2000.
- J. K. Bassett, 2002, A study of generalization techniques in evolutionary rule learning
- D. Bernstein, S. Zilberstein, and N. Immerman, “The complexity of decentralized control of MDPs,” in Proceedings of UAI-2000: The Sixteenth Conference on Uncertainty in Artificial Intelligence, 2000.
- L. Bull and O. Holland, “Evolutionary computing in multiagent environments: Eusociality”, in Proceedings of Seventh Annual Conference on Genetic Algorithms, 1997.
- M.R. Cutkosky, 1997, Readings in Agents, 46
- F. Fernandez, 2001, Int. J. Robot. Autom., 16, 217
- B. M. Good, Evolving multi-agent systems: Comparing existing approaches and suggesting new directions, Master’s thesis, University of Sussex, 2000
- D. L. Grecu, Using Learning to Improve Multi-Agent Systems for Design. PhD thesis, Worcester Polytechnic Institute, 1997
- J. Grefenstette, 1990, Machine Learn., 5, 355
- S.M. Gustafson, 2000, Layered learning in genetic programming for a co-operative robot soccer problem
- Haynes T., 1995, Adaptation and Learning in Multiagent Systems, Lecture Notes in Artificial Intelligence
- T. Haynes and S. Sen, “Crossover operators for evolving a team,” in J. R. Koza, K. Deb, M. Dorigo, D. B. Fogel, M. Garzon, H. Iba, and R. L. Riolo, (eds.), Genetic Programming 1997: Proceedings of the Second Annual Conference, Morgan Kaufmann: Stanford University, CA, USA, pp. 162–167, 13–16 July 1997
- D. Hillis, 1991, Artif. Life II, SFI Stud. Sci. Complex., 10, 313
- J. Holland, 1975, Adaptation in Natural and Artificial Systems
- J. Hu, 2003, J. Machine Learn. Res., 4, 1039
- M. Huhns and M. Singh, “Agents and multiagent systems: Themes, approaches and challenges,” in’M. Huhns and M. Singh, (eds.), Readings in Agents, Morgan Kaufmann, pp. 1–23, 1998
- I. Imam, (ed.), Intelligent Adaptive Agents. Papers from the 1996 AAAI Workshop. Technical Report WS-96-04, AAAI Press, 1996
- A. Ito, “How do selfish agents learn to cooperate?,” in Artificial Life V: Proceedings of the Fifth International Workshop on the Synthesis and Simulation of Living Systems, MIT Press, pp. 185–192, 1997
- L. R. Leerink, S. R. Schultz, and M. A. Jabri, “A reinforcement learning exploration strategy based on ant foraging mechanisms,” in Proceedings of the Sixth Australian Conference on Neural Networks, Sydney, Australia, 1995
- S. Luke, “Genetic programming produced competitive soccer softbot teams for RoboCup97,” in J. R. Koza et al, (ed.), Genetic Programming 1998: Proceedings of the Third Annual Conference, Morgan Kaufmann, pp. 214–222, 1998
- M. Mitchell, J. Crutchfield, and R. Das, “Evolving cellular automata with genetic algorithms: A’review of recent work,” in Proceedings of the First International Conference on Evolutionary Computation and its Applications (EvCA’96), 1996
- N. D. Monekosso, P. Remagnino, and A. Szarowicz, “An improved Q-learning algorithm using synthetic pheromones,” in Proceedings of the Second Workshop of Central and Eastern Europe on Multi-Agent Systems CEEMAS-01, pp. 197–206, 2001 · DOI
- J. Pollack, 1997, Artificial Life V: Proc. of the Fifth Int. Workshop on the Synthesis and Simulation of Living Systems, 92
- J. Schmidhuber, “Realistic multi-agent reinforcement learning,” in Learning in Distributed Artificial Intelligence Systems, Working Notes of the 1996 ECAI Workshop, 1996
- A. Schultz, J. Grefenstette, and W. Adams, “Robo-shepherd: Learning complex robotic behaviors,” in Robotics and Manufacturing: Recent Trends in Research and Applications. Vol. 6, ASME Press, pp. 763–768, 1996
- M. Sekaran and S. Sen, “To help or not to help”, in Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society, Pittsburgh, PA, pp. 736–741, 1995
- L. Spector and J. Klein, “Evolutionary dynamics discovered via visualization in the breve simulation environment,” in Workshop Proceedings of the 8th International Conference on the Simulation and Synthesis of Living Systems, pp. 163–170, 2002
- L. Steels, 1996, Machine Intelligence 15
- P. Stone, “Layered learning in multiagent systems,” in Proceedings of National Conference on Artificial Intelligence AAAI/IAAI, 1997
- P. Stone, “Layered Learning in Multi-Agent Systems,” PhD thesis, Carnegie Mellon University, 1998
- R. Sutton, 1998, Machine Learn., 3, 9
- P. ’t Hoen and K. Tuyls, “Analyzing multi-agent reinforcement learning using evolutionary dynamics,” in Proceedings of the 15th European Conference on Machine Learning (ECML), 2004
- M. Tan, 1993, Readings in Agents, 487
- J. Werfel, November 2000, IEEE Trans. Evol. Comput., 4, 388
- T. White, 1998, Genetic Programming 1998: Proceedings of the Third Annual Conference, 22
Cited by
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
“For example, AI is often applied in open systems, blurring organizational boundaries (Panait & Luke, 2005).”
BackgroundA Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
“wise solutions in the context of the dynamic task is currently unclear [14], [17].”
Swarm robotics: a review from the swarm engineering perspective
Brambilla, M., Ferrante, E., Birattari, M., & Dorigo, M. (2013) · Swarm Intelligence · doi:10.1007/s11721-012-0075-2 · Cited by 1,762
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
“The rapid progress in recent years of machine learning, and deep learning in particular, opens the door to a new perspective on this debate.”
Background
Metadata
- Authors
- Panait, L., & Luke, S.
- Affiliations
- George Mason University (US)
- Corresponding author
- Panait, Liviu
- ORCID
- Luke, Sean
- Venue
- Autonomous Agents and Multi-Agent Systems
- Published
- 2005-11
- Volume
- 11
- Issue
- 3
- Pages
- 387-434
- ISSN
- 1387-2532 (ISSN-L)
- 1573-7454
- OpenAlex
- W2107544712
- Cited by
- 1,237
- References
- 327
- Citations by year
- 2026: 39 · 2025: 42 · 2024: 39 · 2023: 67 · 2022: 48 · 2021: 69 · 2020: 78 · 2019: 80 · 2018: 74 · 2017: 64 · 2016: 58 · 2015: 72 · 2014: 74 · 2013: 89 · 2012: 66
- FWCI
- 32.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Autonomous Agents and Multi-Agent Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- cooperative multi-agent learning, multi-agent systems, team learning, concurrent learning, direct communication, indirect communication, task decomposition, scalability, adaptive dynamics, evolutionary computation, game theory, reinforcement learning, agent-based modeling, robotics, complex systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.