Cooperative Multi-Agent Learning: The State of the Art
The DOI matches its Crossref record; 324 of the 327 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Integration ensures that machine outputs are used to challenge humans, and human inputs to challenge machines (Hoc, 2001), allowing for mutual learning (Panait & Luke, 2005) and debiasing (Larrick, 2004).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Panait & Luke, 2005
In the citing paper
“For example, AI is often applied in open systems, blurring organizational boundaries (Panait & Luke, 2005).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Panait & Luke, 2005
In the citing paper
“Multi-agent RL can also be applied to understand the behavior of groups of agents who need to cooperate; see [607] for an overview and [385,475] for recent examples.”
From Tackling climate change with machine learning (2023) · cites this paper as [607]
Citations
Cites
Items 201–324 of 324
The relationship between journal productivity and obsolescence
Wallace, D. P. (1986) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(198605)37:3<136::aid-asi4>3.0.co;2-r · Cited by 50
Electric Elves: Agent Technology for Supporting Human Organizations
Chalupsky, H., Gil, Y., Knoblock, C. A., Lerman, K., Oh, J., Pynadath, D. V., Russ, T. A., & Tambe, M. (2002) · doi:10.21236/ada459956 · Cited by 50
Collective Learning and Semiotic Dynamics
Steels, L., & Kaplan, F. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48304-7_89 · Cited by 48 · cited 2×
“Steels and Kaplan [251] continue this investigation to show that agents are able to create general words through collective agreement on their meanings and coverage.”
BackgroundProceedings of the sixth international conference on Artificial life
Adami, C., Belew, R. K., Kitano, H., & Taylor, C. E. (1998) · Cited by 47
Altruism in the Evolution of Communication
Ackley, D. H., & Littman, M. L. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/1428.003.0008 · Cited by 46 · cited 5×
“Littman [148] introduces the Friend-or-Foe Q-learning algorithm to find either a coordination equilibrium (with cooperative agents) or an adversarial one (with competitive agents).”
BackgroundInfluentialMultiagent learning in the presence of agents with limitations
Bowling, M., & Veloso, M. (2003) · Cited by 45
Steels, L. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3118.003.0068 · Cited by 45 · cited 1×
“Steels [216] reports the emergence of a spontaneous coherent lexicon that may adapt to cope with new meanings during the lifetime of the agents.”
BackgroundA multiagent reinforcement learning algorithm using extended optimal response
Suematsu, N., & Hayashi, A. (2002) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/544741.544831 · Cited by 45
Learning to Communicate and Act Using Hierarchical Reinforcement Learning
Ghavamzadeh, M., & Mahadevan, S. (2004) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.1109/aamas.2004.160 · Cited by 45 · cited 2×
“Also, Makar et al. [157], Ghavamzadeh and Mahadevan [84] suggest a different hierarchical approach to simplifying the inter-agent coordination task, where agents coordinate their high-level behaviors, rather than each primitive action they may perform.”
BackgroundLEARNING OTHER AGENTS' PREFERENCES IN MULTI-AGENT NEGOTIATION USING THE BAYESIAN CLASSIFIER
Bui, H., Venkatesh, S., & Kieronska, D. H. (1999) · International Journal of Cooperative Information Systems · doi:10.1142/s0218843099000149 · Cited by 44 · cited 1×
“A related approach is presented in [37, 36]: here, Bayesian learning is used to incrementally update models of other agents to reduce communication load by anticipating their future actions based on their previous ones.”
MethodAdvantages of cooperation between reinforcement learning agents in difficult stochastic problems
Berenji, H. R., & Vengerov, D. (2002) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzzy.2000.839146 · Cited by 44 · cited 1×
“For example, Berenji and Vengerov [16] investigate a cooperative learning setting where multiple agents employ communication to use and update the same policy.”
BackgroundSteels, L. (1996) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · Cited by 44
Exploring the Explorative Advantage of the Cooperative Coevolutionary (1+1) EA
Jansen, T., & Wiegand, R. P. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45105-6_37 · Cited by 43 · cited 4×
“Luke and Wiegand [155] cite (harsh) conditions under which single-learner coevolution can be rid of these difficulties.”
MethodInfluentialAN ARCHITECTURE FOR DYNAMICALLY INTERACTING AGENTS
Müller, J. P., & Pischel, M. (1994) · International Journal of Cooperative Information Systems · doi:10.1142/s021821579400003x · Cited by 43 · cited 2×
“The “Loading Dock” is a similar problem, where several forklifts load and unload trucks according to task requirements; either individual forklifts or groups of forklifts may be modeled as an agent [154].”
BackgroundPanait, L., & Luke, S. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/1429.003.0096 · Cited by 42 · cited 10×
“Luke [151], Luke et al. [152] focus on evolving soccer teams for the RoboCup competition, and they mention that the limited amount of time available before the competition diminished the probability of obtaining good heterogeneous teams.”
BackgroundInfluentialSelf-citationExistence of Multiagent Equilibria with Limited Agents
Bowling, M., & Veloso, M. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1332 · Cited by 42 · cited 7×
“Stone and Veloso [255] argue that unrestricted communication reduces a multi-agent system to something isomorphic to a single-agent system.”
BackgroundInfluentialThe Evolution of Communication Schemes Over Continuous Channels
Saunders, G. M., & Pollack, J. B. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/3118.003.0070 · Cited by 41
Recursive Agent and Agent-Group Tracking in a Real-Time Dynamic Environment.
Tambe, M. (1995) · Cited by 41
Keepaway Soccer: A Machine Learning Test bed
Stone, P., & Sutton, R. S. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45603-1_22 · Cited by 41
Reinforcement Learning Soccer Teams with Incomplete World Models
Wiering, M., Sałustowicz, R., & Schmidhuber, J. (1999) · Autonomous Robots · doi:10.1023/a:1008921914343 · Cited by 41 · cited 2×
“[261] M.”
ResultReinforcement Learning of Coordination in Heterogeneous Cooperative Multi-Agent Systems
Kapetanakis, S., & Kudenko⋆, D. (2004) · doi:10.1109/aamas.2004.227 · Cited by 40
Spatial Embedding and Loss of Gradient in Cooperative Coevolutionary Algorithms
Wiegand, R. P., & Sarma, J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30217-9_92 · Cited by 39
A comparison of approaches to the evolution of homogeneous multi-robot teams
Quinn, M. (2002) · Congress on Evolutionary Computation · doi:10.1109/cec.2001.934381 · Cited by 39
Evolutionary learning of communicating agents
Iba, H. (1998) · Information Sciences · doi:10.1016/s0020-0255(97)10055-x · Cited by 38 · cited 2×
“Some research has presented domains where concurrent learning outperforms both homogeneous and heterogeneous team learning [40, 108, 109].”
BackgroundSophisticated and distributed: The transportation domain
Fischer, K., Kuhn, N., Müller, H. J., Müller, J. P., & Pischel, M. (1995) · Lecture notes in computer science · doi:10.1007/bfb0027060 · Cited by 38
Multi-machine scheduling-a multi-agent learning approach
Brauer, W., & Weiß, G. (2002) · International Conference on Multi Agent Systems · doi:10.1109/icmas.1998.699030 · Cited by 38 · cited 2×
“Last, Weiß [285, 287] and Huhns and Singh [123] characterize multi-agent systems based on types of environments, agents, and inter-agent interactions.”
BackgroundAgents Learning about Agents: A Framework and Analysis
Vidal, M. C., & Durfee, E. H. (1997) · Cited by 37
The Legion System: A Novel Approach to Evolving Heterogeneity for Collective Problem Solving
Bongard, J. (2000) · Lecture notes in computer science · doi:10.1007/978-3-540-46239-2_2 · Cited by 37 · cited 5×
“[22] J.”
BackgroundResultInfluentialThe puzzle of language evolution
Steels, L. (1999) · Kognitionswissenschaft · doi:10.1007/bf03354936 · Cited by 37
Robustness in cooperative coevolution
Wiegand, R. P., & Potter, M. A. (2006) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1143997.1144063 · Cited by 36
Improving coevolutionary search for optimal multiagent behaviors
Panait, L., Wiegand, R. P., & Luke, S. (2003) · Cited by 35
Self-citationLearning in distributed systems and multi-agent environments
Brazdil, P., Gams, M., Sian, S., Torgo, L., & de Velde, W. V. (1991) · Lecture notes in computer science · doi:10.1007/bfb0017034 · Cited by 35 · cited 2×
“Other surveys of existing work in multi-agent learning and related domains include [61, 68, 33, 67, 244, 171, 43, 205, 132, 249, 60, 127, 225, 169].”
BackgroundMultiagent systems: Milestones and new horizons
Sen, S. (1997) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(97)01100-5 · Cited by 35 · cited 2×
“[205] S.”
BackgroundTowards a pareto-optimal solution in general-sum games
Sen, S., Airiau, S., & Mukherjee, R. (2003) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/860575.860600 · Cited by 35
Emergence of the cooperative behavior using ADG; Automatically Defined Groups.
Hara, A., & Nagao, T. (1999) · Tokyo Tech Research Repository (Tokyo Institute of Technology) · Cited by 34
Self-fulfilling Bias in Multiagent Learning
Hu, J., & Wellman, M. P. (1996) · Cited by 34
Reward and Diversity in Multirobot Foraging
Balch, T. R. (1999) · Cited by 34
The moving target function problem in multi-agent learning
Vidal, J. M., & Durfee, E. H. (2002) · International Conference on Multi Agent Systems · doi:10.1109/icmas.1998.699075 · Cited by 34
Predicting the Expected Behavior of Agents that Learn About Agents: The CLRI Framework
Vidal, J. M., & Durfee, E. H. (2003) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/a:1021765422660 · Cited by 33 · cited 3×
“Vidal and Durfee [275] categorize agents based on the complexity they assume for their teammates.”
BackgroundLearning from Multiple Sources
Nunes, L., & Oliveira, E. (2004) · doi:10.1109/aamas.2004.159 · Cited by 33 · cited 1×
“The agents need to coordinate to dealwith fluctuations in traffic [145, 183].”
BackgroundReinforcement Learning Approaches to Coordination in Cooperative Multi-agent Systems
Kapetanakis, S., Kudenko⋆, D., & Strens, M. J. A. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44826-8_2 · Cited by 32
An investigation, using co-evolution, to evolve an Awari player
Davis, J. E., & Kendall, G. (2003) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2002.1004449 · Cited by 32 · cited 2×
“Other games have included Tic-Tac-Toe [4], Mancala [61], Othello [241], Go [149], Chess [138, 269], Poker [139], Blackjack [261], Nim and 3D Tic-TacToe [219], and Tag [215].”
Cooperative Strategies and the Evolution of Communication
Wagner, K. (2000) · Artificial Life · doi:10.1162/106454600568384 · Cited by 32 · cited 2×
“[240] K.”
BackgroundEvolving Behaviors for Cooperating Agents
Bassett, J. K., & Jong, K. A. D. (2000) · Lecture notes in computer science · doi:10.1007/3-540-39963-1_17 · Cited by 31 · cited 1×
“A related problem domain is described in [268, 16, 15]: a team of agents needs to perform a surveillance task in a region of space.”
BackgroundEvolutionary computing in multi-agent environments: Operators
Bull, L. (1998) · Lecture notes in computer science · doi:10.1007/bfb0040758 · Cited by 31 · cited 1×
“Bull [38, 39] examines different learning parameters in coevolutionary algorithms.”
BackgroundUnderstanding cooperative co-evolutionary dynamics via simple fitness landscapes
Popovici, E., & Jong, K. A. D. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068094 · Cited by 31
Enhancing performance of cooperating agents in real-time diagnostic systems
Schwuttke, U. M., & Quan, A. G. (1993) · International Joint Conference on Artificial Intelligence · Cited by 30
The necessity of average rewards in cooperative multirobot learning
Tangamchit, P., Dolan, J. M., & Khosla, P. K. (2003) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2002.1014721 · Cited by 30 · cited 1×
“[232] suggest that discounting rewards (considering immediate rewards to be more important than future ones) leads to robots learning greedy actions designed for immediate reinforcement, hampering better collaborations.”
BackgroundModeling Variation in Cooperative Coevolution Using Evolutionary Game Theory.
Wiegand, R. P., Liles, W. C., & Jong, K. A. D. (2002) · Cited by 30
Learning Ant Foraging Behaviors
Panait, L., & Luke, S. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/1429.003.0097 · Cited by 29 · cited 1×
“Panait and Luke [187, 188, 189] present a related algorithm that exhibits good performance at various foraging tasks in the presence of obstacles.”
BackgroundSelf-citationAn Investigation of an Adaptive Poker Player
Kendall, G., & Willdig, M. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45656-2_17 · Cited by 28 · cited 1×
“Other games have included Tic-Tac-Toe [4], Mancala [61], Othello [241], Go [149], Chess [138, 269], Poker [139], Blackjack [261], Nim and 3D Tic-TacToe [219], and Tag [215].”
A Visual Demonstration of Convergence Properties of Cooperative Coevolution
Panait, L., Wiegand, R. P., & Luke, S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30217-9_90 · Cited by 28
Self-citationA Sensitivity Analysis of a Cooperative Coevolutionary Algorithm Biased for Optimization
Panait, L., Wiegand, R. P., & Luke, S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24854-5_59 · Cited by 28
Self-citationAkiyama, E., & Kaneko, K. (1995) · Artificial Life · doi:10.1162/artl.1995.2.293 · Cited by 28
Mutually supervised learning in multiagent systems
Goldman, C. V., & Rosenschein, J. S. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_20 · Cited by 28
Learning cases to resolve conflicts and improve group behavior
Haynes, T. D., & Sen, S. (1998) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1997.0159 · Cited by 27 · cited 1×
“Haynes et al. [103], Haynes and Sen [105, 107] use this approach complemented with a case-based learning mechanism for dealing with exceptions from this assumed behavior.”
BackgroundMulti-agent systems by incremental gradient reinforcement learning
Dutech, A., Buffet, O., & Charpillet, F. (2001) · Cited by 27
An artificial neural network representation for artificial organisms
Collins, R. J., & Jefferson, D. R. (2006) · Springer eBooks · doi:10.1007/bfb0029761 · Cited by 27 · cited 1×
“This question was first examined in AntFarm, a system that combines communication via pheromones and evolutionary computation [50, 49].”
BackgroundLearning Cases to Compliment Rules for Conflict Resolution in Multiagent Systems
Haynes, T. D., Lau, K., & Sen, S. (1996) · Cited by 26
Autonomous Agents that Learn to Better Coordinate
Garland, A., & Alterman, R. (2004) · Autonomous Agents and Multi-Agent Systems · doi:10.1023/b:agnt.0000018808.95119.9e · Cited by 26 · cited 2×
“Case-based learning has also been used to develop successful joint plans based on one’s historical expectations of other agents’ actions [83].”
BackgroundAn intelligent system for document retrieval in distributed office environments
Mukhopadhyay, U., Stephens, L. M., Huhns, M. N., & Bonnell, R. D. (1986) · Journal of the American Society for Information Science · doi:10.1002/asi.4630370304 · Cited by 26
Large-scale dynamic optimization using teams of reinforcement learning agents
Crites, R. H., & Barto, A. G. (1996) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 25
Learning Conventions in Multiagent Stochastic Domains using Likelihood EstimatesPreprint
Boutilier, C. E. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.3561 · Cited by 25 · cited 1×
“Boutilier [23], Chalkiadakis and Boutilier [46] suggest a Bayesian learning method for approximating the correct move each agent should make given a history of past interactions with the other agents, even in cases when the agent does not know the actions of the other agents that led to its reward.”
BackgroundAdaptive spatio-temporal organization in groups of robots
Dahl, T., Matarić, M. J., & Sukhatme, G. S. (2003) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/irds.2002.1041529 · Cited by 25 · cited 1×
“The efficiency of an approach may be defined by how quickly it completes the foraging task [142, 54], or by the number of items collected in a fixed amount of time.”
BackgroundWhat Your Computer Really Needs to Know, You Learned in Kindergarten
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/4631.003.0014 · Cited by 24
Incremental Self-Improvement for Life-Time Multi-Agent Reinforcement Learning
Zhao, J., & Schmidhuber, J. (1996) · From Animals to Animats 4 · doi:10.7551/mitpress/3118.003.0062 · Cited by 24 · cited 1×
“This idea was used in early multi-agent learning literature [228, 229, 312].”
MethodTrail-laying robots for robust terrain coverage
Svennebring, J., & Koenig, S. (2004) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2003.1241576 · Cited by 24 · cited 1×
“Multi-agent patrolling is a non-stationary variant of this surveillance task: the agents are required to continuously explore the environment [224, 262].”
BackgroundEvaluating concurrent reinforcement learners
Mundhe, M., & Sen, S. (2002) · International Conference on Multi Agent Systems · doi:10.1109/icmas.2000.858505 · Cited by 24 · cited 8×
“Banerjee et al. [10], Mukherjee and Sen [173] present experiments in which 1-level agents model each others’ action probability distributions; this produces a form of mutual trust.”
BackgroundInfluentialFair and Efficient Solutions to the Santa Fe Bar Problem
Farago, J., Greenwald, A., & Hall, K. (1910) · Cited by 23
Evolving cooperative communicating classifier systems
Bull, L., & Fogarty, T. C. (1994) · UWE Research Repository (UWE Bristol) · Cited by 23
Application of Distributed AI and Cooperative Problem Solving to Telecommunications
Weihmayer, R., & Velthuijsen, H. (1994) · Cited by 22
Learning, Cooperation, and Coordination in Multi-Agent Systems
Berenji, H. R., & Vengerov, D. (2000) · Cited by 22
Production sequencing as negotiation
Wooldridge, M., Bussmann, S., & Klosterberg, M. (1996) · Cited by 22
Phe-Q : A Pheromone Based Q-Learning
Monekosso, D., & Remagnino, P. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45656-2_30 · Cited by 21 · cited 1×
“A series of reinforcement learning algorithms have adopted a fixed pheromone laying procedure, and use current pheromone amounts for additional sensor information while exploring the space or while updating the state-action utility estimates [143, 168, 169, 170, 171].”
MethodA bartering approach to improve multiagent learning
Ontañón, S., & Plaza, E. (2002) · doi:10.1145/544741.544833 · Cited by 21
Incremental reinforcement learning for designing multi-agent systems
Buffet, O., Dutech, A., & Charpillet, F. (2001) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/375735.375826 · Cited by 21
Evolutionary computing in multi-agent environments: Eusociality
Bull, L., & Holland, O. E. (1997) · UWE Research Repository (UWE Bristol) · Cited by 21
When evolving populations is better than coevolving individuals: the blind mice problem
Miconi, T. (2003) · Cited by 20
Shared memory based cooperative coevolution
Puppala, N., Sen, S., & Gordin, M. (2002) · doi:10.1109/icec.1998.700091 · Cited by 20 · cited 1×
“In [79, 182], a coevolutionary algorithm is augmented with a “hall of fame” repository consisting of theN best teams discovered so far.”
MethodAn Update on the Distributed Vehicle Monitoring Testbed
Lesser, V., Corkill, D. D., & Durfee, E. H. (1987) · Cited by 20
On the Agenda(s) of Research on Multi-Agent Learning.
Shoham, Y., Powers, R., & Grenager, T. (2004) · Cited by 20
Opportunities for Learning in Multi-Agent Meeting Scheduling.
Crawford, E., & Veloso, M. (2004) · Cited by 19
Bajcsy, R. K. (1993) · Medical Entomology and Zoology · Cited by 19
Evolving agent societies that avoid social dilemmas
Mundhe, M., & Sen, S. (2000) · Cited by 18
Multi-Agent Learning with the Success-Story Algorithm
Schmidhuber, J., & Zhao, J.-Y. (1996) · ECAI Workshop LDAIS / ICMAS Workshop LIOME · doi:10.1007/3-540-62934-3_43 · Cited by 18
Co-Evolving Team Capture Strategies for Dissimilar Robots.
Blumenthal, H. J., & Parker, G. B. (2004) · Cited by 17
Evolving Multiple Agents by Genetic Programming
(1999) · The MIT Press eBooks · doi:10.7551/mitpress/1110.003.0024 · Cited by 16 · cited 1×
“This explosion in the state space size can be overwhelming for learning methods that explore the space of state utilities (such as reinforcement learning), but it may not as drastically affect techniques that explore the space of behaviors (such as evolutionary computation) [192, 193, 208, 110].”
BackgroundGenerating Vowel Systems in a Population of Agents
de Boer, B. (2004) · Cited by 16
Efficient Learning Equilibrium
Brafman, R. I., & Tennenholtz, M. (2002) · Cited by 16
Decentralized control for coordinated flow of multi-agent systems
Crespi, V., Cybenko, G. V., Rus, D. L., & Santini, M. (2003) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2002.1007554 · Cited by 16 · cited 1×
“The Opera Problem, discussed in [56], represents another challenge problem in cooperative navigation: a large number of agents located in a bounded space need to coordinate in order to quickly leave through a small fixed exit area.”
BackgroundExploiting Embodiment in Multi-Robot Teams
Werger, B. B., & Matarić, M. J. (1999) · Cited by 14
Ohko, T., Hiraki, K., & Anzai, Y. (1997) · Lecture notes in computer science · doi:10.1007/3-540-62934-3_52 · Cited by 14
Understanding Competitive Co-Evolutionary Dynamics via Fitness Landscapes.
Popovici, E., & Jong, K. A. D. (2004) · Cited by 13
Architectures for distributed air-traffic control
Steeb, R., Cammarata, S. J., Hayes-Roth, F. A., Thornadyke, P. W., & Wesson, R. B. (1988) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 13
Using reciprocity to adapt to others
Sen, S., & Sekaran, M. (1996) · Lecture notes in computer science · doi:10.1007/3-540-60923-7_29 · Cited by 13 · cited 2×
“Sekaran and Sen [233], Sen and Sekaran [236] investigate the application of reciprocity concepts to multi-agent domains where not enough information on the intentions of other agents is known a priori .”
BackgroundThe puzzle of language evolution
Steels, L. (2000) · Kognitionswissenschaft · doi:10.1007/s001970050001 · Cited by 13
Robinson, A. J., & Spector, L. C. (2002) · Cited by 12
Stochastic Direct Reinforcement: Application to Simple Games with Recurrence.
Moody, J. E., Liu, Y., Saffell, M., & Youn, K. (2004) · Cited by 12
Guaranteeing Coevolutionary Objective Measures.
Luke, S., & Wiegand, R. P. (2002) · Cited by 12
Self-citationA collective genetic algorithm
Miconi, T. (2001) · Cited by 11
Sałustowicz, R., Wiering, M., & Schmidhuber, J. (1997) · Lecture notes in computer science · doi:10.1007/bfb0020247 · Cited by 11
Sophisticated and distributed: The transportation domain
Fischer, K., Kuhn, N., Muller, H. J., Müller, J. P., & Pischel, M. (2002) · Conference on Artificial Intelligence for Applications · doi:10.1109/caia.1993.366629 · Cited by 11 · cited 1×
“A multi-agent approach to this domain is reported in [72].”
BackgroundEvolving Cooperative Groups: Preliminary Results
Gordin, M., Sen, S., & Puppala, N. (1997) · Cited by 10
A decision-theoretic model of coordination and communication in autonomous systems.
Gmytrasiewicz, P. J. (1992) · Deep Blue (University of Michigan) · Cited by 10
An Analysis of the Pheromone Q-Learning Algorithm
Monekosso, D., & Remagnino, P. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36131-6_23 · Cited by 9 · cited 1×
“A series of reinforcement learning algorithms have adopted a fixed pheromone laying procedure, and use current pheromone amounts as additional sensor information while exploring the space or while updating the state-action utility estimates [126, 149, 151, 148, 150].”
MethodTuning Synthetic Pheromones With Evolutionary ComputingPreprint
Sauter, J., Parunak, H. V. D., Brueckner, S., & Matthews, R. (2001) · Cited by 9
Foundations of Multi-Agent Systems: Techniques, Tools and Theory
Flucke, G., d’Inverno, M., Fisher, M., & CONTRIBUTORS, F. (1998) · The Knowledge Engineering Review · doi:10.1017/s0269888998003014 · Cited by 9
Weiß, G. (1995) · Cited by 8
Applying diffusion to a cooperative coevolutionary model
Wiegand, R. P. (1998) · Lecture notes in computer science · doi:10.1007/bfb0056898 · Cited by 8 · cited 1×
“ing globally optimal solutions for the team as a whole; and approaches to assessing the external performance of the learners despite their sensitivity to the other agents involved [256, 258, 259, 260, 257].”
BackgroundLearning Agents in a Homo Egualis Society
Nowé, A., Verbeeck, K., & Lenaerts, T. (2001) · Cited by 7
An Improved Q-Learning Algorithm Using Synthetic Pheromones
Monekosso, D., Remagnino, P., & Szarowicz, A. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45941-3_21 · Cited by 7
Learning Team Strategies With Multiple Policy-Sharing Agents: A Soccer Case Study
Sałustowicz, R., Wiering, M., & Schmidhuber, J. (1997) · doi:10.71910/supsi.7457 · Cited by 7
Adaptation Using Cases in Cooperative Groups
Haynes, T. D., & Sen, S. (2002) · Cited by 6
Continuing research in multi-agent systems
Decker, K., Fisher, M., Flucke, G., Tennenholtz, M., & Contributors, U. (1999) · The Knowledge Engineering Review · doi:10.1017/s026988899900301x · Cited by 6
Huhns, M. N., & Weiß, G. (1998) · Machine Learning · doi:10.1023/a:1007547205842 · Cited by 6
Learning in multiagent systems
Dowell, M. L., & Stephens, L. M. (1995) · Cited by 5
Learning situtation-specific control in multi-agent systems
Nagendraprasad, M. V. (1997) · Cited by 5
A framework for coordination and learning among teams of agents
Bui, H., Venkatesh, S., & Kieronska, D. H. (1998) · Lecture notes in computer science · doi:10.1007/bfb0055027 · Cited by 5
Learning to weigh basic behaviors in scalable agents
Buffet, O., Dutech, A., & Charpillet, F. (2002) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/545056.545111 · Cited by 5 · cited 1×
“Sometimes a robot is capable of pushing one box by itself (see for example the single-agent experiments reported in [136, 35]).”
BackgroundMaes, P., Matarić, M. J., Merer, J.-A., Pollack, J. B., & Wilson, S. W. (1996) · Defense Technical Information Center (DTIC) · Cited by 5
Multi-Agent Learning in Mobilized Ad-Hoc Networks.
Chang, Y.-H., Ho, T., & Kaelbling, L. P. (2004) · Cited by 5
Techniques for Learning in Multirobot Teams
Balch, T., & Parker, L. E. (2002) · A K Peters/CRC Press eBooks · doi:10.1201/9781439863671-14 · Cited by 5
Co-evolutionary Fitness Switching: Learning Complex Collective Behaviors Using Genetic Programming
Zhang, B.-T., & Cho, D.-Y. (1999) · The MIT Press eBooks · doi:10.7551/mitpress/1110.003.0023 · Cited by 4
Multi-Agent Learning in Conflicting Multi-Level Games with Incomplete Information.
Peeters, M., Verbeeck, K., & Nowé, A. (2004) · Cited by 4
Research works printed but not linked: 36
- W. Arthur, 1994, Complex. Econ. Theory, 84, 406
- B. Banerjee, R. Mukherjee, and S. Sen. “Learning mutual trust,” in Working Notes of AGENTS-00 Workshop on Deception, Fraud and Trust in Agent Societies, pp. 9–14, 2000.
- J. K. Bassett, 2002, A study of generalization techniques in evolutionary rule learning
- D. Bernstein, S. Zilberstein, and N. Immerman, “The complexity of decentralized control of MDPs,” in Proceedings of UAI-2000: The Sixteenth Conference on Uncertainty in Artificial Intelligence, 2000.
- L. Bull and O. Holland, “Evolutionary computing in multiagent environments: Eusociality”, in Proceedings of Seventh Annual Conference on Genetic Algorithms, 1997.
- M.R. Cutkosky, 1997, Readings in Agents, 46
- F. Fernandez, 2001, Int. J. Robot. Autom., 16, 217
- B. M. Good, Evolving multi-agent systems: Comparing existing approaches and suggesting new directions, Master’s thesis, University of Sussex, 2000
- D. L. Grecu, Using Learning to Improve Multi-Agent Systems for Design. PhD thesis, Worcester Polytechnic Institute, 1997
- J. Grefenstette, 1990, Machine Learn., 5, 355
- S.M. Gustafson, 2000, Layered learning in genetic programming for a co-operative robot soccer problem
- Haynes T., 1995, Adaptation and Learning in Multiagent Systems, Lecture Notes in Artificial Intelligence
- T. Haynes and S. Sen, “Crossover operators for evolving a team,” in J. R. Koza, K. Deb, M. Dorigo, D. B. Fogel, M. Garzon, H. Iba, and R. L. Riolo, (eds.), Genetic Programming 1997: Proceedings of the Second Annual Conference, Morgan Kaufmann: Stanford University, CA, USA, pp. 162–167, 13–16 July 1997
- D. Hillis, 1991, Artif. Life II, SFI Stud. Sci. Complex., 10, 313
- J. Holland, 1975, Adaptation in Natural and Artificial Systems
- J. Hu, 2003, J. Machine Learn. Res., 4, 1039
- M. Huhns and M. Singh, “Agents and multiagent systems: Themes, approaches and challenges,” in’M. Huhns and M. Singh, (eds.), Readings in Agents, Morgan Kaufmann, pp. 1–23, 1998
- I. Imam, (ed.), Intelligent Adaptive Agents. Papers from the 1996 AAAI Workshop. Technical Report WS-96-04, AAAI Press, 1996
- A. Ito, “How do selfish agents learn to cooperate?,” in Artificial Life V: Proceedings of the Fifth International Workshop on the Synthesis and Simulation of Living Systems, MIT Press, pp. 185–192, 1997
- L. R. Leerink, S. R. Schultz, and M. A. Jabri, “A reinforcement learning exploration strategy based on ant foraging mechanisms,” in Proceedings of the Sixth Australian Conference on Neural Networks, Sydney, Australia, 1995
- S. Luke, “Genetic programming produced competitive soccer softbot teams for RoboCup97,” in J. R. Koza et al, (ed.), Genetic Programming 1998: Proceedings of the Third Annual Conference, Morgan Kaufmann, pp. 214–222, 1998
- M. Mitchell, J. Crutchfield, and R. Das, “Evolving cellular automata with genetic algorithms: A’review of recent work,” in Proceedings of the First International Conference on Evolutionary Computation and its Applications (EvCA’96), 1996
- N. D. Monekosso, P. Remagnino, and A. Szarowicz, “An improved Q-learning algorithm using synthetic pheromones,” in Proceedings of the Second Workshop of Central and Eastern Europe on Multi-Agent Systems CEEMAS-01, pp. 197–206, 2001 · DOI
- J. Pollack, 1997, Artificial Life V: Proc. of the Fifth Int. Workshop on the Synthesis and Simulation of Living Systems, 92
- J. Schmidhuber, “Realistic multi-agent reinforcement learning,” in Learning in Distributed Artificial Intelligence Systems, Working Notes of the 1996 ECAI Workshop, 1996
- A. Schultz, J. Grefenstette, and W. Adams, “Robo-shepherd: Learning complex robotic behaviors,” in Robotics and Manufacturing: Recent Trends in Research and Applications. Vol. 6, ASME Press, pp. 763–768, 1996
- M. Sekaran and S. Sen, “To help or not to help”, in Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society, Pittsburgh, PA, pp. 736–741, 1995
- L. Spector and J. Klein, “Evolutionary dynamics discovered via visualization in the breve simulation environment,” in Workshop Proceedings of the 8th International Conference on the Simulation and Synthesis of Living Systems, pp. 163–170, 2002
- L. Steels, 1996, Machine Intelligence 15
- P. Stone, “Layered learning in multiagent systems,” in Proceedings of National Conference on Artificial Intelligence AAAI/IAAI, 1997
- P. Stone, “Layered Learning in Multi-Agent Systems,” PhD thesis, Carnegie Mellon University, 1998
- R. Sutton, 1998, Machine Learn., 3, 9
- P. ’t Hoen and K. Tuyls, “Analyzing multi-agent reinforcement learning using evolutionary dynamics,” in Proceedings of the 15th European Conference on Machine Learning (ECML), 2004
- M. Tan, 1993, Readings in Agents, 487
- J. Werfel, November 2000, IEEE Trans. Evol. Comput., 4, 388
- T. White, 1998, Genetic Programming 1998: Proceedings of the Third Annual Conference, 22
Cited by
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
“For example, AI is often applied in open systems, blurring organizational boundaries (Panait & Luke, 2005).”
BackgroundA Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
“wise solutions in the context of the dynamic task is currently unclear [14], [17].”
Swarm robotics: a review from the swarm engineering perspective
Brambilla, M., Ferrante, E., Birattari, M., & Dorigo, M. (2013) · Swarm Intelligence · doi:10.1007/s11721-012-0075-2 · Cited by 1,762
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
“The rapid progress in recent years of machine learning, and deep learning in particular, opens the door to a new perspective on this debate.”
Background
Metadata
- Authors
- Panait, L., & Luke, S.
- Affiliations
- George Mason University (US)
- Corresponding author
- Panait, Liviu
- ORCID
- Luke, Sean
- Venue
- Autonomous Agents and Multi-Agent Systems
- Published
- 2005-11
- Volume
- 11
- Issue
- 3
- Pages
- 387-434
- ISSN
- 1387-2532 (ISSN-L)
- 1573-7454
- OpenAlex
- W2107544712
- Cited by
- 1,237
- References
- 327
- Citations by year
- 2026: 39 · 2025: 42 · 2024: 39 · 2023: 67 · 2022: 48 · 2021: 69 · 2020: 78 · 2019: 80 · 2018: 74 · 2017: 64 · 2016: 58 · 2015: 72 · 2014: 74 · 2013: 89 · 2012: 66
- FWCI
- 32.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Autonomous Agents and Multi-Agent Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- cooperative multi-agent learning, multi-agent systems, team learning, concurrent learning, direct communication, indirect communication, task decomposition, scalability, adaptive dynamics, evolutionary computation, game theory, reinforcement learning, agent-based modeling, robotics, complex systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.