The DOI matches its Crossref record; 158 of the 170 references it cites were found in a registry or an index.
A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Open accessAbstract
Multiagent Reinforcement Learning (RL) solves complex tasks that require coordination with other agents through autonomous exploration of the environment. However, learning a complex task from scratch is impractical due to the huge sample complexity of RL algorithms. For this reason, reusing knowledge that can come from previous experience or other agents is indispensable to scale up multiagent RL algorithms. This survey provides a unifying view of the literature on knowledge reuse in multiagent RL. We define a taxonomy of solutions for the general knowledge reuse problem, providing a comprehensive discussion of recent progress on knowledge reuse in Multiagent Systems (MAS) and of techniques for knowledge reuse across agents (that may be actuating in a shared environment or not). We aim at encouraging the community to work towards reusing all the knowledge sources available in a MAS. For that, we provide an in-depth discussion of current lines of research and open questions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The pretraining approach has been successful for various machine vision problems28–30.”
From Cellpose 2.0: how to train your own model (2022) · cites this paper as [29]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. P. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,269
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,789
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
Multi-Agent Reinforcement Learning: Independent vs. Cooperative Agents
Tan, M. (1993) · Elsevier eBooks · doi:10.1016/b978-1-55860-307-3.50049-6 · Cited by 1,900
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Baxter, L. A., & Puterman, M. L. (1995) · Technometrics · doi:10.2307/1269932 · Cited by 1,889
Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping
Ng, A. Y., Harada, D., & Russell, S. (1999) · Cited by 1,744
Borko, H., & Putnam, R. T. (1996) · Cited by 1,655
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Dietterich, T. G. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.639 · Cited by 1,526
Transfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,524
Cooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237
Multiagent systems: A survey from a machine learning perspective
Stone, P., & Veloso, M. (2000) · Autonomous Robots · doi:10.1023/a:1008942012299 · Cited by 1,218
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217
Cooperative Multi-agent Control Using Deep Reinforcement Learning
Gupta, J. K., Egorov, M., & Kochenderfer, M. J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71682-4_5 · Cited by 926
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 923
Learning Multiagent Communication with BackpropagationPreprint
Sukhbaatar, S., Szlam, A. D., & Fergus, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07736 · Cited by 649
Interactively shaping agents via human reinforcement: the TAMER framework
Knox, W. B., & Stone, P. (2009) · International Conference on Knowledge Capture · doi:10.1145/1597735.1597738 · Cited by 601
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (2005) · Cited by 588
Thrun, S., & Mitchell, T. M. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00004-y · Cited by 536
Bayesian Inverse Reinforcement Learning
Krishnamurthy, V. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009449441.027 · Cited by 443
RoboCup: A Challenge Problem for AI
(1997) · AI Magazine · doi:10.1609/aimag.v18i1.1276 · Cited by 425
Autonomous agents modelling other agents: A comprehensive survey and open problems
Albrecht, S. V., & Stone, P. (2018) · Artificial Intelligence · doi:10.1016/j.artint.2018.01.002 · Cited by 417
An Algorithm for Distributed Reinforcement Learning in Cooperative Multi-Agent Systems
Lauer, M., & Riedmiller, M. (2000) · Cited by 412
Sammut, C., & Webb, G. I. (2010) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_447 · Cited by 400
Teacher–Student Curriculum Learning
Matiisen, T., Oliver, A., Cohen, T., & Schulman, J. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2934906 · Cited by 396
Reinforcement Learning for RoboCup Soccer Keepaway
STONE, P. R., Sutton, R. S., & Kuhlmann, G. (2005) · Adaptive Behavior · doi:10.1177/105971230501300301 · Cited by 388
Reinforcement learning improves behaviour from evaluative feedback
Littman, M. L. (2015) · Nature · doi:10.1038/nature14540 · Cited by 378
Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial ObservabilityPreprint
Omidshafiei, S., Pazis, J., Amato, C., How, J. P., & Vian, J. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.06182 · Cited by 333
Learning modular neural network policies for multi-task and multi-robot transfer
Devin, C., Gupta, A., Darrell, T., Abbeel, P., & Levine, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989250 · Cited by 324
Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination
Stone, P., Kaminka, G., Kraus, S., & Rosenschein, J. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7529 · Cited by 323
Policy Shaping: Integrating Human Feedback with Reinforcement Learning
Griffith, S., Subramanian, K. A., Scholz, J., Isbell, C. L., & Thomaz, A. L. (2013) · Cited by 307
Reverse Curriculum Generation for Reinforcement LearningPreprint
Florensa, C., Held, D., Wulfmeier, M., Zhang, M., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05300 · Cited by 277
Transfer in Reinforcement Learning: A Framework and a Survey
Lazaric, A. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_5 · Cited by 276
Empirical evaluation methods for multiobjective reinforcement learning algorithms
Vamplew, P. W., Dazeley, R., Berry, A., Issabekov, R., & Dekker, E. (2010) · Machine Learning · doi:10.1007/s10994-010-5232-5 · Cited by 275
Probabilistic policy reuse in a reinforcement learning agent
Fernández, F., & Veloso, M. (2006) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1160633.1160762 · Cited by 274
An object-oriented representation for efficient reinforcement learning
Diuk, C., Cohen, A., & Littman, M. L. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390187 · Cited by 226
Interactive Policy Learning through Confidence-Based Autonomy
Chernova, S., & Veloso, M. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2584 · Cited by 218
Learning with Opponent-Learning Awareness
Foerster, J., Chen, R. Y., Al-Shedivat, M., Whiteson, S., Abbeel, P., & Mordatch, I. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/hgwa8807 · Cited by 215
Learning Invariant Feature Spaces to Transfer Skills with Reinforcement LearningPreprint
Gupta, A., Devin, C., Liu, Y., Abbeel, P., & Levine, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02949 · Cited by 209
Multiagent Systems: A Survey from a Machine Learning Perspective
Stone, P., & Veloso, M. (1997) · doi:10.21236/ada333248 · Cited by 205
Transfer Learning via Inter-Task Mappings for Temporal Difference Learning
Taylor, M. E., Stone, P., & Liu, Y. (2007) · doi:10.5555/1314498.1314569 · Cited by 196
Informing sequential clinical decision-making through reinforcement learning: an empirical study
Shortreed, S. M., Laber, E. B., Lizotte, D. J., Stroup, T. S., Pineau, J., & Murphy, S. A. (2010) · Machine Learning · doi:10.1007/s10994-010-5229-0 · Cited by 193
A Survey of Learning in Multiagent Environments: Dealing with Non-StationarityPreprint
Hernández-Leal, P., Kaisers, M., Baarslag, T., & de Cote, E. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09183 · Cited by 187
Konidaris, G., & Barto, A. G. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143906 · Cited by 184
Accelerating Reinforcement Learning through Implicit Imitation
Price, B., & Boutilier, C. E. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.898 · Cited by 180
Reinforcement learning from demonstration through shaping
Brys, T., Harutyunyan, A., Suay, H. B., Chernova, S., Taylor, M. E., & Nowé, A. (2015) · Cited by 174
Confidence-based policy learning from demonstration using Gaussian mixture models
Chernova, S., & Veloso, M. (2007) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1329125.1329407 · Cited by 166
Interactive Learning from Policy-Dependent Human Feedback
MacGlashan, J., Ho, M. K., Loftin, R., Peng, B., Wang, G., Roberts, D., Taylor, M. E., & Littman, M. L. (2017) · arXiv · doi:10.48550/arxiv.1701.06049 · Cited by 163
Active Learning for Reward Estimation in Inverse Reinforcement Learning
Lopes, M. C., Melo, F. S., & Montesano, L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04174-7_3 · Cited by 158
Teaching on a budget: agents advising agents in reinforcement learning
Torrey, L. A., & Taylor, M. E. (2013) · doi:10.5555/2484920.2485086 · Cited by 149
Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play
Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A., & Fergus, R. (2017) · arXiv · doi:10.48550/arxiv.1703.05407 · Cited by 149
Principled methods for advising reinforcement learning agents
Wiewiora, E., Cottrell, G. W., & Elkan, C. (2003) · Cited by 147
Coordinated Multi-Agent Imitation LearningPreprint
Le, H. M., Yue, Y., Carr, P., & Lucey, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03121 · Cited by 140
An Analysis of Stochastic Game Theory for Multiagent Reinforcement Learning
Bowling, M., & Veloso, M. (2000) · Cited by 132
Knows what it knows: a framework for self-aware learning
Li, L. C., Littman, M. L., Walsh, T. J., & Strehl, A. L. (2010) · Machine Learning · doi:10.1007/s10994-010-5225-4 · Cited by 127
Hierarchical Apprenticeship Learning with Application to Quadruped Locomotion
Kolter, J. Z., Abbeel, P., & Ng, A. Y. (2007) · Cited by 122
A survey of inverse reinforcement learning techniques
Shao, Z., & Joo, E. M. (2012) · International Journal of Intelligent Computing and Cybernetics · doi:10.1108/17563781211255862 · Cited by 115
Interactive teaching strategies for agent training
Amir, O., Kamar, E. S., Kolobov, A., & Grosz, B. J. (2016) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 108
Creating Advice-Taking Reinforcement Learners
Maclin, R., & SHAVLIK, J. W. (1996) · Machine Learning · doi:10.1007/bf00114730 · Cited by 107
Thrun, S., & Mitchell, T. M. (1995) · Springer eBooks · doi:10.1007/978-3-642-79629-6_7 · Cited by 107
Learning to Teach in Cooperative Multiagent Reinforcement Learning
Omidshafiei, S., Kim, D.-K., Liu, M., Tesauro, G. J., Riemer, M., Amato, C., Campbell, M. S., & How, J. P. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v33i01.33016128 · Cited by 105
Kristian Kersting, B., van Otterlo, M., & Raedt, L. D. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015401 · Cited by 103
General game learning using knowledge transfer
Banerjee, B., & Stone, P. (2007) · Cited by 103
Simultaneously Learning and Advising in Multiagent Reinforcement Learning
da Silva, F. L., Glatt, R., & Costa, A. H. R. (2017) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/3091125.3091280 · Cited by 101
Self-citationRL-Glue: Language-Independent Software for Reinforcement-Learning Experiments
Tanner, B. K., & White, A. (2009) · Cited by 95
Decentralized MDPs with sparse interactions
Melo, F. S., & Veloso, M. (2011) · Artificial Intelligence · doi:10.1016/j.artint.2011.05.001 · Cited by 94
Autonomous Task Sequencing for Customized Curriculum Design in Reinforcement Learning
Narvekar, S., Sinapov, J., & Stone, P. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/353 · Cited by 93
Theoretical considerations of potential-based reward shaping for multi-agent systems
Devlin, S., & Kudenko⋆, D. (2011) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/vdid3904 · Cited by 93
Source Task Creation for Curriculum Learning
Narvekar, S., Sinapov, J., Leonetti, M., & Stone, P. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/wwrd6174 · Cited by 91
Potential-based difference rewards for multiagent reinforcement learning
Devlin, S., Yliniemi, L., Kudenko⋆, D., & Tumer, K. (2014) · doi:10.5555/2615731.2615761 · Cited by 86
Multi-Agent System Development Based on Organizations
Argente, E., Julián, V., & Botti, V. J. (2006) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2006.03.005 · Cited by 86
A Case-based Reasoning Approach to Imitating RoboCup Players
Floyd, M. W., Esfandiari, B., & Lam, K. (2008) · Cited by 83
Learning From Explanations Using Sentiment and Advice in RL
Krening, S., Harrison, B. E., Feigh, K. M., Isbell, C. L., Riedl, M. O., & Thomaz, A. L. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2628365 · Cited by 83
Multi-Agent Inverse Reinforcement Learning
Natarajan, S., Kunapuli, G., Judah, K., Tadepalli, P. V., Kristian Kersting, B., & SHAVLIK, J. W. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.65 · Cited by 83
Improving action selection in MDP's via knowledge transfer
Sherstov, A. A., & Stone, P. (2005) · National Conference on Artificial Intelligence · Cited by 79
Grounded Action Transformation for Robot Learning in Simulation
Hanna, J. P., & Stone, P. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11044 · Cited by 79
Heuristically-Accelerated Multiagent Reinforcement Learning
Bianchi, R. A. C., Martins, M. F., Ribeiro, C. H. C., & Costa, A. H. R. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2253094 · Cited by 78
Self-citationReinforcement learning agents providing advice in complex video games
Taylor, M. E., Carboni, N., Fachantidis, A., Vlahavas, I. P., & Torrey, L. A. (2014) · Connection Science · doi:10.1080/09540091.2014.885279 · Cited by 76
Multiagent Reinforcement Learning With Unshared Value Functions
Hu, Y., Gao, Y., & An, B. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2332042 · Cited by 70
Automatic Curriculum Graph Generation for Reinforcement Learning Agents
Svetlik, M., Leonetti, M., Sinapov, J., Shah, R., Walker, N., & Stone, P. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10933 · Cited by 70
Learning to Teach Reinforcement Learning Agents
Fachantidis, A., Taylor, M., & Vlahavas, I. (2017) · Machine Learning and Knowledge Extraction · doi:10.3390/make1010002 · Cited by 70
Cooperating with Unknown Teammates in Complex Domains: A Robot Soccer Case Study of Ad Hoc Teamwork
Barrett, S., & Stone, P. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9428 · Cited by 69
Active Reward Learning from Critiques
Cui, Y., & Niekum, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460854 · Cited by 69
Reinforcement Learning Via Practice and Critique Advice
Judah, K., Roy, S., Fern, A., & Dietterich, T. G. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7690 · Cited by 69
Exploration from Demonstration for Interactive Reinforcement Learning
Subramanian, K. A., Isbell, C. L., & Thomaz, A. L. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2936924.2936990 · Cited by 68
Transferring knowledge as heuristics in reinforcement learning: A case-based approach
Bianchi, R. A. C., Junior, L. A. C., Santos, P. E., Matsuura, J. P., & de Mántaras, R. L. (2015) · Artificial Intelligence · doi:10.1016/j.artint.2015.05.008 · Cited by 68
Policy shaping with human teachers
Cederborg, T., Grover, I., Isbell, C. L., & Thomaz, A. L. (2015) · Cited by 66
Multiagent Inverse Reinforcement Learning for Two-Person Zero-Sum Games
Lin, X., Beling, P. A., & Cogill, R. (2017) · IEEE Transactions on Games · doi:10.1109/tciaig.2017.2679115 · Cited by 65
Transfer Learning in Multi-Agent Reinforcement Learning Domains
Boutsioukis, G., Partalas, I., & Vlahavas, I. P. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29946-9_25 · Cited by 64
Learning multi-agent state space representations
Hauwere, Y.-M. D., Vrancx, P., & Nowé, A. (2010) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/1838206.1838301 · Cited by 64
Half Field Offense: An Environment for Multiagent Learning and Ad Hoc Teamwork
Stone, M. H. A. P. (2016) · Cited by 63
Policy Transfer using Reward Shaping
Brys, T., Harutyunyan, A., Taylor, M. E., & Nowé, A. (2015) · doi:10.5555/2772879.2772905 · Cited by 62
Learning from Demonstration for Shaping through Inverse Reinforcement Learning
Suay, H. B., Brys, T., Taylor, M. E., & Chernova, S. (2016) · VUBIR (Vrije Universiteit Brussel) · doi:10.5555/2936924.2936988 · Cited by 62
Transfer of Experience Between Reinforcement Learning Environments with Progressive Difficulty
Madden, M. G., & Howley, T. (2004) · Artificial Intelligence Review · doi:10.1023/b:aire.0000036264.95672.64 · Cited by 58
Multiagent Reinforcement Learning With Sparse Interactions by Negotiation and Knowledge Transfer
Zhou, L., Yang, P., Chen, C., & Gao, Y. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2543238 · Cited by 56
Implicit Imitation in Multiagent Reinforcement Learning
Price, B., & Boutilier, C. E. (1999) · Cited by 54
Learning to Predict Consequences as a Method of Knowledge Transfer in Reinforcement Learning
Chalmers, E., Bermudez-Contreras, E. J., Robertson, B., Luczak, A., & Gruber, A. J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2690910 · Cited by 53
Accelerating Multiagent Reinforcement Learning by Equilibrium Transfer
Hu, Y., Gao, Y., & An, B. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2349152 · Cited by 50
Teacher-Student Framework: a Reinforcement Learning Approach
Zimmer, M., Viappiani, P., & Weng, P. (2014) · HAL · Cited by 50
Pre-training Neural Networks with Human Demonstrations for Deep Reinforcement LearningPreprint
Cruz, G., Du, Y., & Taylor, M. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.04083 · Cited by 50
Accelerating Learning in multi-objective systems through Transfer Learning
Taylor, A., Dusparić, I., Galván, E., Clarke, S., & Cahill, V. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889438 · Cited by 48
Improving Reinforcement Learning by Using Case Based Heuristics
Bianchi, R. A. C., Ros, R., & de Mántaras, R. L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02998-1_7 · Cited by 47
Multi-thresholded approach to demonstration selection for interactive robot learning
Chernova, S., & Veloso, M. (2008) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1349822.1349852 · Cited by 46
Stochastic Abstract Policies: Generalizing Knowledge to Improve Reinforcement Learning
Koga, M. L., Freire, V., & Costa, A. H. R. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2319733 · Cited by 42
Self-citationDistributed W-Learning: Multi-Policy Optimization in Self-Organizing Systems
Dusparić, I., & Cahill, V. (2009) · IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO) · doi:10.1109/saso.2009.23 · Cited by 41
Towards Knowledge Transfer in Deep Reinforcement Learning
Glatt, R., da Silva, F. L., & Costa, A. H. R. (2016) · Brazilian Conference on Intelligent Systems · doi:10.1109/bracis.2016.027 · Cited by 40
Self-citationMOO-MDP: An Object-Oriented Representation for Cooperative Multiagent Reinforcement Learning
da Silva, F. L., Glatt, R., & Costa, A. H. R. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2781130 · Cited by 40
Self-citationWhere to Add Actions in Human-in-the-Loop Reinforcement Learning
Mandel, T., Liu, Y.-E., Brunskill, E., & Popović, Z. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10945 · Cited by 39
Improving Reinforcement Learning with Confidence-Based Demonstrations
Wang, Z., & Taylor, M. E. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/422 · Cited by 39
Autonomously Reusing Knowledge in Multiagent Reinforcement Learning
da Silva, F. L., Taylor, M. E., & Costa, A. H. R. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/774 · Cited by 39
Self-citationLeveraging Human Knowledge in Tabular Reinforcement Learning: A Study of Human Subjects
Rosenfeld, A., Cohen, M., Taylor, M. E., & Kraus, S. (2017) · The Knowledge Engineering Review · doi:10.1017/s0269888918000206 · Cited by 39
Object-Oriented Curriculum Generation for Reinforcement Learning
da Silva, F. L., & Costa, A. H. R. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/insi6337 · Cited by 37
Self-citationRL-Glue: Language-Independent Software for Reinforcement-Learning Experiments
TannerBrian, & WhiteAdam (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755857 · Cited by 35
A Need for Speed: Adapting Agent Action Speed to Improve Task Learning from Non-Expert Humans
Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2936924.2937065 · Cited by 35
Zhan, Y., Ammar, H. B., & Taylor, M. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.03986 · Cited by 34
Efficiently detecting switches against non-stationary opponents
Hernández-Leal, P., Zhan, Y., Taylor, M. E., Sucar, L. E., & de Cote, E. M. (2016) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-016-9352-6 · Cited by 33
Inverse reinforcement learning for decentralized non-cooperative multiagent systems
Reddy, T. S., Gopikrishna, V., Zaruba, G. V., & Huber, M. (2012) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2012.6378020 · Cited by 32
Transfer learning in multi-agent systems through parallel transfer
Taylor, A., Duparic, I., Galván, E., Clarke, S., & Cahill, V. (2013) · University of Limerick Institutional Repository (University of Limerick) · doi:10.34961/1016 · Cited by 32
Active Imitation Learning via Reduction to I.I.D. Active LearningPreprint
Judah, K., Fern, A., & Dietterich, T. G. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1210.4876 · Cited by 32
(2012) · Harvard University Press eBooks · doi:10.2307/j.ctt2jbq07.6 · Cited by 32
Grounded Action Transformation for Robot Learning in Simulation
Hanna, J. P., & STONE, P. R. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11124 · Cited by 29
Shon, A. P., Verma, D. K., & Rao, R. P. N. (2007) · Cited by 28
Learning Inter-Task Transferability in the Absence of Target Task Samples
Sinapov, J., Narvekar, S., Leonetti, M., & Stone, P. (2015) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/xmcc3729 · Cited by 28
Towards a Fast Detection of Opponents in Repeated Stochastic Games
Hernández-Leal, P., & Kaisers, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71682-4_15 · Cited by 26
Object focused q-learning for autonomous agents
Cobo, L. C., Isbell, C. L., & Thomaz, A. L. (2013) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/sibo5381 · Cited by 25
Learning in Multi-agent Systems with Sparse Interactions by Knowledge Transfer and Game Abstraction
Hu, Y., Gao, Y., & An, B. (2015) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2772879.2773250 · Cited by 19
TRANSFER LEARNING FOR MULTI-AGENT COORDINATION
Vrancx, P., Hauwere, Y.-M. D., & Nowé, A. (2011) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0003185602630272 · Cited by 18
Multi-agent Behavior-Based Policy Transfer
Didi, S., & Nitschke, G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31153-1_13 · Cited by 17
Transfer Learning Method Using Ontology for Heterogeneous Multi-agent Reinforcement Learning
Kono, H., Kamimura, A., Tomita, K., Murata, Y., & SUZUKI, T. (2014) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2014.051022 · Cited by 17
Multi-agent Relational Reinforcement Learning
Croonenborghs, T., Tuyls, K., Ramon, J., & Bruynooghe, M. (2006) · Lecture notes in computer science · doi:10.1007/11691839_12 · Cited by 16
Blending Autonomous Exploration and Apprenticeship Learning
Walsh, T. J., Hewlett, D., & Morrison, C. T. (2011) · Cited by 13
Autonomous Shaping: Knowledge Transfer in Reinforcement Learning
Konidaris, G., & Barto, A. G. (2006) · Cited by 13
Transfer learning by prototype generation in continuous spaces
de Cote, E. M., Garcia, E., & Morales, E. F. (2016) · Adaptive Behavior · doi:10.1177/1059712316664570 · Cited by 12
Transferring knowledge from human-demonstration trajectories to reinforcement learning
Wang, G., Fang, Z., Ping, L., & Li, B. (2016) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331216649655 · Cited by 12
Creating Advice-Taking Reinforcement Learners
Maclin, R., & SHAVLIK, J. W. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5529-2_13 · Cited by 12
Speeding-up reinforcement learning through abstraction and transfer learning
Koga, M. L., Freire, V., Cozman, F. G., & Costa, A. H. R. (2013) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/otnn9968 · Cited by 11
Self-citationAccelerating Multiagent Reinforcement Learning through Transfer Learning
da Silva, F., & Costa, A. H. R. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10518 · Cited by 11
Self-citationBeyond Reinforcement Learning and Local View in Multiagent Systems
Bazzan, A. L. C. (2014) · Künstliche Intell. · doi:10.1007/s13218-014-0312-5 · Cited by 10
Object-model transfer in the general video game domain
Braylan, A. (2019) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.26153/tsw/3139 · Cited by 9
Learning Options From Demonstrations: A Pac-Man Case Study
Tamassia, M., Zambetta, F., Raffe, W. L., Mueller, F., & Li, X. (2017) · IEEE Transactions on Games · doi:10.1109/tciaig.2017.2658659 · Cited by 8
HogRider: Champion Agent of Microsoft Malmo Collaborative AI Challenge
Xiong, Y., Chen, H., Zhao, M., & An, B. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11581 · Cited by 8
Multiagent Transfer Learning via Assignment-Based Decomposition
Proper, S., & Tadepalli, P. V. (2009) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2009.59 · Cited by 7
Coco-Q: Learning in Stochastic Games with Side Payments
Sodomka, E., Hilliard, E., Littman, M. L., & Greenwald, A. (2013) · Cited by 5
Object-Model Transfer in the General Video Game Domain
Braylan, A., & Miikkulainen, R. P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12870 · Cited by 5
Comparative Analysis of Abstract Policies to Transfer Learning in Robotics Navigation.
Freire, V., & Costa, A. H. R. (2015) · National Conference on Artificial Intelligence · Cited by 4
Self-citationLearning through Imitation and Reinforcement Learning: Toward the Acquisition of Painting Motions
Sakato, T., Ozeki, M., & Oka, N. (2014) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai.2014.174 · Cited by 3
Coordination Confidence Based Human-Multi-Agent Transfer Learning For Collaborative Teams
Banerjee, B., & Taylor, M. E. (2020) · Aquila Digital Community (University of Southern Mississippi) · Cited by 2
Robust and Incremental Robot Learning by Imitation.
Capobianco, R. (2014) · Cited by 1
Learning Options From Demonstrations: A Pac-Man Case Study
Tamassia, M., Zambetta, F., Raffe, W. L., Mueller, F., & (181281), X. L. (2024) · Figshare · Cited by 1
Research works printed but not linked: 17
- Abel, D., Salvatier, J., Stuhlmüller, A., & Evans, O. (2016). Agent-Agnostic Human-in- the-Loop Reinforcement Learning. In Proceedings of the NIPS Future of Interactive Learning Machines Workshop.
- Barto, A. G., Thomas, P. S., & Sutton, R. S. (2017). Some Recent Applications of Re- inforcement Learning. In Proceedings of the 18th Yale Workshop on Adaptive and Learning Systems.
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W. (2016). OpenAI Gym. CoRR, abs/1606.01540. · arXiv
- Castaneda, A. O. (2016). Deep Reinforcement Learning Variants of Multi-Agent Learning Algorithms. Ph.D. thesis, University of Edinburgh.
- Diuk, C. (2009). An Object-Oriented Representation for Efficient Reinforcement Learning. Ph.D. thesis, Rutgers University.
- Du, Y., de la Cruz, G. V., Irwin, J., & Taylor, M. E. (2016). Initial Progress in Transfer for Deep Reinforcement Learning Algorithms. In Proceedings of Deep Reinforcement Learning: Frontiers and Challenges Workshop at IJCAI.
- Fitzgerald, T., Bullard, K., Thomaz, A., & Goel, A. (2016). Situated Mapping for Transfer Learning. In Proceedings of the 4th Annual Conference on Advances in Cognitive Systems, pp. 1-14.
- PMLR.
- Isele, D., Rostami, M., & Eaton, E. (2016). Using Task Features for Zero-Shot Knowl- edge Transfer in Lifelong Learning. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), pp. 1620-1626.
- Judah, K., Fern, A. P., Dietterich, T. G., & Tadepalii, P. (2014). Active Imitation Learning: Formal and Practical Reductions to I.I.D. Learning. Journal of Machine Learning Research (JMLR), 15 (1), 3925-3963.
- Kelly, S., & Heywood, M. I. (2015). Knowledge Transfer from Keepaway Soccer to Half- Field Offense through Program Symbiosis: Building Simple Programs for a Complex Task. In Proceedings of the 17th Conference on Genetic and Evolutionary Computation (GECCO), pp. 1143-1150. ACM.
- Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2016b). An Empirical Study of Non-expert Curriculum Design for Machine Learners. In Proceedings of the IJCAI Interactive Machine Learning Workshop.
- Perico, D. H., & Bianchi, R. A. C. (2013). Use of Heuristics from Demonstrations to Speed Up Reinforcement Learning. In Proceedings of the 12th Brazilian Symposium on Intelligent Automation (SBAI).
- Ramakrishnan, R., Narasimhan, K., & Shah, J. (2016). Interpretable Transfer for Reinforce- ment Learning based on Object Similarities. In Proceedings of the IJCAI Interactive Machine Learning Workshop.
- Schaal, S. (1997). Learning from Demonstration. In Advances in Neural Information Pro- cessing Systems (NIPS), pp. 1040-1046.
- Silva, F. L. D., & Costa, A. H. R. (2017b). Towards Zero-Shot Autonomous Inter-Task Map- ping through Object-Oriented Task Description. In Proceedings of the 1st Workshop on Transfer in Reinforcement Learning (TiRL).
- Watkins, C. J., & Dayan, P. (1992). Q-Learning. Machine Learning, 8 (3), 279-292.
Cited by
Sorted by citations
Cellpose 2.0: how to train your own model
Pachitariu, M., & Stringer, C. (2022) · Nature Methods · doi:10.1038/s41592-022-01663-4 · Cited by 1,381
Multi-agent deep reinforcement learning: a survey
Gronauer, S., & Diepold, K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09996-w · Cited by 957
A survey and critique of multiagent deep reinforcement learning
Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 799
Xu, Z., & Saleh, J. H. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107530 · Cited by 543
A review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 683
Metadata
- Authors
- Silva, F. L. D., & Costa, A. H. R.
- Affiliations
- Universidade de São Paulo (BR)
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2019-03-11
- Volume
- 64
- Pages
- 645-703
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2921955147
- Cited by
- 273
- References
- 170
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 38 · 2023: 43 · 2022: 40 · 2021: 56 · 2020: 34 · 2019: 10
- FWCI
- 15.97
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Journal of Artificial Intelligence Research (publishedVersion, cc-by)
- Funders
- University of Texas at Austin
- Fundação de Amparo à Pesquisa do Estado de São Paulo (16/21047-3, 2015/, 2015/16310-4, 2018/00344-5)
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (425860/2016-7, 307027/2017-1, 2017-1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Keywords
- multi-agent reinforcement learning, transfer learning, knowledge reuse, multi-agent systems, sample complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review