A Survey on Transfer Learning for Multiagent Reinforcement Learning Systems
Open accessAbstract
Multiagent Reinforcement Learning (RL) solves complex tasks that require coordination with other agents through autonomous exploration of the environment. However, learning a complex task from scratch is impractical due to the huge sample complexity of RL algorithms. For this reason, reusing knowledge that can come from previous experience or other agents is indispensable to scale up multiagent RL algorithms. This survey provides a unifying view of the literature on knowledge reuse in multiagent RL. We define a taxonomy of solutions for the general knowledge reuse problem, providing a comprehensive discussion of recent progress on knowledge reuse in Multiagent Systems (MAS) and of techniques for knowledge reuse across agents (that may be actuating in a shared environment or not). We aim at encouraging the community to work towards reusing all the knowledge sources available in a MAS. For that, we provide an in-depth discussion of current lines of research and open questions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The pretraining approach has been successful for various machine vision problems.
“The pretraining approach has been successful for various machine vision problems28–30.”
From Cellpose 2.0: how to train your own model (2022) · cites this paper as [29]
Section 5.8 describes pre-training a deep network from demonstrations for reinforcement learning, but does not address success across machine-vision problems. Section 6.3 discusses image-derived features in video games, not the success of pretraining for machine vision. Searches for pre-training in machine vision and pretrained networks in computer vision found no passage establishing the claim; page numbers were unavailable in our copy. (LLM, conf=0.74)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · see citing works
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · see citing works
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · see citing works
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037 · see citing works
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · see citing works
Markov Games as a Framework for Multi-Agent Reinforcement Learning
Littman, M. L. (1994) · International Conference on Machine Learning · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 3,406 · see citing works
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377 · see citing works
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. P. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,269 · see citing works
A survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227 · see citing works
Reinforcement learning in robotics: A survey
Kober, J., Bagnell, J. A., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913495721 · Cited by 3,160 · see citing works
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235 · see citing works
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Baxter, L. A., & Puterman, M. L. (1995) · Technometrics · doi:10.2307/1269932 · Cited by 1,889 · see citing works
Multi-Agent Reinforcement Learning: Independent vs. Cooperative Agents
Tan, M. (1993) · Elsevier eBooks · doi:10.1016/b978-1-55860-307-3.50049-6 · Cited by 1,860 · see citing works
Borko, H., & Putnam, R. T. (1996) · Cited by 1,655 · see citing works
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618 · see citing works
Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping
Ng, A. Y., Harada, D., & Russell, S. (1999) · Cited by 1,586 · see citing works
Transfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,521 · see citing works
Learning Multiagent Communication with BackpropagationPreprint
Sukhbaatar, S., Szlam, A., & Fergus, R. (2016) · Neural Information Processing Systems · doi:10.48550/arxiv.1605.07736 · Cited by 1,479 · see citing works
Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Dietterich, T. G. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.639 · Cited by 1,464 · see citing works
Cooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237 · see citing works
Multiagent systems: A survey from a machine learning perspective
Stone, P., & Veloso, M. (2000) · Autonomous Robots · doi:10.1023/a:1008942012299 · Cited by 1,218 · see citing works
Learning to Communicate with Deep Multi-Agent Reinforcement Learning
Foerster, J. N., Assael, Y. M., de Freitas, N., & Whiteson, S. (2016) · arXiv · doi:10.48550/arxiv.1605.06676 · Cited by 1,217 · see citing works
Cooperative Multi-agent Control Using Deep Reinforcement Learning
Gupta, J. K., Egorov, M., & Kochenderfer, M. J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71682-4_5 · Cited by 926 · see citing works
Nash Q-Learning for General-Sum Stochastic Games
Hu, J., Wellman, M. P., & Boutilier, C. (2003) · Cited by 909 · see citing works
Interactively shaping agents via human reinforcement: the TAMER framework
Knox, W. B., & Stone, P. (2009) · International Conference on Knowledge Capture · doi:10.1145/1597735.1597738 · Cited by 601 · see citing works
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Puterman, M. L. (2005) · Cited by 588 · see citing works
Thrun, S., & Mitchell, T. M. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00004-y · Cited by 523 · see citing works
Bayesian Inverse Reinforcement Learning
Krishnamurthy, V. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009449441.027 · Cited by 443 · see citing works
RoboCup: A Challenge Problem for AI
(1997) · AI Magazine · doi:10.1609/aimag.v18i1.1276 · Cited by 425 · see citing works
Autonomous agents modelling other agents: A comprehensive survey and open problems
Albrecht, S. V., & Stone, P. (2018) · Artificial Intelligence · doi:10.1016/j.artint.2018.01.002 · Cited by 417 · see citing works
Sammut, C., & Webb, G. I. (2010) · Encyclopedia of Machine Learning · doi:10.1007/978-0-387-30164-8_447 · Cited by 400 · see citing works
An Algorithm for Distributed Reinforcement Learning in Cooperative Multi-Agent Systems
Lauer, M., & Riedmiller, M. (2000) · Cited by 395 · see citing works
Reinforcement Learning for RoboCup Soccer Keepaway
STONE, P. R., Sutton, R. S., & Kuhlmann, G. (2005) · Adaptive Behavior · doi:10.1177/105971230501300301 · Cited by 388 · see citing works
Reinforcement learning improves behaviour from evaluative feedback
Littman, M. L. (2015) · Nature · doi:10.1038/nature14540 · Cited by 371 · see citing works
Teacher–Student Curriculum Learning
Matiisen, T., Oliver, A., Cohen, T., & Schulman, J. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2934906 · Cited by 351 · see citing works
Learning modular neural network policies for multi-task and multi-robot transfer
Devin, C., Gupta, A., Darrell, T., Abbeel, P., & Levine, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989250 · Cited by 324 · see citing works
Ad Hoc Autonomous Agent Teams: Collaboration without Pre-Coordination
Stone, P., Kaminka, G., Kraus, S., & Rosenschein, J. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7529 · Cited by 323 · see citing works
Policy Shaping: Integrating Human Feedback with Reinforcement Learning
Griffith, S., Subramanian, K. A., Scholz, J., Isbell, C. L., & Thomaz, A. L. (2013) · Cited by 307 · see citing works
Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial ObservabilityPreprint
Omidshafiei, S., Pazis, J., Amato, C., How, J. P., & Vian, J. L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.06182 · Cited by 289 · see citing works
Reverse Curriculum Generation for Reinforcement LearningPreprint
Florensa, C., Held, D., Wulfmeier, M., Zhang, M., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05300 · Cited by 277 · see citing works
Empirical evaluation methods for multiobjective reinforcement learning algorithms
Vamplew, P. W., Dazeley, R., Berry, A., Issabekov, R., & Dekker, E. (2010) · Machine Learning · doi:10.1007/s10994-010-5232-5 · Cited by 275 · see citing works
Probabilistic policy reuse in a reinforcement learning agent
Fernández, F., & Veloso, M. (2006) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1160633.1160762 · Cited by 274 · see citing works
Transfer in Reinforcement Learning: A Framework and a Survey
Lazaric, A. (2012) · Adaptation, learning, and optimization · doi:10.1007/978-3-642-27645-3_5 · Cited by 270 · see citing works
An object-oriented representation for efficient reinforcement learning
Diuk, C., Cohen, A., & Littman, M. L. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390187 · Cited by 226 · see citing works
Interactive Policy Learning through Confidence-Based Autonomy
Chernova, S., & Veloso, M. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2584 · Cited by 218 · see citing works
Learning with Opponent-Learning Awareness
Foerster, J., Chen, R. Y., Al-Shedivat, M., Whiteson, S., Abbeel, P., & Mordatch, I. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/hgwa8807 · Cited by 215 · see citing works
Learning Invariant Feature Spaces to Transfer Skills with Reinforcement LearningPreprint
Gupta, A., Devin, C., Liu, Y., Abbeel, P., & Levine, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02949 · Cited by 209 · see citing works
Multiagent Systems: A Survey from a Machine Learning Perspective
Stone, P., & Veloso, M. (1997) · doi:10.21236/ada333248 · Cited by 205 · see citing works
Informing sequential clinical decision-making through reinforcement learning: an empirical study
Shortreed, S. M., Laber, E. B., Lizotte, D. J., Stroup, T. S., Pineau, J., & Murphy, S. A. (2010) · Machine Learning · doi:10.1007/s10994-010-5229-0 · Cited by 196 · see citing works
Transfer Learning via Inter-Task Mappings for Temporal Difference Learning
Taylor, M. E., Stone, P., & Liu, Y. (2007) · doi:10.5555/1314498.1314569 · Cited by 196 · see citing works
A Survey of Learning in Multiagent Environments: Dealing with Non-StationarityPreprint
Hernández-Leal, P., Kaisers, M., Baarslag, T., & de Cote, E. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09183 · Cited by 187 · see citing works
Konidaris, G., & Barto, A. G. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143906 · Cited by 184 · see citing works
Accelerating Reinforcement Learning through Implicit Imitation
Price, B., & Boutilier, C. E. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.898 · Cited by 179 · see citing works
Reinforcement learning from demonstration through shaping
Brys, T., Harutyunyan, A., Suay, H. B., Chernova, S., Taylor, M. E., & Nowé, A. (2015) · Cited by 174 · see citing works
Confidence-based policy learning from demonstration using Gaussian mixture models
Chernova, S., & Veloso, M. (2007) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1329125.1329407 · Cited by 166 · see citing works
Interactive Learning from Policy-Dependent Human Feedback
MacGlashan, J., Ho, M. K., Loftin, R., Peng, B., Wang, G., Roberts, D., Taylor, M. E., & Littman, M. L. (2017) · arXiv · doi:10.48550/arxiv.1701.06049 · Cited by 163 · see citing works
Active Learning for Reward Estimation in Inverse Reinforcement Learning
Lopes, M. C., Melo, F. S., & Montesano, L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04174-7_3 · Cited by 158 · see citing works
Teaching on a budget: agents advising agents in reinforcement learning
Torrey, L. A., & Taylor, M. E. (2013) · doi:10.5555/2484920.2485086 · Cited by 149 · see citing works
Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play
Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A., & Fergus, R. (2017) · arXiv · doi:10.48550/arxiv.1703.05407 · Cited by 149 · see citing works
Principled methods for advising reinforcement learning agents
Wiewiora, E., Cottrell, G. W., & Elkan, C. (2003) · Cited by 147 · see citing works
Coordinated Multi-Agent Imitation LearningPreprint
Le, H. M., Yue, Y., Carr, P., & Lucey, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03121 · Cited by 130 · see citing works
An Analysis of Stochastic Game Theory for Multiagent Reinforcement Learning
Bowling, M., & Veloso, M. (2000) · Cited by 129 · see citing works
Knows what it knows: a framework for self-aware learning
Li, L. C., Littman, M. L., Walsh, T. J., & Strehl, A. L. (2010) · Machine Learning · doi:10.1007/s10994-010-5225-4 · Cited by 127 · see citing works
Hierarchical Apprenticeship Learning with Application to Quadruped Locomotion
Kolter, J. Z., Abbeel, P., & Ng, A. Y. (2007) · Cited by 122 · see citing works
A survey of inverse reinforcement learning techniques
Shao, Z., & Joo, E. M. (2012) · International Journal of Intelligent Computing and Cybernetics · doi:10.1108/17563781211255862 · Cited by 112 · see citing works
Interactive teaching strategies for agent training
Amir, O., Kamar, E. S., Kolobov, A., & Grosz, B. J. (2016) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 108 · see citing works
Kristian Kersting, B., van Otterlo, M., & Raedt, L. D. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015401 · Cited by 103 · see citing works
General game learning using knowledge transfer
Banerjee, B., & Stone, P. (2007) · Cited by 103 · see citing works
Thrun, S., & Mitchell, T. M. (1995) · Springer eBooks · doi:10.1007/978-3-642-79629-6_7 · Cited by 102 · see citing works
Simultaneously Learning and Advising in Multiagent Reinforcement Learning
da Silva, F. L., Glatt, R., & Costa, A. H. R. (2017) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/3091125.3091280 · Cited by 101 · see citing works
Self-citationCreating advice-taking reinforcement learners
Maclin, R., & SHAVLIK, J. W. (1996) · Machine Learning · doi:10.1007/bf00114730 · Cited by 99 · see citing works
RL-Glue: Language-Independent Software for Reinforcement-Learning Experiments
Tanner, B. K., & White, A. (2009) · Cited by 95 · see citing works
Decentralized MDPs with sparse interactions
Melo, F. S., & Veloso, M. (2011) · Artificial Intelligence · doi:10.1016/j.artint.2011.05.001 · Cited by 94 · see citing works
Autonomous Task Sequencing for Customized Curriculum Design in Reinforcement Learning
Narvekar, S., Sinapov, J., & Stone, P. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/353 · Cited by 93 · see citing works
Theoretical considerations of potential-based reward shaping for multi-agent systems
Devlin, S., & Kudenko⋆, D. (2011) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/vdid3904 · Cited by 93 · see citing works
Source Task Creation for Curriculum Learning
Narvekar, S., Sinapov, J., Leonetti, M., & Stone, P. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/wwrd6174 · Cited by 91 · see citing works
Multi-Agent System Development Based on Organizations
Argente, E., Julián, V., & Botti, V. J. (2006) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2006.03.005 · Cited by 86 · see citing works
A Case-based Reasoning Approach to Imitating RoboCup Players
Floyd, M. W., Esfandiari, B., & Lam, K. (2008) · Cited by 83 · see citing works
Learning From Explanations Using Sentiment and Advice in RL
Krening, S., Harrison, B. E., Feigh, K. M., Isbell, C. L., Riedl, M. O., & Thomaz, A. L. (2016) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2016.2628365 · Cited by 83 · see citing works
Multi-Agent Inverse Reinforcement Learning
Natarajan, S., Kunapuli, G., Judah, K., Tadepalli, P. V., Kristian Kersting, B., & SHAVLIK, J. W. (2010) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2010.65 · Cited by 83 · see citing works
Potential-based difference rewards for multiagent reinforcement learning
Devlin, S., Yliniemi, L., Kudenko⋆, D., & Tumer, K. (2014) · doi:10.5555/2615731.2615761 · Cited by 81 · see citing works
Improving action selection in MDP's via knowledge transfer
Sherstov, A. A., & Stone, P. (2005) · National Conference on Artificial Intelligence · Cited by 79 · see citing works
Grounded Action Transformation for Robot Learning in Simulation
Hanna, J. P., & Stone, P. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11044 · Cited by 79 · see citing works
Reinforcement learning agents providing advice in complex video games
Taylor, M. E., Carboni, N., Fachantidis, A., Vlahavas, I. P., & Torrey, L. A. (2014) · Connection Science · doi:10.1080/09540091.2014.885279 · Cited by 76 · see citing works
Heuristically-Accelerated Multiagent Reinforcement Learning
Bianchi, R. A. C., Martins, M. F., Ribeiro, C. H. C., & Costa, A. H. R. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2253094 · Cited by 76 · see citing works
Self-citationIntrinsic motivation and automatic curricula via asymmetric self-play
Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A. D., & Fergus, R. (2018) · International Conference on Learning Representations · Cited by 72 · see citing works
Multiagent Reinforcement Learning With Unshared Value Functions
Hu, Y., Gao, Y., & An, B. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2332042 · Cited by 70 · see citing works
Automatic Curriculum Graph Generation for Reinforcement Learning Agents
Svetlik, M., Leonetti, M., Sinapov, J., Shah, R., Walker, N., & Stone, P. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10933 · Cited by 70 · see citing works
Learning to Teach Reinforcement Learning Agents
Fachantidis, A., Taylor, M., & Vlahavas, I. (2017) · Machine Learning and Knowledge Extraction · doi:10.3390/make1010002 · Cited by 70 · see citing works
Cooperating with Unknown Teammates in Complex Domains: A Robot Soccer Case Study of Ad Hoc Teamwork
Barrett, S., & Stone, P. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9428 · Cited by 69 · see citing works
Reinforcement Learning Via Practice and Critique Advice
Judah, K., Roy, S., Fern, A., & Dietterich, T. G. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7690 · Cited by 69 · see citing works
Exploration from Demonstration for Interactive Reinforcement Learning
Subramanian, K. A., Isbell, C. L., & Thomaz, A. L. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2936924.2936990 · Cited by 68 · see citing works
Transferring knowledge as heuristics in reinforcement learning: A case-based approach
Bianchi, R. A. C., Junior, L. A. C., Santos, P. E., Matsuura, J. P., & de Mántaras, R. L. (2015) · Artificial Intelligence · doi:10.1016/j.artint.2015.05.008 · Cited by 67 · see citing works
Policy shaping with human teachers
Cederborg, T., Grover, I., Isbell, C. L., & Thomaz, A. L. (2015) · Cited by 66 · see citing works
Multiagent Inverse Reinforcement Learning for Two-Person Zero-Sum Games
Lin, X., Beling, P. A., & Cogill, R. (2017) · IEEE Transactions on Games · doi:10.1109/tciaig.2017.2679115 · Cited by 65 · see citing works
Transfer Learning in Multi-Agent Reinforcement Learning Domains
Boutsioukis, G., Partalas, I., & Vlahavas, I. P. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29946-9_25 · Cited by 64 · see citing works
Learning multi-agent state space representations
Hauwere, Y.-M. D., Vrancx, P., & Nowé, A. (2010) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/1838206.1838301 · Cited by 64 · see citing works
Half Field Offense: An Environment for Multiagent Learning and Ad Hoc Teamwork
Stone, M. H. A. P. (2016) · Cited by 63 · see citing works
Active Reward Learning from Critiques
Cui, Y., & Niekum, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460854 · Cited by 63 · see citing works
Policy Transfer using Reward Shaping
Brys, T., Harutyunyan, A., Taylor, M. E., & Nowé, A. (2015) · doi:10.5555/2772879.2772905 · Cited by 62 · see citing works
Learning from Demonstration for Shaping through Inverse Reinforcement Learning
Suay, H. B., Brys, T., Taylor, M. E., & Chernova, S. (2016) · VUBIR (Vrije Universiteit Brussel) · doi:10.5555/2936924.2936988 · Cited by 62 · see citing works
Transfer of Experience Between Reinforcement Learning Environments with Progressive Difficulty
Madden, M. G., & Howley, T. (2004) · Artificial Intelligence Review · doi:10.1023/b:aire.0000036264.95672.64 · Cited by 58 · see citing works
Multiagent Reinforcement Learning With Sparse Interactions by Negotiation and Knowledge Transfer
Zhou, L., Yang, P., Chen, C., & Gao, Y. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2543238 · Cited by 55 · see citing works
Implicit Imitation in Multiagent Reinforcement Learning
Price, B., & Boutilier, C. E. (1999) · Cited by 54 · see citing works
Learning to Predict Consequences as a Method of Knowledge Transfer in Reinforcement Learning
Chalmers, E., Bermudez-Contreras, E. J., Robertson, B., Luczak, A., & Gruber, A. J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2690910 · Cited by 53 · see citing works
Accelerating Multiagent Reinforcement Learning by Equilibrium Transfer
Hu, Y., Gao, Y., & An, B. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2349152 · Cited by 50 · see citing works
Teacher-Student Framework: a Reinforcement Learning Approach
Zimmer, M., Viappiani, P., & Weng, P. (2014) · HAL · Cited by 50 · see citing works
Accelerating Learning in multi-objective systems through Transfer Learning
Taylor, A., Dusparić, I., Galván, E., Clarke, S., & Cahill, V. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889438 · Cited by 48 · see citing works
Improving Reinforcement Learning by Using Case Based Heuristics
Bianchi, R. A. C., Ros, R., & de Mántaras, R. L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02998-1_7 · Cited by 47 · see citing works
Multi-thresholded approach to demonstration selection for interactive robot learning
Chernova, S., & Veloso, M. (2008) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/1349822.1349852 · Cited by 46 · see citing works
Stochastic Abstract Policies: Generalizing Knowledge to Improve Reinforcement Learning
Koga, M. L., Freire, V., & Costa, A. H. R. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2319733 · Cited by 42 · see citing works
Self-citationDistributed W-Learning: Multi-Policy Optimization in Self-Organizing Systems
Dusparić, I., & Cahill, V. (2009) · IEEE International Conference on Self-Adaptive and Self-Organizing Systems (SASO) · doi:10.1109/saso.2009.23 · Cited by 41 · see citing works
MOO-MDP: An Object-Oriented Representation for Cooperative Multiagent Reinforcement Learning
da Silva, F. L., Glatt, R., & Costa, A. H. R. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2781130 · Cited by 40 · see citing works
Self-citationWhere to Add Actions in Human-in-the-Loop Reinforcement Learning
Mandel, T., Liu, Y.-E., Brunskill, E., & Popović, Z. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10945 · Cited by 39 · see citing works
Improving Reinforcement Learning with Confidence-Based Demonstrations
Wang, Z., & Taylor, M. E. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/422 · Cited by 39 · see citing works
Autonomously Reusing Knowledge in Multiagent Reinforcement Learning
da Silva, F. L., Taylor, M. E., & Costa, A. H. R. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/774 · Cited by 39 · see citing works
Self-citationLeveraging Human Knowledge in Tabular Reinforcement Learning: A Study of Human Subjects
Rosenfeld, A., Cohen, M., Taylor, M. E., & Kraus, S. (2017) · The Knowledge Engineering Review · doi:10.1017/s0269888918000206 · Cited by 39 · see citing works
Towards Knowledge Transfer in Deep Reinforcement Learning
Glatt, R., da Silva, F. L., & Costa, A. H. R. (2016) · Brazilian Conference on Intelligent Systems · doi:10.1109/bracis.2016.027 · Cited by 38 · see citing works
Self-citationObject-Oriented Curriculum Generation for Reinforcement Learning
da Silva, F. L., & Costa, A. H. R. (2018) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/insi6337 · Cited by 37 · see citing works
Self-citationRL-Glue: Language-Independent Software for Reinforcement-Learning Experiments
TannerBrian, & WhiteAdam (2009) · Journal of Machine Learning Research · doi:10.5555/1577069.1755857 · Cited by 35 · see citing works
A Need for Speed: Adapting Agent Action Speed to Improve Task Learning from Non-Expert Humans
Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2016) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2936924.2937065 · Cited by 35 · see citing works
Zhan, Y., Ammar, H. B., & Taylor, M. E. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.03986 · Cited by 34 · see citing works
Efficiently detecting switches against non-stationary opponents
Hernández-Leal, P., Zhan, Y., Taylor, M. E., Sucar, L. E., & de Cote, E. M. (2016) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-016-9352-6 · Cited by 33 · see citing works
Inverse reinforcement learning for decentralized non-cooperative multiagent systems
Reddy, T. S., Gopikrishna, V., Zaruba, G. V., & Huber, M. (2012) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2012.6378020 · Cited by 32 · see citing works
Active Imitation Learning via Reduction to I.I.D. Active LearningPreprint
Judah, K., Fern, A., & Dietterich, T. G. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1210.4876 · Cited by 32 · see citing works
(2012) · Harvard University Press eBooks · doi:10.2307/j.ctt2jbq07.6 · Cited by 32 · see citing works
Transfer learning in multi-agent systems through parallel transfer
Taylor, A., Duparic, I., Galván, E., Clarke, S., & Cahill, V. (2013) · University of Limerick Institutional Repository (University of Limerick) · doi:10.34961/1016 · Cited by 31 · see citing works
Shon, A. P., Verma, D. K., & Rao, R. P. N. (2007) · Cited by 28 · see citing works
Learning Inter-Task Transferability in the Absence of Target Task Samples
Sinapov, J., Narvekar, S., Leonetti, M., & Stone, P. (2015) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/xmcc3729 · Cited by 28 · see citing works
Towards a Fast Detection of Opponents in Repeated Stochastic Games
Hernández-Leal, P., & Kaisers, M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71682-4_15 · Cited by 26 · see citing works
Pre-training Neural Networks with Human Demonstrations for Deep Reinforcement LearningPreprint
Cruz, G., Du, Y., & Taylor, M. E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.04083 · Cited by 26 · see citing works
Grounded Action Transformation for Robot Learning in Simulation
Hanna, J. P., & STONE, P. R. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11124 · Cited by 25 · see citing works
Object focused q-learning for autonomous agents
Cobo, L. C., Isbell, C. L., & Thomaz, A. L. (2013) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/sibo5381 · Cited by 25 · see citing works
Learning to Teach in Cooperative Multiagent Reinforcement Learning
Omidshafiei, S., Kim, D.-K., Liu, M., Tesauro, G. J., Riemer, M., Amato, C., Campbell, M. S., & How, J. P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016128 · Cited by 23 · see citing works
Learning in Multi-agent Systems with Sparse Interactions by Knowledge Transfer and Game Abstraction
Hu, Y., Gao, Y., & An, B. (2015) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2772879.2773250 · Cited by 19 · see citing works
TRANSFER LEARNING FOR MULTI-AGENT COORDINATION
Vrancx, P., Hauwere, Y.-M. D., & Nowé, A. (2011) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0003185602630272 · Cited by 18 · see citing works
Multi-agent Behavior-Based Policy Transfer
Didi, S., & Nitschke, G. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31153-1_13 · Cited by 17 · see citing works
Transfer Learning Method Using Ontology for Heterogeneous Multi-agent Reinforcement Learning
Kono, H., Kamimura, A., Tomita, K., Murata, Y., & SUZUKI, T. (2014) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2014.051022 · Cited by 17 · see citing works
Multi-agent Relational Reinforcement Learning
Croonenborghs, T., Tuyls, K., Ramon, J., & Bruynooghe, M. (2006) · Lecture notes in computer science · doi:10.1007/11691839_12 · Cited by 16 · see citing works
Blending Autonomous Exploration and Apprenticeship Learning
Walsh, T. J., Hewlett, D., & Morrison, C. T. (2011) · Cited by 13 · see citing works
Autonomous Shaping: Knowledge Transfer in Reinforcement Learning
Konidaris, G., & Barto, A. G. (2006) · Cited by 13 · see citing works
Transfer learning by prototype generation in continuous spaces
de Cote, E. M., Garcia, E., & Morales, E. F. (2016) · Adaptive Behavior · doi:10.1177/1059712316664570 · Cited by 12 · see citing works
Transferring knowledge from human-demonstration trajectories to reinforcement learning
Wang, G., Fang, Z., Ping, L., & Li, B. (2016) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331216649655 · Cited by 12 · see citing works
Creating Advice-Taking Reinforcement Learners
Maclin, R., & SHAVLIK, J. W. (1998) · Springer eBooks · doi:10.1007/978-1-4615-5529-2_13 · Cited by 12 · see citing works
Speeding-up reinforcement learning through abstraction and transfer learning
Koga, M. L., Freire, V., Cozman, F. G., & Costa, A. H. R. (2013) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/otnn9968 · Cited by 11 · see citing works
Self-citationAccelerating Multiagent Reinforcement Learning through Transfer Learning
da Silva, F., & Costa, A. H. R. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10518 · Cited by 11 · see citing works
Self-citationBeyond Reinforcement Learning and Local View in Multiagent Systems
Bazzan, A. L. C. (2014) · Künstliche Intell. · doi:10.1007/s13218-014-0312-5 · Cited by 10 · see citing works
Object-model transfer in the general video game domain
Braylan, A. (2019) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.26153/tsw/3139 · Cited by 9 · see citing works
Learning Options From Demonstrations: A Pac-Man Case Study
Tamassia, M., Zambetta, F., Raffe, W. L., Mueller, F., & Li, X. (2017) · IEEE Transactions on Games · doi:10.1109/tciaig.2017.2658659 · Cited by 8 · see citing works
HogRider: Champion Agent of Microsoft Malmo Collaborative AI Challenge
Xiong, Y., Chen, H., Zhao, M., & An, B. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11581 · Cited by 8 · see citing works
Multiagent Transfer Learning via Assignment-Based Decomposition
Proper, S., & Tadepalli, P. V. (2009) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2009.59 · Cited by 7 · see citing works
Coco-Q: Learning in Stochastic Games with Side Payments
Sodomka, E., Hilliard, E., Littman, M. L., & Greenwald, A. (2013) · Cited by 5 · see citing works
Object-Model Transfer in the General Video Game Domain
Braylan, A., & Miikkulainen, R. P. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · doi:10.1609/aiide.v12i1.12870 · Cited by 5 · see citing works
Comparative Analysis of Abstract Policies to Transfer Learning in Robotics Navigation.
Freire, V., & Costa, A. H. R. (2015) · National Conference on Artificial Intelligence · Cited by 4 · see citing works
Self-citationLearning through Imitation and Reinforcement Learning: Toward the Acquisition of Painting Motions
Sakato, T., Ozeki, M., & Oka, N. (2014) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai.2014.174 · Cited by 3 · see citing works
Coordination Confidence Based Human-Multi-Agent Transfer Learning For Collaborative Teams
Banerjee, B., & Taylor, M. E. (2020) · Aquila Digital Community (University of Southern Mississippi) · Cited by 2 · see citing works
Robust and Incremental Robot Learning by Imitation.
Capobianco, R. (2014) · Cited by 1 · see citing works
Learning Options From Demonstrations: A Pac-Man Case Study
Tamassia, M., Zambetta, F., Raffe, W. L., Mueller, F., & (181281), X. L. (2024) · Figshare · Cited by 1 · see citing works
Flagged first, then by citations
11 of the 170 references couldn’t be matched to a known paper.
Research works printed but not linked: 17
- Abel, D., Salvatier, J., Stuhlmüller, A., & Evans, O. (2016). Agent-Agnostic Human-in- the-Loop Reinforcement Learning. In Proceedings of the NIPS Future of Interactive Learning Machines Workshop.
- Barto, A. G., Thomas, P. S., & Sutton, R. S. (2017). Some Recent Applications of Re- inforcement Learning. In Proceedings of the 18th Yale Workshop on Adaptive and Learning Systems.
- Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W. (2016). OpenAI Gym. CoRR, abs/1606.01540. · arXiv
- Castaneda, A. O. (2016). Deep Reinforcement Learning Variants of Multi-Agent Learning Algorithms. Ph.D. thesis, University of Edinburgh.
- Diuk, C. (2009). An Object-Oriented Representation for Efficient Reinforcement Learning. Ph.D. thesis, Rutgers University.
- Du, Y., de la Cruz, G. V., Irwin, J., & Taylor, M. E. (2016). Initial Progress in Transfer for Deep Reinforcement Learning Algorithms. In Proceedings of Deep Reinforcement Learning: Frontiers and Challenges Workshop at IJCAI.
- Fitzgerald, T., Bullard, K., Thomaz, A., & Goel, A. (2016). Situated Mapping for Transfer Learning. In Proceedings of the 4th Annual Conference on Advances in Cognitive Systems, pp. 1-14.
- PMLR.
- Isele, D., Rostami, M., & Eaton, E. (2016). Using Task Features for Zero-Shot Knowl- edge Transfer in Lifelong Learning. In Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), pp. 1620-1626.
- Judah, K., Fern, A. P., Dietterich, T. G., & Tadepalii, P. (2014). Active Imitation Learning: Formal and Practical Reductions to I.I.D. Learning. Journal of Machine Learning Research (JMLR), 15 (1), 3925-3963.
- Kelly, S., & Heywood, M. I. (2015). Knowledge Transfer from Keepaway Soccer to Half- Field Offense through Program Symbiosis: Building Simple Programs for a Complex Task. In Proceedings of the 17th Conference on Genetic and Evolutionary Computation (GECCO), pp. 1143-1150. ACM.
- Peng, B., MacGlashan, J., Loftin, R., Littman, M. L., Roberts, D. L., & Taylor, M. E. (2016b). An Empirical Study of Non-expert Curriculum Design for Machine Learners. In Proceedings of the IJCAI Interactive Machine Learning Workshop.
- Perico, D. H., & Bianchi, R. A. C. (2013). Use of Heuristics from Demonstrations to Speed Up Reinforcement Learning. In Proceedings of the 12th Brazilian Symposium on Intelligent Automation (SBAI).
- Ramakrishnan, R., Narasimhan, K., & Shah, J. (2016). Interpretable Transfer for Reinforce- ment Learning based on Object Similarities. In Proceedings of the IJCAI Interactive Machine Learning Workshop.
- Schaal, S. (1997). Learning from Demonstration. In Advances in Neural Information Pro- cessing Systems (NIPS), pp. 1040-1046.
- Silva, F. L. D., & Costa, A. H. R. (2017b). Towards Zero-Shot Autonomous Inter-Task Map- ping through Object-Oriented Task Description. In Proceedings of the 1st Workshop on Transfer in Reinforcement Learning (TiRL).
- Watkins, C. J., & Dayan, P. (1992). Q-Learning. Machine Learning, 8 (3), 279-292.
Cited by
Sorted by citations
Cellpose 2.0: how to train your own model
Pachitariu, M., & Stringer, C. (2022) · Nature Methods · doi:10.1038/s41592-022-01663-4 · Cited by 1,381 · see citing works
Multi-agent deep reinforcement learning: a survey
Gronauer, S., & Diepold, K. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09996-w · Cited by 957 · see citing works
A survey and critique of multiagent deep reinforcement learning
Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 747 · see citing works
Xu, Z., & Saleh, J. H. (2021) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.107530 · Cited by 521 · see citing works
A review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 607 · see citing works
Zhang, W., Deng, L., Zhang, L., & Wu, D. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.106004 · Cited by 457 · see citing works
Intelligent Computing: The Latest Advances, Challenges, and Future
Zhu, S., Yu, T., Xu, T., Chen, H., Dustdar, S., Gigan, S., Gündüz, D., Hossain, E., Jin, Y., Lin, F., et al. (2023) · Intelligent Computing · doi:10.34133/icomputing.0006 · Cited by 319 · see citing works
An overview of machine learning applications for smart buildings
Alanne, K., & Sierla, S. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103445 · Cited by 282 · see citing works
Du, W., & Ding, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09938-y · Cited by 278 · see citing works
Rezaee, K., Rezakhani, S. M., Khosravi, M. R., & Moghimi, M. K. (2021) · Personal and Ubiquitous Computing · doi:10.1007/s00779-021-01586-5 · Cited by 210 · see citing works
Deep multiagent reinforcement learning: challenges and directions
Wong, A., Bäck, T., Kononova, A. V., & Plaat, A. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10299-x · Cited by 201 · see citing works
More Than Privacy: Applying Differential Privacy in Key Areas of Artificial Intelligence
Zhu, T., Ye, D., Wang, W., Zhou, W., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3014246 · Cited by 219 · see citing works
A survey on multi-agent reinforcement learning and its application
Ning, Z., & Xie, L.-H. (2024) · Journal of Automation and Intelligence · doi:10.1016/j.jai.2024.02.003 · Cited by 257 · see citing works
Tuchnitz, F., Ebell, N., Schlund, J., & Pruckner, M. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.116382 · Cited by 175 · see citing works
A Survey of Multi-Task Deep Reinforcement Learning
Varghese, N. V., & Mahmoud, Q. H. (2020) · Electronics · doi:10.3390/electronics9091363 · Cited by 159 · see citing works
Coordination of Electric Vehicle Charging Through Multiagent Reinforcement Learning
da Silva, F. L., Nishida, C. E. H., Roijers, D. M., & Costa, A. H. R. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2952331 · Cited by 149 · see citing works
Self-citationGame-Theoretic Multiagent Reinforcement LearningPreprint
Yang, Y., Ma, C., Ding, Z., McAleer, S., Jin, C., Wang, J., & Sandholm, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.00583 · Cited by 192 · see citing works
Can Emotion Be Transferred?—A Review on Transfer Learning for EEG-Based Emotion Recognition
Li, W., Huan, W., Hou, B., Tian, Y., Zhang, Z., & Song, A. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3098842 · Cited by 128 · see citing works
Coraci, D., Brandi, S., Hong, T., & Capozzoli, A. (2023) · Applied Energy · doi:10.1016/j.apenergy.2022.120598 · Cited by 108 · see citing works
Energy-Efficient Online Path Planning of Multiple Drones Using Reinforcement Learning
Hong, D., Lee, S., Cho, Y. H., Baek, D., Kim, J., & Chang, N. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3102589 · Cited by 105 · see citing works
Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey
Majid, A. Y., Majid, A. Y., Saaybi, S., van Rietbergen, T., François-Lavet, V., Prasad, R. R. V., & Verhoeven, C. J. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264540 · Cited by 108 · see citing works
A review of research on reinforcement learning algorithms for multi-agents
Hu, K., Li, M., Song, Z., Xu, K., Xia, Q., Sun, N., Zhou, P., & Xia, M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128068 · Cited by 113 · see citing works
Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines
Ruiz-Rodríguez, M. L., Sylvain Kubler, A., de Giorgio, A., Cordy, M., Robert, J., & Traon, Y. L. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2022.102406 · Cited by 105 · see citing works
Reinforcement Learning-Based Physical Cross-Layer Security and Privacy in 6G
Lu, X., Xiao, L., Li, P., Ji, X., Xu, C., Yu, S., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3224279 · Cited by 105 · see citing works
A Review of Safe Reinforcement Learning Methods for Modern Power Systems
Su, T., Wu, T., Zhao, J., Scaglione, A., & Xie, L. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3584656 · Cited by 91 · see citing works
On reliability of reinforcement learning based production scheduling systems: a comparative survey
de Puiseau, C. W., Meyes, R., & Meisen, T. (2022) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-01915-2 · Cited by 68 · see citing works
Analyzing Malaria Disease Using Effective Deep Learning Approach
Sriporn, K., Tsai, C.-F., Tsai, C.-E., & Wang, P. (2020) · Diagnostics · doi:10.3390/diagnostics10100744 · Cited by 72 · see citing works
Cichocki, A. S., & Kuleshov, A. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/8893795 · Cited by 71 · see citing works
Lateral Transfer Learning for Multiagent Reinforcement Learning
Shi, H., Li, J., Mao, J., & Hwang, K. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3108237 · Cited by 72 · see citing works
Xu, S., Wang, Y., Wang, Y., O’Neill, Z. D., & Zhu, Q. (2020) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3408308.3427617 · Cited by 70 · see citing works
Uncertainty-Aware Action Advising for Deep Reinforcement Learning Agents
Da Silva, F. L., Hernandez-Leal, P., Kartal, B., & Taylor, M. E. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6036 · Cited by 69 · see citing works
Self-citationRakhsha, A., Radanović, G., Devidze, R., Zhu, X., & Singla, A. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12909 · Cited by 68 · see citing works
Agents teaching agents: a survey on inter-agent transfer learning
da Silva, F. L., Warnell, G., Costa, A. H. R., & Stone, P. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09430-0 · Cited by 65 · see citing works
Self-citationCui, C., Yang, T., Dai, Y., Zhang, C., & Xu, Q. (2022) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2022.3192676 · Cited by 63 · see citing works
Tilahun, F. D., Abebe, A. T., & Kang, C. G. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3290954 · Cited by 57 · see citing works
Deep Reinforcement Learning: A State-of-the-Art Walkthrough
Lazaridis, A., Fachantidis, A., & Vlahavas, I. P. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12412 · Cited by 58 · see citing works
Is multiagent deep reinforcement learning the answer or the question? A brief surveyPreprint
Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2018) · arXiv (Cornell University) · Cited by 56 · see citing works
Transfer learning applied to DRL-Based heat pump control to leverage microgrid energy efficiency
Lissa, P., Schukat, M., Keane, M. M., & Barrett, E. (2021) · Smart Energy · doi:10.1016/j.segy.2021.100044 · Cited by 48 · see citing works
Analyzing Lung Disease Using Highly Effective Deep Learning Techniques
Sriporn, K., Tsai, C.-F., Tsai, C.-F., & Wang, P. (2020) · Healthcare · doi:10.3390/healthcare8020107 · Cited by 48 · see citing works
Educational Robotics and Robot Creativity: An Interdisciplinary Dialogue
Gubenko, A., Kirsch, C., Smilek, J. N., Lubart, T., & Houssemand, C. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.662030 · Cited by 55 · see citing works
Guo, W., Wang, Y., Chen, X., & Jiang, P. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02126-z · Cited by 46 · see citing works
Jawad, S., & Liu, J. (2020) · Energies · doi:10.3390/en13133371 · Cited by 46 · see citing works
Coraci, D., Brandi, S., Hong, T., & Capozzoli, A. (2024) · Building Simulation · doi:10.1007/s12273-024-1109-6 · Cited by 44 · see citing works
Scaling Up Multi-Agent Reinforcement Learning: An Extensive Survey on Scalability Issues
Liu, D., Ren, F., Yan, J. H., Su, G., Gu, W., & Kato, S. (2024) · IEEE Access · doi:10.1109/access.2024.3410318 · Cited by 46 · see citing works
UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with TransformersPreprint
Hu, S., Zhu, F., Chang, X., & Liang, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.08001 · Cited by 43 · see citing works
Spatharis, C., & Blekas, K. (2022) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2022.2109416 · Cited by 41 · see citing works
Future vehicles: interactive wheeled robots
Ma, N., Li, D., He, W., Deng, Y. C., Li, J., Gao, Y., Bao, H., Zhang, H., Xu, X., Liu, Y., et al. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3171-4 · Cited by 38 · see citing works
A Survey of Opponent Modeling in Adversarial Domains
Nashed, S. B., & Shlomo Zilberstein, B. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12889 · Cited by 38 · see citing works
jin, W., Du, H., Zhao, B., Tian, X., Shi, B., & Yang, G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5106265 · Cited by 55 · see citing works
Teaching on a Budget in Multi-Agent Deep Reinforcement Learning
İlhan, E., Gow, J., & Pérez-Liébana, D. (2019) · IEEE Conference on Games (CoG) · doi:10.1109/cig.2019.8847988 · Cited by 36 · see citing works
Low-power deep learning edge computing platform for resource constrained lightweight compact UAVs
Albanese, A., Nardello, M., & Brunelli, D. (2022) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2022.100725 · Cited by 38 · see citing works
The role of information structures in game-theoretic multi-agent learning
Li, T., Zhao, Y., & Zhu, Q. (2022) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2022.03.003 · Cited by 35 · see citing works
Agents Teaching Agents: A Survey on Inter-agent Transfer Learning
da Silva, F. L., Warnell, G., Costa, A. H. R., & Stone, P. (2020) · Texas Digital Library (University of Texas) · doi:10.26153/tsw/8400 · Cited by 34 · see citing works
Self-citationDifferential Advising in Multiagent Reinforcement Learning
Ye, D., Zhu, T., Cheng, Z., Zhou, W., & Yu, P. S. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3034424 · Cited by 31 · see citing works
A Survey of Adaptive Multi-Agent Networks and Their Applications in Smart Cities
Nezamoddini, N., & Gholami, A. (2022) · Smart Cities · doi:10.3390/smartcities5010019 · Cited by 30 · see citing works
Reinforcement learning and bandits for speech and language processing: Tutorial, review and outlook
Lin, B. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122254 · Cited by 28 · see citing works
Wang, T., Peng, X., Wang, T., Liu, T., & Xu, D. (2024) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2024.101475 · Cited by 27 · see citing works
MADRaS : Multi Agent Driving Simulator
Santara, A., Rudra, S., Buridi, S. A., Kaushik, M., Naik, A., Kaul, B., & Ravindran, B. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12531 · Cited by 27 · see citing works
Scalable Multi-Agent Reinforcement Learning for Dynamic Coordinated Multipoint Clustering
Hu, F., Deng, Y., & Aghvami, A. H. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3220870 · Cited by 27 · see citing works
Coraci, D., Silvestri, A., Razzano, G., Fop, D., Brandi, S., Borkowski, E., Hong, T., Schlueter, A., & Capozzoli, A. (2025) · Energy and Buildings · doi:10.1016/j.enbuild.2024.115254 · Cited by 26 · see citing works
Du, K.-L., Zhang, R., Jiang, B., Zeng, J., & Lu, J. (2025) · Mathematics · doi:10.3390/math13030451 · Cited by 28 · see citing works
Achieving Fast Environment Adaptation of DRL-Based Computation Offloading in Mobile Edge Computing
Hu, Z., Niu, J., Ren, T., & Guizani, M. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3320253 · Cited by 25 · see citing works
A conceptual framework for externally-influenced agents: an assisted reinforcement learning review
Bignold, A., Cruz, F., Taylor, M. E., Brys, T., Dazeley, R., Vamplew, P., & Foale, C. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03489-y · Cited by 24 · see citing works
Zhang, L., Zhu, T., Xiong, P., Zhou, W., & Yu, P. S. (2021) · ACM Computing Surveys · doi:10.1145/3460771 · Cited by 24 · see citing works
Sudha, S., & Suganya, S. S. (2023) · Measurement Sensors · doi:10.1016/j.measen.2023.100711 · Cited by 24 · see citing works
Knowledge Transfer for Cross-Domain Reinforcement Learning: A Systematic Review
Serrano, S. A., Martínez-Carranza, J., & Sucar, L. E. (2024) · IEEE Access · doi:10.1109/access.2024.3435558 · Cited by 24 · see citing works
Federated Reinforcement Learning Acceleration Method for Precise Control of Multiple Devices
Lim, H.-K., Kim, J.-B., Ullah, I., Heo, J.-S., & Han, Y. (2021) · IEEE Access · doi:10.1109/access.2021.3083087 · Cited by 23 · see citing works
Reinforcement Learning Control With Knowledge Shaping
Gao, X. H., Si, J., & Huang, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3243631 · Cited by 23 · see citing works
Zhang, Z., Hong, J., Enayati, A. M. S., & Najjaran, H. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3468770 · Cited by 21 · see citing works
Visual language integration: A survey and open challenges
Park, S., & Kim, Y. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100548 · Cited by 21 · see citing works
A Multiagent Cooperative Learning System With Evolution of Social Roles
Hou, Y., Sun, M., Zeng, Y., Ong, Y.-S., Jin, Y., Ge, H., & Zhang, Q. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3268076 · Cited by 21 · see citing works
An Efficient Transfer Learning Framework for Multiagent Reinforcement LearningPreprint
Yang, T., Wang, W., Tang, H., Hao, J., Meng, Z., Mao, H., Li, D., Liu, W., Zhang, C., Hu, Y., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08030 · Cited by 21 · see citing works
Guo, Z., Wu, Y., Wang, L., & Zhang, J. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3407760 · Cited by 20 · see citing works
Multi-agent Q-Learning control of spacecraft formation flying reconfiguration trajectories
Kankashvar, M., Bolandi, H., & Mozayani, N. (2022) · Advances in Space Research · doi:10.1016/j.asr.2022.09.034 · Cited by 20 · see citing works
KnowRU: Knowledge Reuse via Knowledge Distillation in Multi-Agent Reinforcement Learning
Gao, Z., Xu, K., Ding, B., & Wang, H. (2021) · Entropy · doi:10.3390/e23081043 · Cited by 19 · see citing works
Intelligent Computing: The Latest Advances, Challenges and Future
Zhu, S., Yu, T., Xu, T., Chen, H., Dustdar, S., Gigan, S., Gündüz, D., Hossain, E., Jin, Y., Lin, F., et al. (2022) · Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) · doi:10.48550/arxiv.2211.11281 · Cited by 19 · see citing works
Multi‐agent reinforcement learning via knowledge transfer with differentially private noise
Cheng, Z., Ye, D., Zhu, T., Zhou, W., Yu, P. S., & Zhu, C. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22648 · Cited by 19 · see citing works
Efficient Exploration for Multi-Agent Reinforcement Learning via Transferable Successor Features
Liu, W., Dong, L., Niu, D., & Sun, C. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105809 · Cited by 18 · see citing works
Model-Based Self-Advising for Multi-Agent Learning
Ye, D., Zhu, T., Zhu, C., Zhou, W., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3147221 · Cited by 18 · see citing works
Gao, S., Xu, Y., Zhang, Z., Wang, Z., Zhou, X., & Wang, J. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3541350 · Cited by 17 · see citing works
Deep Dense Network-Based Curriculum Reinforcement Learning for High-Speed Overtaking
Liu, J., Li, H., Yang, Z., Dang, S., & Huang, Z. (2022) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2022.3174410 · Cited by 17 · see citing works
Zhou, W. J., Zhang, C., & Chen, S. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04601-9 · Cited by 17 · see citing works
Experience classification for transfer learning in traffic signal control
Norouzi, M., Abdoos, M., & Bazzan, A. L. C. (2020) · The Journal of Supercomputing · doi:10.1007/s11227-020-03287-x · Cited by 17 · see citing works
An Optimization Framework for Task Sequencing in Curriculum Learning
Foglino, F., Christakou, C. C., & Leonetti, M. (2019) · IEEE International Conference on Development and Learning (ICDL) · doi:10.1109/devlrn.2019.8850690 · Cited by 17 · see citing works
Ghayvat, H., & Gope, P. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06139-8 · Cited by 16 · see citing works
Learning to Resolve Social Dilemmas: A Survey
Fatima, S. S., Jennings, N. R., & Wooldridge, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15167 · Cited by 16 · see citing works
Efficient Reinforcement Learning for StarCraft by Abstract Forward Models and Transfer Learning
Liu, R.-Z., Guo, H., Ji, X., Yu, Y., Pang, Z.-J., Xiao, Z., Wu, Y., & Lü, T. (2021) · IEEE Transactions on Games · doi:10.1109/tg.2021.3071162 · Cited by 19 · see citing works
Pedestrian Simulation with Reinforcement Learning: A Curriculum-Based Approach
Vizzari, G., & Cecconello, T. (2022) · Future Internet · doi:10.3390/fi15010012 · Cited by 15 · see citing works
A Review on Simulation Platforms for Agent-Based Modeling in Electrified Transportation
Harris, D., da Silva, F. L., Su, W., & Glatt, R. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3318928 · Cited by 15 · see citing works
Self-citationUPDeT: Universal Multi-agent RL via Policy Decoupling with Transformers
Hu, S., Zhu, F., Chang, X., & Liang, X. (2021) · International Conference on Learning Representations · Cited by 15 · see citing works
A conceptual framework for externally-influenced agents: an assisted reinforcement learning review
Bignold, A., Cruz, F., Taylor, M., Brys, T., Dazeley, R., Vamplew, P., & Foale, C. (2021) · Deakin Research Online (Deakin University) · Cited by 15 · see citing works
AutoTG: Reinforcement Learning-Based Symbolic Optimization for AI-Assisted Power Converter Design
da Silva, F. L., Glatt, R., Su, W., Bui, V., Chang, F., Chaturvedi, S., Wang, M., Murphey, Y. L., Huang, C., Xue, L. L., et al. (2023) · IEEE Journal of Emerging and Selected Topics in Industrial Electronics · doi:10.1109/jestie.2023.3303836 · Cited by 14 · see citing works
Self-citationThe utilization of different AI methods-based satellite communications: A survey
Abdulwahid, M. M., & Kurnaz, S. (2024) · AIP conference proceedings · doi:10.1063/5.0192068 · Cited by 14 · see citing works
Periocular Biometrics in Head-Mounted Displays: A Sample Selection Approach for Better Recognition
Boutros, F., Damer, N., Raja, K. B., Ramachandra, R., Kirchbuchner, F., & Kuijper, A. (2020) · International Workshop on Biometrics and Forensics (IWBF) · doi:10.1109/iwbf49977.2020.9107939 · Cited by 14 · see citing works
Towards Automatic Facility Layout Design Using Reinforcement Learning
Ikeda, H., Nakagawa, H., & Tsuchiya, T. (2022) · Annals of Computer Science and Information Systems · doi:10.15439/2022f25 · Cited by 13 · see citing works
Explainable Action Advising for Multi-Agent Reinforcement Learning
Guo, Y., Campbell, J., Stepputtis, S., Li, R., Hughes, D., Fang, F., & Sycara, K. P. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160557 · Cited by 12 · see citing works
Resource-Constrained Multisource Instance-Based Transfer Learning
Askarizadeh, M., Morsali, A., & Nguyen, K. K. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3327248 · Cited by 12 · see citing works
Sahraoui, M., Bilami, A., & Ahmed, A. T. (2021) · Wireless Personal Communications · doi:10.1007/s11277-021-09094-8 · Cited by 12 · see citing works
Behavior Reasoning for Opponent Agents in Multi-Agent Learning Systems
Hou, Y., Sun, M., Zhu, W., Zeng, Y., Piao, H., Chen, X., & Zhang, Q. (2022) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2022.3147011 · Cited by 12 · see citing works
Cooperative Multi-Agent Transfer Learning with Level-Adaptive Credit AssignmentPreprint
Zhou, T., Zhang, F., Shao, K., Li, K., Huang, W., Luo, J., Wang, W., Yang, Y., Mao, H., Wang, B., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.00517 · Cited by 12 · see citing works
- Authors
- Silva, F. L. D., & Costa, A. H. R.
- Affiliations
- Universidade de São Paulo (BR)
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2019-03-11
- Volume
- 64
- Pages
- 645-703
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2921955147
- Cited by
- 273
- References
- 170
- Citations by year
- 2026: 18 · 2025: 33 · 2024: 38 · 2023: 43 · 2022: 40 · 2021: 56 · 2020: 34 · 2019: 10 · 2018: 1
- FWCI
- 15.97
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Journal of Artificial Intelligence Research (publishedVersion, cc-by)
- Funders
- University of Texas at Austin
- Fundação de Amparo à Pesquisa do Estado de São Paulo (16/21047-3, 2015/, 2015/16310-4, 2018/00344-5)
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (425860/2016-7, 307027/2017-1, 2017-1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
- Keywords
- multi-agent reinforcement learning, transfer learning, knowledge reuse, multi-agent systems, sample complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review