The DOI matches its Crossref record, with a small difference in title or year; 194 of the 194 references it cites were found in a registry or an index.
Transfer Learning in Deep Reinforcement Learning: A Survey
Open accessAbstract
Reinforcement learning is a learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in reinforcement learning upon the fast development of deep neural networks. Along with the promising prospects of reinforcement learning in numerous domains such as robotics and game-playing, transfer learning has arisen to tackle various challenges faced by reinforcement learning, by transferring knowledge from external expertise to facilitate the efficiency and effectiveness of the learning process. In this survey, we systematically investigate the recent progress of transfer learning approaches in the context of deep reinforcement learning. Specifically, we provide a framework for categorizing the state-of-the-art transfer learning approaches, under which we analyze their goals, methodologies, compatible reinforcement learning backbones, and practical applications. We also draw connections between transfer learning and other relevant topics from the reinforcement learning perspective and explore their potential challenges that await future research progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Even though TL has been widely used in other supervised and unsupervised learning, employing TL can be more complicated for DRL since the knowledge needs to be transferred in the context of MDP [165].”
From Leveraging 3GPP Features and Optimization Techniques for 5G NR-V2X Resource Allocation: A Survey (2025) · cites this paper as [165]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Labaca-Castro, R. (2023) · Springer eBooks · doi:10.1007/978-3-658-40442-0_9 · Cited by 21,119
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
Badrinarayanan, V., Kendall, A., & Cipolla, R. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2644615 · Cited by 19,631
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Research works printed but not linked: 4
- gal, 2016, Improving PILCO with Bayesian neural network dynamics models, Proc Data-Efficient Mach Learn Workshop
- schaal, 1997, Learning from demonstration, Proc Int Conf Neural Inf Process, 1040
- 10.1126/science.153.3731.34 · DOI · Paper page
- finn, 2019, Meta-learning: From few-shot learning to rapid reinforcement learning, Proc Int Conf Mach Learn
Cited by
Sorted by citations
Items 801–865 of 865
Mouhiha, M., & Mabrouk, A. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-19963-8_6
Accelerated three-dimensional topology optimization via deep transfer reinforcement learning
Wang, M., Zhang, J., Li, E., Zhang, H., Wang, Z., Huang, X., Jiang, T., & Zhou, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.114974
Self-citationTang, X., Su, X., Luo, Y., & Zhang, L. (2026) · Energy and Buildings · doi:10.1016/j.enbuild.2026.118110
Autonomous Maneuver Decision‐Making for Unmanned Aerial Vehicles via Transfer Reinforcement Learning
Huang, Y., Long, Y., Cheng, Z., Shen, A., & Liu, M. H. (2026) · International Journal of Robust and Nonlinear Control · doi:10.1002/rnc.70586
Sun, X., Peng, C., Chu, F., Zeng, G., & Cao, Z. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134048
An Accurate Detection Method for Fruits and Vegetables in the Space Station Cargo Bay
Wenqin, L. I., Sui, T., ZHANG, Z., Huiying, W. U., & Liang, C. (2026) · Chinese Journal of Space Science · doi:10.11728/cjss2026.03.2025-0080
Alex, M., & Ojo, S. O. (2026) · Computers · doi:10.3390/computers15060339
Multi-source Adaptive Boosting for Encrypted Traffic Classification in Heterogeneous SDNs
Hoang, N.-T., Duong, C.-S., Nguyen, T., Tran, H.-A., & Tran, T. X. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-026-03155-9
He, Y., Romero-Cano, V., Patiño, J. J., Hernández, J. D., Sawtell, W., & Colombo, G. B. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38404-1_15
Learning-Based Resilient Dynamic Routing for Fault-Tolerant Robust LEO Satellite Networks
Kim, G. S., Im, C., Kim, Y. G., Ha, J., & Kim, J. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3701260
P2W: From Power Traces to Weights Matrix - An Unconventional Transfer Learning Approach
Siyadatzadeh, R., Mehrafrooz, F., Mentens, N., & Stefanov, T. P. (2026) · ACM Symposium on Applied Computing · doi:10.1145/3748522.3779939
Illi, C., & Elhassouny, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6928670
Safe Reinforcement Learning Control for Unmanned Surface Vessel
Yang, Y., Liu, C., Zhang, T., Hua, C., & Li, J. (2026) · Conference on Fully Actuated System Theory and Applications (FASTA) · doi:10.1109/fasta70174.2026.11548912
Qiu, X., Wang, H., Tan, X., Li, S., Xiong, Y.-J., & Fang, Z. (2026) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2026.3695671
Deep Reinforcement Learning for Engineering Project Management: A Systematic ReviewPreprint
Gawade, Y., & Nezamoddini, N. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6958926
Zhu, W., Cheng, M., Lu, Q., Zhao, Z., Cao, L., Luo, L., & He, Y. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3701446
Topology-Aware Distribution System State Estimation Using Bayesian Model-Agnostic Meta-Learning
Wang, T. R., Cheng, R., Liu, W. T., Heshi, W., Shi, Q., & Yu, N. (2026) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2026.3700844
Ravichandran, M., Sivasankaran, S., Sakthiyavathi, M., Jayasree, P., Kaviya, L., & Keerthana, R. (2026) · International Conference on Sustainable and Futuristic Technologies (ICSFT) · doi:10.1109/icsft67370.2026.11566106
More, K. S., Rangarajan, R., Esmaeili, A., Gouissem, A., & Benlamri, R. (2026) · Environmental Earth Sciences · doi:10.1007/s12665-026-13023-y
Research on Collision-Free Motion Planning Method of Citrus Picking Manipulator Based on A-SAC
Li, C. B., Wang, L. L., Chen, K., & Wang, B. (2026) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc69976.2026.11560835
Zhang, X., & Zhang, L. (2026) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-026-11455-z
Wu, C., Chen, Y., Dang, J., Mou, B., & Liu, Z. (2026) · Structures · doi:10.1016/j.istruc.2026.112508
Yu, J., Hu, Z., & Ma, W. (2026) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2026.105833
Experience replay in reinforcement learning: A systematic review
Amirabadi, R. K., Jalaeian-F., M., & Fard, O. S. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.134403 · Cited by 2
A surrogate-assisted multitask knowledge transfer optimization algorithm and application
Xiang, J., Dong, H., Li, J., Wang, W., Wang, S., Liu, G., & Wang, P. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116576
Satellite Constellation Scheduling with Quantum Reinforcement Learning
Kim, G. S., Chen, S. Y.-C., Park, S., & Kim, J. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7829-0_6
Gregurić, M., Ivanjko, E., Hlupić, N., & Čakija, D. (2026) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.1109/mipro70003.2026.11591972
Li, G., Chen, Y., Cai, J., Chen, H., Bai, X., & Cui, B. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3712137
LMM: A Reinforcement-Learning-Based Mitigation Mechanism of Lateral Movement in Kubernetes
Hung, C.-Y., Yang, L.-Y., & Chou, L. (2026) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2026.3713179
A Research Agenda for Usability and Generalisation in Reinforcement Learning
Soemers, D. J. N. J., Samothrakis, S., Driessens, K., & Winands, M. H. M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-25032-2_33
Multi-Agent Autonomous 6G Service Control With Intelligent Reconfiguration
Shakespear-Miles, H., Barzegar, S., Ruiz, M., & Velasco, L. (2026) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2026.3713972
Physics-Informed Ensemble Feature Transfer for Energy Prediction in Generalized Milling Process
Xie, Y., Dai, Y., Wang, F., & Zhang, C. (2026) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2026.3714746
SoK: Telemetry-Aware Runtime Assurance for Always-On On-device Intrusion Detection
Ouyang, N., Shatte, A. B. R., Lu, Z., Chen, C., & Xiang, W. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3018-1_7
Zang, W., Sun, W., Song, D., & Zhang, H. (2026) · Ocean Engineering · doi:10.1016/j.oceaneng.2026.127056
Heterogeneous transfer learning for robust infectious disease forecasting: A data-centric approach
Lee, D.-H. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133728
Sustainable Smart Farm Networks: A Decision Theory-Guided Deep Reinforcement Learning Approach
Chen, D., Wan, Z., Ha, D. S., Shin, S., & Cho, J.-H. (2026) · ACM Transactions on Cyber-Physical Systems · doi:10.1145/3834862
Intelligent Optimization of Deep Reinforcement Learning Control Algorithm for Flotation Process
Wang, S., Fan, S., Zhang, G., & Shi, Q. (2026) · Journal of Sustainable Metallurgy · doi:10.1007/s40831-026-01602-z
Abbas, Y., Akhtar, M. U., Chen, M., & Ahmad, I. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8755-0.ch015
Exponentially Scalable Quantum Reinforcement Learning for Large-Scale Network Scheduling
Kim, G. S., Roh, E. J., Park, S., & Kim, J. (2026) · IEEE Internet of Things Journal · doi:10.1109/jiot.2026.3717839
Data-driven optimization and rheology-guided machine learning of geopolymer direct ink writing
Huang, Z., Yan, W., Chen, W., Islam, S. A., Liu, F., Sun, Q., Lin, H., Kvan, T., & Hao, L. (2026) · Materials Today Communications · doi:10.2139/ssrn.7205852
Data-Driven Optimization and Rheology-Guided Machine Learning of Geopolymer Direct Ink WritingPreprint
Huang, Z., Yan, W., Chen, W., Islam, S. A., Liu, F., Sun, Q., Lin, H., Kvan, T., & Liang, H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7205854
Latent MeanFlow Policy Optimization for Offline Reinforcement Learning
Liu, T., Xu, X., Lan, Y., Huang, J., Zhang, X., & Zeng, L. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3720530 · Cited by 1
Saad, M., Zhao, R., Bai, J., & Zhong, X. (2026) · IEEE Access · doi:10.1109/access.2026.3725131
Li, R., Wang, Z., Wang, Y., & Sun, J. (2026) · Chaos Solitons & Fractals · doi:10.1016/j.chaos.2026.118984
Shokouhalaei, A. (2026) · Chemical Engineering Science · doi:10.1016/j.ces.2026.124975
Meta-Knowledge Extraction and Reuse: A Novel Approach for Transfer Reinforcement Learning
Tang, T., Ma, M., Chen, C. G., Yang, M., Zhang, W., & Lan, Y. (2026) · International Artificial Intelligence Technology Conference (AITC) · doi:10.1109/aitc70732.2026.11666562
Liu, C., Shi, X., Huo, J., Zhang, Y., Sun, Y., Ai, Z., Hu, H., & Liu, Z. (2026) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2026.105183
Li, Y., Chen, Y., Xie, G., & Xu, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38404-1_12
Fang, L., Liu, H., Tong, B., Zhao, Y., Gan, X., & He, C. (2026) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2026.113546
Data-driven preview Q-learning for H∞ tracking control of unknown linear discrete-time systems
Su, Y., Wang, D., Mib, X., & Sun, Y. (2026) · ISA Transactions · doi:10.1016/j.isatra.2026.09.025
Rahman, A., Khandakar, A., Ben‐Brahim, L., Serkan, Kiranyaz, & Muyeen, S. M. (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111523
Hayashida, T., Sekizaki, S., & Kato, N. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8090288
An offline-to-online training method for deep learning based communications over the air
Yu, Q., Duan, C., Yu, J., Liao, X., & Yang, S. (2026) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2026.111556
Ghamari, S. M., & Aziz, A. (2026) · Applied Soft Computing · doi:10.1016/j.asoc.2026.116270
A Task-Oriented Framework for Autonomous Robotic Disassembly and Reassembly in Remanufacturing
Zang, Y., Xu, X., Zhang, Y., Zhang, Z., Wang, F., & Tiwari, A. (2026) · IEEE International Conference on Automation Science and Engineering (CASE) · doi:10.1109/case69030.2026.11704383
Wang, J., Dang, X., Gong, D., Song, X., & Liu, Z. (2026) · Automated Software Engineering · doi:10.1007/s10515-026-00692-z
RFDF: recognition feature-driven fusion method via deep reinforcement learning for dual-modal video
Ji, L., Fengbao, 杨. Y., & Guo, X. (2026) · Measurement · doi:10.1016/j.measurement.2026.123424
Hu, X., Chu, Z., & Shen, X. (2026) · Ocean Engineering · doi:10.1016/j.oceaneng.2026.128492
Cluster-based domain adaptation: toward fine-grained similarity-aware graph transfer learning
Xie, S., Qin, C., Wu, Z., & Gao, J. (2026) · Knowledge and Information Systems · doi:10.1007/s10115-026-02869-0
Kuang, M., Yang, Z., Yang, Z., Liu, H., Zhou, Y., & Zhang, J. (2026) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2026.104034
Selective expert-guided reinforcement learning for vehicle cabin thermal management
Pang, Y., Li, K., Xie, Y., Song, W., & Tan, W. (2026) · Energy · doi:10.1016/j.energy.2026.142707
A Tea-Picking Method of Robot Dexterous Hands Based on Implicit Q-Learning with Flow Matching
Ou, J., & Li, S. (2026) · International Conference on Cyber-Physical Social Intelligence (ICCSI) · doi:10.1109/cpsi70510.2026.11734630
Parashos, P. D., & Koulouriotis, D. E. (2026) · Engineering · doi:10.1016/j.eng.2026.08.030
Dexterous ball balancing with robot arm manipulator using deep reinforcement learning
Kabir, I. K., Sheriff, A. M., Khan, Z. U., Ali, S. S. A., & Mohiuddin, M. B. (2026) · Results in Control and Optimization · doi:10.1016/j.rico.2026.100861
Lim, K. Z., Koh, J., Gunawan, A., Verbeeck, C., & Dai, B. T. (2026) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec69861.2026.11727213
Metadata
- Authors
- Zhu, Z., Lin, K., Jain, A. K., & Zhou, J.
- Affiliations
- Michigan State University (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2023-11-01
- Volume
- 45
- Issue
- 11
- Pages
- 13344-13362
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- PMC
- PMC11018366
- OpenAlex
- W4383112908
- Cited by
- 861
- References
- 185
- Citations by year
- 2026: 138 · 2025: 320 · 2024: 230 · 2023: 93
- FWCI
- 73.62
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2212174, 1749940)
- National Institute on Aging (RF1AG072449)
- Office of Naval Research (N00014-20-1-2382, N00014)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Keywords
- transfer learning, deep reinforcement learning, knowledge transfer, sequential decision making, deep neural network, robotics, game playing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review