The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index.
Learning to reinforcement learn
Open accessAbstract
In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A critical present objective is thus to develop deep RL methods that can adapt rapidly to new tasks. In the present work we introduce a novel approach to this challenge, which we refer to as deep meta-reinforcement learning. Previous work has shown that recurrent networks can support meta-learning in a fully supervised context. We extend this approach to the RL setting. What emerges is a system that is trained using one RL algorithm, but whose recurrent dynamics implement a second, quite separate RL procedure. This second, learned RL algorithm can differ from the original one in arbitrary ways. Importantly, because it is learned, it is configured to exploit structure in the training domain. We unpack these points in a series of seven proof-of-concept experiments, each of which examines a key aspect of deep meta-RL. We consider prospects for extending and scaling up the approach, and also point out some potentially important implications for neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even though finding an analytical expression of the Bayes-optimal policy is often impossible, it is straightforward to meta-learn an approximation to it (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Of particular interest due to their potential and novelty are the following methods: curriculum learning [37], incremental environment complexity [39], and continual learning and policy distillation for multiple tasks [12].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Owing to the more specific environment and sensor suites that are required for different navigation tasks, custom simulators have often been used [36], [37], or simulation worlds have been created using Unity, Unreal Engine, or Gazebo [39], [42].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While our exposition in this section focused on the supervised learning case, the same ideas can also be readily extended to the reinforcement learning setting (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“One way to address these shortcomings are meta-RL approaches, where adaptive agents are pre-trained on diverse task distributions to significantly increase sample efficiency on new problems”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“we are providing near-single-file implementations of recurrent PPO (Schulman et al., 2017) for single-task environments and its extension to RL 2 (Duan et al., 2016; Wang et al., 2016) for meta-learning as baselines.”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Sim-to-real transfer for DRL policies can be applied to complex navigation tasks: from six-legged robots [37] to depth-based mapless navigation [39], including robots for soccer competitions [36].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Self-citationReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Research works printed but not linked: 5
- Marcos Economides, Zeb Kurth-Nelson, Annika Lübbert, Marc Guitart-Masip, and Raymond Dolan. Modelbased reasoning in humans becomes automatic with training. PLoS Computational Biology , 11(9):e1004463, 2015.
- Emilie Kaufmann, Olivier Cappé, and Aurélien Garivier. On bayesian upper confidence bounds for bandit problems. In Proc. of Int'l Conf. on Artificial Intelligence and Statistics, AISTATS , 2012a.
- Tor Lattimore and Rémi Munos. Bounded regret for finite-armed structured bandits. In Advances in Neural Information Processing Systems 27 , pages 550-558, 2014.
- Dan Russo and Benjamin Van Roy. Learning to optimize via information-directed sampling. In Advances in Neural Information Processing Systems 27 , pages 1583-1591, 2014.
- Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap. Meta-learning with memory-augmented neural networks. In Proceedings of The 33rd International Conference on Machine Learning , pages 1842-1850, 2016.
Cited by
Sorted by citations
Items 101–200 of 592
He, Y., Wang, Y., Lin, Q., & Li, J. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3146439 · Cited by 65
A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to ImitationPreprint
Tai, L., Zhang, J., Liu, M., Boedecker, J., & Burgard, W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07139 · Cited by 111
Khadivi, M., Charter, T., Yaghoubi, M., Jalayer, M., Ahang, M., Shojaeinasab, A., & Najjaran, H. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.110856 · Cited by 81
A Survey of Generalisation in Deep Reinforcement LearningPreprint
Kirk, R., Zhang, A., Grefenstette, E., & Rocktäschel, T. (2021) · arXiv (Cornell University) · Cited by 63
Meta reinforcement learning as task inference
Humplik, J., Galashov, A., Hasenclever, L., Ortega, P. A., Teh, Y. W., & Heess, N. (2019) · arXiv · doi:10.48550/arxiv.1905.06424 · Cited by 82
Adaptive Posterior Learning: few-shot learning with a surprise-based memory modulePreprint
Ramalho, T., & Garnelo, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.02527 · Cited by 68
Foundation models and intelligent decision-making: Progress, challenges, and perspectives
Huang, J., Xu, Y., Wang, Q., Wang, Q., Liang, X., Wang, F., Zhang, Z., Wei, W., Zhang, B., Huang, L., et al. (2025) · The Innovation · doi:10.1016/j.xinn.2025.100948 · Cited by 87
Been There, Done That: Meta-Learning with Episodic RecallPreprint
Ritter, S., Wang, J. X., Kurth-Nelson, Z. L., Jayakumar, S. M., Blundell, C., Pascanu, R., & Botvinick, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09692 · Cited by 60
Self-citationImproving Generalization in Meta Reinforcement Learning using Learned ObjectivesPreprint
Kirsch, L., van Steenkiste, S., & Schmidhuber, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04098 · Cited by 94
Gaudet, B., Linares, R., & Furfaro, R. (2020) · Acta Astronautica · doi:10.1016/j.actaastro.2020.03.026 · Cited by 60
Zhang, H., Liu, C., Zhang, W.-N., Zheng, G., & Yu, Y. (2020) · International Conference on Information and Knowledge Management · doi:10.1145/3340531.3411859 · Cited by 57
Adaptive learning is structure learning in time
Yu, L. Q., Wilson, R. C., & Nassar, M. R. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.06.024 · Cited by 60
Boukoberine, M. N., Zia, M. F., Berghout, T., & Benbouzid, M. (2025) · Energy and AI · doi:10.1016/j.egyai.2025.100514 · Cited by 55
Psychlab: A Psychology Laboratory for Deep Reinforcement Learning AgentsPreprint
Leibo, J. Z., d’Autume, C. D. M., Zoran, D., Amos, D., Beattie, C., Anderson, K., Castañeda, A. G., Sanchez, M., Green, S., Gruslys, A., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.08116 · Cited by 55
Self-citationBuilding machines that learn and think for themselves
Botvinick, M., Barrett, D. G. T., Battaglia, P., de Freitas, N., Kumaran, D., Leibo, J. Z., Lillicrap, T., Modayil, J., Mohamed, S., Rabinowitz, N. C., et al. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x17000048 · Cited by 64
Self-citationGASTO: A Fast Adaptive Graph Learning Framework for Edge Computing Empowered Task Offloading
Li, Y., Li, J., Lv, Z., Li, H., Wang, Y., & Xu, Z. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3250395 · Cited by 56
A survey of deep learning applications in cryptocurrency
Zhang, J., Cai, K., & Wen, J. (2023) · iScience · doi:10.1016/j.isci.2023.108509 · Cited by 68
Learning Gradient Descent: Better Generalization and Longer HorizonsPreprint
Lv, K., Jiang, S., & Li, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03633 · Cited by 68
Neuromorphic Hardware Learns to Learn
Bohnstingl, T., Scherr, F., Pehle, C., Meier, K., & Maass, W. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00483 · Cited by 53
Crowd Navigation in an Unknown and Dynamic Environment Based on Deep Reinforcement Learning
Sun, L., Zhai, J., & Qin, W. (2019) · IEEE Access · doi:10.1109/access.2019.2933492 · Cited by 55
Wang, R., Lehman, J., Rawal, A., Zhi, J., Li, Y., Clune, J., & Stanley, K. O. (2020) · arXiv · doi:10.48550/arxiv.2003.08536 · Cited by 53
Parrot: Data-Driven Behavioral Priors for Reinforcement LearningPreprint
Singh, A., Liu, H., Zhou, G., Yu, A., Rhinehart, N., & Levine, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.10024 · Cited by 101
It’s new, but is it good? How generalization and uncertainty guide the exploration of novel options.
Stojić, H., Schulz, E., Analytis, P. P., & Speekenbrink, M. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000749 · Cited by 57
Small Sample Learning in Big Data EraPreprint
Shu, J., Xu, Z., & Meng, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04572 · Cited by 85
A neural circuit architecture for rapid learning in goal-directed navigation
Dan, C., Hulse, B. K., Kappagantula, R., Jayaraman, V., & Hermundstad, A. M. (2024) · Neuron · doi:10.1016/j.neuron.2024.04.036 · Cited by 51
“78,79 Recent RL studies have explored how such inductive biases might be constructed by learning common features across different learning tasks, 80,81 a process known as learning to learn.”
BackgroundSmith, L., Kostrikov, I., & Levine, S. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.056 · Cited by 61
Image quality assessment for machine learning tasks using meta-reinforcement learning
Saeed, S. U., Fu, Y., Stavrinides, V., Baum, Z. M. C., Yang, Q., Rusu, M., Fan, R. E., Sonn, G. A., Noble, J. A., Barratt, D. C., et al. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102427 · Cited by 52
MKN: Metakernel Networks for Few Shot Remote Sensing Scene Classification
Cui, Z., Yang, W., Chen, L., & Li, H. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3153679 · Cited by 49
Meta-reinforcement learning for the tuning of PI controllers: An offline approach
McClement, D. G., Lawrence, N. P., Backström, J. U., Loewen, P. D., Forbes, M. G., & Gopaluni, R. B. (2022) · Journal of Process Control · doi:10.1016/j.jprocont.2022.08.002 · Cited by 48
Brain-Inspired Learning, Perception, and Cognition: A Comprehensive Review
Jiao, L., Ma, M., He, P., Geng, X., Liu, X., Liu, F., Ma, W., Yang, S., Hou, B., & Tang, X. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3401711 · Cited by 54
Automatic Data Augmentation for Generalization in Deep Reinforcement LearningPreprint
Răileanu, R., Goldstein, M., Yarats, D., Kostrikov, I., & Fergus, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.12862 · Cited by 101
Large language model-based evolutionary optimizer: Reasoning with elitism
Brahmachary, S., Joshi, S. M., Panda, A., Koneripalli, K., Sagotra, A. K., Patel, H., Sharma, A., Jagtap, A. D., & Kalyanaraman, K. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129272 · Cited by 66
Multi-modal Active Learning From Human Data: A Deep Reinforcement Learning Approach
Rudovic, O. O., Zhang, M., Schuller, B. W., & Picard, R. W. (2019) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3340555.3353742 · Cited by 52
Exploring Applications of Deep Reinforcement Learning for Real-world Autonomous Driving Systems
Talpaert, V., Sobh, I., Kiran, B. R., Mannion, P., Yogamani, S. K., El-Sallab, A., & Pérez, P. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007520305640572 · Cited by 76
Visual Navigation With Multiple Goals Based on Deep Reinforcement Learning
Rao, Z., Wu, Y., Yang, Z., Zhang, W., Lu, S., Lu, W., & Zha, Z.-J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3057424 · Cited by 53
Meta-learning of Sequential Strategies
Ortega, P. A., Wang, J. X., Rowland, M., Genewein, T., Kurth-Nelson, Z., Pascanu, R., Heess, N., Veness, J., Pritzel, A., Sprechmann, P., et al. (2019) · arXiv · doi:10.48550/arxiv.1905.03030 · Cited by 47
Self-citationDRAS: Deep Reinforcement Learning for Cluster Scheduling in High Performance Computing
Fan, Y., Li, B., Favorite, D., Singh, N., Childers, J. T., Rich, P., Allcock, W. E., Papka, M. E., & Lan, Z. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3205325 · Cited by 49
Jin, J., & Xu, Y. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3181613 · Cited by 46
A recurrent network model of planning explains hippocampal replay and human behavior
Jensen, K. T., Hennequin, G., & Mattar, M. G. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01675-7 · Cited by 75
Rudovic, O. O., Park, H. W., Busche, J., Schuller, B. W., Breazeal, C., & Picard, R. W. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00031 · Cited by 43
Catecholaminergic modulation of meta-learning
Cook, J. L., Swart, J. C., Froböse, M. I., Diaconescu, A. O., Geurts, D. E. M., den Ouden, H. E. M., & Cools, R. (2019) · eLife · doi:10.7554/elife.51439 · Cited by 54
Reward Shaping via Meta-LearningPreprint
Zou, H., Ren, T., Yan, D., Su, H., & Zhu, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09330 · Cited by 76
What Can Learned Intrinsic Rewards Capture?Preprint
Zheng, Z., Oh, J., Hessel, M., Xu, Z., Kroiss, M., van Hasselt, H. P., Silver, D., & Singh, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05500 · Cited by 48
The Societal Implications of Deep Reinforcement Learning
Whittlestone, J., Arulkumaran, K., & Crosby, M. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12360 · Cited by 47
Kuo, C., Chen, C.-T., Lin, S.-J., & Huang, S.-H. (2021) · IEEE Access · doi:10.1109/access.2021.3068269 · Cited by 39
Learning from Few Samples: A SurveyPreprint
Bendre, N., Terashima‐Marín, H., & Najafirad, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15484 · Cited by 66
Learning and Adapting Agile Locomotion Skills by Transferring Experience
Smith, L. E., Kew, J. C., Li, T., Luu, L., Peng, X. B., Ha, S., Tan, J., & Levine, S. (2023) · Robotics: Science and Systems · doi:10.15607/rss.2023.xix.051 · Cited by 60
Few-Shot Goal Inference for Visuomotor Learning and PlanningPreprint
Xie, A., Singh, A., Levine, S., & Finn, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00482 · Cited by 42
A Survey of Exploration Methods in Reinforcement Learning
Amin, S., Gomrokchi, M., Satija, H., van Hoof, H., & Precup, D. (2021) · arXiv · doi:10.48550/arxiv.2109.00157 · Cited by 41
Meta-learned models of cognition
Binz, M., Dasgupta, I., Jagadish, A. K., Botvinick, M., Wang, J. X., & Schulz, E. (2024) · Behavioral and Brain Sciences · doi:10.1017/s0140525x23003266 · Cited by 38
Self-citationChen, X., Qu, G., Tang, Y., Low, S. H., & Li, N. (2021) · CaltechAUTHORS (California Institute of Technology) · Cited by 42
Federici, L., Scorsoglio, A., Zavoli, A., & Furfaro, R. (2022) · Acta Astronautica · doi:10.1016/j.actaastro.2022.08.047 · Cited by 44
Guiding Policies with Language via Meta-LearningPreprint
Co-Reyes, J. D., Gupta, A., Sanjeev, S., Altieri, N., Andreas, J., DeNero, J., Abbeel, P., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07882 · Cited by 51
A neural network walks into a lab: towards using deep nets as models for human behaviorPreprint
Ma, W. J., & Peters, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.02181 · Cited by 53
Meta-Learning through Hebbian Plasticity in Random NetworksPreprint
Najarro, E., & Risi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02686 · Cited by 49
Quantum Architecture Search with Meta‐Learning
He, Z., Chen, C., Li, L., Zheng, S., & Situ, H. (2022) · Advanced Quantum Technologies · doi:10.1002/qute.202100134 · Cited by 44
Adaptable automation with modular deep reinforcement learning and policy transfer
Raziei, Z., & Moghaddam, M. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104296 · Cited by 40
Huang, S., Sun, C., Wang, R., & Pompili, D. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3560227 · Cited by 37
Tang, Y., & Ha, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02869 · Cited by 44
On the Crossroad of Artificial Intelligence: A Revisit to Alan Turing and Norbert Wiener
Li, L., Zheng, N., & Wang, F. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2884315 · Cited by 36
Introducing neuromodulation in deep neural networks to learn adaptive behaviours
Vecoven, N., Ernst, D., Wehenkel, A., & Drion, G. (2020) · PLoS ONE · doi:10.1371/journal.pone.0227922 · Cited by 42
Meta Reinforcement Learning-Based Lane Change Strategy for Autonomous Vehicles
Ye, F., Wang, P., Chan, C., & Zhang, J. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575379 · Cited by 36
Adversarial vulnerabilities of human decision-making
Dezfouli, A., Nock, R., & Dayan, P. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016921117 · Cited by 39
Leveraging Task Modularity in Reinforcement Learning for Adaptable Industry 4.0 Automation
Chen, Q., Heydari, B., & Moghaddam, M. (2021) · Journal of Mechanical Design · doi:10.1115/1.4049531 · Cited by 38
Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning
Ivanovic, B., Harrison, J., & Pavone, M. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161155 · Cited by 35
Meta-ETI: Meta-Reinforcement Learning With Explicit Task Inference for AAV-IoT Coverage
Huang, S., Sun, C., & Pompili, D. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3553808 · Cited by 36
Meta-Reinforcement Learning-Based Transferable Scheduling Strategy for Energy Management
Xiong, L., Tang, Y. S., Liu, C., Mao, S., Meng, K., Dong, Z. Y., & Qian, F. (2023) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2023.3240702 · Cited by 37
Barsce, J. C., Palombarini, J. A., & Martínez, E. (2017) · CLEI electronic journal · doi:10.1109/clei.2017.8226439 · Cited by 37
Li, Y., He, H., Khajepour, A., Chen, Y., Huo, W., & Wang, H. (2024) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2024.3377809 · Cited by 36
Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems
Munir, M. S., Tran, N. H. K., Saad, W., & Hong, C. S. (2021) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2021.3057960 · Cited by 37
A Comprehensive Overview and Survey of Recent Advances in Meta-LearningPreprint
Peng, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.11149 · Cited by 58
A Data-Efficient Framework for Training and Sim-to-Real Transfer of Navigation Policies
Bharadhwaj, H., Wang, Z., Bengio, Y., & Paull, L. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794310 · Cited by 31
Meta-learning pseudo-differential operators with deep neural networks
Feliu‐Fabà, J., Fan, Y., & Ying, L. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109309 · Cited by 35
Models of heterogeneous dopamine signaling in an insect learning and memory center
Jiang, L., & Litwin-Kumar, A. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009205 · Cited by 35
MetalGAN: Multi-domain label-less image synthesis using cGANs and meta-learning
Fontanini, T., Iotti, E., Donati, L., & Prati, A. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.031 · Cited by 30
Gaudet, B., Furfaro, R., Linares, R., & Scorsoglio, A. (2020) · Journal of Spacecraft and Rockets · doi:10.2514/1.a34841 · Cited by 30
Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning
Fu, H., Tang, H., Hao, J., Chen, C., Feng, X., Dong, L., & Liu, W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16914 · Cited by 31
Munkhdalai, T., Sordoni, A., Wang, T., & Trischler, A. (2019) · arXiv · doi:10.48550/arxiv.1907.09720 · Cited by 31
Continuous Meta-Learning without TasksPreprint
Harrison, J., Sharma, A., Finn, C., & Pavone, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.08866 · Cited by 40
Task-Robust Model-Agnostic Meta-LearningPreprint
Collins, L., Mokhtari, A., & Shakkottai, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04766 · Cited by 30
Resource Management in Wireless Networks via Multi-Agent Deep Reinforcement Learning
Naderializadeh, N., Sydir, J. J., Simsek, M., & Nikopour, H. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154250 · Cited by 30
Liu, C., Li, Y., Huang, C. X., Zhao, Y., & Zhao, Z. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2027041 · Cited by 29
Deep Reinforcement Learning With NMPC Assistance Nash Switching for Urban Autonomous Driving
Alighanbari, S., & Azad, N. L. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3167616 · Cited by 31
An Atari Model Zoo for Analyzing, Visualizing, and Comparing Deep Reinforcement Learning Agents
Such, F. P., Madhavan, V., Liu, R., Wang, R., Castro, P. S., Li, Y., Zhi, J., Schubert, L., Bellemare, M. G., Clune, J., et al. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/452 · Cited by 45
Adapt to Environment Sudden Changes by Learning a Context Sensitive Policy
Luo, F.-M., Jiang, S., Yu, Y., Zhang, Z., & Zhang, Y. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20730 · Cited by 30
A review of reinforcement learning in chemistry
Gow, S., Niranjan, M., Kanza, S., & Frey, J. G. (2022) · Digital Discovery · doi:10.1039/d2dd00047d · Cited by 30
Learning a Prior over Intent via Meta-Inverse Reinforcement LearningPreprint
Xu, K., Ratner, E., Dragan, A. D., Levine, S., & Finn, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12573 · Cited by 39
Disentangled behavioral representationsPreprint
Dezfouli, A., Ashtiani, H., Ghattas, O., Nock, R., Dayan, P., & Ong, C. S. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/658252 · Cited by 27
Deep Reinforcement Learning amidst Lifelong Non-StationarityPreprint
Xie, A., Harrison, J., & Finn, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10701 · Cited by 66
Meta-Reinforced Multi-Domain State Generator for Dialogue Systems
Huang, Y., Feng, J., Hu, M., Wu, X., Du, X., & Ma, S. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.636 · Cited by 27
Sugiyama, T., Schweighofer, N., & Izawa, J. (2023) · Nature Communications · doi:10.1038/s41467-023-39536-9 · Cited by 30
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
An Active Inference Approach to Modeling Structure Learning: Concept Learning as an Example Case
Smith, R., Schwartenbeck, P., Parr, T., & Friston, K. J. (2020) · UCL Discovery (University College London) · Cited by 26
When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey
Zhang, C., Wang, J., Yen, G. G., Zhao, C., Sun, Q., Tang, Y. S., Qian, F., & Kurths, J. (2020) · Patterns · doi:10.1016/j.patter.2020.100050 · Cited by 28
Self-citationOffline Meta-Reinforcement Learning with Advantage WeightingPreprint
Mitchell, E., Rafailov, R., Peng, X. B., Levine, S., & Finn, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.06043 · Cited by 26
Meta-learning by the baldwin effect
Fernando, C., Sygnowski, J., Osindero, S., Wang, J., Schaul, T., Teplyashin, D., Sprechmann, P., Pritzel, A., & Rusu, A. A. (2018) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3205651.3205763 · Cited by 25
Self-citationReinforcement Learning during Adolescence in Rats
Afshar, N. M., Keip, A. J., Taylor, J. R., Lee, D., & Groman, S. M. (2020) · Journal of Neuroscience · doi:10.1523/jneurosci.0910-20.2020 · Cited by 23
The neural architecture of theory-based reinforcement learning
Tomov, M. S., Tsividis, P. A., Pouncy, T., Tenenbaum, J. B., & Gershman, S. J. (2023) · Neuron · doi:10.1016/j.neuron.2023.01.023 · Cited by 27
Bayesian nonparametric models characterize instantaneous strategies in a competitive dynamic game
McDonald, K. R., Broderick, W. F., Huettel, S. A., & Pearson, J. M. (2019) · Nature Communications · doi:10.1038/s41467-019-09789-4 · Cited by 27
Gu, Z., Yang, X., Zhang, Q., Yu, W., & Liu, Z. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3272688 · Cited by 24
Metadata
- Authors
- Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1611.05763
- OpenAlex
- W2550182557
- Cited by
- 579
- References
- 32
- Citations by year
- 2026: 2 · 2025: 17 · 2024: 47 · 2023: 59 · 2022: 79 · 2021: 104 · 2020: 117 · 2019: 69 · 2018: 61 · 2017: 22 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- meta-learning, recurrent neural networks, training data efficiency, learned dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
