The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index.
Learning to reinforcement learn
Open accessAbstract
In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A critical present objective is thus to develop deep RL methods that can adapt rapidly to new tasks. In the present work we introduce a novel approach to this challenge, which we refer to as deep meta-reinforcement learning. Previous work has shown that recurrent networks can support meta-learning in a fully supervised context. We extend this approach to the RL setting. What emerges is a system that is trained using one RL algorithm, but whose recurrent dynamics implement a second, quite separate RL procedure. This second, learned RL algorithm can differ from the original one in arbitrary ways. Importantly, because it is learned, it is configured to exploit structure in the training domain. We unpack these points in a series of seven proof-of-concept experiments, each of which examines a key aspect of deep meta-RL. We consider prospects for extending and scaling up the approach, and also point out some potentially important implications for neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even though finding an analytical expression of the Bayes-optimal policy is often impossible, it is straightforward to meta-learn an approximation to it (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Of particular interest due to their potential and novelty are the following methods: curriculum learning [37], incremental environment complexity [39], and continual learning and policy distillation for multiple tasks [12].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Owing to the more specific environment and sensor suites that are required for different navigation tasks, custom simulators have often been used [36], [37], or simulation worlds have been created using Unity, Unreal Engine, or Gazebo [39], [42].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While our exposition in this section focused on the supervised learning case, the same ideas can also be readily extended to the reinforcement learning setting (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“One way to address these shortcomings are meta-RL approaches, where adaptive agents are pre-trained on diverse task distributions to significantly increase sample efficiency on new problems”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“we are providing near-single-file implementations of recurrent PPO (Schulman et al., 2017) for single-task environments and its extension to RL 2 (Duan et al., 2016; Wang et al., 2016) for meta-learning as baselines.”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Sim-to-real transfer for DRL policies can be applied to complex navigation tasks: from six-legged robots [37] to depth-based mapless navigation [39], including robots for soccer competitions [36].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Self-citationReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Research works printed but not linked: 5
- Marcos Economides, Zeb Kurth-Nelson, Annika Lübbert, Marc Guitart-Masip, and Raymond Dolan. Modelbased reasoning in humans becomes automatic with training. PLoS Computational Biology , 11(9):e1004463, 2015.
- Emilie Kaufmann, Olivier Cappé, and Aurélien Garivier. On bayesian upper confidence bounds for bandit problems. In Proc. of Int'l Conf. on Artificial Intelligence and Statistics, AISTATS , 2012a.
- Tor Lattimore and Rémi Munos. Bounded regret for finite-armed structured bandits. In Advances in Neural Information Processing Systems 27 , pages 550-558, 2014.
- Dan Russo and Benjamin Van Roy. Learning to optimize via information-directed sampling. In Advances in Neural Information Processing Systems 27 , pages 1583-1591, 2014.
- Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap. Meta-learning with memory-augmented neural networks. In Proceedings of The 33rd International Conference on Machine Learning , pages 1842-1850, 2016.
Cited by
Sorted by citations
Items 301–400 of 592
MELD: Meta-Reinforcement Learning from Images via Latent State ModelsPreprint
Zhao, T. Z., Nagabandi, A., Rakelly, K., Finn, C., & Levine, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13957 · Cited by 11
The Information Geometry of Unsupervised Reinforcement LearningPreprint
Eysenbach, B., Salakhutdinov, R., & Levine, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.02719 · Cited by 21
Fast learning without synaptic plasticity in spiking neural networks
Subramoney, A., Bellec, G., Scherr, F., Legenstein, R. A., & Maass, W. (2024) · Scientific Reports · doi:10.1038/s41598-024-55769-0 · Cited by 11
Seshagiri, S., & Prema, K. V. (2025) · IEEE Access · doi:10.1109/access.2025.3536479 · Cited by 10
Context meta-reinforcement learning via neuromodulation
Ben-Iwhiwhu, E., Dick, J., Ketz, N., Pilly, P. K., & Soltoggio, A. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.04.003 · Cited by 13
Exploration With Task Information for Meta Reinforcement Learning
Jiang, P., Song, S., & Huang, G. M. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3121432 · Cited by 10
Side-Aware Meta-Learning for Cross-Dataset Listener Diagnosis With Subjective Tinnitus
Liu, Z., Li, Y., Yao, L., Lucas, M. V., Monaghan, J. J. M., & Zhang, Y. (2022) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3201158 · Cited by 11
31st Annual Computational Neuroscience Meeting: CNS*2022
Corsi, M., Sorrentino, P., Schwartz, D., George, N., Hugueville, L., Kahn, A. E., Dupont, S., Bassett, D. S., Jirsa, V., & Fallani, F. D. V. (2023) · Journal of Computational Neuroscience · doi:10.1007/s10827-022-00841-9 · Cited by 11
AMRL: Aggregated Memory For Reinforcement Learning
Beck, J., Ciosek, K., Devlin, S., Tschiatschek, S., Zhang, C., & Hofmann, K. (2020) · International Conference on Learning Representations · Cited by 10
(2020) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 10
Fast Adaptation to New Environments via Policy-Dynamics Value Functions
Răileanu, R., Goldstein, M. A., & Szlam, A. D. (2020) · International Conference on Machine Learning · Cited by 10
Computational mechanisms of distributed value representations and mixed learning strategies
Farashahi, S. G., & Soltani, A. (2021) · Nature Communications · doi:10.1038/s41467-021-27413-2 · Cited by 10
Complementary Meta-Reinforcement Learning for Fault-Adaptive Control
Ahmed, I. H., Quiñones-Grueiro, M., & Biswas, G. (2020) · Annual Conference of the PHM Society · doi:10.36001/phmconf.2020.v12i1.1289 · Cited by 10
SafeLife 1.0: Exploring Side Effects in Complex EnvironmentsPreprint
Wainwright, C. L., & Eckersley, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01217 · Cited by 15
Curriculum in Gradient-Based Meta-Reinforcement LearningPreprint
Mehta, B., Deleu, T., Raparthy, S. C., Pal, C., & Paull, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07956 · Cited by 15
Nonlinear control strategies for 3-DOF control moment gyroscope using deep reinforcement learning
Xiong, Y., Liu, S., Zhang, J., Xu, M., & Guo, L. (2024) · Neural Computing and Applications · doi:10.1007/s00521-023-09341-y · Cited by 9
Meta-Reinforcement Learning with Transformer Networks for Space Guidance Applications
Federici, L., & Furfaro, R. (2024) · AIAA SciTech Forum · doi:10.2514/6.2024-2061 · Cited by 9
Data-Efficient Task Generalization via Probabilistic Model-Based Meta Reinforcement Learning
Bhardwaj, A., Rothfuss, J., Sukhija, B., As, Y., Hutter, M., Coros, S., & Krause, A. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3371260 · Cited by 9
Reinforcement Learning based Lane Change Decision-Making with Imaginary Sampling
Li, D., Zhao, D., & Zhang, Q. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9003029 · Cited by 9
Learn to Adapt for Self-Supervised Monocular Depth Estimation
Sun, Q., Yen, G. G., Tang, Y. S., & Zhao, C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3289051 · Cited by 13
RNN Beamforming Optimizer for Rate-Splitting Multiple Access and Cell-Free Massive MIMO
Johnston, J., & Wang, X. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3486982 · Cited by 9
Cognitive bots and algorithmic humans: toward a shared understanding of social intelligence
McDonald, K. R., & Pearson, J. M. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.04.013 · Cited by 10
Gaudet, B., Linares, R., & Furfaro, R. (2020) · AIAA SciTech Forum · doi:10.2514/6.2020-0953 · Cited by 10
Prefrontal solution to the bias-variance tradeoff during reinforcement learning
Kim, D., Jeong, J., & Lee, S. W. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.110185 · Cited by 9
Aznar-Poveda, J., García-Sánchez, A.-J., Egea-López, E., & Garcı́a-Haro, J. (2021) · IEEE Access · doi:10.1109/access.2021.3109422 · Cited by 11
Meta-Learning surrogate models for sequential decision makingPreprint
Galashov, A., Schwarz, J., Kim, H., Garnelo, M., Saxton, D., Kohli, P., Eslami, S. M. A., & Teh, Y. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.11907 · Cited by 21
Model-free conventions in multi-agent reinforcement learning with heterogeneous preferencesPreprint
Koster, R., McKee, K. R., Everett, R., Weidinger, L., Isaac, W. S., Hughes, E., Duéñez‐Guzmán, E. A., Graepel, T., Botvinick, M., & Leibo, J. Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.09054 · Cited by 34
Self-citationAlchemy: A structured task distribution for meta-reinforcement learning.Preprint
Wang, J. X., King, M. C., Porcel, N., Kurth-Nelson, Z. L., Zhu, T., Deck, C., Choy, P., Cassin, M., Reynolds, M., Song, H., et al. (2021) · arXiv (Cornell University) · Cited by 8
Self-citationAutomated Design of Agentic Systems
Hu, S., Lu, C., & Clune, J. (2024) · arXiv · doi:10.48550/arxiv.2408.08435 · Cited by 10
“…2019; Hu et al., 2021) exem-plifies the first pillar by automating neural network design, while works like MAML (Finn et al., 2017) and Meta-RL (Wang et al., 2016; Duan et al., 2017; Norman & Clune, 2023; Zintgraf et al., 2021a;b) exemplify the second pillar, focusing on “learning to learn”…”
Gaudet, B., & Furfaro, R. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-2638 · Cited by 8
Meta-Reinforcement Learning via Exploratory Task Clustering
Chu, Z., Cai, R., & Wang, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29046 · Cited by 10
Task and Domain Adaptive Reinforcement Learning for Robot Control
Liu, Y. T., Singh, N., & Ahmad, A. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10801963 · Cited by 8
Meta-Deep Q-Learning for Eco-Routing
Ma, X., Xie, Y., & Chigan, C. (2019) · IEEE Connected and Automated Vehicles Symposium (CAVS) · doi:10.1109/cavs.2019.8887764 · Cited by 8
Adaptive Adversarial Training for Meta Reinforcement Learning
Chen, S., Chen, Z., & Wang, D. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534316 · Cited by 8
Intelligent Ultrareliable and Low-Latency Communications: Flexibility and Adaptation
Zhang, J., Xu, X., Han, S., Zhang, K., Zhang, P., & Quek, T. Q. S. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3150490 · Cited by 8
Temporal Logic Guided Meta Q-Learning of Multiple Tasks
Zhang, H., & Kan, Z. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3185384 · Cited by 8
Testing the Possibility of Model-based Pavlovian Control of Attention to Threat
Talmi, D., Slapkova, M., & Wieser, M. J. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01329 · Cited by 9
Multicast Tree Generation using Meta Reinforcement Learning in SDN-based Smart Network Platforms
Chae, J., & Kim, N. (2021) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2021.09.003 · Cited by 8
Generalizing from a few environments in safety-critical reinforcement learningPreprint
Kenton, Z., Filos, A., Evans, O., & Gal, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.01475 · Cited by 12
Fast Adaptation via Policy-Dynamics Value FunctionsPreprint
Răileanu, R., Goldstein, M., Szlam, A. D., & Fergus, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02879 · Cited by 13
HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem SolvingPreprint
Xie, S., Ma, X., Yu, P., Zhu, Y., Wu, Y. N., & Zhu, S. C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11344 · Cited by 15
Decoupling Exploration and Exploitation for Meta-Reinforcement Learning without SacrificesPreprint
Liu, E. Z., Raghunathan, A., Liang, P., & Finn, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.02790 · Cited by 21
On the Convergence Theory of Debiased Model-Agnostic Meta-Reinforcement LearningPreprint
Fallah, A., Georgiev, K., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05135 · Cited by 8
Context-Aware Meta-RL With Two-Stage Constrained Adaptation for Urban Driving
Deng, Q., Li, R., Hu, Q., Zhao, Y., & Li, R. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3312495 · Cited by 7
A Systematic Study of Deep Q-Networks and Its Variations
Jain, A., Mehrotra, A., Rewariya, A., & Kumar, S. (2022) · International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) · doi:10.1109/icacite53722.2022.9823631 · Cited by 9
Supervised Meta-Reinforcement Learning With Trajectory Optimization for Manipulation Tasks
Wang, L., Zhang, Y., Zhu, D., Coleman, S., & Kerr, D. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3286465 · Cited by 9
Deep Model Predictive Optimization
Sacks, J., Rana, R., Huang, K., Spitzer, A., Shi, G., & Boots, B. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10611492 · Cited by 7
High-resolution multi-beam tracking with low overhead for mmWave beamforming system
Kim, S., Kwon, G., & Park, H. (2021) · ICT Express · doi:10.1016/j.icte.2021.01.014 · Cited by 7
Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks
Guo, Y., Wu, Q., & Lee, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20635 · Cited by 7
A multi-scenario text generation method based on meta reinforcement learning
Zhao, T., Li, G., Song, Y., Wang, Y., Chen, Y., & Yang, J. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.11.031 · Cited by 7
Homing Guidance Law Design against Maneuvering Targets Based on DDPG
Liang, Y., Tang, J., Bai, Z., & Li, K. (2023) · International Journal of Aerospace Engineering · doi:10.1155/2023/4188037 · Cited by 7
Evolving inborn knowledge for fast adaptation in dynamic POMDP problems
Ben-Iwhiwhu, E., Ładosz, P., Dick, J., Chen, W., Pilly, P. K., & Soltoggio, A. (2020) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3377930.3390214 · Cited by 7
Kong, W., Zhou, D., Zhang, K., Yang, Z. C., & Yang, W. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00238 · Cited by 7
Learning to Learn to Disambiguate: Meta-Learning for Few-Shot Word Sense Disambiguation
Holla, N., Mishra, P., Yannakoudakis, H., & Shutova, E. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.405 · Cited by 10
A Model-based Approach for Sample-efficient Multi-task Reinforcement LearningPreprint
Landolfi, N. C., Thomas, G., & Ma, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.04964 · Cited by 7
Evolvability ES: Scalable and Direct Optimization of EvolvabilityPreprint
Gajewski, A., Clune, J., Stanley, K. O., & Lehman, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06077 · Cited by 7
Group Equivariant Deep Reinforcement LearningPreprint
Mondal, A. K., Nair, P., & Siddiqi, K. (2020) · arXiv.org · doi:10.48550/arxiv.2007.03437 · Cited by 36
Learning Not to Learn: Nature versus Nurture in Silico
Lange, R. T., & Sprekeler, H. (2020) · arXiv · doi:10.48550/arxiv.2010.04466 · Cited by 6
Active learning using adaptable task-based prioritisation
Saeed, S. U., Ramalhinho, J., Pinnock, M. A., Shen, Z., Fu, Y., Montaña-Brown, N., Bonmati, E., Barratt, D. C., Pereira, S. P., Davidson, B. R., et al. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103181 · Cited by 10
Wen, L., & Wang, H. (2024) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec60901.2024.10611854 · Cited by 6
An Exoatmospheric Homing Guidance Law Based on Deep Q Network
Tang, J., Bai, Z., Liang, Y., Fan, Z., & Li, K. (2022) · International Journal of Aerospace Engineering · doi:10.1155/2022/1544670 · Cited by 5
Planning lunar In-Situ Resource Utilisation with a reinforcement learning agent
Pelech, T. M., Yao, L., & Saydam, S. (2022) · Acta Astronautica · doi:10.1016/j.actaastro.2022.09.040 · Cited by 6
FedMC: Federated Reinforcement Learning on the Edge with Meta-Critic Networks
Zou, D., Liu, X., Sun, L., Duan, J., Li, R., Xu, Y., Li, W., & Lu, S. (2022) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/ipccc55026.2022.9894336 · Cited by 6
BIMRL: Brain Inspired Meta Reinforcement Learning
Rohani, S. R. R., Hedayatian, S., & Baghshah, M. S. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981250 · Cited by 6
Line of Sight Curvature for Missile Guidance using Reinforcement Meta-Learning
Gaudet, B., & Furfaro, R. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-1627 · Cited by 6
Dream to Adapt: Meta Reinforcement Learning by Latent Context Imagination and MDP Imagination
Wen, L., Tseng, E., Peng, H., & Zhang, S. (2024) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2024.3417114 · Cited by 6
Zhang, S., Tian, Y., Liu, Q., & Wu, H. (2024) · eLife · doi:10.7554/elife.92892.4 · Cited by 10
U-net Network for Building Information Extraction of Remote-Sensing Imagery
Li, J., Xu, M., & Xiu, H. (2018) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v14i12.9335 · Cited by 6
Learning Not to Learn: Nature versus Nurture In Silico
Lange, R. T., & Sprekeler, H. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20691 · Cited by 6
Reinforcement Meta-Learning for Autonomous Image-Based Guidance around Binary Asteroid Systems
Federici, L., Scorsoglio, A., Ghilardi, L., D’Ambrosio, A., Benedikter, B., & Furfaro, R. (2022) · AIAA SciTech Forum · doi:10.2514/6.2022-2270 · Cited by 6
Meta-Learning to ClusterPreprint
Jiang, Y., & Verma, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14134 · Cited by 9
Meta Dialogue Policy LearningPreprint
Xu, Y., Zhu, C., Peng, B., & Zeng, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02588 · Cited by 6
Causal Analysis of Agent Behavior for AI SafetyPreprint
Delétang, G., Grau-Moya, J., Martic, M., Genewein, T., McGrath, T., Mikulik, V., Kunesch, M., Legg, S., & Ortega, P. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03938 · Cited by 11
Deep Learning: Implications for Human Learning and MemoryPreprint
McClelland, J. L., & Botvinick, M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3m5sb · Cited by 6
Self-citationProcedural Generalization by Planning with Self-Supervised World Models
Anand, A., Walker, J., Li, Y., Vértes, E., Schrittwieser, J., Ozair, S., Weber, T., & Hamrick, J. B. (2021) · arXiv · doi:10.48550/arxiv.2111.01587 · Cited by 5
Learning to Interactively Learn and Assist
Woodward, M. P., Finn, C., & Hausman, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i03.5636 · Cited by 10
Meta-Inverse Reinforcement Learning for Mean Field Games via Probabilistic Context Variables
Chen, Y., Lin, X., Yan, B., Zhang, L., Liu, J., Tan, N. Ö., & Witbrock, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29021 · Cited by 5
Integrated Guidance and Control for Lunar Landing using a Stabilized Seeker
Gaudet, B., & Furfaro, R. (2022) · AIAA SciTech Forum · doi:10.2514/6.2022-1838 · Cited by 5
Deng, Q., Zhao, Y., Li, R., Hu, Q., Liu, T., & Li, R. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191187 · Cited by 5
Scheduling Real-Time Wireless Traffic: A Network-Aided Offline Reinforcement Learning Approach
Wan, J., Lin, S., Zhang, Z., Zhang, J., & Zhang, T. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3304969 · Cited by 7
Online Optimization Method of Learning Process for Meta-Learning
Xu, Z., Zhang, W., Li, A., Zhao, F., Jing, Y., Wan, Z., Cao, L., & Chen, X. (2023) · The Computer Journal · doi:10.1093/comjnl/bxad089 · Cited by 5
Decoupling Meta-Reinforcement Learning with Gaussian Task Contexts and Skills
He, H., Zhu, A., Liang, S., Chen, F., & Shao, J. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29127 · Cited by 4
A Reinforcement Learning Based 3D Guided Drilling Method
Liu, H., Zhu, D., Liu, Y., Du, A., Chen, D., & Ye, Z. (2018) · International Conference Network, Communication and Computing · doi:10.1145/3301326.3301374 · Cited by 5
Fast Adaptation via Meta Learning in Multi-agent Cooperative Tasks
Jia, H., Ding, B. Y., Wang, H., Gong, X., & Zhou, X. (2019) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld-uic-atc-scalcom-iop-sci.2019.00156 · Cited by 5
Kemtur, A., Jain, Y., Mehta, A., Callaway, F., Consul, S., Stojcheski, J., & Lieder, F. (2020) · doi:10.13140/rg.2.2.26453.55529 · Cited by 5
Meta-Reinforcement Learning for Adaptive Control of Second Order Systems
McClement, D. G., Lawrence, N. P., Forbes, M. G., Loewen, P. D., Backström, J. U., & Gopaluni, R. B. (2022) · International Symposium on Advanced Control of Industrial Processes · doi:10.1109/adconip55568.2022.9894150 · Cited by 5
Potapov, A. S., & Rodionov, S. A. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-63703-7_10 · Cited by 5
Uncertainty Aware Learning from Demonstrations in Multiple Contexts using Bayesian Neural Networks
Thakur, S. K., van Hoof, H., Higuera, J. C. G., Precup, D., & Meger, D. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8794328 · Cited by 6
Algorithm selection of off-policy reinforcement learning algorithm.Preprint
Laroche, R., & Féraud, R. (2017) · arXiv (Cornell University) · Cited by 5
Botvinick, M., Barrett, D. G. T., Battaglia, P., de Freitas, N., Kumaran, D., Leibo, J. Z., Lillicrap, T., Modayil, J., Mohamed, S., Rabinowitz, N. C., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.08378 · Cited by 5
Self-citationOn Machine Learning and Structure for Mobile RobotsPreprint
Wulfmeier, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06003 · Cited by 6
Finding online neural update rules by learning to rememberPreprint
Gregor, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03124 · Cited by 6
Meta-Model-Based Meta-Policy OptimizationPreprint
Hiraoka, T., Imagawa, T., Tangkaratt, V., Osa, T., Onishi, T., & Tsuruoka, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02608 · Cited by 7
Meta Learning in the Continuous Time LimitPreprint
Xu, R., Chen, L., & Karbasi, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10921 · Cited by 5
EVO-RL: Evolutionary-Driven Reinforcement LearningPreprint
Hallawa, A., Born, T., Schmeink, A., Dartmann, G., Peine, A., Märtin, L., Iacca, G., Eiben, A. E., & Ascheid, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04725 · Cited by 5
Meta Automatic Curriculum LearningPreprint
Portelas, R., Romac, C., Hofmann, K., & Oudeyer, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08463 · Cited by 5
Subramoney, A., Bellec, G., Scherr, F., Legenstein, R. A., & Maass, W. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.01.25.428153 · Cited by 4
Meta-Learning of Structured Task Distributions in Humans and MachinesPreprint
Kumar, S., Dasgupta, I., Cohen, J. D., Daw, N. D., & Griffiths, T. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02317 · Cited by 8
Wang, K., Shah, S. B., Chen, H., Perrault, A., Doshi‐Velez, F., & Tambe, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.03279 · Cited by 5
Discovering Multi-Agent Auto-Curricula in Two-Player Zero-Sum Games.Preprint
Feng, X., Slumbers, O., Yang, Y., Wan, Z., Liu, B., McAleer, S., Wen, Y., & Wang, J. (2021) · arXiv (Cornell University) · Cited by 5
Self-citation
Metadata
- Authors
- Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1611.05763
- OpenAlex
- W2550182557
- Cited by
- 579
- References
- 32
- Citations by year
- 2026: 2 · 2025: 17 · 2024: 47 · 2023: 59 · 2022: 79 · 2021: 104 · 2020: 117 · 2019: 69 · 2018: 61 · 2017: 22 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- meta-learning, recurrent neural networks, training data efficiency, learned dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
