The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index.
Learning to reinforcement learn
Open accessAbstract
In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A critical present objective is thus to develop deep RL methods that can adapt rapidly to new tasks. In the present work we introduce a novel approach to this challenge, which we refer to as deep meta-reinforcement learning. Previous work has shown that recurrent networks can support meta-learning in a fully supervised context. We extend this approach to the RL setting. What emerges is a system that is trained using one RL algorithm, but whose recurrent dynamics implement a second, quite separate RL procedure. This second, learned RL algorithm can differ from the original one in arbitrary ways. Importantly, because it is learned, it is configured to exploit structure in the training domain. We unpack these points in a series of seven proof-of-concept experiments, each of which examines a key aspect of deep meta-RL. We consider prospects for extending and scaling up the approach, and also point out some potentially important implications for neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even though finding an analytical expression of the Bayes-optimal policy is often impossible, it is straightforward to meta-learn an approximation to it (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Of particular interest due to their potential and novelty are the following methods: curriculum learning [37], incremental environment complexity [39], and continual learning and policy distillation for multiple tasks [12].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Owing to the more specific environment and sensor suites that are required for different navigation tasks, custom simulators have often been used [36], [37], or simulation worlds have been created using Unity, Unreal Engine, or Gazebo [39], [42].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While our exposition in this section focused on the supervised learning case, the same ideas can also be readily extended to the reinforcement learning setting (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“One way to address these shortcomings are meta-RL approaches, where adaptive agents are pre-trained on diverse task distributions to significantly increase sample efficiency on new problems”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“we are providing near-single-file implementations of recurrent PPO (Schulman et al., 2017) for single-task environments and its extension to RL 2 (Duan et al., 2016; Wang et al., 2016) for meta-learning as baselines.”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Sim-to-real transfer for DRL policies can be applied to complex navigation tasks: from six-legged robots [37] to depth-based mapless navigation [39], including robots for soccer competitions [36].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Self-citationReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Research works printed but not linked: 5
- Marcos Economides, Zeb Kurth-Nelson, Annika Lübbert, Marc Guitart-Masip, and Raymond Dolan. Modelbased reasoning in humans becomes automatic with training. PLoS Computational Biology , 11(9):e1004463, 2015.
- Emilie Kaufmann, Olivier Cappé, and Aurélien Garivier. On bayesian upper confidence bounds for bandit problems. In Proc. of Int'l Conf. on Artificial Intelligence and Statistics, AISTATS , 2012a.
- Tor Lattimore and Rémi Munos. Bounded regret for finite-armed structured bandits. In Advances in Neural Information Processing Systems 27 , pages 550-558, 2014.
- Dan Russo and Benjamin Van Roy. Learning to optimize via information-directed sampling. In Advances in Neural Information Processing Systems 27 , pages 1583-1591, 2014.
- Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap. Meta-learning with memory-augmented neural networks. In Proceedings of The 33rd International Conference on Machine Learning , pages 1842-1850, 2016.
Cited by
Sorted by citations
Items 401–500 of 592
Shen, T., & Dayan, P. (2024) · eLife · doi:10.1101/2024.01.07.574574 · Cited by 7
Importance of prefrontal meta control in human-like reinforcement learning
Lee, J. H., Leibo, J. Z., An, S.-J., & Lee, S. W. (2022) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2022.1060101 · Cited by 4
Self-citationIgoe, C., Pande, S., Venkatraman, S., & Schneider, J. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161395 · Cited by 4
Few-Shot Learning Patterns in Financial Time Series for Trend-Following Strategies
Wood, K., Kessler, S., Roberts, S., & Zohren, S. (2024) · The Journal of Financial Data Science · doi:10.3905/jfds.2024.1.157 · Cited by 4
MGHRL: Meta Goal-Generation for Hierarchical Reinforcement Learning
Fu, H., Tang, H., Hao, J., Liu, W., & Chen, C. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64096-5_3 · Cited by 4
Online Learning with Radial Basis Function Networks
Borrageiro, G., Firoozye, N. B., & Barucca, P. (2022) · The Journal of Financial Data Science · doi:10.3905/jfds.2022.1.112 · Cited by 5
Minimal cross-trial generalization in learning the representation of an odor-guided choice task
Song, M., Takahashi, Y. K., Burton, A. C., Roesch, M. R., Schoenbaum, G. M., Niv, Y., & Langdon, A. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009897 · Cited by 5
When Artificial Intelligence and Computational Neuroscience Meet
Alexandre, F., Dominey, P. F., Gaussier, P., Girard, B., Khamassi, M., & Rougier, N. P. (2020) · Springer eBooks · doi:10.1007/978-3-030-06170-8_9 · Cited by 4
Double Meta-Learning for Data Efficient Policy Optimization in Non-Stationary Environments
Aghapour, E., & Ayanian, N. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561219 · Cited by 5
Observer models of perceptual development
Marko Nardini, A., & Dekker, T. M. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1800136x · Cited by 4
Learning Navigation Behaviors End-to-End with AutoRLPreprint
Chiang, H.-T. L., Faust, A., Fišer, M., & Francis, A. G., Jr. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.10124 · Cited by 4
BADGER: Learning to (Learn [Learning Algorithms] through Multi-Agent Communication)Preprint
Rosa, M., Afanasjeva, O., Andersson, S., Davidson, J., Guttenberg, N., Hlubuček, P., Poliak, M., Vítků, J., & Feyereisl, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.01513 · Cited by 8
Learning State Abstractions for Transfer in Continuous ControlPreprint
Asadi, K., Abel, D. L., & Littman, M. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05518 · Cited by 5
Veith, E. M., Wenninghoff, N., & Frost, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.13601 · Cited by 13
Skill Transfer via Partially Amortized Hierarchical PlanningPreprint
Xie, K., Bharadhwaj, H., Hafner, D., Garg, A., & Shkurti, F. (2020) · arXiv (Cornell University) · Cited by 4
Meta-Reinforcement Learning in Broad and Non-Parametric EnvironmentsPreprint
Bing, Z., Knak, L., Robin, F. O., Huang, K., & Knoll, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.03718 · Cited by 4
Integrated and Adaptive Guidance and Control for Endoatmospheric Missiles via Reinforcement LearningPreprint
Gaudet, B., & Furfaro, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.03880 · Cited by 7
Zero-shot compositional reasoning in a reinforcement learning settingPreprint
Jagadish, A. K., Binz, M., Saanum, T., Wang, J. X., & Schulz, E. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ymve5 · Cited by 4
Self-citationXLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX
Nikulin, A., Kurenkov, V., Zisman, I., Agarkov, A., Sinii, V., & Kolesnikov, S. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-1390 · Cited by 3
“One way to address these shortcomings are meta-RL approaches, where adaptive agents are pre-trained on diverse task distributions to significantly increase sample efficiency on new problems (Wang et al., 2016; Duan et al., 2016).”
When Can AI Models Explain Learning? Validity Criteria for AI as Cognitive Models in Education
Wang, P., Viberg, O., Law, E. L.-C., & Greiff, S. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10202-y · Cited by 3
Analysis of Model-Agnostic Meta-Reinforcement Learning on Automated HVAC Control
Filiz, U., Hekimoğlu, M. B., Baghaee, S., & Ulusoy, İ. (2025) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu66497.2025.11112293 · Cited by 3
Ma, X., Shahbakhti, M., & Chigan, C. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3239943 · Cited by 3
MetaAug: Meta-data Augmentation for Post-training Quantization
Pham, C., Hoang, A. D., Nguyen, C. C., Le, T., Phung, D., Carneiro, G., & Do, T.-T. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73383-3_14 · Cited by 3
Global–Local Decomposition of Contextual Representations in Meta-Reinforcement Learning
Ma, N., Xuan, J., Zhang, G., & Lü, J. (2025) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2025.3533035 · Cited by 4
Güitta-López, L., Güitta-López, L., Boal, J., & López-López, Á. J. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111510 · Cited by 5
Deep Recurrent Deterministic Policy Gradient for Physical Control
Zhang, L., Han, S. D., Zhang, Z., Li, L., & Lü, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61616-8_21 · Cited by 3
Robust Waypoint Guidance of a Hexacopter on Mars using Meta-Reinforcement Learning
Federici, L., Furfaro, R., Zavoli, A., & Matteis, G. D. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-2663 · Cited by 3
Uncertainty-based Meta-Reinforcement Learning for Robust Radar Tracking
Ott, J., Servadei, L., Mauro, G., Stadelmayer, T., Santra, A., & Wille, R. (2022) · International Conference on Machine Learning and Applications · doi:10.1109/icmla55696.2022.00232 · Cited by 3
Domain Adaptation of Reinforcement Learning Agents based on Network Service Proximity
Dey, K., Perepu, S. K., Dasgupta, P., & Das, A. (2023) · IEEE International Conference on Network Softwarization (NetSoft) · doi:10.1109/netsoft57336.2023.10175507 · Cited by 3
Azran, G., Danesh, M. H., Albrecht, S. V., & Keren, S. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28970 · Cited by 3
BSE-MAML: Model Agnostic Meta-Reinforcement Learning via Bayesian Structured Exploration
Wang, H., Zhang, Y., Feng, D., Li, D., & Huang, F. (2020) · IEEE International Conference on Services Computing · doi:10.1109/scc49832.2020.00017 · Cited by 3
Meta Reinforcement Learning for Heuristic Planing
Gutiérrez, R. L., & Leonetti, M. (2021) · Proceedings of the International Conference on Automated Planning and Scheduling · doi:10.1609/icaps.v31i1.16003 · Cited by 3
Aggregating Learning Agents for Microgrid Energy Scheduling During Extreme Weather Events
Das, A., Ni, Z., & Zhong, X. (2021) · IEEE Power Engineering Society General Meeting · doi:10.1109/pesgm46819.2021.9637949 · Cited by 3
Optimizing Interactive Systems with Data-Driven Objectives
Li, Z. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/912 · Cited by 3
Meta-Reinforcement Learning by Tracking Task Non-stationarity
Poiani, R., Tirinzoni, A., & Restelli, M. (2021) · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · Cited by 3
Utilising Prior Knowledge for Visual Navigation: Distil and AdaptPreprint
Moghaddam, M. M. K., Wu, Q., Abbasnejad, E., & Shi, Q. (2020) · arXiv (Cornell University) · Cited by 3
A Brief Look at Generalization in Visual Meta-Reinforcement LearningPreprint
Alver, S., & Precup, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07262 · Cited by 5
REALab: An Embedded Perspective on TamperingPreprint
Kumar, R., Uesato, J., Ngo, R., Everitt, T., Krakovna, V., & Legg, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.08820 · Cited by 3
Meta-Learning Guarantees for Online Receding Horizon Learning ControlPreprint
Muthirayan, D. R. P., & Khargonekar, P. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11327 · Cited by 3
One-shot learning of paired associations by a reservoir computing model with Hebbian plasticityPreprint
Kumar, M. G., Tan, C., Libedinsky, C., Yen, S., & Tan, A. K. (2022) · arXiv (Cornell University) · doi:10.57736/ww-77df-61e4 · Cited by 3
Demircioğlu, U., & Bakır, H. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.112692 · Cited by 2
A DEEP REINFORCEMENT LEARNING APPROACH TO THE ANCIENT INDIAN GAME - CHOWKA BHARA
Patil, A. P., Raghavendra, S., & Ram, S. S. A. R. (2022) · IADIS International Conference on Interfaces and Human Computer Interaction and International Conference on Game and Entertainment Technologies (IHCI/GET) · doi:10.33965/ihci_get2022_202205c028 · Cited by 2
McClelland, J. L., & Botvinick, M. (2024) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780190917982.013.8 · Cited by 2
Self-citationMeta-Reinforcement Learning by Tracking Task Non-stationarity
Poiani, R., Tirinzoni, A., & Restelli, M. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/399 · Cited by 8
Reinforcement Learning System of UAV for Antenna Beam Localization
Omi, S., Shin, H., Tsourdos, A., Espeland, J., & Buchi, A. (2021) · IEEE Conference on Antenna Measurements & Applications · doi:10.1109/cama49227.2021.9703640 · Cited by 2
Stochastic Activation Actor Critic Methods
Shang, W., van der Wal, D., van Hoof, H., & Welling, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46133-1_7 · Cited by 2
Selecting Algorithms Without Meta-features
Lukáč, M., Bayanov, A., Li, A., Abiyeva, K., Izbassarova, N., Gabidolla, M., & Kameyama, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68799-1_44 · Cited by 2
Asayesh, S., Chen, M., Mehrandezh, M., & Gupta, K. K. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-26889-2_19 · Cited by 2
A model-based approach to meta-Reinforcement Learning: Transformers and tree search
Pinon, B., Jungers, R. M., & Delvenne, J. (2023) · European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) · doi:10.14428/esann/2023.es2023-117 · Cited by 4
Yang, Y., Shao, C., Zuo, J., & Shi, C. (2024) · World Conference on Computing and Communication Technologies (WCCCT) · doi:10.1109/wccct60665.2024.10541826 · Cited by 2
Malaysia, U. T. H. O., Mubarak, Z. K., Selimin, M. A., & Malaysia, U. T. H. O. (2024) · International Journal of Sustainable Construction Engineering Technology · doi:10.30880/ijscet.2024.15.01.006 · Cited by 2
Meta-Learning Related Tasks with Recurrent Networks: Optimization and Generalization
Nguyen, T., Younger, A. S., Redd, E., & Obafemi-Ajayi, T. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489583 · Cited by 2
Distributed Continuous Control with Meta Learning on Robotic Arms
Chen, K., & Wang, S. (2018) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2018.00522 · Cited by 2
Meta-Reward Model Based on Trajectory Data with k-Nearest Neighbors Method
Zhu, X., & Sugawara, T. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207388 · Cited by 2
Bridging Computational Neuroscience and Machine Learning on Non-Stationary Multi-Armed BanditsPreprint
Velentzas, G., Tzafestas, C. S., & Khamassi, M. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/117598 · Cited by 2
Deep Episodic Value Iteration for Model-based Meta-Reinforcement LearningPreprint
Hansen, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.03562 · Cited by 2
Meta-Learning with Hessian-Free Approach in Deep Neural Nets TrainingPreprint
Chen, B., Lu, W., & Fokoue, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08462 · Cited by 2
Continual and Multi-task Reinforcement Learning With Shared Episodic MemoryPreprint
Sorokin, A. Y., & Burtsev, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02662 · Cited by 6
Zero-shot task adaptation by homoiconic meta-mappingPreprint
Lampinen, A. K., & McClelland, J. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09950 · Cited by 2
Model-Agnostic Meta-Learning using Runge-Kutta MethodsPreprint
Im, D. J., Jiang, Y., & Verma, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07368 · Cited by 2
Bottom-Up Meta-Policy SearchPreprint
Melo, L. C., Máximo, M. R. O. A., & da Cunha, A. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.10232 · Cited by 3
Psychological and Neural Evidence for Reinforcement Learning: A Survey.Preprint
Subramanian, A., Chitlangia, S., & Baths, V. (2020) · arXiv (Cornell University) · Cited by 2
On the Reliability and Generalizability of Brain-inspired Reinforcement Learning AlgorithmsPreprint
Kim, D., Lee, J. H., Shin, J. H., Yang, M. A., & Lee, S. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.04578 · Cited by 2
Submodular Meta-LearningPreprint
Adibi, A., Mokhtari, A., & Hassani, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.05852 · Cited by 2
Meta-Learning of Compositional Task Distributions in Humans and Machines.Preprint
Kumar, S., Dasgupta, I., Cohen, J., Daw, N. D., & Griffiths, T. L. (2020) · arXiv (Cornell University) · Cited by 2
Exploration by Maximizing Rényi Entropy for Reward-Free RL FrameworkPreprint
Zhang, C., Cai, Y., Huang, L., & Li, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06193 · Cited by 2
Sparse Attention Guided Dynamic Value Estimation for Single-Task Multi-Scene Reinforcement LearningPreprint
Singh, J., & Zheng, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07266 · Cited by 2
Wang, B., Xu, S., Keutzer, K., Gao, Y., & Wu, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.06386 · Cited by 7
Local Information Agent Modelling in Partially-Observable EnvironmentsPreprint
Papoudakis, G., Christianos, F., & Albrecht, S. V. (2020) · arXiv (Cornell University) · Cited by 2
Hindsight Foresight Relabeling for Meta-Reinforcement LearningPreprint
Wan, M., Peng, J., & Gangwani, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.09031 · Cited by 4
Meta-Learning with Adjoint MethodsPreprint
Li, S., Wang, Z., Narayan, A., Kirby, R. M., & Zhe, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08432 · Cited by 2
Provably Improved Context-Based Offline Meta-RL with Attention and Contrastive LearningPreprint
Li, L., Huang, Y., Chen, M., Luo, S., Luo, D., & Huang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10774 · Cited by 14
Model-Free Risk-Sensitive Reinforcement LearningPreprint
Delétang, G., Grau-Moya, J., Kunesch, M., Genewein, T., Brekelmans, R., Legg, S., & Ortega, P. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.02907 · Cited by 10
Neural Auto-CurriculaPreprint
Feng, X., Slumbers, O., Wan, Z., Liu, B., McAleer, S., Wen, Y., Wang, J., & Yang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02745 · Cited by 6
Self-citationBayes meets Bernstein at the Meta Level: an Analysis of Fast Rates in Meta-Learning with PAC-BayesPreprint
Riou, C., Alquier, P., & Chérief-Abdellatif, B.-E. (2023) · HAL · doi:10.48550/arxiv.2302.11709 · Cited by 2
Long short-term prediction guides human metacognitive reinforcement learningPreprint
Lee, S. W., Kim, D., Lee, J. H., Jung, W., & Kim, S. H. (2023) · Research Square · doi:10.21203/rs.3.rs-3080402/v1 · Cited by 2
Patel, V., Shrivastava, A., Nagar, S. K., & GUPTA, N. (2023) · doi:10.61909/isbn.978-81-966743-8-0.amkedtb122304 · Cited by 2
Shen, T., & Dayan, P. (2024) · eLife · doi:10.7554/elife.100366.1 · Cited by 2
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0006 · Cited by 1
A stable method for task priority adaptation in quadratic programming via reinforcement learning
Testa, A., Laghi, M., Bianco, E. D., Raiola, G., Hoffman, E. M., & Ajoudani, A. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102857 · Cited by 1
Searching for Meaning in RNNs using Deep Neural Inspection
Lin, K., & Wu, E. (2017) · doi:10.7916/d8h13dgd · Cited by 1
Few-Shot Learning Based on Attention Relation Compare Network
Ma, X., Yu, C., Yang, X. S., & Chen, X. (2019) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2019.00100 · Cited by 1
Optimizing Recurrent Neural Network Using Neuromodulation
Hiremath, A., Sayyed, I., Ijari, K., Bhat, M., Jain, A., Meti, A. S., Gurlahosur, S. V., & Vyakaranal, S. B. (2021) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt51525.2021.9580032 · Cited by 1
Attentive One-Shot Meta-Imitation Learning From Visual Demonstration
Bhutani, V., Majumder, A., Vankadari, M. B., Dutta, S., Asati, A., & Kumar, S. (2022) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra46639.2022.9812281 · Cited by 1
Celebrating Robustness in Efficient Off-Policy Meta-Reinforcement Learning
Liu, Z., Li, Z., Cao, Q., Wan, Y., & Guo, X. (2022) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar54675.2022.9872291 · Cited by 1
Lü, W., Zhang, S., Tseng, H. E., Singh, B., Filev, D., & Peng, H. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981621 · Cited by 1
Efficient Data-Driven Modeling of Nonlinear Dynamical Systems via Metalearning
Li, S., & Yang, Y. (2023) · Journal of Engineering Mechanics · doi:10.1061/jenmdt.emeng-6917 · Cited by 1
Gaudet, B., & Furfaro, R. (2023) · AIAA SciTech Forum · doi:10.2514/6.2023-1628 · Cited by 1
Fedorov, E., Nechyporenko, О., Chychuzhko, M., Chychuzhko, V., & Leshchenko, R. (2023) · RADIOELECTRONIC AND COMPUTER SYSTEMS · doi:10.32620/reks.2023.2.05 · Cited by 2
Pu, Y., & Bei, C. (2023) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2632/1/012032 · Cited by 1
Enhancing Few-Shot 3D Point Cloud Semantic Segmentation through Bidirectional Prototype Learning
Guo, X., Hu, H. M., Yang, X., & Deng, Y. (2023) · doi:10.1145/3637843.3637848 · Cited by 1
Unsupervised Training Sequence Design: Efficient and Generalizable Agent Training
Li, W., & Varakantham, P. R. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29268 · Cited by 1
Relabeling and policy distillation of hierarchical reinforcement learning
Zou, Q., Zhao, X., Gao, B., Chen, S., Liu, Z., & Zhang, Z. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02192-6 · Cited by 1
Vaart, P. V. D., Spaan, M. T. J., & Yorke‐Smith, N. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i20.35393 · Cited by 1
Learning Intuitive Physics and One‐Shot Imitation Using State‐Action‐Prediction Self‐Organizing Maps
Stetter, M., & Lang, E. W. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/5590445 · Cited by 1
Kovač, M. (2020) · Springer eBooks · doi:10.1007/978-3-030-53644-2_5 · Cited by 1
Learning model-based strategies in simple environments with hierarchical q-networksPreprint
Müyesser, N. A., Dunovan, K., & Verstynen, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.06689 · Cited by 1
Neural Conditional GradientsPreprint
Schramowski, P., Bauckhage, C., & Kersting, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04300 · Cited by 2
Interactive Agent Modeling by Learning to ProbePreprint
Shu, T., Xiong, C., Wu, Y. N., & Zhu, S. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00510 · Cited by 1
Local Nonparametric Meta-LearningPreprint
Goo, W., & Niekum, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.03272 · Cited by 1
Metadata
- Authors
- Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1611.05763
- OpenAlex
- W2550182557
- Cited by
- 579
- References
- 32
- Citations by year
- 2026: 2 · 2025: 17 · 2024: 47 · 2023: 59 · 2022: 79 · 2021: 104 · 2020: 117 · 2019: 69 · 2018: 61 · 2017: 22 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- meta-learning, recurrent neural networks, training data efficiency, learned dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
