The DOI matches its DataCite record; 45 of the 45 references it cites were found in a registry or an index.
Learning to reinforcement learn
Open accessAbstract
In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A critical present objective is thus to develop deep RL methods that can adapt rapidly to new tasks. In the present work we introduce a novel approach to this challenge, which we refer to as deep meta-reinforcement learning. Previous work has shown that recurrent networks can support meta-learning in a fully supervised context. We extend this approach to the RL setting. What emerges is a system that is trained using one RL algorithm, but whose recurrent dynamics implement a second, quite separate RL procedure. This second, learned RL algorithm can differ from the original one in arbitrary ways. Importantly, because it is learned, it is configured to exploit structure in the training domain. We unpack these points in a series of seven proof-of-concept experiments, each of which examines a key aspect of deep meta-RL. We consider prospects for extending and scaling up the approach, and also point out some potentially important implications for neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Even though finding an analytical expression of the Bayes-optimal policy is often impossible, it is straightforward to meta-learn an approximation to it (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Of particular interest due to their potential and novelty are the following methods: curriculum learning [37], incremental environment complexity [39], and continual learning and policy distillation for multiple tasks [12].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Owing to the more specific environment and sensor suites that are required for different navigation tasks, custom simulators have often been used [36], [37], or simulation worlds have been created using Unity, Unreal Engine, or Gazebo [39], [42].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While our exposition in this section focused on the supervised learning case, the same ideas can also be readily extended to the reinforcement learning setting (Duan et al., 2016; Wang et al., 2016).”
From Meta-learned models of cognition (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“One way to address these shortcomings are meta-RL approaches, where adaptive agents are pre-trained on diverse task distributions to significantly increase sample efficiency on new problems”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“we are providing near-single-file implementations of recurrent PPO (Schulman et al., 2017) for single-task environments and its extension to RL 2 (Duan et al., 2016; Wang et al., 2016) for meta-learning as baselines.”
From XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX (2024) · cites this paper as Wang et al., 2016
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Sim-to-real transfer for DRL policies can be applied to complex navigation tasks: from six-legged robots [37] to depth-based mapless navigation [39], including robots for soccer competitions [36].”
From Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey (2020) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Self-citationReinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Finite-time Analysis of the Multiarmed Bandit Problem
Auer, P., Cesa-Bianchi, N., & Fischer, P. (2002) · Machine Learning · doi:10.1023/a:1013689704352 · Cited by 6,033
Neural Architecture Search with Reinforcement LearningPreprint
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,705
THOMPSON, W. R. (1933) · Biometrika · doi:10.1093/biomet/25.3-4.285 · Cited by 2,712
Research works printed but not linked: 5
- Marcos Economides, Zeb Kurth-Nelson, Annika Lübbert, Marc Guitart-Masip, and Raymond Dolan. Modelbased reasoning in humans becomes automatic with training. PLoS Computational Biology , 11(9):e1004463, 2015.
- Emilie Kaufmann, Olivier Cappé, and Aurélien Garivier. On bayesian upper confidence bounds for bandit problems. In Proc. of Int'l Conf. on Artificial Intelligence and Statistics, AISTATS , 2012a.
- Tor Lattimore and Rémi Munos. Bounded regret for finite-armed structured bandits. In Advances in Neural Information Processing Systems 27 , pages 550-558, 2014.
- Dan Russo and Benjamin Van Roy. Learning to optimize via information-directed sampling. In Advances in Neural Information Processing Systems 27 , pages 1583-1591, 2014.
- Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap. Meta-learning with memory-augmented neural networks. In Proceedings of The 33rd International Conference on Machine Learning , pages 1842-1850, 2016.
Cited by
Sorted by citations
Items 501–592 of 592
EgoMap: Projective mapping and structured egocentric memory for Deep RLPreprint
Beeching, E., Wolf, C., Dibangoye, J., & Simonin, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.02286 · Cited by 1
Generalized Reinforcement Meta Learning for Few-Shot OptimizationPreprint
Anantha, R., Pulman, S., & Chappidi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.01246 · Cited by 2
Importance Weighted Policy Learning and Adaption.Preprint
Galashov, A., Sygnowski, J., Desjardins, G., Humplik, J., Hasenclever, L., Jeong, R., Teh, Y. W., & Heess, N. (2020) · arXiv (Cornell University) · Cited by 1
Li, L., Yang, R., & Luo, D. (2020) · arXiv (Cornell University) · Cited by 1
Variable-Shot Adaptation for Online Meta-LearningPreprint
Yu, T., Geng, X., Finn, C., & Levine, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.07769 · Cited by 1
Improved Context-Based Offline Meta-RL with Attention and Contrastive Learning.Preprint
Li, L., Huang, Y., & Luo, D. (2021) · arXiv (Cornell University) · Cited by 1
What is Going on Inside Recurrent Meta Reinforcement Learning Agents?Preprint
Alver, S., & Precup, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.14644 · Cited by 4
HMRL: Hyper-Meta Learning for Sparse Reward Reinforcement Learning ProblemPreprint
Hua, Y., Wang, X., Jin, B., Li, W., Yan, J., He, X., & Hongyuan Zha, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04238 · Cited by 1
Meta-Reinforcement Learning for Heuristic PlanningPreprint
Gutiérrez, R. L., & Leonetti, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02603 · Cited by 1
Prior Is All You Need to Improve the Robustness and Safety for the First Time Deployment of Meta RL.Preprint
Wen, L., Zhang, S., Tseng, H. E., Singh, B., Filev, D., & Peng, H. (2021) · arXiv (Cornell University) · Cited by 1
Learning Meta Representations for Agents in Multi-Agent Reinforcement LearningPreprint
Zhang, S., Shen, L., Han, L., & Shen, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.12988 · Cited by 1
Eden: A Unified Environment Framework for Booming Reinforcement Learning AlgorithmsPreprint
Chen, R., Wu, X., Pan, Y., Yuan, K., Li, L., Ma, T., Liang, J., Zhang, R., Wang, K., Zhang, C., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.01768 · Cited by 2
Few-shot Quality-Diversity Optimisation.Preprint
Salehi, A., Coninx, A., & Doncieux, S. (2021) · arXiv (Cornell University) · Cited by 1
On the Practical Consistency of Meta-Reinforcement Learning AlgorithmsPreprint
Xiong, Z., Zintgraf, L., Beck, J., Vuorio, R., & Whiteson, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00478 · Cited by 3
A Deep Reinforcement Learning Approach to The Ancient Indian Game - Chowka BharaPreprint
Patil, A. P., Raghavendra, S., Srinarasi, S., & Ram, R. (2021) · doi:10.36227/techrxiv.16780414 · Cited by 1
Fleet Planning Under Demand and Fuel Price UncertaintyPreprint
Geursen, I. L., Santos, B. F., & Yorke‐Smith, N. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3990594 · Cited by 1
A Data-efficiency Training Framework for Deep Reinforcement LearningPreprint
Feng, W., Han, C., Lian, F., & Liu, X. (2022) · Preprints.org · doi:10.20944/preprints202209.0483.v1
Kadi, H. A., & Terzić, K. (2022) · Preprints.org · doi:10.20944/preprints202212.0305.v1 · Cited by 1
Meta-Learning Strategies through Value Maximization in Neural NetworksPreprint
Carrasco-Davis, R., Masis, J. A., & Saxe, A. (2023) · PubMed · doi:10.48550/arxiv.2310.19919 · Cited by 7
Tuzsus, D., Pappas, I., & Peters, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.05.09.593363 · Cited by 1
Zhang, S., Tian, Y., Liu, Q., & Wu, H. (2024) · eLife · doi:10.7554/elife.92892.2 · Cited by 1
Kuo, P.-C., Hou, H., Dabney, W., & Walker, E. Y. (2025) · arXiv
“Memory-based meta-RL Exemplified by RL 2 [6, 7], memory-based meta-RL emerges as a powerful method for learning adaptive policies across related tasks.”
InfluentialArtificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning
Cook, J., Lu, C., Hughes, E., Leibo, J. Z., & Foerster, J. (2024) · arXiv · doi:10.48550/arxiv.2406.00392 · Cited by 6
“One common approach to meta-RL uses gradient-based optimisation to train a meta-policy with respect to M using recurrent network architectures [Duan et al., 2016, Wang et al., 2016].”
MethodSelf-citation- Self-citation
Binz, M. (2002) · CRC Press eBooks · doi:10.1201/9780203164587.ch3
A Useful Motif for Flexible Task Learning in an Embodied Two-Dimensional Visual EnvironmentPreprint
Feigelis, K., & Yamins, D. L. K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.07147
Algorithm Selection for Reinforcement LearningPreprint
Laroche, R., & Féraud, R. (2017) · arXiv (Cornell University)
General AI Challenge - Round One: Gradual LearningPreprint
Feyereisl, J., Nikl, M., Poliak, M., Stránský, M., & Vlasak, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05346 · Cited by 1
Modular Continual Learning in a Unified Visual EnvironmentPreprint
Feigelis, K., Sheffer, B., & Yamins, D. L. K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07425
Why Learning Has Aha-Moments and Why We Should Also Reward Effort, Not Just Results
Uranga, G., Крейнович, В., & Kosheleva, O. M. (2018) · scholarworks - UTEP (The University of Texas at El Paso)
Learning Shared Dynamics with Meta-World ModelsPreprint
Wu, L., Li, M., & Wang, Y.-X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01741
Where Do Human Heuristics Come From?Preprint
Binz, M., & Endres, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07580
One-Shot Generation of Near-Optimal Topology through Theory-Driven Machine LearningPreprint
Cang, R., Yao, H., & Ren, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.10787
Scaling characteristics of sequential multitask learning: Networks naturally learn to learn
Davidson, G., & Mozer, M. C. (2019)
Agent Probing Interaction PoliciesPreprint
Ghiya, S., Azeez, O., & Miller, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09535
Learning Data-Driven Objectives to Optimize Interactive SystemsPreprint
Li, Z., Kiseleva, J., Agarwal, A., & de Rijke, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.06306 · Cited by 3
Planning with Brain-inspired AIPreprint
Arakawa, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12353 · Cited by 1
Towards intervention-centric causal reasoning in learning agentsPreprint
Lansdell, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.12968
Exploration by Maximizing Rényi Entropy for Zero-Shot Meta RL.Preprint
Zhang, C., Cai, Y., Huang, L., & Li, J. (2020) · arXiv (Cornell University)
Recurrent Neural-Linear Posterior Sampling for Nonstationary Contextual Bandits
Ramesh, A., Rauber, P., Conserva, M., & Schmidhuber, J. (2022) · Neural Computation · doi:10.1162/neco_a_01539
MTL2L: A Context Aware Neural OptimiserPreprint
Kuo, N. I.-H., Harandi, M. T., Fourrier, N., Walder, C., Ferraro, G., & Suominen, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.09343
Biological Reinforcement Learning via Predictive Spacetime EncodingPreprint
Yang, M. A., Lee, J. H., & Lee, S. W. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.21.260844
A Meta-Learning Control Algorithm with Provable Finite-Time GuaranteesPreprint
Muthirayan, D. R. P., & Khargonekar, P. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.13265
A Matching Network Focusing on the Relation between Samples
Zhao, J. L., & Gao, F. (2020) · IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA) · doi:10.1109/iciba50161.2020.9276759
Transfer Reinforcement Learning across Homotopy ClassesPreprint
Cao, Z., Kwon, M., & Sadigh, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05207
Computational Prometheus: How reinforcement was stolen, and how to steal it backPreprint
Jensen, G., & Freestone, D. M. (2018) · doi:10.31234/osf.io/4mtns
Evaluating Meta-Reinforcement Learning through a HVAC Control Benchmark (Student Abstract)
Grewal, Y. S., de Nijs, F., & Goodwin, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i18.17889
What underlies rapid learning and systematic generalization in humans.Preprint
Nam, A., & McClelland, J. L. (2021) · arXiv (Cornell University)
Learning to Represent State with Perceptual Schemata
Carvalho, W., & Shanahan, M. (2021) · International Conference on Machine Learning
Hindsight Reward Tweaking via Conditional Deep Reinforcement LearningPreprint
Wei, N., Liang, J., Xie, D., & Pu, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.02332
Dagar, S., Alexandre, F., & Rougier, N. P. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534315
Knowledge is reward: Learning optimal exploration by predictive reward cashingPreprint
Ambrogioni, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.08518 · Cited by 1
2022 roadmap on neuromorphic computing and engineering
Christensen, D. V., Dittmann, R., Linares-Barranco, B., Sebastian, A., Le Gallo, M., Redaelli, A., Slesazeck, S., Mikolajick, T., Spiga, S., Menzel, S., et al. (2022) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac4a83
Learning to Cooperate with Unseen Agent via Meta-Reinforcement LearningPreprint
Charakorn, R., Manoonpong, P., & Dilokthanakul, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.03431 · Cited by 2
Exploration With a Finite BrainPreprint
Binz, M., & Schulz, E. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qx4h5
A Deep Reinforcement Learning Approach to The Ancient Indian Game - Chowka BharaPreprint
Patil, A. P., Raghavendra, S., Srinarasi, S., & Ram, R. (2021) · doi:10.36227/techrxiv.16780414.v1
Accelerating Robot Reinforcement Learning with Samples of Different Simulation Precision
Zhao, Y. B., Zhai, Y., Luo, J., Feng, D., Ding, B., & Li, Z. (2021) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys53884.2021.00080
Separating Explorer for Task Inference Based Meta Reinforcement Learning Algorithm
Gong, L., Ling, X., Lu, J., Zhou, J., & Xue, L. (2021) · International Conference on Networking Systems of AI (INSAI) · doi:10.1109/insai54028.2021.00048
Adversarial Discriminative Feature Separation for Generalization in Reinforcement Learning
Liu, Y. K., Wu, C., Xi, X., Li, Y., Cao, G., Cao, W., & Wang, H. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892539
Predicting Other’s Minds Using Model-based Reinforcement Learning
Joo, H., Jeong, I., Baek, J. W., & Lee, S. W. (2022) · Joint International Conference on Soft Computing and Intelligent Systems and International Symposium on Advanced Intelligent Systems (SCIS&ISIS) · doi:10.1109/scisisis55246.2022.10001864
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0008
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0003
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0007
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0002
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0004
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.002.0003
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.002.0004
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.002.0006
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0005
Summerfield, C. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780192843883.003.0001
Image Captioning: From Encoder-Decoder to Reinforcement Learning
Tang, Y. (2022) · International Conference on Imaging, Signal Processing and Communications (ICISPC) · doi:10.1109/icispc57208.2022.00009
Soft Action Priors: Towards Robust Policy Transfer
Centa, M., & Preux, P. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25850
Towards Clear Evaluation of Robotic Visual Semantic Navigation
Gutiérrez-Álvarez, C., Hernández-García, S., Nasri, N., Cuesta‐Infante, A., & López-Sastre, R. J. (2023) · International Conference on Automation, Robotics and Applications · doi:10.1109/icara56516.2023.10125866
Biologically plausible gated recurrent neural networks for working memory and learning-to-learnPreprint
van den Berg, A. R., Roelfsema, P. R., & Bohté, S. M. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.06.547911
Performance Analysis for a Recommending System Based on Partially Observed Markov Decision Processes
Cai, X. (2023) · International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE) · doi:10.1109/icbaie59714.2023.10281325
A Review on Bayesian Meta-Learning for Robot Mapping and NavigationPreprint
Nayak, S. K., & Pal, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4673996
DYNAMIC PROGRAMMING FOR SOLVE THE INVENTORY MANAGEMENT PROBLEM IN LOGISTICS
Fedorov, E., Nechyporenko, О., Neskorodieva, T., & Leshchenko, M. M. (2024) · Computer Systems and Information Technologies · doi:10.31891/csit-2024-1-14 · Cited by 1
Spike-Based Learning with Multi-compartment Model
Yang, S., & Chen, B. (2024) · Synthesis lectures on engineering, science, and technology · doi:10.1007/978-3-031-57873-1_2
SOMeL: Multi-Granular Optimized Framework for Digital Neuromorphic Meta-Learning
Yang, S., He, Q., & Azghadi, M. R. (2024) · IEEE International Instrumentation and Measurement Technology Conference · doi:10.1109/i2mtc60896.2024.10560828
Graceful Task Adaptation with a Bi-hemispheric RL Agent
Nicholas, G., Kuhlmann, L., & Kowadlo, G. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0351-0_3
Biologically plausible gated recurrent neural networks for working memory and learning-to-learn
van den Berg, A. R., Roelfsema, P. R., & Bohté, S. M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0316453
Güitta-López, L., Güitta-López, L., Martín-Larrauri, J. B., & López, Á. J. L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5158700
Zhang, S., Tian, Y., Liu, Q., & Wu, H. (2025) · eLife · doi:10.7554/elife.92892.3
Kim, J., & Lee, J. H. (2025) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2025.1559915
Civitas: A Reflexive Cognitive Architecture for Ethically Governed Causal InferencePreprint
Mazzocchetti, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5362693
Kim, J., & Kang, D. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3688
Kuo, P.-C., Hou, H., Dabney, W., & Walker, E. (2025) · Advances in Neural Information Processing Systems 38 · doi:10.52202/085713-0945
Zweiger, A., Pari, J., Guo, H., Akyürek, E., Kim, Y., & Agrawal, P. (2025) · arXiv · Cited by 3
“SEAL learns how to best utilize this external data for self-improvement.”
Solving Rubik's Cube with a Robot Hand
OpenAI, Akkaya, I., Andrychowicz, M., Chociej, M., Litwin, M., McGrew, B., Petron, A., Paino, A., Plappert, M., Powell, G., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.07113 · Cited by 602
Metadata
- Authors
- Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M.
- Affiliations
- Google DeepMind (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1611.05763
- OpenAlex
- W2550182557
- Cited by
- 579
- References
- 32
- Citations by year
- 2026: 2 · 2025: 17 · 2024: 47 · 2023: 59 · 2022: 79 · 2021: 104 · 2020: 117 · 2019: 69 · 2018: 61 · 2017: 22 · 2016: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Keywords
- meta-learning, recurrent neural networks, training data efficiency, learned dynamics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
