Towards Continual Reinforcement Learning: A Review and Perspectives

Khetarpal, Khimya, Riemer, Matthew, Rish, Irina, Precup, Doina·2022·Journal of Artificial Intelligence Research
DOI 10.1613/jair.1.13673

Cites (474)

Items 201–400 of 436

  1. Generalization of value in reinforcement learning by humans
    Wimmer, G. Elliott, Daw, Nathaniel D., Shohamy, Daphna · 2012 · European Journal of Neuroscience
  2. CURIOUS: Intrinsically Motivated Modular Multi-Goal Reinforcement Learning
    Cédric Colas, Fournier, Pierre, Olivier Sigaud, Mohamed Chétouani, Pierre‐Yves Oudeyer · 2018 · arXiv (Cornell University)
  3. The Benefit of Multitask Representation Learning
    Maurer, Andreas, Massimiliano Pontil, Bernardino Romera‐Paredes · 2015 · arXiv (Cornell University)
  4. Playing FPS Games with Deep Reinforcement Learning
    Guillaume Lample, Devendra Singh Chaplot · 2016 · arXiv (Cornell University)
  5. Multi-Agent Learning with Policy Prediction
    Chongjie Zhang, Victor Lesser · 2010 · Proceedings of the AAAI Conference on Artificial Intelligence
  6. Minecraft, Beyond Construction and Survival
    Sean C. Duncan · 2019 · Figshare
  7. Belief state representation in the dopamine system
    Babayan, Benedicte M., Uchida, Naoshige, Gershman, Samuel. J. · 2018 · Nature Communications
  8. Where Do Rewards Come From
    Andrew G. Barto, Richard L. Lewis, Satinder Pal Singh · 2009 · eScholarship (California Digital Library)
  9. A theory for how sensorimotor skills are learned and retained in noisy and nonstationary neural circuits
    Robert Ajemian, Alessandro D’Ausilio, Helene G. Moorman, Emilio Bizzi · 2013 · Proceedings of the National Academy of Sciences
  10. Routing Networks: Adaptive Selection of Non-linear Functions for Multi-Task Learning
    Clemens Rosenbaum, Tim Klinger, Matthew Riemer · 2017 · arXiv (Cornell University)
  11. A Laplacian Framework for Option Discovery in Reinforcement Learning
    Marlos C. Machado, Marc G. Bellemare, Michael Bowling · 2017 · arXiv (Cornell University)
  12. Generalization and Regularization in DQN
    Farebrother, Jesse, Machado, Marlos C., Bowling, Michael · 2018 · arXiv
  13. Learning to Learn: Meta-Critic Networks for Sample Efficient Learning
    Flood Sung, Zhang Li, Tao Xiang, Timothy M. Hospedales, Yongxin Yang · 2017 · arXiv (Cornell University)
  14. Pseudo-rehearsal: Achieving deep reinforcement learning without catastrophic forgetting
    Craig Atkinson, Brendan Mccane A, Lech Szymanski, Anthony V. Robins · 2020 · Neurocomputing
  15. Bayesian Decision Problems and Markov Chains
    Paul H. Randolph, J. J. Martin · 1968 · Technometrics
  16. Multi-task Reinforcement Learning in Partially Observable Stochastic Environments
    Hui Li, Xuejun Liao, Lawrence Carin · 2009
  17. Multi-Task Reinforcement Learning with Soft Modularization
    Ruihan Yang, Huazhe Xu, Wu, Yi, Xiaolong Wang · 2020 · arXiv (Cornell University)
  18. Reinforcement Learning and Its Relationship to Supervised Learning
    Andrew G. Barto, Thomas G. Dietterich · 2009 · Institute of Electrical and Electronics Engineers eBooks
  19. Child: A First Step Towards Continual Learning
    Ring, Mark B. · 1998 · Learning to Learn
  20. Consolidation in Neural Networks and in the Sleeping Brain
    Anthony V. Robins · 1996 · Connection Science
  21. Superposition of many models into one
    Brian Cheung, A. L. Terekhov, Yubei Chen, Pulkit Agrawal, Bruno A. Olshausen · 2019 · arXiv (Cornell University)
  22. Variational Option Discovery Algorithms
    Joshua Achiam, Harrison S. Edwards, Dario Amodei, Pieter Abbeel · 2018 · arXiv (Cornell University)
  23. Meta reinforcement learning as task inference
    Humplik, Jan, Galashov, Alexandre, Hasenclever, Leonard, Ortega, Pedro A., Teh, Yee Whye, Heess, Nicolas · 2019 · arXiv
  24. Curiosity-driven Exploration in Deep Reinforcement Learning via Bayesian Neural Networks
    Rein Houthooft, Xi Chen, Yan Duan, John D. Schulman, F. de Turck, P. Abbeel · 2016 · arXiv.org
  25. Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
    M. Caccia, Pau Rodríguez, Oleksiy Ostapenko, Fabrice Normandin, Min Lin, Lucas Caccia, Issam Laradji, Irina Rish, Alexandre Lacoste, David Vázquez et al. · 2020 · arXiv (Cornell University)
  26. Learning to Continually Learn
    Shawn Beaulieu, Frati, Lapo, Thomas Miconi, Joel Lehman, Kenneth Owen Stanley, Jeff Clune, Nick Cheney · 2020 · arXiv (Cornell University)
  27. PAC-inspired Option Discovery in Lifelong Reinforcement Learning
    Emma Brunskill, Lihong Li · 2014
  28. Bootstrap Latent-Predictive Representations for Multitask Reinforcement Learning
    Zhaohan Daniel Guo, Bernardo Ávila Pires, Bilal Piot, Jean-Bastien Grill, Florent Altché, Rémi Munos, Mohammad Gheshlaghi Azar · 2020 · arXiv (Cornell University)
  29. State Abstractions for Lifelong Reinforcement Learning
    David Lynn Abel, Dilip Arumugam, Lucas Lehnert, Michael L. Littman · 2018 · International Conference on Machine Learning
  30. Optimizing agent behavior over long time scales by transporting value
    Chia-Chun Hung, Timothy Lillicrap, Josh Abramson, Yan Wu, Mehdi Mirza, Federico Carnevale, Arun Ahuja, Greg Wayne · 2019 · Nature Communications
  31. Curiosity driven reinforcement learning for motion planning on humanoids
    Mikhail Frank, Jürgen Leitner, Marijn Stollenga, Alexander Förster, Jürgen Schmidhuber · 2014 · Frontiers in Neurorobotics
  32. Some Considerations on Learning to Explore via Meta-Reinforcement Learning
    Stadie, Bradly C., Yang, Ge, Houthooft, Rein, Chen, Xi, Duan, Yan, Wu, Yuhuai, Abbeel, Pieter, Sutskever, Ilya · 2018 · arXiv
  33. Intrinsic motivation and automatic curricula via asymmetric self-play
    Sainbayar Sukhbaatar, Zeming Lin, Ilya Kostrikov, Gabriel Synnaeve, Arthur D. Szlam, Rob Fergus · 2018 · International Conference on Learning Representations
  34. Learning Action Representations for Reinforcement Learning
    Yash Chandak, Georgios Theocharous, James Kostas, Scott M. Jordan, Philip S. Thomas · 2019 · arXiv (Cornell University)
  35. Computational models of reinforcement learning: the role of dopamine as a reward signal
    Rachel D. Samson, Michael J. Frank, Jean‐Marc Fellous · 2010 · Cognitive Neurodynamics
  36. Prediction-Based Multi-Agent Reinforcement Learning in Inherently Non-Stationary Environments
    Andrei Marinescu, Ivana Dusparić, Siobhán Clarke · 2017 · ACM Transactions on Autonomous and Adaptive Systems
  37. Eigenoption Discovery through the Deep Successor Representation
    Marlos C. Machado, Clemens Rosenbaum, Xiaoxiao Guo, Miao Liu, Gerald J. Tesauro, Murray S. Campbell · 2017 · arXiv (Cornell University)
  38. Combined Reinforcement Learning via Abstract Representations
    Vincent François-Lavet, Yoshua Bengio, Doina Precup, Joëlle Pineau · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  39. Discovering Reinforcement Learning Algorithms
    Junhyuk Oh, Matteo Hessel, Wojciech Marian Czarnecki, Zhongwen Xu, Hado P. van Hasselt, Satinder Pal Singh, David Silver · 2020 · arXiv (Cornell University)
  40. Improving Generalization in Meta Reinforcement Learning using Learned Objectives
    Louis Kirsch, Sjoerd van Steenkiste, Jürgen Schmidhuber · 2019 · arXiv (Cornell University)
  41. Distributional Reinforcement Learning in the Brain
    Adam S. Lowet, Zheng Qiao, Sara Matias, Jan Drugowitsch, Naoshige Uchida · 2020 · Trends in Neurosciences
  42. ProMP: Proximal Meta-Policy Search
    Jonas Rothfuss, Dennis M. Lee, Ignasi Clavera, Tamim Asfour, Pieter Abbeel · 2018 · arXiv (Cornell University)
  43. DeepMind Lab
    Beattie, Charles, Leibo, Joel Z., Teplyashin, Denis, Ward, Tom, Wainwright, Marcus, Küttler, Heinrich, Lefrancq, Andrew, Green, Simon, Valdés, Víctor, Sadik, Amir et al. · 2016 · arXiv
  44. Provably efficient RL with Rich Observations via Latent State Decoding
    Simon S. Du, Akshay Krishnamurthy, Jiang, Nan, Alekh Agarwal, Miroslav Dudı́k, John C. Langford · 2019 · arXiv (Cornell University)
  45. Learning Causal State Representations of Partially Observable Environments
    Amy Zhang, Zachary Chase Lipton, L. Pineda, K. Azizzadenesheli, Anima Anandkumar, L. Itti, Joelle Pineau, T. Furlanello · 2019 · arXiv.org
  46. Reinforcement Learning with Self-Modifying Policies
    Jürgen Schmidhuber, Jieyu Zhao, Nicol N. Schraudolph · 1998 · Springer eBooks
  47. Reinforcement Learning and Causal Models
    S. Gershman · 2017 · Oxford University Press eBooks
  48. Sparse multi-task reinforcement learning
    Daniele Calandriello, Alessandro Lazaric, Marcello Restelli · 2015 · Intelligenza Artificiale
  49. The role of executive function in shaping reinforcement learning
    Milena Rmus, Samuel D. McDougle, Anne Gabrielle Eva Collins · 2020 · Current Opinion in Behavioral Sciences
  50. Modular meta-learning
    Ferran Alet, Tomás Lozano‐Pérez, Leslie Pack Kaelbling · 2018 · arXiv (Cornell University)
  51. Recurrent Reinforcement Learning: A Hybrid Approach
    Xiujun Li, Lihong C. Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He · 2015 · arXiv (Cornell University)
  52. Modular Networks: Learning to Decompose Neural Computation
    Louis Kirsch, Julius Kunze, David Barber · 2018 · arXiv (Cornell University)
  53. Behaviour Suite for Reinforcement Learning
    Ian Osband, Yotam Doron, Matteo Hessel, John Aslanides, Eren Sezener, Saraiva, Andre, Katrina McKinney, Tor Lattimore, Csaba Szepesvári, Satinder Pal Singh et al. · 2019 · arXiv (Cornell University)
  54. Multi-Task Reinforcement Learning with Context-based Representations
    Shagun Sodhani, Amy Zhang, Joëlle Pineau · 2021 · arXiv (Cornell University)
  55. Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learning
    Tianmin Shu, Caiming Xiong, Richard Socher · 2017 · arXiv (Cornell University)
  56. Sharing Knowledge in Multi-Task Deep Reinforcement Learning
    Carlo D’Eramo, Davide Tateo, Andrea Bonarini, Marcello Restelli, Jan Peters · 2024 · arXiv (Cornell University)
  57. Is a Good Representation Sufficient for Sample Efficient Reinforcement Learning?
    Simon S. Du, Sham M. Kakade, Ruosong Wang, Lin Forrest Yang · 2019 · arXiv (Cornell University)
  58. Decoupling Dynamics and Reward for Transfer Learning
    Amy Zhang, Harsh Satija, Joëlle Pineau · 2018 · arXiv (Cornell University)
  59. Cyclic Equilibria in Markov Games
    Martin Zinkevich, Amy Greenwald, Michael L. Littman · 2005
  60. Discovery of Useful Questions as Auxiliary Tasks
    Vivek Veeriah, Matteo Hessel, Zhongwen Xu, Richard L. Lewis, Janarthanan Rajendran, Junhyuk Oh, Hado P. van Hasselt, David Silver, Satinder Pal Singh · 2019 · arXiv (Cornell University)
  61. Enhanced POET: Open-Ended Reinforcement Learning through Unbounded Invention of Learning Challenges and their Solutions
    Wang, Rui, Lehman, Joel, Rawal, Aditya, Zhi, Jiale, Li, Yulun, Clune, Jeff, Stanley, Kenneth O. · 2020 · arXiv
  62. CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agents
    Sam Powers, Eliot Xing, Eric Kolve, Roozbeh Mottaghi, A. Gupta · 2021 · CoLLAs
  63. Risk-Averse Bayes-Adaptive Reinforcement Learning
    Marc Rigter, Bruno Lacerda, Nick Hawes · 2021 · Neural Information Processing Systems
  64. Routing Networks and the Challenges of Modular and Compositional Computation
    Clemens Rosenbaum, Ignacio Cases, Matthew Riemer, Tim Klinger · 2019 · arXiv (Cornell University)
  65. Evolving Reinforcement Learning Algorithms
    John D. Co-Reyes, Miao, Yingjie, Daiyi Peng, Esteban Real, Sergey Levine, Quoc Viet Le, Honglak Lee, Aleksandra Faust · 2021 · arXiv (Cornell University)
  66. Invariant Causal Prediction for Block MDPs
    Amy Zhang, Clare Lyle, Shagun Sodhani, Angelos Filos, Marta Kwiatkowska, Joëlle Pineau, Yarin Gal, Doina Precup · 2020 · arXiv (Cornell University)
  67. CausalWorld: A Robotic Manipulation Benchmark for Causal Structure and Transfer Learning
    Ahmed, Ossama, Träuble, Frederik, Goyal, Anirudh, Neitz, Alexander, Bengio, Yoshua, Schölkopf, Bernhard, Wüthrich, Manuel, Bauer, Stefan · 2020 · arXiv
  68. Automatically Composing Representation Transformations as a Means for Generalization
    Michael B. Chang, Abhishek Gupta, Sergey Levine, Thomas L. Griffiths · 2018 · arXiv (Cornell University)
  69. Hidden-Mode Markov Decision Processes for Nonstationary Sequential Decision Making
    Samuel P. M. Choi, Dit‐Yan Yeung, Nevin Lianwen Zhang · 2000 · Lecture notes in computer science
  70. Continual Reinforcement Learning with Complex Synapses
    Christos Kaplanis, Murray Shanahan, Claudia Clopath A · 2018 · arXiv (Cornell University)
  71. Meta-learning of Sequential Strategies
    Ortega, Pedro A., Wang, Jane X., Rowland, Mark, Genewein, Tim, Kurth-Nelson, Zeb, Pascanu, Razvan, Heess, Nicolas, Veness, Joel, Pritzel, Alex, Sprechmann, Pablo et al. · 2019 · arXiv
  72. A Geometric Perspective on Optimal Representations for Reinforcement Learning
    Marc G. Bellemare, Will Dabney, Robert Dadashi, Adrien Ali Taïga, Pablo Samuel Castro, Nicolas Le Roux, Dale Schuurmans, Tor Lattimore, Clare Lyle · 2019 · arXiv (Cornell University)
  73. Automatic Data Augmentation for Generalization in Reinforcement Learning
    Roberta Răileanu, Maxwell Goldstein, Denis Yarats, Ilya Kostrikov, Rob Fergus · 2021 · arXiv (Cornell University)
  74. Reward Shaping via Meta-Learning
    Haosheng Zou, Tongzheng Ren, Dong Yan, Hang Su, Jun Zhu · 2019 · arXiv (Cornell University)
  75. Beyond Shared Hierarchies: Deep Multitask Learning through Soft Layer Ordering
    Elliot Meyerson, Risto P Miikkulainen · 2017 · arXiv (Cornell University)
  76. Learning Abstract Options
    Matthew Riemer, Miao Liu, Gerald J. Tesauro · 2018 · arXiv (Cornell University)
  77. Non-Stationary Markov Decision Processes a Worst-Case Approach using Model-Based Reinforcement Learning
    Erwan Lecarpentier, Emmanuel Rachelson · 2019 · Open Archive Toulouse Archive Ouverte (University of Toulouse)
  78. What Can Learned Intrinsic Rewards Capture?
    Zheng, Zeyu, Junhyuk Oh, Matteo Hessel, Zhongwen Xu, Kroiss, Manuel, Hado P. van Hasselt, David Silver, Satinder Pal Singh · 2019 · arXiv (Cornell University)
  79. FLAMBE: Structural Complexity and Representation Learning of Low Rank MDPs
    Alekh Agarwal, Sham M. Kakade, Akshay Krishnamurthy, Sun, Wen · 2020 · arXiv (Cornell University)
  80. Adaptive Skills, Adaptive Partitions (ASAP)
    Daniel J. Mankowitz, Timothy Mann, Shie Mannor · 2016 · arXiv (Cornell University)
  81. Transferring Knowledge across Learning Processes
    Sebastian Flennerhag, Pablo García Moreno, Neil David Lawrence, Andreas Damianou · 2018 · arXiv (Cornell University)
  82. The Option Keyboard: Combining Skills in Reinforcement Learning
    André da Motta Salles Barreto, Diana Borsa, Shaobo Hou, Gheorghe Comanici, Eser Aygün, Hamel, Philippe, Daniel Toyama, Jonathan J. Hunt, Shibl Mourad, David Silver et al. · 2019 · arXiv (Cornell University)
  83. Meta-Gradient Reinforcement Learning with an Objective Discovered Online
    Zhongwen Xu, Hado P. van Hasselt, Matteo Hessel, Junhyuk Oh, Satinder Pal Singh, David Silver · 2020 · arXiv (Cornell University)
  84. Meta-Q-Learning
    Rasool Fakoor, Pratik Chaudhari, Stefano Soatto, Alexander Johannes Smola · 2019 · arXiv (Cornell University)
  85. Hindsight policy gradients
    Paulo Rauber, Ummadisingu, Avinash, Filipe Wall Mutz, Jürgen Schmidhuber · 2017 · arXiv (Cornell University)
  86. Explore, discover and learn: unsupervised discovery of state-covering skills
    Campos Camúñez, Víctor, Trott, Alex, Caiming Xiong, Richard Socher, Xavier Giró-i-Nieto, Jordi Torres · 2020 · UPCommons institutional repository (Universitat Politècnica de Catalunya)
  87. Continual and Multi-Task Architecture Search
    Ramakanth Pasunuru, Mohit Bansal · 2019 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  88. Reinforcement Learning for Non-Stationary Markov Decision Processes: The Blessing of (More) Optimism
    Wang Chi Cheung, David Simchi‐Levi, Ruihao Zhu · 2020 · arXiv (Cornell University)
  89. Temporal-Logic-Based Reward Shaping for Continuing Reinforcement Learning Tasks
    Yuqian Jiang, Suda Bharadwaj, Bo Wu, Rishi Shah, Ufuk Topcu, Peter Stone · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  90. Guided Meta-Policy Search
    Russell Mendonca, Abhishek Gupta, Rosen Kralev, Pieter Abbeel, Sergey Levine, Chelsea Finn · 2019 · arXiv (Cornell University)
  91. Deep Reinforcement Learning amidst Lifelong Non-Stationarity
    Annie Xie, Harrison, James, Chelsea Finn · 2020 · arXiv (Cornell University)
  92. Posterior Meta-Replay for Continual Learning
    Henning, Christian, Maria R. Cervera, Francesco D'Angelo, Johannes von Oswald, Regina Traber, Benjamin Ehret, Seijin Kobayashi, Benjamin F. Grewe, João Sacramento · 2021 · Zurich Open Repository and Archive (University of Zurich)
  93. Unicorn: Continual Learning with a Universal, Off-policy Agent
    Daniel J. Mankowitz, Augustin Žídek, André da Motta Salles Barreto, Dan Horgan, Matteo Hessel, John Quan, Junhyuk Oh, Hado P. van Hasselt, David Silver, Tom Schaul · 2018 · arXiv (Cornell University)
  94. DisCoRL: Continual Reinforcement Learning via Policy Distillation
    Kalifou René Traoré, Hugo Caselles-Dupré, Timothée Lesort, Te Sun, Guanghang Cai, Natalia Díaz-Rodríguez, David Filliat · 2019 · arXiv (Cornell University)
  95. On Reward-Free Reinforcement Learning with Linear Function Approximation
    Ruosong Wang, Simon S. Du, Lin Forrest Yang, Ruslan Salakhutdinov · 2020 · arXiv (Cornell University)
  96. Automated curricula through setter-solver interactions
    Sébastien Racanière, Andrew K. Lampinen, Adam Santoro, David Reichert, Vlad Firoiu, Timothy Lillicrap · 2019 · arXiv (Cornell University)
  97. Generalized Proximal Policy Optimization with Sample Reuse
    James Queeney, Ioannis Ch. Paschalidis, Christos G. Cassandras · 2021 · OpenBU (Boston University)
  98. Organizing Experience: a Deeper Look at Replay Mechanisms for Sample-Based Planning in Continuous State Domains
    Yangchen Pan, Muhammad Zaigham Zaheer, Adam White, Andrew P. Patterson, Martha White · 2018 · International Joint Conference on Artificial Intelligence
  99. Behavioral considerations suggest an average reward TD model of the dopamine system
    Nathaniel D. Daw, David S. Touretzky · 2000 · Neurocomputing
  100. Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control
    Glen Berseth, Xie, Cheng, Paul T Cernek, Michiel van de Panne · 2018 · arXiv (Cornell University)
  101. Online Meta-Critic Learning for Off-Policy Actor-Critic Methods
    Wei Zhou, Yiying Li, Yongxin Yang, Huaimin Wang, Timothy M. Hospedales · 2020 · arXiv (Cornell University)
  102. Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning
    Haotian Fu, Hongyao Tang, Jianye Hao, Chen Chen, Xidong Feng, Li Dong, Wulong Liu · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  103. What is an Agent?
    Carol A. Rovane · 2004 · Synthese
  104. Subgoal- and Goal-related Reward Prediction Errors in Medial Prefrontal Cortex
    José J. F. Ribas Fernandes, Danesh Shahnazian, Clay B. Holroyd, Matthew Botvinick · 2018 · Journal of Cognitive Neuroscience
  105. On Q-learning Convergence for Non-Markov Decision Processes
    Sultan Javed Majeed, Marcus Hütter · 2018 · International Joint Conference on Artificial Intelligence
  106. Generalized Hindsight for Reinforcement Learning
    Alexander C. Li, Lerrel Pinto, Pieter Abbeel · 2020 · arXiv (Cornell University)
  107. Virtual Embodiment: A Scalable Long-Term Strategy for Artificial Intelligence Research
    Douwe Kiela, Luana Bulat, Anita L. Verő, Stephen Charles Clark · 2016 · arXiv (Cornell University)
  108. Policy Consolidation for Continual Reinforcement Learning
    Christos Kaplanis, Murray Shanahan, Claudia Clopath · 2019 · arXiv (Cornell University)
  109. What can I do here? A Theory of Affordances in Reinforcement Learning
    Khimya Khetarpal, Zafarali Ahmed, Gheorghe Comanici, David Lynn Abel, Doina Precup · 2020 · arXiv (Cornell University)
  110. Bellman Eluder Dimension: New Rich Classes of RL Problems, and Sample-Efficient Algorithms
    Chi Jin, Qinghua Liu, Sobhan Miryoosefi · 2021 · arXiv (Cornell University)
  111. Unsupervised Real-Time Control Through Variational Empowerment
    Maximilian Karl, Philip Becker-Ehmck, Maximilian Soelch, Djalel Benbouzid, Patrick van der Smagt, Justin Bayer · 2022 · Springer proceedings in advanced robotics
  112. On the value of information and other rewards
    Yael Niv, Stephanie C. Y. Chan · 2011 · Nature Neuroscience
  113. Competitive Experience Replay
    Hao Liu, Alexander Trott, Richard Socher, Caiming Xiong · 2019 · arXiv (Cornell University)
  114. Adapt to Environment Sudden Changes by Learning a Context Sensitive Policy
    Fan-Ming Luo, Shengyi Jiang, Yang Yu, Zongzhang Zhang, Yifeng Zhang · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  115. Benchmark Environments for Multitask Learning in Continuous Domains
    Peter Henderson, Wei-Di Chang, Florian Shkurti, Johanna Hansen, David Meger, Gregory Dudek · 2017 · arXiv (Cornell University)
  116. Ingredients of intelligence: From classic debates to an engineering roadmap
    Brenden M. Lake, Tomer David Ullman, Joshua B. Tenenbaum, Samuel Joseph Gershman · 2017 · Behavioral and Brain Sciences
  117. Learning to Explore with Meta-Policy Gradient
    Tian-Bing Xu, Qiang Liu, Liang L. Zhao, Jian Peng · 2018 · arXiv (Cornell University)
  118. NoRML: No-Reward Meta Learning
    Yuxiang Yang, Ken Caluwaerts, Atıl Işçen, Jie Tan, Chelsea Finn · 2019 · Adaptive Agents and Multi-Agents Systems
  119. Efficiency of learning vs. processing: Towards a normative theory of multitasking
    Yotam Sagiv, Sebastian Musslick, Yael Niv, Jonathan D. Cohen · 2020 · arXiv (Cornell University)
  120. Divide and Conquer: Hierarchical Reinforcement Learning and Task Decomposition in Humans
    Carlos Diuk, Anna C. Schapiro, Natalia I. Córdova, José J. F. Ribas Fernandes, Yael Niv, Matthew Botvinick · 2013 · Springer eBooks
  121. Learning Shared Representations in Multi-task Reinforcement Learning
    Diana Borsa, Thore Graepel, John S. Shawe-Taylor · 2016 · arXiv (Cornell University)
  122. A General Method for Incremental Self-improvement and Multi-agent Learning
    J. Schmidhuber · 1999 · WORLD SCIENTIFIC eBooks
  123. Generalized Hidden Parameter MDPs:Transferable Model-Based RL in a Handful of Trials
    Perez, Christian, Petroski Such, Felipe, Karaletsos, Theofanis · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  124. Many-Goals Reinforcement Learning
    Vivek Veeriah, Junhyuk Oh, Satinder Pal Singh · 2018 · arXiv (Cornell University)
  125. Meta-Adaptive Nonlinear Control: Theory and Algorithms
    Guanya Shi, Kamyar Azizzadenesheli, O'Connell, Michael, Soon‐Jo Chung, Yisong Yue · 2021 · CaltechAUTHORS (California Institute of Technology)
  126. Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge Distillation
    Tiantian Zhang, Xueqian Wang, Bin Liang, Bo Yuan · 2022 · IEEE Transactions on Neural Networks and Learning Systems
  127. Sequential Decision-Making under Non-stationary Environments via Sequential Change-point Detection
    Emmanuel Hadoux, Aurélie Beynier, Paul Weng · 2014 · HAL
  128. Environmental statistics and the trade-off between model-based and TD learning in humans
    Dylan Alexander Simon, Nathaniel D. Daw · 2011 · neural information processing systems
  129. Learning to Compose Skills
    Himanshu Sahni, Saurabh Kumar, Farhan Tejani, Charles Lee Isbell · 2017 · arXiv (Cornell University)
  130. Exploiting Hierarchy for Learning and Transfer in KL-regularized RL
    Dhruva Tirumala, Hyeonwoo Noh, Alexandre Galashov, Leonard Hasenclever, Arun Ahuja, Greg Wayne, Razvan Pascanu, Yee Whye Teh, Nicolas Heess · 2019 · arXiv (Cornell University)
  131. Diversity and Depth in Per-Example Routing Models
    Prajit Ramachandran, Quoc Viet Le · 2018 · International Conference on Learning Representations
  132. Learning to Teach in Cooperative Multiagent Reinforcement Learning
    Shayegan Omidshafiei, Dong-Ki Kim, Miao Liu, Gerald J. Tesauro, Matthew Riemer, Christopher Amato, Murray S. Campbell, Jonathan P. How · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  133. Options of Interest: Temporal Abstraction with Interest Functions
    Khimya Khetarpal, Martin Klissarov, Maxime Chevalier-Boisvert, Pierre‐Luc Bacon, Doina Precup · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  134. Learning to Multi-Task by Active Sampling
    Sahil Sharma, Ashutosh Jha, Parikshit Hegde, Balaraman Ravindran · 2017 · arXiv (Cornell University)
  135. Stable Opponent Shaping in Differentiable Games
    Alistair Letcher, Jakob Foerster, David Balduzzi, Tim Rocktäschel, Shimon Whiteson · 2018 · arXiv (Cornell University)
  136. Optimizing for the Future in Non-Stationary MDPs
    Yash Chandak, Georgios Theocharous, Shiv Shankar Shankar, Martha White, Sridhar Mahadevan, Philip S. Thomas · 2020 · arXiv (Cornell University)
  137. Learning to Learn: Hierarchical Meta-Critic Networks
    Zhixiong Xu, Lei Cao, Xiliang Chen · 2019 · IEEE Access
  138. SMiRL: Surprise Minimizing RL in Dynamic Environments
    Glen Berseth, Daniel Geng, Coline Devin, Chelsea Finn, Dinesh Jayaraman, S. Levine · 2019 · arXiv.org
  139. Model-based Adversarial Meta-Reinforcement Learning
    Zichuan Lin, Garrett Thomas, Guangwen Yang, Tengyu Ma · 2020 · arXiv (Cornell University)
  140. A Policy Gradient Algorithm for Learning to Learn in Multiagent Reinforcement Learning
    Kim, Dong-Ki, Miao Liu, Matthew Riemer, Chuangchuang Sun, Marwa Abdulhai, Golnaz Habibi, Sebastian Lopez-Cot, Gerald J. Tesauro, Jonathan P. How · 2020 · arXiv (Cornell University)
  141. Skill-based Meta-Reinforcement Learning
    Taewook Nam, Shao-Hua Sun, Karl Pertsch, Sung Ju Hwang, Joseph J. Lim · 2022 · arXiv (Cornell University)
  142. Catastrophic forgetting in simple networks: an analysis of the pseudorehearsal solution
    Marcus R. Frean, Anthony V. Robins · 1999 · Network Computation in Neural Systems
  143. Replay-Guided Adversarial Environment Design
    Jiang, Minqi, Dennis, Michael, Parker-Holder, Jack, Foerster, Jakob, Grefenstette, Edward, Rocktäschel, Tim · 2021 · arXiv
  144. DiCE: The Infinitely Differentiable Monte-Carlo Estimator
    Jakob Foerster, Gregory Farquhar, Maruan Al-Shedivat, Tim Rocktäschel, Eric P. Xing, Shimon Whiteson · 2018 · arXiv (Cornell University)
  145. When Waiting Is Not an Option: Learning Options With a Deliberation Cost
    Jean Harb, Pierre‐Luc Bacon, Martin Klissarov, Doina Precup · 2018 · Proceedings of the AAAI Conference on Artificial Intelligence
  146. A Neural Scaling Law from the Dimension of the Data Manifold
    Utkarsh Sharma, Jared Kaplan A · 2020 · arXiv (Cornell University)
  147. The Value Equivalence Principle for Model-Based Reinforcement Learning
    Christopher Grimm, André da Motta Salles Barreto, Satinder Pal Singh, David Silver · 2020 · arXiv (Cornell University)
  148. Context-Aware Policy Reuse
    Siyuan Li, Fangda Gu, Guangxiang Zhu, Chongjie Zhang · 2019 · Adaptive Agents and Multi-Agents Systems
  149. LTL2Action: Generalizing LTL Instructions for Multi-Task RL
    Vaezipoor, Pashootan, Li, Andrew, Icarte, Rodrigo Toro, McIlraith, Sheila · 2021 · arXiv
  150. Value Preserving State-Action Abstractions
    David Lynn Abel, Nate Umbanhowar, Khimya Khetarpal, Dilip Arumugam, Doina Precup, Michael L. Littman · 2020 · International Conference on Artificial Intelligence and Statistics
  151. Same State, Different Task: Continual Reinforcement Learning without Interference
    Samuel Kessler, Jack Parker-Holder, Philip Ball, Stefan Zohren, Stephen Roberts · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  152. Continual Backprop: Stochastic Gradient Descent with Persistent Randomness
    Shibhansh Dohare, Richard S. Sutton, A. Rupam Mahmood · 2021 · arXiv (Cornell University)
  153. RE-EVALUATE: Reproducibility in Evaluating Reinforcement Learning Algorithms
    Khimya Khetarpal, Zafarali Ahmed, Andre Cianflone, Riashat Islam, Joëlle Pineau · 2018
  154. Regret Minimization Experience Replay in Off-Policy Reinforcement Learning
    Xuhui Liu, Zhenghai Xue, Jing-Cheng Pang, Shengyi Jiang, Feng Xu, Yang Yu · 2021 · arXiv (Cornell University)
  155. DREAM Architecture: a Developmental Approach to Open-Ended Learning in Robotics
    Stéphane Doncieux, Nicolas Bredèche, Léni K. Le Goff, Benoît Girard, Alexandre Coninx, Olivier Sigaud, Mehdi Khamassi, Natalia Díaz-Rodríguez, David Filliat, Timothy M. Hospedales et al. · 2020 · arXiv (Cornell University)
  156. Introducing Symmetries to Black Box Meta Reinforcement Learning
    Louis Kirsch, Sebastian Flennerhag, Hado P. van Hasselt, Abram L. Friesen, Junhyuk Oh, Yutian Chen · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  157. Universal Off-Policy Evaluation
    Yash Chandak, Scott Niekum, Bruno Castro da Silva, Erik G. Miller, Emma Brunskill, Philip S. Thomas · 2021 · arXiv (Cornell University)
  158. Variational Automatic Curriculum Learning for Sparse-Reward Cooperative Multi-Agent Problems
    Jiayu Chen, Yuanxin Zhang, Yuanfan Xu, Huimin Ma, Huazhong Yang, Jiaming Song, Yu Wang, Wu, Yi · 2021 · arXiv (Cornell University)
  159. Transformers are Meta-Reinforcement Learners
    Luckeciano C. Melo · 2022 · arXiv (Cornell University)
  160. Automated Curriculum Learning by Rewarding Temporally Rare Events
    Niels Justesen, Sebastian Risi · 2018 · IEEE Conference on Computational Intelligence and Games (CIG)
  161. Learning Markov State Abstractions for Deep Reinforcement Learning
    Allen, Cameron, Neev Parikh, Omer Gottesman, George Konidaris · 2021 · arXiv (Cornell University)
  162. Reinforcement learning in non-stationary environments
    Erwan Lecarpentier · 2020
  163. Bayesian Reinforcement Learning in Factored POMDPs
    Sammie Katt, Frans Adriaan Oliehoek, Christopher Amato · 2019 · Adaptive Agents and Multi-Agents Systems
  164. Learning Hierarchical Teaching Policies for Cooperative Agents
    Dong-Ki Kim, Miao Liu, Shayegan Omidshafiei, Sebastian Lopez-Cot, Matthew Riemer, Golnaz Habibi, Gerald J. Tesauro, Sami Mourad, Murray S. Campbell, Jonathan P. How · 2020 · Adaptive Agents and Multi-Agents Systems
  165. Policy Evaluation Networks
    Jean Harb, Tom Schaul, Doina Precup, Pierre‐Luc Bacon · 2020 · arXiv (Cornell University)
  166. Discovering State and Action Abstractions for Generalized Task and Motion Planning
    Aidan Curtis, Tom Silver, Joshua B. Tenenbaum, Tomás Lozano‐Pérez, Leslie Pack Kaelbling · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  167. Dynamic Dialogue Policy for Continual Reinforcement Learning
    Christian Geishauser, Carel van Niekerk, Nurul Lubis, Michael C. Heck, Hsien-chin Lin, Shutong Feng, Milica Gašić · 2022 · arXiv (Cornell University)
  168. Bootstrapped Meta-Learning
    Sebastian Flennerhag, Yannick Schroecker, Tom Zahavy, Hado P. van Hasselt, David Silver, Satinder Pal Singh · 2021 · arXiv (Cornell University)
  169. Interference and Generalization in Temporal Difference Learning
    Bengio, Emmanuel, Pineau, Joelle, Precup, Doina · 2020 · arXiv
  170. Solving Hidden-Semi-Markov-Mode Markov Decision Problems
    Emmanuel Hadoux, Aurélie Beynier, Paul Weng · 2014 · Lecture notes in computer science
  171. Recursive Routing Networks: Learning to Compose Modules for Language Understanding
    Ignacio Cases, Clemens Rosenbaum, Matthew Riemer, Atticus Geiger, Tim Klinger, Alex Tamkin, Olivia Li, Sandhini Agarwal, Joshua D. Greene, Dan Jurafsky et al. · 2019 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  172. A Kernel-Based Approach to Non-Stationary Reinforcement Learning in Metric Spaces
    Omar Darwiche Domingues, Pierre Ménard, Matteo Pirotta, Emilie Kaufmann, Michal Valko · 2020 · arXiv (Cornell University)
  173. Towards Safe Policy Improvement for Non-Stationary MDPs
    Yash Chandak, Scott M. Jordan, Georgios Theocharous, Martha White, Philip S. Thomas · 2020 · arXiv (Cornell University)
  174. Continuous Coordination As a Realistic Scenario for Lifelong Learning
    Hadi Nekoei, Akilesh Badrinaaraayanan, Aaron C. Courville, Sarath Chandar · 2021 · arXiv (Cornell University)
  175. Towards mental time travel: a hierarchical memory for reinforcement learning agents
    Andrew K. Lampinen, Stephanie C. Y. Chan, Andrea Banino, Felix Hill · 2021 · arXiv (Cornell University)
  176. Offline Meta Reinforcement Learning -- Identifiability Challenges and Effective Data Collection Strategies
    Ron Dorfman, Idan Shenfeld, Aviv Tamar · 2021 · neural information processing systems
  177. Building a Subspace of Policies for Scalable Continual Learning
    Jean-Baptiste Gaya, Thang Doan, Lucas Caccia, Laure Soulier, Ludovic Denoyer, Roberta Răileanu · 2022 · arXiv (Cornell University)
  178. Efficient Learning in Non-Stationary Linear Markov Decision Processes
    Touati, Ahmed, Pascal Vincent · 2020 · arXiv (Cornell University)
  179. Scalable Recollections for Continual Lifelong Learning
    Matthew Riemer, Tim Klinger, Djallel Bouneffouf, Michele Franceschini · 2019 · Proceedings of the AAAI Conference on Artificial Intelligence
  180. Jelly Bean World: A Testbed for Never-Ending Learning
    Emmanouil Antonios Platanios, Abulhair Saparov, Tom M. Mitchell · 2020 · arXiv (Cornell University)
  181. Representation Stability as a Regularizer for Improved Text Analytics Transfer Learning
    Matthew Riemer, Elham Khabiri, Richard Goodwin · 2017 · arXiv (Cornell University)
  182. How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition
    Jorge A. Mendez, Eric Eaton · 2022 · arXiv (Cornell University)
  183. Unsupervised Real-Time Control through Variational Empowerment
    Maximilian Karl, Maximilian Soelch, Philip Becker-Ehmck, Djalel Benbouzid, Patrick van der Smagt, Justin Bayer · 2017 · arXiv (Cornell University)
  184. Multitask Soft Option Learning
    Maximilian Igl, Andrew Gambardella, Jinke He, Nantas Nardelli, N. Siddharth, Wendelin Böhmer, Shimon Whiteson · 2019 · arXiv (Cornell University)
  185. Reset-Free Lifelong Learning with Skill-Space Planning
    Lu, Kevin, Aditya Grover, Pieter Abbeel, Igor Mordatch · 2020 · arXiv (Cornell University)
  186. Flexible Option Learning
    Martin Klissarov, Doina Precup · 2021 · arXiv (Cornell University)
  187. Bisimulation Makes Analogies in Goal-Conditioned Reinforcement Learning
    Philippe Hansen-Estruch, Amy Zhang, Ashvin Nair, Patrick Yin, Sergey Levine · 2022 · arXiv (Cornell University)
  188. Options as responses: Grounding behavioural hierarchies in multi-agent RL
    Alexander Sasha Vezhnevets, Yuhuai Wu, Rémi Leblond, Joel Z. Leibo · 2019 · arXiv (Cornell University)
  189. Control-Aware Representations for Model-based Reinforcement Learning
    Brandon Cui, Yinlam Chow, Mohammad Ghavamzadeh · 2020 · arXiv (Cornell University)
  190. A Multitask Representation Using Reusable Local Policy Templates.
    Benjamin Rosman, Subramanian Ramamoorthy · 2012 · National Conference on Artificial Intelligence
  191. Meta-learnt priors slow down catastrophic forgetting in neural networks
    Giacomo Spigler · 2019 · arXiv (Cornell University)
  192. Near-Optimal Model-Free Reinforcement Learning in Non-Stationary Episodic MDPs
    Weichao Mao, Kaiqing Zhang, Ruihao Zhu, David Simchi‐Levi, Tamer Başar · 2021 · DSpace@MIT (Massachusetts Institute of Technology)
  193. Autonomous Reinforcement Learning via Subgoal Curricula
    Archit Sharma, Abhishek Gupta, Sergey Levine, Karol Hausman, Chelsea Finn · 2021 · arXiv (Cornell University)
  194. Modular Lifelong Reinforcement Learning via Neural Composition
    Jorge A. Mendez, Harm van Seijen, Eric Eaton · 2022 · arXiv (Cornell University)
  195. Fast Adaptation via Policy-Dynamics Value Functions
    Roberta Răileanu, Goldstein, Max, Arthur D. Szlam, Rob Fergus · 2020 · arXiv (Cornell University)
  196. An exploration strategy for non-stationary opponents
    Pablo Hernández-Leal, Yusen Zhan, Matthew Edmund Taylor, Luis Enrique Sucar, Enrique Muñoz de Cote · 2016 · Autonomous Agents and Multi-Agent Systems
  197. Self-Tuning Deep Reinforcement Learning
    Tom Zahavy, Zhongwen Xu, Vivek Veeriah, Matteo Hessel, Junhyuk Oh, Hado P. van Hasselt, David Silver, Satinder Pal Singh · 2020 · arXiv (Cornell University)
  198. Reactive Exploration to Cope with Non-Stationarity in Lifelong Reinforcement Learning
    Christian Steinparz, Thomas Schmied, Fabian Paischer, Marius-Constantin Dinu, Vihang Patil, Angela Bitto-Nemling, Hamid Eghbal-zadeh, Sepp Hochreiter · 2022 · arXiv (Cornell University)
  199. Dealing with Non-Stationarity in MARL via Trust-Region Decomposition
    Wenhao Li, Xiangfeng Wang, Bo Jin, Junjie Sheng, Hongyuan Zha B · 2021 · arXiv (Cornell University)
  200. Sharing Less is More: Lifelong Learning in Deep Networks with Selective Layer Transfer
    Seungwon Lee, Sima Behpour, Eric Eaton · 2021