Towards Continual Reinforcement Learning: A Review and Perspectives

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · see citing works

Language Models are Few-Shot Learners

Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works

Visualizing and understanding convolutional networks

Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · see citing works

Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks

Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512 · see citing works

Intriguing properties of neural networks

Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143 · see citing works

Overcoming catastrophic forgetting in neural networks

Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899 · see citing works

Introduction to Reinforcement Learning

Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855 · see citing works

Multitask Learning

Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636 · see citing works

Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory

McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · see citing works

Neural Architecture Search with Reinforcement LearningPreprint

Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 5,091 · see citing works

The theory of affordances

Gibson, J. J. (1977) · Medical Entomology and Zoology · doi:10.4324/9781315740218-18 · Cited by 4,471 · see citing works

Learning without Forgetting

Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202 · see citing works

Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem

McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770 · see citing works

A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play

Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. (2018) · Science · doi:10.1126/science.aar6404 · Cited by 3,562 · cited 1× · see citing works

Markov Games as a Framework for Multi-Agent Reinforcement Learning

Littman, M. L. (1994) · International Conference on Machine Learning · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 3,406 · see citing works

Prioritized Experience Replay

Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120 · see citing works

Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning

Sutton, R. S., Precup, D., & Singh, S. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00052-1 · Cited by 3,119 · see citing works

Continual lifelong learning with neural networks: A review

Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117 · see citing works

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control

Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · see citing works

A massively parallel architecture for a self-organizing neural pattern recognition machine

Carpenter, G. A., & Grossberg, S. (1987) · Computer Vision, Graphics, and Image Processing · doi:10.1016/s0734-189x(87)80014-2 · Cited by 2,525 · see citing works

Internal models in the cerebellum

Wolpert, D. M., Miall, R. C., & Kawato, M. (1998) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(98)01221-2 · Cited by 2,469 · see citing works

The Arcade Learning Environment: An Evaluation Platform for General Agents

Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161 · see citing works

A Note on Measurement of Utility

Samuelson, P. A. (1937) · The Review of Economic Studies · doi:10.2307/2967612 · Cited by 2,140 · see citing works

Toward an architecture for never-ending language learning

Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000 · see citing works

Curiosity-Driven Exploration by Self-Supervised Prediction

Pathak, D., Agrawal, P., Efros, A. A., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.70 · Cited by 1,815 · see citing works

Model-based influences on humans’ choices and striatal prediction errors

Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P., & Dolan, R. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.02.027 · Cited by 1,779 · see citing works

Scaling Laws for Neural Language Models

Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · Cited by 1,749 · see citing works

Deep Reinforcement Learning That Matters

Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., & Meger, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11694 · Cited by 1,685 · see citing works

A Continual Learning Survey: Defying Forgetting in Classification Tasks

Delange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., & Tuytelaars, T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3057446 · Cited by 1,647 · see citing works

Self-improving reactive agents based on reinforcement learning, planning and teaching

Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564 · see citing works

Neuroscience-Inspired Artificial Intelligence

Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557 · see citing works

Transfer Learning for Reinforcement Learning Domains: A Survey

Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,521 · see citing works

Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition

Dietterich, T. G. (2000) · Journal of Artificial Intelligence Research · doi:10.1613/jair.639 · Cited by 1,464 · see citing works

An Outline of a Theory of Affordances

Chemero, A. P. (2003) · Ecological Psychology · doi:10.1207/s15326969eco1502_5 · Cited by 1,363 · see citing works

Hindsight experience replay

Andrychowicz, M., Wolski, F., Ray, A., Schneider, J., Fong, R., Welinder, P., McGrew, B., Tobin, J., Abbeel, P., & Zaremba, W. (2017) · arXiv · doi:10.48550/arxiv.1707.01495 · Cited by 1,355 · see citing works

Progressive Neural Networks

Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., & Hadsell, R. (2016) · arXiv · doi:10.48550/arxiv.1606.04671 · Cited by 1,307 · see citing works

States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning

Gläscher, J., Daw, N., Dayan, P., & O'Doherty, J. P. (2010) · Neuron · doi:10.1016/j.neuron.2010.04.016 · Cited by 1,166 · see citing works

A perspective view and survey of meta-learning

Vilalta, R., & Drissi, Y. (2002) · Artificial Intelligence Review · doi:10.1023/a:1019956318069 · Cited by 1,108 · see citing works

Human cerebellar activity reflecting an acquired internal model of a new tool

Imamizu, H., Miyauchi, S., Tamada, T., Sasaki, Y., Takino, R., Pütz, B., Yoshioka, T., & Kawato, M. (2000) · Nature · doi:10.1038/35003194 · Cited by 1,000 · see citing works

A Simple Neural Attentive Meta-LearnerPreprint

Mishra, N., Rohaninejad, M., Chen, X., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.03141 · Cited by 961 · see citing works

Meta-Learning in Neural Networks: A Survey

Hospedales, T. M., Antoniou, A., Micaelli, P., & Storkey, A. J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3079209 · Cited by 886 · see citing works

Efficient Lifelong Learning with A-GEM

Chaudhry, A., Ranzato, M., Rohrbach, M., & Elhoseiny, M. (2018) · arXiv · doi:10.48550/arxiv.1812.00420 · Cited by 852 · see citing works

IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner ArchitecturesPreprint

Espeholt, L., Soyer, H., Munos, R., Simonyan, K., Mnih, V., Ward, T., Doron, Y., Firoiu, V., Harley, T., Dunning, I., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01561 · Cited by 851 · see citing works

Catastrophic forgetting, rehearsal and pseudorehearsal

ROBINS, A. (1995) · Connection Science · doi:10.1080/09540099550039318 · Cited by 833 · see citing works

Reinforcement Learning with Unsupervised Auxiliary TasksPreprint

Jaderberg, M., Mnih, V., Czarnecki, W. M., Schaul, T., Leibo, J. Z., Silver, D., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05397 · Cited by 826 · see citing works

Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems

Levine, S., Kumar, A., Tucker, G., & Fu, J. (2020) · arXiv · doi:10.48550/arxiv.2005.01643 · Cited by 824 · see citing works

Dyna, an Integrated Architecture for Learning, Planning, and Reacting

Sutton, R. S. (1991) · ACM SIGART Bulletin · doi:10.1145/122344.122377 · Cited by 777 · see citing works

A survey and critique of multiagent deep reinforcement learning

Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 747 · see citing works

Untitled work

(2016) · neural information processing systems · Cited by 735 · see citing works

Curious model-building control systems

Schmidhuber, J. (1991) · [Proceedings] 1991 IEEE International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.170605 · Cited by 733 · see citing works

Reinforcement learning in the brain

Niv, Y. (2009) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.12.005 · Cited by 724 · see citing works

Improving generalization for temporal difference learning: The successor representation

Dayan, P. (1993) · Neural Computation · doi:10.1162/neco.1993.5.4.613 · Cited by 693 · see citing works

Learning to Navigate in Complex EnvironmentsPreprint

Mirowski, P., Pascanu, R., Viola, F., Soyer, H., Ballard, A. J., Banino, A., Denil, M., Goroshin, R., Sifre, L., Kavukcuoglu, K., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03673 · Cited by 679 · see citing works

Universal Value Function Approximators

Schaul, T., Horgan, D., Gregor, K., & Silver, D. (2015) · Cited by 677 · see citing works

Learning Without Forgetting

Li, Z., & Hoiem, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_37 · Cited by 659 · see citing works

Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective

Botvinick, M. M., Niv, Y., & Barto, A. G. (2009) · Cognition · doi:10.1016/j.cognition.2008.08.011 · Cited by 646 · see citing works

PathNet: Evolution Channels Gradient Descent in Super Neural NetworksPreprint

Fernando, C., Banarse, D., Blundell, C., Zwólš, Y., Ha, D., Rusu, A. A., Pritzel, A., & Wierstra, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08734 · Cited by 619 · see citing works

Reinforcement Learning with Hierarchies of Machines

Parr, R., & Russell, S. (1997) · Cited by 618 · see citing works

Intrinsically Motivated Reinforcement Learning

Singh, S. P., Barto, A. G., & Chentanez, N. (2005) · doi:10.21236/ada440280 · Cited by 614 · see citing works

Prefrontal cortex as a meta-reinforcement learning system

Wang, J. X., Kurth-Nelson, Z., Kumaran, D., Tirumala, D., Soyer, H., Leibo, J. Z., Hassabis, D., & Botvinick, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0147-8 · Cited by 596 · see citing works

OpenAI Gym

Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., & Zaremba, W. (2016) · arXiv · doi:10.48550/arxiv.1606.01540 · Cited by 582 · see citing works

Learning to reinforcement learn

Wang, J. X., Kurth-Nelson, Z., Tirumala, D., Soyer, H., Leibo, J. Z., Munos, R., Blundell, C., Kumaran, D., & Botvinick, M. (2016) · arXiv · doi:10.48550/arxiv.1611.05763 · Cited by 579 · see citing works

ViZDoom: A Doom-based AI research platform for visual reinforcement learning

Kempka, M., Wydmuch, M., Runc, G., Toczek, J., & Jaśkowski, W. (2016) · IEEE Conference on Computational Intelligence and Games (CIG) · doi:10.1109/cig.2016.7860433 · Cited by 550 · see citing works

Reptile: a Scalable Metalearning AlgorithmPreprint

Nichol, A., & Schulman, J. (2018) · arXiv (Cornell University) · Cited by 548 · see citing works

Learning to Learn without Forgetting by Maximizing Transfer and Minimizing InterferencePreprint

Riemer, M., Cases, I., Ajemian, R., Liu, M., Rish, I., Tu, Y., & Tesauro, G. J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11910 · Cited by 534 · see citing works

Experience Replay for Continual Learning

Rolnick, D., Ahuja, A., Schwarz, J., Lillicrap, T. P., & Wayne, G. (2018) · arXiv · doi:10.48550/arxiv.1811.11682 · Cited by 529 · see citing works

Affordances and the Body: An Intentional Analysis of Gibson's Ecological Approach to Visual Perception

HEFT, H. (1989) · Journal for the Theory of Social Behaviour · doi:10.1111/j.1468-5914.1989.tb00133.x · Cited by 522 · see citing works

RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning

Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1611.02779 · Cited by 503 · see citing works

SMASH: One-Shot Model Architecture Search through HyperNetworksPreprint

Brock, A., Lim, T., Ritchie, J. M., & Weston, N. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05344 · Cited by 500 · see citing works

Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation

Fleming, S. M., & Daw, N. D. (2017) · Psychological Review · doi:10.1037/rev0000045 · Cited by 489 · see citing works

Diversity is All You Need: Learning Skills without a Reward Function

Eysenbach, B., Gupta, A., Ibarz, J., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1802.06070 · Cited by 480 · see citing works

Multiple model-based reinforcement learning

Doya, K., Samejima, K., Katagiri, K.-I., & Kawato, M. (2002) · Neural Computation · doi:10.1162/089976602753712972 · Cited by 476 · see citing works

Playing FPS Games with Deep Reinforcement Learning

Lample, G., & Chaplot, D. S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10827 · Cited by 475 · see citing works

Embracing Change: Continual Learning in Deep Neural Networks

Hadsell, R., Rao, D., Rusu, A. A., & Pascanu, R. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.09.004 · Cited by 467 · see citing works

Variational Information Maximisation for Intrinsically Motivated Reinforcement LearningPreprint

Mohamed, S., & Rezende, D. J. (2015) · Neural Information Processing Systems · doi:10.48550/arxiv.1509.08731 · Cited by 460 · see citing works

Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning

Yu, T., Quillen, D., He, Z., Julian, R., Narayan, A., Shively, H., Bellathur, A., Hausman, K., Finn, C., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1910.10897 · Cited by 450 · see citing works

Progress & Compress: A scalable framework for continual learningPreprint

Schwarz, J., Luketina, J., Czarnecki, W. M., Grabska‐Barwińska, A., Teh, Y. W., Pascanu, R., & Hadsell, R. T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06370 · Cited by 422 · see citing works

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis

Collins, A. G. E., & Frank, M. J. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07980.x · Cited by 419 · see citing works

Navigating the Affordance Landscape: Feedback Control as a Process Model of Behavior and Cognition

Pezzulo, G., & Cisek, P. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.013 · Cited by 419 · see citing works

Friend-or-Foe Q-learning in General-Sum Games

Littman, M. L. (2001) · Cited by 403 · see citing works

Learning a synaptic learning rule

Bengio, Y., Bengio, S., & Cloutier, J. (1991) · IJCNN-91-Seattle International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1991.155621 · Cited by 402 · see citing works

Large-Scale Study of Curiosity-Driven Learning

Burda, Y., Edwards, H., Pathak, D., Storkey, A., Darrell, T., & Efros, A. A. (2018) · arXiv · doi:10.48550/arxiv.1808.04355 · Cited by 401 · see citing works

Prioritized memory access explains planning and hippocampal replay

Mattar, M. G., & Daw, N. D. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0232-z · Cited by 393 · see citing works

Meta-Gradient Reinforcement LearningPreprint

Xu, Z., Hasselt, H. V., & Silver, D. (2018) · Neural Information Processing Systems · doi:10.48550/arxiv.1805.09801 · Cited by 388 · see citing works

The successor representation in human reinforcement learning

Momennejad, I., Russek, E. M., Cheong, J. H., Botvinick, M., Daw, N. D., & Gershman, S. J. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0180-8 · Cited by 384 · see citing works

The ubiquity of model-based reinforcement learning

Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380 · see citing works

Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context VariablesPreprint

Rakelly, K., Zhou, A., Quillen, D., Finn, C., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.08254 · Cited by 371 · see citing works

Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms

Niv, Y., Daniel, R., Geana, A., Gershman, S. J., Leong, Y. C., Radulescu, A., & Wilson, R. C. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.2978-14.2015 · Cited by 362 · see citing works

Stochastic dynamic programming with factored representations

Boutilier, C., Dearden, R., & Goldszmidt, M. (2000) · Artificial Intelligence · doi:10.1016/s0004-3702(00)00033-3 · Cited by 361 · see citing works

Selective Experience Replay for Lifelong Learning

Isele, D., & Cosgun, A. (2018) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v32i1.11595 · Cited by 360 · see citing works

Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents

Machado, M. C., Bellemare, M. G., Talvitie, E., Veness, J., Hausknecht, M., & Bowling, M. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5699 · Cited by 359 · see citing works

Learning to Control Fast-Weight Memories: An Alternative to Dynamic Recurrent Networks

Schmidhuber, J. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.131 · Cited by 357 · see citing works

Learning task-state representations

Niv, Y. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0470-8 · Cited by 356 · see citing works

Quantifying Generalization in Reinforcement LearningPreprint

Cobbe, K., Klimov, O., Hesse, C., Kim, T., & Schulman, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02341 · Cited by 348 · see citing works

Mechanisms of Hierarchical Reinforcement Learning in Corticostriatal Circuits 1: Computational Analysis

Frank, M. J., & Badre, D. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr114 · Cited by 330 · see citing works

Experience Grounds Language

Bisk, Y., Holtzman, A., Thomason, J., Andreas, J., Bengio, Y., Chai, J. Y., Lapata, M., Lazaridou, A., May, J., Nisnevich, A., et al. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.703 · Cited by 325 · see citing works

Learning modular neural network policies for multi-task and multi-robot transfer

Devin, C., Gupta, A., Darrell, T., Abbeel, P., & Levine, S. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989250 · Cited by 324 · see citing works

Sequential replay of nonspatial task states in the human hippocampus

Schuck, N. W., & Niv, Y. (2019) · Science · doi:10.1126/science.aaw5181 · Cited by 304 · see citing works

Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction

Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., & Precup, D. (2011) · doi:10.5555/2031678.2031726 · Cited by 301 · see citing works

A Deep Hierarchical Approach to Lifelong Learning in Minecraft

Tessler, C., Givony, S., Zahavy, T., Mankowitz, D. J., & Mannor, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10744 · Cited by 300 · see citing works

Zero-Shot Task Generalization with Multi-Task Deep Reinforcement LearningPreprint

Oh, J., Singh, S., Lee, H., & Kohli, P. (2017) · International Conference on Machine Learning · doi:10.48550/arxiv.1706.05064 · Cited by 292 · see citing works

Transfer of learning by composing solutions of elemental sequential tasks

Singh, S. P. (1992) · Machine Learning · doi:10.1007/bf00992700 · Cited by 289 · see citing works

Empowerment: A Universal Agent-Centric Measure of Control

Klyubin, A. S., Polani, D., & Nehaniv, C. L. (2005) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2005.1554676 · Cited by 285 · see citing works

Towards a Unified Theory of State Abstraction for MDPs.

Li, L. C., Walsh, T. J., & Littman, M. L. (2006) · Cited by 283 · see citing works

Model-based learning protects against forming habits

Gillan, C. M., Otto, A. R., Phelps, E. A., & Daw, N. D. (2015) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-015-0347-6 · Cited by 283 · see citing works

Modular Multitask Reinforcement Learning with Policy Sketches

Andreas, J., Klein, D., & Levine, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01796 · Cited by 274 · see citing works

Policy Distillation

Rusu, A. A., Colmenarejo, S. G., Gulcehre, C., Desjardins, G., Kirkpatrick, J., Pascanu, R., Mnih, V., Kavukcuoglu, K., & Hadsell, R. (2015) · arXiv · doi:10.48550/arxiv.1511.06295 · Cited by 270 · see citing works

Continuous Adaptation via Meta-Learning in Nonstationary and Competitive EnvironmentsPreprint

Al-Shedivat, M., Bansal, T., Burda, Y., Sutskever, I., Mordatch, I., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.03641 · Cited by 263 · see citing works

Multi-task reinforcement learning

Wilson, A., Fern, A., Ray, S., & Tadepalli, P. V. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273624 · Cited by 262 · see citing works

Reinforced Continual Learning

Xu, J., & Zhu, Z. (2018) · ePrints Soton (University of Southampton) · doi:10.48550/arxiv.1805.12369 · Cited by 254 · see citing works

Reinforcement Learning to Play an Optimal Nash Equilibrium in Team Markov Games

Wang, X., & Sandholm, T. (2002) · Cited by 251 · see citing works

A Study on Overfitting in Deep Reinforcement LearningPreprint

Zhang, C., Vinyals, O., Munos, R., & Samy Bengio, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06893 · Cited by 246 · see citing works

Optimal learning: computational procedures for bayes-adaptive markov decision processes

Duff, M. O., & Barto, A. G. (2002) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 242 · see citing works

Planning under Uncertainty for Robotic Tasks with Mixed Observability

Ong, S. C. W., Png, S., Hsu, D., & Lee, W. S. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910369861 · Cited by 238 · see citing works

Intrinsic Motivation and Reinforcement Learning

Barto, A. G. (2012) · Springer eBooks · doi:10.1007/978-3-642-32375-1_2 · Cited by 234 · see citing works

Fast Context Adaptation via Meta-LearningPreprint

Zintgraf, L., Shiarlis, K., Kurin, V., Hofmann, K., & Whiteson, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.03642 · Cited by 234 · see citing works

Hierarchical Solution of Markov Decision Processes using Macro-actionsPreprint

Hauskrecht, M., Meuleau, N., Kaelbling, L. P., Dean, T., & Boutilier, C. E. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.7381 · Cited by 230 · see citing works

An object-oriented representation for efficient reinforcement learning

Diuk, C., Cohen, A., & Littman, M. L. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390187 · Cited by 226 · see citing works

Online Meta-LearningPreprint

Finn, C., Rajeswaran, A., Kakade, S. M., & Levine, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.08438 · Cited by 221 · see citing works

Meta Learning Shared HierarchiesPreprint

Frans, K., Ho, J., Chen, X., Abbeel, P., & Schulman, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09767 · Cited by 219 · see citing works

The Option-Critic Architecture

Bacon, P., Harb, J., & Precup, D. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10916 · Cited by 219 · see citing works

Symbolic dynamic programming for first-order MDPs

Boutilier, C. E., Reiter, R., & Price, B. (2001) · Cited by 218 · see citing works

SMASH: One-Shot Model Architecture Search through HyperNetworks

Brock, A., Lim, T., Ritchie, J. M., & Weston, N. J. (2018) · International Conference on Learning Representations · Cited by 217 · see citing works

Multi-Task Deep Reinforcement Learning with PopArt

Hessel, M., Soyer, H., Espeholt, L., Czarnecki, W. M., Schmitt, S., & van Hasselt, H. P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013796 · Cited by 216 · see citing works

Learning with Opponent-Learning Awareness

Foerster, J., Chen, R. Y., Al-Shedivat, M., Whiteson, S., Abbeel, P., & Mordatch, I. (2018) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/hgwa8807 · Cited by 215 · see citing works

Variational Intrinsic ControlPreprint

Gregor, K., Rezende, D. J., & Wierstra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07507 · Cited by 213 · see citing works

Convergence and No-Regret in Multiagent Learning

Bowling, M. (2004) · doi:10.7939/r3zs2kf41 · Cited by 213 · see citing works

The hardware lottery

Hooker, S. (2021) · Communications of the ACM · doi:10.1145/3467017 · Cited by 211 · see citing works

Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI

Badre, D., & Frank, M. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr117 · Cited by 210 · see citing works

Embodiment theory and education: The foundations of cognition in perception and action

Kiefer, M., & Trumpp, N. M. (2012) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2012.07.002 · Cited by 208 · see citing works

Model-Based Active ExplorationPreprint

Shyam, P., Jaśkowski, W., & Gomez, F. (2018) · International Conference on Machine Learning · doi:10.48550/arxiv.1810.12162 · Cited by 207 · see citing works

Near-optimal Regret Bounds for Reinforcement Learning

(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1859902 · Cited by 207 · see citing works

Learning to Achieve Goals

Kaelbling, L. P. (1993) · Cited by 206 · see citing works

Dopamine reward prediction errors reflect hidden-state inference across time

Starkweather, C. K., Babayan, B. M., Uchida, N., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4520 · Cited by 206 · see citing works

Go-Explore: a New Approach for Hard-Exploration Problems

Ecoffet, A., Huizinga, J., Lehman, J., Stanley, K. O., & Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1901.10995 · Cited by 205 · see citing works

Markov Decision Processes

Thomas, L. C., White, D. J., & Puterman, M. L. (1995) · Journal of the Operational Research Society · doi:10.1057/jors.1995.110 · Cited by 204 · see citing works

Multi-criteria Reinforcement Learning

Gábor, Z., Kalmár, Z., & Szepesvári, C. (1998) · Cited by 202 · see citing works

Discovering Structure in Multiple Learning Tasks: The TC Algorithm.

Thrun, S., & O’Sullivan, J. A. (1996) · Cited by 201 · see citing works

Leveraging Procedural Generation to Benchmark Reinforcement Learning

Cobbe, K., Hesse, C., Hilton, J., & Schulman, J. (2019) · arXiv · doi:10.48550/arxiv.1912.01588 · Cited by 196 · see citing works

Automatic Goal Generation for Reinforcement Learning AgentsPreprint

Florensa, C., Held, D., Geng, X., & Abbeel, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.06366 · Cited by 193 · see citing works

Learning an Embedding Space for Transferable Robot Skills

Hausman, K., Springenberg, J. T., Wang, Z., Heess, N., & Riedmiller, M. (2018) · International Conference on Learning Representations · Cited by 189 · see citing works

On the Optimization of a Synaptic Learning Rule

Samy Bengio, A., Bengio, Y., Cloutier, J., & Gescei, J. (2013) · doi:10.4324/9780203773833-22 · Cited by 181 · see citing works

Finding Structure in Reinforcement Learning

Thrun, S., & Schwartz, A. (1994) · Cited by 176 · see citing works

Adapting bias by gradient descent: an incremental version of delta-bar-delta

Sutton, R. S. (1992) · Cited by 169 · see citing works

Shifting Inductive Bias with Success-Story Algorithm, Adaptive Levin Search, and Incremental Self-Improvement

Schmidhuber, J., Zhao, J., & Wiering, M. (1997) · Machine Learning · doi:10.1023/a:1007383707642 · Cited by 167 · see citing works

Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their SolutionsPreprint

Wang, R., Lehman, J., Clune, J., & Stanley, K. O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01753 · Cited by 166 · see citing works

Bayesian Model-Agnostic Meta-LearningPreprint

Kim, T., Yoon, J., Dia, O., Kim, S., Bengio, Y., & Ahn, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03836 · Cited by 164 · see citing works

Model-based predictions for dopamine

Langdon, A. J., Sharpe, M. J., Schoenbaum, G., & Niv, Y. (2018) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.10.006 · Cited by 161 · see citing works

Self-Improving Reactive Agents Based on Reinforcement Learning, Planning and Teaching

Lin, L.-J. (1992) · Springer eBooks · doi:10.1007/978-1-4615-3618-5_5 · Cited by 160 · see citing works

Evolved Policy GradientsPreprint

Houthooft, R., Chen, R. Y., Isola, P., Stadie, B. C., Wolski, F., Ho, J., & Abbeel, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04821 · Cited by 160 · see citing works

Learning structures: Predictive representations, replay, and generalization

Momennejad, I. (2020) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2020.02.017 · Cited by 159 · see citing works

Generalizing plans to new environments in relational MDPs

Guestrin, C., Koller, D., Gearhart, C., & Kanodia, N. (2003) · Cited by 157 · see citing works

Dealing with non-stationary environments using context detection

da Silva, B. C., Basso, E. W., Bazzan, A. L. C., & Engel, P. M. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143872 · Cited by 154 · see citing works

Bayesian Decision Problems and Markov Chains.

Olshen, R. A., & Martin, J. J. (1968) · Journal of the American Statistical Association · doi:10.2307/2285906 · Cited by 154 · see citing works

Model-based hierarchical reinforcement learning and human action control

Botvinick, M., & Weinstein, A. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0480 · Cited by 153 · see citing works

Dopamine, uncertainty and TD learning

Niv, Y., Duff, M. O., & Dayan, P. (2005) · Behavioral and Brain Functions · doi:10.1186/1744-9081-1-6 · Cited by 153 · see citing works

Hippocampal Contributions to Model-Based Planning and Spatial Memory

Vikbladh, O. M., Meager, M. R., King, J. A., Blackmon, K., Devinsky, O., Shohamy, D., Burgess, N., & Daw, N. D. (2019) · Neuron · doi:10.1016/j.neuron.2019.02.014 · Cited by 152 · see citing works

Discovering latent causes in reinforcement learning

Gershman, S. J., Norman, K. A., & Niv, Y. (2015) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2015.07.007 · Cited by 151 · see citing works

Online Multi-Task Learning for Policy Gradient Methods

Ammar, H. B., Eaton, E., Ruvolo, P., & Taylor, M. E. (2014) · Cited by 151 · see citing works

Scaling Laws for Autoregressive Generative Modeling

Henighan, T., Kaplan, J., Katz, M., Chen, M., Hesse, C., Jackson, J., Jun, H., Brown, T. B., Dhariwal, P., Gray, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2010.14701 · Cited by 150 · see citing works

Teaching on a budget: agents advising agents in reinforcement learning

Torrey, L. A., & Taylor, M. E. (2013) · doi:10.5555/2484920.2485086 · Cited by 149 · see citing works

Hidden Parameter Markov Decision Processes: A Semiparametric Regression Approach for Discovering Latent Task Parametrizations

Doshi-Velez, F., & Konidaris, G. (2013) · International Joint Conference on Artificial Intelligence · doi:10.48550/arxiv.1308.3513 · Cited by 149 · see citing works

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play

Sukhbaatar, S., Lin, Z., Kostrikov, I., Synnaeve, G., Szlam, A., & Fergus, R. (2017) · arXiv · doi:10.48550/arxiv.1703.05407 · Cited by 149 · see citing works

A wholistic view of continual learning with deep neural networks: Forgotten lessons and the bridge to active and open world learning

Mundt, M., Hong, Y., Pliushch, I., & Ramesh, V. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.01.014 · Cited by 148 · see citing works

Optimal Behavioral Hierarchy

Solway, A., Diuk, C., Córdova, N. I., Yee, D. M., Barto, A. G., Niv, Y., & Botvinick, M. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003779 · Cited by 145 · see citing works

Supermasks in Superposition

Wortsman, M., Ramanujan, V., Liu, R., Kembhavi, A., Rastegari, M., Yosinski, J., & Farhadi, A. (2020) · arXiv · doi:10.48550/arxiv.2006.14769 · Cited by 144 · see citing works

Efficient reinforcement learning in factored MDPs

Kearns, M. J., & Koller, D. (1999) · Cited by 142 · see citing works

Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

Schmidhuber, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02565-5_4 · Cited by 141 · see citing works

Continual learning: A comparative study on how to defy forgetting in classification tasks.Preprint

Lange, M. D., Aljundi, R., Masana, M., Parisot, S., Xu, J., Leonardis, A., Slabaugh, G., & Tuytelaars, T. (2019) · arXiv (Cornell University) · Cited by 141 · see citing works

Conflict-Averse Gradient Descent for Multi-task LearningPreprint

Liu, B., Liu, X., Jin, X., Stone, P., & Liu, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14048 · Cited by 141 · see citing works

Surprise-Based Intrinsic Motivation for Deep Reinforcement Learning

Achiam, J., & Sastry, S. (2017) · arXiv · doi:10.48550/arxiv.1703.01732 · Cited by 139 · see citing works

Gotta Learn Fast: A New Benchmark for Generalization in RLPreprint

Nichol, A., Pfau, V., Hesse, C., Klimov, O., & Schulman, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.03720 · Cited by 136 · see citing works

R-IAC: Robust Intrinsically Motivated Exploration and Active Learning

Baranès, A., & Oudeyer, P. (2009) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2009.2037513 · Cited by 133 · see citing works

Offline replay supports planning in human reinforcement learning

Momennejad, I., Otto, A. R., Daw, N. D., & Norman, K. A. (2018) · eLife · doi:10.7554/elife.32548 · Cited by 133 · see citing works

Acute stress selectively reduces reward sensitivity

Berghorst, L. H., Bogdan, R., Frank, M. J., & Pizzagalli, D. A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00133 · Cited by 131 · see citing works

On Learning Intrinsic Rewards for Policy Gradient MethodsPreprint

Zheng, Z., Oh, J., & Singh, S. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06459 · Cited by 131 · see citing works

Using Semi-Distributed Representations to Overcome Catastrophic Forgetting in Connectionist Networks

French, R. M. (1991) · Cited by 130 · see citing works

Positive reward prediction errors during decision-making strengthen memory encoding

Jang, A. I., Nassar, M. R., Dillon, D. G., & Frank, M. J. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0597-3 · Cited by 129 · see citing works

Planning to Explore via Self-Supervised World Models

Sekar, R., Rybkin, O., Daniilidis, K., Abbeel, P., Hafner, D., & Pathak, D. (2020) · arXiv · doi:10.48550/arxiv.2005.05960 · Cited by 129 · see citing works

Doing more with less: meta-reasoning and meta-learning in humans and machines

Griffiths, T. L., Callaway, F., Chang, M. B., Grant, E., Krueger, P. M., & Lieder, F. (2019) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2019.01.005 · Cited by 128 · see citing works

Automatic Curriculum Learning For Deep RL: A Short Survey

Portelas, R., Colas, C., Weng, L., Hofmann, K., & Oudeyer, P.-Y. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/671 · Cited by 127 · see citing works

Automatic Goal Generation for Reinforcement Learning Agents

Florensa, C., Held, D., Geng, X., & Abbeel, P. (2018) · International Conference on Machine Learning · Cited by 127 · see citing works

Meta-Learning Representations for Continual LearningPreprint

Javed, K., & White, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12588 · Cited by 124 · see citing works

Loss is its own Reward: Self-Supervision for Reinforcement LearningPreprint

Shelhamer, E., Mahmoudieh, P., Argus, M. J., & Darrell, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07307 · Cited by 124 · see citing works

Minimax Regret Bounds for Reinforcement Learning

Azar, M. G., Osband, I., & Munos, R. (2017) · arXiv · doi:10.48550/arxiv.1703.05449 · Cited by 124 · see citing works

Experience Replay for Continual LearningPreprint

Rolnick, D., Ahuja, A., Schwarz, J., Lillicrap, T., & Wayne, G. (2019) · arXiv (Cornell University) · Cited by 124 · see citing works

Search on the Replay Buffer: Bridging Planning and Reinforcement Learning

Eysenbach, B., Salakhutdinov, R., & Levine, S. (2019) · arXiv · doi:10.48550/arxiv.1906.05253 · Cited by 123 · see citing works

Reinforcement learning algorithm for non-stationary environments

Padakandla, S., J., P. K., & Bhatnagar, S. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01758-5 · Cited by 122 · see citing works

PowerPlay: Training an Increasingly General Problem Solver by Continually Searching for the Simplest Still Unsolvable Problem

Schmidhuber, J. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00313 · Cited by 121 · see citing works

Moderate levels of activation lead to forgetting in the think/no-think paradigm

Detre, G. J., Natarajan, A., Gershman, S. J., & Norman, K. A. (2013) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2013.02.017 · Cited by 120 · see citing works

Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RLPreprint

Nagabandi, A., Finn, C., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07671 · Cited by 120 · see citing works

CHILD: A First Step Towards Continual Learning

Ring, M. B. (1997) · Machine Learning · doi:10.1023/a:1007331723572 · Cited by 119 · see citing works

Human reinforcement learning subdivides structured action spaces by learning effector-specific values

Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118 · see citing works

Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generation

Justesen, N., Torrado, R. R., Bontrager, P., Khalifa, A., Togelius, J., & Risi, S. (2018) · OAR@UM (University of Malta) · doi:10.48550/arxiv.1806.10729 · Cited by 117 · see citing works

Evolutionary architecture search for deep multitask networks

Liang, J., Meyerson, E., & Miikkulainen, R. P. (2018) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/3205455.3205489 · Cited by 115 · see citing works

An Outline of a Theory of Affordances

Chemero, A. P. (2018) · Routledge eBooks · doi:10.4324/9780203726655-5 · Cited by 115 · see citing works

Assessing Generalization in Deep Reinforcement Learning

Packer, C., Gao, K., Kos, J., Krähenbühl, P., Koltun, V., & Song, D. (2018) · arXiv · doi:10.48550/arxiv.1810.12282 · Cited by 114 · see citing works

VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learning

Zintgraf, L., Shiarlis, K., Igl, M., Schulze, S., Gal, Y., Hofmann, K., & Whiteson, S. (2019) · arXiv · doi:10.48550/arxiv.1910.08348 · Cited by 112 · see citing works

A Comprehensive Survey of Continual Learning: Theory, Method and Application

Wang, L., Zhang, X., Su, H., & Zhu, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367329 · Cited by 1,113 · see citing works

Organoid intelligence (OI): the new frontier in biocomputing and intelligence-in-a-dish

Smirnova, L., Caffo, B. S., Gracias, D. H., Huang, Q., Pantoja, I. E. M., Tang, B., Zack, D. J., Berlinicke, C. A., Boyd, J. L., Harris, T. D., et al. (2023) · Frontiers in Science · doi:10.3389/fsci.2023.1017235 · Cited by 290 · see citing works

A Survey of Deep RL and IL for Autonomous Driving Policy Learning

Zhu, Z., & Zhao, H. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3134702 · Cited by 244 · see citing works

A Survey of Zero-shot Generalisation in Deep Reinforcement Learning

Kirk, R., Zhang, A., Grefenstette, E., & Rocktäschel, T. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14174 · Cited by 193 · see citing works

Autonomous Drone Racing: A Survey

Hanover, D., Loquercio, A., Bauersfeld, L., Romero, Á., Pěnička, R., Song, Y., Cioffi, G., Kaufmann, E., & Scaramuzza, D. (2024) · IEEE Transactions on Robotics · doi:10.1109/tro.2024.3400838 · Cited by 148 · see citing works

Reinforcement Learning in Process Industries: Review and Perspective

Dogru, O., Xie, J., Prakash, O., Chiplunkar, R., Soesanto, J. F., Chen, H., Velswamy, K., Ibrahim, F., & Huang, B. (2024) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2024.124227 · Cited by 121 · see citing works

Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review

Al-Hamadani, M. N. A., Fadhel, M. A., Alzubaidi, L., & Harangi, B. (2024) · Sensors · doi:10.3390/s24082461 · Cited by 100 · see citing works

A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning

Wang, Z., Yang, E., Shen, L., & Huang, H. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3498346 · Cited by 101 · see citing works

Continual learning for predictive maintenance: Overview and challenges

Hurtado, J., Salvati, D., Semola, R., Bosio, M., & Lomonaco, V. (2023) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2023.200251 · Cited by 70 · see citing works

Metaverse for Wireless Systems: Vision, Enablers, Architecture, and Future Directions

Khan, L. U., Han, Z., Niyato, D. T., Guizani, M., & Hong, C. S. (2024) · IEEE Wireless Communications · doi:10.1109/mwc.013.2300287 · Cited by 68 · see citing works

A Survey on Scheduling Techniques in Computing and Network Convergence

Tang, S., Yu, Y., Wang, H., Wang, G., Chen, W., Xu, Z., Guo, S., & Gao, W. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3329027 · Cited by 68 · see citing works

A Survey of Generalisation in Deep Reinforcement LearningPreprint

Kirk, R., Zhang, A., Grefenstette, E., & Rocktäschel, T. (2021) · arXiv (Cornell University) · Cited by 63 · see citing works

Continual Learning With Knowledge Distillation: A Survey

Li, S., Su, T., Zhang, X.-Y., & Wang, Z. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3476068 · Cited by 63 · see citing works

Toward 6G-Based Metaverse: Supporting Highly-Dynamic Deterministic Multi-User Extended Reality Services

Yu, H., Shokrnezhad, M., Taleb, T., Li, R. Z., & Song, J. (2023) · IEEE Network · doi:10.1109/mnet.004.2300101 · Cited by 60 · see citing works

Continual Deep Learning for Time Series Modeling

Ao, S.-I., & Fayek, H. M. (2023) · Sensors · doi:10.3390/s23167167 · Cited by 56 · see citing works

Preserving and combining knowledge in robotic lifelong reinforcement learning

Meng, Y., Bing, Z., Yao, X., Chen, K., Huang, K., Gao, Y., Sun, F., & Knoll, A. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-00983-2 · Cited by 54 · see citing works

A collective AI via lifelong learning and sharing at the edge

Soltoggio, A., Ben-Iwhiwhu, E., Braverman, V., Eaton, E., Epstein, B., Ge, Y., Halperin, L., How, J., Itti, L., Jacobs, M. A., et al. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00800-2 · Cited by 51 · see citing works

Attention-Based QoE-Aware Digital Twin Empowered Edge Computing for Immersive Virtual Reality

Yu, J., Alhilal, A. Y., Zhou, T., Hui, P., & Tsang, D. H. K. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3380820 · Cited by 50 · see citing works

How Can the Blue Economy Contribute to Inclusive Growth and Ecosystem Resources in Asia? A Comparative Analysis

Geng, B., Wu, D., Zhang, C., Xie, W., Mahmood, M. A., & Ali, Q. (2024) · Sustainability · doi:10.3390/su16010429 · Cited by 43 · see citing works

A rubric for human-like agents and NeuroAI

Momennejad, I. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0446 · Cited by 41 · see citing works

Continual Learning for Smart City: A Survey

Yang, L., Luo, Z., Zhang, S., Teng, F., & Li, T. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3447123 · Cited by 41 · see citing works

A Definition of Continual Reinforcement Learning

Abel, D., Barreto, A., Roy, B. V., Precup, D., Hasselt, H. V., & Singh, S. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2192 · Cited by 36 · see citing works

Neural circuits and symbolic processing

Do, Q. H., & Hasselmo, M. E. (2021) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2021.107552 · Cited by 34 · see citing works

Pareto: Fair Congestion Control With Online Reinforcement Learning

Emara, S., Fei, W., Li, B., & Zeyl, T. J. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3185253 · Cited by 34 · see citing works

Measuring student attention based on EEG brain signals using deep reinforcement learning

Rehman, A. U., Shi, X., Ullah, F., Wang, Z., & Ma, C. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126426 · Cited by 33 · see citing works

A Survey of Machine Learning-Based Ride-Hailing Planning

Wen, D., Li, Y., & Lau, F. C. M. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3345174 · Cited by 33 · see citing works

Continual Deep Reinforcement Learning for Decentralized Satellite Routing

Lozano-Cuadra, F., Soret, B., Leyva‐Mayorga, I., & Popovski, P. (2025) · IEEE Transactions on Communications · doi:10.1109/tcomm.2025.3562522 · Cited by 28 · see citing works

Continual World: A Robotic Benchmark For Continual Reinforcement LearningPreprint

Wołczyk, M., Zając, M., Pascanu, R., Kuciński, Ł., & Miłoś, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.10919 · Cited by 25 · see citing works

Catastrophic Interference in Reinforcement Learning: A Solution Based on Context Division and Knowledge Distillation

Zhang, T., Wang, X., Liang, B., & Yuan, B. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3162241 · Cited by 24 · see citing works

Cooperative Multi-Agent Reinforcement Learning for Data Gathering in Energy-Harvesting Wireless Sensor Networks

Dvir, E., Shifrin, M., & Gurewitz, O. (2024) · Mathematics · doi:10.3390/math12132102 · Cited by 23 · see citing works

Knowledge Transfer for Cross-Domain Reinforcement Learning: A Systematic Review

Serrano, S. A., Martínez-Carranza, J., & Sucar, L. E. (2024) · IEEE Access · doi:10.1109/access.2024.3435558 · Cited by 24 · see citing works

Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment

Ganjdanesh, A., Gao, S., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01520 · Cited by 21 · see citing works

Learning to Dispatch for Flexible Job Shop Scheduling Based on Deep Reinforcement Learning via Graph Gated Channel Transformation

Huang, D., Zhao, H. P., Zhang, L., & Chen, K. (2024) · IEEE Access · doi:10.1109/access.2024.3384923 · Cited by 20 · see citing works

Continuum: Simple Management of Complex Continual Learning ScenariosPreprint

Douillard, A., & Lesort, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06253 · Cited by 19 · see citing works

Same State, Different Task: Continual Reinforcement Learning without Interference

Kessler, S., Parker-Holder, J., Ball, P., Zohren, S., & Roberts, S. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20674 · Cited by 18 · see citing works

Attention With System Entropy for Optimizing Credit Assignment in Cooperative Multi-Agent Reinforcement Learning

Wei, W., Li, H., Zhou, S., Li, B., & Liu, X. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2025.3563725 · Cited by 17 · see citing works

CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning AgentsPreprint

Powers, S., Xing, E., Kolve, E., Mottaghi, R., & Gupta, A. (2021) · CoLLAs · doi:10.48550/arxiv.2110.10067 · Cited by 52 · see citing works

Reinforcement learning for an enhanced energy flexibility controller incorporating predictive safety filter and adaptive policy updates

Paesschesoone, S., Kayedpour, N., Manna, C., & Crevecoeur, G. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123507 · Cited by 17 · see citing works

ConvLab-3: A Flexible Dialogue System Toolkit Based on a Unified Data Format

Zhu, Q., Geishauser, C., Lin, H.-C., van Niekerk, C., Peng, B., Zhang, Z., Feng, S., Heck, M. C., Lubis, N., Wan, D., et al. (2023) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2023.emnlp-demo.9 · Cited by 16 · see citing works

Learning to Resolve Social Dilemmas: A Survey

Fatima, S. S., Jennings, N. R., & Wooldridge, M. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15167 · Cited by 16 · see citing works

Universal Off-Policy EvaluationPreprint

Chandak, Y., Niekum, S., da Silva, B. C., Miller, E. G., Brunskill, E., & Thomas, P. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.12820 · Cited by 16 · see citing works

Continual learning: A systematic literature review

Yang, Q., Wang, L., Wicker, J., & Dobbie, G. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108226 · Cited by 17 · see citing works

Phyllis: Physics-Informed Lifelong Reinforcement Learning for Data Center Cooling Control

Wang, R., Cao, Z., Zhou, X., Wen, Y., & Tan, R. (2023) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3575813.3595189 · Cited by 15 · see citing works

State-of-the-Art Review: Seismic Design and Performance Assessment of Special Concentrically Braced Frames Developed for Complex Industrial Building Structures

Wasse, A. D., Dai, K., Wang, J., & Sharbati, R. (2024) · International Journal of Steel Structures · doi:10.1007/s13296-024-00815-w · Cited by 15 · see citing works

A sparse quantized hopfield network for online-continual memory

Alonso, N., & Krichmar, J. L. (2024) · Nature Communications · doi:10.1038/s41467-024-46976-4 · Cited by 15 · see citing works

Sampled-data funnel control and its use for safe continual learning

Lanza, L., Dennstädt, D., Worthmann, K., Schmitz, P., Şen, G. D., Trenn, S., & Schaller, M. (2024) · Systems & Control Letters · doi:10.1016/j.sysconle.2024.105892 · Cited by 15 · see citing works

Oscillatory neural network learning for pattern recognition: an on-chip learning perspective and implementation

Abernot, M., Azémard, N., & Todri‐Sanial, A. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1196796 · Cited by 13 · see citing works

Hamilton-Jacobi Reachability in Reinforcement Learning: A Survey

Ganai, M., Gao, S., & Herbert, S. (2024) · IEEE Open Journal of Control Systems · doi:10.1109/ojcsys.2024.3449138 · Cited by 13 · see citing works

Continuous Coordination As a Realistic Scenario for Lifelong LearningPreprint

Nekoei, H., Badrinaaraayanan, A., Courville, A. C., & Chandar, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.03216 · Cited by 13 · see citing works

Continual Backprop: Stochastic Gradient Descent with Persistent RandomnessPreprint

Dohare, S., Sutton, R. S., & Mahmood, A. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06325 · Cited by 18 · see citing works

Dynamics-Adaptive Continual Reinforcement Learning via Progressive Contextualization

Zhang, T., Lin, Z., Wang, Y., Ye, D., Fu, Q., Yang, W., Wang, X., Liang, B., Yuan, B., & Li, X. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3280085 · Cited by 13 · see citing works

Deep Reinforcement Learning in Nonstationary Environments With Unknown Change Points

Liu, Z. Q., Lü, J., Xuan, J., & Zhang, G. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3356981 · Cited by 14 · see citing works

Reinforcement learning in cold atom experiments

Reinschmidt, M., Fortágh, J., Günther, A., & Volchkov, V. (2024) · Nature Communications · doi:10.1038/s41467-024-52775-8 · Cited by 17 · see citing works

Emerging Trends in Machine Learning Assisted Optimization Techniques Across Intelligent Transportation Systems

Afolayan, B. I., Ghosh, A., Calderín, J. F., & Masegosa, A. D. (2024) · IEEE Access · doi:10.1109/access.2024.3501775 · Cited by 13 · see citing works

Prevalence of Code Smells in Reinforcement Learning Projects

Cardozo, N., Dusparić, I., & Cabrera, C. (2023) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain58948.2023.00013 · Cited by 12 · see citing works

Self-Sustaining Multiple Access with Continual Deep Reinforcement Learning for Dynamic Metaverse Applications

Mazandarani, H., Shokrnezhad, M., Taleb, T., & Li, R. Z. (2023) · IEEE International Conference on Metaverse Computing, Networking and Applications (MetaCom) · doi:10.1109/metacom57706.2023.00024 · Cited by 12 · see citing works

Visual adversarial imitation learning using variational models

Rafailov, R., Yu, T., Rajeswaran, A., & Finn, C. (2021) · arXiv · doi:10.48550/arxiv.2107.08829 · Cited by 12 · see citing works

(Un)supervised (Co)adaptation via Incremental Learning for Myoelectric Control: Motivation, Review, and Future Directions

Campbell, E., Egle, F., Oßwald, M., Côté‐Allard, U., Pilarski, P. M., Boccardo, N., Meattini, R., Vujaklija, I., Hargrove, L. J., Canepa, M., et al. (2025) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2025.3602397 · Cited by 11 · see citing works

A systematic review of reinforcement learning in Building-Integrated Photovoltaic (BIPV) optimization

Li, J., Xie, H., Zhang, J., Li, L., Song, G., Fu, H., Chen, P., Liu, C., Zhang, L., Shi, Z., et al. (2025) · Advances in Applied Energy · doi:10.1016/j.adapen.2025.100239 · Cited by 11 · see citing works

Reinforcement learning enhanced swarm intelligence and trajectory-based algorithms for parallel machine scheduling problems

Özsoydan, F. B. (2025) · Computers & Industrial Engineering · doi:10.1016/j.cie.2025.110948 · Cited by 11 · see citing works

A look into how machine learning is reshaping engineering models: the rise of analysis paralysis, optimal yet infeasible solutions, and the inevitable Rashomon paradox

Naser, M. Z. (2025) · Machine learning for computational science and engineering · doi:10.1007/s44379-025-00020-4 · Cited by 11 · see citing works

Diabetes-focused food recommender system (DFRS) to enabling digital health

Ahmed, E., Oumer, M., & Hassan, M. S. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000530 · Cited by 10 · see citing works

FLaRe: Achieving Masterful and Adaptive Robot Policies with Large-Scale Reinforcement Learning Fine-Tuning

Hu, J., Hendrix, R. C., Farhadi, A., Kembhavi, A., Martín-Martín, R., Stone, P., Zeng, K.-H., & Ehsani, K. (2025) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra55743.2025.11127934 · Cited by 10 · see citing works

Sequoia: A Software Framework to Unify Continual Learning ResearchPreprint

Normandin, F., Golemo, F., Ostapenko, O., Rodríguez, P., Riemer, M., Hurtado, J., Khetarpal, K., Lindeborg, R., Cecchi, L., Lesort, T., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01005 · Cited by 12 · see citing works

ACL-QL: Adaptive Conservative Level in Q-Learning for Offline Reinforcement Learning

Wu, K., Zhao, Y., Xu, Z., Che, Z., Yin, C., Liu, C. H., Feng, F., & Tang, J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3497667 · Cited by 9 · see citing works

Autonomous Reinforcement Learning via Subgoal CurriculaPreprint

Sharma, A., Gupta, A., Levine, S., Hausman, K., & Finn, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.12931 · Cited by 9 · see citing works

Optimal Cyber Attack Strategy Using Reinforcement Learning Based on Common Vulnerability Scoring System

Kim, B.-S., Suk, H.-W., Choi, Y., Moon, D., & Kim, M. S. (2024) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2024.052375 · Cited by 8 · see citing works

Sustainable Transport and Development Partnership: Enhancing Urban Growth in Hobart, Australia Through TOD, PPP and Green Building Practices

Wong, P. Y. L., Lai, J. H. K., & Lo, K. C. C. (2025) · Sustainability · doi:10.3390/su17030881 · Cited by 8 · see citing works

Loss of Plasticity in Continual Deep Reinforcement Learning

Abbas, Z., Zhao, R., Modayil, J., White, A., & Machado, M. C. (2023) · arXiv · doi:10.48550/arxiv.2303.07507 · Cited by 10 · see citing works

Reservoir computing with brain organoids

Smirnova, L., Caffo, B. S., & Johnson, E. C. (2023) · Nature Electronics · doi:10.1038/s41928-023-01096-7 · Cited by 7 · see citing works

Continual Domain Randomization

Josifovski, J., Auddy, S., Malmir, M., Piater, J., Knoll, A., & Navarro-Guerrero, N. (2024) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros58592.2024.10802060 · Cited by 7 · see citing works

SCRIPT: A Scalable Continual Reinforcement Learning Framework for Autonomous Penetration Testing

Zhou, S., Liu, J., Lu, Y., Yang, J., Zhang, Y., Lin, B., Zhong, X., & Hu, S. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.127827 · Cited by 7 · see citing works

Bidirectional Progressive Neural Networks With Episodic Return Progress for Emergent Task Sequencing and Robotic Skill Transfer

Ada, S. E., Say, H., Uğur, E., & Öztop, E. (2024) · IEEE Access · doi:10.1109/access.2024.3402089 · Cited by 7 · see citing works

A Survey: Navigating the Landscape of Incremental Learning Techniques and Trends

Li, Y., Wu, W., Luo, X., Zheng, M., Zhang, Y., & Peng, B. (2023) · International Conference on Intelligent Systems and Knowledge Engineering (ISKE) · doi:10.1109/iske60036.2023.10481497 · Cited by 7 · see citing works

An Adaptive Contention Window using Actor-Critic Reinforcement Learning Algorithm for Vehicular Ad-hoc NETworks

Kumar, P., Hota, L., Nayak, B. P., & Sangaiah, A. K. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.04.288 · Cited by 7 · see citing works

A Workflow for Building Computationally Rational Models of Human Behavior

Chandramouli, S., Shi, D., Putkonen, A., Peuter, S. D., Zhang, S., Jokinen, J., Howes, A., & Oulasvirta, A. (2024) · Computational Brain & Behavior · doi:10.1007/s42113-024-00208-6 · Cited by 7 · see citing works

Lifelong Hyper-Policy Optimization with Multiple Importance Sampling Regularization

Liotet, P., Vidaich, F., Metelli, A. M., & Restelli, M. (2022) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v36i7.20717 · Cited by 7 · see citing works

Avalanche: an End-to-End Library for Continual Learning

Lomonaco, V., Pellegrini, L., Cossu, A., Carta, A., Graffieti, G., Hayes, T. L., Lange, M. D., Masana, M., Pomponi, J., van de Ven, G. M., et al. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00399 · Cited by 137 · see citing works

A Novel Multiple Access Scheme for Heterogeneous Wireless Communications Using Symmetry-Aware Continual Deep Reinforcement Learning

Mazandarani, H., Shokrnezhad, M., & Taleb, T. (2025) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2025.3546183 · Cited by 6 · see citing works

Skill‐abstracting continual reinforcement learning for safe, efficient, and comfortable autonomous driving through vehicle–cloud collaboration

Chen, J., Zhao, C., Gao, K., Ji, Y., & Du, Y. (2025) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.13503 · Cited by 6 · see citing works

Beyond Reinforcement Learning for network security: A comprehensive survey and tutorial

Javadpour, A., Ja’fari, F., Taleb, T., Türkmen, F., & Benzaïd, C. (2025) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2025.104294 · Cited by 6 · see citing works

CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community

Liu, Y., Guo, B., Li, N., Ding, Y., Zhang, Z., & Yu, Z. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3423319 · Cited by 9 · see citing works

Adaptation to Unknown Situations as the Holy Grail of Learning-Based Self-Adaptive Systems: Research Directions

Cardozo, N., & Dusparić, I. (2021) · International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS) · doi:10.1109/seams51251.2021.00041 · Cited by 6 · see citing works

Surfing Information: The Challenge of Intelligent Decision-Making

Wu, C., & Zhang, Z. (2023) · Intelligent Computing · doi:10.34133/icomputing.0041 · Cited by 6 · see citing works

One Cannot Stand for Everyone! Leveraging Multiple User Simulators to train Task-oriented Dialogue Systems

Liu, Y., Jiang, X., Yin, Y., Wang, Y., Mi, F., Liu, Q., Wan, X., & Wang, B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.1 · Cited by 6 · see citing works

Emergent Communication in Multi-Agent Reinforcement Learning for Flying Base Stations

Naoumi, S., Alami, R., Hacid, H., Almazrouei, E., Debbah, M. A., Bennis, M., & Chafii, M. (2023) · IEEE International Mediterranean Conference on Communications and Networking (MeditCom) · doi:10.1109/meditcom58224.2023.10266608 · Cited by 6 · see citing works

Dual regularized policy updating and shiftpoint detection for automated deployment of reinforcement learning controllers on industrial mechatronic systems

Vantilborgh, V., Staessens, T., Groote, W. D., & Crevecoeur, G. (2023) · Control Engineering Practice · doi:10.1016/j.conengprac.2023.105783 · Cited by 6 · see citing works

Predictive reinforcement learning in non-stationary environments using weighted mixture policy

Pourshamsaei, H., & Nobakhti, A. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111305 · Cited by 6 · see citing works

A Study of Continual Learning Methods for Q-Learning

Bagus, B., & Gepperth, A. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892384 · Cited by 6 · see citing works

Vibration Suppression of Robotic Manipulators: A Review

Xu, D., Yang, G., Feng, H., Wang, X., & Liu, Y. (2025) · IEEE Open Journal of the Industrial Electronics Society · doi:10.1109/ojies.2025.3610876 · Cited by 5 · see citing works

Advanced EEG Signal Processing and Deep Q-Learning for Accurate Student Attention Monitoring

Rehman, A. U., Eman, N. U., Ullah, F., Cacciagrano, D., Mostarda, L., & Raza, N. M. (2024) · IEEE Access · doi:10.1109/access.2024.3523225 · Cited by 5 · see citing works

GAPPO-ERW: an imitation reinforcement learning approach for AGV path planning

Chen, W., Lin, X., Zhou, Z., Qiao, Y., Li, P., & Yu, D. X. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-07361-0 · Cited by 5 · see citing works

Multiagent Continual Coordination via Progressive Task Contextualization

Yuan, L., Li, L., Zhang, Z., Zhang, F., Guan, C., & Yu, Y. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3394513 · Cited by 5 · see citing works

Merging Decision Transformers: Weight Averaging for Forming Multi-Task Policies

Lawson, D., & Qureshi, A. H. (2024) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra57147.2024.10610919 · Cited by 5 · see citing works

High-Efficiency Vector Field by Time-Optimal Spatial Iterative Learning

Lv, S., Gao, Y., & Quan, Q. (2025) · IEEE Transactions on Robotics · doi:10.1109/tro.2025.3610174 · Cited by 4 · see citing works

Learning With an Open Horizon in Ever-Changing Dialogue Circumstances

Geishauser, C., van Niekerk, C., Lubis, N., Lin, H.-C., Heck, M. C., Feng, S., Ruppik, B., Vukovic, R., & Gašić, M. (2024) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2024.3385289 · Cited by 4 · see citing works

Survival games for humans and machines

Strannegård, C., Engsner, N., Ulfsbäcker, S., Andreasson, S., Endler, J. A., & Nordgren, A. (2024) · Cognitive Systems Research · doi:10.1016/j.cogsys.2024.101235 · Cited by 4 · see citing works

Hybrid Control Framework of UAVs Under Varying Wind and Payload Conditions

Coursey, A., Zhang, A., Quiñones-Grueiro, M., & Biswas, G. (2024) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc60939.2024.10645000 · Cited by 4 · see citing works

Cross-Domain DRL Agents for Efficient Job Placement in the Cloud-Edge Continuum

Aslanidis, T., Kosta, S., Lalis, S., & Chatzopoulos, D. (2025) · Workshop on Machine Learning and Systems (EuroMLSys) · doi:10.1145/3721146.3721934 · Cited by 4 · see citing works

Continual Learning as Computationally Constrained Reinforcement Learning

Kumar, S., Marklund, H., Rao, A., Zhu, Y., Jeon, H. J., Liu, Y., & Roy, B. V. (2025) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000116 · Cited by 4 · see citing works

Advancements and Challenges in Continual Reinforcement Learning: A Comprehensive ReviewPreprint

Zuffer, A., Burke, M., & Harandi, M. T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.21899

A Survey of Continual Reinforcement LearningPreprint

Pan, C., Yang, X. Z., Li, Y., Wei, W., Li, T., An, B., & Liang, J. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.21872

A Definition of Continual Reinforcement Learning

Abel, D., Barreto, A., Roy, B. V., Precup, D., Hasselt, H. V., & Singh, S. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2192 · Cited by 36 · see citing works

Position: Deployed Reinforcement Learning should be ContinualPreprint

Behdin, P., Roice, K., & Mesbahi, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.04029

Rethinking the Foundations for Continual Reinforcement LearningPreprint

Elelimy, E., Szepesvári, D., White, M., & Bowling, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.08161 · Cited by 1 · see citing works