The DOI matches its Crossref record; 184 of the 184 references it cites were found in a registry or an index.
Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges
Open accessAbstract
Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective change through time, or where all the training data and objective criteria are never available at once. The evolution of the learning process is modeled by a sequence of learning experiences where the goal is to be able to learn new skills all along the sequence without forgetting what has been previously learned. CL can be seen as an online learning where knowledge fusion needs to take place in order to learn from streams of data presented sequentially in time. Continual learning also aims at the same time at optimizing the memory, the computation power and the speed during the learning process. An important challenge for machine learning is not necessarily finding solutions that work in the real world but rather finding stable algorithms that can learn in real world. Hence, the ideal approach would be tackling the real world in a embodied platform: an autonomous agent. Continual learning would then be effective in an autonomous agent or robot, which would learn autonomously through time about the external world, and incrementally develop a set of complex skills and knowledge.Robotic agents have to learn to adapt and interact with their environment using a continuous stream of observations. Some recent approaches aim at tackling continual learning for robotics, but most recent papers on continual learning only experiment approaches in simulation or with static datasets. Unfortunately, the evaluation of those algorithms does not provide insights on whether their solutions may help continual learning in the context of robotics. This paper aims at reviewing the existing state of the art of continual learning, summarizing existing benchmarks and metrics, and proposing a framework for presenting and evaluating both robotics and non robotics approaches in a way that makes transfer between both fields easier. We put light on continual learning in the context of robotics to create connections between fields and normalize approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Proceedings of IEEE International Conference on Computer Vision
(1995) · Proceedings of IEEE International Conference on Computer Vision · doi:10.1109/iccv.1995.466933 · Cited by 12,860
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., & Hochreiter, S. (2017) · arXiv · doi:10.48550/arxiv.1706.08500 · Cited by 8,365
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
The Pascal Visual Object Classes Challenge: A Retrospective
Everingham, M., Eslami, S. M. A., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-014-0733-5 · Cited by 7,139
Improved Techniques for Training GANs
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., & Chen, X. (2016) · arXiv · doi:10.48550/arxiv.1606.03498 · Cited by 6,965
Introduction to Reinforcement Learning
Sutton, R. S., & Barto, A. G. (1998) · The MIT Press eBooks · Cited by 6,855
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366 · cited 1×
“Curriculum Learning Curriculum learning (Bengio et al., 2009) is a training process that proposes a sequence of more and more difficult tasks to a learning algorithm in order to make it able to learn, at last, a generally harder task.”
BackgroundMcClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
Li, Z., & Hoiem, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2773081 · Cited by 4,202
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,149
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.587 · Cited by 3,988
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198
Schaul, T., Quan, J., Antonoglou, I., & Silver, D. (2015) · arXiv · doi:10.48550/arxiv.1511.05952 · Cited by 3,120
Continual lifelong learning with neural networks: A review
Parisi, G. I., Kemker, R., Part, J. L., Kanan, C., & Wermter, S. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.01.012 · Cited by 3,117
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817
Catastrophic forgetting in connectionist networks
French, R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01294-2 · Cited by 2,311
The Arcade Learning Environment: An Evaluation Platform for General Agents
Bellemare, M. G., Naddaf, Y., Veness, J., & Bowling, M. (2013) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3912 · Cited by 2,161
Toward an architecture for never-ending language learning
Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
Continual Learning Through Synaptic Intelligence
Zenke, F., Poole, B., & Ganguli, S. (2017) · arXiv · doi:10.48550/arxiv.1703.04200 · Cited by 1,784
Proceedings for the Annual Meeting of the Cognitive Science Society
Dziemianko, M., Clarke, A. D. F., & Keller, F. (2013) · Cited by 1,726
Steps toward Artificial Intelligence
Minsky, M. (1961) · Proceedings of the IRE · doi:10.1109/jrproc.1961.287775 · Cited by 1,675
Self-improving reactive agents based on reinforcement learning, planning and teaching
Lin, L.-J. (1992) · Machine Learning · doi:10.1007/bf00992699 · Cited by 1,564
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bhlmann, P., & van de Geer, S. (2011) · Cited by 1,527
Proceedings of the 2nd International Conference on Neural Information Processing Systems
Touretzky, D. S. (1989) · Cited by 1,439
Gradient Episodic Memory for Continual Learning
Lopez-Paz, D., & Ranzato, M. (2017) · arXiv · doi:10.48550/arxiv.1706.08840 · Cited by 1,403
Continual Learning with Deep Generative Replay
Shin, H., Lee, J. K., Kim, J., & Kim, J. (2017) · arXiv · doi:10.48550/arxiv.1705.08690 · Cited by 1,385
End-to-End Training of Deep Visuomotor Policies
Levine, S., Finn, C., Darrell, T. J., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 1,344
Rusu, A. A., Rabinowitz, N. C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., & Hadsell, R. (2016) · arXiv · doi:10.48550/arxiv.1606.04671 · Cited by 1,307
PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning
Mallya, A., & Lazebnik, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00810 · Cited by 1,258
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,245
Intrinsic Motivation Systems for Autonomous Mental Development
Oudeyer, P.-Y., Kaplan, F., & Hafner, V. V. (2007) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2006.890271 · Cited by 1,126
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
Chaudhry, A., Dokania, P. K., Ajanthan, T., & Torr, P. H. S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01252-6_33 · Cited by 1,091
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
Goodfellow, I. J., Mirza, M., Xiao, D., Courville, A., & Bengio, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6211 · Cited by 1,089
Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours
Pinto, L., & Gupta, A. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487517 · Cited by 1,047
Pros and cons of GAN evaluation measures
Borji, A. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.009 · Cited by 963
2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2014)
Wada, T. (2015) · Journal of the Robotics Society of Japan · doi:10.7210/jrsj.33.100 · Cited by 958
Visual Domain Adaptation: A survey of recent advances
Patel, V. M., Gopalan, R., Li, R., & Chellappa, R. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2347059 · Cited by 899
Efficient Lifelong Learning with A-GEM
Chaudhry, A., Ranzato, M., Rohrbach, M., & Elhoseiny, M. (2018) · arXiv · doi:10.48550/arxiv.1812.00420 · Cited by 852
Catastrophic forgetting, rehearsal and pseudorehearsal
ROBINS, A. (1995) · Connection Science · doi:10.1080/09540099550039318 · Cited by 833
2020 International Joint Conference on Neural Networks (IJCNN)
(2020) · doi:10.1109/ijcnn48605.2020 · Cited by 774
Formal theory of creativity, fun, and intrinsic motivation (1990–2010)
Schmidhuber, J. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2056368 · Cited by 747
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
Kalashnikov, D., Irpan, A., Pastor, P., Ibarz, J., Herzog, A., Jang, E., Quillen, D., Holly, E., Kalakrishnan, M., Vanhoucke, V., et al. (2018) · arXiv · doi:10.48550/arxiv.1806.10293 · Cited by 697
One shot learning of simple visual concepts
Lake, B. M., Salakhutdinov, R., Gross, J. N., & Tenenbaum, J. B. (2011) · eScholarship (California Digital Library) · Cited by 687
Measuring Catastrophic Forgetting in Neural Networks
Kemker, R., McClure, M., Abitino, A., Hayes, T., & Kanan, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11651 · Cited by 672
Li, Z., & Hoiem, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_37 · Cited by 659
Autonomous Mental Development by Robots and Animals
Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., & Thelen, E. (2001) · Science · doi:10.1126/science.291.5504.599 · Cited by 654
Developmental robotics: a survey
Lungarella, M., Metta, G., Pfeifer, R., & Sandini, G. (2003) · Connection Science · doi:10.1080/09540090310001655110 · Cited by 624
Expert Gate: Lifelong Learning with a Network of Experts
Aljundi, R., Chakravarty, P., & Tuytelaars, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.753 · Cited by 619
Piggyback: Adapting a Single Network to Multiple Tasks by Learning to Mask Weights
Mallya, A., Davis, D., & Lazebnik, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01225-0_5 · Cited by 613
Multi-task Self-Supervised Visual Learning
Doersch, C., & Zisserman, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.226 · Cited by 598
The Development of Embodied Cognition: Six Lessons from Babies
Smith, L., & Gasser, M. (2005) · Artificial Life · doi:10.1162/1064546053278973 · Cited by 597
PathNet: Evolution Channels Gradient Descent in Super Neural Networks
Fernando, C., Banarse, D., Blundell, C., Zwólš, Y., Ha, D., Rusu, A. A., Pritzel, A., & Wierstra, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08734 · Cited by 591
Incremental Learning of Object Detectors without Catastrophic Forgetting
Shmelkov, K., Schmid, C., & Alahari, K. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.368 · Cited by 559
The scientist in the crib : minds, brains, and how children learn
Alison Gopnik, C., Meltzoff, A. N., & Kuhl, P. K. (1999) · Medical Entomology and Zoology · Cited by 534
A Survey of Zero-Shot Learning: Settings, Methods, and Applications
Wang, W., Zheng, V. W., Yu, H., & Miao, C. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3293318 · Cited by 528
The limits and potentials of deep learning for robotics
Sünderhauf, N., Brock, O., Scheirer, W. J., Hadsell, R. T., Fox, D., Leitner, J., Upcroft, B., Abbeel, P., Burgard, W., Milford, M. J., et al. (2018) · QUT ePrints (Queensland University of Technology) · Cited by 519
Dhar, P., Singh, R. V., Peng, K.-C., Wu, Z., & Chellappa, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00528 · Cited by 516
Thrun, S., & Mitchell, T. M. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00004-y · Cited by 509
Robotics and Automation, 2009. ICRA '09. IEEE International Conference on
Chli, M., & Davison, A. J. (2009) · CiteSeer X (The Pennsylvania State University) · Cited by 506
Variational Continual Learning
Nguyen, C. V., Li, Y., Bui, T. D., & Turner, R. E. (2017) · arXiv · doi:10.48550/arxiv.1710.10628 · Cited by 491
Memory Replay GANs: learning to generate images from new categories without forgettingPreprint
Wu, C., Herranz, L., Liu, X., wang, Y., van de Weijer, J., & Raducanu, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02058 · Cited by 483
Chen, Z., & Liu, B. (2018) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01581-6 · Cited by 466
2016 IEEE International Conference on Robotics and Automation (ICRA)
(2016) · doi:10.1109/icra33126.2016 · Cited by 446
A Comprehensive Survey on Domain Adaptation for Visual Applications
Csurka, G. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_1 · Cited by 440
Variational Continual Learning
Turner, R., Bui, T., Li, Y., & Cuong, N. (2019) · Apollo - University of Cambridge Repository · doi:10.17863/cam.35471 · Cited by 438
Deep spatial autoencoders for visuomotor learning
Finn, C., Tan, X. Y., Duan, Y., Darrell, T., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487173 · Cited by 430
Mermillod, M., Bugaiska, A., & Bonin, P. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00504 · Cited by 424
Large-Scale Study of Curiosity-Driven Learning
Burda, Y., Edwards, H., Pathak, D., Storkey, A., Darrell, T., & Efros, A. A. (2018) · arXiv · doi:10.48550/arxiv.1808.04355 · Cited by 401
Incremental learning algorithms and applications
Gepperth, A., & Hammer, B. (2016) · HAL · Cited by 401
Proceedings of the 26th Annual International Conference on Machine Learning
(2009) · doi:10.1145/1553374 · Cited by 399
Sim-to-Real Robot Learning from Pixels with Progressive Nets
Rusu, A. A., Vecerik, M., Rothörl, T., Heess, N., Pascanu, R., & Hadsell, R. (2016) · arXiv · doi:10.48550/arxiv.1610.04286 · Cited by 385
2016 IEEE 55th Conference on Decision and Control (CDC)
(2016) · doi:10.1109/cdc32025.2016 · Cited by 368
Encoder Based Lifelong Learning
Rannen, A., Aljundi, R., Blaschko, M. B., & Tuytelaars, T. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.148 · Cited by 324
(1992) · Cited by 316
Continuous learning in single-incremental-task scenarios
Maltoni, D., & Lomonaco, V. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.03.010 · Cited by 309
Self-citationState representation learning for control: An overview
Lesort, T., Díaz-Rodríguez, N., Goudou, J.-F., & Filliat, D. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.006 · Cited by 301
Self-citationFearNet: Brain-Inspired Model for Incremental Learning
Kemker, R., & Kanan, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10563 · Cited by 296
Progress & Compress: A scalable framework for continual learning
Schwarz, J., Luketina, J., Czarnecki, W. M., Grabska‐Barwińska, A., Teh, Y. W., Pascanu, R., & Hadsell, R. T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06370 · Cited by 272
Metalearning: Applications to Data Mining
Brazdil, P., Giraud-Carrier, C., Soares, C., & Vilalta, R. (2009) · Cognitive Technologies · doi:10.1007/978-3-540-73263-1 · Cited by 264
Incremental Learning Techniques for Semantic Segmentation
Michieli, U., & Zanuttigh, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00400 · Cited by 256
Gandhi, D., Pinto, L., & Gupta, A. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206247 · Cited by 253
Don't forget, there is more than forgetting: new metrics for Continual LearningPreprint
Díaz-Rodríguez, N., Lomonaco, V., Filliat, D., & Maltoni, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.13166 · Cited by 253
Self-citationLess-forgetting Learning in Deep Neural NetworksPreprint
Jung, H., Ju, J., Jung, M., & Kim, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.00122 · Cited by 249
NIPS 2011 Workshop on Deep Learning and Unsupervised Feature Learning
Cho, K., Raiko, T., & Ilin, A. (2011) · Cited by 245
Overcoming catastrophic forgetting with hard attention to the task
Serrà, J., Surís, D., Miron, M., & Karatzoglou, A. (2018) · arXiv · doi:10.48550/arxiv.1801.01423 · Cited by 213
End-to-End Race Driving with Deep Reinforcement Learning
Jaritz, M., de Charette, R., Toromanoff, M., Perot, E., & Nashashibi, F. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460934 · Cited by 210
Memory Efficient Experience Replay for Streaming Learning
Hayes, T. L., Cahill, N. D., & Kanan, C. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793982 · Cited by 200
Roediger, H. L., Dudai, Y., & Fitzpatrick, S. M. (2007) · doi:10.1093/acprof:oso/9780195310443.001.0001 · Cited by 187
Stable reinforcement learning with autoencoders for tactile and visual data
van Hoof, H., Chen, N., Karl, M., van der Smagt, P., & Peters, J. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759578 · Cited by 184
Generative Models from the perspective of Continual Learning
Lesort, T., Caselles-Dupré, H., Garcia-Ortiz, M., Stoian, A., & Filliat, D. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8851986 · Cited by 184
Self-citationLoss is its own Reward: Self-Supervision for Reinforcement LearningPreprint
Shelhamer, E., Mahmoudieh, P., Argus, M. J., & Darrell, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.07307 · Cited by 182
Deep Generative Dual Memory Network for Continual LearningPreprint
Kamra, N., Gupta, U., & Liu, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.10368 · Cited by 176
Towards Robust Evaluations of Continual Learning
Farquhar, S., & Gal, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.09733 · Cited by 169
Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning
Forestier, S., Portelas, R., Mollard, Y., & Oudeyer, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.02190 · Cited by 166
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting
Ritter, H., Botev, A., & Barber, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07810 · Cited by 164
Online Incremental Feature Learning with Denoising Autoencoders
Zhou, G., Sohn, K., & Lee, H. (2012) · Cited by 160
Learning state representations with robotic priors
Jonschkowski, R., & Brock, O. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9459-7 · Cited by 158
Deep Imitative Models for Flexible Inference, Planning, and ControlPreprint
Rhinehart, N., McAllister, R., & Levine, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06544 · Cited by 155
Growing a Brain: Fine-Tuning by Increasing Model Capacity
Wang, Y.-X., Ramanan, D., & Hebert, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.323 · Cited by 154 · cited 1×
“Instead, layers may be dynamically expanded in a single network without the need of re-training or freezing previously learned parameters, improving model capacity over time (Wang et al., 2017).”
BackgroundRamapuram, J., Gregorová, M., & Kalousis, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.02.115 · Cited by 152
A Bio-Inspired Incremental Learning Architecture for Applied Perceptual Problems
Gepperth, A., & Karaoguz, C. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9389-5 · Cited by 150
On-the-Fly Adaptation of Regression Forests for Online Camera Relocalisation
Cavallari, T., Golodetz, S., Lord, N. A., Valentin, J., Stefano, L. D., & Torr, P. H. S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.31 · Cited by 150
GEP-PG: Decoupling Exploration and Exploitation in Deep Reinforcement Learning AlgorithmsPreprint
Colas, C., Sigaud, O., & Oudeyer, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05054 · Cited by 147
Life-Long Disentangled Representation Learning with Cross-Domain Latent HomologiesPreprint
Achille, A., Eccles, T., Matthey, L., Burgess, C., Watters, N., Lerchner, A., & Higgins, I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.06508 · Cited by 141
Incremental Classifier Learning with Generative Adversarial NetworksPreprint
Wu, Y., Chen, Y., Wang, L., Ye, Y., Liu, Z., Guo, Y., Zhang, Z., & Fu, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.00853 · Cited by 139
Planning to be surprised: optimal bayesian exploration in dynamic environments
Sun, Y., Gomez, F., & Schmidhuber, J. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22887-2_5 · Cited by 134 · cited 1×
“This idea is related to online change detection algorithms (Sarkar and Meeker, 1998; Moens and Zenon, 2018) or Bayesian surprise (Sun et al., 2011) in ML.”
MethodROBOTURK: A Crowdsourcing Platform for Robotic Skill Learning through Imitation
Mandlekar, A., Zhu, Y., Garg, A., Booher, J., Spero, M., Tung, A., Gao, J., Emmons, J., Gupta, A., Orbay, E., et al. (2018) · arXiv · doi:10.48550/arxiv.1811.02790 · Cited by 134
Embodied Evolution in Collective Robotics: A Review
Bredèche, N., Haasdijk, E., & Prieto, A. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2018.00012 · Cited by 134
CURIOUS: Intrinsically Motivated Modular Multi-Goal Reinforcement LearningPreprint
Colas, C., Fournier, P., Sigaud, O., Chétouani, M., & Oudeyer, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06284 · Cited by 134
SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark
Fan, L., Zhu, Y., Zhu, J., Liu, Z., Zeng, O., Gupta, A., Creus‐Costa, J., Savarese, S., & Fei-Fei, L. (2018) · Conference on Robot Learning · Cited by 132
End-to-End Driving Via Conditional Imitation Learning
Codevilla, F., Muller, M., Lopez, A., Koltun, V., & Dosovitskiy, A. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460487 · Cited by 129
Fine-Tuning Deep Neural Networks in Continuous Learning Scenarios
Käding, C., Rodner, E., Freytag, A., & Denzler, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54526-4_43 · Cited by 129
Continual Learning in Generative Adversarial NetsPreprint
Seff, A., Beatson, A., Suo, D., & Liu, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08395 · Cited by 128
Neurogenesis deep learning: Extending deep networks to accommodate new classes
Draelos, T. J., Miner, N. E., Lamb, C. C., Cox, J. A., Vineyard, C. M., Carlson, K. D., Severa, W., James, C. D., & Aimone, J. B. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7965898 · Cited by 121
Lifelong Learning of Spatiotemporal Representations With Dual-Memory Recurrent Self-Organization
Parisi, G. I., Tani, J., Weber, C., & Wermter, S. (2018) · Institutional Repositories DataBase (IRDB) · Cited by 120
Memory-based Parameter AdaptationPreprint
Sprechmann, P., Jayakumar, S. M., Rae, J. W., Pritzel, A., Badia, A. P., Uría, B., Vinyals, O., Hassabis, D., Pascanu, R., & Blundell, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10542 · Cited by 118
Overcoming Catastrophic Interference using Conceptor-Aided Backpropagation
He, X., & Jaeger, H. (2018) · International Conference on Learning Representations · Cited by 115
Multilevel Darwinist Brain (MDB): Artificial Evolution in a Cognitive Architecture for Real Robots
Bellas, F., Duro, R. J., Faíña, A., et al. (2010) · IEEE Transactions on Autonomous Mental Development · doi:10.1109/tamd.2010.2086453 · Cited by 102
A comprehensive, application-oriented study of catastrophic forgetting in DNNsPreprint
Pfülb, B., & Gepperth, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.08101 · Cited by 102
European Symposium on Artificial Neural Networks (ESANN) 2015
Mwebaze, E., Bearda, G., Biehl, M. L., & Zühlke, D. (2015) · Cited by 90
Curiosity Driven Exploration of Learned Disentangled Goal SpacesPreprint
Laversanne-Finot, A., Péré, A., & Oudeyer, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01521 · Cited by 87
Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on
Martínez-Carranza, J., Calway, A. D., & Mayol-Cuevas, W. W. (2013) · Cited by 82
From Babies to Robots: The Contribution of Developmental Robotics to Developmental Psychology
Cangelosi, A., & Schlesinger, M. (2018) · Child Development Perspectives · doi:10.1111/cdep.12282 · Cited by 77
Computational Theories of Curiosity-Driven LearningPreprint
Oudeyer, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10546 · Cited by 69
Open-Ended Learning: A Conceptual Framework Based on Representational Redescription
Doncieux, S., Filliat, D., Díaz-Rodríguez, N., Hospedales, T. M., Duro, R. J., Coninx, A., Roijers, D. M., Girard, B., Perrin, N., & Sigaud, O. (2018) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2018.00059 · Cited by 66
Self-citationDisCoRL: Continual Reinforcement Learning via Policy DistillationPreprint
Traoré, K. R., Caselles-Dupré, H., Lesort, T., Sun, T., Cai, G., Díaz-Rodríguez, N., & Filliat, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05855 · Cited by 57
Self-citationClosed-Loop Memory GAN for Continual Learning
Rios, A., & Itti, L. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/462 · Cited by 56
Raffin, A., Hill, A., Traoré, R., Lesort, T., Díaz-Rodríguez, N., & Filliat, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08651 · Cited by 56
Self-citationDiffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks
Velez, R., & Clune, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187736 · Cited by 55
Continual Reinforcement Learning in 3D Non-stationary Environments
Lomonaco, V., Desai, K., Culurciello, E., & Maltoni, D. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00132 · Cited by 55
Self-citationUnicorn: Continual Learning with a Universal, Off-policy AgentPreprint
Mankowitz, D. J., Žídek, A., Barreto, A. D. M. S., Horgan, D., Hessel, M., Quan, J., Oh, J., van Hasselt, H. P., Silver, D., & Schaul, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08294 · Cited by 54
Using conceptors to manage neural long-term memories for temporal patterns
Jaeger, H. (2017) · Journal of Machine Learning Research · doi:10.5555/3122009.3122022 · Cited by 53
Pasquale, G., Ciliberto, C., Rosasco, L., & Natale, L. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759720 · Cited by 51
Active Long Term Memory NetworksPreprint
Furlanello, T., Zhao, J., Saxe, A., Itti, L., & Tjan, B. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02355 · Cited by 49
New Metrics and Experimental Paradigms for Continual Learning
Hayes, T. L., Kemker, R., Cahill, N. D., & Kanan, C. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00273 · Cited by 47
Incremental robot learning of new objects with fixed update time
Camoriano, R., Pasquale, G., Ciliberto, C., Natale, L., Rosasco, L., & Giorgio Metta, B. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989364 · Cited by 46
Learn to Swing Up and Balance a Real Pole Based on Raw Visual Input Data
Mattner, J., Lange, S., & Riedmiller, M. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34500-5_16 · Cited by 43
Marginal Replay vs Conditional Replay for Continual Learning
Lesort, T., Gepperth, A., Stoian, A., & Filliat, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_38 · Cited by 41
Self-citationOnline semi-parametric learning for inverse dynamics modeling
Romeres, D., Zorzi, M., Camoriano, R., & Chiuso, A. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798708 · Cited by 40
Kim, S., Coninx, A., & Doncieux, S. (2020) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2020.103710 · Cited by 39
Computational Theories of Curiosity-Driven Learning
Oudeyer, P. (2018) · HAL · doi:10.17605/osf.io/3p8f6 · Cited by 39
The limits and potentials of deep learning for robotics
Sünderhauf, N., Brock, O., Scheirer, W., Hadsell, R., Fox, D., Leitner, J., Upcroft, B., Abbeel, P., Burgard, W., Milford, M., et al. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918770733 · Cited by 38
Teaching iCub to recognize objects using deep convolutional neural networks
Pasquale, G., Ciliberto, C., Odone, F., et al. (2015) · CINECA IRIS Institutial Research Information System (University of Genoa) · Cited by 34
Derivative-Free Online Learning of Inverse Dynamics Models
Romeres, D., Zorzi, M., Camoriano, R., Traversaro, S., & Chiuso, A. (2019) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2019.2891222 · Cited by 33
Lyubova, N., Ivaldi, S., & Filliat, D. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9445-0 · Cited by 28
Self-citationLearning and forgetting using reinforced Bayesian change detection
Moens, V., & Zénon, A. (2019) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006713 · Cited by 27
HerbDisc: Towards lifelong robotic object discovery
Collet, A., Xiong, B., Gurău, C., Hebert, M., & Srinivasa, S. S. (2014) · The International Journal of Robotics Research · doi:10.1177/0278364914546030 · Cited by 26
Tensor Based Knowledge Transfer Across Skill Categories for Robot Control
Zhao, C., Hospedales, T. M., Stulp, F., & Sigaud, O. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/484 · Cited by 26
Comparing Incremental Learning Strategies for Convolutional Neural Networks
Lomonaco, V., & Maltoni, D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46182-3_15 · Cited by 25
Self-citationS-TRIGGER: Continual State Representation Learning via Self-Triggered Generative Replay
Caselles-Dupré, H., Garcia-Ortiz, M., & Filliat, D. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533683 · Cited by 24
Self-citationTraoré, R., Caselles-Dupré, H., Lesort, T., Sun, T., Díaz-Rodríguez, N., & Filliat, D. (2019) · arXiv · doi:10.48550/arxiv.1906.04452 · Cited by 24
Self-citationSimultaneous on-line Discovery and Improvement of Robotic Skill options
Stulp, F., Herlant, L., Hoarau, A., & Raiola, G. (2014) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2014.6942741 · Cited by 19
Deep unsupervised state representation learning with robotic priors: a robustness analysis
Lesort, T., Seurin, M., Li, X., Díaz-Rodríguez, N., & Filliat, D. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852042 · Cited by 19
Self-citationTowards Lifelong Self-Supervision: A Deep Learning Direction for RoboticsPreprint
Wong, J. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.00201 · Cited by 13
A multimodal dataset for object model learning from natural human-robot interaction
Azagra, P., Golemo, F., Mollard, Y., et al. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206514 · Cited by 13
Towards Training Recurrent Neural Networks for Lifelong LearningPreprint
Sodhani, S., Chandar, S., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.07017 · Cited by 13
Exploring to learn visual saliency: The RL-IAC approach
Craye, C., Lesort, T., Filliat, D., & Goudou, J.-F. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.11.012 · Cited by 8
Self-citationValiant, L. G. (2026) · Foundations of Computation and Machine Learning · doi:10.1145/3749740.3749746
Research works printed but not linked: 7
- Bellas, 2009, Using promoters and functional introns in genetic algorithms for neuroevolutionary learning in non-stationary problems, Neurocomputing, 72, 2134, 10.1016/j.neucom.2008.10.022 · doi:10.1016/j.neucom.2008.10.022
- Bellas, 2010, 2, 340
- Duan, 2017, Learning State Representations for Robotic Control, M. Thesis
- He, 2019, NICO: A Dataset Towards Non-I.I.D. Image Classification, arXiv e-prints
- LeCun, 2010, MNIST handwritten digit database, Public
- Rusu, 2015, Policy Distillation, arXiv e-prints
- Sarkar, 1998, A bayesian on-line change detection algorithm with process monitoring applications, Qual. Eng., 10, 539, 10.1080/08982119808919168 · doi:10.1080/08982119808919168
Cited by
Ali, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Self-citationA Continual Learning Survey: Defying Forgetting in Classification Tasks
Delange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., & Tuytelaars, T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3057446 · Cited by 1,647
A continual learning survey: Defying forgetting in classification tasks
De Lange, M., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G., & Tuytelaars, T. (2019) · arXiv · doi:10.48550/arxiv.1909.08383 · Cited by 1,647
A Comprehensive Survey of Continual Learning: Theory, Method and Application
Wang, L., Zhang, X., Su, H., & Zhu, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3367329 · Cited by 1,113
Díaz-Rodríguez, N., Del Ser, J., Coeckelbergh, M., López de Prado, M., Herrera-Viedma, E., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101896 · Cited by 800
Self-citation
Metadata
- Authors
- Lesort, T., Lomonaco, V., Stoian, A., Maltoni, D., Filliat, D., & Díaz-Rodríguez, N.
- Venue
- Information Fusion
- Publisher
- Elsevier BV
- Published
- 2020-06
- Volume
- 58
- Pages
- 52-68
- ISSN
- 1566-2535
- OpenAlex
- W2996514457
- Cited by
- 506
- References
- 184
- FWCI
- 24.44
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (am, 222 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.