CoChat

A Comprehensive Survey of Continual Learning: Theory, Method and Application

Open access
Wang, Liyuan, Zhang, Xingxing, Su, Hang, Zhu, Jun · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence

The DOI matches its Crossref record; 459 of the 459 references it cites were found in a registry or an index.

Abstract

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to develop themselves adaptively. In a general sense, continual learning is explicitly limited by catastrophic forgetting, where learning a new task usually results in a dramatic performance drop of the old tasks. Beyond this, increasingly numerous advances have emerged in recent years that largely extend the understanding and application of continual learning. The growing and widespread interest in this direction demonstrates its realistic significance as well as complexity. In this work, we present a comprehensive survey of continual learning, seeking to bridge the basic settings, theoretical foundations, representative methods, and practical applications. Based on existing theoretical and empirical results, we summarize the general objectives of continual learning as ensuring a proper stability-plasticity trade-off and an adequate intra/inter-task generalizability in the context of resource efficiency. Then we provide a state-of-the-art and elaborated taxonomy, extensively analyzing how representative strategies address continual learning, and how they are adapted to particular challenges in various applications. Through an in-depth discussion of promising directions, we believe that such a holistic perspective can greatly facilitate subsequent exploration in this field and beyond.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tpami.2024.3367329

Cites

459 of 459 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Items 401–459 of 459

Research works printed but not linked: 96

  1. Elahe Arani, Fahad Sarfraz, and Bahram Zonooz. Learning fast, learning slow: A general continual learning method based on complementary learning system. In International Conference on Learning Representations, 2021.
  2. Dushyant Rao, Francesco Visin, Andrei Rusu, Razvan Pascanu, Yee Whye Teh, and Raia Hadsell. Continual unsupervised rep- resentation learning. Advances in Neural Information Processing Systems, 32, 2019.
  3. Fan Bao, Chongxuan Li, Jun Zhu, and Bo Zhang. Analytic- dpm: an analytic estimate of the optimal reverse variance in diffusion probabilistic models. In International Conference on Learning Representations, 2021.
  4. Wickliffe C Abraham. Metaplasticity: tuning synapses and net- works for plasticity. Nature Reviews Neuroscience, 9(5):387-387, 2008.
  5. Alessandro Achille, Tom Eccles, Loic Matthey, Chris Burgess, Nicholas Watters, Alexander Lerchner, and Irina Higgins. Life- long disentangled representation learning with cross-domain latent homologies. Advances in Neural Information Processing Systems, 31, 2018.
  6. Idan Achituve, Aviv Navon, Yochai Yemini, Gal Chechik, and Ethan Fetaya. Gp-tree: A gaussian process classifier for few- shot incremental learning. In International Conference on Machine Learning, pages 54-65. PMLR, 2021.
  7. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1):1929-1958, 2014.
  8. Serban Stan and Mohammad Rostami. Unsupervised model adaptation for continual semantic segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 2593-2601, 2021.
  9. Fan-Keng Sun, Cheng-Hao Ho, and Hung-Yi Lee. Lamol: Lan- guage modeling for lifelong language learning. In International Conference on Learning Representations, 2019.
  10. Jingyuan Sun, Shaonan Wang, Jiajun Zhang, and Chengqing Zong. Distill and replay for continual language learning. In Proceedings of the 28th international conference on computational linguistics, pages 3569-3579, 2020.
  11. Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu. Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps. In Advances in Neural Information Processing Systems, 2022.
  12. Akiko Hayashi-Takagi, Sho Yagishita, Mayumi Nakamura, Fuku- toshi Shirai, Yi I Wu, Amanda L Loshbaugh, Brian Kuhlman, Klaus M Hahn, and Haruo Kasai. Labelling and optical era- sure of synaptic memory traces in the motor cortex. Nature, 525(7569):333-338, 2015.
  13. David Rolnick, Arun Ahuja, Jonathan Schwarz, Timothy Lil- licrap, and Gregory Wayne. Experience replay for continual learning. Advances in Neural Information Processing Systems, 32, 2019.
  14. Mohammad Rostami, Soheil Kolouri, Praveen Pilly, and James McClelland. Generative continual concept learning. In Proceed- ings of the AAAI Conference on Artificial Intelligence, volume 34, pages 5545-5552, 2020.
  15. Mohammad Rostami, Soheil Kolouri, and Praveen K Pilly. Com- plementary learning for overcoming catastrophic forgetting us- ing experience replay. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 3339-3345, 2019.
  16. Aishwarya Agarwal, Biplab Banerjee, Fabio Cuzzolin, and Sub- hasis Chaudhuri. Semantics-driven generative replay for few- shot class incremental learning. In Proceedings of the ACM Inter- national Conference on Multimedia, pages 5246-5254, 2022.
  17. Ben Tsuda, Kay M Tye, Hava T Siegelmann, and Terrence J Sejnowski. A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex. Proceedings of the National Academy of Sciences, 117(47):29872- 29882, 2020.
  18. Weikang Wang, Jiajun Zhang, Qian Li, Mei-Yuh Hwang, Chengqing Zong, and Zhifei Li. Incremental learning from scratch for task-oriented dialogue systems. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3710-3720, 2019.
  19. Mehrab N Modi, Yichun Shuai, and Glenn C Turner. The drosophila mushroom body: From architecture to algorithm in a learning circuit. Annual Review of Neuroscience, 43:465-484, 2020.
  20. Natawut Monaikul, Giuseppe Castellucci, Simone Filice, and Oleg Rokhlenko. Continual learning for named entity recogni- tion. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 13570-13577, 2021.
  21. Hadi Nekoei, Akilesh Badrinaaraayanan, Aaron Courville, and Sarath Chandar. Continuous coordination as a realistic scenario for lifelong learning. In International Conference on Machine Learn- ing, pages 8016-8024. PMLR, 2021.
  22. Jorge Mendez, Boyu Wang, and Eric Eaton. Lifelong policy gradient learning of factored policies for faster training without forgetting. Advances in Neural Information Processing Systems, 33:14398-14409, 2020.
  23. Fei Mi, Liangwei Chen, Mengjie Zhao, Minlie Huang, and Boi Faltings. Continual learning for natural language generation in task-oriented dialog systems. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3461-3474, 2020.
  24. Vinay Venkatesh Ramasesh, Aitor Lewkowycz, and Ethan Dyer. Effect of scale on catastrophic forgetting in neural networks. In International Conference on Learning Representations, 2021.
  25. Seyed Iman Mirzadeh, Mehrdad Farajtabar, and Hassan Ghasemzadeh. Dropout as an implicit gating mechanism for continual learning. In CVPR Workshops, pages 232-233, 2020.
  26. Junbum Cha, Sanghyuk Chun, Kyungjae Lee, Han-Cheol Cho, Seunghyun Park, Yunsung Lee, and Sungrae Park. Swad: Do- main generalization by seeking flat minima. Advances in Neural Information Processing Systems, 34:22405-22418, 2021.
  27. Andrea Madotto, Zhaojiang Lin, Zhenpeng Zhou, Seungwhan Moon, Paul A Crook, Bing Liu, Zhou Yu, Eunjoon Cho, Pascale Fung, and Zhiguang Wang. Continual learning in task-oriented dialogue systems. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 7452-7467, 2021.
  28. Maciej Wolczyk, Michal Zajkac, Razvan Pascanu, Lukasz Kucin- ski, and Piotr Milos. Continual world: A robotic benchmark for continual reinforcement learning. Advances in Neural Information Processing Systems, 34:28496-28510, 2021.
  29. Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Re- becca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, et al. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. In Interna- tional Conference on Machine Learning, pages 23965-23998. PMLR, 2022.
  30. Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Anirud- dha Kembhavi, Mohammad Rastegari, Jason Yosinski, and Ali Farhadi. Supermasks in superposition. Advances in Neural Information Processing Systems, 33:15173-15184, 2020.
  31. Frederik Benzing. Unifying importance based regularisation methods for continual learning. In International Conference on Artificial Intelligence and Statistics, pages 2372-2396. PMLR, 2022.
  32. Glen Berseth, Zhiwei Zhang, Grace Zhang, Chelsea Finn, and Sergey Levine. Comps: Continual meta policy search. In Interna- tional Conference on Learning Representations, 2021.
  33. Prashant Shivaram Bhat, Bahram Zonooz, and Elahe Arani. Task- aware information routing from common representation space in lifelong learning. In International Conference on Learning Represen- tations, 2023.
  34. Jaeyoo Park, Minsoo Kang, and Bohyung Han. Class-incremental learning for action recognition in videos. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13698-13707, 2021.
  35. Ramakanth Pasunuru, Veselin Stoyanov, and Mohit Bansal. Con- tinual few-shot learning for text classification. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 5688-5702, 2021.
  36. Dingcheng Li, Zheng Chen, Eunah Cho, Jie Hao, Xiaohu Liu, Fan Xing, Chenlei Guo, and Yang Liu. Overcoming catastrophic forgetting during domain adaptation of seq2seq language gener- ation. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 5441-5454, 2022.
  37. Dawei Li, Serafettin Tasci, Shalini Ghosh, Jingwen Zhu, Junting Zhang, and Larry Heck. Rilod: Near real-time incremental learning for object detection at the edge. In Proceedings of the 4th ACM/IEEE Symposium on Edge Computing, pages 113-126, 2019.
  38. Guodun Li, Yuchen Zhai, Qianglong Chen, Xing Gao, Ji Zhang, and Yin Zhang. Continual few-shot intent detection. In Proceed- ings of the 29th International Conference on Computational Linguis- tics, pages 333-343, 2022.
  39. Tian Li, Anit Kumar Sahu, Manzil Zaheer, Maziar Sanjabi, Ameet Talwalkar, and Virginia Smith. Federated optimization in hetero- geneous networks. Proceedings of Machine Learning and Systems, 2:429-450, 2020.
  40. Shuhao Gu and Yang Feng. Investigating catastrophic forgetting during continual training for neural machine translation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 4315-4326, 2020.
  41. Yanan Gu, Cheng Deng, and Kun Wei. Class-incremental instance segmentation via multi-teacher networks. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 1478- 1486, 2021.
  42. Zhuang Li, Lizhen Qu, and Gholamreza Haffari. Total recall: a customized continual learning method for neural semantic parsers. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3816-3831, 2021.
  43. Haopeng Ren, Yi Cai, Xiaofeng Chen, Guohua Wang, and Qing Li. A two-phase prototypical network model for incremental few-shot relation classification. In Proceedings of the International Conference on Computational Linguistics, pages 1618-1629, 2020.
  44. Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, 28, 2015.
  45. Guile Wu, Shaogang Gong, and Pan Li. Striking a balance between stability and plasticity for class-incremental learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1124-1133, 2021.
  46. Tongtong Wu, Xuekai Li, Yuan-Fang Li, Gholamreza Haffari, Guilin Qi, Yujin Zhu, and Guoqiang Xu. Curriculum-meta learn- ing for order-robust continual relation extraction. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 10363-10369, 2021.
  47. Zhen Wang, Liu Liu, Yajing Kong, Jiaxian Guo, and Dacheng Tao. Online continual learning with contrastive vision transformer. In European Conference on Computer Vision, pages 631-650. Springer, 2022.
  48. Vaibhav Varshney, Mayur Patidar, Rajat Kumar, Lovekesh Vig, and Gautam Shroff. Prompt augmented generative replay via supervised contrastive learning for lifelong intent detection. In Findings of the Association for Computational Linguistics: NAACL 2022, pages 1113-1127, 2022.
  49. Qiu-Feng Wang, Xin Geng, Shu-Xia Lin, Shi-Yu Xia, Lei Qi, and Ning Xu. Learngene: From open-world to your learning task. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 8557-8565, 2022.
  50. Evgenii Egorov, Anna Kuzina, and Evgeny Burnaev. Boovae: Boosting approach for continual learning of vae. Advances in Neural Information Processing Systems, 34:17889-17901, 2021.
  51. Jonathan Schwarz, Daniel Altman, Andrew Dudzik, Oriol Vinyals, Yee Whye Teh, and Razvan Pascanu. Towards a natural benchmark for continual learning. In NeurIPS Workshops, 2018.
  52. Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 10012-10022, 2021.
  53. Vincenzo Lomonaco, Karan Desai, Eugenio Culurciello, and Davide Maltoni. Continual reinforcement learning in 3d non- stationary environments. In CVPR Workshops, pages 248-249, 2020.
  54. Andrés Villa, Kumail Alhamoud, Victor Escorcia, Fabian Caba, Juan Le ón Alcázar, and Bernard Ghanem. vclimb: A novel video class incremental learning benchmark. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19035-19044, 2022.
  55. Jeffrey S Vitter. Random sampling with a reservoir. ACM Transactions on Mathematical Software (TOMS), 11(1):37-57, 1985.
  56. Johannes von Oswald, Christian Henning, Benjamin F Grewe, and João Sacramento. Continual learning with hypernetworks. In International Conference on Learning Representations, 2019.
  57. Scott Waddell. Neural plasticity: Dopamine tunes the mushroom body output network. Current Biology, 26(3):R109-R112, 2016.
  58. Chengyu Wang, Haojie Pan, Yuan Liu, Kehan Chen, Minghui Qiu, Wei Zhou, Jun Huang, Haiqing Chen, Wei Lin, and Deng Cai. Mell: Large-scale extensible user intent classification for dialogue systems with meta lifelong learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 3649-3659, 2021.
  59. Chen Wang, Yuheng Qiu, Dasong Gao, and Sebastian Scherer. Lifelong graph learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13719-13728, 2022.
  60. Yaoyao Liu, Bernt Schiele, and Qianru Sun. Adaptive aggregation networks for class-incremental learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2544-2553, 2021.
  61. Yaoyao Liu, Bernt Schiele, and Qianru Sun. Rmm: Reinforced memory management for class-incremental learning. Advances in Neural Information Processing Systems, 34:3478-3490, 2021.
  62. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Im- agenet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems, volume 25, pages 1097-1105, 2012.
  63. Rui Wang, Tong Yu, Handong Zhao, Sungchul Kim, Subrata Mi- tra, Ruiyi Zhang, and Ricardo Henao. Few-shot class-incremental learning for named entity recognition. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 571-582, 2022.
  64. Christian Geishauser, Carel van Niekerk, Hsien-Chin Lin, Nurul Lubis, Michael Heck, Shutong Feng, and Milica Gasic. Dy- namic dialogue policy for continual reinforcement learning. In Proceedings of the 29th International Conference on Computational Linguistics, pages 266-284, 2022.
  65. Ross Girshick. Fast r-cnn. In Proceedings of the IEEE International Conference on Computer Vision, pages 1440-1448, 2015.
  66. Yu Hao, Yanwei Fu, Yu-Gang Jiang, and Qi Tian. An end-to-end architecture for class-incremental object detection with knowl- edge distillation. In IEEE International Conference on Multimedia and Expo, pages 1-6. IEEE, 2019.
  67. Chengwei Qin and Shafiq Joty. Lfpt5: A unified framework for lifelong few-shot language learning based on prompt tuning of t5. In International Conference on Learning Representations, 2021.
  68. Christian Simon, Masoud Faraki, Yi-Hsuan Tsai, Xiang Yu, Samuel Schulter, Yumin Suh, Mehrtash Harandi, and Manmohan Chandraker. On generalizing beyond domains in cross-domain continual learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9265-9274, 2022.
  69. Juan-Manuel Perez-Rua, Xiatian Zhu, Timothy M Hospedales, and Tao Xiang. Incremental few-shot object detection. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13846-13855, 2020.
  70. Khurram Javed and Martha White. Meta-learning represen- tations for continual learning. Advances in Neural Information Processing Systems, 32, 2019.
  71. Stan Franklin. Autonomous agents as embodied ai. Cybernetics & Systems, 28(6):499-520, 1997.
  72. Hongyi Zhang, Moustapha Cisse, Yann N Dauphin, and David Lopez-Paz. Mixup: Beyond empirical risk minimization. In International Conference on Learning Representations, 2018.
  73. Shipeng Yan, Jiangwei Xie, and Xuming He. Der: Dynamically expandable representation for class incremental learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3014-3023, 2021.
  74. Shipeng Yan, Jiale Zhou, Jiangwei Xie, Songyang Zhang, and Xuming He. An em framework for online incremental learning of semantic segmentation. In Proceedings of the ACM International Conference on Multimedia, pages 3052-3060, 2021.
  75. Guanglei Yang, Enrico Fini, Dan Xu, Paolo Rota, Mingli Ding, Moin Nabi, Xavier Alameda-Pineda, and Elisa Ricci. Uncertainty- aware contrastive distillation for incremental semantic segmenta- tion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
  76. Tianlin Liu, Lyle Ungar, and Joao Sedoc. Continual learning for sentence representations using conceptors. In Proceedings of NAACL-HLT, pages 3274-3279, 2019.
  77. Kelvin Xu, Siddharth Verma, Chelsea Finn, and Sergey Levine. Continual learning of control primitives: Skill discovery via reset- games. Advances in Neural Information Processing Systems, 33:4999- 5010, 2020.
  78. Mengqi Xue, Haofei Zhang, Jie Song, and Mingli Song. Meta- attention for vit-backed continual learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 150-159, 2022.
  79. Congying Xia, Wenpeng Yin, Yihao Feng, and S Yu Philip. Incremental few-shot text classification with multi-round new classes: Formulation, dataset and system. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1351-1360, 2021.
  80. Kenji Doya. Complementary roles of basal ganglia and cerebel- lum in learning and motor control. Current opinion in neurobiology, 10(6):732-739, 2000.
  81. Zichen Miao, Ze Wang, Wei Chen, and Qiang Qiu. Continual learning with filter atom swapping. In International Conference on Learning Representations, 2021.
  82. Sergey Ioffe and Christian Szegedy. Batch normalization: Ac- celerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning, pages 448- 456. PMLR, 2015.
  83. Torben Ott and Andreas Nieder. Dopamine and cognitive control in prefrontal cortex. Trends in Cognitive Sciences, 23(3):213-234, 2019.
  84. Ron Chrisley. Embodied artificial intelligence. Artificial intelli- gence, 149(1):131-150, 2003.
  85. Aristotelis Chrysakis and Marie-Francine Moens. Online contin- ual learning from imbalanced data. In International Conference on Machine Learning, pages 1952-1961. PMLR, 2020.
  86. Randy Ardywibowo, Zepeng Huo, Zhangyang Wang, Bobak J Mortazavi, Shuai Huang, and Xiaoning Qian. Varigrow: Varia- tional architecture growing for task-agnostic continual learning based on bayesian novelty. In International Conference on Machine Learning, pages 865-877. PMLR, 2022.
  87. Pei Chen, Yangkang Zhang, Zejian Li, and Lingyun Sun. Few- shot incremental learning for label-to-image translation. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3697-3707, 2022.
  88. Yiduo Guo, Bing Liu, and Dongyan Zhao. Online continual learn- ing through mutual information maximization. In International Conference on Machine Learning, pages 8109-8126. PMLR, 2022.
  89. Mozhgan PourKeshavarzi, Guoying Zhao, and Mohammad Sabokrou. Looking back on learned experiences for class/task incremental learning. In International Conference on Learning Representations, 2021.
  90. Jiangpeng He and Fengqing Zhu. Online continual learning via candidates voting. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 3154-3163, 2022.
  91. Haw-Shiuan Chang, Erik Learned-Miller, and Andrew McCal- lum. Active bias: Training more accurate neural networks by em- phasizing high variance samples. Advances in Neural Information Processing Systems, 30, 2017.
  92. Wenpeng Hu, Zhou Lin, Bing Liu, Chongyang Tao, Zhengwei Tao Tao, Dongyan Zhao, Jinwen Ma, and Rui Yan. Overcoming catas- trophic forgetting for continual learning via model adaptation. In International Conference on Learning Representations, 2019.
  93. Wenpeng Hu, Qi Qin, Mengyu Wang, Jinwen Ma, and Bing Liu. Continual learning by using information of each class holistically. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 7797-7805, 2021.
  94. Haiyan Yin, Ping Li, et al. Mitigating forgetting in online continual learning with neuron calibration. Advances in Neural Information Processing Systems, 34:10260-10272, 2021.
  95. Fei Zhu, Zhen Cheng, Xu-Yao Zhang, and Cheng-lin Liu. Class- incremental learning via dual augmentation. Advances in Neural Information Processing Systems, 34:14306-14318, 2021.
  96. Fei Zhu, Xu-Yao Zhang, Chuang Wang, Fei Yin, and Cheng-Lin Liu. Prototype augmentation and self-supervision for incremen- tal learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5871-5880, 2021.

Cited by

See all 1,113

Metadata

Authors
Wang, L., Zhang, X., Su, H., & Zhu, J.
Affiliations
Tsinghua University (CN)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2024-08
Volume
46
Issue
8
Pages
5362-5383
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W4392173735
Cited by
1,113
References
313
Citations by year
2026: 437 · 2025: 471 · 2024: 170
FWCI
158.75
Type
journal article
Language
en
Open access
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • National Natural Science Foundation of China (62350080, 62076147, 62106123, U19A2081)
  • BNRist (BNR2022RC01006)
  • Tsinghua Institute for Guo Qiang
  • Tsinghua-OPPO Joint Research Center for Future Terminal Technology
  • High Performance Computing Center
  • Tsinghua University
  • Postdoctoral Fellowship Program of CPSF (GZB20230350)
  • Shuimu Tsinghua Scholar
  • New Cornerstone Science Foundation
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
continual learning, catastrophic forgetting, stability-plasticity trade-off, resource efficiency, incremental learning, adaptive intelligent systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.