A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks
Open accessThe DOI matches its DataCite record; 103 of the 103 references it cites were found in a registry or an index; 43 of the 89 sources its claims cite were checked for support.
Abstract
The ability of artificial agents to increment their capabilities when\nconfronted with new data is an open challenge in artificial intelligence. The\nmain challenge faced in such cases is catastrophic forgetting, i.e., the\ntendency of neural networks to underfit past data when new ones are ingested. A\nfirst group of approaches tackles forgetting by increasing deep model capacity\nto accommodate new knowledge. A second type of approaches fix the deep model\nsize and introduce a mechanism whose objective is to ensure a good compromise\nbetween stability and plasticity of the model. While the first type of\nalgorithms were compared thoroughly, this is not the case for methods which\nexploit a fixed size model. Here, we focus on the latter, place them in a\ncommon conceptual and experimental framework and propose the following\ncontributions: (1) define six desirable properties of incremental learning\nalgorithms and analyze them according to these properties, (2) introduce a\nunified formalization of the class-incremental learning problem, (3) propose a\ncommon evaluation framework which is more thorough than existing ones in terms\nof number of datasets, size of datasets, size of bounded memory and number of\nincremental states, (4) investigate the usefulness of herding for past\nexemplars selection, (5) provide experimental evidence that it is possible to\nobtain competitive performance without the use of knowledge distillation to\ntackle catastrophic forgetting and (6) facilitate reproducibility by\nintegrating all tested methods in a common open-source repository. The main\nexperimental finding is that none of the existing algorithms achieves the best\nresults in all evaluated settings. Important differences arise notably if a\nbounded memory of past classes is allowed or not.\n
Overview
CoChat Summary
TL;DR
This paper provides a comparative study of class incremental learning (IL) methods for visual tasks under a unified formalization and evaluation protocol. It finds that no single algorithm is best in all settings, and that the best choice depends strongly on whether a bounded memory of past classes is available.
Key findings
- With memory allowed, the strongest overall results came from methods that treat class IL as an imbalanced learning problem: the paper reports FT th as best overall with GIL = -3.62, followed by ScaIL (-3.70), BiC (-4.03), and LUCIR CNN (-4.13).
- In the memory setting, the authors report that vanilla FT can outperform iCaRL globally: FT has GIL = -5.19 versus iCaRL’s -7.36; they also state that FT is globally better than iCaRL by over 2 GIL points.
- Without memory, fixed-representation methods are reported to be much more competitive than fine-tuning methods; the best global score is said to come from DeeSIL, followed by Deep-SLDA, FR, and REMIND.
- Herding-based exemplar selection outperformed random selection for all methods tested in the reported experiments, though the gain varied by method.
Methods
- The paper compares class incremental learning algorithms in a common conceptual and experimental framework, focusing on methods for constant model complexity with bounded or no memory of past classes.
- Experiments use four datasets: ILSVRC (1,231,167 train / 50,000 test), VGGFACE2 (491,746 / 50,000), LANDMARKS (374,367 / 20,000), and CIFAR100 (50,000 / 10,000).
- Evaluation uses a ResNet-18 backbone with SGD, top-5 accuracy averaged over incremental states, and the Incremental Learning Gap (GIL) across configurations with varying numbers of states (T = 10, 20, 50) and memory sizes (including K = 2%, 1%, 0.5%, and K = 0 in the no-memory case).
Limitations
- The paper states that the evaluation scenario is still simplified and recommends future work on more realistic settings: no assumption of readily annotated incoming data, variable numbers of classes per incremental state, and imbalanced datasets.
- The authors note that their conclusions are limited to the tested setting of fixed-complexity visual class incremental learning; methods that grow model capacity, generative replay methods, and some online approaches are discussed but not evaluated under this protocol.
- Evident from the text: the study is constrained to four datasets and a specific set of algorithm families, so the findings may not generalize beyond the tested visual tasks and configurations.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
28 Valid · 3 Not valid · 29 Not checked · 127 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“The method does not need a bounded memory for the update.”
What the sources say
- Disputedcites [56] [56] Rebuffi, S., Kolesnikov, A., Sperl, G., Lampert, C.H., 2017b. icarl: Incremental classifier and representation learning, in: Conference on Computer Vision and Pattern Recognition. - sourceExperimental — accuracy not yet measured
If the cited method is iCaRL, the paper says the opposite. Section 2.4 (p. 4) states that its stored exemplars never exceed a memory budget of K, and the representation-learning discussion (p. 4) says those exemplars are used during updates. The copy does not identify a method called FR. (LLM, conf=0.84)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“However, fixed-representations work well only if the task does not change over time, as it is the case in the evaluated scenarios presented in [2].”
What the sources say
- Disputedcites [2] [2] Aljundi, R., Babiloni, F., Elhoseiny, M., Rohrbach, M., Tuytelaars, T., 2018. Memory aware synapses: Learning what (not) to forget, in: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (Eds.), Computer Vision - ECCV 2018 - 15th European Conference, Munich, Germany, September 8-14, 2018, Proceedings, Part III, Springer. pp. 144-161. - sourceExperimental — accuracy not yet measured
The evaluated scenarios do change tasks over time. Section 5.1 (p. 10) describes sequences such as Scenes → Birds, and the Longer Sequence results (p. 11) evaluate performance after successive tasks. The paper therefore contradicts the claim that its evaluated scenarios involve an unchanging task; it does not establish the broader rule about when fixed representations work well. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“FT BAL is also tributary to the fixed memory K because past exemplars are needed for the balancing step.”
What the sources say
- Supportedcites [7] [7] Belouadah, E., Popescu, A., 2019. Il2m: Class incremental learning with dual memory, in: Proceedings of the IEEE International Conference on Computer Vision, pp. 583-592. - source
Section 5.3.1 says FT BAL uses fine-tuning with memory and that, as memory decreases, more data must be dropped during its balancing step. Section 5.1 identifies that step as balanced fine-tuning after the initial imbalanced training. Together, these passages support the claim that FT BAL's balancing depends on stored past exemplars. (LLM, conf=0.88)
- Not matchedcites [8] [8] Belouadah, E., Popescu, A., 2020. Scail: Classifier weights scaling for class incremental learning, in: The IEEE Winter Conference on Applications of Computer Vision (WACV). -
More than one paper fits this citation.
- Partly supportedcites [14] [14] Castro, F.M., Marín-Jiménez, M.J., Guil, N., Schmid, C., Alahari, K., 2018. End-to-end incremental learning, in: Computer Vision - ECCV 2018 - 15th European Conference, Munich, Germany, September 814, 2018, Proceedings, Part XII, pp. 241-257. - sourceExperimental — accuracy not yet measured
Section 4 (Incremental Learning; page not provided) says balanced fine-tuning uses equal numbers of samples from old and new classes, supporting the need for stored past exemplars. But Section 3.1 (Representative memory; page not provided) describes both a fixed-capacity memory K and a memory that grows with the number of classes. The balancing step therefore depends on past exemplars, not specifically on fixed memory K. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“one early example of such work [56] is shown to outperform continual learning approaches when tested in a common experimental setting [35].”
What the sources say
- Supportedcites [56] [56] Rebuffi, S., Kolesnikov, A., Sperl, G., Lampert, C.H., 2017b. icarl: Incremental classifier and representation learning, in: Conference on Computer Vision and Pattern Recognition. - source
The Abstract (p. 1) identifies iCaRL as a class-incremental learning strategy. The Results (p. 7) report that iCaRL outperformed the other methods tested. The separate citation [35] is attached to the common experimental setting, so that setting is not attributed to this source. (LLM, conf=0.91)
- Supportedcites [35] [35] Lange, M.D., Aljundi, R., Masana, M., Parisot, S., Jia, X., Leonardis, A., Slabaugh, G.G., Tuytelaars, T., 2019. Continual learning: A comparative study on how to defy forgetting in classification tasks. CoRR abs/1909.08383. - source
Section 5.1 (p. 4) identifies iCaRL as an early class-incremental method and says the authors adapted it to their task-incremental, multi-head setting for a fair comparison. Section 6.3.1 (p. 10) reports that iCaRL outperformed all compared continual-learning methods for the DEEP model on Tiny Imagenet. The reported result is specific to that configuration. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“FT NEM can only be deployed if a bounded memory is allowed to alleviate catastrophic forgetting.”
What the sources say
- Supportedcites [7] [7] Belouadah, E., Popescu, A., 2019. Il2m: Class incremental learning with dual memory, in: Proceedings of the IEEE International Conference on Computer Vision, pp. 583-592. - source
Section 5.1 defines FT NEM by its nearest-exemplars-mean classifier. Section 5.3 reports that, with no memory (K = 0), all methods derived from fine tuning perform identically because their score-rectification methods rely on exemplars. Thus FT NEM’s distinctive classifier requires exemplar memory, even though the paper still reports a K = 0 result under the FT NEM label. (LLM, conf=0.86)
- Not matchedcites [8] [8] Belouadah, E., Popescu, A., 2020. Scail: Classifier weights scaling for class incremental learning, in: The IEEE Winter Conference on Applications of Computer Vision (WACV). -
More than one paper fits this citation.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
106 more claims · 6 with their cited sources checked
Create a free account to see all 187 claims and to verify the 12 references still open.
- It may state two separate claims as one. 52
- Probably not a substantial claim. 27
- The quote only partly states this claim. 2
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Although some surveys briefly mention FSCIL [32, 35], they only provide a short introduction to the concept and a few studies without offering a thorough or systematic analysis.”
From Few-Shot Class-Incremental Learning for Classification and Object Detection: A Survey (2025) · cites this paper as [32]
Experimental — accuracy not yet measured
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 5×
“In an end-to-end DNN [17], a softmax function is applied to transform raw scores 𝒐 𝑡 = ( 1 𝑡 , 𝑜 2 𝑡 , ..., ) to probabilities 𝒑 𝑡 = ( 1 𝑡 , 𝑝 2 𝑡 , ..., ) .”
BackgroundMethodInfluentialA Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb00917.x · Cited by 48,949
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380 · cited 2×
“• ILSVRC [47]”
MethodA mathematical theory of communication
Hockett, C. F., Shannon, C., & Weaver, W. (1948) · MOCO · doi:10.1145/584091.584093 · Cited by 30,543 · cited 1×
“We also tried exemplar selection techniques inspired from active learning approaches such as: entropy [52], min margin [51], core-set [50], k-means [62].”
MethodLearning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992 · cited 1×
“batch of classes and a battery of Support Vector Machines (SVMs) [7] to incrementally learn new classes.”
Background(2017) · Cited by 11,625
Research works printed but not linked: 4
- [19][19] Fritzke, B., 1994b. A growing neural gas network learns topologies, in: Tesauro, G., Touretzky, D.S., Leen, T.K. (Eds.), Advances in Neural Information Processing Systems 7, [NIPS Conference, Denver, Colorado, USA, 1994], MIT Press. pp. 625-632. -
- [70][70] Tao, X., Chang, X., Hong, X., Wei, X., Gong, Y., 2020a. Topologypreserving class-incremental learning, in: Vedaldi, A., Bischof, H., Brox, T., Frahm, J. (Eds.), Computer Vision - ECCV 2020 - 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XIX, Springer. pp. 254-270. -
- [73][73] Wang, Y., Ramanan, D., Hebert, M., 2017. Growing a brain: Finetuning by increasing model capacity, in: Conference on Computer Vision and Pattern Recognition. -
- [80][80] Yu, L., Twardowski, B., Liu, X., Herranz, L., Wang, K., Cheng, Y., Jui, S., van de Weijer, J., 2020. Semantic drift compensation for classincremental learning, in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13-19, 2020, IEEE. pp. 6980-6989. -
Cited by
Items 201–259 of 259
Incremental Learning with Repetition via Pseudo-Feature Projection
Tscheschner, B., Veas, E., & Masana, M. (2025) · arXiv.org · doi:10.3217/978-3-99161-022-9-004 · Cited by 1
“This limits the continual learning process as the initial task constrains the diversity and robustness of the features that can be learned for new classes [4, 33].”
Lightweight Autoencoder with Hierarchical Priors for Learned Image Compression
Zhou, J., Huang, Q., Tian, X., Zhou, L., Yang, Y., & Xiang, J. (2024) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc64274.2024.00015
“Shannon’s source coding theorem [22] establishes that the cross-entropy between the probability model as assumed by the encoder, and the actual distribution of the symbols as generated by the encoder.”
He, X., Ding, C., Qiao, F., & Shi, J. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831026 · Cited by 4
“Research methods for incremental learning can be divided into three types: replay-based, parameter isolation, and regularization-based[14], [15].”
FeTT: Continual Class Incremental Learning via Feature Transformation TuningPreprint
Qiang, S., Lin, X., Liang, Y., Wan, J., & Zhang, D. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.11822 · Cited by 2
“Currently, there are four main directions [3, 20, 21] of CL methods: regularization, memory replay, dynamic architecture-based, and pre-trained methods.”
BackgroundPreliminary exploration of data incremental learning method
Yu, M., Ding, M., Xi, Z., & Huang, T. (2024) · SPIE Medical Imaging: Image Processing · doi:10.1117/12.3005495 · Cited by 1
Zhao, M., Di, Z., Xia, Z., Tian, J. M., Xiang, J., & Lin, J. (2023) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom59178.2023.00175 · Cited by 2
“This process aims to achieve class incremental learning for traffic classification [2]; 2) The traffic classifier model should have the capability to deal with unknown classes within the network environment.”
BackgroundAn Optimized Class Incremental Learning Network with Dynamic Backbone Based on Sonar Images
Chen, X., & Hong, L. (2023) · Journal of Marine Science and Engineering · doi:10.3390/jmse11091781 · Cited by 1
MultIOD: Rehearsal-free Multihead Incremental Object Detector
Belouadah, E., Dapogny, A., & Bailly, K. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00414 · Cited by 2
Self-citationOnline Continual Learning for Control of Mobile Robots
Sarabakha, A., Qiao, Z., Ramasamy, S., & Suganthan, P. N. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191188 · Cited by 1
“To overcome the catastrophic forgetting, a trade-off between rigidity, i.e. being good on old tasks, and plasticity, i.e. being good on new tasks, has to be found [10].”
BackgroundIncremental learning without looking back: a neural connection relocation approach
Liu, Y., Wu, X., Bo, Y., Zheng, Z., & Yin, M. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08448-6 · Cited by 1
“Among them, the most focused incremental learning paradigm mainly includes three types of methods: regularization, replay [15], and parameter isolation [16].”
BackgroundDeep incremental learning models for financial temporal tabular datasets with distribution shiftsPreprint
Wong, T., & Barahona, M. (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2303.07925 · Cited by 2
“Incremental learning [3, 4, 5] is used to adapt deployed machine learning systems to changes in data streams.”
MethodCentroids Matching: an efficient Continual Learning approach operating in the embedding spacePreprint
Pomponi, J., Scardapane, S., & Uncini, A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.02048 · Cited by 2
“Initial CL works focused on fighting the CF phenomenon on the easiest supervised CL scenario, called task incremental learning, but, recently, we have seen a shift toward class incremental scenario, being closer, and more suitable, to real-world applications; nevertheless, a limited number of proposed approaches focus…”
BackgroundA Dynamic Testing Strategy With Incremental Learning Model for Quantum Programs
Huang, L.-Z., Pei, H., Li, Y.-C., et al. (2026) · IEEE Transactions on Quantum Engineering · doi:10.1109/tqe.2025.3626745 · Cited by 1
“In addition, incremental learning is also applied in other fields such as software reliability assessment [24] and fault prediction [25].”
Enhancing decision boundaries in continual learning through a decoupled Gaussian framework
FENG, Z., Chen, C., Yang, Z., Liu, Y., Kuang, P., Zhou, M., Dang, K., Gao, Z., & Ju, Y. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104963 · Cited by 1
Specialized Convolutional Neural Network Models for Echolocation-Based Perception
Kwon, H., Patil, G. U., Epureanu, B. I., & Popa, B.-I. (2025) · IEEE Access · doi:10.1109/access.2025.3607108 · Cited by 1
“In these cases, the network architecture needs to be changed to accommodate the additional output classes, and additional training needs to be performed [27], [49].”
L 2,1 -Constrained Deep Incremental NMF Approach for SAR Automatic Target Recognition
Cao, C., Chou, R., Zhang, H., Li, X. W., Luo, T., & Liu, B. (2024) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2024.3361500 · Cited by 3
“An urgent need exists for the proposal of an incremental learning scheme to improve the drawbacks of DNMF-based methods [16], [17], [18].”
BackgroundIncremental Learning Based on Data Translation and Knowledge Distillation
Tan, C., & Wang, J. (2023) · International Journal of Intelligence Science · doi:10.4236/ijis.2023.132003 · Cited by 1
NeCa: Network Calibration for Class Incremental Learning
Zhang, Z., & Zhang, L. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-47634-1_29 · Cited by 1
“Specifically, when a new task arrives, DNNs are prone to forget the knowledge gained on the old task, which is known academically as catastrophic forgetting [4,22].”
BackgroundSIGMA: Statistical Memory Head for Robust Class-Incremental Vision–Language Learning with CLIP
Nguyen, D.-D., Mai, D.-D., Ho, H. X., Pham, T., & Dang, T. H. (2026) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3776574.3831233
“The ability to learn incrementally without retraining from scratch is essential for visual recognition systems [1].”
Deng, J., Mei, C., & Jiang, H. (2026) · Microchemical Journal · doi:10.1016/j.microc.2026.119566
Modern Continual Learning with Foundation Models, Evaluation Challenges, and Future Directions
Ullah, Z., Hong, M., & Kim, J. (2026) · Mathematics · doi:10.3390/math14152774 · Cited by 1
Cuzzocrea, A., & Hafsaoui, A. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10080255
“…scaling to larger workloads will require further architectural enhancements, including the adoption of distributed computing frameworks (e.g., Apache Spark, Hadoop) and the implementation of incremental learning algorithms that can update models without retraining from scratch (e.g., [82,83]).”
Su, S., Liu, S., Hu, M., Wei, L., & Yan, Z. (2026) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2026.110365
Cui, C.-M., Zhou, H.-Y., Lai, P.-Y., & Wang, C. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.109447
Learning Probabilistic Prompt for Continual Learning
Park, H., Lee, S., Lee, G., et al. (2026) · arXiv.org · doi:10.48550/arxiv.2607.04711
“Approximating a Gaussian mixture with a single Gaussian via moment matching is a standard practice in probabilistic modeling [3, 5, 12, 13], as it retains the first and second-order statistics of the mixture, while allowing all components to be jointly optimized during training.”
ORACIL: Conflict-Graph-Based Order-Robust Analytic Class-Incremental Learning
Wang, G., Sun, H., Li, W., & Dong, Y. (2026) · Electronics · doi:10.3390/electronics15132941
Semi-Supervised Class-Incremental Learning for SAR Aircraft Recognition based on Mixture of Experts
Zhang, Y., & Geng, Z. (2026) · International Conference on Electronics and Communication, Network and Computer Technology (ECNCT) · doi:10.1109/ecnct70535.2026.11661525
“A table comparing the complexity, memory, accuracy, timeliness, plasticity, scalability of these three groups of meth-ods has been provided in [6].”
PSM: Prompt specialization module for prompt-based continual learning
Liu, J., Tong, Q., Lu, Z., & Lu, Z. (2026) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2026.104798 · Cited by 1
Non-Forgetting Knowledge Allocation with Bi-level Competition for Class-Incremental LearningPreprint
Tan, X., He, R., Cui, Y., Zhao, M., Wu, Y., Chen, T., Zhuang, H., Luo, X., & Li, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.29592
“However, CIL suffers from the issue of catastrophic forgetting [1, 22], where the performance of the model plunges on old tasks after learning new tasks.”
Angle-adaptive SAR images recognition based on combinatorial knowledge distillation optimization
Zhang, T. (2026) · International Journal of Remote Sensing · doi:10.1080/01431161.2026.2663565
“…(Shin et al. 2017; van de Ven, Siegelmann, and Tolias 2020; von Oswald et al. 2020), including categories never observed simultaneously – a particularly demanding requirement under constraints prohibiting historical sample retention (Belouadah, Popescu, and Kanellos 2021; Masana et al. 2022).”
Explainable Part-Based Vehicle Classifier with Spatial AwarenessPreprint
Caduff, A., Zahn, K., Hofstetter, J., Rechsteiner, M., & Flaig, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.07831
“Within this domain fixed representation approaches are noteworthy, where – generally speaking – the basic feature extraction part (e.g. convolutional layers for CNN) are not updated for each incremental state [6].”
Zhao, G., Yao, Y., Wang, X., et al. (2026) · 2026 IEEE 15th Data Driven Control and Learning Systems (DDCLS) · doi:10.1109/ddcls71227.2026.11610349
“Be-louadah et al. identified this as a primary cause of catastrophic forgetting, where the model fails to balance learning new tasks with preserving past knowledge [14].”
Sadhana, S., & Vanitha, M. (2026) · Telecommunications Systems · doi:10.1007/s11235-026-01409-z
“Incremental learning allows detection models to dynamically update behaviour profiles and learn new data while maintaining past information [19].”
Locally adaptive compensation for analytic class-incremental learning
Chen, H., Shi, N., Chen, L., et al. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.108761
Xie, C.-X., Zhong, Z.-G., & Zhang, L.-M. (2026) · Journal of Systems Engineering and Electronics · doi:10.23919/jsee.2025.000180
Is Parameter Isolation Better for Prompt-Based Continual Learning?Preprint
Li, J., Ding, C., Dong, S., Wang, Q., Zhao, J., He, Y., & Gong, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.20894 · Cited by 2
“Continual learning (CL) [1, 2] aims to endow models with the ability to learn new tasks sequentially without forgetting previously acquired knowledge.”
Zhang, H., & Zhang, S. (2025) · The Journal of Supercomputing · doi:10.1007/s11227-025-08166-x · Cited by 2
“However, these methods suffer from increased model complexity and computational overhead that limit their applicability in high-frequency update scenarios [35, 36].”
Continual Causal Effect Estimation for Dataset Shifting Streams in Marketing Optimization
Chen, B., Zhang, Y., Han, Y., Zhang, R., Du, R., Zhou, Z., Zhu, Z., Liu, X., & Guo, J. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401623
“Specifically, ICE-PKD extends the Disentangled Representations for CounterFactual Regression (DR-CFR) framework [19] into multiple treatments and draws inspiration from class-incremental methods in computer vision [20], [21], such as functional regularization [22] and relay-based techniques [23].”
Dile: a distribution-based incremental learning approach
Morales, E. F., Herrera-Vega, J., Cuevas, J. S., Aburto, Y., Sucar, L. E., & Escalante, H. J. (2025) · Pattern Analysis and Applications · doi:10.1007/s10044-025-01552-4
Qin, T., Cheng, G., Chen, Z., & Zhou, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.02031
“Commonly used strategies to mitigate this issue include regularization constraints, data replay, and parameter separation [6].”
Tang, H., Zu, X., Jiang, X., et al. (2025) · 2025 International Conference on Equipment Intelligent Operation and Maintenance (ICEIOM) · doi:10.1109/iceiom65271.2025.11239646
“However, two prerequisites to the reliability of those methods are supported by sufficient data collection on a comprehensive range of fault types, and “closed set hypothesis or similarity dependence” [7], in which it is a paradox with real industrial scenarios.”
Wang, Q., Shen, A., Feng, D., Zhang, X., Ding, B., & Wang, H. (2025) · IEEE International Conference on Joint Cloud Computing (JCC) · doi:10.1109/jcc67032.2025.00019
“Incremental Learning [13], [14] aims to address the issue of catastrophic forgetting on dynamic data streams.”
The Estimation of Continual Causal Effect for Dataset Shifting Streams
Chen, B., Zhang, Y., Han, Y., et al. (2025) · arXiv.org · doi:10.48550/arxiv.2504.20471
“Incremental learning [De Lange et al., 2019, Van de Ven et al., 2022, Belouadah et al., 2021] focuses on enabling models to learn from non-stationary data streams, a concept widely applied in computer vision.”
FeTT: Class-Incremental Learning with Feature Transformation Tuning
Qiang, S., & Liang, Y. (2025) · Mathematics · doi:10.3390/math13071095
Towards Experience Replay for Class-Incremental Learning in Fully-Binary Networks
Basso-Bert, Y., Molnos, A., Lemaire, R., Guicquéro, W., & Dupret, A. (2026) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3794851 · Cited by 1
“However, storing logits in CIL requires a bias correction mechanism [50] and it is not clear if they truly enhance performance [60].”
Fair Class-Incremental Learning using Sample Weighting
Park, J., Kim, M., & Whang, S. E. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770854.3780167 · Cited by 2
Han, H., Zhu, D., Wang, S., Kang, W., & Sha, J. (2024) · International Conference on Electronic Information Engineering and Data Processing (EIEDP) · doi:10.1117/12.3033184
“Based on a training set composed of multiple subsets, starting from the original state of the problem, an additional subset is added in each learning stage and a learning process is performed until the final result is achieved [6].”
Sampling Point Method: A Generalized Algorithm for Class-Incremental Learning of Linear Model
Cheng, Y. (2024) · International Symposium on Intelligent Robotics and Systems (ISoIRS) · doi:10.1109/isoirs63136.2024.00050
“However, incremental learning continually faces the issue of catastrophic forgetting [3], [4], where a model’s ability to handle old tasks significantly deteriorates after learning new tasks.”
BackgroundMethodData-Free Generative Replay for Class-Incremental Learning on Imbalanced DataPreprint
Younis, S., & Seeger, B. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2406.09052 · Cited by 1
“In the following, we focus on the most recent and effective techniques for class-incremental learning [3] [27].”
MethodA Methodology-Oriented Study of Catastrophic Forgetting in Incremental Deep Neural NetworksPreprint
Kumar, A., Agarwal, S., & Hemanth, D. J. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.08015
“To overcome this problem we can use the incremental learning also referred as online learning in which data continuously comes into chunks and confronted with the learning model[8, 28, 64].”
MethodRecommendation of data-free class-incremental learning algorithms by simulating future data
Feillet, E., Popescu, A., & Hudelot, C. (2024) · International Conference on Pattern Recognition · doi:10.48550/arxiv.2403.18132
“In practice, for evaluation purposes, T and N are defined based on the datasets used in evaluation benchmarks [2,33,63].”
BackgroundMethodInfluentialSelf-citationAdaptive Growth: Real-time CNN Layer ExpansionPreprint
Zhu, Y., & Chen, Y. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.03049 · Cited by 3
Combination of deep learning with representation learning in X-ray prohibited item detection
Rao, J., Qin, P., Zhou, G., Li, M., Zhang, J., Bao, Q., & Peng, Z. (2023) · Frontiers in Physics · doi:10.3389/fphy.2023.1174220
KRNet: Towards Efficient Knowledge Replay
Zhang, Y., Zhong, Q., Xie, D., & Pu, S. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956371
RF-CM: Cross-Modal Framework for RF-enabled Few-Shot Human Activity Recognition
Wang, X., Liu, T., Feng, C., Fang, D., & Chen, X. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580859 · Cited by 26
“In the future, we can use the incremental learning framework [2] to update the pre-trained network with newly collected mmWave samples to improve the radar model’s accuracy.”
MethodFu, D., Cheng, X., Chen, J., Jin, T., & Zhang, Z. M. (2026) · IEEE Transactions on Image Processing · doi:10.1109/tip.2026.3682022 · Cited by 1
“To address these challenges, we introduce the concept of Continual Audio-Visual Speech Recognition (CL-AVSR), inspired by the continual learning paradigm [5], [6], [7], [8], [9], [10].”
Wang, D., Liu, S., Zhang, J., et al. (2025) · Scandinavian International Conference on Fluid Power (SICFP) · doi:10.13052/rp-9788743808251a36
“Conversely, fine-tuning the fault diagnosis model solely with new data leads to catastrophic forgetting, dramatically degrading the fault diagnosis performance on the previously learned fault patterns[10].”
Class incremental learning in convolutional neural networks
Sharma, A. K., Rathore, A. S., & Goel, A. (2023) · AIP conference proceedings · doi:10.1063/5.0169652
Robust Saliency Guidance for Data-free Class Incremental Learning
Liu, X.-L., Zhai, J.-T., Bagdanov, A. D., et al. (2022) · arXiv.org · doi:10.48550/arxiv.2212.08251
“Class Incremental Learning (CIL) [1, 36] is a scenario that considers the possibility of adding new classes to already-trained models.”
Background
Metadata
- Authors
- Belouadah, E., Popescu, A., & Kanellos, I.
- Affiliations
- Commissariat à l'Énergie Atomique et aux Énergies Alternatives (FR)
- IMT Atlantique (FR)
- Corresponding author
- Popescu, Adrian
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2020
- Volume
- 135
- Pages
- 38-54
- ISSN
- 0893-6080 (ISSN-L)
- arXiv
- 2011.01844
- OpenAlex
- W3096398238
- Cited by
- 235
- References
- 86
- Citations by year
- 2026: 28 · 2025: 40 · 2024: 61 · 2023: 58 · 2022: 32 · 2021: 16
- FWCI
- 0.91
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Neural Networks (acceptedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- HAL (submittedVersion, cc-by-nc)
- Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- European Commission (951911, HORIZON2020)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
- Keywords
- class-incremental learning, catastrophic forgetting, stability-plasticity balance, herding behavior, knowledge distillation, evaluation framework, reproducibility, open-source repositories, visual task
- MeSH terms
- Algorithms, Artificial Intelligence, Humans, Memory, Psychomotor Performance, Visual Perception, Reproducibility of Results, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.