CoChat
Sign Up
PreprintCited by 56Domain Adaptation and Few-Shot LearningAdvanced Neural Network ApplicationsReinforcement Learning in Robotics

Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy

Open access
Aleixo, Everton L., Colonna, Juan G., Cristo, Marco, Fernandes, Everlandio·2023·arXiv
DOI 10.48550/arxiv.2312.10549arXiv 2312.10549
Open this paper in CoChat — free accountOpen PDF

Abstract

Deep Learning models have achieved remarkable performance in tasks such as image classification or generation, often surpassing human accuracy. However, they can struggle to learn new tasks and update their knowledge without access to previous data, leading to a significant loss of accuracy known as Catastrophic Forgetting (CF). This phenomenon was first observed by McCloskey and Cohen in 1989 and remains an active research topic. Incremental learning without forgetting is widely recognized as a crucial aspect in building better AI systems, as it allows models to adapt to new tasks without losing the ability to perform previously learned ones. This article surveys recent studies that tackle CF in modern Deep Learning models that use gradient descent as their learning algorithm. Although several solutions have been proposed, a definitive solution or consensus on assessing CF is yet to be established. The article provides a comprehensive review of recent solutions, proposes a taxonomy to organize them, and identifies research gaps in this area.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2312.10549

Cites

183 of 183 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Existing agent memory architectures lack selective forgetting mechanisms, causing either catastrophic forgetting at context boundaries or information overload within them.

    “Large language models deployed as autonomous agents face critical memory limitations, lacking selective forgetting mechanisms that lead to either catastrophic forgetting at context boundaries or information overload within them.”

    From FadeMem: Biologically-Inspired Forgetting for Efficient Agent Memory (2026) · cites this paper as [13]

    The Introduction describes catastrophic forgetting in deep neural networks during incremental learning, and §4, Final Considerations, describes limits on storing past data. The paper does not establish that autonomous LLM agents lack selective forgetting mechanisms or that context boundaries cause forgetting while information within them causes overload; §3.1.2 instead discusses methods for selecting what to retain in memory. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • The distance-based method is suitable for multi-class continual learning tasks; its objective is to minimize distance between data points within the same class and maximize distance between data points of different classes, thereby maintaining distinctiveness between classes and avoiding catastrophic forgetting of class attribution information during continual learning.

    “The distance-based method, based on Aleixo et al.'s theory [123], is suitable for multi-class continual learning tasks. Its objective is to minimize the distance between data points within the same class and to maximize the distance between data points of different classes, thereby maintaining the distinctiveness between classes and avoiding catastrophic forgetting of class attribution information”

    From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [123]

    Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

  • Aleixo et al. summarized four primary methods to mitigate catastrophic forgetting: rehearsal, distance-based methods, sub-networks, and dynamic networks.

    “Aleixo et al. [123] summarized four primary methods to mitigate catastrophic forgetting: rehearsal, distance-based methods, sub-networks, and dynamic networks.”

    From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [123]

  • The rehearsal method involves obtaining representative samples of previous tasks for incremental training to mitigate catastrophic forgetting.

    “The rehearsal method, based on Aleixo et al.'s theory [123], involves obtaining representative samples of previous tasks for incremental training to mitigate catastrophic forgetting.”

    From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [123]

  • The sub-networks method mitigates catastrophic forgetting by leveraging the idea that different tasks rely on distinct sets of weight parameters within the same model.

    “The sub-networks method, based on Aleixo et al.'s theory [123], mitigates catastrophic forgetting by leveraging the idea that different tasks rely on distinct sets of weight parameters within the same model.”

    From Human-inspired Perspectives: A Survey on AI Long-term Memory (2024) · cites this paper as [123]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 184 references couldn’t be matched to a known paper.

Research works printed but not linked: 36

  1. Adel, T., Zhao, H., & Turner, R. E. (2020). Continual learning with adaptive weights (claw). In International Conference on Learning Representations.
  2. Caccia, M., Rodr´ıguez, P., Ostapenko, O., Normandin, F., Lin, M., Page-Caccia, L., Laradji, I. H., Rish, I., Lacoste, A., Va´zquez, D., & Charlin, L. (2020). Online fast adaptation and knowl-edge accumulation (OSAKA): a new approach to continual learning. In Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M., & Lin, H. (Eds.), Advances in Neural Information Pro-cessing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual.
  3. Castro, F. M., Mar´ın-Jime´nez, M. J., Guil, N., Schmid, C., & Alahari, K. (2018). End-to-end in- cremental learning. In Ferrari, V., Hebert, M., Sminchisescu, C., & Weiss, Y. (Eds.), Com- puter Vision -ECCV 2018 -15th European Conference, Munich, Germany, September 8-14, 2018, Proceedings, Part XII, Vol. 11216 of Lecture Notes in Computer Science, pp. 241-257. Springer.
  4. Cha, H., Lee, J., & Shin, J. (2021). Co2l: Contrastive continual learning. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9516-9525.
  5. Church, K. W. (2017). Word2vec. Natural Language Engineering, 23(1), 155-162.
  6. Gepperth, A., Lefort, M., & Hecht, T. (2015). Resource-efficient incremental learning in very high dimensions. In 23rd European Symposium on Artificial Neural Networks, ESANN 2015, Bruges, Belgium, April 22-24, 2015, Bruges, Belgium.
  7. Goodfellow, I. J., Bengio, Y., & Courville, A. C. (2016). Deep Learning. Adaptive computation and machine learning. MIT Press.
  8. Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A. C., & Bengio, Y. (2014b). Generative adversarial nets. In Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N. D., & Weinberger, K. Q. (Eds.), Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, pp. 2672-2680.
  9. Han, S., Pool, J., Tran, J., & Dally, W. J. (2015). Learning both weights and connections for efficient neural networks. In Cortes, C., Lawrence, N. D., Lee, D. D., Sugiyama, M., & Garnett, R. (Eds.), Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada, pp. 1135-1143.
  10. Henning, C., Cervera, M., D'Angelo, F., Von Oswald, J., Traber, R., Ehret, B., Kobayashi, S., Grewe, B. F., & Sacramento, J. (2021). Posterior meta-replay for continual learning. Advances in Neural Information Processing Systems, 34.
  11. Hung, C.-Y., Tu, C.-H., Wu, C.-E., Chen, C.-H., Chan, Y.-M., & Chen, C.-S. (2019). Compact- ing, picking and growing for unforgetting continual learning. In Wallach, H., Larochelle, H., Beygelzimer, A., d'Alche´-Buc, F., Fox, E., & Garnett, R. (Eds.), Advances in Neural Informa-tion Processing Systems, Vol. 32. Curran Associates, Inc.
  12. Javed, K., & White, M. (2019). Meta-learning representations for continual learning. In Wallach, H., Larochelle, H., Beygelzimer, A., d'Alche´-Buc, F., Fox, E., & Garnett, R. (Eds.), Advances in Neural Information Processing Systems, Vol. 32. Curran Associates, Inc.
  13. Kim, G., Liu, B., & Ke, Z. (2022). A multi-head model for continual learning via out-of-distribution replay. In Chandar, S., Pascanu, R., & Precup, D. (Eds.), Conference on Lifelong Learning Agents, CoLLAs 2022, 22-24 August 2022, McGill University, Montre´al, Que´bec, Canada, Vol. 199 of Proceedings of Machine Learning Research, pp. 548-563.
  14. PMLR.
  15. PMLR.
  16. PMLR.
  17. Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., & Gar- nett, R. (Eds.), Advances in Neural Information Processing Systems, Vol. 30, pp. 6467-6476.
  18. Ma, C., Ji, Z., Huang, Z., Shen, Y., Gao, M., & Xu, J. (2023). Progressive voronoi diagram sub- division enables accurate data-free class-incremental learning. In The Eleventh International Conference on Learning Representations.
  19. Masana, M., Liu, X., Twardowski, B., Menta, M., Bagdanov, A. D., & van de Weijer, J. (2020). Class-incremental learning: survey and performance evaluation. CoRR, abs/2010.15277. · arXiv
  20. Touretzky, D. S., Elman, J. L., Sejnowski, T. J., & Hinton, G. E. (Eds.), Connectionist Models, pp. 10-17.
  21. Morgan Kaufmann.
  22. Nair, V., & Hinton, G. E. (2010). Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th International Conference on International Conference on Machine Learning, ICML'10, p. 807-814, Madison, WI, USA.
  23. Perez-Rua, J.-M., Zhu, X., Hospedales, T. M., & Xiang, T. (2020). Incremental few-shot object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13846-13855.
  24. PourKeshavarzi, M., Zhao, G., & Sabokrou, M. (2022). Looking back on learned experiences for class/task incremental learning. In 10th International Conference on Learning Representations, ICLR 2022, Virtual, April 25 -April 29, 2022, Conference Track Proceedings.
  25. Ritter, H., Botev, A., & Barber, D. (2018). Online structured laplace approximations for overcoming catastrophic forgetting. In Bengio, S., Wallach, H. M., Larochelle, H., Grauman, K., Cesa-Bianchi, N., & Garnett, R. (Eds.), Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, Decem-ber 3-8, 2018, Montre´al, Canada, pp. 3742-3752.
  26. Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. P. (2016). Meta-learning with memory-augmented neural networks. In Balcan, M., & Weinberger, K. Q. (Eds.), Proceedings of the 33rd International Conference on International Conference on Machine Learning -Volume 48, ICML'16, p. 1842-1850. JMLR.org.
  27. Serra`, J., Suris, D., Miron, M., & Karatzoglou, A. (2018). Overcoming catastrophic forgetting with hard attention to the task. In Dy, J. G., & Krause, A. (Eds.), Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsma¨ssan, Stockholm, Sweden, July 10-15, 2018, Vol. 80 of Proceedings of Machine Learning Research, pp. 4555-4564. PMLR.
  28. McIlraith, S. A., & Weinberger, K. Q. (Eds.), Proceedings of the Thirty-Second AAAI Con- ference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018, pp. 4034-4041. AAAI Press.
  29. Wang, Y., Huang, Z., & Hong, X. (2022b). S-prompts learning with pre-trained transformers: An occam's razor for domain incremental learning. In Conference on Neural Information Pro- cessing Systems (NeurIPS).
  30. Wu, Y., Chen, Y., Wang, L., Ye, Y., Liu, Z., Guo, Y., & Fu, Y. (2019). Large scale incremen-tal learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  31. Xu, J., & Zhu, Z. (2018). Reinforced continual learning. In Bengio, S., Wallach, H. M., Larochelle, H., Grauman, K., Cesa-Bianchi, N., & Garnett, R. (Eds.), Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3-8, 2018, Montre´al, Canada, pp. 907-916.
  32. PMLR.
  33. In Yin, H., Camacho, D., Novais, P., & Tallo´n-Ballesteros, A. J. (Eds.), Intelligent Data En-gineering and Automated Learning -IDEAL 2018 -19th International Conference, Madrid, Spain, November 21-23, 2018, Proceedings, Part I, Vol. 11314 of Lecture Notes in Computer Science, pp. 711-721. Springer.
  34. PMLR.
  35. Zenke, F., Poole, B., & Ganguli, S. (2017). Continual learning through synaptic intelligence. In Pro-ceedings of the 34th International Conference on Machine Learning -Volume 70, ICML'17, p. 3987-3995. JMLR.org.
  36. Zhu, F., Cheng, Z., Zhang, X.-y., & Liu, C.-l. (2021a). Class-incremental learning via dual augmentation. Advances in Neural Information Processing Systems, 34.

Cited by

Sorted by citations

Related

Authors
Aleixo, E. L., Colonna, J. G., Cristo, M., & Fernandes, E.
Affiliations
Universidade Federal do Amazonas (BR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
30
Issue
1
ISSN
0104-6500 (ISSN-L)
DOI
10.48550/arxiv.2312.10549
arXiv
2312.10549
OpenAlex
W4401478512
Cited by
54
References
184
Citations by year
2026: 22 · 2025: 28 · 2024: 4
FWCI
8.00
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of the Brazilian Computer Society (publishedVersion, cc-by-nc)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc)
  • arXiv (Cornell University) (cc-by)
Funders
  • Institute for Catastrophic Loss Reduction
  • Universidade Federal do Amazonas
  • Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
  • Samsung (8.387/1991, 001/2020)
  • Instituto de Ciencias del Mar y Limnología, Universidad Nacional Autónoma de México
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
catastrophic forgetting, incremental learning, continual learning, gradient-based learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review