The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Catastrophic Forgetting, Rehearsal and Pseudorehearsal
Abstract
This paper reviews the problem of catastrophic forgetting (the loss or disruption of previously learned information when new information is learned) in neural networks, and explores rehearsal mechanisms (the retraining of some of the previously learned information as the new information is added) as a potential solution. We replicate some of the experiments described by Ratcliff (1990), including those relating to a simple 'recency' based rehearsal regime. We then develop further rehearsal regimes which are more effective than recency rehearsal. In particular, 'sweep rehearsal' is very successful at minimizing catastrophic forgetting. One possible limitation of rehearsal in general, however, is that previously learned information may not be available for retraining. We describe a solution to this problem, 'pseudorehearsal', a method which provides the advantages of rehearsal without actually requiring any access to the previously learned information (the original training population) itself. We then suggest an interpretation of these rehearsal mechanisms in the context of a function approximation based account of neural network learning. Both rehearsal and pseudorehearsal may have practical applications, allowing new information to be integrated into an existing network with minimum disruption of old information.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Inspired by replay strategies in continual learning (Robins, 1995; Rolnick et al., 2019; De Lange et al., 2021) as well as by the replay phenomena observed in humans (Smolen et al., 2016) and in neural network models (Amiri et al., 2017), we explore whether simple continual learning strategies remain effective for LLMs.”
From Evaluating the Long-Term Memory of Large Language Models (2025) · cites this paper as Robins, 1995
In the citing paper
“While replaying data from pre-training or previous training stages can alleviate forgetting (Lin, 1992; Robins, 1995; Chen et al., 2025), this strategy is data-inefficient and not scalable as we grow the amount of experience.”
From Continual Learning via Sparse Memory Finetuning (2025) · cites this paper as Robins, 1995
In the citing paper
“Before the era of deep learning, Robins [86,87] stated that catastrophic forgetting could be mitigated through rehearsal or pseudo-rehearsal.”
From An Appraisal of Incremental Learning Methods (2020) · cites this paper as [87]
Citations
Cites
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Introduction to the theory of neural computation
Hertz, J., Krogh, A., & Palmer, R. G. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,410
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Competitive learning: From interactive activation to adaptive resonance
Grossberg, S. (1987) · Cognitive Science · doi:10.1111/j.1551-6708.1987.tb00862.x · Cited by 1,471
The ART of adaptive pattern recognition by a self-organizing neural network
Carpenter, G. A., & Grossberg, S. (1988) · Computer · doi:10.1109/2.33 · Cited by 1,278
Ratcliff, R. (1990) · Psychological Review · doi:10.1037/0033-295x.97.2.285 · Cited by 939
Artificial Neural Networks: Approximation and Learning Theory
White, H. (1992) · Medical Entomology and Zoology · Cited by 441
Networks of Formal Neurons and Memory Palimpsests
Nadal, J., Toulouse, G., Changeux, J., & Dehaene, S. (1986) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/1/10/008 · Cited by 215
From Statistics to Neural Networks: Theory and Pattern Recognition Applications
Cherkassky, V., Friedman, J. H., & Wechsler, H. L. (1996) · CERN Document Server (European Organization for Nuclear Research) · Cited by 177
Prediction Risk and Architecture Selection for Neural Networks
Moody, J. E. (1994) · Springer eBooks · doi:10.1007/978-3-642-79119-2_7 · Cited by 158
Cited by
Sorted by citations
Items 301–400 of 830
Lifelong language learning with adaptive uncertainty regularization
Zhang, L., Wang, S., Yuan, F., Geng, B., & Yang, M. (2022) · Information Sciences · doi:10.1016/j.ins.2022.11.141 · Cited by 14
Distributed Fine-tuning of Language Models on Private Data
Va, P., Kudinov, M., Piontkovskaya, I., Vytovtov, P., & Nevidomsky, A. (2018) · International Conference on Learning Representations · Cited by 13
Wang, C., Zheng, X., Guo, C., Yu, Z., Yu, J., Zheng, H., & Zheng, B. (2018) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceanskobe.2018.8558836 · Cited by 13
Control of consolidation in neural networks: Avoiding runaway effects
Meeter, M. (2003) · Connection Science · doi:10.1080/0954009031000149591 · Cited by 15
Tackling Catastrophic Forgetting and Background Shift in Continual Semantic SegmentationPreprint
Douillard, A., Chen, Y., Dapogny, A., & Cord, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15287 · Cited by 18
A Class-Incremental Learning Method for SAR Images Based on Self-Sustainment Guidance Representation
Pan, Q., Liao, K., He, X., Bu, Z., & Huang, J. (2023) · Remote Sensing · doi:10.3390/rs15102631 · Cited by 12
Continual Learning with Dual Regularizations
Han, X., & Guo, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86486-6_38 · Cited by 12
Bayram, B., & İnce, G. (2021) · Sensors · doi:10.3390/s21196622 · Cited by 12
Deep learning via message passing algorithms based on belief propagation
Lucibello, C., Pittorino, F., Perugini, G., & Zecchina, R. (2022) · Machine Learning Science and Technology · doi:10.1088/2632-2153/ac7d3b · Cited by 12
Adversarial counterfactual augmentation: application in Alzheimer’s disease classification
Xia, T., Sanchez, P. L., Qin, C., & Tsaftaris, S. A. (2022) · Frontiers in Radiology · doi:10.3389/fradi.2022.1039160 · Cited by 12
Balanced Class-Incremental 3D Object Classification and Retrieval
Liu, A.-A., Lu, H., Zhou, H., Li, T.-B., & Kankanhalli, M. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3284032 · Cited by 12
Towards Knowledgeable Supervised Lifelong Learning Systems
Benavides‐Prado, D., Koh, Y. S., & Riddle, P. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11432 · Cited by 13
Reduction of catastrophic forgetting with transfer learning and ternary output codes
Gutstein, S., & Stump, E. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280416 · Cited by 14
Requirements for Machine Lifelong Learning
Silver, D. L., & Poirier, R. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73053-8_31 · Cited by 12
Catastrophic Forgetting in Reinforcement-Learning Environments
Cahill, A. (2010) · Otago University Research Archive (University of Otago) · Cited by 12
Introspective GAN: Learning to grow a GAN for incremental generation and classification
He, C., Wang, R., Shan, S., & Chen, X. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110383 · Cited by 11
Drifting explanations in continual learning
Cossu, A., Spinnato, F., Guidotti, R., & Bacciu, D. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127960 · Cited by 11
Prevention of catastrophic interference and imposing active forgetting with generative methods
Sukhov, S. V., Leontev, M., Miheev, A., & Sviatov, K. V. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.024 · Cited by 10
Cross Domain Lifelong Learning Based on Task Similarity
Yang, S., & Cai, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3276991 · Cited by 11
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?
Liu, S., & Ritter, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.459 · Cited by 12
Enabling Continual Learning with Differentiable Hebbian Plasticity
Thangarasa, V., Miconi, T., & Taylor, G. W. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206764 · Cited by 13
Learned approximate query processing : make it light, accurate and fast
Ma, Q., Shanghooshabad, A. M., Almasi, M., Kurmanji, M., & Triantafillou, P. (2021) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33832966 · Cited by 11
Alleviating Representational Shift for Continual Fine-tuning
Jie, S., Deng, Z., & Li, Z. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00426 · Cited by 11
Multi-objective Learning to Overcome Catastrophic Forgetting in Time-series Applications
Mahmoud, R. A., & Hajj, H. M. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3502728 · Cited by 11
Representation Stability as a Regularizer for Improved Text Analytics Transfer LearningPreprint
Riemer, M., Khabiri, E., & Goodwin, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.03617 · Cited by 21
Distillation Techniques for Pseudo-rehearsal Based Incremental LearningPreprint
Shah, H., Javed, K., & Faisal Shafait, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02799 · Cited by 11
Analyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response ModelsPreprint
He, T., Liu, J., Cho, K., Ott, M., Liu, B., Glass, J. R., & Peng, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.07117 · Cited by 19
Scalable Recollections for Continual Lifelong Learning
Riemer, M., Klinger, T., Bouneffouf, D., & Franceschini, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011352 · Cited by 14
Ji, Z., Jiao, Z., Wang, Q., Pang, Y., & Han, J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3347477 · Cited by 10
Lee, A. H., Moore, J. M., Covarrubias, B. V., & Lynch, L. M. (2025) · The Anatomical Record · doi:10.1002/ar.25633 · Cited by 10
Boudreault-Morales, G.-E., Márquez-Chin, C., Liu, X., & Zariffa, J. (2025) · BioMedical Engineering OnLine · doi:10.1186/s12938-025-01347-y · Cited by 10
Insights from the Future for Continual Learning
Douillard, A., Junior, E. A. D. V., Ollion, C., Robert, T., & Cord, M. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00387 · Cited by 12
Incremental learning of object detection with output merging of compact expert detectors
Zhang, N., Sun, Z., Zhang, K., & Xiao, L. (2021) · Intelligent Autonomous Systems · doi:10.1109/icoias53694.2021.00008 · Cited by 10
Self-Distillation Dual-Memory Online Hashing with Hash Centers for Streaming Data Retrieval
Zhang, C.-Y., Luo, X., Zhan, Y.-W., Zhang, P.-F., Chen, Z.-D., Wang, Y., Yang, X., & Xu, X.-S. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612119 · Cited by 10
Instant Continual Learning of Neural Radiance Fields
Po, R., Dong, Z., Bergman, A. W., & Wetzstein, G. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00358 · Cited by 11
DeepVenom: Persistent DNN Backdoors Exploiting Transient Weight Perturbations in Memories
Cai, K., Chowdhuryy, M. H. I., Zhang, Z., & Yao, F. (2024) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp54263.2024.00223 · Cited by 12
Transfer learning techniques for cross-domain analysis of posts in massive educational forums
Capuano, N. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823410-5.00014-0 · Cited by 10
Dream Net: a privacy preserving continual leaming model for face emotion recognition
Mainsant, M., Solinas, M., Reyboz, M., Godin, C., & Mermillod, M. (2021) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw52867.2021.9666338 · Cited by 10
Shultz, T. R., & Rivest, F. (2000) · Cited by 10
Implications of resource limitations for a conscious machine
Coward, L. A., & Gedeon, T. D. (2008) · Neurocomputing · doi:10.1016/j.neucom.2008.06.015 · Cited by 10
Locally Weighted Regression Pseudo-Rehearsal for Online Learning of Vehicle DynamicsPreprint
Williams, G., Goldfain, B., Rehg, J. M., & Theodorou, E. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.05162 · Cited by 10
Prototype Reminding for Continual Learning.Preprint
Zhang, M., Wang, T., Lim, J., & Feng, J. (2019) · arXiv (Cornell University) · Cited by 9
Variational Prototype Replays for Continual LearningPreprint
Zhang, M., Wang, T., Lim, J., Kreiman, G., & Feng, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.09447 · Cited by 23
Continual Learning: Tackling Catastrophic Forgetting in Deep Neural Networks with Replay ProcessesPreprint
Lesort, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.00487 · Cited by 31
Storing Encoded Episodes as Concepts for Continual LearningPreprint
Ayub, A., & Wagner, A. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06637 · Cited by 11
Gradient Episodic Memory with a Soft Constraint for Continual LearningPreprint
Hu, G., Zhang, W., Ding, H., & Zhu, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07801 · Cited by 19
Defense without Forgetting: Continual Adversarial Defense with Anisotropic & Isotropic Pseudo Replay
Zhou, Y., & Hua, Z. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.02290 · Cited by 9
Digital Twin Aided Compressive Sensing: Enabling Sitespecific MIMO Hybrid Precoding
Luo, H., & Alkhateeb, A. (2024) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/ieeeconf60004.2024.10942772 · Cited by 9
Tricomi, G., Cicceri, G., Ficili, I., Vitabile, S., Merlino, G., & Puliafito, A. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107991 · Cited by 9
Continual adaptation of federated reservoirs in pervasive environments
Caro, V. D., Gallicchio, C., & Bacciu, D. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126638 · Cited by 9
Continual Learning for Personalized Co-Speech Gesture Generation
Ahuja, C., Joshi, P., Ishii, R., & Morency, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01910 · Cited by 11
Tangent Model Composition for Ensembling and Continual Fine-tuning
Liu, T. Y., & Soatto, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01712 · Cited by 11
CLR: Channel-wise Lightweight Reprogramming for Continual Learning
Ge, Y., Li, Y., Ni, S., Zhao, J., Yang, M., & Itti, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01723 · Cited by 9
Cross-Subject Lifelong Learning for Continuous Estimation From Surface Electromyographic Signal
Chen, X., Guo, W., Lin, C., Jiang, N., & Su, J. (2024) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2024.3400535 · Cited by 9
IB-DRR - Incremental Learning with Information-Back Discrete Representation Replay
Jian, J., Cetin, E., & Çeliktutan, O. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00392 · Cited by 12
CONDA: Continual Unsupervised Domain Adaptation Learning in Visual Perception for Self-Driving Cars
Truong, T.-D., Helton, P., Moustafa, A. A., Cothren, J. D., & Luu, K. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00573 · Cited by 10
Retroactive interference in neural networks and in humans: The effect of pattern-based learning
Spivey, M. J., & Mirman, D. (2001) · Connection Science · doi:10.1080/09540090110091830 · Cited by 9
Retroactive Transfer Phenomena in Alternating User Interfaces
Raissi, R., Dimara, E., Berry, J. H., Gray, W. D., & Bailly, G. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376538 · Cited by 10
Maintaining stability during new learning in neural networks
Robins, A. V. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1997.633048 · Cited by 9
Self-citationContinual Reinforcement Learning with Multi-Timescale ReplayPreprint
Kaplanis, C., Clopath, C., & Shanahan, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07530 · Cited by 13
Lomonaco, V., Pellegrini, L., Rodríguez, P., Caccia, M., She, Q., Chen, Y., Jodelet, Q., Wang, R., Mai, Z., Vázquez, D., et al. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103635 · Cited by 50
Continual Learning-Based MIMO Channel Estimation: A Benchmarking Study
Akrout, M., Feriani, A., Bellili, F., Mezghani, A., & Hossain, E. (2023) · International Conference on Communications · doi:10.1109/icc45041.2023.10278623 · Cited by 8
Low-rank Prompt Interaction for Continual Vision-Language Retrieval
Yan, W. B., Wang, Y., Wang, L., Guo, Z., Zhao, Z., & Jin, T. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681264 · Cited by 9
Low-redundancy distillation for continual learning
Liu, R., Diao, B., Huang, L., An, Z., Liu, H., An, Z., & Xu, Y. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.111712 · Cited by 9
Continual Learning for Grounded Instruction Generation by Observing Human Following Behavior
Kojima, N., Suhr, A., & Artzi, Y. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00428 · Cited by 13
Incremental class learning using variational autoencoders with similarity learning
Huo, J., & van Zyl, T. L. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08485-1 · Cited by 8
Continuous unsupervised domain adaptation using stabilized representations and experience replay
Rostami, M. G. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128017 · Cited by 8
Return of the normal distribution: Flexible deep continual learning with variational auto-encoders
Hong, Y., Mundt, M., Park, S., Uh, Y., & Byun, H. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.07.016 · Cited by 8
Selective Transfer of Task Knowledge Using Stochastic Noise
Silver, D. L., & McCracken, P. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44886-1_16 · Cited by 8
The Importance of Long-term Memory in Infant Perceptual Categorization
Mermillod, M., French, R. M., Quinn, P. C., & Denis Mareschal, B. (2003) · eScholarship (California Digital Library) · Cited by 8
Sequential changepoint detection in neural networks with checkpoints
Titsias, M. K., Sygnowski, J., & Chen, Y. (2022) · Statistics and Computing · doi:10.1007/s11222-022-10088-0 · Cited by 9
The Evolution of Minimal Catastrophic Forgetting in Neural Systems
Bullinaria, J. A., & Seipone, T. (2005) · eScholarship (California Digital Library) · Cited by 8
Locally Weighted Regression Pseudo-Rehearsal for Adaptive Model Predictive Control
Williams, G., Goldfain, B., Lee, K., Gibson, J., Rehg, J. M., & Theodorou, E. A. (2019) · Conference on Robot Learning · Cited by 8
Pseudo-Rehearsal for Continual Learning with Normalizing FlowsPreprint
Pomponi, J., Scardapane, S., & Uncini, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.02443 · Cited by 8
Continual Learning with Deep Artificial NeuronsPreprint
Camp, B., Mandivarapu, J. K., & Estrada, R. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07035 · Cited by 8
Continual learning in sensor-based human activity recognition with dynamic mixture of experts
Rahman, F., Schiemer, M., Sanabria, A. R., & Ye, J. (2025) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2025.102044 · Cited by 9
A Benchmark and Empirical Analysis for Replay Strategies in Continual Learning
Yang, Q., Feng, F., & Chan, R. H. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17587-9_6 · Cited by 8
Continual learning with invertible generative models
Pomponi, J., Scardapane, S., & Uncini, A. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.05.020 · Cited by 7
Incremental Detection of Hyperspectral Targets in Consistent Scenes With Continuous Learning
Dong, W., Chen, Y., Xiao, S., Qu, J., & Li, Y. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3461868 · Cited by 7
Hong, D.-Y., Li, Y., & Shin, B. (2019) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-019-01346-7 · Cited by 7
Predicting How to Test Requirements: An Automated Approach
Winkler, J., Grönberg, J., & Vogelsang, A. (2019) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2019.00023 · Cited by 7
Exemplar-Supported Representation for Effective Class-Incremental Learning
Guo, L., Xie, G., Xu, X., & Ren, J. (2020) · IEEE Access · doi:10.1109/access.2020.2980386 · Cited by 7
Comparative Analysis of Catastrophic Forgetting in Metric Learning
Huo, J., & van Zyl, T. L. (2020) · International Conference on Soft Computing & Machine Intelligence (ISCMI) · doi:10.1109/iscmi51676.2020.9311580 · Cited by 7
Incremental Learning of Object Detector with Limited Training Data
Hafeez, M. A., Ul-Hasan, A., & Faisal Shafait, B. (2021) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta52665.2021.9647245 · Cited by 7
Shieh, J.-L., Haq, M. A., Haq, Q. M. U., Ruan, S.-J., & Chondro, P. (2022) · Machine Vision and Applications · doi:10.1007/s00138-022-01284-z · Cited by 7
Ohki, T., Kunii, N., & Chao, Z. C. (2023) · Reviews in the Neurosciences · doi:10.1515/revneuro-2022-0137 · Cited by 7
L3DMC: Lifelong Learning Using Distillation via Mixed-Curvature Space
Roy, K., Moghadam, P., & Harandi, M. T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43895-0_12 · Cited by 7
Universal adversarial perturbations for multiple classification tasks with quantum classifiers
Qiu, Y. (2023) · Machine Learning Science and Technology · doi:10.1088/2632-2153/acffa3 · Cited by 11
Uncertainty-aware enhanced dark experience replay for continual learning
Wang, Q., Ji, Z., Pang, Y.-W., & Zhang, Z. (2024) · Applied intelligence (Boston) · doi:10.1007/s10489-024-05488-w · Cited by 10
Consolidation Using Context-Sensitive Multiple Task Learning
Fowler, B., & Silver, D. L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21043-3_16 · Cited by 7
Mitigation of catastrophic interference in neural networks using a fixed expansion layer
Coop, R., & Arel, I. (2012) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2012.6292123 · Cited by 7
Sequential Inductive Transfer for Coronary Artery Disease Diagnosis
Silver, D. L., & Mercer, R. E. (2007) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2007.4371374 · Cited by 7
Schematic memory persistence and transience for efficient and robust continual learning
Gao, Y., Ascoli, G. A., & Zhao, L. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.011 · Cited by 7
Fujii, W., Suzuki, K., Ando, T., Tateishi, A., Hiroki, M. O. R. I., & Ogata, T. (2022) · IEEE/SICE International Symposium on System Integration (SII) · doi:10.1109/sii52469.2022.9708612 · Cited by 7
Preempting Catastrophic Forgetting in Continual Learning Models by Anticipatory Regularization
Khatib, A. E., & Karray, F. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852426 · Cited by 7
Never Forget: Balancing Exploration and Exploitation via Learning Optical FlowPreprint
Yang, H.-K., Chiang, P.-H., Ho, K.-W., Hong, M.-F., & Lee, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.08486 · Cited by 11
On Catastrophic Interference in Atari 2600 GamesPreprint
Fedus, W., Ghosh, D., Martin, J. D., Bellemare, M. G., Bengio, Y., & Larochelle, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12499 · Cited by 20
A general approach to progressive learningPreprint
Vogelstein, J. T., Helm, H. S., Mehta, R., Dey, J. K., Yang, W., Tower, B., LeVine, W., Larson, J., White, C., & Priebe, C. E. (2020) · arXiv (Cornell University) · Cited by 7
Automatic Recall Machines: Internal Replay, Continual Learning and the BrainPreprint
Ji, X., Henriques, J. F., Tuytelaars, T., & Vedaldi, A. (2020) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.48550/arxiv.2006.12323 · Cited by 14
Metadata
- Authors
- ROBINS, A.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- ROBINS, ANTHONY
- ORCID
- ROBINS, ANTHONY
- Venue
- Connection Science
- Publisher
- Informa UK Limited
- Published
- 1995-06
- Volume
- 7
- Issue
- 2
- Pages
- 123-146
- ISSN
- 0954-0091 (ISSN-L)
- 1360-0494
- OpenAlex
- W2116522068
- Cited by
- 833
- References
- 18
- Citations by year
- 2026: 52 · 2025: 79 · 2024: 92 · 2023: 109 · 2022: 94 · 2021: 100 · 2020: 77 · 2019: 68 · 2018: 23 · 2017: 15 · 2016: 4 · 2015: 6 · 2014: 3 · 2013: 8 · 2012: 1
- FWCI
- 6.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Connection Science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- catastrophic forgetting, rehearsal, neural network learning, function approximation, incremental learning, knowledge retention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review