Cited by 833Domain Adaptation and Few-Shot LearningMemory Processes and InfluencesNeural Networks and Applications

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Catastrophic Forgetting, Rehearsal and Pseudorehearsal

ROBINS, ANTHONY·1995·Connection Science

Open this paper in CoChat — free account

Abstract

This paper reviews the problem of catastrophic forgetting (the loss or disruption of previously learned information when new information is learned) in neural networks, and explores rehearsal mechanisms (the retraining of some of the previously learned information as the new information is added) as a potential solution. We replicate some of the experiments described by Ratcliff (1990), including those relating to a simple 'recency' based rehearsal regime. We then develop further rehearsal regimes which are more effective than recency rehearsal. In particular, 'sweep rehearsal' is very successful at minimizing catastrophic forgetting. One possible limitation of rehearsal in general, however, is that previously learned information may not be available for retraining. We describe a solution to this problem, 'pseudorehearsal', a method which provides the advantages of rehearsal without actually requiring any access to the previously learned information (the original training population) itself. We then suggest an interpretation of these rehearsal mechanisms in the context of a function approximation based account of neural network learning. Both rehearsal and pseudorehearsal may have practical applications, allowing new information to be integrated into an existing network with minimum disruption of old information.

Integrity signals

Registry

Crossref · 10.1080/09540099550039318

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Introduction to the theory of neural computation
Hertz, J., Krogh, A., & Palmer, R. G. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,410
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Competitive learning: From interactive activation to adaptive resonance
Grossberg, S. (1987) · Cognitive Science · doi:10.1111/j.1551-6708.1987.tb00862.x · Cited by 1,471
The ART of adaptive pattern recognition by a self-organizing neural network
Carpenter, G. A., & Grossberg, S. (1988) · Computer · doi:10.1109/2.33 · Cited by 1,278
Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions.
Ratcliff, R. (1990) · Psychological Review · doi:10.1037/0033-295x.97.2.285 · Cited by 939
Artificial Neural Networks: Approximation and Learning Theory
White, H. (1992) · Medical Entomology and Zoology · Cited by 441
Networks of Formal Neurons and Memory Palimpsests
Nadal, J., Toulouse, G., Changeux, J., & Dehaene, S. (1986) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/1/10/008 · Cited by 215
From Statistics to Neural Networks: Theory and Pattern Recognition Applications
Cherkassky, V., Friedman, J. H., & Wechsler, H. L. (1996) · CERN Document Server (European Organization for Nuclear Research) · Cited by 177
Prediction Risk and Architecture Selection for Neural Networks
Moody, J. E. (1994) · Springer eBooks · doi:10.1007/978-3-642-79119-2_7 · Cited by 158

Show all 18 references

Sorted by citations

Items 501–600 of 830

Rethinking Experience Replay: a Bag of Tricks for Continual LearningPreprint
Buzzega, P., Boschini, M., Porrello, A., & Calderara, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05595 · Cited by 9
A Procedural World Generation Framework for Systematic Evaluation of Continual LearningPreprint
Hess, T., Mundt, M., Pliushch, I., & Ramesh, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.02585 · Cited by 6
Continual Competitive Memory: A Neural System for Online Task-Free Lifelong LearningPreprint
Ororbia, A. G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13300 · Cited by 4
Efficient Online Bayesian Inference for Neural BanditsPreprint
Duràn-Martín, G., Kara, A., & Murphy, K. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2112.00195 · Cited by 7
Teleportation Links: Mitigating Catastrophic Forgetting in Decentralized Federated Learning
Wang, X., Chen, Y., Ye, Q. J., & Dobre, O. A. (2025) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2025.3611109 · Cited by 3
Online improving NOX concentration prediction at SCR system outlet through continual learning
Chen, P., Xu, B., Wei, H., & Hu, H. (2025) · Journal of the Taiwan Institute of Chemical Engineers · doi:10.1016/j.jtice.2025.106417 · Cited by 3
Remember Past, Anticipate Future: Learning Continual Multimodal Misinformation Detectors
Wang, B., Li, X., Ye, M., Chang-chun, L., Fu, B., Qu, J., & Wu, L. Y. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3754759 · Cited by 3
A practical guide to streaming continual learning
Cossu, A., Giannini, F., Ziffer, G., Bernardo, A., Gepperth, A., Valle, E. D., Hammer, B., & Bacciu, D. (2026) · Neurocomputing · doi:10.1016/j.neucom.2026.132951 · Cited by 3
Class incremental learning via dynamic regeneration with task-adaptive distillation
Yang, H., He, W., Shan, Z., Fang, X., & Chen, X. (2023) · Computer Communications · doi:10.1016/j.comcom.2023.12.030 · Cited by 3
Hebbian Descent: A Unified View on Log-Likelihood Learning
Melchior, J., Schiewer, R., & Wiskott, L. (2024) · Neural Computation · doi:10.1162/neco_a_01684 · Cited by 4
FedRewind: Rewinding Continual Model Exchange for Decentralized Federated Learning
Palazzo, L., Pennisi, M., Salanitri, F. P., Bellitto, G., Palazzo, S., & Spampinato, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78389-0_6 · Cited by 6
Incremental learning of code authors over time
Gong, S., & Zhong, H. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112527 · Cited by 4
Overcoming classic challenges for artificial neural networks by providing incentives and practice
Irie, K., & Lake, B. M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01121-8 · Cited by 10
Modular-Relatedness for Continual Learning
Shaker, A., Alesiani, F., & Yu, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-01333-1_23 · Cited by 3
Dynamic Lyapunov Machine Learning Control of Nonlinear Magnetic Levitation System
Mahmoud, A. S., & Zohdy, M. A. (2022) · Energies · doi:10.3390/en15051866 · Cited by 3
Avalanche RL: A Continual Reinforcement Learning Library
Lucchesi, N., Carta, A., Lomonaco, V., & Bacciu, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-06427-2_44 · Cited by 7
Class-Wise Buffer Management for Incremental Object Detection: An Effective Buffer Training Strategy
Kim, J., Hong, S., Kim, C., Kim, J., Tiruneh, Y. Y., On, J., Song, J., Choi, S., & Baek, S. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10446428 · Cited by 3
Any-Way Meta Learning
Lee, J., Kim, Y., Lee, H., & Kwak, N. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i12.29242 · Cited by 3
Repairing Learning-Enabled Controllers While Preserving What Works
Lu, P., Cleaveland, M., Sokolsky, O. V., Lee, I., & Ruchkin, I. (2024) · ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1109/iccps61052.2024.00007 · Cited by 3
Efficient distributed continual learning for steering experiments in real-time
Bouvier, T., Nicolae, B., Costan, A., Biçer, T., Foster, I. T., & Antoniu, G. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.07.016 · Cited by 5
Embracing Massive Medical Data
Chou, Y.-C., Zhou, Z., & Yuille, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72378-0_3 · Cited by 4
Distribution-Aware Replay for Continual MRI Segmentation
Lemke, N., González, C., Mukhopadhyay, A., & Mundt, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73483-0_7 · Cited by 3
A New Regularization-Based Continual Learning Framework
Hassan, S., Rasheed, N., & Qureshi, M. A. (2024) · Horizons of Information Technology and Engineering (HITE) · doi:10.1109/hite63532.2024.10777234 · Cited by 3
Incremental Machine Learning-Integrated Blockchain for Real-Time Security Protection in Cyber-Enabled Manufacturing Systems
Oskolkov, B., Chen, K., Tian, W., Law, A. C. C., & Liu, C. (2025) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4067736 · Cited by 4
Zero-shot incremental learning using spatial-frequency feature representations
Ren, J., Zhao, Y., Zhang, W., & Sun, C. (2025) · Scientific Reports · doi:10.1038/s41598-024-83649-0 · Cited by 3
Memory-efficient Continual Learning with Neural Collapse Contrastive
Dang, T.-A., Nguyen, V., Vu, N., & Vrain, C. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00772 · Cited by 3
Mitigating Forgetting in Adapting Pre-trained Language Models to Text Processing Tasks via Consistency Alignment
Gao, J., Hao, W. U., Cheung, Y., Cao, J., Yu, H., & Zhang, Y. (2025) · International World Wide Web Conference (WWW) · doi:10.1145/3696410.3714687 · Cited by 3
Pseudorehearsal in Value Function Approximation
Marochko, V., Johard, L., & Mazzara, M. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-59394-4_18 · Cited by 3
Pseudorehearsal in Actor-Critic Agents with Neural Network Function Approximation
Marochko, V., Johard, L., Mazzara, M., & Longo, L. (2018) · International Conference on Advanced Information Networking and Applications (AINA) · doi:10.1109/aina.2018.00099 · Cited by 3
Deep online classification using pseudo-generative models
Besedin, A., Blanchart, P., Crucianu, M., & Ferecatu, M. (2020) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2020.103048 · Cited by 3
Enhanced Stochastic Gradient Descent with Backward Queried Data for Online Learning
Huh, G. (2020) · IEEE International Conference on Machine Learning and Applied Network Technologies (ICMLANT) · doi:10.1109/icmlant50963.2020.9355978 · Cited by 3
The Consolidation of Neural Network Task Knowledge.
Silver, D., & McCracken, P. (2003) · International Conference on Machine Learning and Applications · Cited by 3
A neural network model of causative actions
Lee-Hand, J., & Knott, A. (2015) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2015.00004 · Cited by 3
Reduction of catastrophic forgetting in multilayer neural networks trained by contrastive Hebbian Learning with pseudorehearsal
Nakano, S., & Hattori, M. (2017) · IEEE International Workshop on Computational Intelligence and Applications (IWCIA) · doi:10.1109/iwcia.2017.8203567 · Cited by 3
Advances in Adaptive Skill Acquisition
Holas, J., & Farkaš, I. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86380-7_53 · Cited by 3
Generative Pseudorehearsal Strategy for Fault Classification Under an Incremental Learning
Lee, S., & Baek, J. (2019) · IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC) · doi:10.1109/cse/euc.2019.00035 · Cited by 3
Memory model with unsupervised sequential learning
Anatoli Gorchetchnikov, A. (1999) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/306363.306385 · Cited by 3
Self-Refreshing SOM as a Semantic Memory Model
Pöllä, M., Lindh‐Knuutila, T., & Honkela, T. (2005) · Cited by 3
Continual Learning Using World Models for Pseudo-RehearsalPreprint
Ketz, N., Kolouri, S., & Pilly, P. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02647 · Cited by 12
Bayesian Structure Adaptation for Continual LearningPreprint
Kumar, A., Chatterjee, S., & Rai, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.03624 · Cited by 3
Omnidirectional Transfer for Quasilinear Lifelong LearningPreprint
Dey, J. K., Vogelstein, J. T., Helm, H. S., LeVine, W., Mehta, R., Geisa, A., van de Ven, G. M., Chang, E., Gao, C., Yang, W., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-831408/v1 · Cited by 3
Entropic Alternatives to InitializationPreprint
Musso, D. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4057054 · Cited by 3
Generative Continual Concept Learning
Rostami, M. G., Kolouri, S., Pilly, P. K., & McClelland, J. L. (2020) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v34i04.6006 · Cited by 38
MemoryGAN: GAN Generator as Heterogeneous Memory for Compositional Image Synthesis
Wang, Z., Peng, J., & Liu, Z. (2023) · Electronics · doi:10.3390/electronics12132927 · Cited by 2
Potential Knowledge Extraction Network for Class-Incremental Learning
Xi, X., Cao, G., Cao, W., Liu, Y., Li, Y., Wang, H., & Ren, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128923 · Cited by 2
Practical incremental learning: Striving for better performance-efficiency trade-off
Xu, S., Ni, B., Nie, X., Zhu, F., Li, Y., Chang, J., & Meng, G. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129831 · Cited by 2
Compress to One Point: Neural Collapse for Pre-Trained Model-Based Class-Incremental Learning
Wei, K., Xu, Z., & Deng, C. D. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i20.35448 · Cited by 2
Revisiting Clustering of Neural Bandits: Selective Reinitialization for Mitigating Loss of Plasticity
Su, Z., Dai, S.-H., & Zhang, X. (2025) · Knowledge Discovery and Data Mining · doi:10.1145/3711896.3737105 · Cited by 4
Slowly expanding neural network for class incremental learning
Xu, Z., Li, X., Chang, X., Zheng, W., & Wang, R. (2025) · Pattern Recognition · doi:10.1016/j.patcog.2025.112213 · Cited by 2
Suppressing catastrophic forgetting in deep-learning-based imaging through scattering media
Shingu, D., Kamiya, Y., & Watanabe, W. (2025) · Applied Optics · doi:10.1364/ao.581845 · Cited by 2
Continuous Lyapunov Controlled Non-linear System Optimization Using Deep Learning with Memory
Mahmoud, A. S., Ismaeil, Y., & Zohdy, M. A. (2020) · International Journal of Control Science and Engineering · doi:10.5923/j.control.20201002.01 · Cited by 2
MICROBE-OPOLY: exploring the microbial world through associations
Soule, T. T. (2022) · FEMS Microbiology Letters · doi:10.1093/femsle/fnac030 · Cited by 2
Metric Learning with Distillation for Overcoming Catastrophic Forgetting
Yu, P., He, J., Min, Q., & Zhu, Q. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-1253-5_17 · Cited by 2
Task-aware network: Mitigation of task-aware and task-free performance gap in online continual learning
Hong, Y., Park, S., & Byun, H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126527 · Cited by 3
CLOCK: Online Temporal Hierarchical Framework for Multi-scale Multi-granularity Forecasting of User Impression
Wang, X., Guo, Y., Ma, X., Huang, D., Xu, L., Tan, H., Zhou, H., & Li, X. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614810 · Cited by 2
Hybrid approach combining deep learning and a rule based expert system for concept extraction from prescriptions
Mishra, R. K., Roy, S., Palla, S. K., Patel, N., Patel, M., & Jos, S. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10339977 · Cited by 2
Demystifying the QoS and QoE of Edge-hosted Video Streaming Applications in the Wild with SNESet
Li, Y., Deng, G., Bai, C., Yang, J., Wang, G., Zhang, H. H., Bai, J., Yuan, H., Xu, M., & Wang, S. (2023) · Proceedings of the ACM on Management of Data · doi:10.1145/3626723 · Cited by 2
Robust Meta-Learning of Vehicle Yaw Rate Dynamics via Conditional Neural Processes
Ullrich, L., Völz, A., & Graichen, K. (2023) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc49753.2023.10384159 · Cited by 2
Similarity-Based Adaptation for Task-Aware and Task-Free Continual Learning
Adel, T. (2024) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.15693 · Cited by 3
Optimal Knowledge Distillation through Non-Heuristic Control of Dark Knowledge
Onchiş, D. M., Istin, C., & Samuila, I.-V. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6030094 · Cited by 2
Adaptive Robust Continual Learning based on Bayesian Uncertainty Propagation
Kandel, D., & Dera, D. (2024) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion59988.2024.10706277 · Cited by 2
CroMo-Mixup: Augmenting Cross-Model Representations for Continual Self-Supervised Learning
Mushtaq, E., Yaldiz, D. N., Bakman, Y. F., Ding, J., Tao, C., Dimitriadis, D., & Avestimehr, A. S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72989-8_18 · Cited by 2
HMR-Adapter: A Lightweight Adapter with Dual-Path Cross Augmentation for Expressive Human Mesh Recovery
Shen, W., Yin, W., Wang, H., Wei, C., Cai, Z., Yang, L., & Lin, G. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681641 · Cited by 2
Incremental Learning in Generative Adversarial Networks(GANs) using Pseudo Replay to overcome Catastrophic Forgetting
Kumar, A., & Agarwal, S. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10725872 · Cited by 2
An interactive AI-driven platform for fish age reading
Cayetano, A., Stransky, C., Birk, A., & Brey, T. (2024) · PLoS ONE · doi:10.1371/journal.pone.0313934 · Cited by 2
Behavioral decision-making of mobile robots simulating the memory consolidation mechanism of human brain
Wang, H. (2024) · Adaptive Behavior · doi:10.1177/10597123241302508 · Cited by 2
Adaptively forget with crossmodal and textual distillation for class-incremental video captioning
Xiong, H., Wang, L., Qiu, H., Zhao, T., Qiu, B., & Li, H. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129388 · Cited by 2
Computational models suggest that human memory judgments exhibit interference due to the use of overlapping representations.
Huffman, D. J., & Guan, R. (2025) · Psychological Review · doi:10.1037/rev0000517 · Cited by 2
HiProIBM: unsupervised continual learning through hierarchical prototypical cross-level discrimination along with information bottleneck subnetwork masking
Malviya, A., & Maurya, C. K. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06362-z · Cited by 2
An Experimental Study on Dynamic Lifelong Learning With GPT for Mitigating Catastrophic Forgetting in Aspect-Based Sentiment Analysis
Huang, H., Mustafa, M. B., & Asemi, A. (2025) · IEEE Access · doi:10.1109/access.2025.3547359 · Cited by 2
Unveiling the Tapestry: The Interplay of Generalization and Forgetting in Continual Learning
Shi, Z., Jing, J., Sun, Y., Lim, J., & Zhang, M. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3546269 · Cited by 5
Plastic and Stable Gated Classifiers for Continual Learning
Kuo, N. I.-H., Harandi, M. T., Fourrier, N., Walder, C., Ferraro, G., & Suominen, H. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00394 · Cited by 2
Comparison of Consolidation Methods for Predictive Learning of Time Series
Nakajo, R., & Ogata, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-79457-6_10 · Cited by 2
Modelling supra-classical logic in a Boltzmann neural network: I representation
Blanchette, G., Robins, A. V., & Labuschagne, W. A. (2021) · Journal of Logic and Computation · doi:10.1093/logcom/exab054 · Cited by 2
Self-citation
Artificial neural networks whispering to the brain: nonlinear system attractors induce familiarity with never seen items
Musca, S. C., Rousset, S., & Ans, B. (2009) · Connection Science · doi:10.1080/09540090903067493 · Cited by 2
A Cognitive Model for Generalization during Sequential Learning
Gupta, A., Vig, L., & Noelle, D. C. (2011) · Journal of Robotics · doi:10.1155/2011/617613 · Cited by 2
Match memory recurrent networks
Samothrakis, S., Vodopivec, T., Fasli, M., & Fairbank, M. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727353 · Cited by 2
Complementary Layered Learning
Mondesire, S. C. (2014) · Journal of International Crisis and Risk Communication Research · Cited by 2
In situ compression artifact removal in scientific data using deep transfer learning and experience replay
Madireddy, S., Park, J. H., Lee, S., Balaprakash, P., Yoo, S., Liao, W., Hauck, C. D., Laiu, M. P., & Archibald, R. K. (2020) · Machine Learning Science and Technology · doi:10.1088/2632-2153/abc326 · Cited by 2
Neurocomputational Mechanisms for Generalization During the Sequential Learning of Multiple Tasks.
Gupta, A., & Noelle, D. C. (2005) · Cited by 2
Continual Learning in Vision Transformer
Takeda, M., & Yanai‬, ‪. (2022) · Proceedings - International Conference on Image Processing · doi:10.1109/icip46576.2022.9897851 · Cited by 2
When Deep is not Enough: Towards Understanding Shallow and Continual Learning Models in Realistic Environmental Sound Classification for Robots
Eldardeer, O., Rea, F., Sandini, G., & Jirak, D. (2023) · International Journal of Humanoid Robotics · doi:10.1142/s0219843623500081 · Cited by 2
Prototype Representation Expansion in Incremental Learning
Mao, K., Luo, Y., Ren, Y., & Wang, R. (2023) · Neural Processing Letters · doi:10.1007/s11063-023-11317-x · Cited by 2
Stochastic Gradient Descent and Anomaly of Variance-Flatness Relation in Artificial Neural Networks
Xia, X., Chen, Y.-C., Shi, C., & Ao, P. (2023) · Chinese Physics Letters · doi:10.1088/0256-307x/40/8/080202 · Cited by 4
Class Incremental Learning with Important and Diverse Memory
Mei, L., Yan, Z., & Li, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46314-3_13 · Cited by 2
FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image Classification
Weißflog, M., Protzel, P., & Neubert, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48232-8_38 · Cited by 2
Optimizing Named Entity Recognition for Improving Logical Formulae Abstraction from Technical Requirements Documents
Perko, A., Zhao, H., & Wotawa, F. (2023) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa59317.2023.00034 · Cited by 2
Flashback for Continual Learning
Mahmoodi, L., Harandi, M. T., & Moghadam, P. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00368 · Cited by 2
Differential retroactive interference in humans following exposure to structured or unstructured learning material: a single distributed neural network account
Musca, S. C., Rousset, S., & Ans, B. (2004) · Connection Science · doi:10.1080/09540090412331285536 · Cited by 2
Sleep and Plasticity
Sousouri, G., & Huber, R. (2019) · Handbook of behavioral neuroscience · doi:10.1016/b978-0-12-813743-7.00028-1 · Cited by 3
Polarity Classification of Social Media Feeds Using Incremental Learning — A Deep Learning Approach
Jaganathan, S., & Madhusudhanan, S. (2021) · IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · doi:10.1587/transfun.2021eap1046 · Cited by 2
Continual Learning Using Multi-view Task Conditional Neural NetworksPreprint
Li, H., Barnaghi, P. M., Enshaeifar, S., & Ganz, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.05080 · Cited by 2
Lifelong Learning of Few-shot Learners across NLP Tasks.Preprint
Jin, X., Rostami, M. G., & Ren, X. (2021) · arXiv (Cornell University) · Cited by 3
Lifelong Learning of Graph Neural Networks for Open-World Node Classification
Galke, L. P. A., Franke, B., Zielke, T., & Scherp, A. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3764769 · Cited by 3
Accretionary Learning with Deep Neural NetworksPreprint
Wei, X., Juang, B.-H. F., Wang, O., Zhou, S., & Li, G. Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.10857 · Cited by 2
Machine learning force field ranking of candidate solid electrolyte interphase structures in Li-ion batteriesPreprint
Stevenson, J., Agarwal, G., & Jacobson, L. D. (2023) · ChemRxiv · doi:10.26434/chemrxiv-2023-gwnl8 · Cited by 2
Adaptive Self-Evolving Neural Networks a Meta-Learning Approach for Continual Lifelong Learning in Dynamic EnvironmentsPreprint
Joshi, K. K., & Kokulavani, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5142382 · Cited by 2
Dual Network Based Complementary Learning System for Continual Learning
Kumari, G. L. A., & Song, I. (2021) · IEEE/CIC International Conference on Communications in China (ICCC) · doi:10.1109/icccworkshops52231.2021.9538861 · Cited by 1
Universal Sound Separation Using Replay-based Data Sampling in Incremental Learning
Shimonishi, K., Fukumori, T., & Yamashita, Y. (2023) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipaasc58517.2023.10317582 · Cited by 1
Lifelong learning with selective attention over seen classes and memorized instances
Wang, Z., & Wang, H. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09542-z · Cited by 1

Authors: ROBINS, A.
Affiliations: University of Otago (NZ)
Corresponding author: ROBINS, ANTHONY
ORCID: ROBINS, ANTHONY
Venue: Connection Science
Publisher: Informa UK Limited
Published: 1995-06
Volume: 7
Issue: 2
Pages: 123-146
ISSN: 0954-0091 (ISSN-L)
1360-0494
DOI: 10.1080/09540099550039318
OpenAlex: W2116522068
Cited by: 833
References: 18
Citations by year: 2026: 52 · 2025: 79 · 2024: 92 · 2023: 109 · 2022: 94 · 2021: 100 · 2020: 77 · 2019: 68 · 2018: 23 · 2017: 15 · 2016: 4 · 2015: 6 · 2014: 3 · 2013: 8 · 2012: 1
FWCI: 6.68
Type: journal article
Language: en
Open access: closed
Locations: Connection Science (publishedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
Keywords: catastrophic forgetting, rehearsal, neural network learning, function approximation, incremental learning, knowledge retention

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Catastrophic Forgetting, Rehearsal and Pseudorehearsal

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks