The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Catastrophic Forgetting, Rehearsal and Pseudorehearsal
Abstract
This paper reviews the problem of catastrophic forgetting (the loss or disruption of previously learned information when new information is learned) in neural networks, and explores rehearsal mechanisms (the retraining of some of the previously learned information as the new information is added) as a potential solution. We replicate some of the experiments described by Ratcliff (1990), including those relating to a simple 'recency' based rehearsal regime. We then develop further rehearsal regimes which are more effective than recency rehearsal. In particular, 'sweep rehearsal' is very successful at minimizing catastrophic forgetting. One possible limitation of rehearsal in general, however, is that previously learned information may not be available for retraining. We describe a solution to this problem, 'pseudorehearsal', a method which provides the advantages of rehearsal without actually requiring any access to the previously learned information (the original training population) itself. We then suggest an interpretation of these rehearsal mechanisms in the context of a function approximation based account of neural network learning. Both rehearsal and pseudorehearsal may have practical applications, allowing new information to be integrated into an existing network with minimum disruption of old information.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Inspired by replay strategies in continual learning (Robins, 1995; Rolnick et al., 2019; De Lange et al., 2021) as well as by the replay phenomena observed in humans (Smolen et al., 2016) and in neural network models (Amiri et al., 2017), we explore whether simple continual learning strategies remain effective for LLMs.”
From Evaluating the Long-Term Memory of Large Language Models (2025) · cites this paper as Robins, 1995
In the citing paper
“While replaying data from pre-training or previous training stages can alleviate forgetting (Lin, 1992; Robins, 1995; Chen et al., 2025), this strategy is data-inefficient and not scalable as we grow the amount of experience.”
From Continual Learning via Sparse Memory Finetuning (2025) · cites this paper as Robins, 1995
In the citing paper
“Before the era of deep learning, Robins [86,87] stated that catastrophic forgetting could be mitigated through rehearsal or pseudo-rehearsal.”
From An Appraisal of Incremental Learning Methods (2020) · cites this paper as [87]
Citations
Cites
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,501
Introduction to the theory of neural computation
Hertz, J., Krogh, A., & Palmer, R. G. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,410
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Competitive learning: From interactive activation to adaptive resonance
Grossberg, S. (1987) · Cognitive Science · doi:10.1111/j.1551-6708.1987.tb00862.x · Cited by 1,471
The ART of adaptive pattern recognition by a self-organizing neural network
Carpenter, G. A., & Grossberg, S. (1988) · Computer · doi:10.1109/2.33 · Cited by 1,278
Ratcliff, R. (1990) · Psychological Review · doi:10.1037/0033-295x.97.2.285 · Cited by 939
Artificial Neural Networks: Approximation and Learning Theory
White, H. (1992) · Medical Entomology and Zoology · Cited by 441
Networks of Formal Neurons and Memory Palimpsests
Nadal, J., Toulouse, G., Changeux, J., & Dehaene, S. (1986) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/1/10/008 · Cited by 215
From Statistics to Neural Networks: Theory and Pattern Recognition Applications
Cherkassky, V., Friedman, J. H., & Wechsler, H. L. (1996) · CERN Document Server (European Organization for Nuclear Research) · Cited by 177
Prediction Risk and Architecture Selection for Neural Networks
Moody, J. E. (1994) · Springer eBooks · doi:10.1007/978-3-642-79119-2_7 · Cited by 158
Cited by
Sorted by citations
Items 201–300 of 830
ADINet: Attribute Driven Incremental Network for Retinal Image Classification
Meng, Q., & Satoh, S. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00409 · Cited by 25
Online continual learning with no task boundaries.Preprint
Aljundi, R., Lin, M., Goujaud, B., & Bengio, Y. (2019) · arXiv (Cornell University) · Cited by 25
Knowledge Capture and Replay for Continual Learning
Gopalakrishnan, S., Singh, P. R., Fayek, H. M., Ramasamy, S., & Ambikapathi, A. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00041 · Cited by 26
Saliency Guided Experience Packing for Replay in Continual Learning
Saha, G., & Roy, K. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00524 · Cited by 24
Multi-Head Distillation for Continual Unsupervised Domain Adaptation in Semantic Segmentation
Saporta, A., Douillard, A., Vu, T.-H., Pérez, P., & Cord, M. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00419 · Cited by 26
Catastrophic interference in connectionist networks
French, R. M. (2003) · Cited by 24
A rapid and efficient learning rule for biological neural circuitsPreprint
Sezener, E., Grabska‐Barwińska, A., Kostadinov, D., Beau, M., Krishnagopal, S., Budden, D., Hütter, M., Veness, J., Botvinick, M., Clopath, C., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.03.10.434756 · Cited by 24
Slesinski, J., & Wierzbicki, D. (2025) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2025.3589804 · Cited by 28
Continual Residual Reservoir Computing for Remaining Useful Life Prediction
Wang, T., Liu, H., Guo, D., & Sun, X. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3271661 · Cited by 25
Assessment of catastrophic forgetting in continual credit card fraud detection
Lebichot, B., Siblini, W., Paldino, G. M., Borgne, Y. L., Oblé, F., & Bontempi, G. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123445 · Cited by 26
Relational Experience Replay: Continual Learning by Adaptively Tuning Task-Wise Relationship
Wang, Q., Wang, R., Li, Y., Wei, D., Wang, H., Ma, K., Zheng, Y., & Meng, D. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2024.3397048 · Cited by 29
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation
Vu, T., Barua, A., Lester, B., Cer, D. M., Iyyer, M., & Constant, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.630 · Cited by 37
Yang, Z., Li, R., Ling, E., Zhang, C., Wang, Y., Huang, D., Ma, K. T., Hur, M., & Lin, G. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01705 · Cited by 23
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansionPreprint
Douillard, A., Ramé, A., Couairon, G., & Cord, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.11326 · Cited by 22
FedViT: Federated continual learning of vision transformer at edge
Zuo, X., Luopan, Y., Han, R., Zhang, Q., Liu, C. H., Wang, G., & Chen, L. Y. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.11.038 · Cited by 22
A novel composite model approach to improve software quality prediction
Bouktif, S., Ahmed, F., Khalil, I. M., & Antoniol, G. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.07.003 · Cited by 21
Continual Adaptation for Efficient Machine Communication
Hawkins, R., Kwon, M., Sadigh, D., & Goodman, N. D. (2020) · Conference on Computational Natural Language Learning · doi:10.18653/v1/2020.conll-1.33 · Cited by 21
Learning to Continuously Optimize Wireless Resource in Episodically Dynamic Environment
Sun, H., Pu, W., Zhu, M., Fu, X., Chang, T.-H., & Hong, M. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413503 · Cited by 21
Continual Pedestrian Trajectory Learning With Social Generative Replay
Wu, Y., Bighashdel, A., Chen, G., Dubbelman, G., & Jancura, P. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3231833 · Cited by 21
Lifelong learning on evolving graphs under the constraints of imbalanced classes and new classes
Galke, L. P. A., Vagliano, I., Franke, B., Zielke, T., Hoffmann, M., & Scherp, A. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.04.022 · Cited by 23
Continual Named Entity Recognition without Catastrophic Forgetting
Zhang, D., Wei, C., Dong, J., Yu, Y., Chen, X., Zhang, Y., & Fang, Z. Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.509 · Cited by 26
CBA: Improving Online Continual Learning via Continual Bias Adaptor
Wang, Q., Wang, R., Wu, Y., Jia, X., & Meng, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01749 · Cited by 24
Kim, J., Ku, Y., Kim, J., Cha, J., & Baek, S. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00420 · Cited by 22
Catastrophic forgetting in simple networks: an analysis of the pseudorehearsal solution
Frean, M. R., & Robins, A. V. (1999) · Network Computation in Neural Systems · doi:10.1088/0954-898x/10/3/302 · Cited by 21
Self-citationGeneralisation Guarantees for Continual Learning with Orthogonal Gradient DescentPreprint
Bennani, M., Doan, T., & Sugiyama, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.11942 · Cited by 76
Self-Improving Generative Artificial Neural Network for Pseudorehearsal Incremental Class Learning
Mellado, D., Saavedra, C., Chabert, S., Torres, R., & Rodrigo Salas, F. (2019) · Algorithms · doi:10.3390/a12100206 · Cited by 20
LIRA: Lifelong Image Restoration from Unknown Blended Distortions
Liu, J., Lin, J., Li, X., Zhou, W., Liu, S., & Chen, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58523-5_36 · Cited by 20
Coordinating Experience Replay: A Harmonious Experience Retention approach for Continual Learning
Ji, Z., Liu, J., Wang, Q., & Zhang, Z. M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107589 · Cited by 21
Continual learning with attentive recurrent neural networks for temporal data classification
Yin, S.-Y., Huang, Y., Chang, T.-Y., Chang, S.-F., & Tseng, V. S. M. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.10.031 · Cited by 20
Automating Code-Related Tasks Through Transformers: The Impact of Pre-training
Tufano, R., Pascarella, L., & Bavota, G. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00203 · Cited by 20
Self-Supervised Learning for Infant Cry Analysis
Gorin, A., Subakan, C., Abdoli, S., Wang, J., Latremouille, S., & Onu, C. C. (2023) · IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw59220.2023.10193421 · Cited by 20
Continual Nuclei Segmentation via Prototype-Wise Relation Distillation and Contrastive Learning
Wu, H., Wang, Z., Zhao, Z., Chen, C., & Qin, J. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3307892 · Cited by 20
Task Relation Distillation and Prototypical Pseudo Label for Incremental Named Entity Recognition
Zhang, D., Li, H., Cong, W. W., Xu, R., Dong, J., & Chen, X. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615075 · Cited by 20
Digital Twin Aided Massive MIMO: CSI Compression and Feedback
Jiang, S., & Alkhateeb, A. (2024) · International Conference on Communications · doi:10.1109/icc51166.2024.10622316 · Cited by 20
Swappers: introns promote flexibility, diversity and invention
Levenick, J. (1999) · Genetic and Evolutionary Computation Conference (GECCO) · Cited by 20
Fine-Grained Continual Learning
Lomonaco, V., Maltoni, D., & Pellegrini, L. (2019) · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) · Cited by 20
Wang, C., Wu, Y., Vuong, Q., & Ross, K. W. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02208 · Cited by 23
Alawwad, H. A., Alhothali, A., Naseem, U., Alkhathlan, A., & Jamal, A. T. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4761601 · Cited by 20
FedER: Federated Learning through Experience Replay and privacy-preserving data synthesis
Pennisi, M., Salanitri, F. P., Bellitto, G., Casella, B., Aldinucci, M., Palazzo, S., & Spampinato, C. (2023) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2023.103882 · Cited by 25
Vast Amounts of Encoded Items Nullify but Do Not Reverse the Effect of Sleep on Declarative Memory
Kolibius, L. D., Jan Born, A., & Feld, G. B. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.607070 · Cited by 23
Continual learning in cross-modal retrieval
Wang, K., Herranz, L., & van de Weijer, J. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00402 · Cited by 19
Decomposing Logits Distillation for Incremental Named Entity Recognition
Zhang, D., Yu, Y., Chen, F., & Chen, X. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591970 · Cited by 19
Improving Replay Sample Selection and Storage for Less Forgetting in Continual Learning
Brignac, D., Lobo, N. D. V., & Mahalanobis, A. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00380 · Cited by 19
A biologically inspired dual-network memory model for reduction of catastrophic forgetting
Hattori, M. (2014) · Neurocomputing · doi:10.1016/j.neucom.2013.08.044 · Cited by 19
Adaptation of Artificial Neural Networks Avoiding Catastrophic Forgetting
Albesano, D., Gemello, R., Laface, P., Mana, F., & Scanzio, S. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.1716291 · Cited by 19
Incremental Embedding Learning via Zero-Shot Translation
Wei, K., Deng, C. D., Yang, X., & Li, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17229 · Cited by 22
Continual Learning in Neural NetworksPreprint
Aljundi, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02718 · Cited by 34
Gradient Based Memory Editing for Task-Free Continual LearningPreprint
Jin, X., Du, J., & Ren, X. (2021) · arXiv (Cornell University) · Cited by 19
Energy-Based Models for Continual LearningPreprint
Li, S., Du, Y., van de Ven, G. M., & Mordatch, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.12216 · Cited by 19
Tjomsland, J., Kalkan, S., & Güneş, H. (2022) · Frontiers in Robotics and AI · doi:10.3389/frobt.2022.669420 · Cited by 23
Continuous learning of spiking networks trained with local rules
Antonov, D. I., Sviatov, K. V., & Sukhov, S. V. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.09.003 · Cited by 20
Ji, Z., Li, J., Wang, Q., & Zhang, Z. M. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3230457 · Cited by 18
Fine-Grained Knowledge Selection and Restoration for Non-exemplar Class Incremental Learning
Zhai, J.-T., Liu, X., Lu, Y., & Cheng, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i7.28523 · Cited by 18
Enhancing skin lesion diagnosis with data augmentation techniques: a review of the state-of-the-art
Patil, A. Y., Mehto, A., & Nalband, S. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20145-7 · Cited by 23
Lifelong Machine Learning, Second Edition
Chen, Z., & Liu, B. (2018) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00832ed1v01y201802aim037 · Cited by 160
SPACE: Structured Compression and Sharing of Representational Space for Continual Learning
Saha, G., Garg, I., Ankit, A., & Roy, K. (2021) · IEEE Access · doi:10.1109/access.2021.3126027 · Cited by 22
Drinking from a Firehose: Continual Learning with Web-scale Natural Language
Hu, H., Şener, O., Sha, F., & Koltun, V. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3218265 · Cited by 23
Mitigation of catastrophic forgetting in recurrent neural networks using a Fixed Expansion Layer
Coop, R., & Arel, I. (2013) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2013.6707047 · Cited by 20
Learning and memory in the human brain
Petersson, K. M. (2005) · Figshare · Cited by 18
The Effectiveness of Memory Replay in Large Scale Continual LearningPreprint
Balaji, Y., Farajtabar, M., Yin, D., Mott, A., & Li, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02418 · Cited by 18
General intelligence requires rethinking exploration
Jiang, M., Rocktäschel, T., & Grefenstette, E. (2022) · arXiv · doi:10.48550/arxiv.2211.07819 · Cited by 17
Han, Y.-N., & Liu, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.104966 · Cited by 17
Learning in deep neural networks and brains with similarity-weighted interleaved learning
Saxena, R., Shobe, J. L., & McNaughton, B. L. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2115229119 · Cited by 23
Zhou, X., & Liao, P. (2023) · Sustainability · doi:10.3390/su15064812 · Cited by 18
Ding, N., Thompson, M., Dallas, J., Goh, J. Y. M., & Subosits, J. K. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588474 · Cited by 17
Consolidation Using Sweep Task Rehearsal: Overcoming the Stability-Plasticity Problem
Silver, D. L., Mason, G., & Eljabu, L. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-18356-5_27 · Cited by 17
Learn to Detect Objects Incrementally
Guan, L., Wu, Y. X., Zhao, J., & Ye, C. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500673 · Cited by 17
General intelligence requires rethinking exploration
Jiang, M., Rocktäschel, T., & Grefenstette, E. (2023) · Royal Society Open Science · doi:10.1098/rsos.230539 · Cited by 23
Initial Classifier Weights Replay for Memoryless Class Incremental Learning
Belouadah, E., Popescu, A., & Kanellos, I. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.163 · Cited by 17
Alleviating Catastrophic Forgetting via Multi-Objective Learning
Jin, Y., & Sendhoff, B. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2006.1716554 · Cited by 17
Local Learning Algorithms for Sequential Tasks in Neural Networks
Robins, A. V., & Frean, M. R. (1998) · Journal of Advanced Computational Intelligence and Intelligent Informatics · doi:10.20965/jaciii.1998.p0221 · Cited by 17
Self-citationThe Next Big Thing(s) in Unsupervised Machine Learning: Five Lessons from Infant LearningPreprint
Zaadnoordijk, L., Besold, T. R., & Cusack, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.08497 · Cited by 17
Transfer Learning in Earth Observation Data Analysis: A review
Nowakowski, A., Rosso, M. P. D., Zachar, P., Spiller, D., Gabara, G., Barretta, D., Kalinowska, K. B., Choromański, K., Wilkowski, A., Sebastianelli, A., et al. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3494673 · Cited by 17
Quantum Continual Learning Overcoming Catastrophic Forgetting
Jiang, W., Lu, Z., & Deng, D.-L. (2022) · Chinese Physics Letters · doi:10.1088/0256-307x/39/5/050303 · Cited by 18
Mixed‐Precision Continual Learning Based on Computational Resistance Random Access Memory
Li, Y., Zhang, W., Xu, X., He, Y., Dong, D., Jiang, N., Wang, F., Guo, Z., Wang, S., Dou, C., et al. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202200026 · Cited by 16
Evolving Improved Incremental Learning Schemes for Neural Network Systems
Seipone, T., & Bullinaria, J. A. (2005) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2005.1554941 · Cited by 16
The Effect of Hebbian Learning on Optimisation in Hopfield Networks
Watson, R. A. R., Buckley, C. L., & Mills, R. (2009) · ePrints Soton (University of Southampton) · Cited by 16
Distilling Causal Effect of Data in Class-Incremental LearningPreprint
Hu, X., Tang, K., Miao, C., Hua, X., & Zhang, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.01737 · Cited by 16
Adaptive instance similarity embedding for online continual learning
Han, Y.-N., & Liu, J. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.110238 · Cited by 15
Continual Segmentation with Disentangled Objectness Learning and Class Recognition
Gong, Y., Yu, S., Wang, X., & Xiao, J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00369 · Cited by 15
Online Task-free Continual Learning with Dynamic Sparse Distributed Memory
Pourcel, J., Vu, N., & French, R. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19806-9_42 · Cited by 20
Catastophic Forgetting in Neural Networks
Stranden, H. (2005) · Cited by 15
Context-Sensitive MTL Networks for Machine Lifelong Learning.
Silver, D., & Poirier, R. (2007) · Cited by 15
Short-term plasticity as cause-effect hypothesis testing in distal reward learning
Soltoggio, A. (2019) · Loughborough University Research Repository (Loughborough University) · Cited by 15
Atomistic learning in non-modular systems
Blackmon, J. C., Byrd, D. B., Cummins, R., Poirier, P., & Roth, M. (2005) · Philosophical Psychology · doi:10.1080/09515080500177283 · Cited by 15
Self-Net: Lifelong Learning via Continual Self-Modeling
Mandivarapu, J. K., Camp, B., & Estrada, R. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00019 · Cited by 14
Neural population dynamics of computing with synaptic modulations
Aitken, K., & Mihalaş, Ş. (2023) · eLife · doi:10.7554/elife.83035 · Cited by 17
Bugarin, N., Bugaric, J., Barusco, M., Pezze, D. D., & Susto, G. A. (2024) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw63382.2024.00410 · Cited by 14
Pseudorehearsal Approach for Incremental Learning of Deep Convolutional Neural Networks
Mellado, D., Saavedra, C., Chabert, S., & Salas, R. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-71011-2_10 · Cited by 14
Bayesian Structural Adaptation for Continual Learning
Kumar, A., Chatterjee, S., & Rai, P. (2021) · International Conference on Machine Learning · Cited by 14
Santhakumar, K., & Kasaei, H. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.02.027 · Cited by 14
Cognitively Inspired Learning of Incremental Drifting Concepts
Rostami, M. G., & Galstyan, A. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/341 · Cited by 14
ISM-Net: Mining incremental semantics for class incremental learning
Qiu, Z., Xu, L., Wang, Z., Wu, Q., Meng, F., & Li, H. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.12.029 · Cited by 14
Visually Grounded Continual Learning of Compositional Phrases
Jin, X., Du, J., Sadhu, A., Nevatia, R., & Ren, X. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.158 · Cited by 16
Knowledge-Adaptation PriorsPreprint
Khan, M. E., & Swaroop, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.08769 · Cited by 14
Incremental Embedding Learning With Disentangled Representation Translation
Wei, K., Chen, D., Li, Y., Yang, X., Deng, C. D., & Tao, D. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3199816 · Cited by 13
Adversarially Robust Continual Learning
Khan, H., Bouaynaya, N. C., & Rasool, G. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9892970 · Cited by 13
Chen, Y., & Liang, H. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.413 · Cited by 14
CoLLaRS : A cloud–edge–terminal collaborative lifelong learning framework for AIoT
Hu, S., Lin, J., Lu, Z., Du, X., Duan, Q., & Huang, S.-C. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.04.046 · Cited by 14
Hamilton-Jacobi Reachability in Reinforcement Learning: A Survey
Ganai, M., Gao, S., & Herbert, S. (2024) · IEEE Open Journal of Control Systems · doi:10.1109/ojcsys.2024.3449138 · Cited by 20
Metadata
- Authors
- ROBINS, A.
- Affiliations
- University of Otago (NZ)
- Corresponding author
- ROBINS, ANTHONY
- ORCID
- ROBINS, ANTHONY
- Venue
- Connection Science
- Publisher
- Informa UK Limited
- Published
- 1995-06
- Volume
- 7
- Issue
- 2
- Pages
- 123-146
- ISSN
- 0954-0091 (ISSN-L)
- 1360-0494
- OpenAlex
- W2116522068
- Cited by
- 833
- References
- 18
- Citations by year
- 2026: 52 · 2025: 79 · 2024: 92 · 2023: 109 · 2022: 94 · 2021: 100 · 2020: 77 · 2019: 68 · 2018: 23 · 2017: 15 · 2016: 4 · 2015: 6 · 2014: 3 · 2013: 8 · 2012: 1
- FWCI
- 6.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Connection Science (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- catastrophic forgetting, rehearsal, neural network learning, function approximation, incremental learning, knowledge retention
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review