CoChat
Sign Up
PreprintCited by 1,385Domain Adaptation and Few-Shot LearningReinforcement Learning in RoboticsAdvanced Neural Network Applications

Continual Learning with Deep Generative Replay

Open access
Shin, Hanul, Lee, Jung Kwon, Kim, Jaehong, Kim, Jiwon·2017·arXiv
DOI 10.48550/arxiv.1705.08690arXiv 1705.08690
Open this paper in CoChat — free accountOpen PDF

Abstract

Attempts to train a comprehensive artificial intelligence capable of solving multiple tasks have been impeded by a chronic problem called catastrophic forgetting. Although simply replaying all previous data alleviates the problem, it requires large memory and even worse, often infeasible in real world applications where the access to past data is limited. Inspired by the generative nature of hippocampus as a short-term memory system in primate brain, we propose the Deep Generative Replay, a novel framework with a cooperative dual model architecture consisting of a deep generative model ("generator") and a task solving model ("solver"). With only these two models, training data for previous tasks can easily be sampled and interleaved with those for a new task. We test our methods in several sequential learning settings involving image classification tasks.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1705.08690

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Classical continual learning methods typically treat memory as a static mechanism for knowledge retention.

    “but they typically treat memory as a static mechanism for knowledge retention.”

    From A Survey of Agent Memory in the Second Half: Towards Self-Evolving and Long-Horizon Agents (2026) · cites this paper as Shin et al., 2017

    The Introduction (p. 1) says previous approaches often stored past examples for replay, which supports the idea of retaining knowledge through stored memory. But it also says those examples are replayed while network parameters are jointly optimized, and the Related Works section (p. 3) describes methods that generate pseudoinputs. The paper does not establish that classical methods typically treat memory itself as a static mechanism. (LLM, conf=0.80)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 32 · Cited by 1,385

Research works printed but not linked: 27

  1. [1][1] W. C. Abraham and A. Robins. Memory retention-the synaptic stability versus plasticity dilemma. Trends in neurosciences , 28(2):73-78, 2005. -
  2. [2][2] B. Ans and S. Rousset. Avoiding catastrophic forgetting by coupling two reverberating neural networks. Comptes Rendus de l'Académie des Sciences-Series III-Sciences de la Vie , 320(12):989-997, 1997. -
  3. [3][3] D. A. Baldwin, E. M. Markman, and R. L. Melartin. Infants' ability to draw inferences about nonobvious object properties: Evidence from exploratory play. Child development , 64(3):711728, 1993. -
  4. [4][4] M. H. Bornstein and M. E. Arterberry. The development of object categorization in young children: Hierarchical inclusiveness, age, perceptual attribute, and group versus individual analyses. Developmental psychology , 46(2):350, 2010. -
  5. [6][6] J. Fagot and R. G. Cook. Evidence for large long-term memory capacities in baboons and pigeons and its implications for learning and the evolution of cognition. Proceedings of the National Academy of Sciences , 103(46):17564-17567, 2006. -
  6. [7][7] R. M. French. Catastrophic forgetting in connectionist networks. Trends in cognitive sciences , 3(4):128-135, 1999. -
  7. [8][8] H. Gelbard-Sagiv, R. Mukamel, M. Harel, R. Malach, and I. Fried. Internally generated reactivation of single neurons in human hippocampus during free recall. Science , 322(5898):96101, 2008. -
  8. [9][9] R. Girshick, J. Donahue, T. Darrell, and J. Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 580-587, 2014. -
  9. [10][10] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio. Generative adversarial nets. In Advances in Neural Information Processing Systems (NIPS) , 2014. -
  10. [11][11] I. J. Goodfellow. NIPS 2016 tutorial: Generative adversarial networks. CoRR , abs/1701.00160, 2017. - · arXiv
  11. [12][12] I. J. Goodfellow, M. Mirza, D. Xiao, A. Courville, and Y. Bengio. An empirical investigation of catastrophic forgetting in gradient-based neural networks. arXiv preprint arXiv:1312.6211 , 2013. - · arXiv
  12. [16][16] G. E. Hinton and D. C. Plaut. Using fast weights to deblur old memories. In Proceedings of the ninth annual conference of the Cognitive Science Society , pages 177-186, 1987. -
  13. [17][17] D. P. Kingma and M. Welling. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 , 2013. - · arXiv
  14. [19][19] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE , 86(11):2278-2324, 1998. -
  15. [20][20] S.-W. Lee, J.-H. Kim, J.-W. Ha, and B.-T. Zhang. Overcoming catastrophic forgetting by incremental moment matching. arXiv preprint arXiv:1703.08475 , 2017. - · arXiv
  16. [21][21] Z. Li and D. Hoiem. Learning without forgetting. In European Conference on Computer Vision , pages 614-629. Springer, 2016. -
  17. [23][23] V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, et al. Human-level control through deep reinforcement learning. Nature , 518(7540):529-533, 2015. -
  18. [24][24] D. C. Mocanu, M. T. Vega, E. Eaton, P. Stone, and A. Liotta. Online contrastive divergence with generative replay: Experience replay without storing data. CoRR , abs/1610.05555, 2016. - · arXiv
  19. [25][25] Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu, and A. Y. Ng. Reading digits in natural images with unsupervised feature learning. In NIPS workshop on deep learning and unsupervised feature learning , volume 2011, page 5, 2011. -
  20. [27][27] J. O'Neill, B. Pleydell-Bouverie, D. Dupret, and J. Csicsvari. Play it again: reactivation of waking experience and memory. Trends in neurosciences , 33(5):220-229, 2010. -
  21. [28][28] S. Ramirez, X. Liu, P.-A. Lin, J. Suh, M. Pignatelli, R. L. Redondo, T. J. Ryan, and S. Tonegawa. Creating a false memory in the hippocampus. Science , 341(6144):387-391, 2013. -
  22. [29][29] R. Ratcliff. Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions. Psychological review , 97(2):285-308, 1990. -
  23. [30][30] A. Robins. Catastrophic forgetting in neural networks: the role of rehearsal mechanisms. In Artificial Neural Networks and Expert Systems, 1993. Proceedings., First New Zealand International Two-Stream Conference on , pages 65-68. IEEE, 1993. -
  24. [32][32] R. Salakhutdinov and G. Hinton. Deep boltzmann machines. In Artificial Intelligence and Statistics , pages 448-455, 2009. -
  25. [33][33] N. Srivastava, G. E. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. Dropout: a simple way to prevent neural networks from overfitting. Journal of Machine Learning Research , 15(1):1929-1958, 2014. -
  26. [34][34] R. K. Srivastava, J. Masci, S. Kazerounian, F. Gomez, and J. Schmidhuber. Compete to compute. In Advances in neural information processing systems , pages 2310-2318, 2013. -
  27. [35][35] R. Stickgold and M. P. Walker. Sleep-dependent memory consolidation and reconsolidation. Sleep medicine , 8(4):331-343, 2007.

Authors
Shin, H., Lee, J. K., Kim, J., & Kim, J.
Affiliations
  • Seoul National University (KR)
  • Samsung (South Korea) (KR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2017
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1705.08690
arXiv
1705.08690
OpenAlex
W2618767506
Cited by
1,385
References
32
Citations by year
2026: 2 · 2025: 121 · 2024: 205 · 2023: 294 · 2022: 174 · 2021: 262 · 2020: 196 · 2019: 93 · 2018: 37 · 2017: 1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
continual learning, catastrophic forgetting, generative replay, deep generative models, dual-model architecture, data sampling, image classification, sequential learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review