The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Incorporating rapid neocortical learning of new schema-consistent information into complementary learning systems theory.
Abstract
The complementary learning systems theory of the roles of hippocampus and neocortex (McClelland, McNaughton, & O'Reilly, 1995) holds that the rapid integration of arbitrary new information into neocortical structures is avoided to prevent catastrophic interference with structured knowledge representations stored in synaptic connections among neocortical neurons. Recent studies (Tse et al., 2007, 2011) showed that neocortical circuits can rapidly acquire new associations that are consistent with prior knowledge. The findings challenge the complementary learning systems theory as previously presented. However, new simulations extending those reported in McClelland et al. (1995) show that new information that is consistent with knowledge previously acquired by a putatively cortexlike artificial neural network can be learned rapidly and without interfering with existing knowledge; it is when inconsistent new knowledge is acquired quickly that catastrophic interference ensues. Several important features of the findings of Tse et al. (2007, 2011) are captured in these simulations, indicating that the neural network model used in McClelland et al. has characteristics in common with neocortical learning mechanisms. An additional simulation generalizes beyond the network model previously used, showing how the rate of change of cortical connections can depend on prior knowledge in an arguably more biologically plausible network architecture. In sum, the findings of Tse et al. are fully consistent with the idea that hippocampus and neocortex are complementary learning systems. Taken together, these findings and the simulations reported here advance our knowledge by bringing out the role of consistency of new experience with existing knowledge and demonstrating that the rate of change of connections in real and artificial neural networks can be strongly prior-knowledge dependent.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256
Self-citationMcClelland, J. L., & Rumelhart, D. E. (1981) · Psychological Review · doi:10.1037/0033-295x.88.5.375 · Cited by 4,889
Self-citationConceptual Change in Childhood
Carey, S. E. (1985) · Medical Entomology and Zoology · Cited by 4,609
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402
Bienenstock, E., Cooper, L., & Munro, P. (1982) · The Journal of Neuroscience · doi:10.1523/jneurosci.02-01-00032.1982 · Cited by 2,896
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771
Interaction of information in word recognition.
Morton, J. (1969) · Psychological Review · doi:10.1037/h0027366 · Cited by 2,151
Grossberg, S. (1976) · Biological Cybernetics · doi:10.1007/bf00344744 · Cited by 1,909
Hippocampal synaptic enhancement and information storage within a distributed memory system
McNaughton, B. L., & Morris, R. G. M. (1987) · Trends in Neurosciences · doi:10.1016/0166-2236(87)90011-7 · Cited by 1,304
Schemas and Memory Consolidation.
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., & Morris, R. G. M. (2007) · Science · doi:10.1126/science.1135935 · Cited by 1,244
Categories and induction in young children
Gelman, S. A., & Markman, E. M. (1986) · Cognition · doi:10.1016/0010-0277(86)90034-x · Cited by 1,155
Sutherland, R. J., & Rudy, J. W. (1989) · Psychobiology · doi:10.3758/bf03337828 · Cited by 954
Rogers, T. T., Lambon Ralph, M. A., Garrard, P., Bozeat, S., McClelland, J. L., Hodges, J. R., & Patterson, K. (2004) · Psychological Review · doi:10.1037/0033-295x.111.1.205 · Cited by 948
Self-citationHippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off
O'Reilly, R. C., & McClelland, J. L. (1994) · Hippocampus · doi:10.1002/hipo.450040605 · Cited by 914
Self-citationSemantic Cognition: A Parallel Distributed Processing Approach
Rogers, T. T., & McClelland, J. L. (2004) · Cited by 891
Self-citationFeature discovery by competitive learning
RUMELHART, D., & ZIPSER, D. (1985) · Cognitive Science · doi:10.1016/s0364-0213(85)80010-0 · Cited by 882
Choice, similarity, and the context theory of classification.
Nosofsky, R. M. (1984) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.10.1.104 · Cited by 739
Explorations in Parallel Distributed Processing: A Handbook of Models, Programs, and Exercises
Kawamoto, A. H., McClelland, J. L., & Rumelhart, D. E. (1989) · The American Journal of Psychology · doi:10.2307/1423065 · Cited by 726
Self-citationTreves, A., & Rolls, E. T. (1992) · Hippocampus · doi:10.1002/hipo.450020209 · Cited by 707
Three aspects of cognitive development
Siegler, R. S. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90016-5 · Cited by 666
Adding a conscience to competitive learning
DeSieno (1988) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1988.23839 · Cited by 637
Schema-dependent gene activation and memory encoding in neocortex
Tse, D., Takeuchi, T., Kakeyama, M., Kajii, Y., Okuno, H., Tohyama, C., Bito, H., & Morris, R. G. M. (2011) · Science · doi:10.1126/science.1205274 · Cited by 618
Human cognition : learning, understanding, and remembering
Bransford, J. D. (1979) · Medical Entomology and Zoology · Cited by 604
Odor Representations in Olfactory Cortex: “Sparse” Coding, Global Inhibition, and Oscillations
Poo, C., & Isaacson, J. S. (2009) · Neuron · doi:10.1016/j.neuron.2009.05.022 · Cited by 464
Charting the progression in semantic dementia: Implications for the organisation of semantic memory
Hodges, J. R., Graham, N., & Patterson, K. (1995) · Memory · doi:10.1080/09658219508253161 · Cited by 432
The BCM theory of synapse modification at 30: interaction of theory with experiment
Cooper, L. N., & Bear, M. F. (2012) · Nature Reviews Neuroscience · doi:10.1038/nrn3353 · Cited by 395
Semantic and Conceptual Development: An Ontological Perspective
Zwicky, A., & Keil, F. C. (1980) · The Modern Language Journal · doi:10.2307/325916 · Cited by 382
Kumaran, D., & McClelland, J. L. (2012) · Psychological Review · doi:10.1037/a0028681 · Cited by 370
Self-citationO'Reilly, R. C. (1996) · Neural Computation · doi:10.1162/neco.1996.8.5.895 · Cited by 352
Are there interactive processes in speech perception?
MCCLELLAND, J., MIRMAN, D., & HOLT, L. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.06.007 · Cited by 246
Self-citationA more biologically plausible learning rule for neural networks.
Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.88.10.4433 · Cited by 227
Order of Acquisition of Subordinate-, Basic-, and Superordinate-Level Categories
Mervis, C. Β., & Crisafi, M. A. (1982) · Child Development · doi:10.1111/j.1467-8624.1982.tb01315.x · Cited by 226
The cradle of categorization: Is the basic level basic?
Mandler, J. M., & Bauer, P. J. (1988) · Cognitive Development · doi:10.1016/0885-2014(88)90011-1 · Cited by 204
"Presemantic" Cognition in Semantic Dementia: Six Deficits in Search of an Explanation
Patterson, K., Lambon Ralph, M. A., Jefferies, E., Woollams, A., Jones, R., Hodges, J. R., & Rogers, T. T. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/089892906775783714 · Cited by 203
Graded state machines: The representation of temporal contingencies in simple recurrent networks
Servan-Schreiber, D., Cleeremans, A., & Mcclelland, J. L. (1991) · Machine Learning · doi:10.1007/bf00114843 · Cited by 201
Self-citationMcClelland, J. L., & Goddard, N. H. (1996) · Hippocampus · doi:10.1002/(sici)1098-1063(1996)6:6<654::aid-hipo8>3.3.co;2-d · Cited by 196
Self-citationBowers, J. S. (2009) · Psychological Review · doi:10.1037/a0014462 · Cited by 191
Learning and Connectionist Representations
Rumelhart, D. E., & Todd, P. M. (1993) · Attention and Performance XIV · doi:10.7551/mitpress/1477.003.0005 · Cited by 185
Young children's use of color in classification: Foods and canonically colored objects
Macario, J. F. (1991) · Cognitive Development · doi:10.1016/0885-2014(91)90004-w · Cited by 174
Précis ofSemantic Cognition: A Parallel Distributed Processing Approach
Rogers, T. T., & McClelland, J. L. (2008) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0800589x · Cited by 161
Self-citationParallel distributed processing : implications for cognition and development
McClelland, J. L., & Project., A. I. A. P. (2018) · doi:10.1184/r1/6617408 · Cited by 160
Self-citationLearning Representations by Recirculation
Hinton, G. E., & McClelland, J. L. (1987) · Cited by 152
Self-citationHow Inhibitory Oscillations Can Train Neural Networks and Punish Competitors
Norman, K. A., Newman, E. L., Detre, G. J., & Polyn, S. M. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1577 · Cited by 121
Odor representations in olfactory cortex
Poo, C. (2010) · eScholarship (California Digital Library) · Cited by 101
A single-system account of semantic and lexical deficits in five semantic dementia patients
Dilkina, K., McClelland, J. L., & Plaut, D. C. (2008) · Cognitive Neuropsychology · doi:10.1080/02643290701723948 · Cited by 80
Self-citationBrain style computation: learning and generalization
Rumelhart, D. E. (1990) · Academic Press Professional, Inc. eBooks · Cited by 68
Shouval, H. (2007) · Scholarpedia · doi:10.4249/scholarpedia.1605 · Cited by 26
Gibson, W. G., Robinson, J., & Bennett, M. R. (1991) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1991.0050 · Cited by 21
Cited by
Engrams and circuits crucial for systems consolidation of a memory
Kitamura, T., Ogawa, S. K., Roy, D. S., Okuyama, T., Morrissey, M. D., Smith, L. M., Redondo, R. L., & Tonegawa, S. (2017) · Science · doi:10.1126/science.aam6808 · Cited by 1,104
Neurobiology of Schemas and Schema-Mediated Memory
Gilboa, A., & Marlatte, H. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.04.013 · Cited by 742
What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated
Kumaran, D., Hassabis, D., & McClelland, J. L. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.05.004 · Cited by 759
Self-citationSquire, L. R., Genzel, L., Wixted, J. T., & Morris, R. G. (2015) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a021766 · Cited by 700
The Role of Hippocampal Replay in Memory and Planning
Ólafsdóttir, H. F., Bush, D., & Barry, C. (2018) · Current Biology · doi:10.1016/j.cub.2017.10.073 · Cited by 413
Metadata
- Authors
- McClelland, J. L.
- Venue
- Journal of Experimental Psychology: General
- Published
- 2013-11
- Volume
- 142
- Issue
- 4
- Pages
- 1190-1210
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2075423593
- Cited by
- 275
- References
- 50
- FWCI
- 7.24
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.