The Construction of Semantic Memory: Grammar-Based Representations Learned from Relational Episodic Information
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
After acquisition, memories underlie a process of consolidation, making them more resistant to interference and brain injury. Memory consolidation involves systems-level interactions, most importantly between the hippocampus and associated structures, which takes part in the initial encoding of memory, and the neocortex, which supports long-term storage. This dichotomy parallels the contrast between episodic memory (tied to the hippocampal formation), collecting an autobiographical stream of experiences, and semantic memory, a repertoire of facts and statistical regularities about the world, involving the neocortex at large. Experimental evidence points to a gradual transformation of memories, following encoding, from an episodic to a semantic character. This may require an exchange of information between different memory modules during inactive periods. We propose a theory for such interactions and for the formation of semantic memory, in which episodic memory is encoded as relational data. Semantic memory is modeled as a modified stochastic grammar, which learns to parse episodic configurations expressed as an association matrix. The grammar produces tree-like representations of episodes, describing the relationships between its main constituents at multiple levels of categorization, based on its current knowledge of world regularities. These regularities are learned by the grammar from episodic memory information, through an expectation-maximization procedure, analogous to the inside-outside algorithm for stochastic context-free grammars. We propose that a Monte-Carlo sampling version of this algorithm can be mapped on the dynamics of "sleep replay" of previously acquired information in the hippocampus and neocortex. We propose that the model can reproduce several properties of semantic memory such as decontextualization, top-down processing, and creation of schemata.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
Rao, R. P. N., & Ballard, D. H. (1999) · Nature Neuroscience · doi:10.1038/4580 · Cited by 5,483
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460
A View of the Em Algorithm that Justifies Incremental, Sparse, and other Variants
Neal, R. M., & Hinton, G. E. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_12 · Cited by 2,187
The organization of recent and remote memories
Frankland, P. W., & Bontempi, B. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1607 · Cited by 2,138
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774
Coordinated memory replay in the visual cortex and hippocampus during sleep
Ji, D., & Wilson, M. A. (2007) · Nature Neuroscience · doi:10.1038/nn1825 · Cited by 1,669
Hierarchical Bayesian inference in the visual cortex
Lee, T. S., & Mumford, D. (2003) · Journal of the Optical Society of America A · doi:10.1364/josaa.20.001434 · Cited by 1,473
Hippocampal synaptic enhancement and information storage within a distributed memory system
McNaughton, B. L., & Morris, R. G. M. (1987) · Trends in Neurosciences · doi:10.1016/0166-2236(87)90011-7 · Cited by 1,304
Memory of sequential experience in the hippocampus during slow wave sleep
Lee, A. K., & Wilson, M. A. (2002) · Neuron · doi:10.1016/s0896-6273(02)01096-6 · Cited by 1,296
Computational analysis of the role of the hippocampus in memory
Treves, A., & Rolls, E. T. (1994) · Hippocampus · doi:10.1002/hipo.450040319 · Cited by 1,272
Schemas and Memory Consolidation.
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., & Morris, R. G. M. (2007) · Science · doi:10.1126/science.1135935 · Cited by 1,244
Coordinated interactions between hippocampal Ripples and Cortical Spindles during Slow-Wave Sleep
Siapas, A. G., & Wilson, M. A. (1998) · Neuron · doi:10.1016/s0896-6273(00)80629-7 · Cited by 1,052
Wagner, U., Gais, S., Haider, H., Verleger, R., & Born, J. (2004) · Nature · doi:10.1038/nature02223 · Cited by 1,012
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Communication between neocortex and hippocampus during sleep in rodents
Sirota, A., Csicsvari, J., Buhl, D., & Buzsáki, G. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0437938100 · Cited by 930
Moscovitch, M., Rosenbaum, R. S., Gilboa, A., Addis, D. R., Westmacott, R., Grady, C., McAndrews, M. P., Levine, B., Black, S., Winocur, G., et al. (2005) · Journal of Anatomy · doi:10.1111/j.1469-7580.2005.00421.x · Cited by 893
Replay of rule-learning related neural patterns in the prefrontal cortex during sleep
Peyrache, A., Khamassi, M., Benchenane, K., Wiener, S. I., & Battaglia, F. P. (2009) · Nature Neuroscience · doi:10.1038/nn.2337 · Cited by 767
Self-citationKudrimoti, H. S., Barnes, C. A., & McNaughton, B. L. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-10-04090.1999 · Cited by 753
Learning and inference in the brain
Friston, K. (2003) · Neural Networks · doi:10.1016/j.neunet.2003.06.005 · Cited by 724
Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep
Euston, D. R., Tatsuno, M., & McNaughton, B. L. (2007) · Science · doi:10.1126/science.1148979 · Cited by 586
The Neuropsychology of Human Memory
Squire, L. R. (1982) · Annual Review of Neuroscience · doi:10.1146/annurev.ne.05.030182.001325 · Cited by 574
Takashima, A., Petersson, K. M., Rutters, F., Tendolkar, I., Jensen, O., Zwarts, M. J., McNaughton, B. L., & Fernández, G. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0507774103 · Cited by 557
Isomura, Y., Sirota, A., Özen, S., Montgomery, S., Mizuseki, K., Henze, D. A., & Buzsáki, G. (2006) · Neuron · doi:10.1016/j.neuron.2006.10.023 · Cited by 500
A rational analysis of rule-based concept learning
Goodman, N. D., Tenenbaum, J. B., Feldman, J., & Griffiths, T. L. (2008) · Cognitive Science · doi:10.1080/03640210701802071 · Cited by 469
Coordinated Reactivation of Distributed Memory Traces in Primate Neocortex
Hoffman, K. L., & McNaughton, B. L. (2002) · Science · doi:10.1126/science.1073538 · Cited by 420
Human relational memory requires time and sleep
Ellenbogen, J. M., Hu, P. T., Payne, J. D., Titone, D., & Walker, M. P. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700094104 · Cited by 415
Towards a mathematical theory of cortical micro-circuits
George, D., & Hawkins, J. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000532 · Cited by 404
Naps promote abstraction in language-learning infants
Gómez, R. L., Bootzin, R. R., & Nadel, L. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01764.x · Cited by 386
Reactivation of experience-dependent cell assembly patterns in the hippocampus
O'Neill, J., Senior, T. J., Allen, K., Huxter, J. R., & Csicsvari, J. (2008) · Nature Neuroscience · doi:10.1038/nn2037 · Cited by 318
New Experiences Enhance Coordinated Neural Activity in the Hippocampus
Cheng, S., & Frank, L. M. (2008) · Neuron · doi:10.1016/j.neuron.2007.11.035 · Cited by 286
Schabus, M., Hödlmoser, K., Gruber, G., Sauter, C., Anderer, P., Klösch, G., Parapatics, S., Saletu, B., Klimesch, W., & Zeitlhofer, J. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04694.x · Cited by 261
Maintaining memories by reactivation
Rasch, B., & Born, J. (2007) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2007.11.007 · Cited by 240
Cited by
Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning
Buzsáki, G. (2015) · Hippocampus · doi:10.1002/hipo.22488 · Cited by 1,759
Internally generated sequences in learning and executing goal-directed behavior
Pezzulo, G., van der Meer, M. A. A., Lansink, C. S., & Pennartz, C. M. A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.011 · Cited by 217
Self-citationHippocampal sharp-wave ripples in waking and sleeping states
Roumis, D. K., & Frank, L. M. (2015) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2015.05.001 · Cited by 155
Aging memories: Differential decay of episodic memory components
Talamini, L. M., & Gorree, E. (2012) · Learning & Memory · doi:10.1101/lm.024281.111 · Cited by 39
No evidence for a preferential role of sleep in episodic memory abstraction
Talamini, L. M., van Moorselaar, D., Bakker, R., Bulath, M., Szegedi, S., Sinichi, M., & De Boer, M. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.871188 · Cited by 4
Metadata
- Authors
- Battaglia, F. P., & Pennartz, C. M. A.
- Venue
- Frontiers in Computational Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2011
- Volume
- 5
- Pages
- 36-36
- ISSN
- 1662-5188 (ISSN-L)
- OpenAlex
- W2155996867
- Cited by
- 34
- References
- 33
- FWCI
- 2.11
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.