Neuronal Computation Underlying Inferential Reasoning in Humans and Mice
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Every day we make decisions critical for adaptation and survival. We repeat actions with known consequences. But we also draw on loosely related events to infer and imagine the outcome of entirely novel choices. These inferential decisions are thought to engage a number of brain regions; however, the underlying neuronal computation remains unknown. Here, we use a multi-day cross-species approach in humans and mice to report the functional anatomy and neuronal computation underlying inferential decisions. We show that during successful inference, the mammalian brain uses a hippocampal prospective code to forecast temporally structured learned associations. Moreover, during resting behavior, coactivation of hippocampal cells in sharp-wave/ripples represent inferred relationships that include reward, thereby "joining-the-dots" between events that have not been observed together but lead to profitable outcomes. Computing mnemonic links in this manner may provide an important mechanism to build a cognitive map that stretches beyond direct experience, thus supporting flexible behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cognitive maps in rats and men
Tolman, E. C. (1948) · Psychological Review · doi:10.1037/h0061626 · Cited by 6,641
The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat
O'Keefe, J., & Dostrovsky, J. (1971) · Brain Research · doi:10.1016/0006-8993(71)90358-1 · Cited by 6,151
Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans.
Squire, L. R. (1992) · Psychological Review · doi:10.1037/0033-295x.99.2.195 · Cited by 5,376 · cited 2×
“In addition to representing space, the hippocampus supports memory for past experience (Squire, 1992) and mediates associations between sequential events (Fortin et al., 2002; Schendan et al., 2003).”
BackgroundLearning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 1×
“Specifically, hippocampal SWR spiking may broadcast value information to relate reward information received at the end of a sequence to earlier events (Foster et al., 2000; Sutton, 1988).”
BackgroundRepresentational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“Retrieval mechanisms of this kind may be described by a family of theories known as model-based reinforcement learning (Daw et al., 2005) that involve a learned model of the world.”
BackgroundMemory, navigation and theta rhythm in the hippocampal-entorhinal system
Buzsáki, G., & Moser, E. I. (2013) · Nature Neuroscience · doi:10.1038/nn.3304 · Cited by 1,847 · cited 1×
“Sequential firing of this kind may be a necessary requirement for a brain region evolved to support memory (Buzsáki and Moser, 2013).”
BackgroundHippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning
Buzsáki, G. (2015) · Hippocampus · doi:10.1002/hipo.22488 · Cited by 1,759
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727 · cited 2×
“Consistent with this hypothesis, reverse replay in awake SWRs occurs during rewardmotivated spatial behavior (Diba and Buzsáki, 2007; Foster and Wilson, 2006; Gupta et al., 2010), while our data show an inverted temporal order in non-spatial inferred relationships.”
BackgroundCellular networks underlying human spatial navigation
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., & Fried, I. (2003) · Nature · doi:10.1038/nature01964 · Cited by 1,425 · cited 1×
“The hippocampus has been attributed to holding a cognitive map (O’Keefe and Nadel, 1978), with neuronal representations observed in the spatially tuned activity of pyramidal cells during exploration (Ekstrom et al., 2003; O’Keefe and Dostrovsky, 1971).”
Internally Generated Cell Assembly Sequences in the Rat Hippocampus
Pastalkova, E., Itskov, V., Amarasingham, A., & Buzsáki, G. (2008) · Science · doi:10.1126/science.1159775 · Cited by 1,301
Schemas and Memory Consolidation.
Tse, D., Langston, R. F., Kakeyama, M., Bethus, I., Spooner, P. A., Wood, E. R., Witter, M. P., & Morris, R. G. M. (2007) · Science · doi:10.1126/science.1135935 · Cited by 1,244
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Forward and reverse hippocampal place-cell sequences during ripples
Diba, K., & Buzsáki, G. (2007) · Nature Neuroscience · doi:10.1038/nn1961 · Cited by 1,205
Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep
Louie, K., & Wilson, M. A. (2001) · Neuron · doi:10.1016/s0896-6273(01)00186-6 · Cited by 1,148 · cited 1×
“During SWRs, hippocampal cells fire synchronously and their temporally structured spiking can ‘‘replay’’ previous waking experience (Louie and Wilson, 2001; Nádasdy et al., 1999; Wilson and McNaughton, 1994) to support memory and planning (Buzsáki, 2015; Foster, 2017; Joo and Frank, 2018).”
BackgroundEngrams and circuits crucial for systems consolidation of a memory
Kitamura, T., Ogawa, S. K., Roy, D. S., Okuyama, T., Morrissey, M. D., Smith, L. M., Redondo, R. L., & Tonegawa, S. (2017) · Science · doi:10.1126/science.aam6808 · Cited by 1,104
McNaughton, B. L., Barnes, C. A., & O'Keefe, J. (1983) · Experimental Brain Research · doi:10.1007/bf00237147 · Cited by 1,071
Wagner, U., Gais, S., Haider, H., Verleger, R., & Born, J. (2004) · Nature · doi:10.1038/nature02223 · Cited by 1,012 · cited 1×
“This new understanding of hippocampal SWRs may explain why sleep/ rest facilitates behavioral readouts of insight and inferential reasoning in humans (Coutanche et al., 2013; Ellenbogen et al., 2007; van Kesteren et al., 2010; Lau et al., 2011; Wagner et al., 2004; Werchan and Gómez, 2013).”
BackgroundNeural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 1×
“232 Cell 183, 228–243, October 1, 2020 (Gupta et al., 2013; Johnson and Redish, 2007; Mehta et al., 2000) and predict subsequent behavior (Ferbinteanu and Shapiro, 2003; Pastalkova et al.”
BackgroundWood, E. R., Dudchenko, P. A., Robitsek, R. J., & Eichenbaum, H. (2000) · Neuron · doi:10.1016/s0896-6273(00)00071-4 · Cited by 992 · cited 1×
“, 2000) and predict subsequent behavior (Ferbinteanu and Shapiro, 2003; Pastalkova et al., 2008; Pfeiffer and Foster, 2013; Singer et al., 2013; Wood et al., 2000).”
Replay and Time Compression of Recurring Spike Sequences in the Hippocampus
Nádasdy, Z., Hirase, H., Czurkó, A., Csicsvari, J., & Buzsáki, G. (1999) · The Journal of Neuroscience · doi:10.1523/jneurosci.19-21-09497.1999 · Cited by 932 · cited 1×
“During SWRs, hippocampal cells fire synchronously and their temporally structured spiking can ‘‘replay’’ previous waking experience (Louie and Wilson, 2001; Nádasdy et al., 1999; Wilson and McNaughton, 1994) to support memory and planning (Buzsáki, 2015; Foster, 2017; Joo and Frank, 2018).”
BackgroundCritical role of the hippocampus in memory for sequences of events
Fortin, N. J., Agster, K. L., & Eichenbaum, H. B. (2002) · Nature Neuroscience · doi:10.1038/nn834 · Cited by 881 · cited 1×
“In addition to representing space, the hippocampus supports memory for past experience (Squire, 1992) and mediates associations between sequential events (Fortin et al., 2002; Schendan et al., 2003).”
BackgroundConjunctive representations in learning and memory: Principles of cortical and hippocampal function.
O'Reilly, R. C., & Rudy, J. W. (2001) · Psychological Review · doi:10.1037//0033-295x.108.2.311 · Cited by 865 · cited 1×
“’’ Together with prior memories, such higher-order relationships may form a ‘‘relational’’ or ‘‘cognitive map’’ of the world (Cohen and Eichenbaum, 1993; O’Reilly and Rudy, 2001; Tolman, 1948).”
Dyna, an Integrated Architecture for Learning, Planning, and Reacting
Sutton, R. S. (1991) · ACM SIGART Bulletin · doi:10.1145/122344.122377 · Cited by 777 · cited 1×
“One candidate mechanism involves using multiple memories to internally simulate and cache statistics of the environment (Sutton, 1991).”
BackgroundAwake replay of remote experiences in the hippocampus
Karlsson, M. P., & Frank, L. M. (2009) · Nature Neuroscience · doi:10.1038/nn.2344 · Cited by 769 · cited 1×
“Comparable results were observed during offline periods of sleep but with lower fidelity (Figures S1B, S7D, and S7E), as reported for replay of spatial firing patterns during awake rest versus sleep (Karlsson and Frank, 2009).”
ResultThe reorganization and reactivation of hippocampal maps predict spatial memory performance
Dupret, D., O'Neill, J., Pleydell-Bouverie, B., & Csicsvari, J. (2010) · Nature Neuroscience · doi:10.1038/nn.2599 · Cited by 769 · cited 1×
“(B) To further measure firing associations between hippocampal neurons during SWRs (Figure 7), we used a second approach reported previously (Dupret et al., 2010; McNamara et al., 2014).”
MethodSelf-citationHippocampal replay is not a simple function of experience
Gupta, A. S., van der Meer, M. A. A., Touretzky, D. S., & Redish, A. D. (2010) · Neuron · doi:10.1016/j.neuron.2010.01.034 · Cited by 733
Preplay of future place cell sequences by hippocampal cellular assemblies
Dragoi, G., & Tonegawa, S. (2011) · Nature · doi:10.1038/nature09633 · Cited by 716 · cited 2×
“Rather, the intrinsic connectivity of the hippocampus (Somogyi and Klausberger, 2017), self-generated sequences (Dragoi and Tonegawa, 2011), forward planning (Ólafsdóttir et al.”
BackgroundSquire, L. R., Genzel, L., Wixted, J. T., & Morris, R. G. (2015) · Cold Spring Harbor Perspectives in Biology · doi:10.1101/cshperspect.a021766 · Cited by 700 · cited 1×
“Our task design also lends toward using more mature or consolidated memories: evidence in rodents suggests memories are rapidly generated in both hippocampus and mPFC, gradually becoming quiescent in hippocampus with consolidation in mPFC (Kitamura et al., 2017; Preston and Eichenbaum, 2013; Squire et al., 2015).”
MethodAn fMRI Study of the Role of the Medial Temporal Lobe in Implicit and Explicit Sequence Learning
Schendan, H. E., Searl, M. M., Melrose, R. J., & Stern, C. E. (2003) · Neuron · doi:10.1016/s0896-6273(03)00123-5 · Cited by 610 · cited 1×
“In addition to representing space, the hippocampus supports memory for past experience (Squire, 1992) and mediates associations between sequential events (Fortin et al., 2002; Schendan et al., 2003).”
BackgroundOverlapping memory replay during sleep builds cognitive schemata
Lewis, P. A., & Durrant, S. J. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.06.004 · Cited by 512 · cited 1×
“SWR-related activity could extend beyond direct experience by recombining and recoding mnemonic information (Buzsáki, 2015; Diekelmann and Born, 2010; Lewis and Durrant, 2011; Shohamy and Daw, 2015; Zeithamova et al., 2012b).”
BackgroundHampton, A. N., Bossaerts, P., & O’Doherty, J. P. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.1010-06.2006 · Cited by 498
Human replay spontaneously reorganizes experience
Liu, Y., Dolan, R. J., Kurth-Nelson, Z., & Behrens, T. E. J. (2019) · Cell · doi:10.1016/j.cell.2019.06.012 · Cited by 497
Self-citationDopaminergic neurons promote hippocampal reactivation and spatial memory persistence
McNamara, C. G., Tejero-Cantero, Á., Trouche, S., Campo-Urriza, N., & Dupret, D. (2014) · Nature Neuroscience · doi:10.1038/nn.3843 · Cited by 486
Self-citationThe hippocampal sharp wave-ripple in memory retrieval for immediate use and consolidation
Joo, H. R., & Frank, L. M. (2018) · Nature Reviews Neuroscience · doi:10.1038/s41583-018-0077-1 · Cited by 430
The Role of the Hippocampus in Prediction and Imagination
Buckner, R. L. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163508 · Cited by 419 · cited 2×
“One possibility is that memories for distinct experiences are linked together or even fundamentally restructured during awake rest and sleep (Buckner, 2010; Buzsáki, 2015; Diekelmann and Born, 2010; Foster, 2017; Joo and Frank, 2018).”
BackgroundHuman relational memory requires time and sleep
Ellenbogen, J. M., Hu, P. T., Payne, J. D., Titone, D., & Walker, M. P. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700094104 · Cited by 415 · cited 1×
“This new understanding of hippocampal SWRs may explain why sleep/ rest facilitates behavioral readouts of insight and inferential reasoning in humans (Coutanche et al., 2013; Ellenbogen et al., 2007; van Kesteren et al., 2010; Lau et al., 2011; Wagner et al., 2004; Werchan and Gómez, 2013).”
BackgroundRewarded Outcomes Enhance Reactivation of Experience in the Hippocampus
Singer, A. C., & Frank, L. M. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.016 · Cited by 385
McKenzie, S., Frank, A. J., Kinsky, N. R., Porter, B., Rivière, P. D., & Eichenbaum, H. (2014) · Neuron · doi:10.1016/j.neuron.2014.05.019 · Cited by 373 · cited 15×
“J) In humans, searchlight RSA with multiple regression (Figures S6D and S6E) was used to identify regions showing representational similarity between auditory cues Xn in the inference test and outcomes Zn in conditioning.”
MethodInfluentialvan de Ven, G. M., Trouche, S., McNamara, C. G., Allen, K., & Dupret, D. (2016) · Neuron · doi:10.1016/j.neuron.2016.10.020 · Cited by 320 · cited 3×
“…containing 12-14 independently movable tetrodes that either all targeted the pyramidal layer of bilateral CA1 in the hippocampus (n = 6) (van de Ven et al., 2016) or three brain regions: the pyramidal layer of hippocampal CA1, the medial prefrontal cortex and the ventral tegmental area…”
BackgroundMethodSelf-citationHippocampal place cells construct reward related sequences through unexplored space
Ólafsdóttir, H. F., Barry, C., Saleem, A. B., Hassabis, D., & Spiers, H. J. (2015) · eLife · doi:10.7554/elife.06063 · Cited by 319 · cited 2×
“Rather, the intrinsic connectivity of the hippocampus (Somogyi and Klausberger, 2017), self-generated sequences (Dragoi and Tonegawa, 2011), forward planning (Ólafsdóttir et al., 2015; Pfeiffer and Foster, 2013), structural knowledge (Liu et al.”
BackgroundThe hippocampus and inferential reasoning: building memories to navigate future decisions
Zeithamova, D., Schlichting, M. L., & Preston, A. R. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00070 · Cited by 266
Hippocampal Replay Captures the Unique Topological Structure of a Novel Environment
Wu, X., & Foster, D. J. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3414-13.2014 · Cited by 201
Dopamine neurons respond to errors in the prediction of sensory features of expected rewards
Takahashi, Y. K., Batchelor, H. M., Liu, B., Khanna, A., Morales, M., & Schoenbaum, G. (2017) · Neuron · doi:10.1016/j.neuron.2017.08.025 · Cited by 200 · cited 2×
“, 2006), while themidbrainsupports learningof relationships that extendbeyond those associated with direct reinforcement (Langdon et al., 2018; Sadaccaetal., 2016;Sharpeetal., 2017;Stalnakeretal., 2019;Takahashi et al., 2017).”
BackgroundResultKoster, R., Chadwick, M. J., Chen, Y., Berron, D., Banino, A., Düzel, E., Hassabis, D., & Kumaran, D. (2018) · Neuron · doi:10.1016/j.neuron.2018.08.009 · Cited by 191 · cited 2×
“Thisdiffers from computational models that propose associative information is integrated locally within the medial temporal lobe via recurrent loops (Kumaran, 2012), but is consistent with evidence showing representation of intermediary cues in the medial temporal lobe at the time of choice (Koster et al., 2018).”
BackgroundResultVTA neurons coordinate with the hippocampal reactivation of spatial experience
Gomperts, S. N., Kloosterman, F., & Wilson, M. A. (2015) · eLife · doi:10.7554/elife.05360 · Cited by 191
Dissociable reward and timing signals in human midbrain and ventral striatum
Klein-Flügge, M. C., Hunt, L. T., Bach, D. R., Dolan, R. J., & Behrens, T. E. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.024 · Cited by 75 · cited 2×
“, 2013) and reward prediction error signals in ventral tegmental area (Klein-Flügge et al., 2011) respectively (Figures S6F and S6G).”
BackgroundMethodSelf-citationRelational Memory: A Daytime Nap Facilitates the Abstraction of General Concepts
Lau, H., Alger, S. E., & Fishbein, W. (2011) · PLoS ONE · doi:10.1371/journal.pone.0027139 · Cited by 75 · cited 1×
“This new understanding of hippocampal SWRs may explain why sleep/ rest facilitates behavioral readouts of insight and inferential reasoning in humans (Coutanche et al., 2013; Ellenbogen et al., 2007; van Kesteren et al., 2010; Lau et al., 2011; Wagner et al., 2004; Werchan and Gómez, 2013).”
Background
Cited by
In vitro neurons learn and exhibit sentience when embodied in a simulated game-world
Kagan, B. J., Kitchen, A. C., Tran, N. T., Habibollahi, F., Khajehnejad, M., Parker, B. J., Bhat, A., Rollo, B., Razi, A., & Friston, K. J. (2022) · Neuron · doi:10.1016/j.neuron.2022.09.001 · Cited by 400
Memory consolidation as an adaptive process
Cowan, E. T., Schapiro, A. C., Dunsmoor, J. E., & Murty, V. P. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01978-x · Cited by 133
Predictive maps in rats and humans for spatial navigation
de Cothi, W., Nyberg, N., Griesbauer, E.-M., Ghanamé, C., Zisch, F., Lefort, J. M., Fletcher, L., Newton, C., Renaudineau, S., Bendor, D., et al. (2022) · Current Biology · doi:10.1016/j.cub.2022.06.090 · Cited by 109
Selective engram coreactivation in idling brain inspires implicit learning
Aly, M. H., Abdou, K., Okubo-Suzuki, R., Nomoto, M., & Inokuchi, K. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2201578119 · Cited by 39
Mental navigation and the neural mechanisms of insight
Aru, J., Drüke, M., Pikamäe, J., & Larkum, M. E. (2023) · Trends in Neurosciences · doi:10.1016/j.tins.2022.11.002 · Cited by 38
Metadata
- Authors
- Barron, H. C., Reeve, H. M., Koolschijn, R. S., Perestenko, P. V., Shpektor, A., Nili, H., Rothaermel, R., Campo-Urriza, N., O’Reilly, J. X., Bannerman, D. M., Behrens, T. E. J., & Dupret, D.
- Venue
- Cell
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 183
- Issue
- 1
- Pages
- 228-243.e21
- ISSN
- 0092-8674 (ISSN-L)
- OpenAlex
- W3070427138
- Cited by
- 179
- References
- 48
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.