Hippocampal Neural Correlates for Values of Experienced Events
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Newly experienced events are often remembered together with how rewarding the experiences are personally. Although the hippocampus is a candidate structure where subjective values are integrated with other elements of episodic memory, it is uncertain whether and how the hippocampus processes value-related information. We examined how activity of dorsal CA1 and dorsal subicular neurons in rats performing a dynamic foraging task was related to reward values that were estimated using a reinforcement learning model. CA1 neurons carried significant signals related to action values before the animal revealed its choice behaviorally, indicating that the information on the expected values of potential choice outcomes was available in CA1. Moreover, after the outcome of the animal's goal choice was revealed, CA1 neurons carried robust signals for the value of chosen action and they temporally overlapped with the signals related to the animal's goal choice and its outcome, indicating that all the signals necessary to evaluate the outcome of an experienced event converged in CA1. On the other hand, value-related signals were substantially weaker in the subiculum. These results suggest a major role of CA1 in adding values to experienced events during episodic memory encoding. Given that CA1 neuronal activity is modulated by diverse attributes of an experienced event, CA1 might be a place where all the elements of episodic memory are integrated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Episodic memory: from mind to brain
Tulving, E. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135114 · Cited by 4,950 · cited 1×
“…activity related to the “when” component of experienced events (Itskov et al., 2011; MacDonald et al., 2011; Naya and Suzuki, 2011), suggesting that CA1 neurons might encode all the elements of episodic (Tulving, 2002) or episodic-like (Clayton and Dickinson, 1998) memory (what, where, and when).”
BackgroundDaw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533 · cited 1×
“Finally, the hippocampus might play an important role in model-based RL, in which values can be updated according to the decision-maker’s knowledge or model of the environment (Sutton and Barto, 1998; Daw et al., 2005; Lee et al., 2012).”
BackgroundRemembering the past to imagine the future: the prospective brain
Schacter, D. L., Addis, D. R., & Buckner, R. L. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2213 · Cited by 2,394 · cited 1×
“…memories (i.e., knowledge on the surrounding world) and also through its role in simulating the possible outcomes of future actions (Hassabis and Maguire, 2007; Johnson and Redish, 2007; Schacter et al., 2007; Luhmann et al., 2008; Buckner, 2010; Peters and Büchel, 2010; Benoit et al., 2011).”
BackgroundThe effects of changes in the environment on the spatial firing of hippocampal complex-spike cells
Muller, R., & Kubie, J. (1987) · The Journal of Neuroscience · doi:10.1523/jneurosci.07-07-01951.1987 · Cited by 1,581
Episodic-like memory during cache recovery by scrub jays
Clayton, N. S., & Dickinson, A. (1998) · Nature · doi:10.1038/26216 · Cited by 1,464 · cited 1×
“…activity related to the “when” component of experienced events (Itskov et al., 2011; MacDonald et al., 2011; Naya and Suzuki, 2011), suggesting that CA1 neurons might encode all the elements of episodic (Tulving, 2002) or episodic-like (Clayton and Dickinson, 1998) memory (what, where, and when).”
BackgroundON TWO TYPES OF DEVIATION FROM THE MATCHING LAW: BIAS AND UNDERMATCHING 1
Baum, W. M. (1974) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1974.22-231 · Cited by 1,460
Deconstructing episodic memory with construction
Hassabis, D., & Maguire, E. A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.05.001 · Cited by 1,229 · cited 1×
“…and semantic memories (i.e., knowledge on the surrounding world) and also through its role in simulating the possible outcomes of future actions (Hassabis and Maguire, 2007; Johnson and Redish, 2007; Schacter et al., 2007; Luhmann et al., 2008; Buckner, 2010; Peters and Büchel, 2010; Benoit et…”
BackgroundHippocampal ‘time cells’ bridge the gap in memory for discontiguous events
MacDonald, C. J., Lepage, K. Q., Eden, U. T., & Eichenbaum, H. (2011) · Neuron · doi:10.1016/j.neuron.2011.07.012 · Cited by 1,193 · cited 1×
“Recent studies also found CA1 neuronal activity related to the “when” component of experienced events (Itskov et al., 2011; MacDonald et al., 2011; Naya and Suzuki, 2011), suggesting that CA1 neurons might encode all the elements of episodic (Tulving, 2002) or episodic-like (Clayton and Dickinson,…”
BackgroundNeural ensembles in CA3 transiently encode paths forward of the animal at a decision point
Johnson, A., & Redish, A. D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3761-07.2007 · Cited by 1,003 · cited 1×
“…memories (i.e., knowledge on the surrounding world) and also through its role in simulating the possible outcomes of future actions (Hassabis and Maguire, 2007; Johnson and Redish, 2007; Schacter et al., 2007; Luhmann et al., 2008; Buckner, 2010; Peters and Büchel, 2010; Benoit et al., 2011).”
BackgroundReward-motivated learning: mesolimbic activation precedes memory formation
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.036 · Cited by 977
Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval
Carr, M. F., Jadhav, S. P., & Frank, L. M. (2011) · Nature Neuroscience · doi:10.1038/nn.2732 · Cited by 958
Peters, J., & Büchel, C. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.026 · Cited by 871 · cited 1×
“…memories (i.e., knowledge on the surrounding world) and also through its role in simulating the possible outcomes of future actions (Hassabis and Maguire, 2007; Johnson and Redish, 2007; Schacter et al., 2007; Luhmann et al., 2008; Buckner, 2010; Peters and Büchel, 2010; Benoit et al., 2011).”
BackgroundPrediction of immediate and future rewards differentially recruits cortico-basal ganglia loops
Tanaka, S. C., Doya, K., Okada, G., Ueda, K., Okamoto, Y., & Yamawaki, S. (2004) · Nature Neuroscience · doi:10.1038/nn1279 · Cited by 779 · cited 1×
“Moreover, BOLD signals in the hippocampus were correlated with state value (reward prediction in a Markov decision task) (Tanaka et al., 2004) as well as prediction error that was computed with an RL model in probabilistic learning tasks (Dickerson et al., 2011; Foerde and Shohamy, 2011).”
MethodBoundary Vector Cells in the Subiculum of the Hippocampal Formation
Lever, C., Burton, S., Jeewajee, A., O'Keefe, J., & Burgess, N. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1319-09.2009 · Cited by 753
Roitman, M. F., Wheeler, R. A., & Carelli, R. M. (2005) · Neuron · doi:10.1016/j.neuron.2004.12.055 · Cited by 453
A neural mechanism mediating the impact of episodic prospection on farsighted decisions
Benoit, R. G., Gilbert, S. J., & Burgess, P. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.6559-10.2011 · Cited by 422
The Role of the Hippocampus in Prediction and Imagination
Buckner, R. L. (2010) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163508 · Cited by 419 · cited 1×
“…memories (i.e., knowledge on the surrounding world) and also through its role in simulating the possible outcomes of future actions (Hassabis and Maguire, 2007; Johnson and Redish, 2007; Schacter et al., 2007; Luhmann et al., 2008; Buckner, 2010; Peters and Büchel, 2010; Benoit et al., 2011).”
BackgroundMoita, M. A. P., Rosis, S., Zhou, Y., LeDoux, J. E., & Blair, H. T. (2003) · Neuron · doi:10.1016/s0896-6273(03)00033-3 · Cited by 295
Integrating what and when across the primate medial temporal lobe
Naya, Y., & Suzuki, W. A. (2011) · Science · doi:10.1126/science.1206773 · Cited by 257 · cited 1×
“Recent studies also found CA1 neuronal activity related to the “when” component of experienced events (Itskov et al., 2011; MacDonald et al., 2011; Naya and Suzuki, 2011), suggesting that CA1 neurons might encode all the elements of episodic (Tulving, 2002) or episodic-like (Clayton and Dickinson,…”
BackgroundPutting Fear in Its Place: Remapping of Hippocampal Place Cells during Fear Conditioning
Moita, M. A. P., Rosis, S., Zhou, Y., LeDoux, J. E., & Blair, H. T. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5492-03.2004 · Cited by 251 · cited 1×
“…(see Introduction, above) and aversive stimuli (Segal et al., 1972; Berger et al., 1976, 1983; McEchron and Disterhoft, 1997; Múnera et al., 2001; Moita et al., 2003, 2004) are among the nonspatial factors that have been shown to modulate CA1 neuronal activity, suggesting that affective…”
BackgroundResistance to forgetting associated with hippocampus-mediated reactivation during new learning
Kuhl, B. A., Shah, A. T., DuBrow, S., & Wagner, A. D. (2010) · Nature Neuroscience · doi:10.1038/nn.2498 · Cited by 225 · cited 2×
“For example, the hippocampus might play an important role in associating value information with event information so that the retrieval of a memory for a previously experienced event will automatically entail the retrieval of its associated value (cf. Kuhl et al., 2010).”
BackgroundDeclarative memory is critical for sustained advantageous complex decision-making
Gupta, R., Duff, M. C., Denburg, N. L., Cohen, N. J., Bechara, A., & Tranel, D. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.02.007 · Cited by 145 · cited 1×
“There also exists evidence that patients with bilateral hippocampal damages are impaired in making decisions adaptively (Gutbrod et al., 2006; Gupta et al., 2009).”
Background
Cited by
Spatial goal coding in the hippocampal formation
Nyberg, N., Duvelle, É., Barry, C., & Spiers, H. J. (2022) · Neuron · doi:10.1016/j.neuron.2021.12.012 · Cited by 141
Do hippocampal pyramidal cells respond to nonspatial stimuli?
O’Keefe, J., & Krupic, J. (2021) · Physiological Reviews · doi:10.1152/physrev.00014.2020 · Cited by 93
Effects of prospective thinking on intertemporal choice: the role of familiarity
Sasse, L. K., Peters, J., Büchel, C., & Brassen, S. (2015) · Human Brain Mapping · doi:10.1002/hbm.22912 · Cited by 54
Palombo, D. J., Keane, M. M., & Verfaellie, M. (2016) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2016.07.002 · Cited by 43
Metadata
- Authors
- Lee, H., Ghim, J.-W., Kim, H., Lee, D., & Jung, M.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2012-10-24
- Volume
- 32
- Issue
- 43
- Pages
- 15053-15065
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1966712471
- Cited by
- 79
- References
- 22
- FWCI
- 2.30
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.