Reward revaluation biases hippocampal replay content away from the preferred outcome
Open accessPublished version of a preprint
The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
The rodent hippocampus spontaneously generates bursts of neural activity (replay) that can depict spatial trajectories to reward locations, suggesting a role in model-based behavioral control. A largely separate literature emphasizes reward revaluation as the litmus test for such control, yet the content of hippocampal replay under revaluation conditions is unknown. We examined the content of awake replay events following motivational shifts between hunger and thirst. On a T-maze offering free choice between food and water outcomes, rats shifted their behavior toward the restricted outcome, but replay content was shifted away from the restricted outcome. This effect preceded experience on the task each day and did not reverse with experience. These results demonstrate that replay content is not limited to reflecting recent experience or trajectories toward the preferred goal and suggest a role for motivational states in determining replay content. Given a choice between food and water outcomes on a T-maze, rats preferred the outcome they did not have access to overnight, yet the content of awake hippocampal replay was consistently shifted away from the preferred outcome.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“representations of rewarded spatial locations are preferentially reactivated in both wake and sleep states, 80,81,[142][143][144] although there are also findings of a bias of reactivations in the opposite direction.”
From Sleep—A brain-state serving systems memory consolidation (2023) · cites this paper as [145]
Citations
Cites
Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 3,001
Hippocampal sharp wave-ripple: A cognitive biomarker for episodic memory and planning
Buzsáki, G. (2015) · Hippocampus · doi:10.1002/hipo.22488 · Cited by 1,759
Reverse replay of behavioural sequences in hippocampal place cells during the awake state
Foster, D. J., & Wilson, M. A. (2006) · Nature · doi:10.1038/nature04587 · Cited by 1,727
Goal-directed instrumental action: contingency and incentive learning and their cortical substrates
Balleine, B. W., & Dickinson, A. (1998) · Neuropharmacology · doi:10.1016/s0028-3908(98)00033-1 · Cited by 1,541
Hippocampal place-cell sequences depict future paths to remembered goals
Pfeiffer, B. E., & Foster, D. J. (2013) · Nature · doi:10.1038/nature12112 · Cited by 1,216
Temporally structured replay of awake hippocampal ensemble activity during rapid eye movement sleep
Louie, K., & Wilson, M. A. (2001) · Neuron · doi:10.1016/s0896-6273(01)00186-6 · Cited by 1,148
The hippocampus as a predictive map
Stachenfeld, K. L., Botvinick, M. M., & Gershman, S. J. (2017) · Nature Neuroscience · doi:10.1038/nn.4650 · Cited by 1,000
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval
Carr, M. F., Jadhav, S. P., & Frank, L. M. (2011) · Nature Neuroscience · doi:10.1038/nn.2732 · Cited by 958
Awake hippocampal sharp-wave ripples support spatial memory
Jadhav, S. P., Kemere, C., German, P. W., & Frank, L. M. (2012) · Science · doi:10.1126/science.1217230 · Cited by 924
Cited by
Sleep—A brain-state serving systems memory consolidation
Brodt, S., Inostroza, M., Niethard, N., & Born, J. (2023) · Neuron · doi:10.1016/j.neuron.2023.03.005 · Cited by 343
Deep reinforcement learning and its neuroscientific implications
Botvinick, M., Wang, J. X., Dabney, W., Miller, K. J., & Kurth-Nelson, Z. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.014 · Cited by 269
“While early deep RL systems replayed experience uniformly, replay in the brain is not uniform (Mattar & Daw, 2018; Gershman & Daw, 2017; Gupta et al., 2010; Carey et al., 2019), and non-uniformity has been explored in machine learning as a way to enhance learning (Schaul et al., 2015).”
Hippocampal replay reflects specific past experiences rather than a plan for subsequent choice
Gillespie, A. K., Astudillo Maya, D. A., Denovellis, E. L., Liu, D. F., Kastner, D. B., Coulter, M. E., Roumis, D. K., Eden, U. T., & Frank, L. M. (2021) · Neuron · doi:10.1016/j.neuron.2021.07.029 · Cited by 194
What Are Memories For? The Hippocampus Bridges Past Experience with Future Decisions
Biderman, N., Bakkour, A., & Shohamy, D. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.04.004 · Cited by 175
“Indeed, the dynamic integration of events across time and space is evident across many different kinds of behaviors, from shortcut learning in spatial navigation [62], to acquired equivalence [52,63], transitive inference [64–66], learning of latent structure [57,67], odor sequence learning [68,69], reward revaluation…”
BackgroundAssociative and predictive hippocampal codes support memory-guided behaviors
Liu, C., Todorova, R., Tang, W., Oliva, A., & Fernández‐Ruiz, A. (2023) · Science · doi:10.1126/science.adi8237 · Cited by 155
“…views of hippocampal function, including encoding cognitive maps for spatial and episodic memory ( 68 – 70 ), predictive maps for flexible navigation and planning ( 10 , 16 , 17 ), and multimodal memory representations for relational processing ( 18 , 71 ). paths not yet taken ( 77 , 78 ).”
Background
Metadata
- Authors
- Carey, A. A., Tanaka, Y., & van der Meer, M. A. A.
- Affiliations
- Dartmouth College (US)
- Venue
- Nature Neuroscience
- Published
- 2019-08-19
- Volume
- 22
- Issue
- 9
- Pages
- 1450-1459
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2969743374
- Semantic Scholar
- 4900a2205af4daa6eb896c85dd68dc61594c2439
- Cited by
- 106
- References
- 50
- Citations by year
- 2026: 8 · 2025: 17 · 2024: 15 · 2023: 21 · 2022: 10 · 2021: 16 · 2020: 16 · 2019: 3
- FWCI
- 6.55
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nd
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Neuroscience (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nd)
- PubMed (publishedVersion)
- Funders
- Human Frontier Science Program (RGY0088/2014)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Sleep and Wakefulness Research
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- hippocampal replay, motivational states, hunger, thirst, model-based control, freedom of choice, outcome preferences, T-maze, rats
- MeSH terms
- Animals, Behavior, Animal, Hippocampus, Male, Motivation, Reward, Rats, Long-Evans, Rats
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reward revaluation biases hippocampal replay content away from the preferred outcome. https://app.cochat.ai/papers/10.1038/s41593-019-0464-6
- The paper
- Carey, A. A., Tanaka, Y., & van der Meer, M. A. A. (2019). Reward revaluation biases hippocampal replay content away from the preferred outcome. Nature Neuroscience. https://doi.org/10.1038/s41593-019-0464-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.