Dissociating hippocampal and striatal contributions to sequential prediction learning
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
Behavior may be generated on the basis of many different kinds of learned contingencies. For instance, responses could be guided by the direct association between a stimulus and response, or by sequential stimulus–stimulus relationships (as in model‐based reinforcement learning or goal‐directed actions). However, the neural architecture underlying sequential predictive learning is not well understood, in part because it is difficult to isolate its effect on choice behavior. To track such learning more directly, we examined reaction times (RTs) in a probabilistic sequential picture identification task in healthy individuals. We used computational learning models to isolate trial‐by‐trial effects of two distinct learning processes in behavior, and used these as signatures to analyse the separate neural substrates of each process. RTs were best explained via the combination of two delta rule learning processes with different learning rates. To examine neural manifestations of these learning processes, we used functional magnetic resonance imaging to seek correlates of time‐series related to expectancy or surprise. We observed such correlates in two regions, hippocampus and striatum. By estimating the learning rates best explaining each signal, we verified that they were uniquely associated with one of the two distinct processes identified behaviorally. These differential correlates suggest that complementary anticipatory functions drive each region’s effect on behavior. Our results provide novel insights as to the quantitative computational distinctions between medial temporal and basal ganglia learning networks and enable experiments that exploit trial‐by‐trial measurement of the unique contributions of both hippocampus and striatum to response behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995) · Psychological Review · doi:10.1037/0033-295x.102.3.419 · Cited by 5,256 · cited 2×
“encoding (McClelland et al., 1995), and striatum with more incremental procedural learning (Knowlton et al.”
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089 · cited 3×
“…are unlikely to relate to the reward prediction errors posited by these models (Delgado et al., 2000; Knutson et al., 2001; O’Doherty et al., 2003; McClure et al., 2004; Hare et al., 2008), but could relate to other non-reward correlates in striatum (Zink et al., 2006; Wittmann et al., 2008).”
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationAnticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens
Knutson, B., Adams, C. M., Fong, G. W., & Hommer, D. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-16-j0002.2001 · Cited by 2,244
A framework for studying the neurobiology of value-based decision making
Rangel, A., Camerer, C., & Montague, P. R. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2357 · Cited by 2,184 · cited 3×
“learning (Doya, 1999; Daw et al., 2005; Niv et al., 2006; Johnson and Redish 2005; Rangel et al., 2008; Balleine et al., 2008; Doll et al., 2009) and also known as constructive episodic simulation (Tulving &”
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“In particular, whereas much work has examined the brain’s mechanisms for ‘model-free’ reinforcement learning (RL) of action policies (Houk et al., 1995; Montague et al., 1996), decisions may also be evaluated by anticipating their consequences using learned predictive associations among…”
Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983 · cited 1×
“…that hippocampus forms associations preferentially at the detection of sufficiently large deviations from expected input (Tulving et al., 1996; Lisman & Grace, 2005; Bakker et al., 2008), or when task demands enhance the motivational salience of expectancy violations (Duncan et al., 2009).”
The cognitive neuroscience of constructive memory: remembering the past and imagining the future
Schacter, D. L., & Addis, D. R. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2007.2087 · Cited by 1,836 · cited 1×
“…a strategy formalized by model-based reinforcement learning (Doya, 1999; Daw et al., 2005; Niv et al., 2006; Johnson and Redish 2005; Rangel et al., 2008; Balleine et al., 2008; Doll et al., 2009) and also known as constructive episodic simulation (Tulving & Thomson, 1971; Schacter & Addis, 2007).”
Cited by
Domain generality versus modality specificity: the paradox of statistical learning
Frost, R., Armstrong, B. C., Siegelman, N., & Christiansen, M. H. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.010 · Cited by 564
Schapiro, A. C., Turk-Browne, N. B., Botvinick, M. M., & Norman, K. A. (2017) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2016.0049 · Cited by 487
The ubiquity of model-based reinforcement learning
Doll, B. B., Simon, D. A., & Daw, N. D. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.08.003 · Cited by 380
Self-citationOver the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex
Wikenheiser, A. M., & Schoenbaum, G. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.56 · Cited by 359
How the hippocampus preserves order: the role of prediction and context
Davachi, L., & DuBrow, S. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.12.004 · Cited by 328
Metadata
- Authors
- Bornstein, A. M., & Daw, N. D.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2012-04
- Volume
- 35
- Issue
- 7
- Pages
- 1011-1023
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2143963089
- Cited by
- 124
- References
- 54
- FWCI
- 4.61
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dissociating hippocampal and striatal contributions to sequential prediction learning. https://app.cochat.ai/papers/10.1111/j.1460-9568.2011.07920.x
- The paper
- Bornstein, A. M., & Daw, N. D. (2012). Dissociating hippocampal and striatal contributions to sequential prediction learning. European Journal of Neuroscience. https://doi.org/10.1111/j.1460-9568.2011.07920.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.