More Than the Sum of Its Parts: A Role for the Hippocampus in Configural Reinforcement Learning
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Summary People often perceive configurations rather than the elements they are made of, a bias that may emerge because configurations often predict behaviorally relevant outcomes. Yet, little is known about how the brain learns to associate configurations with outcomes and how this learning differs from learning about individual elements. We combined behavior, reinforcement learning models and functional imaging in humans to understand how people learn to associate configurations of cues with outcomes. We found that configural learning varied based on the relative predictive strength of elements vs. configurations and was related to both the strength of BOLD activity in the hippocampus and patterns of hippocampal BOLD responses. Configural learning was further related to functional connectivity between the hippocampus and the nucleus accumbens. Moreover, configural learning was associated with flexible knowledge about cue-outcome associations and with differential eye movements during choice behavior. Together, these findings demonstrate that configural learning is associated with a distinct computational, cognitive and neural profile that is well-suited to support flexible and adaptive behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A component based noise correction method (CompCor) for BOLD and perfusion based fMRI
Behzadi, Y., Restom, K., Liau, J., & Liu, T. T. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.042 · Cited by 4,502
Forest before trees: The precedence of global features in visual perception
Navon, D. (1977) · Cognitive Psychology · doi:10.1016/0010-0285(77)90012-3 · Cited by 4,005 · cited 2×
“This strategy is consistent with the observation that people and animals tend to perceive configurations rather than cues (Kimchi, 1994; Navon, 1977) and that combinations of cues are treated differently from the sum of their elements (Pearce, 1987, 1994; Rudy and Sutherland, 1995).”
Methods to detect, characterize, and remove motion artifact in resting state fMRI
Power, J. D., Mitra, A., Laumann, T. O., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.048 · Cited by 3,748
Large-scale automated synthesis of human functional neuroimaging data.
Yarkoni, T., Poldrack, R. A., Nichols, T. E., Van Essen, D. C., & Wager, T. D. (2011) · Nature Methods · doi:10.1038/nmeth.1635 · Cited by 3,686
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Simple memory: a theory for archicortex
Marr, D. (1971) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1971.0078 · Cited by 2,771 · cited 1×
“…the need to separate overlapping conditions for reinforcement learning parallels a similar requirement for interference reduction in hippocampal-dependent memory, namely, pattern separation between memories with overlapping elements (Marr, 1971; Norman and O’Reilly, 2003; Treves and Rolls, 1992).”
BackgroundThe Medial Temporal Lobe and Recognition Memory
Eichenbaum, H., Yonelinas, A. P., & Ranganath, C. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.30.051606.094328 · Cited by 2,580
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 3×
“The nucleus accumbens is known to play an important role in updating value in reinforcement learning (O’Doherty et al., 2004), and it also has strong anatomical connections with the anterior/ventral hippocampus (Groenewegen et al., 1987; Kelley and Domesick, 1982).”
BackgroundMerging the senses into a robust percept
Ernst, M. O., & Bülthoff, H. H. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.02.002 · Cited by 1,906
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Cited by
Radulescu, A., Shin, Y. S., & Niv, Y. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-092920-120559 · Cited by 63
Parr, A. C., Calabro, F., Larsen, B., Tervo-Clemmens, B., Elliot, S., Foran, W., Olafsson, V., & Luna, B. (2021) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2021.101997 · Cited by 60
Mahmoodi, A., Luo, S., Harbison, C., Piray, P., & Rushworth, M. F. S. (2024) · Neuron · doi:10.1016/j.neuron.2024.09.001 · Cited by 17
Metadata
- Authors
- Duncan, K., Doll, B. B., Daw, N. D., & Shohamy, D.
- Venue
- Neuron
- Publisher
- Elsevier BV
- Published
- 2018-05
- Volume
- 98
- Issue
- 3
- Pages
- 645-657.e6
- ISSN
- 0896-6273 (ISSN-L)
- OpenAlex
- W2800394030
- Cited by
- 75
- References
- 32
- FWCI
- 4.01
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.