Parallel contributions of distinct human memory systems during probabilistic learning
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Regions within the medial temporal lobe and basal ganglia are thought to subserve distinct memory systems underlying declarative and nondeclarative processes, respectively. One question of interest is how these multiple memory systems interact during learning to contribute to goal directed behavior. While some hypotheses suggest that regions such as the striatum and the hippocampus interact in a competitive manner, alternative views posit that these structures may operate in a parallel manner to facilitate learning. In the current experiment, we probed the functional connectivity between regions in the striatum and hippocampus in the human brain during an event related probabilistic learning task that varied with respect to type of difficulty (easy or hard cues) and type of learning (via feedback or observation). We hypothesized that the hippocampus and striatum would interact in a parallel manner during learning. We identified regions of interest (ROI) in the striatum and hippocampus that showed an effect of cue difficulty during learning and found that such ROIs displayed a similar pattern of blood oxygen level dependent (BOLD) responses, irrespective of learning type, and were functionally correlated as assessed by a Granger causality analysis. Given the connectivity of both structures with dopaminergic midbrain centers, we further applied a reinforcement learning algorithm often used to highlight the role of dopamine in human reward related learning paradigms. Activity in both the striatum and hippocampus positively correlated with a prediction error signal during feedback learning. These results suggest that distinct human memory systems operate in parallel during probabilistic learning, and may act synergistically particularly when a violation of expectation occurs, to jointly contribute to learning and decision making.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 2×
“However, it has been shown in the literature that the dorsal striatum is active during instrumental tasks (O'Doherty et al., 2004) and its BOLD signals are modulated by action contingency (Tricomi et al., 2004).”
Measurement of Linear Dependence and Feedback between Multiple Time Series
Geweke, J. (1982) · Journal of the American Statistical Association · doi:10.1080/01621459.1982.10477803 · Cited by 2,060
The hippocampal-VTA loop: controlling the entry of information into long-term memory
Lisman, J. E., & Grace, A. A. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.002 · Cited by 1,983
Basal ganglia and cerebellar loops: motor and cognitive circuits
Middleton, F. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00040-5 · Cited by 1,940 · cited 1×
“It is perhaps not surprising, given the multifunctionality and connectivity of the striatum (Middleton and Strick, 2000a,b; Pennartz et al., 2009) that different voxels would be sensitive to the type of learning or level of difficulty.”
Swanson, L. W. (1982) · Brain Research Bulletin · doi:10.1016/0361-9230(82)90145-9 · Cited by 1,718
Learning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 2×
“Evidence for this type of interaction has been observed in animal research (Lee et al., 2008; Packard and Knowlton, 2002; Packard and McGaugh, 1996) and supported by several human functional magnetic resonance imaging (fMRI) studies of probabilistic learning (Foerde et al.”
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · cited 2×
“A component of reinforcement learning models (Barto, 1995; Rescorla and Wagner, 1972), such prediction error signals typically correlate with activity in dopaminergic targets in the human brain, primarily in the striatum (e.g., McClure et al., 2003; O'Doherty et al., 2003).”
The primate basal ganglia: Parallel and integrative networks
Haber, S. N. (2003) · Journal of Chemical Neuroanatomy · doi:10.1016/j.jchemneu.2003.10.003 · Cited by 1,479 · cited 4×
“, 2003), and it has been suggested that the ventral striatum may influence the dorsal striatum via multiple spiral loops which exist between the striatum and the midbrain dopaminergic centers (Haber, 2003; Heimer et al., 1997).”
InfluentialStructure and function of declarative and nondeclarative memory systems
Squire, L. R., & Zola, S. M. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.24.13515 · Cited by 1,327 · cited 2×
“…across species suggesting that the medial temporal lobes (MTL), in particular the hippocampus, are involved in declarative learning while the basal ganglia (BG) system, primarily the striatum, supports nondeclarative learning (Sherry and Schacter, 1987; Squire, 1992; Squire and Zola, 1996).”
Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory
Squire, L. R. (1992) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1992.4.3.232 · Cited by 1,282 · cited 2×
“…across species suggesting that the medial temporal lobes (MTL), in particular the hippocampus, are involved in declarative learning while the basal ganglia (BG) system, primarily the striatum, supports nondeclarative learning (Sherry and Schacter, 1987; Squire, 1992; Squire and Zola, 1996).”
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Goebel, R., Esposito, F., & Formisano, E. (2006) · Human Brain Mapping · doi:10.1002/hbm.20249 · Cited by 1,053 · cited 1×
“Unless otherwise noted, for all SPMs generated during learning phase analyses, a correction formultiple comparisonswas employedvia the cluster level statistical threshold estimator plugin in the BrainVoyager analysis package (Forman et al., 1995; Goebel et al., 2006).”
Reward-motivated learning: mesolimbic activation precedes memory formation
Adcock, R. A., Thangavel, A., Whitfield-Gabrieli, S., Knutson, B., & Gabrieli, J. D. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.036 · Cited by 977
Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · cited 3×
“Thus, the use of a reinforcement learning model during feedback learning engaged the typically reported prediction error signals in the striatum (Abler et al., 2006; McClure et al., 2003; Pagnoni et al., 2002), while also engaging the hippocampus, which has been more often associated with mismatch signals (Ploghaus et…”
Competition among multiple memory systems: converging evidence from animal and human brain studies
Poldrack, R. A., & Packard, M. G. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00157-4 · Cited by 880
Reward‐Related Responses in the Human Striatum
DELGADO, M. R. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.002 · Cited by 736
Self-citationWittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H.-J., & Düzel, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.01.010 · Cited by 698 · cited 4×
“…been typically associated with striatal function (for review see Schultz, 2002), also facilitates long term memory formation in humans, which is more traditionally associated with hippocampal function (Adcock et al., 2006; Shohamy and Adcock, 2010; Shohamy and Wagner, 2008; Wittmann et al., 2005).”
InfluentialGuidelines for reporting an fMRI study
Poldrack, R. A., Fletcher, P. C., Henson, R. N., Worsley, K. J., Brett, M., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.048 · Cited by 550 · cited 3×
“Any ROIs which did not withstand correction are clearly labeled and should be interpreted with caution (Poldrack et al., 2008).”
InfluentialAbsolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Bunzeck, N., & Düzel, E. (2006) · Neuron · doi:10.1016/j.neuron.2006.06.021 · Cited by 503
Activity in human ventral striatum locked to errors of reward prediction
Pagnoni, G., Zink, C. F., Montague, P. R., & Berns, G. S. (2002) · Nature Neuroscience · doi:10.1038/nn802 · Cited by 451
Prediction error as a linear function of reward probability is coded in human nucleus accumbens
Abler, B., Walter, H., Erk, S., Kammerer, H., & Spitzer, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.001 · Cited by 376 · cited 2×
“Thus, the use of a reinforcement learning model during feedback learning engaged the typically reported prediction error signals in the striatum (Abler et al., 2006; McClure et al., 2003; Pagnoni et al., 2002), while also engaging the hippocampus, which has been more often associated with mismatch…”
Origin of dopaminergic innervation of the rat hippocampal formation
Scatton, B., Simon, H., Le Moal, M., & Bischoff, S. (1980) · Neuroscience Letters · doi:10.1016/0304-3940(80)90314-6 · Cited by 323 · cited 1×
“Midbrain dopaminergic neurons are believed to project to both the striatum and the hippocampus (Lynd-Balta and Haber, 1994; Scatton et al., 1980) and contribute to learning and memory processes (Lisman and Grace, 2005).”
Corticostriatal Interactions during Learning, Memory Processing, and Decision Making
Pennartz, C. M. A., Berke, J. D., Graybiel, A. M., Ito, R., Lansink, C. S., van der Meer, M., Redish, A. D., Smith, K. S., & Voorn, P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3177-09.2009 · Cited by 213
Learning arbitrary visuomotor associations: temporal dynamic of brain activity
Toni, I., Ramnani, N., Josephs, O., Ashburner, J., & Passingham, R. E. (2001) · NeuroImage · doi:10.1006/nimg.2001.0894 · Cited by 210 · cited 2×
“These results complement the visuomotor learning and simple association learning literature, which suggests that the medial temporal lobe and basal ganglia may be online simultaneously and are involved in learning arbitrary visuomotor associations (Amso et al., 2005; Haruno and Kawato, 2006; Law et al., 2005; Toni et…”
Cited by
Supekar, K., Swigart, A. G., Tenison, C., Jolles, D. D., Rosenberg-Lee, M., Fuchs, L., & Menon, V. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1222154110 · Cited by 268
Mechanisms for widespread hippocampal involvement in cognition.
Shohamy, D., & Turk-Browne, N. B. (2013) · Journal of Experimental Psychology: General · doi:10.1037/a0034461 · Cited by 187
Generalization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111
“…not often been reported in previous studies of reward learning and decision-making, but this finding is consistent with several more recent reports of value encoding in the hippocampus in categorization and passive viewing tasks (Kumaran et al., 2009; Lebreton et al., 2009; Dickerson et al., 2011).”
ResultSocial rewards and social networks in the human brain
Fareri, D. S., & Delgado, M. R. (2014) · The Neuroscientist · doi:10.1177/1073858414521869 · Cited by 124
“As such, a complementary question is whether the valuation of social outcomes, or social rewards, relies on neural structures implicated in coding the value of primary and secondary non-social rewards, and how members of one’s social network may further influence reward valuation processes.”
BackgroundSelf-citationPrediction errors disrupt hippocampal representations and update episodic memories
Sinclair, A. H., Manalili, G. M., Brunec, I. K., Adcock, R. A., & Barense, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2117625118 · Cited by 121
Metadata
- Authors
- Dickerson, K. C., Li, J., & Delgado, M. R.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2011-03
- Volume
- 55
- Issue
- 1
- Pages
- 266-276
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2037858735
- Cited by
- 92
- References
- 26
- FWCI
- 4.89
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.