The Cognitive Neuroscience of Motivation and Learning
The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Abstract
Recent advances in the cognitive neuroscience of motivation and learning have demonstrated a critical role for midbrain dopamine and its targets in reward prediction. Converging evidence suggests that midbrain dopamine neurons signal a reward prediction error, allowing an organism to predict, and to act to increase, the probability of reward in the future. This view has been highly successful in accounting for a wide range of reinforcement learning phenomena in animals and humans. However, while current theories of midbrain dopamine provide a good account of behavior known as habitual or stimulus-response learning, we review evidence suggesting that other neural and cognitive processes are involved in motivated, goal-directed behavior. We discuss how this distinction resembles the classic distinction in the cognitive neuroscience of memory between nondeclarative and declarative memory systems, and discuss common themes between mnemonic and motivational functions. Finally, we present data demonstrating links between mnemonic processes and reinforcement learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The functional anatomy of basal ganglia disorders
Albin, R. L., Young, A. B., & Penney, J. B. (1989) · Trends in Neurosciences · doi:10.1016/0166-2236(89)90074-x · Cited by 5,353
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148 · cited 1×
“The temporaldifference learning algorithm (Sutton, 1988) that appears to explain the dopamine response generalizes that model essentially by chaining predictions backward in time.”
MethodReflective and Impulsive Determinants of Social Behavior
Strack, F., & Deutsch, R. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0803_1 · Cited by 3,984 · cited 2×
“…between apparently different sorts of learning have also been reported in behavioral studies in the domain of social psychology , where two-system accounts of behavior at least superficially reminiscent to those discussed here are also popular (e.g., Lieberman, 2003; Strack & Deutsch, 2004).”
BackgroundMethodPrimate models of movement disorders of basal ganglia origin
DeLong, M. R. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90110-v · Cited by 3,824
Neural systems of reinforcement for drug addiction: from actions to habits to compulsion
Everitt, B. J., & Robbins, T. W. (2005) · Nature Neuroscience · doi:10.1038/nn1579 · Cited by 3,785 · cited 1×
“…role for dopamine and its targets in stimulus-response learning (Gabrieli, 1998; Knowlton, Mangels, & Squire, 1996; White, 1997), addiction (Everitt & Robbins, 2005; Hyman, Malenka, & Nestler, 2006), and movement (Albin, Young, & Penney, 1989; DeLong, 1990), these theories suggested the…”
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547
Separate neural systems value immediate and delayed monetary rewards
McClure, S. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2004) · Science · doi:10.1126/science.1100907 · Cited by 3,089
Buckner, R. L., & Carroll, D. C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.11.004 · Cited by 2,691
Daw, N. D., Niv, Y., & Dayan, P. (2005) · Nature Neuroscience · doi:10.1038/nn1560 · Cited by 2,533
Self-citationThe debate over dopamine’s role in reward: the case for incentive salience
Berridge, K. C. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0578-x · Cited by 2,347
Cited by
Baayen, R. H., Milin, P., Đurđević, D. F., Hendrix, P., & Marelli, M. (2011) · Psychological Review · doi:10.1037/a0023851 · Cited by 595
“The parallel dual route models of Frauenfelder and Schreuder (1992); Schreuder and Baayen (1995); Baayen et al.”
MethodIntegrating Memories in the Human Brain: Hippocampal-Midbrain Encoding of Overlapping Events
Shohamy, D., & Wagner, A. D. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.023 · Cited by 539
Self-citationAction, Outcome, and Value: A Dual-System Framework for Morality
Cushman, F. (2013) · Personality and Social Psychology Review · doi:10.1177/1088868313495594 · Cited by 473
VBA: A Probabilistic Treatment of Nonlinear Models for Neurobiological and Behavioural Data
Daunizeau, J., Adam, V., & Rigoux, L. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003441 · Cited by 385
“These measures have been used to demonstrate how value changes as people learn a new operant response [19].”
BackgroundMechanisms of motivation–cognition interaction: challenges and opportunities
Braver, T. S., Krug, M. K., Chiew, K. S., Kool, W., Westbrook, J. A., Clement, N. J., Adcock, R. A., Barch, D. M., Botvinick, M. M., Carver, C. S., et al. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0300-0 · Cited by 391
When Does Model-Based Control Pay Off?
Kool, W., Cushman, F. A., & Gershman, S. J. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005090 · Cited by 211
“Control shifts to the model-free system with extensive experience [57], under cognitive load [22], and after the induction of stress [23, 28].”
MethodPain, decisions, and actions: a motivational perspective
Wiech, K., & Tracey, I. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00046 · Cited by 188
“If the behavior is goal-directed (or “model-based,” see Daw and Shohamy, 2008 for details), it could be targeted by challenging its underlying beliefs—an approach that is, for instance, indicated when avoidance behavior is driven by exaggerated irrational beliefs.”
BackgroundGeneralization of value in reinforcement learning by humans
Wimmer, G. E., Daw, N. D., & Shohamy, D. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2012.08017.x · Cited by 111
“Accordingly (following previous work: Daw et al., 2006; Schönberg et al., 2007; Gershman et al., 2009), we generated regressors for each participant using a single setting of the reinforcement learning model’s free parameters, here taken as the mean over all participants of the best-fitting…”
BackgroundMethodResultInfluentialSelf-citationEckstein, M. K., Summerfield, C., Daw, N. D., & Miller, K. J. (2023) · doi:10.1101/2023.05.17.541226 · Cited by 18
Self-citation
Metadata
- Authors
- Daw, N. D., & Shohamy, D.
- Venue
- Social Cognition
- Publisher
- Guilford Publications
- Published
- 2008-10
- Volume
- 26
- Issue
- 5
- Pages
- 593-620
- ISSN
- 0278-016X (ISSN-L)
- OpenAlex
- W2047124157
- Cited by
- 102
- References
- 72
- FWCI
- 0.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.