The dorsomedial striatum encodes net expected return, critical for energizing performance vigor
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Decision making requires an actor to not only steer behavior toward specific goals but also determine the optimal vigor of performance. Current research and models have largely focused on the former problem of how actions are directed while overlooking the latter problem of how they are energized. Here we designed a self-paced decision-making paradigm, which showed that rats' performance vigor globally fluctuates with the net value of their options, suggesting that they maintain long-term estimates of the value of their current state. Lesions of the dorsomedial striatum (DMS) and, to a lesser degree, in the ventral striatum impaired such state-dependent modulation of vigor, rendering vigor to depend more exclusively on the outcomes of immediately preceding trials. The lesions, however, spared choice biases. Neuronal recordings showed that the DMS is enriched in net value–coding neurons. In sum, the DMS encodes one's net expected return, which drives the general motivation to perform.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ferster, C. B., & Skinner, B. F. (1957) · doi:10.1037/10627-000 · Cited by 4,894
From motivation to action: Functional interface between the limbic system and the motor system
MOGENSON, G., JONES, D., & YIM, C. (1980) · Progress in Neurobiology · doi:10.1016/0301-0082(80)90018-0 · Cited by 2,331 · cited 2×
“Historically, the striatum, particularly the VS has been linked to motivation 18,19 , although other studies implicate the role of dorsal striatum in motivation 20–22 .”
Tonic dopamine: Opportunity costs and the control of response vigor
Niv, Y., Daw, N. D., Joel, D., & Dayan, P. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0502-4 · Cited by 1,133 · cited 3×
“Alternatively, the normative theory of motivation would predict that the `vigor' of grooming or other activities outside the task is also slowed down during the period of low-net value, similar to trial initiation time in the task 4 .”
InfluentialThe role of the dorsomedial striatum in instrumental conditioning
Yin, H. H., Ostlund, S. B., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04218.x · Cited by 1,099
Kelley, A. E. (2004) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2003.11.015 · Cited by 942
Representation of Action-Specific Reward Values in the Striatum
Samejima, K., Ueda, Y., Doya, K., & Kimura, M. (2005) · Science · doi:10.1126/science.1115270 · Cited by 939 · cited 4×
“Although this hypothesis comes from the finding that neurons in DMS (including the anterior-to mid-caudate) encode values of specific actions (absolute value) 15,16 , our results show that net value representation in the DMS is more enriched than previously thought.”
InfluentialThe Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928
Volkow, N. D., Wang, G., Fowler, J. S., Logan, J., Jayne, M., Franceschi, D., Wong, C., Gatley, S. J., Gifford, A. N., Ding, Y., et al. (2002) · Synapse · doi:10.1002/syn.10075 · Cited by 452
Yin, H. H., Knowlton, B. J., & Balleine, B. W. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04219.x · Cited by 447 · cited 2×
“For example, if the outcome value of one of two potential actions is reduced, the performance of the devalued, but not the non-devalued action decreases 38,39 .”
Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value
Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., & Wilbrecht, L. (2012) · Nature Neuroscience · doi:10.1038/nn.3188 · Cited by 399 · cited 1×
“Although there have been a few studies that examined how incentive values of goals modulate reaction times of actions directed towards specific goals, such questions differ in that they do not address how long-term estimates of the animal's state can have global effects on response vigor 9–11 , 26 .”
Cited by
Mesolimbic dopamine signals the value of work
Hamid, A. A., Pettibone, J. R., Mabrouk, O. S., Hetrick, V. L., Schmidt, R., Vander Weele, C. M., Kennedy, R. T., Aragona, B. J., & Berke, J. D. (2016) · Nature Neuroscience · doi:10.1038/nn.4173 · Cited by 824
Demixed principal component analysis of neural population data
Kobak, D., Brendel, W., Constantinidis, C., Feierstein, C. E., Kepecs, A., Mainen, Z. F., Qi, X.-L., Romo, R., Uchida, N., & Machens, C. K. (2016) · eLife · doi:10.7554/elife.10989 · Cited by 599
Self-citationThe Role of Variability in Motor Learning
Dhawale, A. K., Smith, M. A., & Ölveczky, B. P. (2017) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031548 · Cited by 516
Mood as representation of momentum
Eldar, E., Rutledge, R. B., Dolan, R. J., & Niv, Y. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.010 · Cited by 383
Serotonergic neurons signal reward and punishment on multiple timescales
Cohen, J. Y., Amoroso, M. W., & Uchida, N. (2015) · eLife · doi:10.7554/elife.06346 · Cited by 388
Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli
Menegas, W., Akiti, K., Amo, R., Uchida, N., & Watabe-Uchida, M. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0222-1 · Cited by 382
Self-citationStriatal Circuits as a Common Node for Autism Pathophysiology
Fuccillo, M. V. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00027 · Cited by 269
From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making
Burton, A. C., Nakamura, K., & Roesch, M. R. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.003 · Cited by 238
Stable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173
“The latter comprise relative value, which biases choices toward one alternative (Samejima et al., 2005; Seo and Lee, 2007; Ito and Doya, 2009; Sul et al., 2010; Cai et al., 2011; Wang et al., 2013; Murakami et al., 2017), and total value, which modulates the vigor of choice (how fast to make an action; Figures S1H– S1…”
BackgroundTranslational assessment of reward and motivational deficits in psychiatric disorders
Der-Avakian, A., Barnes, S. A., Markou, A., & Pizzagalli, D. A. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_5004 · Cited by 122
Play in predictive minds: A cognitive theory of play.
Andersen, M. M., Kiverstein, J., Miller, M., & Roepstorff, A. (2023) · Psychological Review · doi:10.1037/rev0000369 · Cited by 122
Tanaka, Y. H., Tanaka, Y. R., Kondo, M., Terada, S.-I., Kawaguchi, Y., & Matsuzaki, M. (2018) · Neuron · doi:10.1016/j.neuron.2018.08.016 · Cited by 77
Kroemer, N. B., Guevara, A., Ciocanea Teodorescu, I., Wuttig, F., Kobiella, A., & Smolka, M. N. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.07.060 · Cited by 64
Striatal action-value neurons reconsidered
Elber-Dorozko, L., & Loewenstein, Y. (2018) · eLife · doi:10.7554/elife.34248 · Cited by 53
Lee, A. M., Tai, L.-H., Zador, A., & Wilbrecht, L. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2014.12.042 · Cited by 37
Translational Assessments of Reward and Anhedonia: A Tribute to Athina Markou
Der-Avakian, A., & Pizzagalli, D. A. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.02.008 · Cited by 36
“A similar rat PRT was also recently developed using ambiguous odor cues (43) based on an analogous task developed for monkeys (44,45).”
Metadata
- Authors
- Wang, A. Y., Miura, K., & Uchida, N.
- Venue
- Nature Neuroscience
- Published
- 2013-04-14
- Volume
- 16
- Issue
- 5
- Pages
- 639-647
- ISSN
- 1097-6256 (ISSN-L)
- 1546-1726
- OpenAlex
- W2080790162
- Cited by
- 128
- References
- 16
- FWCI
- 6.73
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.