Representation of Action-Specific Reward Values in the Striatum

Samejima, Kazuyuki; Ueda, Yasumasa; Doya, Kenji; Kimura, Minoru

doi:10.1126/science.1115270

Cited by 939Neural and Behavioral Psychology StudiesNeurotransmitter Receptor Influence on BehaviorMemory and Neural Mechanisms

Representation of Action-Specific Reward Values in the Striatum

Samejima, Kazuyuki, Ueda, Yasumasa, Doya, Kenji, Kimura, Minoru·2005·Science

DOI 10.1126/science.1115270

Open this paper in CoChat — free account

Abstract

The estimation of the reward an action will yield is critical in decision-making. To elucidate the role of the basal ganglia in this process, we recorded striatal neurons of monkeys who chose between left and right handle turns, based on the estimated reward probabilities of the actions. During a delay period before the choices, the activity of more than one-third of striatal projection neurons was selective to the values of one of the two actions. Fewer neurons were tuned to relative values or action choice. These results suggest representation of action values in the striatum, which can guide action selection in the basal ganglia circuit.

Integrity signals

Registry

Crossref · 10.1126/science.1115270

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Brain structures activated in decision making and modulated by reward signals include caudate, lateral parietal cortex area LIP, and prefrontal cortex.
“Brain structures activated in decision making and modulated by reward signals include caudate (Samejima et al., 2005; Hikosaka et al., 2006), lateral parietal cortex area LIP (Platt and Glimcher, 1999; Sugrue et al., 2004), and prefrontal cortex (Watanabe, 1996; Roesch and Olson, 2003).”
From Decision Making in Recurrent Neuronal Circuits (2008) · cites this paper as Samejima et al., 2005

A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388 · see citing works
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · see citing works
Two-process learning theory: Relationships between Pavlovian conditioning and instrumental learning.
Rescorla, R. A., & Solomon, R. L. (1967) · Psychological Review · doi:10.1037/h0024475 · Cited by 1,487 · see citing works
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190 · see citing works
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964 · see citing works
Self-citation
The hippocampus and contextual retrieval of information from memory: A theory
Hirsh, R. (1974) · Behavioral Biology · doi:10.1016/s0091-6773(74)92231-7 · Cited by 957 · see citing works
A cellular mechanism of reward-related learning
Reynolds, J. N. J., Hyland, B. I., & Wickens, J. R. (2001) · Nature · doi:10.1038/35092560 · Cited by 879 · see citing works
Building neural representations of habits.
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., & Graybiel, A. M. (1999) · Science · doi:10.1126/science.286.5445.1745 · Cited by 834 · see citing works
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · see citing works
Reward expectancy in primate prefrental neurons
Watanabe, M. (1996) · Nature · doi:10.1038/382629a0 · Cited by 684 · see citing works
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678 · see citing works
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 653 · see citing works
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 632 · see citing works
Feature Article: Distributed Modular Architectures Linking Basal Ganglia, Cerebellum, and Cerebral Cortex: Their Role in Planning and Controlling Action
Houk, J. C., & Wise, S. P. (1995) · Cerebral Cortex · doi:10.1093/cercor/5.2.95 · Cited by 594 · see citing works
Coincident but Distinct Messages of Midbrain Dopamine and Striatal Tonically Active Neurons
Morris, G., Arkadir, D., Nevet, A., Vaadia, E., & Bergman, H. (2004) · Neuron · doi:10.1016/j.neuron.2004.06.012 · Cited by 574 · see citing works
The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia
Calabresi, P., Pisani, A., Mercuri, N. B., & Bernardi, G. (1996) · Trends in Neurosciences · doi:10.1016/0166-2236(96)81862-5 · Cited by 462 · see citing works
Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum
Cromwell, H. C., & Schultz, W. (2003) · Journal of Neurophysiology · doi:10.1152/jn.01014.2002 · Cited by 357 · see citing works
Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons
Satoh, T., Nakai, S., Sato, T., & Kimura, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-30-09913.2003 · Cited by 298 · see citing works
Self-citation
Neural mechanisms of reward-related motor learning
Wickens, J. R., Reynolds, J. N., & Hyland, B. I. (2003) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2003.10.013 · Cited by 284 · see citing works
Visual and Anticipatory Bias in Three Cortical Eye Fields of the Monkey during an Adaptive Decision-Making Task
Coe, B. C., Tomihara, K., Matsuzawa, M., & Hikosaka, O. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-12-05081.2002 · Cited by 215 · see citing works
Neuronal Signals in the Monkey Ventral Striatum Related to Progress through a Predictable Series of Trials
Shidara, M., Aigner, T. G., & Richmond, B. J. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-07-02613.1998 · Cited by 205 · see citing works
Independent Coding of Movement Direction and Reward Prediction by Single Pallidal Neurons
Arkadir, D., Morris, G., Vaadia, E., & Bergman, H. (2004) · Journal of Neuroscience · doi:10.1523/jneurosci.2583-04.2004 · Cited by 110 · see citing works

Flagged first, then by citations

Sorted by citations

Learning the value of information in an uncertain world
Behrens, T. E. J., Woolrich, M. W., Walton, M. E., & Rushworth, M. F. S. (2007) · Nature Neuroscience · doi:10.1038/nn1954 · Cited by 2,053 · see citing works
Habits, Rituals, and the Evaluative Brain
Graybiel, A. M. (2008) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.112851 · Cited by 1,697 · see citing works
Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans
Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J., & Frith, C. D. (2006) · Nature · doi:10.1038/nature05051 · Cited by 1,584 · see citing works
An opportunity cost model of subjective effort and task performance
Kurzban, R., Duckworth, A., Kable, J. W., & Myers, J. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12003196 · Cited by 1,381 · see citing works
The root of all value: a neural common currency for choice
Levy, D. J., & Glimcher, P. W. (2012) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.06.001 · Cited by 1,342 · see citing works
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126 · see citing works
Dopamine reward prediction-error signalling: A two-component response
Schultz, W. (2016) · Nature Reviews Neuroscience · doi:10.1038/nrn.2015.26 · Cited by 1,036 · see citing works
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955 · see citing works
Optimal decision making and the anterior cingulate cortex
Kennerley, S. W., Walton, M. E., Behrens, T. E. J., Buckley, M. J., & Rushworth, M. F. S. (2006) · Nature Neuroscience · doi:10.1038/nn1724 · Cited by 948 · see citing works
The Neurobiology of Decision: Consensus and Controversy
Kable, J. W., & Glimcher, P. W. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.003 · Cited by 928 · see citing works
Choice, uncertainty and value in prefrontal and cingulate cortex
Rushworth, M. F. S., & Behrens, T. E. J. (2008) · Nature Neuroscience · doi:10.1038/nn2066 · Cited by 866 · see citing works
The short-latency dopamine signal: a role in discovering novel actions?
Redgrave, P., & Gurney, K. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn2022 · Cited by 762 · see citing works
Born to choose: the origins and value of the need for control
Leotti, L. A., Iyengar, S. S., & Ochsner, K. N. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.08.001 · Cited by 717 · see citing works
Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making
Frank, M. J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.03.006 · Cited by 706 · see citing works
Decision Making in Recurrent Neuronal Circuits
Wang, X.-J. (2008) · Neuron · doi:10.1016/j.neuron.2008.09.034 · Cited by 679 · see citing works
“Brain structures activated in decision making and modulated by reward signals include caudate (Samejima et al., 2005; Hikosaka et al., 2006), lateral parietal cortex area LIP (Platt and Glimcher, 1999; Sugrue et al., 2004), and prefrontal cortex (Watanabe, 1996; Roesch and Olson, 2003).”
Background
Modulators of decision making
Doya, K. (2008) · Nature Neuroscience · doi:10.1038/nn2077 · Cited by 642 · see citing works
Self-citation
Neurobiology of economic choice: a good-based model
Padoa-Schioppa, C. (2011) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-061010-113648 · Cited by 600 · see citing works
Representation of negative motivational value in the primate lateral habenula
Matsumoto, M., & Hikosaka, O. (2009) · Nature Neuroscience · doi:10.1038/nn.2233 · Cited by 547 · see citing works
Neural computations associated with goal-directed choice
Rangel, A., & Hare, T. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.001 · Cited by 532 · see citing works
Learning, reward, and decision making
O'Doherty, J. P., Cockburn, J., & Pauli, W. M. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-010416-044216 · Cited by 475 · see citing works
Midbrain dopamine neurons encode decisions for future action
Morris, G., Nevet, A., Arkadir, D., Vaadia, E., & Bergman, H. (2006) · Nature Neuroscience · doi:10.1038/nn1743 · Cited by 503 · see citing works
Serotonin and dopamine: unifying affective, activational, and decision functions.
Cools, R., Nakamura, K., & Daw, N. D. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.121 · Cited by 464 · see citing works
Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value
Tai, L.-H., Lee, A. M., Benavidez, N., Bonci, A., & Wilbrecht, L. (2012) · Nature Neuroscience · doi:10.1038/nn.3188 · Cited by 399 · see citing works
Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks
Yin, H. H., Ostlund, S. B., & Balleine, B. W. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06422.x · Cited by 416 · see citing works
Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior
Hayden, B. Y., Heilbronner, S. R., Pearson, J. M., & Platt, M. L. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.4652-10.2011 · Cited by 379 · see citing works
Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making
Peters, J., & Büchel, C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3489-09.2009 · Cited by 400 · see citing works
Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling
Redish, A. D., Jensen, S., Johnson, A., & Kurth-Nelson, Z. (2007) · Psychological Review · doi:10.1037/0033-295x.114.3.784 · Cited by 346 · see citing works
Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
Dayan, P., & Berridge, K. C. (2014) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-014-0277-8 · Cited by 357 · see citing works
Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala
Belova, M. A., Paton, J. J., Morrison, S. E., & Salzman, C. D. (2007) · Neuron · doi:10.1016/j.neuron.2007.08.004 · Cited by 349 · see citing works
The Inherent Reward of Choice
Leotti, L. A., & Delgado, M. R. (2011) · Psychological Science · doi:10.1177/0956797611417005 · Cited by 318 · see citing works
Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game
Seo, H., & Lee, D. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2369-07.2007 · Cited by 324 · see citing works
Mapping value based planning and extensively trained choice in the human brain
Wunderlich, K., Dayan, P., & Dolan, R. J. (2012) · Nature Neuroscience · doi:10.1038/nn.3068 · Cited by 310 · see citing works
Emotion, decision making, and the amygdala.
Seymour, B., & Dolan, R. (2008) · Neuron · doi:10.1016/j.neuron.2008.05.020 · Cited by 324 · see citing works
An “As Soon As Possible” Effect in Human Intertemporal Decision Making: Behavioral Evidence and Neural Mechanisms
Kable, J. W., & Glimcher, P. W. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00177.2009 · Cited by 316 · see citing works
The role of the striatum in social behavior
Báez-Mendoza, R., & Schultz, W. (2013) · Frontiers in Neuroscience · doi:10.3389/fnins.2013.00233 · Cited by 312 · see citing works
Common brain mechanisms of chronic pain and addiction
Elman, I., & Borsook, D. (2016) · Neuron · doi:10.1016/j.neuron.2015.11.027 · Cited by 303 · see citing works
Neural mechanisms underlying motivation of mental versus physical effort
Schmidt, L., Lebreton, M., Cléry-Melin, M.-L., Daunizeau, J., & Pessiglione, M. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001266 · Cited by 310 · see citing works
Neural computations underlying action-based decision making in the human brain
Wunderlich, K., Rangel, A., & O'Doherty, J. P. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0901077106 · Cited by 301 · see citing works
Striatal Circuits as a Common Node for Autism Pathophysiology
Fuccillo, M. V. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00027 · Cited by 269 · see citing works
Linking Brain Structure and Activation in Temporoparietal Junction to Explain the Neurobiology of Human Altruism
Morishima, Y., Schunk, D., Bruhin, A., Ruff, C. C., & Fehr, E. (2012) · Neuron · doi:10.1016/j.neuron.2012.05.021 · Cited by 296 · see citing works
The hippocampal-striatal axis in learning, prediction and goal-directed behavior
Pennartz, C. M. A., Ito, R., Verschure, P. F. M. J., Battaglia, F. P., & Robbins, T. W. (2011) · Trends in Neurosciences · doi:10.1016/j.tins.2011.08.001 · Cited by 287 · see citing works
The anatomy of choice: dopamine and decision-making.
Friston, K., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., & Dolan, R. J. (2014) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2013.0481 · Cited by 289 · see citing works
What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation
Klaus, A., Alves da Silva, J., & Costa, R. M. (2019) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-072116-031033 · Cited by 284 · see citing works
Striatal activity underlies novelty-based choice in humans
Wittmann, B. C., Daw, N. D., Seymour, B., & Dolan, R. J. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.027 · Cited by 277 · see citing works
Processing of the incentive for social approval in the ventral striatum during charitable donation
Izuma, K., Saito, D. N., & Sadato, N. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21228 · Cited by 276 · see citing works
Dopamine prediction error responses integrate subjective value from different reward dimensions
Lak, A., Stauffer, W. R., & Schultz, W. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1321596111 · Cited by 257 · see citing works
From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making
Burton, A. C., Nakamura, K., & Roesch, M. R. (2015) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2014.05.003 · Cited by 238 · see citing works
Meta-analysis of real-time fMRI neurofeedback studies using individual participant data: how is brain regulation mediated?
Emmert, K., Kopel, R., Sulzer, J., Brühl, A. B., Berman, B. D., Linden, D. E. J., Horovitz, S. G., Breimhorst, M., Caria, A., Frank, S., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.09.042 · Cited by 245 · see citing works
Explicit neural signals reflecting reward uncertainty
Schultz, W., Preuschoff, K., Camerer, C., Hsu, M., Fiorillo, C. D., Tobler, P. N., & Bossaerts, P. (2008) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2008.0152 · Cited by 239 · see citing works
Moment-to-moment tracking of state value in the amygdala
Belova, M. A., Paton, J. J., & Salzman, C. D. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1400-08.2008 · Cited by 221 · see citing works
Contributions of the ventromedial prefrontal cortex to goal-directed action selection
O’Doherty, J. P. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06290.x · Cited by 225 · see citing works
The basal ganglia control the detailed kinematics of learned motor skills
Dhawale, A. K., Wolff, S. B. E., Ko, R., & Ölveczky, B. P. (2021) · Nature Neuroscience · doi:10.1038/s41593-021-00889-3 · Cited by 194 · see citing works
Reward/punishment reversal learning in older suicide attempters
Dombrovski, A. Y., Clark, L., Siegle, G. J., Butters, M. A., Ichikawa, N., Sahakian, B. J., & Szanto, K. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.09030407 · Cited by 193 · see citing works
Beyond working memory: the role of persistent activity in decision making
Curtis, C. E., & Lee, D. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.03.006 · Cited by 191 · see citing works
Gustatory reward and the nucleus accumbens
Norgren, R., Hajnal, A., & Mungarndee, S. S. (2006) · Physiology & Behavior · doi:10.1016/j.physbeh.2006.05.024 · Cited by 181 · see citing works
Serotonin neurons modulate learning rate through uncertainty
Grossman, C. D., Bari, B. A., & Cohen, J. Y. (2022) · Current Biology · doi:10.1016/j.cub.2021.12.006 · Cited by 164 · see citing works
Stable representations of decision variables for flexible behavior
Bari, B. A., Grossman, C. D., Lubin, E. E., Rajagopalan, A. E., Cressy, J. I., & Cohen, J. Y. (2019) · Neuron · doi:10.1016/j.neuron.2019.06.001 · Cited by 173 · see citing works
Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior
Gruber, A. J., & McDonald, R. J. (2012) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2012.00050 · Cited by 173 · see citing works
Striatal Contributions to Reward and Decision Making: Making Sense of Regional Variations in a Reiterated Processing Matrix
WICKENS, J. R., BUDD, C. S., HYLAND, B. I., & ARBUTHNOTT, G. W. (2007) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1390.016 · Cited by 165 · see citing works
Dynamic Signals Related to Choices and Outcomes in the Dorsolateral Prefrontal Cortex
Seo, H., Barraclough, D. J., & Lee, D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm064 · Cited by 143 · see citing works
Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction
Liljeholm, M., Tricomi, E., O'Doherty, J. P., & Balleine, B. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3354-10.2011 · Cited by 130 · see citing works
Translational assessment of reward and motivational deficits in psychiatric disorders
Der-Avakian, A., Barnes, S. A., Markou, A., & Pizzagalli, D. A. (2015) · Current topics in behavioral neurosciences · doi:10.1007/7854_2015_5004 · Cited by 122 · see citing works
Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy Game
Seo, H., Barraclough, D. J., & Lee, D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1479-09.2009 · Cited by 125 · see citing works
I control therefore I do: Judgments of agency influence action selection
Karsh, N., & Eitam, B. (2015) · Cognition · doi:10.1016/j.cognition.2015.02.002 · Cited by 125 · see citing works
Functional neuroimaging of intertemporal choice models: a review
Carter, R. M., Meyer, J. R., & Huettel, S. A. (2010) · Journal of Neuroscience Psychology and Economics · doi:10.1037/a0018046 · Cited by 124 · see citing works
Translational studies of goal-directed action as a framework for classifying deficits across psychiatric disorders
Griffiths, K. R., Morris, R. W., & Balleine, B. W. (2014) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2014.00101 · Cited by 118 · see citing works
Changes in activity of the striatum during formation of a motor habit
Tang, C., Pawlak, A. P., Prokopenko, V., & West, M. O. (2007) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2007.05353.x · Cited by 122 · see citing works
Human reinforcement learning subdivides structured action spaces by learning effector-specific values
Gershman, S. J., Pesaran, B., & Daw, N. D. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.2469-09.2009 · Cited by 118 · see citing works
The primate amygdala combines information about space and value
Peck, C. J., Lau, B., & Salzman, C. D. (2013) · Nature Neuroscience · doi:10.1038/nn.3328 · Cited by 115 · see citing works
A Genetically Defined Compartmentalized Striatal Direct Pathway for Negative Reinforcement
Xiao, X., Deng, H., Furlan, A., Yang, T., Zhang, X., Hwang, G.-R., Tucciarone, J., Wu, P., He, M., Palaniswamy, R., et al. (2020) · Cell · doi:10.1016/j.cell.2020.08.032 · Cited by 101 · see citing works
Reinforcement learning: Computational theory and biological mechanisms
Doya, K. (2007) · HFSP journal · doi:10.2976/1.2732246 · Cited by 150 · see citing works
Self-citation
Human Dorsal Striatum Encodes Prediction Errors during Observational Learning of Instrumental Actions
Cooper, J. C., Dunne, S., Furey, T., & O'Doherty, J. P. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00114 · Cited by 101 · see citing works
Using fMRI to study reward processing in humans: past, present, and future
Wang, K. S., Smith, D. V., & Delgado, M. R. (2016) · Journal of Neurophysiology · doi:10.1152/jn.00333.2015 · Cited by 105 · see citing works
Contextual novelty changes reward representations in the striatum
Guitart-Masip, M., Bunzeck, N., Stephan, K. E., Dolan, R. J., & Düzel, E. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5331-09.2010 · Cited by 104 · see citing works
An insula hierarchical network architecture for active interoceptive inference
Fermin, A. S. R., Friston, K., & Yamawaki, S. (2022) · Royal Society Open Science · doi:10.1098/rsos.220226 · Cited by 101 · see citing works
Dopamine neurons learn to encode the long-term value of multiple future rewards
Enomoto, K., Matsumoto, N., Nakai, S., Satoh, T., Sato, T. K., Ueda, Y., Inokawa, H., Haruno, M., & Kimura, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014457108 · Cited by 83 · see citing works
Self-citation
Neural mechanism for stochastic behaviour during a competitive game
Soltani, A., Lee, D., & Wang, X.-J. (2006) · Neural Networks · doi:10.1016/j.neunet.2006.05.044 · Cited by 77 · see citing works
The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox
Piron, C., Kase, D., Topalidou, M., Goillandeau, M., Orignac, H., N'Guyen, T., Rougier, N., & Boraud, T. (2016) · Movement Disorders · doi:10.1002/mds.26542 · Cited by 66 · see citing works
Action-specific value signals in reward-related regions of the human brain
FitzGerald, T. H. B., Friston, K. J., & Dolan, R. J. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3254-12.2012 · Cited by 68 · see citing works
Stimulus-response and response-outcome learning mechanisms in the striatum
Horvitz, J. C. (2009) · Behavioural Brain Research · doi:10.1016/j.bbr.2008.12.014 · Cited by 58 · see citing works
Striatal action-value neurons reconsidered
Elber-Dorozko, L., & Loewenstein, Y. (2018) · eLife · doi:10.7554/elife.34248 · Cited by 53 · see citing works
Perineuronal Nets Play a Role in Regulating Striatal Function in the Mouse
Lee, H., Leamey, C. A., & Sawatari, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0032747 · Cited by 47 · see citing works
Effects of α-2A adrenergic receptor agonist on time and risk preference in primates
Kim, S., Bobeica, I., Gamo, N. J., Arnsten, A. F. T., & Lee, D. (2012) · Psychopharmacology · doi:10.1007/s00213-011-2520-0 · Cited by 47 · see citing works
Adolescents let sufficient evidence accumulate before making a decision when large incentives are at stake
Teslovich, T., Mulder, M., Franklin, N. T., Ruberry, E. J., Millner, A., Somerville, L. H., Simen, P., Durston, S., & Casey, B. J. (2014) · Developmental Science · doi:10.1111/desc.12092 · Cited by 45 · see citing works
Nicotinic alteration of decision-making
Naudé, J., Dongelmans, M., & Faure, P. (2015) · Neuropharmacology · doi:10.1016/j.neuropharm.2014.11.021 · Cited by 39 · see citing works
Translational Assessments of Reward and Anhedonia: A Tribute to Athina Markou
Der-Avakian, A., & Pizzagalli, D. A. (2018) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.02.008 · Cited by 36 · see citing works
Between the primate and 'reptilian' brain: rodent models demonstrate the role of corticostriatal circuits in decision making
Lee, A. M., Tai, L.-H., Zador, A., & Wilbrecht, L. (2015) · Neuroscience · doi:10.1016/j.neuroscience.2014.12.042 · Cited by 37 · see citing works
Valuation of uncertain and delayed rewards in primate prefrontal cortex
Kim, S., Hwang, J., Seo, H., & Lee, D. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.03.010 · Cited by 37 · see citing works
Conditioned associations and economic decision biases.
Guitart-Masip, M., Talmi, D., & Dolan, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.021 · Cited by 36 · see citing works
Neural activity in relation to temporal distance: Differences in past and future temporal discounting
He, J. M., Huang, X. T., Yuan, H., & Chen, Y. G. (2012) · Consciousness and Cognition · doi:10.1016/j.concog.2012.08.006 · Cited by 13 · see citing works
Altered Reward Processing in Obsessive-Compulsive Disorder: Insights from Active and Observational Learning
Vahedi, J., Bahic, A., Chaliani, I., Schilbach, L., Ciupka‐Schön, B., Bellebaum, C., Pietrowsky, R., & Peterburs, J. (2025) · Psychophysiology · doi:10.1111/psyp.70142 · Cited by 3 · see citing works

Adjusting Behavior to Context: Striatal Network Functions in Learning and Memory
Graybiel, A. M., & Blázquez, P. M. (2002) · Advances in behavioral biology · doi:10.1007/978-1-4757-3538-3_86 · Cited by 1 · see citing works
Amygdaloid projections to ventromedial striatal subterritories in the primate
Fudge, J. L., Kunishio, K., Walsh, P., Richard, C., & Haber, S. N. (2002) · Neuroscience · doi:10.1016/s0306-4522(01)00546-2 · Cited by 226 · see citing works
A Telencephalic Nucleus Essential for Song Learning Contains Neurons with Physiological Characteristics of Both Striatum and Globus Pallidus
Farries, M. A., & Perkel, D. J. (2002) · Journal of Neuroscience · doi:10.1523/jneurosci.22-09-03776.2002 · Cited by 187 · see citing works
Presynaptic Inhibition in the Striatum of the Basal Ganglia Improves Pattern Classification and Thus Promotes Superior Goal Selection
Schwab, D. J., & Houk, J. C. (2015) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2015.00152 · Cited by 3 · see citing works
[The structure and connections of the basal ganglia. The striatum].
Leontovich, T. A., & Na, M. (1997) · PubMed · Cited by 7 · see citing works

Authors: Samejima, K., Ueda, Y., Doya, K., & Kimura, M.
Affiliations: Okinawa Institute of Science and Technology Graduate University (JP)
Corresponding author: Samejima, Kazuyuki
Kimura, Minoru
ORCID: Doya, Kenji
Kimura, Minoru
Venue: Science
Publisher: American Association for the Advancement of Science (AAAS)
Published: 2005-11-25
Volume: 310
Issue: 5752
Pages: 1337-1340
ISSN: 0036-8075 (ISSN-L)
1095-9203
DOI: 10.1126/science.1115270
OpenAlex: W2076256116
Cited by: 939
References: 22
Citations by year: 2026: 25 · 2025: 43 · 2024: 32 · 2023: 30 · 2022: 29 · 2021: 52 · 2020: 73 · 2019: 42 · 2018: 39 · 2017: 34 · 2016: 43 · 2015: 58 · 2014: 48 · 2013: 48 · 2012: 48
FWCI: 19.61
Type: journal article
Language: en
Open access: closed
Locations: Science (publishedVersion)
PubMed (publishedVersion)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
Keywords: striatum, reward probability, basal ganglia, decision-making, action selection, projection neurons, neuronal selectivity, delay period, monkeys
MeSH terms: Action Potentials, Animals, Brain Mapping, Caudate Nucleus, Choice Behavior, Corpus Striatum, Female, Macaca, Male, Neurons, Probability, Putamen, Regression Analysis, Reinforcement, Psychology, Reward

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Representation of Action-Specific Reward Values in the Striatum

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks