The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Action and Outcome Encoding in the Primate Caudate Nucleus
Open accessAbstract
The basal ganglia appear to have a central role in reinforcement learning. Previous experiments, focusing on activity preceding movement execution, support the idea that dorsal striatal neurons bias action selection according to the expected values of actions. However, many phasically active striatal neurons respond at a time too late to initiate or select movements. Given the data suggesting a role for the basal ganglia in reinforcement learning, postmovement activity may therefore reflect evaluative processing important for learning the values of actions. To better understand these postmovement neurons, we determined whether individual striatal neurons encode information about saccade direction, whether a reward had been received, or both. We recorded from phasically active neurons in the caudate nucleus while monkeys performed a probabilistically rewarded delayed saccade task. Many neurons exhibited peak responses after saccade execution (77 of 149) that were often tuned for the direction of the preceding saccade (61 of 77). Of those neurons responding during the reward epoch, one subset showed direction tuning for the immediately preceding saccade (43 of 60), whereas another subset responded differentially on rewarded versus unrewarded trials (35 of 60). We found that there was relatively little overlap of these properties in individual neurons. The encoding of action and outcome was performed by largely separate populations of caudate neurons that were active after movement execution. Thus, striatal neurons active primarily after a movement appear to be segregated into two distinct groups that provide complimentary information about the outcomes of actions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Predictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088 · cited 2×
“, 2004) and reward prediction errors (RPEs) (O’Doherty et al., 2004; Haruno and Kawato, 2006).”
BackgroundResultBasal ganglia and cerebellar loops: motor and cognitive circuits
Middleton, F. (2000) · Brain Research Reviews · doi:10.1016/s0165-0173(99)00040-5 · Cited by 1,940
Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function
Middleton, F. A., & Strick, P. L. (1994) · Science · doi:10.1126/science.7939688 · Cited by 1,356 · cited 2×
“…basal ganglia promotes learning in cortical areas (Wise et al., 1996) via projections through the substantia nigra pars reticulata (SNr) and thalamus (Ilinsky et al., 1985; Middleton and Strick, 1994), an idea supported by recent experiments (Fujii and Graybiel, 2005; Pasupathy and Miller, 2005).”
ResultMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“It is possible that the rewardresponsive neurons we observed encode RPEs, which would be consistent with projections to the striatum from midbrain dopamine neurons, which encode RPEs (Schultz, 1998; Bayer and Glimcher, 2005).”
ResultSelf-citationModels of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Complementary roles of basal ganglia and cerebellum in learning and motor control
Doya, K. (2000) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(00)00153-7 · Cited by 964
Different time courses of learning-related activity in the prefrontal cortex and striatum.
Pasupathy, A., & Miller, E. K. (2005) · Nature · doi:10.1038/nature03287 · Cited by 712 · cited 3×
“…basal ganglia promotes learning in cortical areas (Wise et al., 1996) via projections through the substantia nigra pars reticulata (SNr) and thalamus (Ilinsky et al., 1985; Middleton and Strick, 1994), an idea supported by recent experiments (Fujii and Graybiel, 2005; Pasupathy and Miller, 2005).”
BackgroundResultJoel, D., & Weiner, I. (2000) · Neuroscience · doi:10.1016/s0306-4522(99)00575-8 · Cited by 614 · cited 2×
“This type of postmovement activity might function to convey reward expectations to midbrain dopamine neurons via known projections (Joel and Weiner, 2000) to enable the computation of action-specific reward prediction errors (Houk et al.”
BackgroundActivity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., & Graybiel, A. M. (2005) · Nature · doi:10.1038/nature04053 · Cited by 595 · cited 2×
“Individual phasically active neurons (PANs) in the striatum respond to specific events during instrumental conditioning tasks, and as a population, these neurons are responsive from well before action selection to well after reward receipt (Schultz et al., 1995; Schmitzer-Torbert and Redish, 2004; Barnes et al., 2005).”
BackgroundOrganization of the nigrothalamocortical system in the rhesus monkey
Ilinsky, I. A., Jouandet, M. L., & Goldman‐Rakic, P. S. (1985) · Journal of Comparative Neurology · doi:10.1002/cne.902360304 · Cited by 406 · cited 2×
“…basal ganglia promotes learning in cortical areas (Wise et al., 1996) via projections through the substantia nigra pars reticulata (SNr) and thalamus (Ilinsky et al., 1985; Middleton and Strick, 1994), an idea supported by recent experiments (Fujii and Graybiel, 2005; Pasupathy and Miller, 2005).”
ResultInfluence of Reward Expectation on Behavior-Related Neuronal Activity in Primate Striatum
Hollerman, J. R., Tremblay, L., & Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.2.947 · Cited by 380
Responses to reward in monkey dorsal and ventral striatum
Apicella, P., Ljungberg, T., Scarnati, E., & Schultz, W. (1991) · Experimental Brain Research · doi:10.1007/bf00231732 · Cited by 369 · cited 4×
“…of reward-related responses in the dorsal striatum, which have only examined postmovement responses when the outcomes are fully expected (Apicella et al., 1991; Hollerman et al., 1998; Cromwell and Schultz, 2003) or during learning when reward expectations are changing (Tremblay et al.,…”
BackgroundInfluentialNeuronal activity in monkey striatum related to the expectation of predictable environmental events
Apicella, P., Scarnati, E., Ljungberg, T., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.68.3.945 · Cited by 305
Haruno, M., Kuroda, T., Doya, K., Toyama, K., Kimura, M., Samejima, K., Imamizu, H., & Kawato, M. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3417-03.2004 · Cited by 300 · cited 2×
“…is consistent with functional magnetic resonance imaging studies showing increased activity in the dorsal striatum in response to rewards (Delgado et al., 2000; Knutson et al., 2001; Haruno et al., 2004) and reward prediction errors (RPEs) (O’Doherty et al., 2004; Haruno and Kawato, 2006).”
Result
Cited by
Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis
Glimcher, P. W. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1014269108 · Cited by 955
Self-citationReinforcement learning: The Good, The Bad and The Ugly
Dayan, P., & Niv, Y. (2008) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2008.08.003 · Cited by 704
Visual search: A retrospective
Eckstein, M. P. (2011) · Journal of Vision · doi:10.1167/11.5.14 · Cited by 470
The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward.
Humphries, M. D., & Prescott, T. J. (2010) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.11.003 · Cited by 418
Collins, A. G. E., & Frank, M. J. (2012) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07980.x · Cited by 417
Metadata
- Authors
- Lau, B., & Glimcher, P. W.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2007-12-26
- Volume
- 27
- Issue
- 52
- Pages
- 14502-14514
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1975227851
- Cited by
- 177
- References
- 16
- FWCI
- 9.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.