Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Tonically active neurons (TANs) in the primate striatum are responsive to rewarding stimuli and they are thought to be involved in the storage of stimulus–reward associations or habits. However, it is unclear whether these neurons may signal the difference between the prediction of reward and its actual outcome as a possible neuronal correlate of reward prediction errors at the striatal level. To address this question, we studied the activity of TANs from three monkeys trained in a classical conditioning task in which a liquid reward was preceded by a visual stimulus and reward probability was systematically varied between blocks of trials. The monkeys’ ability to discriminate the conditions according to probability was assessed by monitoring their mouth movements during the stimulus–reward interval. We found that the typical TAN pause responses to the delivery of reward were markedly enhanced as the probability of reward decreased, whereas responses to the predictive stimulus were somewhat stronger for high reward probability. In addition, TAN responses to the omission of reward consisted of either decreases or increases in activity that became stronger with increasing reward probability. It therefore appears that one group of neurons differentially responded to reward delivery and reward omission with changes in activity into opposite directions, while another group responded in the same direction. These data indicate that only a subset of TANs could detect the extent to which reward occurs differently than predicted, thus contributing to the encoding of positive and negative reward prediction errors that is relevant to reinforcement learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Getting formal with dopamine and reward
Schultz, W. (2002) · Neuron · doi:10.1016/s0896-6273(02)00967-4 · Cited by 2,574
Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop
Parent, A., & Hazrati, L.-N. (1995) · Brain Research Reviews · doi:10.1016/0165-0173(94)00007-c · Cited by 2,161 · cited 1×
“…in firing during the acquisition of action–outcome relations and their retention after extensive training (Jog et al., 1999; Barnes et al., 2005; Pasupathy & Miller, 2005; Brasted & Wise, 2004; Tang et al., 2007; Tremblay et al., 1998), whereas tonically active neurons (TANs), presumed to be…”
BackgroundLearning and Memory Functions of the Basal Ganglia
Packard, M. G., & Knowlton, B. J. (2002) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.25.112701.142937 · Cited by 1,717 · cited 1×
“Several lines of evidence have implicated the striatum, especially its dorsal part, in procedural learning processes, such as habit formation and acquisition of motor skills (Graybiel, 1998; Salmon & Butters, 1995; Packard & Knowlton, 2002).”
BackgroundTemporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522 · cited 1×
“Several lines of evidence have implicated the striatum, especially its dorsal part, in procedural learning processes, such as habit formation and acquisition of motor skills (Graybiel, 1998; Salmon & Butters, 1995; Packard & Knowlton, 2002).”
BackgroundToward a modern theory of adaptive networks: Expectation and prediction.
Sutton, R. S., & Barto, A. G. (1981) · Psychological Review · doi:10.1037/0033-295x.88.2.135 · Cited by 1,450 · cited 1×
“…recent findings from one other laboratory (Joshua et al., 2008), suggest that TANs are capable of signaling differences between predictions and rewarding outcomes, which correspond to prediction errors thought to be crucial for reinforcement learning (Rescorla & Wagner, 1972; Sutton & Barto, 1981).”
ResultNeuronal Coding of Prediction Errors
Schultz, W., & Dickinson, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.473 · Cited by 1,427 · cited 1×
“It is generally accepted that the encoding of a prediction error signal of the type required by reinforcement learning models takes the form of changes in neuronal activity into opposite directions (Schultz & Dickinson, 2000; Niv & Schoenbaum, 2008).”
BackgroundMidbrain dopamine neurons encode a quantitative reward prediction error signal
Bayer, H. M., & Glimcher, P. W. (2005) · Neuron · doi:10.1016/j.neuron.2005.05.020 · Cited by 1,304 · cited 1×
“Although it is possible that positive and negative prediction errors can be signaled by specific patterns of decreasing activity (Bayer et al., 2007), it must be emphasized that the experience of reward prediction error was not the only aspect to vary when we manipulated the probability of reward.”
BackgroundLateral habenula as a source of negative reward signals in dopamine neurons
Matsumoto, M., & Hikosaka, O. (2007) · Nature · doi:10.1038/nature05860 · Cited by 1,292 · cited 1×
“…activations related to errors in reward prediction in striatal and prefrontal cortical areas, which are the primary target structures of DA neurons (McClure et al., 2003; Ullsperger & von Cramon, 2003; O’Doherty et al., 2003; Seymour et al., 2004; Abler et al., 2006; Rodriguez et al., 2006; Tobler…”
BackgroundDopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018 · cited 4×
“It has been shown in both monkeys and rats that phasic activations in DA neurons are a possible neuronal substrate for the reward prediction error signal (Waelti et al., 2001; Morris et al., 2004; Bayer & Glimcher, 2005; Roesch et al., 2007).”
BackgroundInfluentialTemporal Prediction Errors in a Passive Learning Task Activate Human Striatum
McClure, S. M., Berns, G. S., & Montague, P. R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00154-5 · Cited by 917 · cited 5×
“A rebound activation often occurred immediately after the pause, this biphasic response pattern being similar to that previously reported (Kimura et al., 1984; Aosaki et al., 1994; Apicella et al., 1997; Morris et al., 2004; Yamada et al., 2004).”
BackgroundResultInfluential
Cited by
Neuronal Reward and Decision Signals: From Theories to Data
Schultz, W. (2015) · Physiological Reviews · doi:10.1152/physrev.00023.2014 · Cited by 1,126
Neuroanatomical and Neurochemical Substrates of Timing
Coull, J. T., Cheng, R.-K., & Meck, W. H. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.113 · Cited by 808
Dopamine reward prediction error coding
Schultz, W. (2016) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2016.18.1/wschultz · Cited by 597
Wen, C., Ogura, Y., & Matsushima, T. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00476 · Cited by 259
Multiphasic modulation of cholinergic interneurons by nigrostriatal afferents
Straub, C., Tritsch, N. X., Hagan, N. A., Gu, C., & Sabatini, B. L. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0589-14.2014 · Cited by 130
“In addition, sensory responses in CINs mirror the activity of dopamine neurons during behavioral conditioning, such that they respond more frequently and vigorously to unpredicted rewards and to sensory cues that reliably predict reward (Ravel et al., 2003; Apicella et al., 2009).”
Background
Metadata
- Authors
- Apicella, P., Deffains, M., Ravel, S., & Legallet, E.
- Venue
- European Journal of Neuroscience
- Publisher
- Wiley
- Published
- 2009-08
- Volume
- 30
- Issue
- 3
- Pages
- 515-526
- ISSN
- 0953-816X (ISSN-L)
- 1460-9568
- OpenAlex
- W2034047240
- Cited by
- 66
- References
- 22
- FWCI
- 2.01
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context. https://app.cochat.ai/papers/10.1111/j.1460-9568.2009.06872.x
- The paper
- Apicella, P., Deffains, M., Ravel, S., & Legallet, E. (2009). Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context. European Journal of Neuroscience. https://doi.org/10.1111/j.1460-9568.2009.06872.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.