The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks
Open accessAbstract
To ensure survival, animals must update the internal representations of their environment in a trial-and-error fashion. Psychological studies of associative learning and neurophysiological analyses of dopaminergic neurons have suggested that this updating process involves the temporal-difference (TD) method in the basal ganglia network. However, the way in which the component variables of the TD method are implemented at the neuronal level is unclear. To investigate the underlying neural mechanisms, we trained domestic chicks to associate color cues with food rewards. We recorded neuronal activities from the medial striatum or tegmentum in a freely behaving condition and examined how reward omission changed neuronal firing. To compare neuronal activities with the signals assumed in the TD method, we simulated the behavioral task in the form of a finite sequence composed of discrete steps of time. The three signals assumed in the simulated task were the prediction signal, the target signal for updating, and the TD-error signal. In both the medial striatum and tegmentum, the majority of recorded neurons were categorized into three types according to their fitness for three models, though these neurons tended to form a continuum spectrum without distinct differences in the firing rate. Specifically, two types of striatal neurons successfully mimicked the target signal and the prediction signal. A linear summation of these two types of striatum neurons was a good fit for the activity of one type of tegmental neurons mimicking the TD-error signal. The present study thus demonstrates that the striatum and tegmentum can convey the signals critically required for the TD method. Based on the theoretical and neurophysiological studies, together with tract-tracing data, we propose a novel model to explain how the convergence of signals represented in the striatum could lead to the computation of TD error in tegmental dopaminergic neurons.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex.
(1930) · Archives of Neurology And Psychiatry · doi:10.1001/archneurpsyc.1930.02220110256018 · Cited by 2,673
Discrete coding of reward probability and uncertainty by dopamine neurons
Fiorillo, C. D., Tobler, P. N., & Schultz, W. (2003) · Science · doi:10.1126/science.1077349 · Cited by 2,085
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Conditioned Reflexes: an Investigation of the Physiological Activity of the Cerebral Cortex
DENNY-BROWN, D. (1928) · Nature · doi:10.1038/121662a0 · Cited by 1,836
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex
Pavlov, I. P. (2010) · Annals of neurosciences · doi:10.5214/ans.0972-7531.1017309 · Cited by 1,460
Cited by
Bryois, J., Skene, N. G., Hansen, T. F., Kogelman, L. J. A., Watson, H. J., Liu, Z., Eating Disorders Working Group of the Psychiatric Genomics Consortium, Adan, R., Alfredsson, L., Ando, T., et al. (2020) · Nature Genetics · doi:10.1038/s41588-020-0610-9 · Cited by 366
Alpha-synuclein oligomers: a new hope
Bengoa-Vergniory, N., Roberts, R. F., Wade-Martins, R., & Alegre-Abarrategui, J. (2017) · Acta Neuropathologica · doi:10.1007/s00401-017-1755-1 · Cited by 338
Alber, J., Goldfarb, D., Thompson, L. I., Arthur, E., Hernandez, K., Cheng, D., DeBuc, D. C., Cordeiro, F., Provetti‐Cunha, L., den Haan, J., et al. (2020) · Alzheimer's & Dementia · doi:10.1002/alz.12006 · Cited by 154
Naturalizing psychedelic spirituality
Letheby, C. (2017) · Zygon: Journal of Religion and Science · doi:10.1111/zygo.12353 · Cited by 18
A machine learning framework to optimize optic nerve electrical stimulation for vision restoration
Romeni, S., Zoccolan, D., & Micera, S. (2021) · Patterns · doi:10.1016/j.patter.2021.100286 · Cited by 17
Metadata
- Authors
- Wen, C., Ogura, Y., & Matsushima, T.
- Venue
- Frontiers in Neuroscience
- Publisher
- Frontiers Media SA
- Published
- 2016-11-08
- Volume
- 10
- Pages
- 476-476
- ISSN
- 1662-453X (ISSN-L)
- OpenAlex
- W2552043181
- Cited by
- 259
- References
- 62
- FWCI
- 23.46
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks. https://app.cochat.ai/papers/10.3389/fnins.2016.00476
- The paper
- Wen, C., Ogura, Y., & Matsushima, T. (2016). Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks. Frontiers in Neuroscience. https://doi.org/10.3389/fnins.2016.00476
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.