The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Reinforcement learning, conditioning, and the brain: Successes and challenges
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Advances in prospect theory: Cumulative representation of uncertainty
Tversky, A., & Kahneman, D. (1992) · Journal of Risk and Uncertainty · doi:10.1007/bf00122574 · Cited by 15,467
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
Plans and the structure of behavior.
Miller, G. A., Galanter, E., & Pribram, K. H. (1960) · doi:10.1037/10039-000 · Cited by 4,630
Cited by
Computational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Self-citationDolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Deep Learning for Intelligent Wireless Networks: A Comprehensive Survey
Mao, Q., Hu, F., & Hao, Q. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2846401 · Cited by 789
From reinforcement learning models to psychiatric and neurological disorders
Maia, T. V., & Frank, M. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2723 · Cited by 722
Self-citationReal-Time Self-Regulation of Emotion Networks in Patients with Depression
Linden, D. E. J., Habes, I., Johnston, S. J., Linden, S., Tatineni, R., Subramanian, L., Sorger, B., Healy, D., & Goebel, R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038115 · Cited by 437
Cognitive control over learning: Creating, clustering, and generalizing task-set structure.
Collins, A. G. E., & Frank, M. J. (2013) · Psychological Review · doi:10.1037/a0030852 · Cited by 426
The brain on art: intense aesthetic experience activates the default mode network
Vessel, E. A., Starr, G. G., & Rubin, N. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00066 · Cited by 383
Gold, J. M. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.1269 · Cited by 317
An integrative perspective on the role of dopamine in schizophrenia
Maia, T. V., & Frank, M. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.05.021 · Cited by 293
Goschke, T. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1410 · Cited by 293
Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration
Badre, D., Doll, B. B., Long, N. M., & Frank, M. J. (2012) · Neuron · doi:10.1016/j.neuron.2011.12.025 · Cited by 309
van den Bos, W., Cohen, M. X., Kahnt, T., & Crone, E. A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr198 · Cited by 276
Reinforcement signalling in Drosophila; dopamine does it all after all
Waddell, S. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2013.01.005 · Cited by 291
The Cognitive Architecture of Spatial Navigation: Hippocampal and Striatal Contributions
Chersi, F., & Burgess, N. (2015) · Neuron · doi:10.1016/j.neuron.2015.09.021 · Cited by 240
Digital Behaviour Change Interventions to Break and Form Habits
Pinder, C., Vermeulen, J., Cowan, B. R., & Beale, R. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3196830 · Cited by 235
Prediction error associated with the perceptual segmentation of naturalistic events
Zacks, J. M., Kurby, C. A., Eisenberg, M. L., & Haroutunian, N. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00078 · Cited by 202
Stimulus representation and the timing of reward-prediction errors in models of the dopamine system
Ludvig, E. A., Sutton, R. S., & Kehoe, E. J. (2008) · Neural Computation · doi:10.1162/neco.2008.11-07-654 · Cited by 148
Mind matters: placebo enhances reward learning in Parkinson's disease
Schmidt, L., Braun, E. K., Wager, T. D., & Shohamy, D. (2014) · Nature Neuroscience · doi:10.1038/nn.3842 · Cited by 84
Time representation in reinforcement learning models of the basal ganglia
Gershman, S. J., Moustafa, A. A., & Ludvig, E. A. (2014) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2013.00194 · Cited by 81
“…these features are represented by cortical Frontiers in Computational Neuroscience www.frontiersin.org January 2014 | Volume 7 | Article 194 | 1 COMPUTATIONAL NEUROSCIENCE inputs to the striatum, with the striatum itself encoding the estimated value (Maia, 2009; Niv, 2009; Ludvig et al., 2011).”
BackgroundInfluentialvan der Schaaf, M. E., Warmerdam, E., Crone, E. A., & Cools, R. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.06.007 · Cited by 70
The Role of Serotonin in Orbitofrontal Function and Obsessive-Compulsive Disorder
Maia, T. V., & Cano-Colino, M. (2015) · Clinical Psychological Science · doi:10.1177/2167702614566809 · Cited by 42
Self-citationClinical advances from a computational approach to anxiety
Pine, D. S. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.09.020 · Cited by 14
Metadata
- Authors
- Maia, T. V.
- Venue
- Cognitive, Affective, & Behavioral Neuroscience
- Published
- 2009-12
- Volume
- 9
- Issue
- 4
- Pages
- 343-364
- ISSN
- 1530-7026 (ISSN-L)
- 1531-135X
- OpenAlex
- W2027600189
- Cited by
- 187
- References
- 73
- FWCI
- 5.18
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.