The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Behavioral Variability through Stochastic Choice and Its Gating by Anterior Cingulate Cortex
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Equilibrium points in n -person games
Nash, J. F. (1950) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.36.1.48 · Cited by 7,560
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764
Faisal, A. A., Selen, L. P. J., & Wolpert, D. M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2258 · Cited by 2,883
Cortical substrates for exploratory decisions in humans
Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006) · Nature · doi:10.1038/nature04766 · Cited by 2,224
Armbruster, B. N., Li, X., Pausch, M. H., Herlitze, S., & Roth, B. L. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700293104 · Cited by 2,046
Uncertainty, Neuromodulation, and Attention
Yu, A. J., & Dayan, P. (2005) · Neuron · doi:10.1016/j.neuron.2005.04.026 · Cited by 1,774 · cited 1×
“See also Figure S1. and Nieuwenhuis, 2011; Nassar et al., 2012; Payzan-LeNestour et al., 2013; Yu and Dayan, 2005), raising the possibility that modulation of ACC’s model-encoding circuits by the input from the noradrenergic system underlies the release of behavior from the control of an internal…”
Sutton, R. S. (1990) · Machine Learning Proceedings 1990 · doi:10.1016/b978-1-55860-141-3.50030-4 · Cited by 1,314
Probabilistic decision making by slow reverberation in cortical circuits
Wang, X.-J. (2002) · Neuron · doi:10.1016/s0896-6273(02)01092-9 · Cited by 1,242
Cohen, J. D., McClure, S. M., & Yu, A. J. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2098 · Cited by 1,121
Rational regulation of learning dynamics by pupil-linked arousal systems
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., & Gold, J. I. (2012) · Nature Neuroscience · doi:10.1038/nn.3130 · Cited by 722
Witten, I. B., Steinberg, E. E., Lee, S. Y., Davidson, T. J., Zalocusky, K. A., Brodsky, M., Yizhar, O., Cho, S. L., Gong, S., Ramakrishnan, C., et al. (2011) · Neuron · doi:10.1016/j.neuron.2011.10.028 · Cited by 680
Prefrontal cortex and decision making in a mixed-strategy game
Barraclough, D. J., Conroy, M. L., & Lee, D. (2004) · Nature Neuroscience · doi:10.1038/nn1209 · Cited by 678
Motivation of extended behaviors by anterior cingulate cortex
Holroyd, C. B., & Yeung, N. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.008 · Cited by 618
The learning curve: Implications of a quantitative analysis
Gallistel, C. R., Fairhurst, S., & Balsam, P. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0404965101 · Cited by 613
Nassar, M. R., Wilson, R. C., Heasly, B., & Gold, J. I. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0822-10.2010 · Cited by 560
Neuronal basis of sequential foraging decisions in a patchy environment
Hayden, B. Y., Pearson, J. M., & Platt, M. L. (2011) · Nature Neuroscience · doi:10.1038/nn.2856 · Cited by 518
Contributions of an avian basal ganglia–forebrain circuit to real-time modulation of song
Kao, M. H., Doupe, A. J., & Brainard, M. S. (2005) · Nature · doi:10.1038/nature03127 · Cited by 513
Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit
Ölveczky, B. P., Andalman, A. S., & Fee, M. S. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030153 · Cited by 501
Inference about the change-point from cumulative sum tests
HINKLEY, D. V. (1971) · Biometrika · doi:10.1093/biomet/58.3.509 · Cited by 460
Martin, J. H. (1991) · Neuroscience Letters · doi:10.1016/0304-3940(91)90784-q · Cited by 459
Bayesian theories of conditioning in a changing world
Courville, A. C., Daw, N. D., & Touretzky, D. S. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.004 · Cited by 457
Jepma, M., & Nieuwenhuis, S. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21548 · Cited by 439
Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex
Buschman, T. J., Denovellis, E. L., Diogo, C., Bullock, D., & Miller, E. K. (2012) · Neuron · doi:10.1016/j.neuron.2012.09.029 · Cited by 436
Dorris, M. C., & Glimcher, P. W. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.009 · Cited by 427
Neuronal correlates of goal-based motor selection in the prefrontal cortex.
Matsumoto, K., Suzuki, W., & Tanaka, K. (2003) · Science · doi:10.1126/science.1084204 · Cited by 384
Dissociable effects of surprise and model update in parietal and anterior cingulate cortex
O’Reilly, J. X., Schüffelgen, U., Cuell, S. F., Behrens, T. E. J., Mars, R. B., & Rushworth, M. F. S. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1305373110 · Cited by 378
Page, S., & Neuringer, A. (1985) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037//0097-7403.11.3.429 · Cited by 318
Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability
Beck, J. M., Ma, W. J., Pitkow, X., Latham, P. E., & Pouget, A. (2012) · Neuron · doi:10.1016/j.neuron.2012.03.016 · Cited by 316
The evolution of aggression: can selection generate variability?
Smith, J. M., & Harper, D. G. C. (1988) · Philosophical Transactions of the Royal Society of London. B, Biological Sciences · doi:10.1098/rstb.1988.0065 · Cited by 297
The neural representation of unexpected uncertainty during value-based decision making
Payzan-LeNestour, E., Dunne, S., Bossaerts, P., & O’Doherty, J. P. (2013) · Neuron · doi:10.1016/j.neuron.2013.04.037 · Cited by 257
Network Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty
Karlsson, M. P., Tervo, D. G. R., & Karpova, A. Y. (2012) · Science · doi:10.1126/science.1226518 · Cited by 236
Self-citationA hypothesis for basal ganglia-dependent reinforcement learning in the songbird
Fee, M. S., & Goldberg, J. H. (2011) · Neuroscience · doi:10.1016/j.neuroscience.2011.09.069 · Cited by 228
Trudeau, L.-E., Emery, D. G., & Haydon, P. G. (1996) · Neuron · doi:10.1016/s0896-6273(00)80210-x · Cited by 228
Page, S., & Neuringer, A. (1985) · Journal of Experimental Psychology: Animal Behavior Processes · doi:10.1037/0097-7403.11.3.429 · Cited by 203
Resolution of Uncertainty in Prefrontal Cortex
Yoshida, W., & Ishii, S. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.006 · Cited by 197
Devoto, P., Flore, G., Pani, L., & Gessa, G. L. (2001) · Molecular Psychiatry · doi:10.1038/sj.mp.4000904 · Cited by 196
A Neural Signature of Hierarchical Reinforcement Learning
Ribas-Fernandes, J. J. F., Solway, A., Diuk, C., McGuire, J. T., Barto, A. G., Niv, Y., & Botvinick, M. M. (2011) · Neuron · doi:10.1016/j.neuron.2011.05.042 · Cited by 195
Ubiquity and Specificity of Reinforcement Signals throughout the Human Brain
Vickery, T. J., Chun, M. M., & Lee, D. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.011 · Cited by 189
Xu, Z.-Q. D., Shi, T.-J. S., & H�kfelt, T. (1998) · The Journal of Comparative Neurology · doi:10.1002/(sici)1096-9861(19980309)392:2<227::aid-cne6>3.0.co;2-4 · Cited by 186
Abe, H., & Lee, D. (2011) · Neuron · doi:10.1016/j.neuron.2011.03.026 · Cited by 167
Neuronal Origins of Choice Variability in Economic Decisions
Padoa-Schioppa, C. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.013 · Cited by 163
Reinforcement learning and decision making in monkeys during a competitive game
Lee, D., Conroy, M. L., McGreevy, B. P., & Barraclough, D. J. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.07.007 · Cited by 156
Zhu, L., Mathewson, K. E., & Hsu, M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116783109 · Cited by 125 · cited 7×
“Indeed, studies in primates support the idea that competition triggers model-based counterprediction rather than stochastic choice (Abe and Lee, 2011; Zhu et al., 2012).”
InfluentialLearning and decision making in monkeys during a rock–paper–scissors game
Lee, D., McGreevy, B. P., & Barraclough, D. J. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.07.003 · Cited by 122
Maximov, A., Shin, O., Liu, X., & Südhof, T. C. (2006) · The Journal of Cell Biology · doi:10.1083/jcb.200607021 · Cited by 113
Alterations in choice behavior by manipulations of world model
Green, C. S., Benson, C., Kersten, D., & Schrater, P. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1001709107 · Cited by 91
A chemical-genetic approach for precise spatio-temporal control of cellular signaling
Dong, S., Allen, J., Farrell, M. S., & Roth, B. L. (2010) · Molecular BioSystems · doi:10.1039/c002568m · Cited by 55
Functional neuroanatomy of learned helplessness
Bauer, H., Pripfl, J., Lamm, C., Prainsack, C., & Taylor, N. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00363-x · Cited by 47
The prefrontal cortex and hybrid learning during iterative competitive games
Abe, H., Seo, H., & Lee, D. (2011) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2011.06223.x · Cited by 13
Cited by
Locus coeruleus: a new look at the blue spot
Poe, G. R., Foote, S., Eschenko, O., Johansen, J. P., Bouret, S., Aston-Jones, G., Harley, C. W., Manahan-Vaughan, D., Weinshenker, D., Valentino, R., et al. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0360-9 · Cited by 720
CRH Engagement of the Locus Coeruleus Noradrenergic System Mediates Stress-Induced Anxiety
McCall, J. G., Al-Hasani, R., Siuda, E. R., Hong, D. Y., Norris, A. J., Ford, C. P., & Bruchas, M. R. (2015) · Neuron · doi:10.1016/j.neuron.2015.07.002 · Cited by 666
Pupil Size as a Window on Neural Substrates of Cognition
Joshi, S., & Gold, J. I. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.03.005 · Cited by 598
Motor Cortex Is Required for Learning but Not for Executing a Motor Skill
Kawai, R., Markman, T., Poddar, R., Ko, R., Fantana, A. L., Dhawale, A. K., Kampff, A. R., & Ölveczky, B. P. (2015) · Neuron · doi:10.1016/j.neuron.2015.03.024 · Cited by 559
Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias
Urai, A. E., Braun, A., & Donner, T. H. (2017) · Nature Communications · doi:10.1038/ncomms14637 · Cited by 466
Metadata
- Authors
- Tervo, D. G. R., Proskurin, M., Manakov, M., Kabra, M., Vollmer, A., Branson, K., & Karpova, A. Y.
- Venue
- Cell
- Publisher
- Elsevier BV
- Published
- 2014-09
- Volume
- 159
- Issue
- 1
- Pages
- 21-32
- ISSN
- 0092-8674 (ISSN-L)
- OpenAlex
- W2029057113
- Cited by
- 280
- References
- 54
- FWCI
- 8.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.