The DOI matches its Crossref record; 280 of the 280 references it cites were found in a registry or an index.
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Abstract
The authors present a unified account of 2 neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a "generic" error-processing system associated with the anterior cingulate cortex. The existence of the error-processing system has been inferred from the error-related negativity (ERN), a component of the event-related brain potential elicited when human participants commit errors in reaction-time tasks. The authors propose that the ERN is generated when a negative reinforcement learning signal is conveyed to the anterior cingulate cortex via the mesencephalic dopamine system and that this signal is used by the anterior cingulate cortex to modify performance on the task at hand. They provide support for this proposal using both computational modeling and psychophysiological experimentation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, studies using fMRI and electrophysiological (error-related negativity) methods in humans, as well as single-unit electrophysiology in experimental animals, have identified the ACC to be a site of computation of prediction errors encoding the difference between expected and obtained outcomes of responding [115–117].”
From The role of prefrontal cortex in cognitive control and executive function (2022) · cites this paper as [116]
In the citing paper
“its functional meaning has shifted from a purely “negative feedback detector” toward a broader index of reinforcement-learning signals, reward prediction error, action–outcome evaluation, and reward positivity modulation [117,118,126,127,128,129].”
In the citing paper
“Classical reinforcement-learning models propose that unexpected unfavourable outcomes produce negative prediction-error signals that are conveyed through dopaminergic and medial-frontal systems and used to update future behaviour [117,118].”
In the citing paper
“In the broader ERP literature, response-locked performance monitoring is usually described as a sequence in which early medial-frontal activity detects conflict, error likelihood, or worse-than-expected outcomes, whereas later positive components support more conscious, evaluative, and metacognitive appraisal of the action that has just been executed [113,116,117,185,186,187].”
In the citing paper
“Earlier components such as ERN are often interpreted in terms of rapid conflict detection, reinforcement-learning signals, or medial-frontal alarm mechanisms, whereas later positive components appear more closely related to conscious appraisal, confidence, and adaptive updating [113,116,117,187].”
In the citing paper
“Unlike the prediction error signals associated with dopamine activity, which are largely reward-focused and associated with model-free RL (Holroyd and Coles, 2002), these respond to incorrect prediction of affectively neutral stimuli.”
From States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning (2010) · cites this paper as Holroyd and Coles, 2002
In the citing paper
“While anterior cingulate cortex was implicated in monitoring conflict between incompatible response processes35 or detecting performance errors36”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [36]
In the citing paper
“However, research and theory suggests that the P3 is more closely related to reward-seeking behaviors (‘wanting’) and the FRN to reward consumption (‘liking’ or ’disliking’) [88,89].”
From Social “wanting” dysfunction in autism: neurobiological underpinnings and treatment implications (2012) · cites this paper as [88]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(1994) · DigitalGeorgetown (Georgetown University Library) · Cited by 10,542
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
(1982) · Trends in Neurosciences · doi:10.1016/0166-2236(82)90076-5 · Cited by 9,150
DESCARTES' ERROR: Emotion, Reason, and the Human Brain
Marg, E. (1995) · Optometry and Vision Science · doi:10.1002/j.1538-9235.1995.tb03988.x · Cited by 8,178
Conflict monitoring and cognitive control
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.624 · Cited by 7,351
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230
The ten-twenty electrode system of the international federation
Jasper, H. H. (1958) · Electroencephalography and Clinical Neurophysiology · Cited by 6,567
Sokoloff, L., Reivich, M., Kennedy, C., Rosiers, M. H. D., Patlak, C. S., Pettigrew, K. D., Sakurada, O., & Shinohara, M. (1977) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1977.tb10649.x · Cited by 6,000
Learning to predict by the methods of temporal differences
Sutton, R. S. (1988) · Machine Learning · doi:10.1007/bf00115009 · Cited by 5,148
A new method for off-line removal of ocular artifact
Gratton, G., Coles, M. G. H., & Donchin, E. (1983) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(83)90135-9 · Cited by 5,055
Self-citationPredictive reward signal of dopamine neurons
Schultz, W. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.80.1.1 · Cited by 4,564
Attention to Action: Willed and Automatic Control of Behavior
Norman, D. A., & Shallice, T. (1986) · Consciousness and Self-Regulation · doi:10.1007/978-1-4757-0629-1_1 · Cited by 4,455
Classical conditioning II: Current research and theory.
Black, A. H., & Prokasy, W. F. (1972) · Appleton-Century-Crofts eBooks · Cited by 4,449
Functional architecture of basal ganglia circuits: neural substrates of parallel processing
Alexander, G. E., & Crutcher, M. D. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90107-l · Cited by 4,131
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Berridge, K. C., & Robinson, T. E. (1998) · Brain Research Reviews · doi:10.1016/s0165-0173(98)00019-8 · Cited by 4,127
Deciding advantageously before knowing the advantageous strategy
Bechara, A., Damasio, H., Tranel, D., & Damasio, A. R. (1997) · Science · doi:10.1126/science.275.5304.1293 · Cited by 3,547
Electroencephalography—Basic principles, clinical applications and related fields
(1982) · Journal of the Autonomic Nervous System · doi:10.1016/0165-1838(82)90067-4 · Cited by 3,449
Introduction to Electrodynamics
Griffiths, D. J. (2017) · Cambridge University Press eBooks · doi:10.1017/9781108333511 · Cited by 3,438
Contributions of anterior cingulate cortex to behaviour
Devinsky, O., Morrell, M. J., & Vogt, B. A. (1995) · Brain · doi:10.1093/brain/118.1.279 · Cited by 3,377
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273
Olds, J., & Milner, P. (1954) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0058775 · Cited by 3,176
A neural system for error detection and compensation
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00586.x · Cited by 2,862
Self-citationFrontal-subcortical circuits and human behavior
Cummings, J. L. (1993) · Archives of Neurology · doi:10.1001/archneur.1993.00540080076020 · Cited by 2,262
Multiple paired forward and inverse models for motor control
Wolpert, D. M., & Kawato, M. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00066-5 · Cited by 2,244
Effects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes
MILNER, B. (1963) · Archives of Neurology · doi:10.1001/archneur.1963.00460070100010 · Cited by 2,217
Stuss, D. T., & Benson, D. F. (1986) · Raven Press eBooks · Cited by 2,102
A framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066
Conflict monitoring versus selection-for-action in anterior cingulate cortex
Botvinick, M., Nystrom, L. E., Fissell, K., Carter, C. S., & Cohen, J. D. (1999) · Nature · doi:10.1038/46035 · Cited by 2,044
Introduction to Electrodynamics
Griffiths, D. J. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009397735 · Cited by 1,981
Wise, R. A., & Rompre, P.-P. (1989) · Annual Review of Psychology · doi:10.1146/annurev.ps.40.020189.001203 · Cited by 1,968
A neostriatal habit learning system in humans
Knowlton, B. J., Mangels, J. A., & Squire, L. R. (1996) · Science · doi:10.1126/science.273.5280.1399 · Cited by 1,777
Motor Areas of the Medial Wall: A Review of Their Location and Functional Activation
Picard, N., & Strick, P. L. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.3.342 · Cited by 1,712
Modulation of memory fields by dopamine Dl receptors in prefrontal cortex
Williams, G. V., & Goldman-Rakic, P. S. (1995) · Nature · doi:10.1038/376572a0 · Cited by 1,593
Practice-related Changes in Human Brain Functional Anatomy during Nonmotor Learning
Raichle, M. E., Fiez, J. A., Videen, T. O., MacLeod, A.-M. K., Pardo, J. V., Fox, P. T., & Petersen, S. E. (1994) · Cerebral Cortex · doi:10.1093/cercor/4.1.8 · Cited by 1,593
Corbetta, M., Miezin, F. M., Dobmeyer, S., Shulman, G. L., & Petersen, S. (1991) · Journal of Neuroscience · doi:10.1523/jneurosci.11-08-02383.1991 · Cited by 1,590
Miltner, W. H. R., Braun, C. H., & Coles, M. G. H. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.788 · Cited by 1,530
Self-citationThe neural basis of the central executive system of working memory
D’Esposito, M., Detre, J. A., Alsop, D. C., Shin, R. K., Atlas, S. W., & Grossman, M. (1995) · Nature · doi:10.1038/378279a0 · Cited by 1,520
Cognitive Deficit Caused by Regional Depletion of Dopamine in Prefrontal Cortex of Rhesus Monkey
Brozoski, T. J., Brown, R. M., Rosvold, H. E., & Goldman, P. S. (1979) · Science · doi:10.1126/science.112679 · Cited by 1,500
The working brain : an introduction to neuropsychology
Lurii︠a︡, A. R. (1973) · Medical Entomology and Zoology · Cited by 1,492
ERP components on reaction errors and their functional significance: A tutorial
Falkenstein, M., Hoormann, J., Christ, S., & Hohnsbein, J. (2000) · Biological Psychology · doi:10.1016/s0301-0511(99)00031-9 · Cited by 1,442 · cited 1×
“Over the past 10 years or so, we and others have elucidated the nature of the system that generates the ERN, both in terms of structure and function (for reviews, see Coles, Scheffers, & Hol-royd, 1998; Falkenstein, Hoormann, Christ, & Hohnsbein, 2000; Gehring, Coles, Meyer, & Donchin, 1995).”
BackgroundLocalization of Cognitive Operations in the Human Brain
Posner, M. I., Petersen, S. E., Fox, P. T., & Raichle, M. E. (1988) · Science · doi:10.1126/science.3289116 · Cited by 1,436
FMRI visualization of brain activity during a monetary incentive delay task
Knutson, B., Westdorp, A., Kaiser, E., & Hommer, D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0593 · Cited by 1,414
Consciousness and Self-Regulation
SCHWARTZ, G. E. R., & Shapiro, D. L. (1978) · Springer eBooks · doi:10.1007/978-1-4684-2571-0 · Cited by 1,370
D1 Dopamine Receptors in Prefrontal Cortex: Involvement in Working Memory
Sawaguchi, T., & Goldman-Rakic, P. S. (1991) · Science · doi:10.1126/science.1825731 · Cited by 1,364
A neuronal model of a global workspace in effortful cognitive tasks
Dehaene, S., Kerszberg, M., & Changeux, J.-P. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.24.14529 · Cited by 1,347
The Basal Ganglia and Adaptive Motor Control
Graybiel, A. M., Aosaki, T., Flaherty, A. W., & Kimura, M. (1994) · Science · doi:10.1126/science.8091209 · Cited by 1,324
Relative reward preference in primate orbitofrontal cortex
Tremblay, L., & Schultz, W. (1999) · Nature · doi:10.1038/19525 · Cited by 1,314
Positron Emission Tomographic Studies of the Processing of Singe Words
Petersen, S. E., Fox, P. T., Posner, M. I., Mintun, M. A., & Raichle, M. E. (1989) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1989.1.2.153 · Cited by 1,298
Schultz, W., Apicella, P., & Ljungberg, T. (1993) · The Journal of Neuroscience · doi:10.1523/jneurosci.13-03-00900.1993 · Cited by 1,291
Localization of a Neural System for Error Detection and Compensation
Dehaene, S., Posner, M. I., & Tucker, D. M. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00630.x · Cited by 1,255
Motor sequence learning: a study with positron emission tomography
Jenkins, I., Brooks, D. J., Nixon, P., Frackowiak, R. S. J., & Passingham, R. E. (1994) · Journal of Neuroscience · doi:10.1523/jneurosci.14-06-03775.1994 · Cited by 1,201
Models of Information Processing in the Basal Ganglia
(1994) · doi:10.7551/mitpress/4708.001.0001 · Cited by 1,190
Neurobehavioural mechanisms of reward and motivation
Robbins, T. W., & Everitt, B. J. (1996) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(96)80077-8 · Cited by 1,187
Nieuwenhuis, S., Ridderinkhof, K. R., Blom, J., Band, G. P. H., & Kok, A. (2001) · Psychophysiology · doi:10.1111/1469-8986.3850752 · Cited by 1,170
Dopamine neurons report an error in the temporal prediction of reward during learning
Hollerman, J. R., & Schultz, W. (1998) · Nature Neuroscience · doi:10.1038/1124 · Cited by 1,161
Abercrombie, E. D., Keefe, K. A., DiFrischia, D. S., & Zigmond, M. J. (1989) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.1989.tb09224.x · Cited by 1,106
Dissociation Of Working Memory from Decision Making within the Human Prefrontal Cortex
Bechara, A., Damásio, H., Tranel, D., & Anderson, S. W. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-01-00428.1998 · Cited by 1,080
Smith, A. D., & Bolam, J. P. (1990) · Trends in Neurosciences · doi:10.1016/0166-2236(90)90106-k · Cited by 1,040
Dopamine responses comply with basic assumptions of formal learning theory
Waelti, P., Dickinson, A., & Schultz, W. (2001) · Nature · doi:10.1038/35083500 · Cited by 1,018
Anterior Cingulate Cortex and Response Conflict: Effects of Frequency, Inhibition and Errors
Braver, T. S. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.9.825 · Cited by 1,016
Rolls, E. T., Hornak, J., Wade, D., & McGrath, J. (1994) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.57.12.1518 · Cited by 1,005
Self-initiated versus externally triggered movements
Jahanshahi, M., Jenkins, I. H., Brown, R. G., MARSDEN, C. D., Passingham, R. E., & Brooks, D. J. (1995) · Brain · doi:10.1093/brain/118.4.913 · Cited by 999
Responses of monkey dopamine neurons during learning of behavioral reactions
Ljungberg, T., Apicella, P., & Schultz, W. (1992) · Journal of Neurophysiology · doi:10.1152/jn.1992.67.1.145 · Cited by 987
Perspectives on Perception and Action
(2016) · Routledge eBooks · doi:10.4324/978131562799 · Cited by 925
Willed action and the prefrontal cortex in man: a study with PET
Frith, C., Friston, K. J., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1991.0077 · Cited by 919
Parasuraman, R. (1998) · Cited by 917
Prefrontal–cingulate interactions in action monitoring
Gehring, W. J., & Knight, R. T. (2000) · Nature Neuroscience · doi:10.1038/74899 · Cited by 912
The problem of the frontal lobe: A reinterpretation
Nauta, W. J. H. (1971) · Journal of Psychiatric Research · doi:10.1016/0022-3956(71)90017-3 · Cited by 903
Cortical areas and the selection of movement: a study with positron emission tomography
Deiber, M., Passingham, R. E., Colebatch, J. G., Friston, K. J., Nixon, P. D., & Frackowiak, R. S. J. (1991) · Experimental Brain Research · doi:10.1007/bf00231461 · Cited by 895
Rogers, R. D., Owen, A. M., Middleton, H. C., Williams, E., Pickard, J. D., Sahakian, B. J., & Robbins, T. W. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-20-09029.1999 · Cited by 882
Interactions between frontal cortex and basal ganglia in working memory: A computational model
FRANK, M. J., LOUGHRY, B., & O'REILLY, R. C. (2001) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.1.2.137 · Cited by 879
The orbitofrontal cortex: Neuronal activity in the behaving monkey
Thorpe, S. J., Rolls, E. T., & Maddison, S. (1983) · Experimental Brain Research · doi:10.1007/bf00235545 · Cited by 836
Paus, T., Petrides, M., Evans, A. C., & Meyer, E. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.70.2.453 · Cited by 834
Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli
Mirenowicz, J., & Schultz, W. (1996) · Nature · doi:10.1038/379449a0 · Cited by 829
TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level Play
Tesauro, G. J. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.215 · Cited by 821
Dopamine neurons and their role in reward mechanisms
Schultz, W. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80007-4 · Cited by 809
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 801
Zahrt, J., Taylor, J. R., Mathew, R. G., & Arnsten, A. F. T. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-21-08528.1997 · Cited by 796
A Network Model of Catecholamine Effects: Gain, Signal-to-Noise Ratio, and Behavior
Servan‐Schreiber, D., Printz, H., & Cohen, J. D. (1990) · Science · doi:10.1126/science.2392679 · Cited by 783
Human cingulate cortex: Surface features, flat maps, and cytoarchitecture
Vogt, B. A., Nimchinsky, E. A., Vogt, L. J., & Hof, P. R. (1995) · Journal of Comparative Neurology · doi:10.1002/cne.903590310 · Cited by 745
Self-initiated versus externally triggered movements
Jenkins, I. H., Jahanshahi, M., Jueptner, M., Passingham, R. E., & Brooks, D. J. (2000) · Brain · doi:10.1093/brain/123.6.1216 · Cited by 744
The recent excitement about neural networks
Crick, F. (1989) · Nature · doi:10.1038/337129a0 · Cited by 740
Predictability modulates human brain response to reward
Berns, G. S., McClure, S. M., Pagnoni, G., & Montague, P. R. (2001) · The Journal of Neuroscience · doi:10.1523/jneurosci.21-08-02793.2001 · Cited by 711
Ullsperger, M., & von Cramon, D. Y. (2001) · NeuroImage · doi:10.1006/nimg.2001.0935 · Cited by 702
Error processing and the rostral anterior cingulate: An event-related fMRI study
Kiehl, K. A., Liddle, P. F., & Hopfinger, J. B. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720216 · Cited by 676
Cerebral glucose metabolism in childhood-onset obsessive-compulsive disorder
Swedo, S. E. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810060038007 · Cited by 671
Action-Monitoring Dysfunction in Obsessive-Compulsive Disorder
Gehring, W. J., Himle, J., & Nisenson, L. G. (2000) · Psychological Science · doi:10.1111/1467-9280.00206 · Cited by 670
Frith, C. D., Friston, K. J., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Neuropsychologia · doi:10.1016/0028-3932(91)90029-8 · Cited by 656
Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward
Shima, K., & Tanji, J. (1998) · Science · doi:10.1126/science.282.5392.1335 · Cited by 645
Motor control : concepts and issues
Issues, Humphrey, D. R., & Freund, H. ‐. (1991) · Wiley eBooks · Cited by 644
Expectation of reward modulates cognitive signals in the basal ganglia
Kawagoe, R., Takikawa, Y., & Hikosaka, O. (1998) · Nature Neuroscience · doi:10.1038/1625 · Cited by 643
Neuroleptic-Induced "Anhedonia" in Rats: Pimozide Blocks Reward Quality of Food
Wise, R. A., Spindler, J., de Wit, H., & Gerberg, G. J. (1978) · Science · doi:10.1126/science.566469 · Cited by 636
Diamond, A., & Goldman-Rakic, P. S. (1989) · Experimental Brain Research · doi:10.1007/bf00248277 · Cited by 628
Psychophysiological brain research.
BRUNIA, C. H. M., Gaillard, A., & Kok, A. (1993) · UvA-DARE (University of Amsterdam) · Cited by 622
Dopaminergic innervation of the cerebral cortex: unexpected differences between rodents and primates
Berger, B., Gaspar, P., & Verney, C. (1991) · Trends in Neurosciences · doi:10.1016/0166-2236(91)90179-x · Cited by 588
Efferent connections of the cingulate gyrus in the rhesus monkey
Pandya, D. Ν., Hoesen, G. W. V., & Mesulam, M. M. (1981) · Experimental Brain Research · doi:10.1007/bf00237497 · Cited by 579
THE WORKING BRAIN (AN INTRODUCTION TO NEUROPSYCHOLOGY)
Draper, I. T. (1974) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.37.3.361-b · Cited by 561
The mesolimbic dopamine system : from motivation to action
Willner, P., & Scheel‐Krüger, J. (1991) · Wiley eBooks · Cited by 556
A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement
Houk, J. C., Adams, J. L., & Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0020 · Cited by 554
Fundamentals if dipole source potential analysis
Scherg, M. (1990) · Max Planck Institute for Plasma Physics · Cited by 530
Further Evidence for Dementia of the Prefrontal Type in Schizophrenia?
Goldberg, T. E. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800230088014 · Cited by 521
Learning and Computational Neuroscience: Foundations of Adaptive Networks
Gabriel, M., & Moore, J. (1990) · Cited by 518
Is the “error negativity” specific to errors?
Vidal, F., Hasbroucq, T., Grapperon, J., & Bonnet, M. (2000) · Biological Psychology · doi:10.1016/s0301-0511(99)00032-0 · Cited by 517
Pfeifer, R., Soulié, F. F., Steels, L., & Schreter, Z. (1989) · Elsevier eBooks · Cited by 514
Jacobs, R. A., Jordan, M. I., & Barto, A. G. (1991) · Cognitive Science · doi:10.1207/s15516709cog1502_2 · Cited by 514
Prefrontal and cingulate unit activity during timing behavior in the monkey
Niki, H., & Watanabe, M. (1979) · Brain Research · doi:10.1016/0006-8993(79)90328-7 · Cited by 511
Is the short-latency dopamine response too short to signal reward error?
Redgrave, P., Prescott, T. J., & Gurney, K. (1999) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01373-3 · Cited by 506
Time-Derivative Models of Pavlovian Reinforcement
Sutton, R. S., & Barto, A. G. (1990) · Cited by 501
Catecholamine regulation of the prefrontal cortex
Arnsten, A. F. T. (1997) · Journal of Psychopharmacology · doi:10.1177/026988119701100208 · Cited by 493
Multiple Nonprimary Motor Areas in the Human Cortex
Fink, G. R., Frackowiak, R. S. J., Pietrzyk, U., & Passingham, R. E. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.77.4.2164 · Cited by 484
Coles, M. G. H., Scheffers, M. K., & Holroyd, C. B. (2001) · Biological Psychology · doi:10.1016/s0301-0511(01)00076-x · Cited by 484
Self-citationAdaptive Critics and the Basal Ganglia
Barto, A. G. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0018 · Cited by 476
The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia
Calabresi, P., Pisani, A., Mercuri, N. B., & Bernardi, G. (1996) · Trends in Neurosciences · doi:10.1016/0166-2236(96)81862-5 · Cited by 462
Rugg, M. D., & COLES, M. G. H. (1996) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780198524168.001.0001 · Cited by 460
Self-citationThe neuropharmacological basis of reward
(1991) · General Pharmacology The Vascular System · doi:10.1016/0306-3623(91)90364-c · Cited by 456
Owen, A. M. (1997) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.1997.tb01487.x · Cited by 454
Frontal lobe and frontal-striatal substrates for different forms of human cognitive flexibility
Eslinger, P. J., & Grattan, L. M. (1993) · Neuropsychologia · doi:10.1016/0028-3932(93)90077-d · Cited by 449
The Frontal Cortex-Basal Ganglia System in Primates
Wise, S. P., Murray, E. A., & Gerfen, C. R. (1996) · Critical Reviews in Neurobiology · doi:10.1615/critrevneurobiol.v10.i3-4.30 · Cited by 437
Prefrontal connections of medial motor areas in the rhesus monkey
Bates, J. F., & Goldman, P. S. (1993) · The Journal of Comparative Neurology · doi:10.1002/cne.903360205 · Cited by 432
Dopamine synaptic complex with pyramidal neurons in primate cerebral cortex.
Goldman-Rakic, P. S., Leranth, C., Williams, S. M., Mons, N. E., & Geffard, M. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.22.9015 · Cited by 429
Obsessive-compulsive disorder in children and adolescents
Rapoport, J. L. (1989) · American Psychiatric Press eBooks · Cited by 418
Event-related brain potentials: an introduction
Coles, M. G. H., & Rugg, M. D. (1996) · Electrophysiology of Mind · doi:10.1093/acprof:oso/9780198524168.003.0001 · Cited by 396
Self-citationGaspar, P., Berger, B., Febvret, A., Vigny, A., & Henry, J. P. (1989) · Journal of Comparative Neurology · doi:10.1002/cne.902790208 · Cited by 395
Performance monitoring by the supplementary eye field
Stuphorn, V., Taylor, T. L., & Schall, J. D. (2000) · Nature · doi:10.1038/35048576 · Cited by 392
Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey
Eblen, F., & Graybiel, A. M. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-09-05999.1995 · Cited by 389
Medial Frontal Cortex in Action Monitoring
Luu, P., Flaisch, T., & Tucker, D. M. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-01-00464.2000 · Cited by 389
Murase, S., Grenhoff, J., Chouvet, G., Gonon, F. G., & Svensson, T. H. (1993) · Neuroscience Letters · doi:10.1016/0304-3940(93)90641-w · Cited by 387
Executive control of thought and action
Logan, G. D. (1985) · Acta Psychologica · doi:10.1016/0001-6918(85)90055-1 · Cited by 386
Neurobiology of cingulate cortex and limbic thalamus : a comprehensive handbook
Vogt, B. A., & Gabriel, M. (1993) · Medical Entomology and Zoology · Cited by 378
Dolan, R. J., Fletcher, P. C., Frith, C., Friston, K. J., Frackowiak, R. S. J., & Grasby, P. M. (1995) · Nature · doi:10.1038/378180a0 · Cited by 372
Human Cingulate and Paracingulate Sulci: Pattern, Variability, Asymmetry, and Probabilistic Map
Paus, T., Tomaiuolo, F., Otaky, N., MacDonald, D. J., Petrides, M., Atlas, J., Morris, R., & Evans, A. C. (1996) · Cerebral Cortex · doi:10.1093/cercor/6.2.207 · Cited by 372
Yang, C., & Seamans, J. K. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01922.1996 · Cited by 369
Dopaminergic A10 neurones are involved in cognitive functions
Simon, H., Scatton, B., & Moal, M. L. (1980) · Nature · doi:10.1038/286150a0 · Cited by 362
Holroyd, C. B., Dien, J., & COLES, M. G. H. (1998) · Neuroscience Letters · doi:10.1016/s0304-3940(98)00035-4 · Cited by 354
Self-citationEvent-related brain potentials in man
Callaway, E., Tueting, P. A., & Koslow, S. H. (1978) · Cited by 304
Anterior cingulate activity during routine and non-routine sequential behaviors in macaques
Procyk, E., Tanaka, Y. L., & Joseph, J. (2000) · Nature Neuroscience · doi:10.1038/74880 · Cited by 302
Cummings, J. L. (1998) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(98)00034-8 · Cited by 302
Barch, D. M., Braver, T. S., Sabb, F. W., & Noll, D. C. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562110 · Cited by 299
Brown, J. W., Bullock, D. H., & Grossberg, S. (1999) · Journal of Neuroscience · doi:10.1523/jneurosci.19-23-10502.1999 · Cited by 299
Wickens, J. R., Begg, A., & Arbuthnott, G. W. (1996) · Neuroscience · doi:10.1016/0306-4522(95)00436-m · Cited by 298
"Where did I go wrong?" A psychophysiological analysis of error detection.
Bernstein, P. S., Scheffers, M. K., & Coles, M. G. H. (1995) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037//0096-1523.21.6.1312 · Cited by 295
Self-citationSuri, R. E., & Schultz, W. (1999) · Neuroscience · doi:10.1016/s0306-4522(98)00697-6 · Cited by 294
Gariano, R. F., & Groves, P. M. (1988) · Brain Research · doi:10.1016/0006-8993(88)90606-3 · Cited by 286
Williams, S. M., & Goldman-Rakic, P. S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.3.199 · Cited by 284 · cited 4×
“Aswehave seen, the mesencephalic dopamine projection terminates diffusely in the human frontal cortex, but its output is focused over the frontal midline (i.e., anterior cingulate and supplementary motor area; Berger et al., 1991; Gaspar et al., 1989; S. M. Williams & Goldman-Rakic, 1993).”
BackgroundInfluentialConvergence of Limbic Input to the Cingulate Motor Cortex in the Rhesus Monkey
Morecraft, R. J., & Hoesen, G. W. V. (1998) · Brain Research Bulletin · doi:10.1016/s0361-9230(97)00344-4 · Cited by 280
Sensory and cognitive functions of the basal ganglia
Brown, L. L., Schneider, J. S., & Lidsky, T. I. (1997) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(97)80003-7 · Cited by 279
Connections of the Monkey Cingulate Cortex
Hoesen, G. W. V., Morecraft, R. J., & Vogt, B. A. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-6704-6_9 · Cited by 276
Koski, L. M., & Paus, T. (2000) · Experimental Brain Research · doi:10.1007/s002210000400 · Cited by 273
Value-dependent selection in the brain: Simulation in a synthetic neural model
Friston, K. J., Tononi, G., Reeke, G. N., Sporns, O., & Edelman, G. M. (1994) · Neuroscience · doi:10.1016/0306-4522(94)90592-4 · Cited by 268
Craniocerebral topography within the international 10–20 system
Steinmetz, H., Fürst, G., & Meyer, B.-U. (1989) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(89)90227-7 · Cited by 261
Latent inhibition of conditioned dopamine release in rat nucleus accumbens
Young, A. M. J., Joseph, M. H., & Gray, J. A. (1993) · Neuroscience · doi:10.1016/0306-4522(93)90378-s · Cited by 261
Scherg, M., & Picton, T. W. (1991) · PubMed · Cited by 254
McKenna, T. M., Davis, J. L., & Zornetzer, S. F. (1992) · Cited by 253
Miltner, W. H. R., Lemke, U., Weiß, T., Holroyd, C. B., Scheffers, M. K., & COLES, M. G. H. (2003) · Biological Psychology · doi:10.1016/s0301-0511(03)00107-8 · Cited by 252
Self-citationBunney, B. S., & Aghajanian, G. K. (1976) · Life Sciences · doi:10.1016/0024-3205(76)90087-4 · Cited by 250
Chronic exposure to low doses of MPTP. I. Cognitive deficits in motor asymptomatic monkeys
Schneider, J. S., & Kovelowski, C. J. (1990) · Brain Research · doi:10.1016/0006-8993(90)90069-n · Cited by 250
Response selection in the human anterior cingulate cortex
Turken, A. U., & Diane Swick, A. (1999) · Nature Neuroscience · doi:10.1038/13224 · Cited by 249
O'Reilly, R. C. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.3.246 · Cited by 241
Pirot, S., Godbout, R., Mantz, J., Tassin, J., Glowinski, J., & Thierry, A. M. (1992) · Neuroscience · doi:10.1016/0306-4522(92)90362-6 · Cited by 237
Modulatory role for biogenic amines in the cerebral cortex. Microiontophoretic studies
Reader, T. A., Ferron, A., Descarries, L., & Jasper, H. H. (1979) · Brain Research · doi:10.1016/0006-8993(79)90420-7 · Cited by 236
Single cell activity in ventral prefrontal cortex of behaving monkeys
Rosenkilde, C. E., Bauer, R. H., & Fuster, J. M. (1981) · Brain Research · doi:10.1016/0006-8993(81)90160-8 · Cited by 233
Stelmach, G. E., & Vroom, J. P. (1980) · Elsevier eBooks · Cited by 231
Auditory Evoked Magnetic Fields and Electric Potentials
Grandori, F., Hoke, M., & Romani, G. L. (1990) · KARGER eBooks · doi:10.1159/isbn.978-3-8055-5001-7 · Cited by 228
The Primate Substantia Nigra and VTA: Integrative Circuitry and Function
Haber, S. N., & Fudge, J. L. (1997) · Critical Reviews in Neurobiology · doi:10.1615/critrevneurobiol.v11.i4.40 · Cited by 228
A more biologically plausible learning rule for neural networks.
Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.88.10.4433 · Cited by 227
Ferron, A., Thierry, A. M., Douarin, C. L., & Glowinski, J. (1984) · Brain Research · doi:10.1016/0006-8993(84)90238-5 · Cited by 222
Selection for Action: Some Behavioral and Neurophysiological Considerations of Attention and Action
Allport, A. (2016) · Routledge eBooks · doi:10.4324/978131562799-25 · Cited by 209
Ventromedial prefrontal cortex mediates guessing
Elliott, R., Rees, G. E., & Dolan, R. J. (1999) · Neuropsychologia · doi:10.1016/s0028-3932(98)00107-9 · Cited by 203
Guarraci, F. A., & Kapp, B. S. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(98)00102-8 · Cited by 201
Toni, I., & Passingham, R. E. (1999) · Experimental Brain Research · doi:10.1007/s002210050770 · Cited by 201
Dopamine Decreases the Excitability of Layer V Pyramidal Cells in the Rat Prefrontal Cortex
Gulledge, A. T., & Jaffe, D. B. (1998) · Journal of Neuroscience · doi:10.1523/jneurosci.18-21-09139.1998 · Cited by 201
Learning of sequential movements by neural network model with dopamine-like reinforcement signal
Suri, R. E., & Schultz, W. (1998) · Experimental Brain Research · doi:10.1007/s002210050467 · Cited by 198
Anterior cingulate cortex and the medial pain system,
Vogt, B. A., Sikes, R. W., & Vogt, L. J. (1993) · Neurobiology of Cingulate Cortex and Limbic Thalamus · doi:10.1007/978-1-4899-6704-6_11 · Cited by 196
Dopamine facilitates long-term depression of glutamatergic transmission in rat prefrontal cortex
Otani, S., Blond, O., Desce, J. M., & Crépel, F. (1998) · Neuroscience · doi:10.1016/s0306-4522(97)00677-5 · Cited by 196
Connell, J. H., & Mahadevan, S. (1993) · Cited by 192
Elevated medial-frontal cerebral blood flow in obsessive-compulsive patients: a SPECT study
Machlin, S. R., Harris, G. J., Pearlson, G. D., Hoehn‐Saric, R., Jeffery, P., & Camargo, E. E. (1991) · American Journal of Psychiatry · doi:10.1176/ajp.148.9.1240 · Cited by 189
Neuropsychology of human emotion
Satz, P., & Heilman, K. M. (1983) · Guilford Press eBooks · Cited by 189
Pratt, W. E., & Mizumori, S. J. Y. (2001) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00204-2 · Cited by 187
Law-Tho, D., Hirsch, J. C., & Crépel, F. (1994) · Neuroscience Research · doi:10.1016/0168-0102(94)90157-0 · Cited by 182
THE FUNCTIONAL NEUROANATOMY OF EVENT RELATED POTENTIALS
Goff, W. R., Allison, T., & Vaughan, H. G. (1978) · Elsevier eBooks · doi:10.1016/b978-0-12-155150-6.50007-9 · Cited by 178
Obsessive-compulsive disorder: evidence for basal ganglia dysfunction.
Jl, R., & Sp, W. (1988) · PubMed · Cited by 176
‘Error’ potentials in limbic cortex (anterior cingulate area 24) of monkeys during motor learning
Gemba, H., Sasaki, K., & Brooks, V. B. (1986) · Neuroscience Letters · doi:10.1016/0304-3940(86)90467-2 · Cited by 176
TD(?) converges with probability 1
Dayan, P., & B, T. J. S. A. (1994) · Machine Learning · doi:10.1023/a:1022657612745 · Cited by 174
Differential modulation by dopamine of responses evoked by excitatory amino acids in human cortex
Cepeda, C., Radisavljevic, Z., Peacock, W. J., Levine, M. S., & Buchwald, N. A. (1992) · Synapse · doi:10.1002/syn.890110408 · Cited by 172
Preserved Adjustment but Impaired Awareness in a Sensory-Motor Conflict following Prefrontal Lesions
Slachevsky, A., Pillon, B., Fourneret, P., Pradat-Diehl, P., Jeannerod, M., & Dubois, B. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/08989290151137386 · Cited by 172
Elliott, R., & Dolan, R. J. (1998) · NeuroImage · doi:10.1006/nimg.1998.0344 · Cited by 170
Cellular Models of Reinforcement
Wickens, J. R., & Kötter, R. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0017 · Cited by 168
Louilot, A., Moal, M. L., & Simon, H. (1986) · Brain Research · doi:10.1016/0006-8993(86)90646-3 · Cited by 168
Temporal Difference Model Reproduces Anticipatory Neural Activity
Suri, R. E., & Schultz, W. (2001) · Neural Computation · doi:10.1162/089976601300014376 · Cited by 166
Dum, R. P., & Strick, P. L. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-6704-6_15 · Cited by 165
Perspectives of Event-Related Potentials Research
Karmos, G. (1995) · Medical Entomology and Zoology · Cited by 165
Wise, R. A. (1989) · Annual Review of Psychology · doi:10.1146/annurev.psych.40.1.191 · Cited by 164
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1993) · doi:10.21236/ada276517 · Cited by 161
Richardson, N. R., & Gratton, A. P. (1996) · Journal of Neuroscience · doi:10.1523/jneurosci.16-24-08160.1996 · Cited by 160
Discriminative Avoidance Learning: A Model System
Gabriel, M. (1993) · Birkhäuser Boston eBooks · doi:10.1007/978-1-4899-6704-6_18 · Cited by 155
Svensson, T. H., & TUNG, C. ‐. (1989) · Acta Physiologica Scandinavica · doi:10.1111/j.1748-1716.1989.tb08640.x · Cited by 155
Reward-related Signals Carried by Dopamine Neurons
Schultz, W., Romo, R., Ljungberg, T., Mirenowicz, J., Hollerman, J. R., & Dickinson, A. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4708.003.0019 · Cited by 154
Cited by
Sorted by citations
Meeting of minds: the medial frontal cortex and social cognition
Amodio, D. M., & Frith, C. D. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1884 · Cited by 3,782
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
The role of the medial frontal cortex in cognitive control
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004) · Science · doi:10.1126/science.1100301 · Cited by 2,974
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726
Influence of cognitive control and mismatch on the N2 component of the ERP: A review
Folstein, J. R., & Van Petten, C. (2008) · Psychophysiology · doi:10.1111/j.1469-8986.2007.00602.x · Cited by 2,567
Metadata
- Authors
- Holroyd, C. B., & Coles, M. G. H.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- ORCID
- Holroyd, Clay B.
- Venue
- Psychological Review
- Published
- 2002-10
- Volume
- 109
- Issue
- 4
- Pages
- 679-709
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2135572147
- Semantic Scholar
- a497b6f27fa708805f5dab7b7470509e72deb8b2
- Cited by
- 4,027
- References
- 280
- Citations by year
- 2026: 125 · 2025: 172 · 2024: 145 · 2023: 138 · 2022: 152 · 2021: 193 · 2020: 188 · 2019: 188 · 2018: 220 · 2017: 219 · 2016: 218 · 2015: 246 · 2014: 244 · 2013: 219 · 2012: 204
- FWCI
- 30.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh041445-13, 5f31mh011530-04)
- National Institute of Mental Health (MH41445, MH11530)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Arts and Humanities › Philosophy › Free Will and Agency
- Keywords
- error processing, error-related negativity, reinforcement learning, dopamine, anterior cingulate cortex, negative reinforcement, adaptive behavior, event-related potentials, reaction time task, computational modeling
- MeSH terms
- Analysis of Variance, Brain Mapping, Dopamine, Humans, Models, Neurological, Motor Cortex, Probability Learning, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
