The DOI matches its Crossref record; 280 of the 280 references it cites were found in a registry or an index.
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
Abstract
The authors present a unified account of 2 neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a "generic" error-processing system associated with the anterior cingulate cortex. The existence of the error-processing system has been inferred from the error-related negativity (ERN), a component of the event-related brain potential elicited when human participants commit errors in reaction-time tasks. The authors propose that the ERN is generated when a negative reinforcement learning signal is conveyed to the anterior cingulate cortex via the mesencephalic dopamine system and that this signal is used by the anterior cingulate cortex to modify performance on the task at hand. They provide support for this proposal using both computational modeling and psychophysiological experimentation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, studies using fMRI and electrophysiological (error-related negativity) methods in humans, as well as single-unit electrophysiology in experimental animals, have identified the ACC to be a site of computation of prediction errors encoding the difference between expected and obtained outcomes of responding [115–117].”
From The role of prefrontal cortex in cognitive control and executive function (2022) · cites this paper as [116]
In the citing paper
“its functional meaning has shifted from a purely “negative feedback detector” toward a broader index of reinforcement-learning signals, reward prediction error, action–outcome evaluation, and reward positivity modulation [117,118,126,127,128,129].”
In the citing paper
“Classical reinforcement-learning models propose that unexpected unfavourable outcomes produce negative prediction-error signals that are conveyed through dopaminergic and medial-frontal systems and used to update future behaviour [117,118].”
In the citing paper
“In the broader ERP literature, response-locked performance monitoring is usually described as a sequence in which early medial-frontal activity detects conflict, error likelihood, or worse-than-expected outcomes, whereas later positive components support more conscious, evaluative, and metacognitive appraisal of the action that has just been executed [113,116,117,185,186,187].”
In the citing paper
“Earlier components such as ERN are often interpreted in terms of rapid conflict detection, reinforcement-learning signals, or medial-frontal alarm mechanisms, whereas later positive components appear more closely related to conscious appraisal, confidence, and adaptive updating [113,116,117,187].”
In the citing paper
“Unlike the prediction error signals associated with dopamine activity, which are largely reward-focused and associated with model-free RL (Holroyd and Coles, 2002), these respond to incorrect prediction of affectively neutral stimuli.”
From States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning (2010) · cites this paper as Holroyd and Coles, 2002
In the citing paper
“While anterior cingulate cortex was implicated in monitoring conflict between incompatible response processes35 or detecting performance errors36”
From A reservoir of time constants for memory traces in cortical neurons (2011) · cites this paper as [36]
In the citing paper
“However, research and theory suggests that the P3 is more closely related to reward-seeking behaviors (‘wanting’) and the FRN to reward consumption (‘liking’ or ’disliking’) [88,89].”
From Social “wanting” dysfunction in autism: neurobiological underpinnings and treatment implications (2012) · cites this paper as [88]
Citations
Cites
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268
(1994) · DigitalGeorgetown (Georgetown University Library) · Cited by 10,542
A neural substrate of prediction and reward
Schultz, W., Dayan, P., & Montague, P. R. (1997) · Science · doi:10.1126/science.275.5306.1593 · Cited by 9,388
(1982) · Trends in Neurosciences · doi:10.1016/0166-2236(82)90076-5 · Cited by 9,150
DESCARTES' ERROR: Emotion, Reason, and the Human Brain
Marg, E. (1995) · Optometry and Vision Science · doi:10.1002/j.1538-9235.1995.tb03988.x · Cited by 8,178
Conflict monitoring and cognitive control
Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001) · Psychological Review · doi:10.1037/0033-295x.108.3.624 · Cited by 7,351
Rescorla, R. A. (1972) · Medical Entomology and Zoology · Cited by 7,268
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230
The ten-twenty electrode system of the international federation
Jasper, H. H. (1958) · Electroencephalography and Clinical Neurophysiology · Cited by 6,567
Cited by
Sorted by citations
Meeting of minds: the medial frontal cortex and social cognition
Amodio, D. M., & Frith, C. D. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1884 · Cited by 3,782
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623
The role of the medial frontal cortex in cognitive control
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., & Nieuwenhuis, S. (2004) · Science · doi:10.1126/science.1100301 · Cited by 2,974
Frontal theta as a mechanism for cognitive control
Cavanagh, J. F., & Frank, M. J. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.04.012 · Cited by 2,726
Influence of cognitive control and mismatch on the N2 component of the ERP: A review
Folstein, J. R., & Van Petten, C. (2008) · Psychophysiology · doi:10.1111/j.1469-8986.2007.00602.x · Cited by 2,567
Metadata
- Authors
- Holroyd, C. B., & Coles, M. G. H.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- ORCID
- Holroyd, Clay B.
- Venue
- Psychological Review
- Published
- 2002-10
- Volume
- 109
- Issue
- 4
- Pages
- 679-709
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2135572147
- Semantic Scholar
- a497b6f27fa708805f5dab7b7470509e72deb8b2
- Cited by
- 4,027
- References
- 280
- Citations by year
- 2026: 125 · 2025: 172 · 2024: 145 · 2023: 138 · 2022: 152 · 2021: 193 · 2020: 188 · 2019: 188 · 2018: 220 · 2017: 219 · 2016: 218 · 2015: 246 · 2014: 244 · 2013: 219 · 2012: 204
- FWCI
- 30.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- Funders
- National Institutes of Health (5r01mh041445-13, 5f31mh011530-04)
- National Institute of Mental Health (MH41445, MH11530)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural and Behavioral Psychology Studies
- Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neurotransmitter Receptor Influence on Behavior
- Social Sciences › Arts and Humanities › Philosophy › Free Will and Agency
- Keywords
- error processing, error-related negativity, reinforcement learning, dopamine, anterior cingulate cortex, negative reinforcement, adaptive behavior, event-related potentials, reaction time task, computational modeling
- MeSH terms
- Analysis of Variance, Brain Mapping, Dopamine, Humans, Models, Neurological, Motor Cortex, Probability Learning, Reinforcement, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review