Dopamine, Learning, and Impulsivity: ABiological Account of Attention-Deficit/Hyperactivity Disorder
The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD) affects up to 10% of school-age children. The impulsivity which is seen as its core feature persists over years, yet experimental measures of impulsivity can be altered in a single session. In this study, we tested the theory that both the persistence and the variability of impulsivity could be the result of abnormalities in learning mechanisms and environment. METHOD: We extended an existing model of the role of dopamine in operant conditioning to address the delayed response time task, which is one of the standard tests for impulsivity in ADHD. In this task, subjects choose between immediate responding for a small reinforcer and later responding for a larger one. We studied the influence on impulsivity of four key parameters of the model: The learning rate, discount factor, brittleness, and action bias. RESULTS: The behavior of the model is broadly comparable with electrophysiological (monkey) and behavioral (ADHD and normal) data. Variations in any of the parameters can cause impulsivity. All parameters except the discount factor show inverted U-shaped curves for their effects on impulsivity, suggesting, for example, how either hyper- or hypofunctioning of dopamine can cause impulsivity. The model suggests how decision making can be affected by environmental unpredictability, and thus offers an account of one aspect of the natural history of ADHD. CONCLUSIONS: Some types of ADHD may be caused by specific deficits in reinforcement learning and in the use of learned lessons. Environmental factors can interact with these deficits to delay maturation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
A Systematic Method for Clinical Description and Classification of Personality Variants: A Proposal
Cloninger, C. R. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800180093014 · Cited by 3,678
Specious reward: A behavioral theory of impulsiveness and impulse control.
Ainslie, G. (1975) · Psychological Bulletin · doi:10.1037/h0076860 · Cited by 2,708 · cited 2×
“However, a different kind of curve, the hyperbolic, better describes the discounting found in many psychological studies (Ainslie 1975; but see also Kacelnik 1997; Kirby and Herrnstein 1995; Madden et al. 2003; Monterosso and Ainslie 1999).”
BackgroundHeroin addicts have higher discount rates for delayed rewards than non-drug-using controls.
Kirby, K. N., Petry, N. M., & Bickel, W. K. (1999) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.128.1.78 · Cited by 2,171
Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning
O'Doherty, J., Dayan, P., Schultz, J., Deichmann, R., Friston, K., & Dolan, R. J. (2004) · Science · doi:10.1126/science.1094285 · Cited by 2,088
Self-citationA framework for mesencephalic dopamine systems based on predictive Hebbian learning
Montague, P., Dayan, P., & Sejnowski, T. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-05-01936.1996 · Cited by 2,066 · cited 2×
“However , there is, as yet, no evidence that children show preference reversals in the DRTT, and so, for simplicity, we preserve the exponential discounting that Montague et al. (1996) used in their model.”
MethodSelf-citationEvenden, J. L. (1999) · Psychopharmacology · doi:10.1007/pl00005481 · Cited by 2,044 · cited 1×
“Experimental tests used to access these include delayed reward, go-no go, stop tasks, response time in the uncertain visual discrimination test, and delayed response time tasks (DRTT) (Evenden 1999; Rubia et al. 2001).”
MethodPashler, H. (1997) · doi:10.7551/mitpress/5677.001.0001 · Cited by 1,607
Temporal difference models and reward-related learning in the human brain
O'Doherty, J. P., Dayan, P., Friston, K., Critchley, H., & Dolan, R. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00169-7 · Cited by 1,522
Self-citationBiederman, J. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.5.816 · Cited by 1,498 · cited 1×
“ADHD symptoms decrease as a child grows older (Biederman et al. 2000; Scahill and Schwab-Stone 2000), though some of the apparent decrease may result from the use of age-inappropriate diagnostic criteria.”
Background
Cited by
Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning
Tsai, H.-C., Zhang, F., Adamantidis, A., Stuber, G. D., Bonci, A., de Lecea, L., & Deisseroth, K. (2009) · Science · doi:10.1126/science.1168878 · Cited by 1,266
Keller, M. C., & Miller, G. (2006) · Behavioral and Brain Sciences · doi:10.1017/s0140525x06009095 · Cited by 540
Tripp, G., & Wickens, J. R. (2009) · Neuropharmacology · doi:10.1016/j.neuropharm.2009.07.026 · Cited by 492
“A further two models approach ADHD from a neurocomputational perspective (Frank, 2005; Frank et al., 2007b; Williams and Dayan, 2005).”
BackgroundOpponency revisited: competition and cooperation between dopamine and serotonin
Boureau, Y.-L., & Dayan, P. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.151 · Cited by 456
Self-citationSerotonin in Affective Control
Dayan, P., & Huys, Q. J. M. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.051508.135607 · Cited by 381
Self-citation
Metadata
- Authors
- Williams, J., & Dayan, P.
- Venue
- Journal of Child and Adolescent Psychopharmacology
- Publisher
- SAGE Publications
- Published
- 2005-04
- Volume
- 15
- Issue
- 2
- Pages
- 160-179
- ISSN
- 1044-5463 (ISSN-L)
- 1557-8992
- OpenAlex
- W2068367895
- Cited by
- 78
- References
- 31
- FWCI
- 3.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Dopamine, Learning, and Impulsivity: ABiological Account of Attention-Deficit/Hyperactivity Disorder. https://app.cochat.ai/papers/10.1089/cap.2005.15.160
- The paper
- Williams, J., & Dayan, P. (2005). Dopamine, Learning, and Impulsivity: ABiological Account of Attention-Deficit/Hyperactivity Disorder. Journal of Child and Adolescent Psychopharmacology. https://doi.org/10.1089/cap.2005.15.160
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.