Reliability, Validity, and Utility of Instruments for Self-Report and Informant Report Concerning Symptoms of ADHD in Adult Patients
The DOI matches its Crossref record; 50 of the 51 references it cites were found in a registry or an index.
Abstract
Objective: To study the correlation between symptoms of ADHD in adults, obtained with different methods and from different sources. Method: Information was obtained from 120 adults with ADHD, their partners, and their parents, using the ADHD Rating Scale, the Conners' Adult ADHD Rating Scales (CAARS), the Brown Attention-Deficit Disorder Scale (BADDS), and the structured interview Diagnostic Interview Schedule-IV, section L (DIS-L). Results: All self-report rating scales can be used to assess ADHD symptoms in clinical samples of adults. The BADDS and the ADHD Rating Scale proved best in predicting the clinical diagnosis. The DSM-IV factors, originally developed for children, achieve lower patient-informant agreement than the other factors. Conclusion: Adults with ADHD appear to be the best informants with regard to their symptoms but tend to underreport the severity of their symptoms. Informant report may be used to get additional information on symptoms and impairment. (J. of Att. Dis. 2008; 11(4) 445-458)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“BADDS scores predict clinical diagnosis of ADHD [36] and multiple ADHD medication trials use the BADDS to assess symptom severity and improvement [16,37–39].”
From Treating new-onset cognitive complaints after risk-reducing salpingo-oophorectomy: A randomized controlled crossover trial of lisdexamfetamine (2024) · cites this paper as [36]
In the citing paper
“and was associated with improvements from baseline in EF, using the validated, self-reported BADDS [13,29], during the open-label phase of a modified analog classroom study (4-week) of adults with ADHD [30].”
In the citing paper
“adult self-reports have been found to be valid”
From Evaluation of the persistence, remission, and emergence of attention-deficit/hyperactivity disorder in young adulthood (2016) · cites this paper as [31]
In the citing paper
“the BADDS, a validated subjective measure of EFs (Sandra Kooij et al, 2008).”
From Lisdexamfetamine Effects on Executive Activation and Neurochemistry in Menopausal Women with Executive Function Difficulties (2017) · cites this paper as Sandra Kooij et al, 2008
In the citing paper
“Recent evidence found that on average parents typically report a later age of onset by around 5-years, even where earlier age of onset was known from previous health care records [170,189,190].”
From European consensus statement on diagnosis and treatment of adult ADHD: The European Network Adult ADHD (2010) · cites this paper as [170]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Applied Multivariate Statistics for the Social Sciences
Stevens, J. P. (2012) · Routledge eBooks · doi:10.4324/9780203843130 · Cited by 10,648
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Diagnostic and Statistical Manual of Mental Disorders
Sciacca, F., Knipe, H., & Sharma, R. (2020) · Radiopaedia.org · doi:10.53347/rid-80880 · Cited by 2,361
Statistical Analysis with Missing Data.
Chatfield, C., Little, R. J. A., & Rubin, D. B. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982783 · Cited by 2,202
(1998) · Cited by 2,026
Modern Multidimensional Scaling
Borg, I., & Groenen, P. (1997) · Springer Series in Statistics · doi:10.1007/978-1-4757-2711-1 · Cited by 1,728
BARKLEY, R. A., FISCHER, M., EDELBROCK, C. S., & SMALLISH, L. (1990) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199007000-00007 · Cited by 1,507
Biederman, J. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.5.816 · Cited by 1,498
Designing Experiments and Analysing Data: A Model Comparison Perspective.
Freeman, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Biometrics · doi:10.2307/2532173 · Cited by 1,229
The British Child and Adolescent Mental Health Survey 1999: The Prevalence of DSM-IV Disorders
FORD, T., GOODMAN, R., & MELTZER, H. (2003) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200310000-00011 · Cited by 1,227
Attention-deficit hyperactivity disorder : a clinical workbook
Barkley, R. A., & Murphy, K. R. (1991) · Guilford Press eBooks · Cited by 1,161
Applied Multivariate Statistics for the Social Sciences
Gonzalez, R. (2003) · The American Statistician · doi:10.1198/tas.2003.s213 · Cited by 876
Attention deficit hyperactivity disorder adults: Comorbidities and adaptive impairments
Murphy, K., & Barkley, R. A. (1996) · Comprehensive Psychiatry · doi:10.1016/s0010-440x(96)90022-x · Cited by 700 · cited 6×
“A cutoff point of 5 of 9 criteria was set for an adult diagnosis of ADHD, based on follow-up data of children with ADHD and epidemiological data using the same ADHD Rating Scale (Biederman, Mick, & Faraone, 2000; Kooij et al., 2005; Murphy & Barkley, 1996b).”
BackgroundMethodResultInfluentialAttention-Deficit Hyperactivity Disorder
Barkley, R. A. (1998) · Scientific American · doi:10.1038/scientificamerican0998-66 · Cited by 688
(1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.11.1652 · Cited by 528
Attention-deficit hyperactivity disorder: A clinical workbook, 2nd ed.
Barkley, R. A., & Murphy, K. R. (1998) · Cited by 491
Kolko, D. J., & Kazdin, A. E. (1993) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1993.tb01103.x · Cited by 479
SANDRA KOOIJ, J. J., BUITELAAR, J. K., van den OORD, E. J., FURER, J. W., TH. RIJNDERS, C. A., & HODIAMONT, P. P. G. (2005) · Psychological Medicine · doi:10.1017/s003329170400337x · Cited by 468 · cited 12×
“J. J. Sandra Kooij PsyQ, Den Haag, The Netherlands A. Marije Boonstra Erasmus University Rotterdam, The Netherlands S. H. N. Swinkels St. Radboud University, Nijmegen Medical Center, The Netherlands Evelijne M. Bekker Utrecht University, The Netherlands Ineke de Noord PsyQ, Den Haag, The Netherlands Jan K. Buitelaar S…”
BackgroundMethodResultInfluentialSelf-citationModern Multidimensional Scaling
(2005) · Springer Series in Statistics · doi:10.1007/0-387-28981-x · Cited by 432
Prevalence of DSM-IV symptoms of ADHD in adult licensed drivers: Implications for clinical diagnosis
Murphy, K., & Barkley, R. A. (1996) · Journal of Attention Disorders · doi:10.1177/108705479600100303 · Cited by 372
Kessler, R. C., Adler, L., Ames, M., Barkley, R. A., Birnbaum, H., Greenberg, P., Johnston, J. A., Spencer, T., & ??st??n, T. B. (2005) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000166863.33541.39 · Cited by 335
Murphy, P., & Schachar, R. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.7.1156 · Cited by 303 · cited 2×
“Using a DSM-IV behavior checklist, the rating of ADHD symptoms by nonclinical adult participants was compared with the rating by the participants’ parents and partners (Murphy & Schachar, 2000).”
BackgroundMethodInfluentialAttention deficit hyperactivity disorder in adults
(1994) · American Journal of Psychiatry · doi:10.1176/ajp.151.5.633 · Cited by 268
WOLRAICH, M. L., LAMBERT, E. W., BICKMAN, L., SIMMONS, T., DOFFING, M. A., & WORLEY, K. A. (2004) · Journal of Developmental & Behavioral Pediatrics · doi:10.1097/00004703-200402000-00007 · Cited by 242
Accuracy of Adult Recall of Childhood Attention Deficit Hyperactivity Disorder
Mannuzza, S., Klein, R. G., Klein, D. F., Bessler, A., & Shrout, P. (2002) · American Journal of Psychiatry · doi:10.1176/appi.ajp.159.11.1882 · Cited by 239
Ferdinand, R. F., van der Ende, J., & Verhulst, F. C. (2004) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.113.2.198 · Cited by 223
Reported prevalence of attentional difficulties in a general sample of college students
Weyandt, L. L., Linterman, I., & Rice, J. A. (1995) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf02229304 · Cited by 178
KOOIJ, J. J. S., BURGER, H., BOONSTRA, A. M., VAN DER LINDEN, P. D., KALMA, L. E., & BUITELAAR, J. K. (2004) · Psychological Medicine · doi:10.1017/s0033291703001776 · Cited by 163 · cited 5×
“However, because patients had participated in a medication study (Kooij et al., 2004) or in a study investigating event related potentials (ERP; Bekker et al., 2006) after they had been diagnosed, the following exclusion criteria were used: presence of cardiac disease, high blood pressure,…”
BackgroundMethodInfluentialSelf-citationZucker, M., Morris, M. K., Ingram, S. M., Morris, R. D., & Bakeman, R. (2002) · Psychological Assessment · doi:10.1037/1040-3590.14.4.379 · Cited by 163 · cited 2×
“…example, informant-patient agreement was higher for nonclinical samples than for clinical samples, with correlation coefficients of 0.2 to 0.7 in clinical samples (Conners et al., 1999; Young, 2004; Zucker et al., 2002) and 0.5 to 0.7 in nonclinical samples (Murphy, 2003; Murphy & Schachar, 2000).”
BackgroundResultInfluentialHoffer, W. (1949) · British Medical Bulletin · doi:10.1093/oxfordjournals.bmb.a073422 · Cited by 162
Smith, B. H., Pelham, W. E., Gnagy, E. M., Molina, B. S. G., & Evans, S. W. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.489 · Cited by 138
To act or not to act, that’s the problem: Primarily inhibition difficulties in adult ADHD.
Boonstra, A. M., Kooij, J. J. S., Oosterlaan, J., Sergeant, J. A., & Buitelaar, J. K. (2010) · Neuropsychology · doi:10.1037/a0017670 · Cited by 109
Self-citationMcCann, B. S., & Roy‐Byrne, P. (2004) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2004.02.006 · Cited by 107
Vaughn, M. L., Riccio, C. A., Hynd, G. W., & Hall, J. (1997) · Journal of Clinical Child Psychology · doi:10.1207/s15374424jccp2604_3 · Cited by 104
Stopping and changing in adults with ADHD
BEKKER, E. M., OVERTOOM, C. C., KENEMANS, J. L., KOOIJ, J. J., DE NOORD, I., BUITELAAR, J. K., & VERBATEN, M. N. (2005) · Psychological Medicine · doi:10.1017/s0033291704003459 · Cited by 101 · cited 3×
“, 2004) or in a study investigating event related potentials (ERP; Bekker et al., 2006) after they had been diagnosed, the following Kooij et al.”
BackgroundMethodSelf-citationVerhulst, F. C., & van der Ende, J. (1991) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1991.tb03120.x · Cited by 91
Carpentier, P. J., De Jong, C. A. J., Dijkstra, B. A. G., Verbrugge, C. A. G., & Krabbe, P. F. M. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.01272.x · Cited by 91
Solanto, M. V., Etefia, K., & Marks, D. J. (2004) · CNS Spectrums · doi:10.1017/s1092852900001929 · Cited by 75
Kooij, J. J. S., Aeckerlin, L. P., & Buitelaar, J. K. (2001) · PubMed · Cited by 63
Self-citationComparison of Multiple Measures of ADHD Symptomatology: A Multivariate Genetic Analysis
Nadder, T. S., Silberg, J. L., Rutter, M., Maes, H. H., & Eaves, L. J. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1017/s0021963001007119 · Cited by 62
Attention Deficit Hyperactivity Disorder- Residual Type
Denckla, M. B. (1991) · Journal of Child Neurology · doi:10.1177/0883073891006001s06 · Cited by 52
Epidemiological Comparisons of American and Dutch Adolescents' Self-Reports
Verhulst, F. C., Achenbach, T. M., Ferdinand, R. F., & Kasius, M. C. (1993) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199311000-00005 · Cited by 48
Self-Report of Attention Deficit and Hyperactivity Disorder in Adolescents
Danckaerts, M., Heptinstall, E., Chadwick, O., & Taylor, E. (1999) · Psychopathology · doi:10.1159/000029071 · Cited by 47 · cited 2×
“This is consistent with the literature in which adolescents and adults with ADHD, compared with other clinical groups and normal controls, have been shown to be poor reporters of their internal states such as inattention or impulsivity but not of negative social behavior (Barkley, Fischer, Edelbrock, & Smallish, 1990;…”
BackgroundResultYoung, S. (2004) · Personality and Individual Differences · doi:10.1016/s0191-8869(03)00212-5 · Cited by 37
Attention-deficit hyperactivity disorder and comorbid substance use disorders in adults
Wilens, T. E., Prince, J. B., Biederman, J., Spencer, T. J., & Frances, R. J. (1995) · Psychiatric Services · doi:10.1176/ps.46.8.761 · Cited by 35
Assessing Adult ADHD Using a Self-Report Symptom Checklist
O'Donnell, J. P., McCann, K. K., & Pluth, S. (2001) · Psychological Reports · doi:10.2466/pr0.2001.88.3.871 · Cited by 34
Murphy, P. (2003) · Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000066158.18608.c8 · Cited by 7
Research works printed but not linked: 12
- Barkley, R.A., 1997, The ADHD Report,, 5, 1
- Brown, T.E., 1996, Brown Attention-Deficit Disorder Scales (Manual)
- Conners, C.K., 1999, Conners' Adult ADHD Rating Scales (CAARS) (Technical manual)
- Kooij, J.J.S., 2003, ADHD in adults. Introduction to diagnosis and treatment
- Kooij, J.J.S., 2001, Nederlands Tijdschrift voor Geneeskunde, 145, 1498
- Krause, K.H., 1999, Deutsche Medizinische Wochenschrif, 124
- 10.1111/1469-7610.00741 · doi:10.1111/1469-7610.00741 · Paper page
- Ratey, J.J., Hallowell, E.M. & Miller, A.C. (1995). Relationship dilemmas for adults with ADD. In K. Nadeau (Ed.), A comprehensive guide to attention deficit hyperactivity disorder in adults. Research, diagnosis, treatment (pp. 218-235). New York: Brunner/Mazel .
- Robins, L.N., 1995, Diagnostic Interview Schedule for DSM-IV (DIS-IV)
- 10.1037/0022-006x.68.3.489 · doi:10.1037/0022-006x.68.3.489 · Paper page
- Stes, S., 2003, Neurone, 8, 20
- Triolo, S.J., 1996, Attention-Deficit Scales for Adults (ADSA): Manual for scoring and interpretation
Cited by
Kooij, S. J., Bejerot, S., Blackwell, A., Caci, H., Casas-Brugué, M., Carpentier, P. J., Edvinsson, D., Fayyad, J., Foeken, K., Fitzgerald, M., et al. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-67 · Cited by 928
Updated European Consensus Statement on diagnosis and treatment of adult ADHD
Kooij, J. J. S., Bijlenga, D., Salerno, L., Jaeschke, R., Bitter, I., Balázs, J., Thome, J., Dom, G., Kasper, S., Nunes Filipe, C., et al. (2019) · European Psychiatry · doi:10.1016/j.eurpsy.2018.11.001 · Cited by 686
“In adults this may be slightly different, as some research shows that the adult patient is the best informant [100].”
BackgroundLever, A. G., & Geurts, H. M. (2016) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-016-2722-8 · Cited by 572
“The validity of the ADHD rating scale is reasonable (Kooij et al. 2008).”
Agnew-Blais, J. C., Polanczyk, G. V., Danese, A., Wertz, J., Moffitt, T. E., & Arseneault, L. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.0465 · Cited by 459
Alderson, R. M., Kasper, L. J., Hudec, K. L., & Patros, C. H. G. (2013) · Neuropsychology · doi:10.1037/a0032371 · Cited by 329
Metadata
- Authors
- Sandra Kooij, J. J., Marije Boonstra, A., Swinkels, S. H. N., Bekker, E. M., de Noord, I., & Buitelaar, J. K.
- Affiliations
- PsyQ, Den Haag, The Netherlands,
- Erasmus University Rotterdam, The Netherlands
- St. Radboud University, Nijmegen Medical Center, The Netherlands
- Utrecht University (NL)
- PsyQ, Den Haag, The Netherlands
- Radboud University Nijmegen (NL)
- ORCID
- Buitelaar, Jan K.
- Venue
- Journal of Attention Disorders
- Publisher
- SAGE Publications
- Published
- 2008-01
- Volume
- 11
- Issue
- 4
- Pages
- 445-458
- ISSN
- 1087-0547 (ISSN-L)
- 1557-1246
- OpenAlex
- W1996783828
- Cited by
- 388
- References
- 51
- Citations by year
- 2026: 6 · 2025: 13 · 2024: 9 · 2023: 9 · 2022: 16 · 2021: 44 · 2020: 18 · 2019: 20 · 2018: 18 · 2017: 25 · 2016: 42 · 2015: 17 · 2014: 30 · 2013: 26 · 2012: 31
- FWCI
- 8.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Attention Disorders (publishedVersion)
- PubMed (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (publishedVersion)
- VU Research Portal (publishedVersion)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Attention Deficit Hyperactivity Disorder
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Clinical Psychology › Historical and Modern Theater Studies
- Keywords
- adult ADHD, ADHD symptoms, informant reports, self-report, ADHD Rating Scale, Conners' Adult ADHD Rating Scale, DSM-IV diagnostic criteria, symptom underreporting, assessment validity, instrument reliability
- MeSH terms
- Adult, Attention Deficit Disorder with Hyperactivity, Diagnosis, Differential, Female, Humans, Male, Mass Screening, Psychological Tests, Surveys and Questionnaires, Reproducibility of Results, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.