CoChat
Sign Up
Cited by 283Child and Adolescent Psychosocial and Emotional DevelopmentMental Health Treatment and AccessMental Health Research Topics

National Comorbidity Survey Replication Adolescent Supplement (NCS-A): III. Concordance of DSM-IV/CIDI Diagnoses With Clinical Reassessments

Open access
Kessler, Ronald C., Avenevoli, Shelli, Green, Jennifer, Gruber, Michael J., Guyer, Margaret, He, Yulei, Jin, Robert, Kaufman, Joan +3 more·2009·Journal of the American Academy of Child & Adolescent Psychiatry
DOI 10.1097/chi.0b013e31819a1cbcPMC PMC3040100
Open this paper in CoChat — free account

Abstract

Objective To report results of the clinical reappraisal study of lifetime DSM-IV diagnoses based on the fully structured lay-administered World Health Organization Composite International Diagnostic Interview (CIDI) Version 3.0 in the U.S. National Comorbidity Survey Replication Adolescent Supplement (NCS-A). Method Blinded clinical reappraisal interviews with a probability subsample of 347 NCS-A respondents were administered using the Schedule for Affective Disorders and Schizophrenia for School-Age Children (K-SADS) as the gold standard. The DSM-IV/CIDI cases were oversampled, and the clinical reappraisal sample was weighted to adjust for this oversampling. Results Good aggregate consistency was found between CIDI and K-SADS prevalence estimates, although CIDI estimates were meaningfully higher than K-SADS estimates for specific phobia (51.2%) and oppositional defiant disorder (38.7%). Estimated prevalence of any disorder, in comparison, was only slightly higher in the CIDI than K-SADS (8.3%). Strong individual-level CIDI versus K-SADS concordance was found for most diagnoses. Area under the receiver operating characteristic curve, a measure of classification accuracy not influenced by prevalence, was 0.88 for any anxiety disorder, 0.89 for any mood disorder, 0.84 for any disruptive behavior disorder, 0.94 for any substance disorder, and 0.87 for any disorder. Although area under the receiver operating characteristic curve was unacceptably low for alcohol dependence and bipolar I and II disorders, these problems were resolved by aggregation with alcohol abuse and bipolar I disorder, respectively. Logistic regression analysis documented that consideration of CIDI symptom-level data significantly improved prediction of some K-SADS diagnoses. Conclusions These results document that the diagnoses made in the NCS-A based on the CIDI have generally good concordance with blinded clinical diagnoses.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1097/chi.0b013e31819a1cbc

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 52

  1. [1]Jewell J Handwerk M Almquist J Lucas C Comparing the validity of clinician-generated diagnosis of conduct disorder to the diagnostic interview schedule for children J Clin Child Adolesc Psychol 2004 33 536 546 15271611
  2. [3]Haro JM Arbabzadeh-Bouchez S Brugha TS Concordance of the Composite International Diagnostic Interview Version 3.0 (CIDI 3.0) with standardized clinical assessments in the WHO World Mental Health surveys Int J Methods Psychiatr Res 2006 15 167 180 17266013 PMC6878271
  3. [4]Narrow WE Rae DS Robins LN Regier DA Revised prevalence estimates of mental disorders in the United States: using a clinical significance criterion to reconcile 2 surveys' estimates Arch Gen Psychiatry 2002 59 115 123 11825131
  4. [5]Schwab-Stone ME Shaffer D Dulcan MK Criterion validity of the NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC-2.3) J Am Acad Child Adolesc Psychiatry 1996 35 878 888 8768347
  5. [6]Angold A Prendergast M Cox A Harrington R Simonoff E Rutter M The Child and Adolescent Psychiatric Assessment (CAPA) Psychol Med 1995 25 739 753 7480451
  6. [7]Welner Z Reich W Herjanic B Jung KG Amado H Reliability, validity, and parent-child agreement studies of the Diagnostic Interview for Children and Adolescents (DICA) J Am Acad Child Adolesc Psychiatry 1987 26 649 653 3667494
  7. [8]Costello EJ Edelbrock CS Costello AJ Validity of the NIMH Diagnostic Interview Schedule for Children: a comparison between psychiatric and pediatric referrals J Abnorm Child Psychol 1985 13 579 595 4078188
  8. [9]Boyle MH Offord DR Racine Y Evaluation of the Diagnostic Interview for Children and Adolescents for use in general population samples J Abnorm Child Psychol 1993 21 663 681 8126319
  9. [10]Ezpeleta L de la Osa N Domenech JM Navarro JB Losilla JM Judez J Diagnostic agreement between clinicians and the Diagnostic Interview for Children and Adolescents--DICA-R--in an outpatient sample J Child Psychol Psychiatry 1997 38 431 440 9232488
  10. [11]Merikangas KR Avenevoli S Costello EJ Koretz D Kessler RC Background and measures in the National Comorbidity Survey Adolescent Supplement (NCS-A) J Am Acad Child Adolesc Psychiatry in press PMC2736858 19242382
  11. [12]Kessler RC Avenevoli S Costello EJ The Design of the US National Comorbidity Survey Replication Adolescent Supplement (NCS-A) J Am Acad Child Adolesc Psychiatry in press PMC2736858 19242382
  12. [13]Kessler RC Avenevoli S Costello EJ Design and field procedures in the US National Comorbidity Survey Replication Adolescent (NCS-A) Supplement Int J Methods Psychiatr Res in press PMC2774712 19507169
  13. [15]Kaufman J Birmaher B Brent D Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data J Am Acad Child Adolesc Psychiatry 1997 36 980 988 9204677
  14. [17]Wittchen HU Reliability and validity studies of the WHO--Composite International Diagnostic Interview (CIDI): a critical review J Psychiatr Res 1994 28 57 84 8064641
  15. [18]Wittchen HU Kessler RC Zhao S Abelson J Reliability and clinical validity of UM-CIDI DSM-III-R generalized anxiety disorder J Psychiatr Res 1995 29 95 110 7666382
  16. [19]Wittchen HU Zhao S Abelson JM Abelson JL Kessler RC Reliability and procedural validity of UM-CIDI DSM-III-R phobic disorders Psychol Med 1996 26 1169 1177 8931163
  17. [21]Andrews G Peters L Guzman AM Bird K A comparison of two structured diagnostic interviews: CIDI and SCAN Aust N Z J Psychiatry 1995 29 124 132 7625961
  18. [22]Jordanova V Wickramesinghe C Gerada C Prince M Validation of two survey diagnostic interviews among primary care attendees: a comparison of CIS-R and CIDI with SCAN ICD-10 diagnostic categories Psychol Med 2004 34 1013 1024 15554572
  19. [24]DeMaio T Landreth A Presser S Rothgeb J Couper M Do different cognitive interview techniques produce different results? Methods for Testing and Evaluating Survey Questionnaires 2004 New York, NY Wiley
  20. [25]Willis G Cognitive Interviewing: A Tool for Improving Questionnaire Design 2004 Thousand Oaks, CA Sage Publications
  21. [26]Grills AE Ollendick TH Issues in parent-child agreement: the case of structured diagnostic interviews Clin Child Fam Psychol Rev 2002 5 57 83 11993545
  22. [27]Johnston C Murray C Incremental validity in the psychological assessment of children and adolescents Psychol Assess 2003 15 496 507 14692845
  23. [28]Kessler RC Merikangas KR The National Comorbidity Survey Replication (NCS-R): background and aims Int J Methods Psychiatr Res 2004 13 60 68 15297904 PMC6878416
  24. [29]Kendler KS Neale MC Kessler RC Heath AC Eaves LJ A population-based twin study of major depression in women. The impact of varying definitions of illness Arch Gen Psychiatry 1992 49 257 266 1558459
  25. [31]Aneshensel CS Frerichs RR Clark VA Yokopenic PA Measuring depression in the community: a comparison of telephone and personal interviews Public Opin Q 1982 46 110 121 10256145
  26. [32]Rohde P Lewinsohn PM Seeley JR Comparability of telephone and face-to-face interviews in assessing axis I and II disorders Am J Psychiatry 1997 154 1593 1598 9356570
  27. [34]Bromet EJ Dunn LO Connell MM Dew MA Schulberg HC Long-term reliability of diagnosing lifetime major depression in a community sample Arch Gen Psychiatry 1986 43 435 440 3964022
  28. [35]Leckman JF Sholomskas D Thompson WD Belanger A Weissman MM Best estimate of lifetime psychiatric diagnosis: a methodological study Arch Gen Psychiatry 1982 39 879 883 7103676
  29. [36]Rubin DB The Bayesian bootstrap The Annals of Statistics 1981 9 130 134
  30. [37]Wolter KM Introduction to Variance Estimation 1985 New York Springer-Verlag
  31. [38]Hanley JA McNeil BJ The meaning and use of the area under a receiver operating characteristic (ROC) curve Radiology 1982 143 29 36 7063747
  32. [41]Cook RJ Armitage P Colton T Kappa and its dependence on marginal rates The Encyclopedia of Biostatistics 1998 New York Wiley 2166 2168
  33. [42]Kraemer HC Morgan GA Leech NL Gliner JA Vaske JJ Harmon RJ Measures of clinical significance J Am Acad Child Adolesc Psychiatry 2003 42 1524 1529 14627890
  34. [43]Agresti A An Introduction to Categorical Data Analysis 1996 New York John Wiley and Sons
  35. [44]Spitznagel EL Helzer JE A proposed solution to the base rate problem in the kappa statistic Arch Gen Psychiatry 1985 42 725 728 4015315
  36. [45]Landis JR Koch GG The measurement of observer agreement for categorical data Biometrics 1977 33 159 174 843571
  37. [46]Brugha TS The end of the beginning: a requiem for the categorization of mental disorder? Psychol Med 2002 32 1149 1154 12420884
  38. [47]Regier DA Community diagnosis counts Arch Gen Psychiatry 2000 57 223 224 10711907
  39. [48]Rush AJ Gullion CM Basco MR Jarrett RB Trivedi MH The Inventory of Depressive Symptomatology (IDS): psychometric properties Psychol Med 1996 26 477 486 8733206
  40. [50]Rush AJ Trivedi MH Ibrahim HM The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression Biol Psychiatry 2003 54 573 583 12946886
  41. [53]Kessler RC Adler L Barkley R The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication Am J Psychiatry 2006 163 716 723 16585449 PMC2859678
  42. [54]Kessler RC Birnbaum H Demler O The prevalence and correlates of nonaffective psychosis in the National Comorbidity Survey Replication (NCS-R) Biol Psychiatry 2005 58 668 676 16023620 PMC2847859
  43. [55]Lenzenweger MF Lane MC Loranger AW Kessler RC DSM-IV personality disorders in the National Comorbidity Survey Replication Biol Psychiatry 2007 62 553 564 17217923 PMC2044500
  44. [57]Kranzler HR Tennen H Babor TF Kadden RM Rounsaville BJ Validity of the longitudinal, expert, all data procedure for psychiatric diagnosis in patients with psychoactive substance use disorders Drug Alcohol Depend 1997 45 93 104 9179511
  45. [58]Ambrosini PJ Historical development and present status of the schedule for affective disorders and schizophrenia for school-age children (K-SADS) J Am Acad Child Adolesc Psychiatry 2000 39 49 58 10638067
  46. [59]Angold A Costello EJ The Child and Adolescent Psychiatric Assessment (CAPA) J Am Acad Child Adolesc Psychiatry 2000 39 39 48 10638066
  47. [60]Booth BM Kirchner JE Hamilton G Harrell R Smith GR Diagnosing depression in the medically ill: validity of a lay-administered structured diagnostic interview J Psychiatr Res 1998 32 353 360 9844951
  48. [61]Spitzer RL Psychiatric diagnosis: are clinicians still necessary? Compr Psychiatry 1983 24 399 411 6354575
  49. [62]U.S. Public Health Service Report of the Surgeon General’s Conference on Children’s Mental Health: A National Action Agenda 2000 Washington, DC Department of Health and Human Services 20669515
  50. [63]Galanter CA Patel VL Medical decision making: a selective review for child psychiatrists and psychologists J Child Psychol Psychiatry 2005 46 675 689 15972065
  51. [64]Lewczyk CM Garland AF Hurlburt MS Gearity J Hough RL Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services J Am Acad Child Adolesc Psychiatry 2003 42 349 356 12595789
  52. [66]Hasin DS Grant BF The co-occurrence of DSM-IV alcohol abuse in DSM-IV alcohol dependence: results of the National Epidemiologic Survey on Alcohol and Related Conditions on heterogeneity that differ by population subgroup Arch Gen Psychiatry 2004 61 891 896 15351767

Cited by

Sorted by citations

Authors
Kessler, R. C., Avenevoli, S., Green, J., Gruber, M. J., Guyer, M., He, Y., Jin, R., Kaufman, J., Sampson, N. A., Zaslavsky, A. M., & Merikangas, K. R.
Affiliations
Harvard University (US)
Corresponding author
Kessler, Ronald C.
ORCID
Venue
Journal of the American Academy of Child & Adolescent Psychiatry
Publisher
Elsevier BV
Published
2009-04
Volume
48
Issue
4
Pages
386-399
ISSN
0890-8567 (ISSN-L)
DOI
10.1097/chi.0b013e31819a1cbc
PMC
PMC3040100
OpenAlex
W2009328439
Cited by
283
References
11
Citations by year
2026: 5 · 2025: 6 · 2024: 6 · 2023: 7 · 2022: 8 · 2021: 18 · 2020: 11 · 2019: 21 · 2018: 19 · 2017: 20 · 2016: 24 · 2015: 33 · 2014: 24 · 2013: 18 · 2012: 24
FWCI
22.33
Type
journal article
Language
en
Open access
Licence
www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations
  • Journal of the American Academy of Child & Adolescent Psychiatry (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health (5r13mh066849-04, 5r01mh069864-04, 5r01mh070884-05)
  • National Institute of Mental Health (R13-MH-066849, R01-MH66627, R01MH066627, R01‐MH070884, R01MH077883, U01-MH-60220, U13MH066849, U01MH060220, R01‐MH069864)
  • National Institute on Drug Abuse (K05DA015799, R01DA016558)
  • Fogarty International Center (R03TW006481)
Topics
  • Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
  • Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
Keywords
Composite International Diagnostic Interview, diagnostic agreement, adolescent mental disorders, prevalence estimates, anxiety disorders, mood disorders, disruptive behavior disorders, specific phobia, oppositional defiant disorder, alcoholism, bipolar disorder, K-SADS
MeSH terms
Adolescent, Mental Disorders, Humans, Surveys and Questionnaires, Schizophrenia, United States, Reproducibility of Results, Diagnostic and Statistical Manual of Mental Disorders

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review