CoChat

Are Clinical Impressions of Adolescent Substance Use Accurate?

Wilson, Celeste R., Sherritt, Lon, Gates, Erin, Knight, John R. · 2004 · Pediatrics
Cited by 155

The DOI matches its Crossref record.

Abstract

Objective. To compare providers' impressions of adolescents' level of substance use with diagnostic classifications from a structured diagnostic interview. Methods. Secondary analysis of data was conducted from a validation study of the CRAFFT substance abuse screening test of 14- to 18-year-old medical clinic patients (n = 533) and their corresponding medical care providers (n = 109) at an adolescent clinic affiliated with a large tertiary care pediatric hospital. Medical care providers completed a form that recorded their clinical impressions of patients' level of alcohol and drug involvement (none, minimal, problem, abuse, dependence) and demographic characteristics. The form included brief diagnostic descriptions for each level of use. After the medical visit, patients completed the Adolescent Diagnostic Interview (ADI), a structured diagnostic interview that yields diagnoses of abuse and dependence according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV). On the basis of their past 12 months of alcohol and drug use on the ADI interview, adolescents were classified into 5 mutually exclusive diagnostic groups. “None” was defined by no reported use of alcohol or drugs during the past year. “Minimal use” was defined as use of alcohol or drugs but no report of any substance-related problems. “Problem use” was defined as reporting 1 or more substance-related problems but no diagnosis of abuse or dependence. “Abuse” was defined by meeting any 1 of 4 DSM-IV diagnostic criteria for either alcohol or drug abuse but no diagnosis of dependence. “Dependence” was defined by meeting any 3 of 7 diagnostic criteria for either alcohol or drug dependence, with or without a diagnosis of abuse. Proportions were compared using Fisher exact test. Agreement was assessed with the weighted κ, and these analyses were stratified by substance used (ie, alcohol vs drug) and demographic characteristics. Sensitivity, specificity, and positive and negative predictive values were calculated from 2 × 2 tables. Results. Compared with the criterion standard interview, providers identified significantly fewer patients with problem use and abuse and no patients with dependence. Of >100 patients whom the ADI classified with substance problem use, providers correctly identified 18. Of 50 patients who were classified with a diagnosis of alcohol or drug abuse, providers correctly identified 10. Of 36 patients who were classified with a diagnosis of alcohol or drug dependence, providers correctly identified none. For the 86 adolescents who were classified with a substance-related disorder (ie, abuse or dependence), providers' impressions were “none” (24.4%), “minimal use” (50%), “problem use” (15.1%), “abuse” (10.5%), and “dependence” (0%). There was only marginal agreement between providers' impressions and diagnoses related to alcohol use (κ = .29), drug use (κ = .31), and any substance use (κ = .30). Kappa was not significantly affected by the patient's age, but it was by gender. Among boys, κ was significantly higher for impressions of drug use versus alcohol use (κ = .48 vs κ = .27); and, among drug users, κ was significantly higher among boys compared with girls (κ = .48 vs κ = .24). Kappa did not differ significantly across race/ethnicity subgroups, although there is a suggestive trend toward higher agreement for black non-Hispanic compared with white non-Hispanic adolescents (κ = .35 vs κ = .21). Kappa did not differ significantly on the basis of the visit type, but the size of this difference (κ = .36 vs κ = .24) suggests that the longer well-child visit yielded greater identification of substance-related pathology. Providers' impressions had a sensitivity of .63 for identifying use of alcohol or drugs. However, sensitivity was poor for identification of problem use (.14), abuse (.10), and dependence (0), whereas specificity and positive predictive values were high. Of the 86 adolescents with a diagnosis of abuse or dependence, 75.6% were correctly identified by providers as using substances; however, the level of use in 50% of these adolescents was reported by providers as minimal. Conclusions. In this study, clinical impressions of adolescents' alcohol/drug involvement underestimated substance-related pathology. When providers thought that use was present, there was a very high likelihood that a problem or disorder existed. The use of structured screening devices would likely improve identification of adolescents with substance-related pathology in primary care settings and should be considered for use with all adolescent patients, rather than only those who are perceived to be at higher risk.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1542/peds.2004-0098

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cited by

See all 155

Metadata

Authors
Wilson, C. R., Sherritt, L., Gates, E., & Knight, J. R.
Venue
Pediatrics
Published
2004-11-01
Volume
114
Issue
5
Pages
e536-e540
ISSN
  • 0031-4005 (ISSN-L)
  • 1098-4275
OpenAlex
W2113058932
Cited by
155
References
0
FWCI
4.28
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Are Clinical Impressions of Adolescent Substance Use Accurate? https://app.cochat.ai/papers/10.1542/peds.2004-0098
The paper
Wilson, C. R., Sherritt, L., Gates, E., & Knight, J. R. (2004). Are Clinical Impressions of Adolescent Substance Use Accurate? Pediatrics. https://doi.org/10.1542/peds.2004-0098

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.