Challenges in Operationalizing the DSM-IV ClinicalSignificance Criterion
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: An explicit clinical significance (CS) criterion was added to many DSM-IV diagnoses in an attempt to more closely approximate the clinical diagnostic process and reduce the proportion of false positives in epidemiological studies. The American Indian Service Utilization, Psychiatric Epidemiology, Risk and Protective Factors Project (AI-SUPERPFP) offered a unique opportunity to examine the success of this effort. OBJECTIVE: To determine the impact of distress, impairment, and help-seeking reported in a lay structured interview on concordance with a clinical reappraisal. Further, to test the efficacy of 5 operationalizations of CS on the concordance and prevalence of DSM-IV lifetime disorders. DESIGN: Completed between 1997 and 2000, a cross-sectional probability sample survey with clinical reappraisal of approximately 10% of participants. SETTING: General community. PARTICIPANTS: A population-based sample of 3084 members of 2 American Indian tribal groups, who were between the ages of 15 and 54 years and resided on or near their home reservations, were randomly sampled from the tribal rolls and participated in structured psychiatric interviews. Clinical reappraisals were conducted with approximately 10% of the lay-interview participants. The response rate for the lay interview was 75%, and for the clinical reappraisal it was 72%. MAIN OUTCOMES MEASURES: The AI-SUPERPFP Composite International Diagnostic Interview (CIDI), a culturally adapted version of the CIDI, University of Michigan version. Adapted to assess DSM-IV diagnoses, questions assessing the CS criterion were inserted in all diagnostic modules. The Structured Clinical Interview for DSM-III-R (SCID) was used in the clinical reappraisal. RESULTS: Most participants who qualified as having AI-SUPERPFP CIDI lifetime disorders reported at least moderate levels of distress or impairment. Evidence of increased concordance between the CIDI and the SCID was lacking when more restrictive operationalizations of CS were used; indeed, the CIDI was very likely to underdiagnose disorders compared with the SCID (false negatives). Concomitantly, the CS operationalizations affected prevalence rates dramatically. CONCLUSION: The CS criterion, at least as operationalized to date, demonstrates little effectiveness in increasing the validity of diagnoses using lay-administered structured interviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Global Assessment Scale: A Procedure for Measuring Overall Severity of Psychiatric Disturbance
Endicott, J. (1976) · Archives of General Psychiatry · doi:10.1001/archpsyc.1976.01770060086012 · Cited by 4,982
Limitations of the Application of Fourfold Table Analysis to Hospital Data
Berkson, J. (1946) · Biometrics Bulletin · doi:10.2307/3002000 · Cited by 1,810 · cited 1×
“For instance, underreporting may be more common in the lay interviews, while clinicians may be more prone to attribute disorder to “normal” behaviors.(43,44) Furthermore, biases inherent in the measurement of DSM-defined diagnoses in these cultural contexts may differentially affect lay- and clinicianadministered inte…”
BackgroundAndrews, G., Henderson, S., & Hall, W. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.178.2.145 · Cited by 933
Cohen, P. (1984) · Archives of General Psychiatry · doi:10.1001/archpsyc.1984.01790230064010 · Cited by 607
Kessler, R. C., Wittchen, H., Abelson, J. M., Mcgonagle, K., Schwarz, N., Kendler, K. S., Knäuper, B., & Zhao, S. (1998) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.33 · Cited by 483 · cited 1×
“Within the baseline NCS, MDE exhibited significant levels of false positives when compared with the SCID; the bias for most disorders was in the opposite direction, although statistically significant only for simple phobias.(27) The recent NCS-Replication appears to have addressed the issue of false positives for life…”
ResultEaton, W. W., Neufeld, K., Chen, L.-S., & Cai, G. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.3.217 · Cited by 339 · cited 1×
“This finding does not appear to be specific to the AI-SUPERPFP, having also been reported with the ECA data.(32,38,42) Within the baseline NCS, MDE exhibited significant levels of false positives when compared with the SCID; the bias for most disorders was in the opposite direction, although statistically significant…”
ResultThe categorical versus dimensional assessment controversy in the sociology of mental illness
Kessler, R. C. (2002) · Journal of Health and Social Behavior · doi:10.2307/3090195 · Cited by 275
Diagnosing DSM-IV—Part I: DSM-IV and the concept of disorder
Wakefield, J. C. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00018-1 · Cited by 212
Beals, J., Manson, S. M., Mitchell, C. M., Spicer, P., & AI-SUPERPFP Team (2003) · Culture Medicine and Psychiatry · doi:10.1023/a:1025347130953 · Cited by 182
Self-citationBRUGHA, T. S., JENKINS, R., TAUB, N., MELTZER, H., & BEBBINGTON, P. E. (2001) · Psychological Medicine · doi:10.1017/s0033291701004184 · Cited by 171
Cited by
Hasin, D. S., Goodwin, R. D., Stinson, F. S., & Grant, B. F. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.10.1097 · Cited by 1,645
Rosenfield, S., & Mouzon, D. (2013) · Handbooks of Sociology and Social Research · doi:10.1007/978-94-007-4276-5_14 · Cited by 494
Sarche, M., & Spicer, P. (2008) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1425.017 · Cited by 339
Fehm, L., Beesdo, K., Jacobi, F., & Fiedler, A. (2008) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-007-0299-4 · Cited by 338
Beals, J. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.1.99 · Cited by 276
Self-citation
Metadata
- Authors
- Beals, J.
- Venue
- Archives of General Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2004-12-01
- Volume
- 61
- Issue
- 12
- Pages
- 1197
- ISSN
- 0003-990X (ISSN-L)
- OpenAlex
- W2168996736
- Cited by
- 110
- References
- 10
- FWCI
- 7.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.