Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.

DSM-5 Field Trials in the United States and Canada, Part II: Test-Retest Reliability of Selected Categorical Diagnoses

Abstract

OBJECTIVE: The DSM-5 Field Trials were designed to obtain precise (standard error,0.1) estimates of the intraclass kappa asa measure of the degree to which two clinicians could independently agree on the presence or absence of selected DSM-5 diagnoses when the same patient was interviewed on separate occasions, in clinical settings, and evaluated with usual clinical interview methods. METHOD: Eleven academic centers in the United States and Canada were selected,and each was assigned several target diagnoses frequently treated in that setting.Consecutive patients visiting a site during the study were screened and stratified on the basis of DSM-IV diagnoses or symptomatic presentations. Patients were randomly assigned to two clinicians for a diagnostic interview; clinicians were blind to any previous diagnosis. All data were entered directly via an Internet-based software system to a secure central server. Detailed research design and statistical methods are presented in an accompanying article. RESULTS: There were a total of 15 adult and eight child/adolescent diagnoses for which adequate sample sizes were obtained to report adequately precise estimates of the intraclass kappa. Overall, five diagnoses were in the very good range(kappa=0.60–0.79), nine in the good range(kappa=0.40–0.59), six in the questionable range (kappa = 0.20–0.39), and three in the unacceptable range (kappa values,0.20). Eight diagnoses had insufficient sample sizes to generate precise kappa estimates at any site. CONCLUSIONS: Most diagnoses adequately tested had good to very good reliability with these representative clinical populations assessed with usual clinical interview methods. Some diagnoses that were revised to encompass a broader spectrum of symptom expression or had a more dimensional approach tested in the good to very good range.

Overview

Integrity signals

Registry

Crossref · 10.1176/appi.ajp.2012.12070999

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 38 references

Research works printed but not linked: 9

  1. Kupfer DJ, 2002, A Research Agenda for the DSM-V
  2. Andrews G, 2009, Stress-Induced and Fear Circuitry Disorders: Refining the Research Agenda for DSM-V
  3. Stengel E, 1959, Bull World Health Organ, 21, 601
  4. Kramer M: Some problems for international research suggested by observations on differences in first admission rates to mental hospitals of England and Wales and of the United States, in Proceedings of the Third World Congress of Psychiatry, vol 3. Montreal, University of Toronto Press/McGill University Press, 1961, pp 153–160
  5. Cooper JE, 1972, Psychiatric Diagnosis in New York and London
  6. American Psychiatric Association, Committee on Nomenclature and Statistics: DSM-III field trials: interrater reliability and listing of participants (Appendix F), in Diagnostic and Statistical Manual of Mental Disorders, Third Edition. Washington, DC, American Psychiatric Association, 1980, pp 467–481
  7. 10.1176/ajp.2006.163.12.2047 · doi:10.1176/ajp.2006.163.12.2047
  8. Kraepelin E, 1898, Dohr Neurol Psychiatry, 56, 254
  9. Kraepelin E: Patterns of Mental Disorder (1920), in Themes and Variations in European Psychiatry . Edited by , Hirsch SR, Shepherd M. Charlottesville, Va, University Press of Virginia, 1974, pp 7–30

Cited by

See all 1,163

Metadata

Authors
Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J.
Affiliations
Johns Hopkins University (US)
Venue
American Journal of Psychiatry
Published
2013-01
Volume
170
Issue
1
Pages
59-70
ISSN
  • 0002-953X (ISSN-L)
  • 1535-7228
OpenAlex
W2118347738
Cited by
1,163
References
38
Citations by year
2026: 66 · 2025: 82 · 2024: 104 · 2023: 83 · 2022: 78 · 2021: 91 · 2020: 87 · 2019: 89 · 2018: 73 · 2017: 107 · 2016: 79 · 2015: 64 · 2014: 88 · 2013: 66
FWCI
109.24
Type
journal article
Language
en
Open access
closed
Locations
  • American Journal of Psychiatry (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
  • Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
Keywords
DSM-5, test-retest reliability, interobserver agreement, diagnostic interview, field trials, psychiatric diagnosis
MeSH terms
Suicide Prevention, Adolescent, Adult, Anxiety Disorders, Mental Disorders, Canada, Child, Cross-Cultural Comparison, Depressive Disorder, Major, Major Depressive Disorder, Diagnosis, Differential, Humans, Patient Care Planning, Prognosis, Psychotic Disorders, Statistics as Topic, Suicide, United States, Reproducibility of Results, Multicenter Studies as Topic, Comorbidity, Randomized Controlled Trials as Topic, Diagnostic and Statistical Manual of Mental Disorders, Suicidal Ideation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: DSM-5 Field Trials in the United States and Canada, Part II: Test-Retest Reliability of Selected Categorical Diagnoses. https://app.cochat.ai/papers/10.1176/appi.ajp.2012.12070999
The paper
Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013). DSM-5 Field Trials in the United States and Canada, Part II: Test-Retest Reliability of Selected Categorical Diagnoses. American Journal of Psychiatry. https://doi.org/10.1176/appi.ajp.2012.12070999

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.