The DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
DSM-5 Field Trials in the United States and Canada, Part II: Test-Retest Reliability of Selected Categorical Diagnoses
Abstract
OBJECTIVE: The DSM-5 Field Trials were designed to obtain precise (standard error,0.1) estimates of the intraclass kappa asa measure of the degree to which two clinicians could independently agree on the presence or absence of selected DSM-5 diagnoses when the same patient was interviewed on separate occasions, in clinical settings, and evaluated with usual clinical interview methods. METHOD: Eleven academic centers in the United States and Canada were selected,and each was assigned several target diagnoses frequently treated in that setting.Consecutive patients visiting a site during the study were screened and stratified on the basis of DSM-IV diagnoses or symptomatic presentations. Patients were randomly assigned to two clinicians for a diagnostic interview; clinicians were blind to any previous diagnosis. All data were entered directly via an Internet-based software system to a secure central server. Detailed research design and statistical methods are presented in an accompanying article. RESULTS: There were a total of 15 adult and eight child/adolescent diagnoses for which adequate sample sizes were obtained to report adequately precise estimates of the intraclass kappa. Overall, five diagnoses were in the very good range(kappa=0.60–0.79), nine in the good range(kappa=0.40–0.59), six in the questionable range (kappa = 0.20–0.39), and three in the unacceptable range (kappa values,0.20). Eight diagnoses had insufficient sample sizes to generate precise kappa estimates at any site. CONCLUSIONS: Most diagnoses adequately tested had good to very good reliability with these representative clinical populations assessed with usual clinical interview methods. Some diagnoses that were revised to encompass a broader spectrum of symptom expression or had a more dimensional approach tested in the good to very good range.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First, the subclassification of 'Asperger's disorder' was subsumed under the unitary term ASD as the diagnosis was inconsistently applied even by expert groups 124”
From Autism spectrum disorder (2020) · cites this paper as [124]
In the citing paper
“Data from DSM-5 field trials suggest that disorders that are more broadly defined have higher reliability 25 .”
In the citing paper
“From the homo- geneity assumption, the comorbidity (17) and heterogeneity (18,19) problems emerge and limit psychiatric research (20–26).”
From Methods and challenges for assessing heterogeneity (2020) · cites this paper as [22]
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Kessler, R. C. (1994) · Archives of General Psychiatry · doi:10.1001/archpsyc.1994.03950010008002 · Cited by 12,370
Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067
Research Diagnostic Criteria: Rationale and Reliability
Spitzer, R. L. (1978) · Archives of General Psychiatry · doi:10.1001/archpsyc.1978.01770300115013 · Cited by 6,951
Diagnostic Criteria for Use in Psychiatric Research
Feighner, J. P. (1972) · Archives of General Psychiatry · doi:10.1001/archpsyc.1972.01750190059011 · Cited by 5,715
Regier, D. A. (1990) · JAMA · doi:10.1001/jama.1990.03450190043026 · Cited by 3,962
Self-citationThe PHQ-15: Validity of a New Measure for Evaluating the Severity of Somatic Symptoms
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2002) · Psychosomatic Medicine · doi:10.1097/00006842-200203000-00008 · Cited by 3,298
Establishment of Diagnostic Validity in Psychiatric Illness: Its Application to Schizophrenia
ROBINS, E., & GUZE, S. B. (1970) · American Journal of Psychiatry · doi:10.1176/ajp.126.7.983 · Cited by 2,243
Distinguishing Between the Validity and Utility of Psychiatric Diagnoses
Kendell, R., & Jablensky, A. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.4 · Cited by 1,246
Research works printed but not linked: 9
- Kupfer DJ, 2002, A Research Agenda for the DSM-V
- Andrews G, 2009, Stress-Induced and Fear Circuitry Disorders: Refining the Research Agenda for DSM-V
- Stengel E, 1959, Bull World Health Organ, 21, 601
- Kramer M: Some problems for international research suggested by observations on differences in first admission rates to mental hospitals of England and Wales and of the United States, in Proceedings of the Third World Congress of Psychiatry, vol 3. Montreal, University of Toronto Press/McGill University Press, 1961, pp 153–160
- Cooper JE, 1972, Psychiatric Diagnosis in New York and London
- American Psychiatric Association, Committee on Nomenclature and Statistics: DSM-III field trials: interrater reliability and listing of participants (Appendix F), in Diagnostic and Statistical Manual of Mental Disorders, Third Edition. Washington, DC, American Psychiatric Association, 1980, pp 467–481
- 10.1176/ajp.2006.163.12.2047 · doi:10.1176/ajp.2006.163.12.2047
- Kraepelin E, 1898, Dohr Neurol Psychiatry, 56, 254
- Kraepelin E: Patterns of Mental Disorder (1920), in Themes and Variations in European Psychiatry . Edited by , Hirsch SR, Shepherd M. Charlottesville, Va, University Press of Virginia, 1974, pp 7–30
Cited by
Kotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335
“For example, the DSM–5 Field Trials found that 40% of diagnoses did not meet even a relaxed cutoff for acceptable interrater reliability (Regier et al., 2013), although the same disorders often showed excellent reliability when operationalized dimensionally (Markon et al.”
Self-citationLord, C., Brugha, T. S., Charman, T., Cusack, J., Dumas, G., Frazier, T., Jones, E. J. H., Jones, R. M., Pickles, A., State, M. W., et al. (2020) · Nature Reviews Disease Primers · doi:10.1038/s41572-019-0138-4 · Cited by 1,859
Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5)
Ma, F. (2020) · Encyclopedia of Gerontology and Population Aging · doi:10.1007/978-3-319-69892-2_419-2 · Cited by 1,198
The DSM-5: Classification and criteria changes
Regier, D. A., Kuhl, E. A., & Kupfer, D. J. (2013) · World Psychiatry · doi:10.1002/wps.20050 · Cited by 1,138
Self-citationFried, E. I., & Nesse, R. M. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.010 · Cited by 1,043
“…for inconsistent findings and recent disappointing results such as the questionable reliability of depression diagnosis in the DSM-5 field trials (Regier et al., 2013), the striking lack of progress in identifying biomarkers associated with depression diagnosis or treatment response (Hek et al.,…”
Metadata
- Authors
- Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J.
- Affiliations
- Johns Hopkins University (US)
- Venue
- American Journal of Psychiatry
- Published
- 2013-01
- Volume
- 170
- Issue
- 1
- Pages
- 59-70
- ISSN
- 0002-953X (ISSN-L)
- 1535-7228
- OpenAlex
- W2118347738
- Semantic Scholar
- d0af306ad5d05727a375c149367571999727ce42
- Cited by
- 1,163
- References
- 38
- Citations by year
- 2026: 66 · 2025: 82 · 2024: 104 · 2023: 83 · 2022: 78 · 2021: 91 · 2020: 87 · 2019: 89 · 2018: 73 · 2017: 107 · 2016: 79 · 2015: 64 · 2014: 88 · 2013: 66
- FWCI
- 109.24
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- DSM-5, test-retest reliability, interobserver agreement, diagnostic interview, field trials, psychiatric diagnosis
- MeSH terms
- Suicide Prevention, Adolescent, Adult, Anxiety Disorders, Mental Disorders, Canada, Child, Cross-Cultural Comparison, Depressive Disorder, Major, Major Depressive Disorder, Diagnosis, Differential, Humans, Patient Care Planning, Prognosis, Psychotic Disorders, Statistics as Topic, Suicide, United States, Reproducibility of Results, Multicenter Studies as Topic, Comorbidity, Randomized Controlled Trials as Topic, Diagnostic and Statistical Manual of Mental Disorders, Suicidal Ideation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: DSM-5 Field Trials in the United States and Canada, Part II: Test-Retest Reliability of Selected Categorical Diagnoses. https://app.cochat.ai/papers/10.1176/appi.ajp.2012.12070999
- The paper
- Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013). DSM-5 Field Trials in the United States and Canada, Part II: Test-Retest Reliability of Selected Categorical Diagnoses. American Journal of Psychiatry. https://doi.org/10.1176/appi.ajp.2012.12070999
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.