The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
DSM-5 Field Trials in the United States and Canada, Part I: Study Design, Sampling Strategy, Implementation, and Analytic Approaches
Abstract
OBJECTIVE: This article discusses the design,sampling strategy, implementation,and data analytic processes of the DSM-5 Field Trials. METHOD: The DSM-5 Field Trials were conducted by using a test-retest reliability design with a stratified sampling approach across six adult and four pediatric sites in the United States and one adult site in Canada. A stratified random sampling approach was used to enhance precision in the estimation of the reliability coefficients. A web-based research electronic data capture system was used for simultaneous data collection from patients and clinicians across sites and for centralized data management.Weighted descriptive analyses, intraclass kappa and intraclass correlation coefficients for stratified samples, and receiver operating curves were computed. The DSM-5 Field Trials capitalized on advances since DSM-III and DSM-IV in statistical measures of reliability (i.e., intraclass kappa for stratified samples) and other recently developed measures to determine confidence intervals around kappa estimates. RESULTS: Diagnostic interviews using DSM-5 criteria were conducted by 279 clinicians of varied disciplines who received training comparable to what would be available to any clinician after publication of DSM-5.Overall, 2,246 patients with various diagnoses and levels of comorbidity were enrolled,of which over 86% were seen for two diagnostic interviews. A range of reliability coefficients were observed for the categorical diagnoses and dimensional measures. CONCLUSIONS: Multisite field trials and training comparable to what would be available to any clinician after publication of DSM-5 provided “real-world” testing of DSM-5 proposed diagnoses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Anxious depression may have a distinct neurobiology that separates it from nonanxious depression.”
From Patients with anxious depression: overview of prevalence, pathophysiology and impact on course and treatment outcome (2018) · cites this paper as [17]
In the citing paper
“Anxious depression has also been related to HPA-axis dysregulations: patients with anxious depression had a significantly attenuated adrenocorticotropic hormone response than patients with nonanxious depression and controls after intravenous corticotropin-releasing hormone challenge test, though samples were small [17,68].”
From Patients with anxious depression: overview of prevalence, pathophysiology and impact on course and treatment outcome (2018) · cites this paper as [17]
In the citing paper
“Opposing patterns may relate to distinct approach-avoidance deficits in anxious versus nonanxious depression [17,83].”
From Patients with anxious depression: overview of prevalence, pathophysiology and impact on course and treatment outcome (2018) · cites this paper as [17]
Citations
Cites
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Efron, B., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013815 · Cited by 6,033
QUANTIFYING TEST-RETEST RELIABILITY USING THE INTRACLASS CORRELATION COEFFICIENT AND THE SEM
Weir, J. P. (2005) · The Journal of Strength and Conditioning Research · doi:10.1519/15184.1 · Cited by 4,864
Signal detection theory and ROC analysis
Egan, J. P. (1975) · Academic Press eBooks · Cited by 1,659
Distinguishing between the validity and utility of psychiatric diagnoses.
Kendell, R., & Jablensky, A. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.1.4 · Cited by 1,294
Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070999 · Cited by 1,163 · cited 1×
“[15]).”
Self-citationBetter Decisions through Science
Swets, J. A., Dawes, R. M., & Monahan, J. C. (2000) · Scientific American · doi:10.1038/scientificamerican1000-82 · Cited by 569
Research works printed but not linked: 2
- Goldberg D, 2010, Diagnostic Issues in Depression and Generalized Anxiety Disorder: Refining the Research Agenda for DSM-5
- Weir JP, 2005, J Strength Cond Res, 19, 231
Cited by
Sorted by citations
Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070999 · Cited by 1,163
Self-citationThe DSM-5: Classification and criteria changes
Regier, D. A., Kuhl, E. A., & Kupfer, D. J. (2013) · World Psychiatry · doi:10.1002/wps.20050 · Cited by 1,138
Self-citationNarrow, W. E., Clarke, D. E., Kuramoto, S. J., Kraemer, H. C., Kupfer, D. J., Greiner, L., & Regier, D. A. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12071000 · Cited by 446
Self-citationThe DSM-5 diagnosis of nonsuicidal self-injury disorder: a review of the empirical literature
Zetterqvist, M. (2015) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-015-0062-7 · Cited by 366
Tolin, D. F., Gilliam, C., Wootton, B. M., Bowe, W., Bragdon, L. B., Davis, E., Hannan, S. E., Steinman, S. A., Worden, B., & Hallion, L. S. (2018) · Assessment · doi:10.1177/1073191116638410 · Cited by 345
Metadata
- Authors
- Clarke, D. E., Narrow, W. E., Regier, D. A., Kuramoto, S. J., Kupfer, D. J., Kuhl, E. A., Greiner, L., & Kraemer, H. C.
- Affiliations
- Johns Hopkins University (US)
- Venue
- American Journal of Psychiatry
- Published
- 2013-01
- Volume
- 170
- Issue
- 1
- Pages
- 43-58
- ISSN
- 0002-953X (ISSN-L)
- 1535-7228
- OpenAlex
- W2103393020
- Cited by
- 201
- References
- 21
- Citations by year
- 2026: 11 · 2025: 17 · 2024: 14 · 2023: 12 · 2022: 11 · 2021: 13 · 2020: 16 · 2019: 6 · 2018: 14 · 2017: 16 · 2016: 13 · 2015: 18 · 2014: 19 · 2013: 21
- FWCI
- 26.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- DSM-5, field trials, diagnostic reliability, test-retest reliability, stratified sampling, intraclass correlation coefficient, diagnostic interview, clinician training, psychiatric diagnosis, multi-site study
- MeSH terms
- Adolescent, Adult, Canada, Child, Cross-Cultural Comparison, Humans, Psychometrics, Research Design, Sampling Studies, Statistics as Topic, United States, Multicenter Studies as Topic, Selection Bias, Randomized Controlled Trials as Topic, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
