Developing a science of clinical utility in diagnostic classification systems field study strategies for ICD-11 mental and behavioral disorders
The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Abstract
The World Health Organization (WHO) Department of Mental Health and Substance Abuse has developed a systematic program of field studies to evaluate and improve the clinical utility of the proposed diagnostic guidelines for mental and behavioral disorders in the Eleventh Revision of the International Classification of Diseases and Related Health Problems (ICD-11). The clinical utility of a diagnostic classification is critical to its function as the interface between health encounters and health information, and to making the ICD-11 be a more effective tool for helping the WHO's 194 member countries, including the United States, reduce the global disease burden of mental disorders. This article describes the WHO's efforts to develop a science of clinical utility in regard to one of the two major classification systems for mental disorders. We present the rationale and methodologies for an integrated and complementary set of field study strategies, including large international surveys, formative field studies of the structure of clinicians' conceptualization of mental disorders, case-controlled field studies using experimental methodologies to evaluate the impact of proposed changes to the diagnostic guidelines on clinicians' diagnostic decision making, and ecological implementation field studies of clinical utility in the global settings in which the guidelines will ultimately be implemented. The results of these studies have already been used in making decisions about the st…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proposed ICD-11 diagnostic guidelines are currently being evaluated in two types of field studies.[92]”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“The first uses a rigorous and innovative methodology to examine the diagnostic accuracy and consistency of diagnostic judgments based on the proposed guidelines for ICD-11 as compared to ICD-10, using standardized case material in the form of clinical vignettes.[92]”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“The proposed ICD-11 diagnostic guidelines for anxiety and fear-related disorders are now been subjected to field testing in multiple languages using standardized case descriptions [91,92] to evaluate whether clinicians interpret and are able to apply them as intended, sources of diagnostic disagreement, clinical utility, and which aspects may require additional development because they are”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“A much broader range of diagnostic categories is being addressed via Internet-based studies 9,12 and the overall consistency between the results of the two types of studies is reassuring in this regard.”
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders, 5th ed.
Carter, M. J. (2014) · Therapeutic Recreation Journal · Cited by 15,169
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
Toward the future of psychiatric diagnosis: the seven pillars of RDoC
Cuthbert, B. N., & Insel, T. R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-126 · Cited by 3,053
Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T. R., & Lee, M. (2000) · JAMA · doi:10.1001/jama.283.13.1715 · Cited by 1,241
The Diagnosis of Mental Disorders: The Problem of Reification
Hyman, S. E. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091532 · Cited by 1,052
Experimental Vignette Studies in Survey Research
Atzmüller, C., & Steiner, P. M. (2010) · Methodology · doi:10.1027/1614-2241/a000014 · Cited by 997
Diagnosis and classification of disorders specifically associated with stress: proposals for ICD-11
Maercker, A., Brewin, C. R., Bryant, R. A., Cloitre, M., van Ommeren, M., Jones, L. M., Humayan, A., Kagee, A., Llosa, A. E., Rousseau, C., et al. (2013) · World Psychiatry · doi:10.1002/wps.20057 · Cited by 762
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R., & Reed, G. M. (2015) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.12.001 · Cited by 757
Self-citationClassification, assessment, prevalence, and effect of personality disorder
Tyrer, P., Reed, G. M., & Crawford, M. J. (2015) · The Lancet · doi:10.1016/s0140-6736(14)61995-4 · Cited by 656
Self-citation
Cited by
Cloitre, M., Shevlin, M., Brewin, C. R., Bisson, J. I., Roberts, N. P., Maercker, A., Karatzias, T., & Hyland, P. (2018) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12956 · Cited by 1,314
“In line with the WHO’s organizing principles for the ICD-11 (2, 6), the optimized ITQ represents a self-report diagnostic measure of PTSD and CPTSD which captures a limited but core set of symptoms using simply worded items which facilitate translation and thus maximize international applicability.”
BackgroundMethodInfluentialReed, G. M., First, M. B., Kogan, C. S., Hyman, S. E., Gureje, O., Gaebel, W., Maj, M., Stein, D. J., Maercker, A., Tyrer, P., et al. (2019) · World Psychiatry · doi:10.1002/wps.20611 · Cited by 765
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R., & Reed, G. M. (2015) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.12.001 · Cited by 757
Self-citationClark, L. A., Cuthbert, B., Lewis-Fernández, R., Narrow, W. E., & Reed, G. M. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100617727266 · Cited by 688
Self-citationA review of current evidence regarding the ICD-11 proposals for diagnosing PTSD and complex PTSD
Brewin, C. R., Cloitre, M., Hyland, P., Shevlin, M., Maercker, A., Bryant, R. A., Humayun, A., Jones, L. M., Kagee, A., Rousseau, C., et al. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.09.001 · Cited by 678
Self-citation
Metadata
- Authors
- Keeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Medina-Mora, M. E., Robles, R., Rebello, T., Sharan, P., Gureje, O., First, M. B., Andrews, H. F., Ayuso-Mateos, J. L., Gaebel, W., Zielasek, J., & Saxena, S.
- Affiliations
- Mississippi State University (US)
- World Health Organization (CH)
- University of Kansas (US)
- Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz (MX)
- Columbia University Irving Medical Center (US)
- All India Institute of Medical Sciences (IN)
- University of Ibadan (NG)
- ORCID
- Venue
- American Psychologist
- Published
- 2016-01
- Volume
- 71
- Issue
- 1
- Pages
- 3-16
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2235213646
- Cited by
- 173
- References
- 44
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 10 · 2023: 13 · 2022: 17 · 2021: 23 · 2020: 22 · 2019: 20 · 2018: 26 · 2017: 21 · 2016: 7
- FWCI
- 153.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Funders
- International Union of Psychological Science
- National Institute of Mental Healthl Health
- World Psychiatric Association
- Royal College of Psychiatrists
- Spanish Foundation of Psychiatry and Mental Health
- Columbia University Global Mental Health Program
- University of Kansas
- Universidad Autónoma de Madrid
- Universidad Nacional Autónoma de México
- University of Zurich
- Topics
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Social Sciences › Psychology › Clinical Psychology › Psychology and Mental Health
- Keywords
- ICD-11, diagnostic classification systems, clinical utility, mental illness, behavioral disorders, fieldwork, diagnostic decision-making, international survey
- MeSH terms
- Mental Disorders, Humans, Psychiatry, World Health Organization, International Classification of Diseases, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Developing a science of clinical utility in diagnostic classification systems field study strategies for ICD-11 mental and behavioral disorders. https://app.cochat.ai/papers/10.1037/a0039972
- The paper
- Keeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Medina-Mora, M. E., Robles, R., Rebello, T., Sharan, P., Gureje, O., First, M. B., Andrews, H. F., Ayuso-Mateos, J. L., Gaebel, W., Zielasek, J., & Saxena, S. (2016). Developing a science of clinical utility in diagnostic classification systems field study strategies for ICD-11 mental and behavioral disorders. American Psychologist. https://doi.org/10.1037/a0039972
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.