The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Developing a science of clinical utility in diagnostic classification systems field study strategies for ICD-11 mental and behavioral disorders
Abstract
The World Health Organization (WHO) Department of Mental Health and Substance Abuse has developed a systematic program of field studies to evaluate and improve the clinical utility of the proposed diagnostic guidelines for mental and behavioral disorders in the Eleventh Revision of the International Classification of Diseases and Related Health Problems (ICD-11). The clinical utility of a diagnostic classification is critical to its function as the interface between health encounters and health information, and to making the ICD-11 be a more effective tool for helping the WHO's 194 member countries, including the United States, reduce the global disease burden of mental disorders. This article describes the WHO's efforts to develop a science of clinical utility in regard to one of the two major classification systems for mental disorders. We present the rationale and methodologies for an integrated and complementary set of field study strategies, including large international surveys, formative field studies of the structure of clinicians' conceptualization of mental disorders, case-controlled field studies using experimental methodologies to evaluate the impact of proposed changes to the diagnostic guidelines on clinicians' diagnostic decision making, and ecological implementation field studies of clinical utility in the global settings in which the guidelines will ultimately be implemented. The results of these studies have already been used in making decisions about the st…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proposed ICD-11 diagnostic guidelines are currently being evaluated in two types of field studies.[92]”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“The first uses a rigorous and innovative methodology to examine the diagnostic accuracy and consistency of diagnostic judgments based on the proposed guidelines for ICD-11 as compared to ICD-10, using standardized case material in the form of clinical vignettes.[92]”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“The proposed ICD-11 diagnostic guidelines for anxiety and fear-related disorders are now been subjected to field testing in multiple languages using standardized case descriptions [91,92] to evaluate whether clinicians interpret and are able to apply them as intended, sources of diagnostic disagreement, clinical utility, and which aspects may require additional development because they are”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“A much broader range of diagnostic categories is being addressed via Internet-based studies 9,12 and the overall consistency between the results of the two types of studies is reassuring in this regard.”
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders, 5th ed.
Carter, M. J. (2014) · Therapeutic Recreation Journal · Cited by 15,169
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
Toward the future of psychiatric diagnosis: the seven pillars of RDoC
Cuthbert, B. N., & Insel, T. R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-126 · Cited by 3,053
Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T. R., & Lee, M. (2000) · JAMA · doi:10.1001/jama.283.13.1715 · Cited by 1,241
The Diagnosis of Mental Disorders: The Problem of Reification
Hyman, S. E. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091532 · Cited by 1,052
Experimental Vignette Studies in Survey Research
Atzmüller, C., & Steiner, P. M. (2010) · Methodology · doi:10.1027/1614-2241/a000014 · Cited by 997
Diagnosis and classification of disorders specifically associated with stress: proposals for ICD-11
Maercker, A., Brewin, C. R., Bryant, R. A., Cloitre, M., van Ommeren, M., Jones, L. M., Humayan, A., Kagee, A., Llosa, A. E., Rousseau, C., et al. (2013) · World Psychiatry · doi:10.1002/wps.20057 · Cited by 762
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R., & Reed, G. M. (2015) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.12.001 · Cited by 757
Self-citationClassification, assessment, prevalence, and effect of personality disorder
Tyrer, P., Reed, G. M., & Crawford, M. J. (2015) · The Lancet · doi:10.1016/s0140-6736(14)61995-4 · Cited by 656
Self-citationKrueger, R. F., Markon, K. E., Patrick, C. J., & Iacono, W. G. (2005) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.114.4.537 · Cited by 566
Can neuroscience be integrated into the DSM-V?
Hyman, S. E. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2218 · Cited by 516
Categorization and Reasoning among Tree Experts: Do All Roads Lead to Rome?
Medin, D. L., Lynch, E. B., Coley, J. D., & Atran, S. (1997) · Cognitive Psychology · doi:10.1006/cogp.1997.0645 · Cited by 489
First, M. B., Reed, G. M., Hyman, S. E., & Saxena, S. (2015) · World Psychiatry · doi:10.1002/wps.20189 · Cited by 366
Self-citationThe WPA‐WHO Global Survey of Psychiatrists’ Attitudes Towards Mental Disorders Classification
REED, G. M., CORREIA, J. M., ESPARZA, P., SAXENA, S., & MAJ, M. (2011) · World Psychiatry · doi:10.1002/j.2051-5545.2011.tb00034.x · Cited by 354
Self-citationThe structure of psychopathology: Toward an expanded quantitative empirical model.
Wright, A. G. C., Krueger, R. F., Hobbs, M. J., Markon, K. E., Eaton, N. R., & Slade, T. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0030133 · Cited by 347
Clinical Utility as a Criterion for Revising Psychiatric Diagnoses
First, M. B., Pincus, H. A., Levine, J. B., Williams, J. B. W., Ustun, B., & Peele, R. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.6.946 · Cited by 341
Self-citationReed, G. M. (2010) · Professional Psychology: Research and Practice · doi:10.1037/a0021701 · Cited by 252
Self-citationAndrews, G., Goldberg, D. P., Krueger, R. F., Carpenter, W. T., Hyman, S. E., Sachdev, P., & Pine, D. S. (2009) · Psychological Medicine · doi:10.1017/s0033291709990250 · Cited by 242
The classification of obsessive-compulsive and related disorders in the ICD-11
Stein, D. J., Kogan, C. S., Atmaca, M., Fineberg, N. A., Fontenelle, L. F., Grant, J. E., Matsunaga, H., Reddy, Y. C. J., Simpson, H. B., Thomsen, P. H., et al. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.061 · Cited by 204
Self-citationClarke, D. E., Narrow, W. E., Regier, D. A., Kuramoto, S. J., Kupfer, D. J., Kuhl, E. A., Greiner, L., & Kraemer, H. C. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12070998 · Cited by 201
Sartorius, N. (1993) · Archives of General Psychiatry · doi:10.1001/archpsyc.1993.01820140037004 · Cited by 195
The Cycle of Classification: DSM-I Through DSM-5
Blashfield, R. K., Keeley, J. W., Flanagan, E. H., & Miles, S. R. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153639 · Cited by 177
Self-citationEvans, S. C., Reed, G. M., Roberts, M. C., Esparza, P., Watts, A. D., Correia, J. M., Ritchie, P., Maj, M., & Saxena, S. (2013) · International Journal of Psychology · doi:10.1080/00207594.2013.804189 · Cited by 175
Self-citationKeeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Robles, R., Matsumoto, C., Brewin, C. R., Cloitre, M., Perkonigg, A., Rousseau, C., et al. (2016) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2015.09.002 · Cited by 134
Self-citationMullins‐Sweatt, S. N., & Widiger, T. A. (2009) · Psychological Assessment · doi:10.1037/a0016607 · Cited by 109
Reed, G. M., Roberts, M. C., Keeley, J. W., Hooppell, C., Matsumoto, C., Sharan, P., Robles, R., de Carvalho, H. W., Wu, C., Gureje, O., et al. (2013) · Journal of Clinical Psychology · doi:10.1002/jclp.22031 · Cited by 94
Self-citationTesting DSM-5 in Routine Clinical Practice Settings: Feasibility and Clinical Utility
Mościcki, E. K., Clarke, D. E., Kuramoto, S. J., KRAEMER, H. C., Narrow, W. E., Kupfer, D. J., & Regier, D. A. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201300098 · Cited by 70
Spitzer, R. L., Sheehy, M., & Endicott, J. (1977) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-03753-7_1 · Cited by 69
WHO's Global Clinical Practice Network for mental health
Reed, G. M., Rebello, T. J., Pike, K. M., Medina-Mora, M. E., Gureje, O., Zhao, M., Dai, Y., Roberts, M. C., Maruta, T., Matsumoto, C., et al. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00183-2 · Cited by 68
Self-citationRoberts, M. C., Reed, G. M., Medina‐Mora, M. E., Keeley, J. W., Sharan, P., Johnson, D. K., Mari, J. D. J., Ayuso‐Mateos, J. L., Gureje, O., Xiao, Z., et al. (2012) · International Review of Psychiatry · doi:10.3109/09540261.2012.736368 · Cited by 62
Self-citationGLOSSARY OF MENTAL DISORDERS AND GUIDE TO THEIR CLASSIFICATION
Bond, M. R. (1976) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp.39.4.410 · Cited by 51
Assessing clinically relevant perceptual organization with multidimensional scaling techniques.
Treat, T. A., McFall, R. M., Viken, R. J., Nosofsky, R. M., MacKay, D. B., & Kruschke, J. K. (2002) · Psychological Assessment · doi:10.1037/1040-3590.14.3.239 · Cited by 34
Robles, R., Fresán, A., Evans, S. C., Lovell, A. M., Medina-Mora, M. E., Maj, M., & Reed, G. M. (2014) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.03.003 · Cited by 30
Self-citationMellsop, G. W., Banzato, C. E. M., Shinfuku, N., Nagamine, M., Pereira, M. E. C., & Dutu, G. (2007) · International Journal of Mental Health · doi:10.2753/imh0020-7411360402 · Cited by 25
Clinicians’ Folk Taxonomies of Mental Disorders
Flanagan, E. H., & Blashfield, R. K. (2007) · Philosophy, psychiatry & psychology · doi:10.1353/ppp.0.0123 · Cited by 25
Maj, M. (2014) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796014000572 · Cited by 20
An alternative hierarchical organization of the mental disorders of the DSM-IV.
Flanagan, E. H., Keeley, J. W., & Blashfield, R. K. (2008) · Journal of Abnormal Psychology · doi:10.1037/a0012535 · Cited by 19
Self-citationReorganizing the diagnostic groupings in DSM-V and ICD-11: a cost/benefit analysis
First, M. B. (2009) · Psychological Medicine · doi:10.1017/s0033291709991152 · Cited by 17
Self-citationA meta-commentary on the proposal for a meta-structure for DSM-V and ICD-11
Jablensky, A. V. (2009) · Psychological Medicine · doi:10.1017/s0033291709991292 · Cited by 16
A Structure-Based Expert Model of the ICD-10 Mental Disorders
Egli, S., Schlatter, K., Streule, R., & Läge, D. (2005) · Psychopathology · doi:10.1159/000089657 · Cited by 13
Zielasek, J., Freyberger, H. J., Jänner, M., Kapfhammer, H., Sartorius, N., Stieglitz, R. D., & Gäebel, W. (2010) · European Psychiatry · doi:10.1016/j.eurpsy.2009.12.023 · Cited by 12
Self-citationDo Clinicians Conceptualize DSM‐IV Disorders Hierarchically?
Flanagan, E. H., Keeley, J. W., & Blashfield, R. K. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21840 · Cited by 7
Self-citation
Cited by
Cloitre, M., Shevlin, M., Brewin, C. R., Bisson, J. I., Roberts, N. P., Maercker, A., Karatzias, T., & Hyland, P. (2018) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12956 · Cited by 1,314
“In line with the WHO’s organizing principles for the ICD-11 (2, 6), the optimized ITQ represents a self-report diagnostic measure of PTSD and CPTSD which captures a limited but core set of symptoms using simply worded items which facilitate translation and thus maximize international applicability.”
BackgroundMethodInfluentialReed, G. M., First, M. B., Kogan, C. S., Hyman, S. E., Gureje, O., Gaebel, W., Maj, M., Stein, D. J., Maercker, A., Tyrer, P., et al. (2019) · World Psychiatry · doi:10.1002/wps.20611 · Cited by 765
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R., & Reed, G. M. (2015) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.12.001 · Cited by 757
Self-citationClark, L. A., Cuthbert, B., Lewis-Fernández, R., Narrow, W. E., & Reed, G. M. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100617727266 · Cited by 688
Self-citationA review of current evidence regarding the ICD-11 proposals for diagnosing PTSD and complex PTSD
Brewin, C. R., Cloitre, M., Hyland, P., Shevlin, M., Maercker, A., Bryant, R. A., Humayun, A., Jones, L. M., Kagee, A., Rousseau, C., et al. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.09.001 · Cited by 678
Self-citation
Metadata
- Authors
- Keeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Medina-Mora, M. E., Robles, R., Rebello, T., Sharan, P., Gureje, O., First, M. B., Andrews, H. F., Ayuso-Mateos, J. L., Gaebel, W., Zielasek, J., & Saxena, S.
- Affiliations
- Mississippi State University (US)
- World Health Organization (CH)
- University of Kansas (US)
- Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz (MX)
- Columbia University Irving Medical Center (US)
- All India Institute of Medical Sciences (IN)
- University of Ibadan (NG)
- ORCID
- Venue
- American Psychologist
- Published
- 2016-01
- Volume
- 71
- Issue
- 1
- Pages
- 3-16
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2235213646
- Cited by
- 173
- References
- 44
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 10 · 2023: 13 · 2022: 17 · 2021: 23 · 2020: 22 · 2019: 20 · 2018: 26 · 2017: 21 · 2016: 7
- FWCI
- 153.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Funders
- International Union of Psychological Science
- National Institute of Mental Healthl Health
- World Psychiatric Association
- Royal College of Psychiatrists
- Spanish Foundation of Psychiatry and Mental Health
- Columbia University Global Mental Health Program
- University of Kansas
- Universidad Autónoma de Madrid
- Universidad Nacional Autónoma de México
- University of Zurich
- Topics
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Social Sciences › Psychology › Clinical Psychology › Psychology and Mental Health
- Keywords
- ICD-11, diagnostic classification systems, clinical utility, mental illness, behavioral disorders, fieldwork, diagnostic decision-making, international survey
- MeSH terms
- Mental Disorders, Humans, Psychiatry, World Health Organization, International Classification of Diseases, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.