Developing a science of clinical utility in diagnostic classification systems field study strategies for ICD-11 mental and behavioral disorders
The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
Abstract
The World Health Organization (WHO) Department of Mental Health and Substance Abuse has developed a systematic program of field studies to evaluate and improve the clinical utility of the proposed diagnostic guidelines for mental and behavioral disorders in the Eleventh Revision of the International Classification of Diseases and Related Health Problems (ICD-11). The clinical utility of a diagnostic classification is critical to its function as the interface between health encounters and health information, and to making the ICD-11 be a more effective tool for helping the WHO's 194 member countries, including the United States, reduce the global disease burden of mental disorders. This article describes the WHO's efforts to develop a science of clinical utility in regard to one of the two major classification systems for mental disorders. We present the rationale and methodologies for an integrated and complementary set of field study strategies, including large international surveys, formative field studies of the structure of clinicians' conceptualization of mental disorders, case-controlled field studies using experimental methodologies to evaluate the impact of proposed changes to the diagnostic guidelines on clinicians' diagnostic decision making, and ecological implementation field studies of clinical utility in the global settings in which the guidelines will ultimately be implemented. The results of these studies have already been used in making decisions about the st…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proposed ICD-11 diagnostic guidelines are currently being evaluated in two types of field studies.[92]”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“The first uses a rigorous and innovative methodology to examine the diagnostic accuracy and consistency of diagnostic judgments based on the proposed guidelines for ICD-11 as compared to ICD-10, using standardized case material in the form of clinical vignettes.[92]”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“The proposed ICD-11 diagnostic guidelines for anxiety and fear-related disorders are now been subjected to field testing in multiple languages using standardized case descriptions [91,92] to evaluate whether clinicians interpret and are able to apply them as intended, sources of diagnostic disagreement, clinical utility, and which aspects may require additional development because they are”
From The Classification of Anxiety and Fear-Related Disorders in the ICD-11: Review: Anxiety and Fear-Related Disorders in ICD-11 (2016) · cites this paper as [92]
In the citing paper
“A much broader range of diagnostic categories is being addressed via Internet-based studies 9,12 and the overall consistency between the results of the two types of studies is reassuring in this regard.”
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders, 5th ed.
Carter, M. J. (2014) · Therapeutic Recreation Journal · Cited by 15,169
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006
Toward the future of psychiatric diagnosis: the seven pillars of RDoC
Cuthbert, B. N., & Insel, T. R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-126 · Cited by 3,053
Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T. R., & Lee, M. (2000) · JAMA · doi:10.1001/jama.283.13.1715 · Cited by 1,241
The Diagnosis of Mental Disorders: The Problem of Reification
Hyman, S. E. (2010) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091532 · Cited by 1,052
Experimental Vignette Studies in Survey Research
Atzmüller, C., & Steiner, P. M. (2010) · Methodology · doi:10.1027/1614-2241/a000014 · Cited by 997
Diagnosis and classification of disorders specifically associated with stress: proposals for ICD-11
Maercker, A., Brewin, C. R., Bryant, R. A., Cloitre, M., van Ommeren, M., Jones, L. M., Humayan, A., Kagee, A., Llosa, A. E., Rousseau, C., et al. (2013) · World Psychiatry · doi:10.1002/wps.20057 · Cited by 762
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R., & Reed, G. M. (2015) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.12.001 · Cited by 757
Self-citationClassification, assessment, prevalence, and effect of personality disorder
Tyrer, P., Reed, G. M., & Crawford, M. J. (2015) · The Lancet · doi:10.1016/s0140-6736(14)61995-4 · Cited by 656
Self-citation
Cited by
Cloitre, M., Shevlin, M., Brewin, C. R., Bisson, J. I., Roberts, N. P., Maercker, A., Karatzias, T., & Hyland, P. (2018) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12956 · Cited by 1,314
“In line with the WHO’s organizing principles for the ICD-11 (2, 6), the optimized ITQ represents a self-report diagnostic measure of PTSD and CPTSD which captures a limited but core set of symptoms using simply worded items which facilitate translation and thus maximize international applicability.”
BackgroundMethodInfluentialReed, G. M., First, M. B., Kogan, C. S., Hyman, S. E., Gureje, O., Gaebel, W., Maj, M., Stein, D. J., Maercker, A., Tyrer, P., et al. (2019) · World Psychiatry · doi:10.1002/wps.20611 · Cited by 765
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Blossom, J. B., Amaro, C. M., Garcia, A. M., Stough, C. O., Canter, K. S., Robles, R., & Reed, G. M. (2015) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2014.12.001 · Cited by 757
Self-citationClark, L. A., Cuthbert, B., Lewis-Fernández, R., Narrow, W. E., & Reed, G. M. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100617727266 · Cited by 688
Self-citationA review of current evidence regarding the ICD-11 proposals for diagnosing PTSD and complex PTSD
Brewin, C. R., Cloitre, M., Hyland, P., Shevlin, M., Maercker, A., Bryant, R. A., Humayun, A., Jones, L. M., Kagee, A., Rousseau, C., et al. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.09.001 · Cited by 678
Self-citationCraske, M. G., & Stein, M. B. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30381-6 · Cited by 640
The time has come for dimensional personality disorder diagnosis
Hopwood, C. J., Kotov, R., Krueger, R. F., Watson, D., Widiger, T. A., Althoff, R. R., Ansell, E. B., Bach, B., Michael Bagby, R., Blais, M. A., et al. (2018) · Personality and Mental Health · doi:10.1002/pmh.1408 · Cited by 320
Validity and utility of Hierarchical Taxonomy of Psychopathology (HiTOP): I. Psychosis superspectrum
Kotov, R., Jonas, K. G., Carpenter, W. T., Dretsch, M. N., Eaton, N. R., Forbes, M. K., Forbush, K. T., Hobbs, K., Reininghaus, U., Slade, T., et al. (2020) · World Psychiatry · doi:10.1002/wps.20730 · Cited by 309
Watson, D., Levin‐Aspenson, H. F., Waszczuk, M. A., Conway, C. C., Dalgleish, T., Dretsch, M. N., Eaton, N. R., Forbes, M. K., Forbush, K. T., Hobbs, K. A., et al. (2022) · World Psychiatry · doi:10.1002/wps.20943 · Cited by 265
The classification of obsessive-compulsive and related disorders in the ICD-11
Stein, D. J., Kogan, C. S., Atmaca, M., Fineberg, N. A., Fontenelle, L. F., Grant, J. E., Matsunaga, H., Reddy, Y. C. J., Simpson, H. B., Thomsen, P. H., et al. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.10.061 · Cited by 204
Self-citationBach, B., Kerber, A., Aluja, A., Bastiaens, T., Keeley, J. W., Claes, L., Fossati, A., Gutierrez, F., Oliveira, S. E. S., Pires, R., et al. (2020) · Psychopathology · doi:10.1159/000507589 · Cited by 204
Self-citationProlonged grief disorder for ICD-11: the primacy of clinical utility and international applicability
Killikelly, C., & Maercker, A. (2017) · European Journal of Psychotraumatology · doi:10.1080/20008198.2018.1476441 · Cited by 187
“There are still significant questions concerning the application of this definition to different cultural groups and across the lifespan (Keeley et al., 2016; Reed et al., 2011; Robles et al., 2014; Schaal, Jacob,Dusingizemungu,&Elbert, 2010).”
BackgroundMethodInfluentialIrritability in child and adolescent psychopathology: An integrative review for ICD-11
Evans, S. C., Burke, J. D., Roberts, M. C., Fite, P. J., Lochman, J. E., de la Peña, F. R., & Reed, G. M. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.01.004 · Cited by 186
“For that reason, mental health professionals, including those whowork with children and adolescents, are contributing to the ICD-11 development process through avenues such as field studies and online public comment forums (Keeley et al., 2016).”
BackgroundInfluentialSelf-citationClaudino, A. M., Pike, K. M., Hay, P., Keeley, J. W., Evans, S. C., Rebello, T. J., Bryant-Waugh, R., Dai, Y., Zhao, M., Matsumoto, C., et al. (2019) · BMC Medicine · doi:10.1186/s12916-019-1327-4 · Cited by 151
Self-citationBach, B., & Simonsen, S. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000658 · Cited by 166
First, M. B., Rebello, T. J., Keeley, J. W., Bhargava, R., Dai, Y., Kulygina, M., Matsumoto, C., Robles, R., Stona, A., & Reed, G. M. (2018) · World Psychiatry · doi:10.1002/wps.20525 · Cited by 136
Self-citationKeeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Robles, R., Matsumoto, C., Brewin, C. R., Cloitre, M., Perkonigg, A., Rousseau, C., et al. (2016) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2015.09.002 · Cited by 134
Self-citationKrueger, R. B., Reed, G. M., First, M. B., Marais, A., Kismodi, E., & Briken, P. (2017) · Archives of Sexual Behavior · doi:10.1007/s10508-017-0944-2 · Cited by 129
Self-citationReed, G. M., Sharan, P., Rebello, T. J., Keeley, J. W., Elena Medina‐Mora, M., Gureje, O., Luis Ayuso‐Mateos, J., Kanba, S., Khoury, B., Kogan, C. S., et al. (2018) · World Psychiatry · doi:10.1002/wps.20524 · Cited by 126
Self-citationA framework for treating DSM‐5 alternative model for personality disorder features
Hopwood, C. J. (2018) · Personality and Mental Health · doi:10.1002/pmh.1414 · Cited by 143
Killikelly, C., Zhou, N., Merzhvynska, M., Stelzer, E.-M., Dotschung, T., Rohner, S., Sun, L. H., & Maercker, A. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.08.057 · Cited by 119
Forbush, K. T., Hagan, K. E., Kite, B. A., Chapa, D. A. N., Bohrer, B. K., & Gould, S. R. (2017) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2017.06.009 · Cited by 131
“Finally, given that a criticism of the current DSM is that it has low utility for understanding clinical course and prognosis [82], an important direction for future research will be to determine whether the model developed in this study prospectively predicts important treatment outcomes.”
BackgroundMisophonia: A new mental disorder?
Taylor, S. (2017) · Medical Hypotheses · doi:10.1016/j.mehy.2017.05.003 · Cited by 109
Barke, A., Korwisi, B., Jakob, R., Konstanjsek, N., Rief, W., & Treede, R. (2021) · Pain · doi:10.1097/j.pain.0000000000002287 · Cited by 131
“prognosis and treatment outcomes, and facilitates communication and documentation.(1,12,16,17) Sponsorships or competing interests that may be relevant to content are disclosed”
BackgroundMental and behavioural disorders in the ICD-11: concepts, methodologies, and current status
Gaebel, W., Zielasek, J., & Reed, G. (2017) · Psychiatria Polska · doi:10.12740/pp/69660 · Cited by 99
“network) and are currently being tested in a range of field studies [5].”
BackgroundSelf-citationKogan, C. S., Stein, D. J., Maj, M., First, M. B., Emmelkamp, P. M. G., & Reed, G. M. (2016) · Depression and Anxiety · doi:10.1002/da.22530 · Cited by 93
“[92] The first uses a rigorous and innovative methodology to examine the diagnostic accuracy and consistency of diagnostic judgments based on the proposed guidelines for ICD-11 as compared to ICD-10, using standardized case material in the form of clinical vignettes.[92] Participants in these internet-based studies ar…”
MethodSelf-citationReed, G. M., Keeley, J. W., Rebello, T. J., First, M. B., Gureje, O., Ayuso‐Mateos, J. L., Kanba, S., Khoury, B., Kogan, C. S., Krasnov, V. N., et al. (2018) · World Psychiatry · doi:10.1002/wps.20581 · Cited by 91
Self-citationBornstein, R. F., & Natoli, A. P. (2019) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000365 · Cited by 108
Kissane, D. W., Bobevski, I., Gaitanis, P., Brooker, J., Michael, N., Lethborg, C. E., Richardson, G. E., Webster, P., & Hempton, C. (2017) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2017.01.007 · Cited by 80
Structure of DSM‐5 and ICD‐11 personality domains in Iranian community sample
Lotfi, M., Bach, B., Amini, M., & Simonsen, E. H. (2018) · Personality and Mental Health · doi:10.1002/pmh.1409 · Cited by 73
Kamp-Becker, I. (2024) · Molecular Psychiatry · doi:10.1038/s41380-023-02354-y · Cited by 63
“Onereason — among others — for the revision of ICD-10 was the arti fi cial and in fl ated comorbidity between mental disorders [61].”
BackgroundGäebel, W., Stricker, J., Riesbeck, M., Zielasek, J., Kerst, A., Meisenzahl‐Lechner, E., Köllner, V., Rose, M., Hofmann, T., Schäfer, I., et al. (2019) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-019-01076-z · Cited by 65
Self-citationAligning the ICD-11 classification of disorders due to substance use with global service needs
Poznyak, V., Reed, G. M., & Medina-Mora, M. E. (2018) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796017000622 · Cited by 62
“For example, Koob & Volkow (2016) have described three phases in the development of dependence in a ‘ cycle that goes from repetition (pursuit of pleasure), to maladaptation (negative emotions and withdrawal), to an increasingly severe dependence (loss of control), which denote repeated failures in…”
BackgroundSelf-citationTo Utility and Beyond! Specifying and Advancing the Utility of Measurement-Based Care for Youth
McLeod, B. D., Jensen‐Doss, A., Lyon, A. R., Douglas, S. R., & Beidas, R. S. (2022) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2022.2042698 · Cited by 64
Item Response Theory Analysis of the Recoded Internet Gaming Disorder Scale-Short-Form (IGDS9-SF)
Gomez, R., Stavropoulos, V., Beard, C. L., & Pontes, H. M. (2018) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-018-9890-z · Cited by 62
“…on dichotomous ratings (presence or absence of a behaviour/symptom) paired with functional consequences (American Psychiatric Association, 2013; Keeley et al. 2016); (b) to align and to provide relative comparability with past IRT studies of IGD measures (that also implemented the 2PLM model;…”
ResultPilot field testing of the chronic pain classification for ICD-11: the results of ecological coding
Barke, A., Korwisi, B., Casser, H.-R., Fors, E. A., Geber, C., Schug, S. A., Stubhaug, A., Ushida, T., Wetterling, T., Rief, W., et al. (2018) · BMC Public Health · doi:10.1186/s12889-018-6135-9 · Cited by 57
Tassé, M. J., Balboni, G., Navas, P., Luckasson, R. A., Nygren, M., Belacchi, C., Bonichini, S., Reed, G. M., & Kogan, C. S. (2019) · Journal of Intellectual Disability Research · doi:10.1111/jir.12582 · Cited by 71
Self-citationEvans, S. C., Roberts, M. C., Keeley, J. W., Rebello, T. J., de la Peña, F., Lochman, J. E., Burke, J. D., Fite, P. J., Ezpeleta, L., Matthys, W., et al. (2020) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13244 · Cited by 62
“As a part of this effort, the Department developed detailed diagnostic guidelines for clinician use and implemented a program of global field studies to assess the reliability and clinical utility of these guidelines (First et al., 2015; Keeley et al., 2016).”
MethodSelf-citationKillikelly, C., Smith, K. V., Zhou, N., Prigerson, H. G., O'Connor, M., Kokou‐Kpolou, C. K., Boelen, P. A., & Maercker, A. (2025) · The Lancet · doi:10.1016/s0140-6736(25)00354-x · Cited by 87
Hansen, S. J., Christensen, S., Kongerslev, M. T., First, M. B., Widiger, T. A., Simonsen, E., & Bach, B. (2019) · Personality and Mental Health · doi:10.1002/pmh.1442 · Cited by 54
Self-citationKillikelly, C., Lorenz, L., Bauer, S., Mahat-Shamir, M., Ben-Ezra, M., & Maercker, A. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.02.014 · Cited by 48
International classification of diseases 11th edition (ICD-11)
Khoury, B., Kogan, C., & Daouk, S. (2017) · Encyclopedia of Personality and Individual Differences · doi:10.1007/978-3-319-28099-8_904-1 · Cited by 47
Do we need a novel framework for classifying psychopathology? A discussion paper
Rief, W., Hofmann, S. G., Berg, M., Forbes, M. K., Pizzagalli, D. A., Zimmermann, J., Fried, E. I., & Reed, G. M. (2023) · Clinical Psychology in Europe · doi:10.32872/cpe.11699 · Cited by 58
“…development of the ICD-11 classification of mental disorders, its extensive program of integrated field studies, and its differences from the ICD-10 and from the DSM-5 have been provided elsewhere (First et al., 2021; First et al., 2015; Keeley et al., 2016; Reed et al., 2022; Reed et al., 2019).”
BackgroundSelf-citationReed, G. M., First, M. B., Elena Medina‐Mora, M., Gureje, O., Pike, K. M., & Saxena, S. (2016) · World Psychiatry · doi:10.1002/wps.20322 · Cited by 44
Self-citationBoelen, P. A., Spuij, M., & Lenferink, L. I. M. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.02.046 · Cited by 42
The WHO International Classification of Diseases 11th Revision (ICD-11)
Dawson-Squibb, J.-J., Davids, E. L., Viljoen, M., Rice, K., & Stein, D. J. (2023) · Autism and child psychopathology series · doi:10.1007/978-3-031-24926-6_4 · Cited by 44
Killikelly, C., Smid, G. E., Wagner, B., & Boelen, P. A. (2021) · Public Health · doi:10.1016/j.puhe.2020.10.034 · Cited by 50
Chung, T. A., Cornelius, J. R., Clark, D. B., & Martin, C. S. (2017) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13441 · Cited by 40
“REVISIONS LEADING TO the International Classifi-cation of Diseases, 11th edition (ICD-11), aim to improve the clinical usefulness of diagnoses, mainly by simplifying diagnostic criteria to make them easier for clinicians to remember and apply (First et al., 2015; Keeley et al., 2016).”
La esquizofrenia en la CIE-11: comparación con la CIE-10 y el DSM-5
Valle, R. (2020) · Revista de Psiquiatría y Salud Mental · doi:10.1016/j.rpsm.2020.01.001 · Cited by 65
Bereavement and reactions of grief among children and adolescents: Present data and perspectives
Revet, A., Bui, É., Benvegnu, G., Suc, A., Mesquida, L., & Raynaud, J. (2020) · L Encéphale · doi:10.1016/j.encep.2020.05.007 · Cited by 52
Symptom rating scales for schizophrenia and other primary psychotic disorders in ICD-11
Keeley, J. W., & Gäebel, W. (2017) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796017000270 · Cited by 41
Self-citationThe reliability and clinical utility of ICD-11 schizoaffective disorder: A field trial
Peterson, D. L., Webb, C. A., Keeley, J. W., Gäebel, W., Zielasek, J., Rebello, T. J., Robles, R., Matsumoto, C., Kogan, C. S., Kulygina, M. A., et al. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2019.02.011 · Cited by 43
“For more information on study translation procedures, see Keeley et al. (2016).”
BackgroundSelf-citationKorwisi, B., Hay, G., Attal, N., Aziz, Q., Bennett, M., Benoliel, R., Cohen, M. L., Evers, S., Giamberardino, M. A., Kaasa, S., et al. (2021) · Pain · doi:10.1097/j.pain.0000000000002208 · Cited by 38
“The use of standardized case vignettes allows control over patient variables.(13) To gather the diagnostic information as needed, participants will be able to elicit information from virtual patients through chatbot technology.”
MethodCommentary on evidence in support of a grief‐related condition as a DSM diagnosis
Simon, N. M., Shear, M. K., Reynolds, C. F., Cozza, S. J., Mauro, C., Zisook, S., Skritskaya, N. A., Robinaugh, D. J., Malgaroli, M., Spandorfer, J., et al. (2020) · Depression and Anxiety · doi:10.1002/da.22985 · Cited by 47
“This decision was responsive to observations that operationalized criteria tended to be too long and complicated (Hyman, 2007; Keeley et al., 2016; Maj, 2015; Reed, 2010) to be useful in clinical practice (First et al.”
MethodFractures in the framework: limitations of classification systems inpsychiatry
Kapadia, M., Desai, M., & Parikh, R. M. (2020) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2020.22.1/rparikh · Cited by 48
Tracy, M., Tiliopoulos, N., Sharpe, L., & Bach, B. (2021) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674211025607 · Cited by 40
“…a step in the right direction in adhering to their primary aim; of first and foremost providing a useful diagnostic scheme for clinicians worldwide that ultimately aids the reduction of suffering among individuals with mental disorders (First et al., 2004; Hansen et al., 2019; Keeley et al., 2016).”
BackgroundSchizophrenia in ICD-11: Comparison of ICD-10 and DSM-5
Valle, R. (2020) · Revista de Psiquiatría y Salud Mental (English Edition) · doi:10.1016/j.rpsmen.2020.01.002 · Cited by 45
Fear of COVID ‐19, stress and depression: A meta‐analytic test of the mediating role of anxiety
Çıkrıkçı, Ö., Çıkrıkçı, N., & Griffiths, M. D. (2022) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12406 · Cited by 41
“Psychopathology may occur in cases where adjustment is not achieved (Bach et al., 2020; Keeley et al., 2016).”
BackgroundAnxiety and Fear-Related Disorders in the ICD-11: Results from a Global Case-controlled Field Study
Rebello, T. J., Keeley, J. W., Kogan, C. S., Sharan, P., Matsumoto, C., Kuligyna, M., Domínguez‐Martínez, T., Stona, A., Grenier, J., Huang, J., et al. (2019) · Archives of Medical Research · doi:10.1016/j.arcmed.2019.12.012 · Cited by 40
Self-citationChristen, D., Killikelly, C., Maercker, A., & Augsburger, M. (2021) · Clinical Psychology in Europe · doi:10.32872/cpe.5501 · Cited by 42
Mad by the Millions: Mental Disorders and the Early Years of the World Health Organization
Wu, H. Y. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/12541.001.0001 · Cited by 42
Chronic pain in the ICD-11: New diagnoses that clinical psychologists should know about
Barke, A., Korwisi, B., & Rief, W. (2022) · Clinical Psychology in Europe · doi:10.32872/cpe.9933 · Cited by 48
“(First et al., 2004; Keeley et al., 2016) The integrity of the diagnostic categories is an important prerequisite for the utility of a classification.”
BackgroundThe importance of developmental field trials in the revision of psychiatric classifications
First, M. B. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)00048-1 · Cited by 36
Self-citationHeyman, R. E., Kogan, C. S., Foran, H. M., Burns, S. C., Slep, A. M. S., Wojda, A. K., Keeley, J. W., Rebello, T. J., & Reed, G. M. (2018) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2018.03.001 · Cited by 32
“Vignette methodology is uniquely suited to test the specific effects of the different guidelines on diagnostic decision-making (Keeley et al., 2016) and responses of clinicians to vignettes tend to be generalizable to decisionmaking in ‘‘real world’’ clinical settings (Evans et al., 2015).”
BackgroundSelf-citationKogan, C. S., Stein, D. J., Rebello, T. J., Keeley, J. W., Chan, K. J., Fineberg, N. A., Fontenelle, L. F., Grant, J. E., Matsunaga, H., Simpson, H. B., et al. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.03.103 · Cited by 35
Self-citationClassification of mental and behavioral disorders.
Reed, G. M., Robles, R., & Domínguez‐Martínez, T. (2016) · American Psychological Association eBooks · doi:10.1037/14862-001 · Cited by 28
Self-citationThe debate about renaming schizophrenia: a new name would not resolve the stigma
Gäebel, W., & Kerst, A. (2018) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796018000513 · Cited by 33
“Reliability of operationalised diagnostic categories improved considerably (Keeley et al., 2016), but the validity of the concept itself still remained elusive.”
BackgroundChakrabarti, S. (2022) · World Journal of Psychiatry · doi:10.5498/wjp.v12.i12.1335 · Cited by 35
Prolonged Grief Disorder: Addressing Misconceptions With Evidence
Prigerson, H. G., Singer, J. P., & Killikelly, C. (2023) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2023.10.020 · Cited by 36
Killikelly, C., & Maercker, A. (2023) · Clinical Psychology in Europe · doi:10.32872/cpe.7655 · Cited by 27
“A strong emphasis on clinical utility and global applicability was prioritized over further delineation of accessory symptoms and subtypes (Keeley et al., 2016).”
BackgroundEvidence Base Update on the Assessment of Irritability, Anger, and Aggression in Youth
Evans, S. C., Karlovich, A. R., Khurana, S., Edelman, A., Buza, B., Riddle, W., & Sosa, D. L. (2024) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2023.2292041 · Cited by 29
“Clinical utility is gaining momentum in many areas of assessment (De Los Reyes & Langer, 2018; Youngstrom et al., 2017), from diagnosis and classification (Keeley et al., 2016) to measurement-based care (McLeod et al., 2022).”
BackgroundSelf-citationPsychosis superspectrum II: neurobiology, treatment, and implications
Kotov, R., Carpenter, W. T., Cicero, D. C., Correll, C. U., Martin, E. A., Young, J. W., Zald, D. H., & Jonas, K. G. (2024) · Molecular Psychiatry · doi:10.1038/s41380-024-02410-1 · Cited by 26
PTSD in Court I: Introducing PTSD for Court
Young, G. C. (2016) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2016.10.012 · Cited by 26
“Further along these lines, the overt aimof the ICD-11 is to construct a classification system that is “maximally intuitive and clinically useful” (Keeley et al., 2016).”
BackgroundMethodInfluentialKillikelly, C., Ramp, M., & Maercker, A. (2021) · Mental Health Religion & Culture · doi:10.1080/13674676.2020.1825361 · Cited by 25
“These guidelines reflect extensive research and expertise (Maciejewski et al., 2016; Prigerson et al., 2009) and have been developed in line with the WHO’s mission to improve clinical utility and global applicability of diagnostic guidelines (Keeley et al., 2016; Reed, 2010).”
Kogan, C. S., Maj, M., Rebello, T. J., Keeley, J. W., Kulygina, M. A., Matsumoto, C., Robles, R., Huang, J., Zhong, N., Chakrabarti, S., et al. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.050 · Cited by 28
Self-citationKrüger-Gottschalk, A., Ehring, T. W., Knaevelsrud, C., Dyer, A., Schäfer, I., Schellong, J., Rau, H., & Köhler, K. (2022) · European Journal of Psychotraumatology · doi:10.1080/20008198.2021.2010995 · Cited by 24
“The ICD-11 revision mainly followed the aims that mental disorders should have a high clinical utility, the diagnostic criteria should focus on a limited set of core symptoms, and that diagnoses are applicable internationally (Keeley et al., 2016).”
BackgroundCross-cultural applicability of ICD-11 and DSM-5 personality disorder
Ayinde, O. O., & Gureje, O. (2020) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000659 · Cited by 25
“Third, and particularly in respect to personality disorder, different cadres of mental health professionals from diverse cultural backgrounds, in using the previous editions of the ICD and DSM, have reported personality disorders diagnoses as among the most problematic diagnostic group [12,13].”
BackgroundSelf-citationStelzer, E.-M., Zhou, N., Merzhvynska, M., Rohner, S., Sun, H., Wagner, B., Maercker, A., & Killikelly, C. (2020) · Psychopathology · doi:10.1159/000505074 · Cited by 19
The DSM-5 Level of Personality Functioning Scale
Zimmermann, J., Hopwood, C. J., & Krueger, R. F. (2023) · Oxford University Press eBooks · doi:10.1093/med-psych/9780197542521.003.0025 · Cited by 22
Bach, B., & Abiddine, F. Z. E. (2020) · International Journal of Mental Health · doi:10.1080/00207411.2020.1732624 · Cited by 22
“However, research has highlighted significant flaws of the established DSM-IV and ICD-10 categorical approach to PD diagnostics, including inadequate structural validity (i.e., construct validity), arbitrary diagnostic thresholds, and extensive overlap among PD categories (e.g., Krueger, 2016).”
BackgroundKorwisi, B., Treede, R., Rief, W., & Barke, A. (2020) · PAIN Reports · doi:10.1097/pr9.0000000000000825 · Cited by 21
“The study protocol presented here is guided by the description of the official WHO ecological implementations field studies for mental and behavioral disorders by Keeley et al.(14) The study will be implemented in 2 phases of data collection.”
BackgroundMethodInfluentialKorwisi, B., Garrido‐Suárez, B. B., Goswami, S., Gunapati, N. R., Hay, G., Arteaga, M., Hill, C., Jones, D., Joshi, M., Kleinstäuber, M., et al. (2021) · Pain · doi:10.1097/j.pain.0000000000002379 · Cited by 20
Medina‐Mora, M. E., Robles, R., Rebello, T. J., Domínguez‐Martínez, T., Martínez, N., Juárez, F., Sharan, P., & Reed, G. M. (2018) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2018.09.003 · Cited by 18
Self-citationKillikelly, C., Hasenöhrl, A., Stelzer, E., & Maercker, A. (2022) · Culture Medicine and Psychiatry · doi:10.1007/s11013-022-09781-6 · Cited by 16
“Nonetheless, the new ICD-11 symptom guidelines are based on the WHO’s call for increased global applicability for criteria for mental disorders (Keeley et al. 2016; Reed et al. 2011).”
BackgroundKogan, C. S., & Paterniti, S. (2017) · The Canadian Journal of Psychiatry · doi:10.1177/0706743717717253 · Cited by 22
“At both stages, a novel methodological approach to evaluating clinical utility based on clinician responses was employed.(34) The first set of field trials concluding in 2017 focuses on testing specific conceptual changes proposed for the ICD-11 using clinical vignettes that evaluate whether diagnostic consistency and…”
MethodCultural Issues Related to ICD-11 Mental, Behavioural and Neurodevelopmental Disorders
Sharan, P., & Hans, G. (2021) · Consortium Psychiatricum · doi:10.17816/cp67 · Cited by 17
“14,15 This strategy also advocated the utilization of prototypical descriptions, as opposed to lists of criteria, to facilitate the inclusion of cultural variations, as well as contextual and health system factors, affecting diagnostic practice.”
BackgroundSelf-citationThe trait–type dialectic: Construct validity, clinical utility, and the diagnostic process.
Bornstein, R. F. (2018) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000299 · Cited by 17
Commentary on “The Challenge of Transforming the Diagnostic System of Personality Disorders”
Hopwood, C. J., Krueger, R. F., Watson, D., Widiger, T. A., Althoff, R. R., Ansell, E. B., Bach, B., Bagby, R. M., Blais, M. A., Bornovalova, M. A., et al. (2019) · Journal of Personality Disorders · doi:10.1521/pedi_2019_33_00 · Cited by 15
“…clinicians and researchers support evidence-based dimensions because the statement is consistent with several published surveys (Bernstein, Iscan, Maser, & Boards of Directors , 2007; Keeley et al., 2016; Morey, Skodol, & Oldham, 2014; Nelson et al., 2017), as described in our initial commentary.”
ResultKeeley, J. W., Reed, G. M., Rebello, T. J., Brechbiel, J. K., García‐Pacheco, J. Á., Adebayo, K. O., Esan, O., Majekodunmi, O. E., Ojagbemi, A., Onofa, L. E. U., et al. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.04.086 · Cited by 15
Self-citationICD-11: the importance of a science of psychiatric nosology
Stein, D. J., & Reed, G. M. (2018) · The Lancet Psychiatry · doi:10.1016/s2215-0366(18)30461-9 · Cited by 15
Self-citationKeeley, J. W., Gäebel, W., First, M. B., Peterson, D. L., Rebello, T. J., Sharan, P., & Reed, G. M. (2018) · Schizophrenia Research · doi:10.1016/j.schres.2018.07.006 · Cited by 15
Self-citationKeeley, J. W., Briken, P., Evans, S. C., First, M. B., Klein, V., Krueger, R. B., Matsumoto, C., Fresán, A., Rebello, T. J., Robles, R., et al. (2021) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2021.06.016 · Cited by 15
“7,22 The developers of the study created fi ve sets of vignettes.”
Self-citationLemay, K. R., Kogan, C. S., Rebello, T. J., Keeley, J. W., Bhargava, R., Sharan, P., Sharma, M., Kommu, J. V. S., Kishore, M. T., Mari, J. D. J., et al. (2022) · Journal of Intellectual Disability Research · doi:10.1111/jir.12924 · Cited by 14
Self-citationSamuel, D. B., & Bucher, M. A. (2017) · Personality Disorders Theory Research and Treatment · doi:10.1037/per0000190 · Cited by 13
Knowns and Unknowns about Students with Disabilities Who Also Happen to Be Intellectually Gifted
Pfeiffer, S. I., & Foley‐Nicpon, M. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780190645472.003.0006 · Cited by 19
Sexual disorders beyond DSM-5: the unfinished affaire
Navarro-Cremades, F., Simonelli, C., & Montejo, A. L. (2017) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000367 · Cited by 15
Schizophrenie und andere primäre psychotische Störungen in ICD-11
Zielasek, J., & Gäebel, W. (2018) · Fortschritte der Neurologie · Psychiatrie · doi:10.1055/s-0044-101832 · Cited by 16
Self-citationFuß, J., Keeley, J. W., Stein, D. J., Rebello, T. J., García, J., Briken, P., Robles, R., Matsumoto, C., Abé, C., Billieux, J., et al. (2024) · Journal of Behavioral Addictions · doi:10.1556/2006.2023.00083 · Cited by 13
Self-citationCultural perspectives related to international classification of Diseases-11
Sharan, P., & Keeley, J. W. (2018) · Indian Journal of Social Psychiatry · doi:10.4103/ijsp.ijsp_45_18 · Cited by 11
“Indian Journal of Social Psychiatry | Volume 34 | Supplement 1 | 2018 S2 incorporating more flexibility in diagnostic guidelines,[10,11] which is one way to increase the fit of varying patient presentations with diagnostic requirements.”
BackgroundSelf-citationTaxonomy and utility in the diagnostic classification of mental disorders
Evans, S. C., Roberts, M. C., Guler, J., Keeley, J. W., & Reed, G. M. (2021) · Journal of Clinical Psychology · doi:10.1002/jclp.23125 · Cited by 15
“Recent revisions have begun by establishing a research agenda with defined goals and priorities for the new editions (First et al., 2015; International Advisory Group for the Revision of ICD ‐ 10 Mental and Behavioral Disorders, 2011; Keeley et al., 2016; Kupfer et al., 2002, 2008; Reed, 2010).”
InfluentialSelf-citation
Metadata
- Authors
- Keeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Medina-Mora, M. E., Robles, R., Rebello, T., Sharan, P., Gureje, O., First, M. B., Andrews, H. F., Ayuso-Mateos, J. L., Gaebel, W., Zielasek, J., & Saxena, S.
- Affiliations
- Mississippi State University (US)
- World Health Organization (CH)
- University of Kansas (US)
- Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz (MX)
- Columbia University Irving Medical Center (US)
- All India Institute of Medical Sciences (IN)
- University of Ibadan (NG)
- ORCID
- Venue
- American Psychologist
- Published
- 2016-01
- Volume
- 71
- Issue
- 1
- Pages
- 3-16
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2235213646
- Cited by
- 173
- References
- 44
- Citations by year
- 2026: 4 · 2025: 5 · 2024: 10 · 2023: 13 · 2022: 17 · 2021: 23 · 2020: 22 · 2019: 20 · 2018: 26 · 2017: 21 · 2016: 7
- FWCI
- 153.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Funders
- International Union of Psychological Science
- National Institute of Mental Healthl Health
- World Psychiatric Association
- Royal College of Psychiatrists
- Spanish Foundation of Psychiatry and Mental Health
- Columbia University Global Mental Health Program
- University of Kansas
- Universidad Autónoma de Madrid
- Universidad Nacional Autónoma de México
- University of Zurich
- Topics
- Social Sciences › Arts and Humanities › Philosophy › Mental Health and Psychiatry
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Social Sciences › Psychology › Clinical Psychology › Psychology and Mental Health
- Keywords
- ICD-11, diagnostic classification systems, clinical utility, mental illness, behavioral disorders, fieldwork, diagnostic decision-making, international survey
- MeSH terms
- Mental Disorders, Humans, Psychiatry, World Health Organization, International Classification of Diseases, Diagnostic and Statistical Manual of Mental Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.