The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Problems and considerations in the valid assessment of personality disorders
Abstract
This article reviews evidence for the reliability and diagnostic concordance of structured-interview and self-report questionnaire methods for the diagnosis of personality disorders. The findings of nine studies that compared two or more axis II diagnostic instruments administered to the same groups of subjects are summarized. Across the eight studies with sufficient data, a summary of the overall diagnostic agreement between any two instruments yielded a low reliability (median kappa = 0.25) for making individual personality disorder diagnoses. Diagnostic concordance was lower between self-report questionnaire and interview methods than between interview methods. Comparing dimensional scores of different methods did not appreciably improve the level of agreement. The author concludes that current methods for making personality disorder diagnoses have high reliability but yield diagnoses that are not significantly comparable across methods beyond chance, which is not scientifically acceptable. Sources for the disagreement include variance due to different raters, interview occasions, data sources (self-report versus observer report), information bases obtained, and instrument sensitivity to state effects (e.g., mood). Serious problems in assessment validity may also arise from the yes/no format, which, despite probes for confirmatory examples, may fail to distinguish adequately between sporadic occurrences and longstanding patterns. Efforts should be made to improve and demonstrate the validity of axis II diagnostic methods. One route to increasing validity is to improve the clinical interview, because personality patterns are best revealed by the recurring patterns one finds when taking a systematic history.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Statistical Methods for Rates and Proportions.
Everitt, B. S., & Fleiss, J. L. (1981) · Biometrics · doi:10.2307/2530193 · Cited by 8,990
Robins, L. N. (1981) · Archives of General Psychiatry · doi:10.1001/archpsyc.1981.01780290015001 · Cited by 5,219
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
Comprehensive Textbook of Psychiatry
Schwab, J. J. (1968) · Psychosomatics · doi:10.1016/s0033-3182(68)71813-2 · Cited by 1,294
Millon Clinical Multiaxial Inventory manual
Millon, T. (1983) · Medical Entomology and Zoology · Cited by 1,241
Psychiatric diagnosis: Are clinicians still necessary?
Spitzer, R. L. (1983) · Comprehensive Psychiatry · doi:10.1016/0010-440x(83)90032-9 · Cited by 687
A Re-analysis of the Reliability of Psychiatric Diagnosis
Spitzer, R. L., & Fleiss, J. L. (1974) · British Journal of Psychiatry · doi:10.1192/bjp.125.4.341 · Cited by 612
Research works printed but not linked: 20
- Spitzer RL, I: initial interrater diagnostic reliabilty. Am J Psychiatry I 979
- Spitzer RL, Endicort J: Schedule for Affective Disorders and Schizophrenia (SADS)
- Spitzer RL, 1977, Robins E: Research Diagnostic Criteria (RDC) for a Selected Group of Functional Disorders
- Robins LN, Burke JD
- Loranger AW, Personality Disorders Examination ual
- 10.1037/1040-3590.3.1.46 · DOI · Paper page
- Spitzer RL, Gibbon M: Structured Clinical Interview for DSM-III-R Personality Disorders (SCID-Il)
- Pfohl B, Corenthal C: Structured Interview for DSM-III Personality Disorders (SIDP). Iowa City
- Shea MT, Watkins J
- Hyler SE, 1987, The Personality Diagnostic Questionnaire Revised (PDQ-R)
- Millon T, Millon Clinical Multiaxial Inventory Manual Supplement
- Skodol A, Hyler S: Diagnosis of DSM-III-R personality disorders: a comparison of two structured interviews. Int J Methods in Psychiatr Res I 99 1
- 10.1521/pedi.1987.1.2.121 · doi:10.1521/pedi.1987.1.2.121
- O'Boyle M, Self D: A comparison oftwo interviews for DSM-IIIR personality disorders. Psychiatry Res 1 990
- 10.1016/0010-440X(91)90046-F · doi:10.1016/0010-440x(91)90046-f
- Fiske DW, 1971, Measuring the Concepts of Personality. dine
- Perry JC, 1991, Personality Disorders: New Perspectives Validity
- Luborsky L, Crits-Christoph P: Understanding Transference: The CCRT Method
- 10.1080/00332747.1989.11024447 · doi:10.1080/00332747.1989.11024447
- Spitzer RL, 1988, Williams JBW
Cited by
Practice Guideline for the Treatment of Patients With Obsessive-Compulsive Disorder
(2008) · APA Practice Guidelines for the Treatment of Psychiatric Disorders: Comprehensive Guidelines and Guideline Watches · doi:10.1176/appi.books.9780890423363.149114 · Cited by 1,028
Psychiatric and Substance Use Comorbidity Among Treatment-Seeking Opioid Abusers
Brooner, R. K. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830130077015 · Cited by 746
The Broad Autism Phenotype Questionnaire
Hurley, R. S. E., Losh, M., Parlier, M., Reznick, J. S., & Piven, J. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0299-3 · Cited by 667
Westen, D., & Shedler, J. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.2.258 · Cited by 487
Psychiatric comorbidity in patients with eating disorders
Braun, D. L., Sunday, S. R., & Halmi, K. A. (1994) · Psychological Medicine · doi:10.1017/s0033291700028956 · Cited by 482
Studying the clinician: judgment research and psychological assessment
(1999) · Choice Reviews Online · doi:10.5860/choice.36-3045 · Cited by 444
Personality and personality disorders.
Widiger, T. A., & Costa, P. T. (1994) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.103.1.78 · Cited by 442
Effectiveness of Psychotherapy for Personality Disorders
Perry, J. C., Banon, E., & Ianni, F. (1999) · American Journal of Psychiatry · doi:10.1176/ajp.156.9.1312 · Cited by 421
Bagby, R. M., Taylor, G. J., Parker, J. D. A., & Dickens, S. E. (2006) · Psychotherapy and Psychosomatics · doi:10.1159/000089224 · Cited by 360
Clinical Judgment and Decision Making
Garb, H. N. (2005) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.1.102803.143810 · Cited by 341
(1997) · American Journal of Psychiatry · doi:10.1176/ajp.154.7.895 · Cited by 326
Reliability and Validity of the Borderline Personality Disorder Severity Index
Arntz, A., van den Hoorn, M., Cornelis, J., Verheul, R., van den Bosch, W. M. C., & de Bie, A. J. H. T. (2003) · Journal of Personality Disorders · doi:10.1521/pedi.17.1.45.24053 · Cited by 305
Comorbidity of axis I and axis II disorders
(1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.4.571 · Cited by 292
When clinical description becomes statistical prediction.
Westen, D., & Weinberger, J. (2004) · American Psychologist · doi:10.1037/0003-066x.59.7.595 · Cited by 292
Bond, M., & Perry, J. C. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.9.1665 · Cited by 275
Beauchaine, T. P., Klein, D. N., Crowell, S. E., Derbidge, C., & Gatzke-Kopp, L. (2009) · Development and Psychopathology · doi:10.1017/s0954579409000418 · Cited by 264
Establishing the severity of personality disorder
(1996) · American Journal of Psychiatry · doi:10.1176/ajp.153.12.1593 · Cited by 260
Unmet need for services and interventions among adolescents with mental disorders
Wang, P. S., Sherrill, J., & Vitiello, B. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.1.1 · Cited by 123
Psychological testing and psychological assessment: A review of evidence and issues.
Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., Kubiszyn, T. W., & Reed, G. M. (2001) · American Psychologist · doi:10.1037//0003-066x.56.2.128 · Cited by 1,469
“…criteria) without fully considering the salience of these responses in the patient's broader life context or without adequately recognizing how the individual responses fit together into a symptomatically coherent pattern (Arkes, 1981; Klein, Ouimette, Kelly, Ferro, & Riso, 1994; Perry, 1992).”
BackgroundThe ADP-IV Questionnaire: Differential Validity and Concordance with the Semi-Structured Interview
Schotte, C. K. W., Doncker, D. A. M. D., Dmitruk, D., Mulders, I. V., D'Haenen, H., & Cosyns, P. (2004) · Journal of Personality Disorders · doi:10.1521/pedi.2004.18.4.405 · Cited by 99
Doidge, N., Simon, B., Brauer, L., Grant, D. C., First, M., Brunshaw, J., Lancee, W. J., Stevens, A., Oldham, J. M., & Mosher, P. (2002) · Journal of the American Psychoanalytic Association · doi:10.1177/00030651020500021201 · Cited by 66
Paranoid personality traits in a panic disorder population: A pilot study
Reich, J., & Braginsky, Y. (1994) · Comprehensive Psychiatry · doi:10.1016/0010-440x(94)90017-5 · Cited by 35
Marchesi, C., Cantoni, A., Fontò, S., Giannelli, M. R., & Maggini, C. (2006) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2006.00772.x · Cited by 30
Elucidating the relationship between borderline personality disorder and intimate partner violence
Munro, O. E., & Sellbom, M. (2020) · Personality and Mental Health · doi:10.1002/pmh.1480 · Cited by 26
Crișan, Ş., Stoia, M., Predescu, E., Miu, A. C., & Szentágotai‐Tătar, A. (2023) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2856 · Cited by 21
Schotte, C. K. W., & De Doncker, D. (2000) · Psychopraxis · doi:10.1007/bf03071865 · Cited by 18
Munjiza, J., Britvic, D., & Crawford, M. J. (2019) · BMC Psychiatry · doi:10.1186/s12888-018-1975-5 · Cited by 15
(2013) · ePrints Soton (University of Southampton) · Cited by 6
Metadata
- Venue
- American Journal of Psychiatry
- Published
- 1992-12-01
- Volume
- 149
- Issue
- 12
- Pages
- 1645-1653
- ISSN
- 0002-953X (ISSN-L)
- 1535-7228
- OpenAlex
- W2360906823
- Cited by
- 325
- References
- 30
- FWCI
- 18.45
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.