The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
A Re-analysis of the Reliability of Psychiatric Diagnosis
Abstract
Classification systems such as diagnosis have two primary properties, reliability and validity. Reliability refers to the consistency with which subjects are classified; validity, to the utility of the system for its various purposes. In the case of psychiatric diagnosis, the purposes of the classification system are communication about clinical features, aetiology, course of illness and treatment. A necessary constraint on the validity of a system is its reliability. There is no guarantee that a reliable system is valid, but assuredly an unreliable system must be invalid.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Self-citationDiagnostic Criteria for Use in Psychiatric Research
Feighner, J. P. (1972) · Archives of General Psychiatry · doi:10.1001/archpsyc.1972.01750190059011 · Cited by 5,715
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
Self-citationMeasures of response agreement for qualitative data: Some generalizations and alternatives.
Light, R. J. (1971) · Psychological Bulletin · doi:10.1037/h0031643 · Cited by 747
Reliability of a Procedure for Measuring and Classifying “Present Psychiatric State”
Wing, J. K., Birley, J. L. T., Cooper, J. E., Graham, P., & Isaacs, A. D. (1967) · British Journal of Psychiatry · doi:10.1192/bjp.113.498.499 · Cited by 371
Quantification of Agreement in Psychiatric Diagnosis: A New Approach
Spitzer, R. L. (1967) · Archives of General Psychiatry · doi:10.1001/archpsyc.1967.01730250085012 · Cited by 333
Self-citationDiagnostic Criteria of American and British Psychiatrists
Kendell, R. E. (1971) · Archives of General Psychiatry · doi:10.1001/archpsyc.1971.01750140027006 · Cited by 317
The Reliability of Psychiatric Diagnosis
Kreitman, N. (1961) · Journal of Mental Science · doi:10.1192/bjp.107.450.876 · Cited by 292
Cited by
Research Diagnostic Criteria: Rationale and Reliability
Spitzer, R. L. (1978) · Archives of General Psychiatry · doi:10.1001/archpsyc.1978.01770300115013 · Cited by 6,951
Self-citationWittchen, H.-U. (1994) · Journal of Psychiatric Research · doi:10.1016/0022-3956(94)90036-1 · Cited by 2,348
The classification of child psychopathology: A review and analysis of empirical efforts.
Achenbach, T. M., & EDELBROCK, C. S. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.6.1275 · Cited by 1,526
Andreasen, N. C. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080023004 · Cited by 1,323
Copeland, J. R. M., Dewey, M. E., & Griffiths-Jones, H. M. (1986) · Psychological Medicine · doi:10.1017/s0033291700057779 · Cited by 750
Grant, B. (1995) · Drug and Alcohol Dependence · doi:10.1016/0376-8716(95)01134-k · Cited by 686
The Reliability of Clinical Methods, Data and Judgments: (First of Two Parts)
Koran, L. M. (1975) · New England Journal of Medicine · doi:10.1056/nejm197509252931307 · Cited by 649
THOITS, P. A. (1983) · Psychosocial Stress · doi:10.1016/b978-0-12-397560-7.50007-6 · Cited by 635
DSM-III and the transformation of American psychiatry: a history
(1993) · American Journal of Psychiatry · doi:10.1176/ajp.150.3.399 · Cited by 628
Helzer, J. E. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790300019003 · Cited by 617
Vulnerability to psychopathology: A biosocial model.
Zuckerman, M. (1999) · American Psychological Association eBooks · doi:10.1037/10316-000 · Cited by 601
Prevalence of Substance Abuse in Schizophrenia: Demographic and Clinical Correlates
Mueser, K. T., Yarnold, P. R., Levinson, D. F., Singh, H., Bellack, A. S., Kee, K., Morisson, R. L., & Yadalam, K. G. (1990) · Schizophrenia Bulletin · doi:10.1093/schbul/16.1.31 · Cited by 587
Ethnic Minorities and Mental Health
Vega, W. A., & Rumbaut, R. G. (1991) · Annual Review of Sociology · doi:10.1146/annurev.so.17.080191.002031 · Cited by 531
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
Performance status assessment in cancer patients. An inter-observer variability study
Sørensen, J., Klee, M., Palshof, T., & Hansen, H. (1993) · British Journal of Cancer · doi:10.1038/bjc.1993.140 · Cited by 483
Schizophrenia: The Characteristic Symptoms
Andreasen, N. C., & Flaum, M. (1991) · Schizophrenia Bulletin · doi:10.1093/schbul/17.1.27 · Cited by 426
Diagnosis and Symptoms of Depression in Opiate Addicts: Course and Relationship to Treatment Outcome
Rounsaville, B. J. (1982) · Archives of General Psychiatry · doi:10.1001/archpsyc.1982.04290020021004 · Cited by 410
Gradient grammar: An effect of animacy on the syntax of give in New Zealand and American English
Bresnan, J., & Hay, J. (2008) · Lingua · doi:10.1016/j.lingua.2007.02.007 · Cited by 406
DSM-III field trials: I. Initial interrater diagnostic reliability
(1979) · American Journal of Psychiatry · doi:10.1176/ajp.136.6.815 · Cited by 394
Self-citationClinical criteria for psychiatric diagnosis and DSM-III
(1975) · American Journal of Psychiatry · doi:10.1176/ajp.132.11.1187 · Cited by 394
Depue, R. A. (1981) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.90.5.381 · Cited by 394
Coghill, D., & Sonuga‐Barke, E. J. S. (2012) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02511.x · Cited by 355
Problems and considerations in the valid assessment of personality disorders
(1992) · American Journal of Psychiatry · doi:10.1176/ajp.149.12.1645 · Cited by 325
DSM-III: the major achievements and an overview
(1980) · American Journal of Psychiatry · doi:10.1176/ajp.137.2.151 · Cited by 324
Ramifications of a Population Model for κ as a Coefficient of Reliability
Kraemer, H. C. (1979) · Psychometrika · doi:10.1007/bf02296208 · Cited by 293
Responsiveness to change: an aspect of validity, not a separate dimension
Hays, R. D., & Hadorn, D. (1992) · Quality of Life Research · doi:10.1007/bf00435438 · Cited by 280
Zaudig, M., Mittelhammer, J., Hiller, W., Pauls, A., Thora, C., Morinigo, A., & Mombour, W. (1991) · Psychological Medicine · doi:10.1017/s0033291700014811 · Cited by 278
Kelly, T. M., & Mann, J. J. (1996) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1996.tb09869.x · Cited by 270
Personality disorders in DSM-III and DSM-III-R: convergence, coverage, and internal consistency
(1988) · American Journal of Psychiatry · doi:10.1176/ajp.145.5.573 · Cited by 265
Method matters: Understanding diagnostic reliability in DSM-IV and DSM-5.
Chmielewski, M., Clark, L. A., Bagby, R. M., & Watson, D. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000069 · Cited by 161
“Prior to DSM-III (American Psychiatric Association, 1980), diagnostic reliability was poor, due in part to the lack of specific diagnostic criteria (Spitzer & Fleiss, 1974).”
BackgroundRief, W., Avorn, J., & Barsky, A. J. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.2.155 · Cited by 167
Singh, J., Karanika-Murray, M., Baguley, T., & Hudson, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17196987 · Cited by 132
Bentall, R. (2006) · Medical Hypotheses · doi:10.1016/j.mehy.2005.09.026 · Cited by 119
The Distance Cure: A History of Teletherapy
Zeavin, H. (2021) · doi:10.7551/mitpress/12823.001.0001 · Cited by 109
Zimmerman, M. (2016) · The Canadian Journal of Psychiatry · doi:10.1177/0706743715625935 · Cited by 83
Competing Definitions of Schizophrenia: What Can Be Learned From Polydiagnostic Studies?
Jansson, L. B., & Parnas, J. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl065 · Cited by 73
Clinical utility of a dimensional model of personality disorder.
Widiger, T. A., & Mullins-Sweatt, S. N. (2010) · Professional Psychology: Research and Practice · doi:10.1037/a0021694 · Cited by 63
Santelmann, H., Franklin, J., Bußhoff, J., & Baethge, C. (2015) · Bipolar Disorders · doi:10.1111/bdi.12340 · Cited by 53
A new interview for the multiaxial assessment of psychiatric morbidity in medical settings
Lobo, A., Campos, R., Pérez-Echeverría, M.-J., Izuzquiza, J., García-Campayo, J., Saz, P., & Marcos, G. (1993) · Psychological Medicine · doi:10.1017/s0033291700028592 · Cited by 45
Genesis, modelling and methodological remedies to autism heterogeneity
Rabot, J., Rødgaard, E.-M., Joober, R., Dumas, G., Bzdok, D., Bernhardt, B., Jacquemont, S., & Mottron, L. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105201 · Cited by 31
Agreement between clinical and MINI diagnoses in outpatients with mood and anxiety disorders
Verhoeven, F. E. A., Swaab, L. S. M. A., Carlier, I. V. E., van Hemert, A. M., Zitman, F. G., Ruhé, H. G., Schoevers, R. A., & Giltay, E. J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.06.041 · Cited by 19
Levy, K. N., Meehan, K. B., Cain, N. M., & Ellison, W. D. (2013) · Understanding and treating pathological narcissism. · doi:10.1037/14041-003 · Cited by 12
Metadata
- Authors
- Spitzer, R. L., & Fleiss, J. L.
- Venue
- British Journal of Psychiatry
- Publisher
- Royal College of Psychiatrists
- Published
- 1974-10
- Volume
- 125
- Issue
- 587
- Pages
- 341-347
- ISSN
- 0007-1250 (ISSN-L)
- 1472-1465
- OpenAlex
- W2133399371
- Cited by
- 612
- References
- 18
- FWCI
- 25.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.