The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Reliability Studies of Psychiatric Diagnosis: Theory and Practice
Abstract
The existing literature on the reliability of psychiatric diagnosis falls into two periods, the earlier reporting low reliability and the latter reporting much higher figures. The reasons for this trend are examined in the context of a discussion of the design of diagnostic reliability studies. The problems of research design and execution in studies of diagnostic reliability are reviewed, and statistical problems are examined. Solutions to many of these problems ae suggested, including recommendations of appropriate reliability coefficients and data analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
DSM-III field trials: I. Initial interrater diagnostic reliability
(1979) · American Journal of Psychiatry · doi:10.1176/ajp.136.6.815 · Cited by 394
Cited by
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034
Keller, M. B. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800180050009 · Cited by 1,643
Loranger, A. W. (1994) · Archives of General Psychiatry · doi:10.1001/archpsyc.1994.03950030051005 · Cited by 1,069
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
The Kappa Statistic: A Second Look
Eugenio, B. D., & Glass, M. (2004) · Computational Linguistics · doi:10.1162/089120104773633402 · Cited by 489
Del-Ben, C. M., Vilela, J. A. A., Crippa, J. A. D. S., Hallak, J. E. C., Labate, C. M., & Zuardi, A. W. (2001) · Revista Brasileira de Psiquiatria · doi:10.1590/s1516-44462001000300008 · Cited by 386
Osório, F. L., Loureiro, S. R., Hallak, J. E. C., Machado‐de‐Sousa, J. P., Ushirohira, J. M., Baes, C. V. W., Apolinario, T. D., Donadon, M. F., Bolsoni, L. M., Guimarães, T., et al. (2019) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12931 · Cited by 348
High interrater reliability for the Structured Clinical Interview for DSM-III-R Axis I (SCID-I)
Skre, I., Onstad, S., Torgersen, S., & Kringlen, E. (1991) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1991.tb03123.x · Cited by 353
Diagnosis of Nonpsychotic Patients in Community Clinics
Shear, M. K., Greeno, C., Kang, J., Ludewig, D., Frank, E., Swartz, H. A., & Hanekamp, M. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.4.581 · Cited by 316
Reliability of the structured clinical interview for DSM-iII-R: an evaluative review
Segal, D. L., Hersen, M., & Van Hasselt, V. B. (1994) · Comprehensive Psychiatry · doi:10.1016/0010-440x(94)90025-6 · Cited by 293
Mental state decoding abilities in clinical depression
Lee, L., Harkness, K. L., Sabbagh, M. A., & Jacobson, J. A. (2005) · Journal of Affective Disorders · doi:10.1016/j.jad.2005.02.007 · Cited by 280
Harkness, K. L., Bruce, A. E., & Lumley, M. N. (2006) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.115.4.730 · Cited by 272
Diversity of decision-making models and the measurement of interrater agreement
Uebersax, J. S. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.1.140 · Cited by 254
Sartorius, N. (1993) · Archives of General Psychiatry · doi:10.1001/archpsyc.1993.01820140037004 · Cited by 195
Lenzenweger, M. F. (1999) · Archives of General Psychiatry · doi:10.1001/archpsyc.56.11.1009 · Cited by 195
Mehta, S., Bastero‐Caballero, R. F., Sun, Y., Zhu, R., Murphy, D. K., Hardas, B., & Koch, G. (2018) · Statistics in Medicine · doi:10.1002/sim.7679 · Cited by 193
(1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.10.1427 · Cited by 135
Boris, N. W., Hinshaw-Fuselier, S. S., Smyke, A. T., Scheeringa, M. S., Heller, S. S., & Zeanah, C. H. (2004) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200405000-00010 · Cited by 128
Impairments of speed and amplitude of movement in Parkinson’s disease: A pilot study
Espay, A. J., Beaton, D. E., Morgante, F., Gunraj, C. A., Lang, A. E., & Chen, R. (2009) · Movement Disorders · doi:10.1002/mds.22480 · Cited by 125
Psychiatric Diagnostic Interviews for Children and Adolescents: A Comparative Study
Angold, A., Erkanli, A., Copeland, W., Goodman, R., Fisher, P. W., & Costello, E. J. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.02.020 · Cited by 119
Levis, B., Yan, X. W., He, C., Sun, Y., Benedetti, A., & Thombs, B. D. (2019) · BMC Medicine · doi:10.1186/s12916-019-1297-6 · Cited by 117
Harkness, K. L., Alavi, N., Monroe, S. M., Slavich, G. M., Gotlib, I. H., & Bagby, R. M. (2010) · Journal of Abnormal Psychology · doi:10.1037/a0020629 · Cited by 116
Assumptions behind Intercoder Reliability Indices
Zhao, X., Liu, J. S., & Deng, K. (2013) · Annals of the International Communication Association · doi:10.1080/23808985.2013.11679142 · Cited by 113
Biopsychobehavioral correlates of insomnia. IV: Diagnosis based on DSM- III
(1984) · American Journal of Psychiatry · doi:10.1176/ajp.141.3.357 · Cited by 105
Mental state decoding in past major depression: effect of sad versus happy mood induction
Harkness, K. L., Jacobson, J. A., Duong, D., & Sabbagh, M. A. (2010) · Cognition & Emotion · doi:10.1080/02699930902750249 · Cited by 94
Aggarwal, N. K., Glass, A., Tirado, A., Boiler, M., Nicasio, A., Alegría, M., Wall, M., & Lewis-Fernández, R. (2014) · Journal of Health Care for the Poor and Underserved · doi:10.1353/hpu.2014.0132 · Cited by 90
Competing Definitions of Schizophrenia: What Can Be Learned From Polydiagnostic Studies?
Jansson, L. B., & Parnas, J. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbl065 · Cited by 73
The Reliability of Peer Assessments: A Meta-Analysis
Goldman, R. L. (1994) · Evaluation & the Health Professions · doi:10.1177/016327879401700101 · Cited by 62
Axelsson, E., Andersson, E., Ljótsson, B., Wallhed Finn, D., & Hedman, E. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1161663 · Cited by 60
Antshel, K. M., Faraone, S. V., Maglione, K., Doyle, A., Fried, R., Seidman, L., & Biederman, J. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e318172eecf · Cited by 56
La Rocque, C. L., Harkness, K. L., & Bagby, R. M. (2014) · Journal of Adolescence · doi:10.1016/j.adolescence.2014.05.012 · Cited by 44
Hawley, L. L., Rogojanski, J., Vorstenbosch, V., Quilty, L. C., Laposa, J. M., & Rector, N. A. (2017) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2017.03.003 · Cited by 31
Agreement between clinical and MINI diagnoses in outpatients with mood and anxiety disorders
Verhoeven, F. E. A., Swaab, L. S. M. A., Carlier, I. V. E., van Hemert, A. M., Zitman, F. G., Ruhé, H. G., Schoevers, R. A., & Giltay, E. J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.06.041 · Cited by 19
Measuring Agreement Using Guessing Models and Knowledge Coefficients
Moss, J. (2023) · Psychometrika · doi:10.1007/s11336-023-09919-4 · Cited by 8
Metadata
- Authors
- Grove, W. M.
- Venue
- Archives of General Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 1981-04-01
- Volume
- 38
- Issue
- 4
- Pages
- 408
- ISSN
- 0003-990X (ISSN-L)
- OpenAlex
- W2144489542
- Cited by
- 449
- References
- 2
- FWCI
- 44.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
