The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Reliability of the Hamilton Rating Scale for Depression: A meta-analysis over a period of 49years
Abstract
The aim of this study was to provide a comprehensive meta-analytic review of the reliability of the Hamilton Rating Scale for Depression (HRSD) for the period 1960-2008, taking into consideration all three types of reliability: internal consistency, inter-rater, and test-retest reliability. This is the first such meta-analytic study of a clinician-administered psychiatric scale. A thorough literature search was conducted using MEDLINE and PsycINFO. The total number of collected articles was 5548, of which 409 reported one or more reliability coefficients. The effect size was obtained by the z-transformation of reliability coefficients. The meta-analysis was performed separately for internal consistency, inter-rater and test-retest reliability. A pooled mean for alpha coefficient in random effects model was 0.789 (95%CI 0.766-0.810). The meta-regression analysis revealed that higher alpha coefficients were associated with higher variability of the HRSD total scores. With regard to inter-rater reliability, pooled means in random effects model were 0.937 (95%CI 0.914-0.954) for the intraclass correlation coefficient, 0.81 (95%CI 0.72-0.88) for the kappa coefficient, 0.94 (95%CI 0.90-0.97) for the Pearson correlation coefficient, and 0.91 (95%CI 0.78-0.96) for the Spearman rank correlation coefficient. A meta-regression analysis showed positive association between inter-rater reliability and publication year. Test-retest reliability of HRSD ranged between 0.65 and 0.98 and generally decreased with extending the interval between two measurements (Spearman r between the duration of interval and test-retest reliability figures=-0.74). Results suggest that HRSD provides a reliable assessment of depression. Figures indicate good overall levels of internal consistency, inter-rater and test-retest reliability, but some HRSD items (e.g., "loss of insight") do not appear to possess a satisfactory reliability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The HDRS is a widely used instrument and holds a good internal consistency of α = .79, an interrater reliability of r = .94, and a test-retest reliability of r = .87 [73].”
From Metacognitive Training for Obsessive-Compulsive Disorder: A study protocol for a randomized controlled trial (2020) · cites this paper as [73]
In the citing paper
“The HRSD17 has shown good internal consistency (α = 79) and test–retest reliability (r = 0.87) in a recent meta-analysis [22].”
From Antidepressant side effects and their impact on treatment outcome in people with major depressive disorder: an iSPOT-D report (2021) · cites this paper as [22]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Development and validation of a geriatric depression screening scale: a preliminary report
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., & Leirer, V. O. (1982) · Journal of Psychiatric Research · doi:10.1016/0022-3956(82)90033-4 · Cited by 15,025
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Foundations of Clinical Research: Applications to Practice,
(2002) · Survey of Ophthalmology · doi:10.1016/s0039-6257(02)00362-4 · Cited by 9,494
Development of a Rating Scale for Primary Depressive Illness
Hamilton, M. (1967) · British Journal of Social and Clinical Psychology · doi:10.1111/j.2044-8260.1967.tb00530.x · Cited by 8,410
Kendall, M. G. (1957) · Biometrika · doi:10.2307/2333282 · Cited by 6,442
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,840
Geary, R. C., & Kendall, M. G. (1949) · The Economic Journal · doi:10.2307/2226580 · Cited by 2,444
Wilamowska (2010) · doi:10.1001/archpsyc.1988.01800320058007 · Cited by 2,115
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
Kaplan & Sadock's Comprehensive Textbook of Psychiatry
Sadock, B. J., & Sadock, V. A. (2000) · Cited by 1,523
Kaplan and Sadock's Comprehensive Text Book of Psychiatry
Saldanha, D. (2005) · Medical Journal Armed Forces India · doi:10.1016/s0377-1237(05)80189-3 · Cited by 1,164
The Hamilton Depression Rating Scale: Has the Gold Standard Become a Lead Weight?
Bagby, R. M., Ryder, A. G., Schuller, D. R., & Marshall, M. B. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.12.2163 · Cited by 1,148
Foundations of clinical research application to practice
Portney, L. (1993) · Medical Entomology and Zoology · Cited by 1,135
Foundations of Clinical Research
Portney, L. G., & Watkins, M. P. (1993) · Cited by 979
Research Methods in Applied Settings: An Integrated Approach to Design and Analysis
Gliner, J. A., Morgan, G. A., & Leech, N. L. (2000) · Cited by 753
Foundations of clinical research. Applications to practice
Fortney, L. (1993) · Medical Entomology and Zoology · Cited by 700
QUANTITATIVE RATING OF DEPRESSIVE STATES
Bech, P., Gram, L. F., Dein, E., Jacobsen, O., Vitger, J., & Bolwig, T. G. (1975) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1975.tb00002.x · Cited by 489
Validity and Reliability of the Chinese Hamilton Depression Rating Scale
Zheng, Y., Zhao, J., Phillips, M., Liu, J., Cai, M., Sun, S., & Huang, M. (1988) · British Journal of Psychiatry · doi:10.1192/bjp.152.5.660 · Cited by 423
The modified Hamilton rating scale for depression: Reliability and validity
Miller, I. W., Bishop, S. B., Norman, W. H., & Maddever, H. M. (1985) · Psychiatry Research · doi:10.1016/0165-1781(85)90057-5 · Cited by 411
Review of developments in meta-analytic method.
Bangert‐Drowns, R. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.3.388 · Cited by 327
The Montgomery‐Åsberg Depression Scale: reliability and validity
Davidson, J., Turnbull, C. D., Strickland, R., Miller, R., & Graves, K. (1986) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1986.tb02723.x · Cited by 290
A K-Sample Significance Test for Independent Alpha Coefficients
Hakstian, A. R., & Whalen, T. E. (1976) · Psychometrika · doi:10.1007/bf02291840 · Cited by 274
A new validation of the Hamilton Rating Scale for depression
Ramos-Brieva, J. A., & Cordero-Villafafila, A. (1988) · Journal of Psychiatric Research · doi:10.1016/0022-3956(88)90024-6 · Cited by 238
Zimmerman, M., Posternak, M. A., & Chelminski, I. (2004) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2004.03.007 · Cited by 229
Addington, D. E., Addington, J., & Atkinson, M. J. (1996) · Schizophrenia Research · doi:10.1016/0920-9964(95)00070-4 · Cited by 225
Yin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197 · cited 3×
“A similar relationship between test–retest reliability and theperiod between the two administrations of the scale was observed in a metaanalysis of reliability of the Beck Depression Inventory (Beck et al., 1961), with the correlation coefficient of r=–0.59 (Yin and Fan, 2000).”
InfluentialDepression in Patients with Parkinsonism
Robins, A. H. (1976) · The British Journal of Psychiatry · doi:10.1192/bjp.128.2.141 · Cited by 185
Maust, D. T., Cristancho, M. A., Gray, L. B., Rushing, S. E., Tjoa, C., & Thase, M. E. (2012) · Handbook of clinical neurology · doi:10.1016/b978-0-444-52002-9.00013-9 · Cited by 183
A Guide to Assessments that Work
(2008) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195310641.001.0001 · Cited by 176
A Guide to assessments that work
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0328 · Cited by 170
The correction for spurious correlation in the evaluation of short-form tests
Levy, P. (1967) · Journal of Clinical Psychology · doi:10.1002/1097-4679(196701)23:1 · Cited by 167
Zimmerman, M., Chelminski, I., & Posternak, M. (2004) · Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000138226.22761.39 · Cited by 150
Potts, M. K., Daniels, M. L., Burnam, M. A., & Wells, K. B. (1990) · Journal of Psychiatric Research · doi:10.1016/0022-3956(90)90005-b · Cited by 146
Pilot studies of telemedicine for patients with obsessive-compulsive disorder
Baer, L., Cukor, P., Jenike, M. A., Leahy, L., O’Laughlen, J., & COYLE, J. T. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.9.1383 · Cited by 144
Sertraline treatment of elderly patients with depression and cognitive impairment
Devanand, D. P., Pelton, G. H., Marston, K., Camacho, Y., Roose, S. P., Stern, Y., & Sackeïm, H. A. (2003) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.802 · Cited by 136
Gottfries, C. G. (1998) · International Clinical Psychopharmacology · doi:10.1097/00004850-199809005-00004 · Cited by 105
Kobak, K. A., Greist, J. H., Jefferson, J. W., Mundt, J. C., & Katzelnick, D. J. (1999) · PubMed · Cited by 95
A Reliability Generalization Study of the Geriatric Depression Scale
Kieffer, K. M., & Reese, R. J. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402238085 · Cited by 86
Tabuse, H., Kalali, A., Azuma, H., Ozaki, N., Iwata, N., Naitoh, H., Higuchi, T., Kanba, S., Shioe, K., Akechi, T., et al. (2007) · Psychiatry Research · doi:10.1016/j.psychres.2006.07.004 · Cited by 81
Reliability of Depression and Associated Clinical Symptoms
Cicchetti, D. V. (1983) · Archives of General Psychiatry · doi:10.1001/archpsyc.1983.01790080069009 · Cited by 78
Müller, M. J., & Dragičević, A. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00097-6 · Cited by 75
Santen, G., Gomeni, R., Danhof, M., & Pasqua, O. D. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2007.11.004 · Cited by 59
The Hamilton Rating Scale for Depression: A meta-analytic reliability generalization study
Pina, J. A. L., Sánchez‐Meca, J., & Alcázar, A. I. R. (2009) · Redalyc (Universidad Autónoma del Estado de México) · Cited by 50
Use of the Hamilton Depression Scale in General Practice
Paykel, E. S. (1990) · Springer eBooks · doi:10.1007/978-3-642-75373-2_6 · Cited by 48
SCHIZOPHRENIA WITH ONSET AT THE EXTREMES OF ADULT LIFE
Castle, D. J., Wessely, S. C., Howard, R. J., & Murray, R. M. (1997) · International Journal of Geriatric Psychiatry · doi:10.1002/(sici)1099-1166(199707)12:7 · Cited by 48
The Hamilton Depression Scale and the Numerical Description of the Symptoms of Depression
Berrios, G. E., & Bulbena-Villarasa, A. (1990) · Springer eBooks · doi:10.1007/978-3-642-75373-2_10 · Cited by 36
Kobak, K. A., Lipsitz, J. D., & Feiger, A. D. (2003) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(03)00056-6 · Cited by 35
Kobak, K. A., Williams, J. B. W., & Engelhardt, N. (2007) · Psychiatry Research · doi:10.1016/j.psychres.2007.06.025 · Cited by 30
Onega, L. L., & Abraham, I. L. (1997) · PubMed · Cited by 28
Bech, P., Lunde, M., & Undén, M. (2002) · International Journal of Psychiatry in Clinical Practice · doi:10.1080/136515002760276063 · Cited by 23
The Structure of Depressive Symptoms in the Elderly
Good, W. R., Vlachonikolis, I. G., Griffiths, P., & Griffiths, R. A. (1987) · The British Journal of Psychiatry · doi:10.1192/bjp.150.4.463 · Cited by 17
Shankman, S. A., & Klein, D. N. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(01)00302-0 · Cited by 15
Fiske, A., & O’Riley, A. A. (2008) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195310641.003.0007 · Cited by 7
Wills, W., Trieman, N., & Leff, J. (1998) · International Journal of Geriatric Psychiatry · doi:10.1002/(sici)1099-1166(199804)13:4
Research works printed but not linked: 1
- Hedlund, 1979, The Hamilton Rating Scale for Depression: A comprehensive review, Journal of Operational Psychiatry, 10, 149
Cited by
Sorted by citations
Distinct symptom-specific treatment targets for circuit-based neuromodulation
Siddiqi, S. H., Taylor, S. F., Cooke, D., Pascual-Leone, A., George, M. S., & Fox, M. D. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19090915 · Cited by 375
DSM-5 Criteria and Depression Severity: Implications for Clinical Practice
Tolentino, J. C., & Schmidt, S. L. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00450 · Cited by 311
Revisiting the theoretical and methodological foundations of depression measurement
Fried, E. I., Flake, J. K., & Robinaugh, D. J. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00050-2 · Cited by 314
SELF-REPORT AND CLINICIAN-RATED MEASURES OF DEPRESSION SEVERITY: CAN ONE REPLACE THE OTHER?
Uher, R., Perlis, R. H., Placentino, A., Dernovšek, M. Z., Henigsberg, N., Mors, O. N., Maier, W., McGuffin, P., & FARMER, A. E. (2012) · Depression and Anxiety · doi:10.1002/da.21993 · Cited by 264
Maternal prenatal stress phenotypes associate with fetal neurodevelopment and birth outcomes
Walsh, K., McCormack, C. A., Webster, R., Pinto, A., Lee, S., Feng, T., Krakovsky, H. S., O’Grady, S. M., Tycko, B., Champagne, F. A., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905890116 · Cited by 273
Metadata
- Authors
- Trajković, G., Starčević, V., Latas, M., Leštarević, M., Ille, T., Bukumirić, Z., & Marinković, J.
- Affiliations
- University of Belgrade (RS)
- The University of Sydney (AU)
- University of Priština - Kosovska Mitrovica (XK)
- Corresponding author
- Trajković, Goran
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2011-08
- Volume
- 189
- Issue
- 1
- Pages
- 1-9
- ISSN
- 0165-1781 (ISSN-L)
- OpenAlex
- W1995485235
- Cited by
- 303
- References
- 59
- Citations by year
- 2026: 23 · 2025: 27 · 2024: 22 · 2023: 26 · 2022: 30 · 2021: 23 · 2020: 32 · 2019: 19 · 2018: 14 · 2017: 16 · 2016: 15 · 2015: 15 · 2014: 22 · 2013: 13 · 2012: 5
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychiatry Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- Hamilton Depression Rating Scale, depression assessment, reliability statistics, internal consistency, inter-rater reliability, test-retest reliability, intraclass correlation coefficient, kappa statistic, Pearson correlation, Spearman correlation, loss of insight
- MeSH terms
- Depression, Humans, Longitudinal Studies, Psychiatric Status Rating Scales, Regression Analysis, Reproducibility of Results, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review