Reliability of the Hamilton Rating Scale for Depression: A meta-analysis over a period of 49years
Abstract
The aim of this study was to provide a comprehensive meta-analytic review of the reliability of the Hamilton Rating Scale for Depression (HRSD) for the period 1960-2008, taking into consideration all three types of reliability: internal consistency, inter-rater, and test-retest reliability. This is the first such meta-analytic study of a clinician-administered psychiatric scale. A thorough literature search was conducted using MEDLINE and PsycINFO. The total number of collected articles was 5548, of which 409 reported one or more reliability coefficients. The effect size was obtained by the z-transformation of reliability coefficients. The meta-analysis was performed separately for internal consistency, inter-rater and test-retest reliability. A pooled mean for alpha coefficient in random effects model was 0.789 (95%CI 0.766-0.810). The meta-regression analysis revealed that higher alpha coefficients were associated with higher variability of the HRSD total scores. With regard to inter-rater reliability, pooled means in random effects model were 0.937 (95%CI 0.914-0.954) for the intraclass correlation coefficient, 0.81 (95%CI 0.72-0.88) for the kappa coefficient, 0.94 (95%CI 0.90-0.97) for the Pearson correlation coefficient, and 0.91 (95%CI 0.78-0.96) for the Spearman rank correlation coefficient. A meta-regression analysis showed positive association between inter-rater reliability and publication year. Test-retest reliability of HRSD ranged between 0.65 and 0.98 and generally decreased with extending the interval between two measurements (Spearman r between the duration of interval and test-retest reliability figures=-0.74). Results suggest that HRSD provides a reliable assessment of depression. Figures indicate good overall levels of internal consistency, inter-rater and test-retest reliability, but some HRSD items (e.g., "loss of insight") do not appear to possess a satisfactory reliability.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The HDRS has good internal consistency (α = .79), interrater reliability (r = .94), and test-retest reliability (r = .87).
“The HDRS is a widely used instrument and holds a good internal consistency of α = .79, an interrater reliability of r = .94, and a test-retest reliability of r = .87 [73].”
From Metacognitive Training for Obsessive-Compulsive Disorder: A study protocol for a randomized controlled trial (2020) · cites this paper as [73]
The HRSD17 has shown good internal consistency (α = 79) and test-retest reliability (r = 0.87) in a recent meta-analysis.
“The HRSD17 has shown good internal consistency (α = 79) and test–retest reliability (r = 0.87) in a recent meta-analysis [22].”
From Antidepressant side effects and their impact on treatment outcome in people with major depressive disorder: an iSPOT-D report (2021) · cites this paper as [22]
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · see citing works
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · see citing works
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646 · see citing works
Development and validation of a geriatric depression screening scale: a preliminary report
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., & Leirer, V. O. (1982) · Journal of Psychiatric Research · doi:10.1016/0022-3956(82)90033-4 · Cited by 15,025 · see citing works
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962 · see citing works
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,347 · see citing works
Foundations of Clinical Research: Applications to Practice,
(2002) · Survey of Ophthalmology · doi:10.1016/s0039-6257(02)00362-4 · Cited by 9,485 · see citing works
Development of a Rating Scale for Primary Depressive Illness
Hamilton, M. (1967) · British Journal of Social and Clinical Psychology · doi:10.1111/j.2044-8260.1967.tb00530.x · Cited by 8,410 · see citing works
Kendall, M. G. (1957) · Biometrika · doi:10.2307/2333282 · Cited by 6,444 · see citing works
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,832 · see citing works
Geary, R. C., & Kendall, M. G. (1949) · The Economic Journal · doi:10.2307/2226580 · Cited by 2,440 · see citing works
Wilamowska (2010) · doi:10.1001/archpsyc.1988.01800320058007 · Cited by 2,115 · see citing works
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · see citing works
Kaplan & Sadock's Comprehensive Textbook of Psychiatry
Sadock, B. J., & Sadock, V. A. (2000) · Cited by 1,523 · see citing works
Kaplan and Sadock's Comprehensive Text Book of Psychiatry
Saldanha, D. (2005) · Medical Journal Armed Forces India · doi:10.1016/s0377-1237(05)80189-3 · Cited by 1,164 · see citing works
The Hamilton Depression Rating Scale: Has the Gold Standard Become a Lead Weight?
Bagby, R. M., Ryder, A. G., Schuller, D. R., & Marshall, M. B. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.12.2163 · Cited by 1,148 · see citing works
Foundations of clinical research application to practice
Portney, L. (1993) · Medical Entomology and Zoology · Cited by 1,133 · see citing works
Foundations of Clinical Research
Portney, L. G., & Watkins, M. P. (1993) · Cited by 981 · see citing works
ALZHEIMER'S DISEASE INTERNATIONAL
Graham, N., & Brodaty, H. (1997) · International Journal of Geriatric Psychiatry · doi:10.1002/(sici)1099-1166(199707)12:7 · Cited by 852 · see citing works
Research Methods in Applied Settings: An Integrated Approach to Design and Analysis
Gliner, J. A., Morgan, G. A., & Leech, N. L. (2000) · Cited by 753 · see citing works
Foundations of clinical research. Applications to practice
Fortney, L. (1993) · Medical Entomology and Zoology · Cited by 700 · see citing works
QUANTITATIVE RATING OF DEPRESSIVE STATES
Bech, P., Gram, L. F., Dein, E., Jacobsen, O., Vitger, J., & Bolwig, T. G. (1975) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1975.tb00002.x · Cited by 489 · see citing works
Validity and Reliability of the Chinese Hamilton Depression Rating Scale
Zheng, Y., Zhao, J., Phillips, M., Liu, J., Cai, M., Sun, S., & Huang, M. (1988) · British Journal of Psychiatry · doi:10.1192/bjp.152.5.660 · Cited by 423 · see citing works
The modified Hamilton rating scale for depression: Reliability and validity
Miller, I. W., Bishop, S. B., Norman, W. H., & Maddever, H. M. (1985) · Psychiatry Research · doi:10.1016/0165-1781(85)90057-5 · Cited by 411 · see citing works
Review of developments in meta-analytic method.
Bangert‐Drowns, R. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.3.388 · Cited by 327 · see citing works
The Montgomery‐Åsberg Depression Scale: reliability and validity
Davidson, J., Turnbull, C. D., Strickland, R., Miller, R., & Graves, K. (1986) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1986.tb02723.x · Cited by 290 · see citing works
A K-Sample Significance Test for Independent Alpha Coefficients
Hakstian, A. R., & Whalen, T. E. (1976) · Psychometrika · doi:10.1007/bf02291840 · Cited by 256 · see citing works
A new validation of the Hamilton Rating Scale for depression
Ramos-Brieva, J. A., & Cordero-Villafafila, A. (1988) · Journal of Psychiatric Research · doi:10.1016/0022-3956(88)90024-6 · Cited by 238 · see citing works
Zimmerman, M., Posternak, M. A., & Chelminski, I. (2004) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2004.03.007 · Cited by 229 · see citing works
Addington, D. E., Addington, J., & Atkinson, M. J. (1996) · Schizophrenia Research · doi:10.1016/0920-9964(95)00070-4 · Cited by 221 · see citing works
Yin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197 · cited 3× · see citing works
“A similar relationship between test–retest reliability and theperiod between the two administrations of the scale was observed in a metaanalysis of reliability of the Beck Depression Inventory (Beck et al., 1961), with the correlation coefficient of r=–0.59 (Yin and Fan, 2000).”
InfluentialDepression in Patients with Parkinsonism
Robins, A. H. (1976) · The British Journal of Psychiatry · doi:10.1192/bjp.128.2.141 · Cited by 185 · see citing works
A Guide to Assessments that Work
(2008) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195310641.001.0001 · Cited by 176 · see citing works
Maust, D. T., Cristancho, M. A., Gray, L. B., Rushing, S. E., Tjoa, C., & Thase, M. E. (2012) · Handbook of clinical neurology · doi:10.1016/b978-0-444-52002-9.00013-9 · Cited by 171 · see citing works
A Guide to assessments that work
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0328 · Cited by 169 · see citing works
The correction for spurious correlation in the evaluation of short-form tests
Levy, P. (1967) · Journal of Clinical Psychology · doi:10.1002/1097-4679(196701)23:1 · Cited by 167 · see citing works
Zimmerman, M., Chelminski, I., & Posternak, M. (2004) · Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000138226.22761.39 · Cited by 150 · see citing works
Potts, M. K., Daniels, M. L., Burnam, M. A., & Wells, K. B. (1990) · Journal of Psychiatric Research · doi:10.1016/0022-3956(90)90005-b · Cited by 146 · see citing works
Pilot studies of telemedicine for patients with obsessive-compulsive disorder
Baer, L., Cukor, P., Jenike, M. A., Leahy, L., O’Laughlen, J., & COYLE, J. T. (1995) · American Journal of Psychiatry · doi:10.1176/ajp.152.9.1383 · Cited by 144 · see citing works
Sertraline treatment of elderly patients with depression and cognitive impairment
Devanand, D. P., Pelton, G. H., Marston, K., Camacho, Y., Roose, S. P., Stern, Y., & Sackeïm, H. A. (2003) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.802 · Cited by 134 · see citing works
Gottfries, C. G. (1998) · International Clinical Psychopharmacology · doi:10.1097/00004850-199809005-00004 · Cited by 105 · see citing works
Kobak, K. A., Greist, J. H., Jefferson, J. W., Mundt, J. C., & Katzelnick, D. J. (1999) · PubMed · Cited by 95 · see citing works
A Reliability Generalization Study of the Geriatric Depression Scale
Kieffer, K. M., & Reese, R. J. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402238085 · Cited by 86 · see citing works
Reliability of Depression and Associated Clinical Symptoms
Cicchetti, D. V. (1983) · Archives of General Psychiatry · doi:10.1001/archpsyc.1983.01790080069009 · Cited by 78 · see citing works
Müller, M. J., & Dragičević, A. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00097-6 · Cited by 75 · see citing works
Tabuse, H., Kalali, A. H., Azuma, H., Ozaki, N., Iwata, N., Naitoh, H., Higuchi, T., Kanba, S., Shioe, K., Akechi, T., et al. (2007) · Psychiatry Research · doi:10.1016/j.psychres.2006.07.004 · Cited by 75 · see citing works
Santen, G., Gomeni, R., Danhof, M., & Pasqua, O. D. (2008) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2007.11.004 · Cited by 59 · see citing works
The Hamilton Rating Scale for Depression: A meta-analytic reliability generalization study
Pina, J. A. L., Sánchez‐Meca, J., & Alcázar, A. I. R. (2009) · Redalyc (Universidad Autónoma del Estado de México) · Cited by 50 · see citing works
Use of the Hamilton Depression Scale in General Practice
Paykel, E. S. (1990) · Springer eBooks · doi:10.1007/978-3-642-75373-2_6 · Cited by 48 · see citing works
The Hamilton Depression Scale and the Numerical Description of the Symptoms of Depression
Berrios, G. E., & Bulbena-Villarasa, A. (1990) · Springer eBooks · doi:10.1007/978-3-642-75373-2_10 · Cited by 36 · see citing works
Kobak, K. A., Lipsitz, J. D., & Feiger, A. D. (2003) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(03)00056-6 · Cited by 35 · see citing works
Kobak, K. A., Williams, J. B. W., & Engelhardt, N. (2007) · Psychiatry Research · doi:10.1016/j.psychres.2007.06.025 · Cited by 30 · see citing works
Onega, L. L., & Abraham, I. L. (1997) · PubMed · Cited by 28 · see citing works
Bech, P., Lunde, M., & Undén, M. (2002) · International Journal of Psychiatry in Clinical Practice · doi:10.1080/136515002760276063 · Cited by 23 · see citing works
The Structure of Depressive Symptoms in the Elderly
Good, W. R., Vlachonikolis, I. G., Griffiths, P., & Griffiths, R. A. (1987) · The British Journal of Psychiatry · doi:10.1192/bjp.150.4.463 · Cited by 17 · see citing works
Shankman, S. A., & Klein, D. N. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(01)00302-0 · Cited by 15 · see citing works
Fiske, A., & O’Riley, A. A. (2008) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195310641.003.0007 · Cited by 7 · see citing works
Wills, W., Trieman, N., & Leff, J. (1998) · International Journal of Geriatric Psychiatry · doi:10.1002/(sici)1099-1166(199804)13:4
Flagged first, then by citations
Cited by
Sorted by citations
Distinct symptom-specific treatment targets for circuit-based neuromodulation
Siddiqi, S. H., Taylor, S. F., Cooke, D., Pascual-Leone, A., George, M. S., & Fox, M. D. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19090915 · Cited by 375 · see citing works
DSM-5 Criteria and Depression Severity: Implications for Clinical Practice
Tolentino, J. C., & Schmidt, S. L. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00450 · Cited by 311 · see citing works
Revisiting the theoretical and methodological foundations of depression measurement
Fried, E. I., Flake, J. K., & Robinaugh, D. J. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00050-2 · Cited by 285 · see citing works
SELF-REPORT AND CLINICIAN-RATED MEASURES OF DEPRESSION SEVERITY: CAN ONE REPLACE THE OTHER?
Uher, R., Perlis, R. H., Placentino, A., Dernovšek, M. Z., Henigsberg, N., Mors, O. N., Maier, W., McGuffin, P., & FARMER, A. E. (2012) · Depression and Anxiety · doi:10.1002/da.21993 · Cited by 264 · see citing works
Maternal prenatal stress phenotypes associate with fetal neurodevelopment and birth outcomes
Walsh, K., McCormack, C. A., Webster, R., Pinto, A., Lee, S., Feng, T., Krakovsky, H. S., O’Grady, S. M., Tycko, B., Champagne, F. A., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905890116 · Cited by 258 · see citing works
Carrozzino, D., Patierno, C., Fava, G. A., & Guidi, J. (2020) · Psychotherapy and Psychosomatics · doi:10.1159/000506879 · Cited by 271 · see citing works
Gowda, U., Mutowo, M. P., Smith, B. J., Wluka, A. E., & Renzaho, A. M. N. (2015) · Nutrition · doi:10.1016/j.nut.2014.06.017 · Cited by 229 · see citing works
Ruíz-Grosso, P., de Mola, C. L., Vega‐Dienstmaier, J. M., Arévalo-Flores, M., Chavez, K., Vilela, A., Lazo, M., & Huapaya, J. A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045413 · Cited by 154 · see citing works
The relationship between purpose in life and depression and anxiety: A meta-analysis.
Boreham, I. D., & Schutte, N. (2023) · Journal of Clinical Psychology · doi:10.1002/jclp.23576 · Cited by 139 · see citing works
Reinertsen, E., & Clifford, G. D. (2018) · Physiological Measurement · doi:10.1088/1361-6579/aabf64 · Cited by 136 · see citing works
Braund, T. A., Tillman, G., Palmer, D. M., Gordon, E., Rush, A. J., & Harris, A. W. F. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01533-1 · Cited by 135 · see citing works
Johnson, K. A., Baig, M., Ramsey, D., Lisanby, S. H., Avery, D., McDonald, W. M., Li, X., Bernhardt, E. R., Haynor, D. R., Holtzheimer, P. E., et al. (2012) · Brain stimulation · doi:10.1016/j.brs.2012.02.003 · Cited by 129 · see citing works
Rohan, K. J., Rough, J. N., Evans, M., Ho, S.-Y., Meyerhoff, J., Roberts, L. M., & Vacek, P. M. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.01.051 · Cited by 114 · see citing works
Pachankis, J. E., Harkness, A., Maciejewski, K. R., Behari, K., Clark, K. A., McConocha, E., Winston, R., Adeyinka, O., Reynolds, J., Bränström, R., et al. (2022) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000724 · Cited by 112 · see citing works
How Does MBCT for Depression Work? Studying Cognitive and Affective Mediation Pathways
Batink, T., Peeters, F., Geschwind, N., van Os, J., & Wichers, M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072778 · Cited by 105 · see citing works
Deep brain stimulation for obsessive-compulsive disorders: long-term analysis of quality of life
Ooms, P., Mantione, M. H. M., Figee, M., Schuurman, P. R., van den Munckhof, P., & Denys, D. A. J. P. (2013) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2012-302550 · Cited by 103 · see citing works
Bernert, R., Luckenbaugh, D., Duncan, W., Iwata, N. G., Ballard, E., & Zarate, C. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.08.050 · Cited by 76 · see citing works
Hvenegaard, M., Møeller, S. B., Poulsen, S., Gondan, M., Grafton, B., Austin, S. F., Kistrup, M., Rosenberg, N. G., Howard, H., & Watkins, E. R. (2019) · Psychological Medicine · doi:10.1017/s0033291718003835 · Cited by 93 · see citing works
Wu, C., Liu, P., Fu, H., Chen, W., Cui, S., Lu, L., & Tang, C. (2018) · Medicine · doi:10.1097/md.0000000000013845 · Cited by 91 · see citing works
Chiesa, A., Castagner, V., Andrisano, C., Serretti, A., Mandelli, L., Porcelli, S., & Giommi, F. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.02.003 · Cited by 89 · see citing works
Jiang, Y., Shorey, S., Seah, B., Chan, W. X., Tam, W. W. S., & Wang, W. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.08.006 · Cited by 88 · see citing works
Ma, S., Yang, J., Yang, B., Kang, L., Wang, P., Zhang, N., Wang, W., Zong, X., Wang, Y., Bai, H., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.747139 · Cited by 91 · see citing works
Translating the BDI and BDI-II into the HAMD and vice versa with equipercentile linking
Furukawa, T. A., Reijnders, M., Kishimoto, S., Sakata, M., DeRubeis, R. J., Dimidjian, S., Dozois, D. J. A., Hegerl, U., Hollon, S. D., Jarrett, R. B., et al. (2019) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796019000088 · Cited by 86 · see citing works
Dialectical Behavior Therapy Group Skills Training for Bipolar Disorder
Eisner, L. R., Eddie, D., Harley, R. M., Jacobo, M., Nierenberg, A. A., & Deckersbach, T. (2017) · Behavior Therapy · doi:10.1016/j.beth.2016.12.006 · Cited by 84 · see citing works
Kanter, J. W., Santiago‐Rivera, A. L., Santos, M. M., Nagy, G. A., Lopez, M., Hurtado, G., & West, P. (2014) · Behavior Therapy · doi:10.1016/j.beth.2014.09.011 · Cited by 77 · see citing works
Heart rate variability as a biomarker of anxious depression response to antidepressant medication
Kircanski, K., Williams, L. M., & Gotlib, I. H. (2018) · Depression and Anxiety · doi:10.1002/da.22843 · Cited by 76 · see citing works
Graat, I., Mocking, R. J. T., Figee, M., Vulink, N. C. C., de Koning, P. P., Ooms, P., Mantione, M. H. M., van den Munckhof, P., Schuurman, R., & Denys, D. A. J. P. (2020) · Biological Psychiatry · doi:10.1016/j.biopsych.2020.08.018 · Cited by 73 · see citing works
PREPP: postpartum depression prevention through the mother–infant dyad
Werner, E. A., Gustafsson, H., Lee, S., Feng, T., Jiang, N., Desai, P., & Monk, C. E. (2015) · Archives of Women s Mental Health · doi:10.1007/s00737-015-0549-5 · Cited by 74 · see citing works
Cognitive emotion regulation in euthymic bipolar disorder
Wolkenstein, L., Zwick, J. C., Hautzinger, M., & Joormann, J. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.12.022 · Cited by 72 · see citing works
Hebbrecht, K., Stuivenga, M., Birkenhäger, T., Morrens, M., Fried, E. I., Sabbe, B., & Giltay, E. J. (2020) · BMC Medicine · doi:10.1186/s12916-020-01867-5 · Cited by 67 · see citing works
Halvorsen, J. Ø., Stenmark, H. I., Neuner, F., & Nordahl, H. M. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.03.010 · Cited by 70 · see citing works
Beevers, C. G., Pearson, R., Hoffman, J. S., Foulser, A. A., Shumake, J., & Meyer, B. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000171 · Cited by 69 · see citing works
Couto, M. I., Monteiro, A., Oliveira, A., Lunet, N., & Massano, J. (2014) · Acta Médica Portuguesa · doi:10.20344/amp.4928 · Cited by 68 · see citing works
Ellard, K. K., Bernstein, E. E., Hearing, C. M., Baek, J. H., Sylvia, L. G., Nierenberg, A. A., Barlow, D. H., & Deckersbach, T. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.05.011 · Cited by 68 · see citing works
Békés, V., Dunkley, D. M., Taylor, G., Zuroff, D. C., Lewkowski, M. D., Foley, J. E., Myhr, G., & Westreich, R. (2015) · Behavior Therapy · doi:10.1016/j.beth.2015.02.003 · Cited by 69 · see citing works
Sander, L. B., Paganini, S., Terhorst, Y., Schlicker, S., Lin, J., Spanhel, K., Buntrock, C., Ebert, D. D., & Baumeister, H. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1021 · Cited by 63 · see citing works
Schneider, K. L., Panza, E. A., Handschin, B., Ma, Y., Busch, A. M., Waring, M. E., Appelhans, B. M., Whited, M. C., Keeney, J., Kern, D., et al. (2015) · Behavior Therapy · doi:10.1016/j.beth.2015.10.005 · Cited by 61 · see citing works
A five‐sample confirmatory factor analytic study of burnout‐depression overlap
Bianchi, R., Schonfeld, I. S., & Verkuilen, J. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.22927 · Cited by 60 · see citing works
Can psychomotor disturbance predict ect outcome in depression?
van Diermen, L., Vanmarcke, S., Walther, S., Moens, H., Veltman, E. M., Fransén, E., Sabbe, B., van der Mast, R. C., Birkenhäger, T. K., & Schrijvers, D. L. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.07.009 · Cited by 61 · see citing works
Vetter, J., Spiller, T. R., Cathomas, F., Robinaugh, D. J., Brühl, A. B., Boeker, H., Seifritz, E., & Kleim, B. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.08.074 · Cited by 58 · see citing works
Woods, A., Solomonov, N., Liles, B., Guillod, A., Kales, H. C., & Sirey, J. A. (2021) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2020.12.021 · Cited by 59 · see citing works
Bödeker, K., Fuchs, A., Führer, D., Kluczniok, D., Dittrich, K., Reichl, C., Reck, C., Kaess, M., Attar, C. H., Möhler, E., et al. (2018) · Child Psychiatry & Human Development · doi:10.1007/s10578-018-0839-z · Cited by 56 · see citing works
Predicting treatment outcome in depression: an introduction into current concepts and challenges
Rost, N., Binder, E. B., & Brückl, T. M. (2022) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-022-01418-4 · Cited by 58 · see citing works
Tse, S., Davidson, L., Chung, K.-F., Ng, K. L., & Yu, C. H. (2014) · Psychiatry: Interpersonal and Biological Processes · doi:10.1521/psyc.2014.77.1.41 · Cited by 53 · see citing works
McKenna, B. S., Drummond, S. P. A., & Eyler, L. T. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.04.034 · Cited by 52 · see citing works
Zandberg, L. J., Zang, Y., McLean, C. P., Yeh, R., Simpson, H. B., & Foa, E. B. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.03.005 · Cited by 52 · see citing works
The Impact of Adolescent Binge Drinking and Sustained Abstinence on Affective State
Bekman, N. M., Winward, J. L., Lau, L. L., Wagner, C., & Brown, S. A. (2013) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12096 · Cited by 51 · see citing works
Abdelnaim, M. A., Langguth, B., Deppe, M., Mohonko, A., Kreuzer, P. M., Poeppl, T. B., Hebel, T., & Schecklmann, M. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00929 · Cited by 50 · see citing works
Ouyang, P., WENGER, N. K., Taylor, D. A., Rich-Edwards, J. W., Steiner, M. S., Shaw, L. J., Berga, S. L., Miller, V. M., & Merz, C. N. B. (2016) · Biology of Sex Differences · doi:10.1186/s13293-016-0073-y · Cited by 51 · see citing works
Fonagy, P., Lemma, A., Target, M., O’Keeffe, S., Constantinou, M., Wurman, T. V., Luyten, P., Allison, E., Roth, A. D., Cape, J. D., et al. (2019) · Psychological Medicine · doi:10.1017/s0033291719000928 · Cited by 51 · see citing works
Equine-Assisted Therapy for Veterans with PTSD: Manual Development and Preliminary Findings
Arnon, S., Fisher, P. W., Pickover, A. M., Lowell, A. M., Turner, J. B., Hilburn, A., Jacob-McVey, J., Malajian, B. E., Farber, D. G., Hamilton, J. F., et al. (2020) · Military Medicine · doi:10.1093/milmed/usz444 · Cited by 50 · see citing works
Belge, J.-B., van Diermen, L., Sabbe, B., Parizel, P. M., Morrens, M., Coppens, V., Constant, E., de Timary, P., Sienaert, P. A., Schrijvers, D. L., et al. (2020) · Neuropsychobiology · doi:10.1159/000506133 · Cited by 52 · see citing works
Rocque, C. L. L., Mazurka, R., Stuckless, T. J. R., Pyke, K., & Harkness, K. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.10.067 · Cited by 51 · see citing works
Reliability Generalization for Childhood Autism Rating Scale
Breidbord, J., & Croudace, T. J. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1832-9 · Cited by 48 · see citing works
Tse, S. S.-K., Murray, G., Chung, K., Davidson, L., Ng, K., & Yu, C. H. (2013) · Bipolar Disorders · doi:10.1111/bdi.12153 · Cited by 45 · see citing works
Haynes, P. L., Kelly, M. R., Warner, L., Quan, S. F., Krakow, B. J., & Bootzin, R. R. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.12.012 · Cited by 45 · see citing works
Lazarov, A., Basel, D., Dolan, S. C., Dillon, D. G., Pizzagalli, D. A., & Schneier, F. R. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.04.063 · Cited by 45 · see citing works
McKenna, B. S., Theilmann, R. J., Sutherland, A. N., & Eyler, L. T. (2015) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617715000314 · Cited by 44 · see citing works
Atypical Antipsychotics as Augmentation Therapy in Anorexia Nervosa
Marzola, E., Nadia, D., Giovannone, C., Amianto, F., Fassino, S., & Daga, G. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0125569 · Cited by 43 · see citing works
Jha, M. K., Minhajuddin, A., Chin-Fatt, C., Greer, T. L., Carmody, T. J., & Trivedi, M. H. (2019) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2019.03.013 · Cited by 40 · see citing works
“94; (Trajković et al., 2011)] and good construct validity [Cronbach’s α of 0.”
BackgroundRaes, F., Schoofs, H., Griffith, J., & Hermans, D. (2012) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2012.03.003 · Cited by 43 · see citing works
Psychometric properties of the Hamilton Depression Rating Scale in multiple sclerosis
Raimo, S., Trojano, L., Spitaleri, D. L. A., Petretta, V., Grossi, D., & Santangelo, G. (2015) · Quality of Life Research · doi:10.1007/s11136-015-0940-8 · Cited by 40 · see citing works
Kulesza, M., Raguram, R., & Rao, D. (2014) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2014.03.005 · Cited by 40 · see citing works
Ooms, P., Blankers, M., Figee, M., Mantione, M., van den Munckhof, P., Schuurman, P. R., & Denys, D. (2014) · Brain Stimulation · doi:10.1016/j.brs.2014.06.009 · Cited by 35 · see citing works
McKenna, B. S., Sutherland, A. N., Legenkaya, A. P., & Eyler, L. T. (2013) · Bipolar Disorders · doi:10.1111/bdi.12126 · Cited by 38 · see citing works
Prophylactic Effects of Duloxetine on Post-Stroke Depression Symptoms: An Open Single-Blind Trial
Zhang, L., Hu, X., Yao, L.-Y., Geng, Y., Wei, L.-L., Zhang, J., & Chen, W. (2013) · European Neurology · doi:10.1159/000345374 · Cited by 37 · see citing works
Peng, W.-F., Wang, X., Hong, Z., Zhu, G.-X., Li, B.-M., Li, Z., Ding, M., Geng, Z., Jin, Z., Miao, L., et al. (2015) · Seizure · doi:10.1016/j.seizure.2015.03.014 · Cited by 37 · see citing works
Anticipatory reward deficits in melancholia.
Liu, H., Sarapas, C., & Shankman, S. A. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000172 · Cited by 36 · see citing works
Dimensional and transdiagnostic phenotypes in psychiatric genome-wide association studies
Waszczuk, M. A., Jonas, K. G., Bornovalova, M. A., Breen, G. D., Bulik, C. M., Docherty, A. R., Eley, T. C., Hettema, J. M., Kotov, R., Krueger, R. F., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02142-8 · Cited by 32 · see citing works
Carlozzi, N. E., Miciura, A. L., Migliore, N., & Dayalu, P. (2014) · Journal of Huntington s Disease · doi:10.3233/jhd-140115 · Cited by 34 · see citing works
Schramm, E., Mack, S., Thiel, N., Jenkner, C., Elsaeßer, M., & Fangmeier, T. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00193 · Cited by 34 · see citing works
MacPherson, H. A., Kudinova, A. Y., Schettini, E., Jenkins, G. A., Gilbert, A. C., Thomas, S. A., Kim, K. L., Radoeva, P. D., Fenerci, R. L. B., Yen, S., et al. (2021) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01688-0 · Cited by 34 · see citing works
Berman, M. I., Morton, S. N., & Hegel, M. T. (2016) · Psychotherapy · doi:10.1037/pst0000083 · Cited by 30 · see citing works
Su, Y., Carpenter, J. K., Zandberg, L. J., Simpson, H. B., & Foa, E. B. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.03.003 · Cited by 32 · see citing works
Jha, M. K., Minhajuddin, A., South, C. C., Rush, A. J., & Trivedi, M. H. (2017) · The International Journal of Neuropsychopharmacology · doi:10.1093/ijnp/pyx097 · Cited by 32 · see citing works
Sebera, F. M., Vissoci, J. R. N., Umwiringirwa, J., Teuwen, D. E., Boon, P., & Dedeken, P. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234095 · Cited by 32 · see citing works
Hebbrecht, K., Giltay, E. J., Birkenhäger, T. K., Sabbe, B., Verwijk, E., Obbels, J., Roelant, E., Schrijvers, D. L., & van Diermen, L. (2020) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.13231 · Cited by 32 · see citing works
How Days Between Tests Impacts Alternate Forms Reliability in Computerized Adaptive Tests
Wyse, A. E. (2020) · Educational and Psychological Measurement · doi:10.1177/0013164420979656 · Cited by 32 · see citing works
Pruessner, L., Timm, C., Kalmar, J., Bents, H., Barnow, S., & Mander, J. (2024) · Depression and Anxiety · doi:10.1155/2024/9081139 · Cited by 31 · see citing works
The Maudsley Staging Method as predictor of electroconvulsive therapy effectiveness in depression
van Diermen, L., Hebbrecht, K., Schrijvers, D. L., Sabbe, B., Fransén, E., & Birkenhäger, T. K. (2018) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12962 · Cited by 30 · see citing works
van Diermen, L., Poljac, E., van der Mast, R. C., Plasmans, K., van den Ameele, S., Heijnen, W. T. C. J., Birkenhäger, T. K., Schrijvers, D. L., & Kamperman, A. M. (2020) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.20m13287 · Cited by 30 · see citing works
Effect of Botulinum Toxin on Non-Motor Symptoms in Cervical Dystonia
Costanzo, M., Belvisi, D., Berardelli, I., Maraone, A., Baione, V., Ferrazzano, G., Cutrona, C., Leodori, G., Pasquini, M., Conte, A., et al. (2021) · Toxins · doi:10.3390/toxins13090647 · Cited by 29 · see citing works
Crits-Christoph, P. F., Gallop, R., Diehl, C., Yin, S., & Gibbons, M. B. C. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000198 · Cited by 28 · see citing works
Shahrokhi, M., Ghaeli, P., Arya, P., Shakiba, A., Noormandi, A., Soleimani, M., & Esfandbod, M. (2021) · Basic and Clinical Neuroscience Journal · doi:10.32598/bcn.12.1.1650.2 · Cited by 28 · see citing works
Matini, D., Jolfaei, A. G., Pazouki, A., Pishgahroudsari, M., & Ehtesham, M. (2014) · PubMed Central · Cited by 27 · see citing works
Kedzior, K. K., & Reitz, S. K. (2014) · BMC Psychology · doi:10.1186/s40359-014-0039-y · Cited by 28 · see citing works
Craig, J. A., Miner, D., Remtulla, T., Miller, J., & Zanussi, L. (2016) · Health & Social Work · doi:10.1093/hsw/hlw064 · Cited by 28 · see citing works
Young, J. W., Geyer, M. A., Halberstadt, A. L., van Enkhuizen, J., Minassian, A., Khan, A., Perry, W., & Eyler, L. T. (2019) · Bipolar Disorders · doi:10.1111/bdi.12786 · Cited by 28 · see citing works
Metacognitive Training for Obsessive-Compulsive Disorder: A randomized controlled trial
Miegel, F. S., Moritz, S., Hottenrott, B., Demiralay, C., & Jelinek, L. (2021) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2021.100647 · Cited by 27 · see citing works
Cladder-Micus, M. B., van Aalderen, J., Donders, A. R. T., Spijker, J., Vrijsen, J. N., & Speckens, A. E. M. (2018) · Cognition and Emotion · doi:10.1080/02699931.2017.1285753 · Cited by 26 · see citing works
Foa, E. B., Asnaani, A., Rosenfield, D., Zandberg, L. J., Gariti, P., & Imms, P. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000213 · Cited by 26 · see citing works
Weiss, B., Erritzøe, D., Giribaldi, B., Nutt, D., & Carhart-Harris, R. L. (2023) · Journal of Psychopharmacology · doi:10.1177/02698811231167848 · Cited by 26 · see citing works
Leuchter, M. K., Citrenbaum, C., Wilson, A. C., Tibbe, T. D., JACKSON, N. J., Krantz, D. E., Wilke, S. A., Corlier, J., Strouse, T. B., Hoftman, G. D., et al. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115608 · Cited by 25 · see citing works
Wasserzug, Y., Degani, Y., Bar-Shaked, M., Binyamin, M., Klein, A., Hershko, S., & Levkovitch, Y. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.12.117 · Cited by 25 · see citing works
Depression with or without comorbid social anxiety: Is attachment the culprit?
Adams, G. C., Wrath, A. J., Mondal, P. K., & Asmundson, G. J. G. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.08.037 · Cited by 25 · see citing works
Increased Cerebral Blood Flow Associated with Better Response Inhibition in Bipolar Disorder
Dev, S. I., McKenna, B. S., Sutherland, A. N., Shin, D. D., Liu, T. T., Wierenga, C. E., & Eyler, L. T. (2015) · Journal of the International Neuropsychological Society · doi:10.1017/s135561771400112x · Cited by 25 · see citing works
Johnson, J. E., Miller, T. R., Stout, R. L., Zlotnick, C., Cerbo, L. A., Andrade, J. T., & Stirman, S. W. (2016) · Contemporary Clinical Trials · doi:10.1016/j.cct.2016.01.013 · Cited by 24 · see citing works
MacPherson, H. A., Ruggieri, A. L., Christensen, R. E., Schettini, E., Kim, K. L., Thomas, S. A., & Dickstein, D. P. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.04.078 · Cited by 24 · see citing works
The Unique Impact of Late-Life Bereavement and Prolonged Grief on Diurnal Cortisol
Holland, J. M., Rozalski, V., Thompson, K. L., Tiongson, R. J., Schatzberg, A. F., O'Hara, R. M., & Gallagher-Thompson, D. E. (2013) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbt051 · Cited by 26 · see citing works
Reliability and factor structure of the Hospital Anxiety and Depression Scale in a polytrauma clinic
Boxley, L., Flaherty, J. M., Spencer, R. J., Drag, L. L., Pangilinan, P. H., & Bieliauskas, L. A. (2016) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2015.05.0088 · Cited by 26 · see citing works
- Authors
- Trajković, G., Starčević, V., Latas, M., Leštarević, M., Ille, T., Bukumirić, Z., & Marinković, J.
- Affiliations
- University of Belgrade (RS)
- The University of Sydney (AU)
- University of Priština - Kosovska Mitrovica (XK)
- Corresponding author
- Trajković, Goran
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2011-08
- Volume
- 189
- Issue
- 1
- Pages
- 1-9
- ISSN
- 0165-1781 (ISSN-L)
- OpenAlex
- W1995485235
- Cited by
- 303
- References
- 59
- Citations by year
- 2026: 23 · 2025: 27 · 2024: 22 · 2023: 26 · 2022: 30 · 2021: 23 · 2020: 32 · 2019: 19 · 2018: 14 · 2017: 16 · 2016: 15 · 2015: 15 · 2014: 22 · 2013: 13 · 2012: 5
- FWCI
- 2.76
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychiatry Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- Hamilton Depression Rating Scale, depression assessment, reliability statistics, internal consistency, inter-rater reliability, test-retest reliability, intraclass correlation coefficient, kappa statistic, Pearson correlation, Spearman correlation, loss of insight
- MeSH terms
- Depression, Humans, Longitudinal Studies, Psychiatric Status Rating Scales, Regression Analysis, Reproducibility of Results, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review