Psychometric considerations of depression symptom rating scales
Abstract
A major difficulty associated with the diagnosis of major depressive disorder (MDD) is that it cannot be unequivocally tied to observable bodily functions in the sense that a condition like hypertension can be described in terms of elevated blood pressure. Thus, MDD exemplifies what is called a ‘latent variable’, ‘inferred variable’ or ‘construct’. Creation of scales to measure MDD symptomatology in adult populations is a popular line of research. The traditional approaches to constructing and evaluating scales are known as classical test theory, but modern test theory – more specifically, item response theory – offers some advantages. One useful feature is the ability to equate a score of X on scale A with a score of Y on scale B. Both classical test theory and item response theory are examined in this review. Perhaps the main point is that scales for depression, whether based upon self reporting or clinician rating, use fairly similar item content so that they are more similar than different. Thus, the purpose of this paper is to review the general considerations involved in constructing depression scales, which applies to the many other latent variables studied in psychiatry, and to compare important factors regarding the utility of scales for research and clinical practice.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
HRSD17 is a multidimensional construct measuring both anxiety and depression, while QIDS-SR16 is a unidimensional construct measuring depression alone.
“Furthermore, while the HRSD17 is a multidimensional construct measuring both anxiety and depression, the QIDS-SR16 is a unidimensional construct measuring depression alone [38].”
From Antidepressant side effects and their impact on treatment outcome in people with major depressive disorder: an iSPOT-D report (2021) · cites this paper as [38]
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267 · see citing works
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · see citing works
Development and validation of a geriatric depression screening scale: a preliminary report
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., & Leirer, V. O. (1982) · Journal of Psychiatric Research · doi:10.1016/0022-3956(82)90033-4 · Cited by 15,025 · see citing works
Detection of Postnatal Depression: Development of the 10-item Edinburgh Postnatal Depression Scale
Cox, J. L., Holden, J. M., & Sagovsky, R. (1987) · British Journal of Psychiatry · doi:10.1192/bjp.150.6.782 · Cited by 14,183 · see citing works
The application of electronic computers to factor analysis
Kaiser, H. F. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000116 · Cited by 12,459 · see citing works
Health Measurement Scales: A Practical Guide to Their Development and Use
Streiner, D. L., Norman, G. R., & Cairney, J. (1989) · Cited by 9,595 · see citing works
A Second Generation Little Jiffy
Kaiser, H. F. (1970) · Psychometrika · doi:10.1007/bf02291817 · Cited by 4,855 · see citing works
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829 · see citing works
A Rating Formulation for Ordered Response Categories
Andrich, D. (1978) · Psychometrika · doi:10.1007/bf02293814 · Cited by 2,984 · see citing works
Handbook of Modern Item Response Theory
van der Linden, W. J., & Hambleton, R. K. (1997) · Springer eBooks · doi:10.1007/978-1-4757-2691-6 · Cited by 2,331 · see citing works
The Inventory of Depressive Symptomatology (IDS): Psychometric properties
Rush, A. J., Gullion, C. M., Basco, M. R., Jarrett, R. B., & Trivedi, M. H. (1996) · Psychological Medicine · doi:10.1017/s0033291700035558 · Cited by 2,177 · see citing works
(2012) · Springer eBooks · doi:10.1007/springerreference_179754 · Cited by 2,095 · see citing works
The theory and practice of item response theory.
Ayala, D. (2009) · Guilford Press eBooks · Cited by 1,812 · see citing works
Some necessary conditions for common-factor analysis
Guttman, L. (1954) · Psychometrika · doi:10.1007/bf02289162 · Cited by 1,689 · see citing works
Health Measurement Scales: A Practical Guide To Their Development And Use
Streiner, D. L., & Norman, G. R. (2003) · doi:10.1093/oso/9780198528470.001.0001 · Cited by 1,460 · see citing works
Utility of confirmatory factor analysis in test validation research.
Cole, D. A. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.55.4.584 · Cited by 1,089 · see citing works
TRIVEDI, M. H., RUSH, A. J., IBRAHIM, H. M., CARMODY, T. J., BIGGS, M. M., SUPPES, T., CRISMON, M. L., SHORES-WILSON, K., TOPRAC, M. G., DENNEHY, E. B., et al. (2004) · Psychological Medicine · doi:10.1017/s0033291703001107 · Cited by 968 · see citing works
Samejima, F. (1997) · Springer eBooks · doi:10.1007/978-1-4757-2691-6_5 · Cited by 946 · see citing works
The inventory for depressive symptomatology (IDS): Preliminary findings
Rush, A. J., Giles, D. E., Schlesser, M. A., Fulton, C. L., Weissenburger, J. E., & Burns, C. (1986) · Psychiatry Research · doi:10.1016/0165-1781(86)90060-0 · Cited by 908 · see citing works
Reliability of the CES-D scale in different ethnic contexts
ROBERTS, R. E. (1980) · Psychiatry Research · doi:10.1016/0165-1781(80)90069-4 · Cited by 739 · see citing works
Psychometric evaluation of the Beck Depression Inventory-II with primary care medical patients.
Arnau, R. C., Meagher, M. W., Norris, M. P., & Bramson, R. (2001) · Health Psychology · doi:10.1037/0278-6133.20.2.112 · Cited by 694 · see citing works
Knight, R. G., Waal‐Manning, H. J., & Spears, G. F. (1983) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1983.tb00610.x · Cited by 693 · see citing works
Psychometric evaluation of the Beck Depression Inventory-II with primary care medical patients.
Arnau, R. C., Meagher, M. W., Norris, M. P., & Bramson, R. (2001) · Health Psychology · doi:10.1037//0278-6133.20.2.112 · Cited by 692 · see citing works
D'Ath, P., Katona, P., Mullan, E., Evans, S., & Katona, C. (1994) · Family Practice · doi:10.1093/fampra/11.3.260 · Cited by 659 · see citing works
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590 · see citing works
Rush, A. J., Carmody, T., & Reimitz, P. (2000) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.79 · Cited by 427 · see citing works
Bech, P., Allerup, P., Gram, L. F., Reisby, N., Rosenberg, R., Jacobsen, O., & Nagy, Á. (1981) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1981.tb00676.x · Cited by 423 · see citing works
Development and Validation of a Rasch-Derived CES-D Short Form.
Cole, J. C., Rabin, A. S., Smith, T. L., & Kaufman, A. S. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.4.360 · Cited by 401 · see citing works
An Investigation of the Parallel Analysis Criterion for Determining the Number of Common Factors
Humphreys, L. G., & Montanelli, R. G. (1975) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1002_5 · Cited by 391 · see citing works
Rush, A. J., Bernstein, I. H., Trivedi, M. H., Carmody, T. J., Wisniewski, S., Mundt, J. C., Shores-Wilson, K., Biggs, M. M., Woo, A., Nierenberg, A. A., et al. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.08.022 · Cited by 385 · see citing works
Self-citationMontanelli, R. G., & Humphreys, L. G. (1976) · Psychometrika · doi:10.1007/bf02293559 · Cited by 273 · see citing works
The Montgomery Äsberg and the Hamilton ratings of depression: A comparison of measures
Carmody, T. J., Rush, A. J., Bernstein, I. H., Warden, D., Brannan, S. K., Burnham, D. B., Woo, A., & Trivedi, M. H. (2006) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2006.04.008 · Cited by 243 · see citing works
Self-citationGrothe, K. B., Dutton, G. R., Jones, G. N., Bodenlos, J. S., Ancona, M., & Brantley, P. J. (2005) · Psychological Assessment · doi:10.1037/1040-3590.17.1.110 · Cited by 181 · see citing works
What Do Depression Rating Scales Measure?
Snaith, P. R. (1993) · The British Journal of Psychiatry · doi:10.1192/bjp.163.3.293 · Cited by 166 · see citing works
Wright, B. D., & Mok, M. M. C. (2000) · PubMed · Cited by 161 · see citing works
Jongenelis, K., Pot, A. M., Eisses, A. M. H., Gerritsen, D. L., Derksen, M. T., Beekman, A. T. F., Kluiter, H., & Ribbe, M. W. (2005) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1398 · Cited by 156 · see citing works
Reynolds, W. M., & Kobak, K. A. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.4.472 · Cited by 148 · see citing works
Potts, M. K., Daniels, M. L., Burnam, M. A., & Wells, K. B. (1990) · Journal of Psychiatric Research · doi:10.1016/0022-3956(90)90005-b · Cited by 146 · see citing works
A confirmatory factor analysis of the Beck Depression Inventory in chronic pain
Morley, S., Williams, A. C. D. C., & Black, S. (2002) · Pain · doi:10.1016/s0304-3959(02)00137-9 · Cited by 143 · see citing works
Sensitivity of the six‐item Hamilton Depression Rating Scale
O'Sullivan, R. L., D, M. F. M., Agustin, C., Baer, L., & Rosenbaum, J. F. (1997) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1997.tb09649.x · Cited by 142 · see citing works
Psychometric Properties of the Quick Inventory of Depressive Symptomatology in Adolescents
Bernstein, I., Rush, A., Trivedi, M. H., Hughes, C., Macleod, L., Witte, B., Jain, S., Mayes, T., & Emslie, G. (2010) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.321 · Cited by 140 · see citing works
Self-citationNote On a Criterion for the Number of Common Factors
Humphreys, L. G., & Ilgen, D. R. (1969) · Educational and Psychological Measurement · doi:10.1177/001316446902900303 · Cited by 136 · see citing works
Item characteristics of the hamilton rating scale for depression
Rehm, L. P., & O’Hara, M. W. (1985) · Journal of Psychiatric Research · doi:10.1016/0022-3956(85)90066-4 · Cited by 123 · see citing works
Summed-score linking using item response theory: Application to depression measurement.
Orlando, M., Sherbourne, C. D., & Thissen, D. (2000) · Psychological Assessment · doi:10.1037//1040-3590.12.3.354 · Cited by 118 · see citing works
An Empirical Comparison of Methods for Estimating Factor Scores
Horn, J. L. (1965) · Educational and Psychological Measurement · doi:10.1177/001316446502500202 · Cited by 117 · see citing works
Psychometric Evaluation of the Montreal Cognitive Assessment (MoCA) in Three Diverse Samples
Bernstein, I. H., Lacritz, L. H., Barlow, C. E., Weiner, M., & DeFina, L. F. (2010) · The Clinical Neuropsychologist · doi:10.1080/13854046.2010.533196 · Cited by 117 · see citing works
Self-citationMaier, W., Philipp, M., Heuser, I., Schlegel, S., Buller, R., & Wetzel, H. (1988) · Journal of Psychiatric Research · doi:10.1016/0022-3956(88)90022-2 · Cited by 108 · see citing works
Carlson, M., Wilcox, R., Chou, C.-P., Chang, M., Yang, F., Blanchard, J., Marterella, A., Kuo, A., & Clark, F. (2011) · Psychological Assessment · doi:10.1037/a0022484 · Cited by 98 · see citing works
Summed-score linking using item response theory: Application to depression measurement.
Orlando, M., Sherbourne, C. D., & Thissen, D. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.3.354 · Cited by 98 · see citing works
Ruhé, H. G., Dekker, J., Peen, J., Holman, R., & de Jonghe, F. (2005) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2005.03.001 · Cited by 93 · see citing works
Toward a generalizable model of symptoms in major depressive disorder
Gullion, C. M., & Rush, A. J. (1998) · Biological Psychiatry · doi:10.1016/s0006-3223(98)00235-2 · Cited by 91 · see citing works
Screening for major depressive disorder in the community: A comparison of measures.
Zimmerman, M., & Coryell, W. H. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.1.71 · Cited by 82 · see citing works
Is the Cutoff to Define Remission on the Hamilton Rating Scale for Depression Too High?
Zimmerman, M., Posternak, M. A., & Chelminski, I. (2005) · Journal of Nervous & Mental Disease · doi:10.1097/01.nmd.0000154840.63529.5d · Cited by 79 · see citing works
Question Wording Effects in the Assessment of Global Self-Esteem
Dunbar, M., Ford, G., Hunt, K., & Der, G. (2000) · European Journal of Psychological Assessment · doi:10.1027//1015-5759.16.1.13 · Cited by 69 · see citing works
Rating depression in normals and depressives: Observer versus self-rating scales
Fava, G. A., Kellner, R., Lisansky, J., Park, S., Perini, G., & Zielezny, M. A. (1986) · Journal of Affective Disorders · doi:10.1016/0165-0327(86)90056-x · Cited by 61 · see citing works
Zimmerman, M. A., Posternak, M. A., & Chelminski, I. (2005) · Journal of Clinical Psychopharmacology · doi:10.1097/01.jcp.0000155824.59585.46 · Cited by 58 · see citing works
Measure for Measure: New Developments in Measurement and Item Response Theory
Streiner, D. L. (2010) · The Canadian Journal of Psychiatry · doi:10.1177/070674371005500310 · Cited by 45 · see citing works
A Comparison of the QIDS-C16, QIDS-SR16, and the MADRS in an Adult Outpatient Clinical Sample
Bernstein, I. H., Rush, A. J., Stegman, D., Macleod, L., Witte, B. P., & Trivedi, M. H. (2010) · CNS Spectrums · doi:10.1017/s1092852900000389 · Cited by 45 · see citing works
Self-citationDoraiswamy, P. M., Bernstein, I. H., Rush, A. J., Kyutoku, Y., Carmody, T. J., Macleod, L., Venkatraman, S., Burks, M., Stegman, D., Witte, B. P., et al. (2010) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2009.01531.x · Cited by 34 · see citing works
Self-citationUse of the Hamilton rating scale for classification of depressive disorders
Overall, J. E., & Rhoades, H. M. (1982) · Comprehensive Psychiatry · doi:10.1016/0010-440x(82)90087-6 · Cited by 28 · see citing works
Screening for Major Depression in Private Practice
Bernstein, I. H., Wendt, B., Nasr, S. J., & Rush, A. J. (2009) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000348361.03925.b3 · Cited by 23 · see citing works
Self-citationAssessing anxious features in depressed outpatients
McClintock, S. M., Husain, M. M., Bernstein, I. H., Wisniewski, S. R., Trivedi, M. H., Morris, D. W., Alpert, J. E., Warden, D., Luther, J. F., Kornstein, S. G., et al. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.353 · Cited by 20 · see citing works
Self-citationCameron, I. M., Crawford, J. R., Lawton, K., Sharma, S., Dutoit, S., Hay, S., & Reid, I. (2008) · doi:10.1080/17468840802067486 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
McClintock, S. M., Reti, I. M., Carpenter, L. L., McDonald, W. M., Dubin, M., Taylor, S. F., Cook, I. A., O’Reardon, J., Husain, M. M., Wall, C., et al. (2018) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.16cs10905 · Cited by 693 · see citing works
Self-citationBraund, T. A., Tillman, G., Palmer, D. M., Gordon, E., Rush, A. J., & Harris, A. W. F. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01533-1 · Cited by 135 · see citing works
Wade, B., Hellemann, G., Espinoza, R. T., Woods, R. P., Joshi, S. H., Redlich, R., Jørgensen, A., Abbott, C., Oedegaard, K. J., McClintock, S. M., et al. (2019) · Journal of Ect · doi:10.1097/yct.0000000000000623 · Cited by 31 · see citing works
Self-citationClinical Neuropsychological Evaluation in Older Adults with Major Depressive Disorder
McClintock, S. M., Minto, L. R., Denney, D., Bailey, K. C., Cullum, C., & Dotson, V. M. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01267-3 · Cited by 21 · see citing works
Self-citationBraund, T. A., Breukelaar, I. A., Griffiths, K. R., Tillman, G., Palmer, D. M., Bryant, R. A., Phillips, M. L., Harris, A. W. F., & Korgaonkar, M. S. (2021) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.07.010 · Cited by 12 · see citing works
Ruiz, M. A., Beenackers, M. A., Doiron, D., Gurer, A., Sarr, A., Sohel, N., Timmermans, E. J., Wissa, R., Chaix, B., Huisman, M. A., et al. (2020) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2020-214241 · Cited by 10 · see citing works
Is MDD the right target for early-stage psychedelic-assisted therapy trials?
Lewis, B. R., & Byrne, K. (2021) · Journal of Psychedelic Studies · doi:10.1556/2054.2021.00180 · Cited by 1 · see citing works
- Authors
- McClintock, S. M., Haley, C., & Bernstein, I. H.
- Affiliations
- National University of Singapore (SG)
- ORCID
- McClintock, Shawn M
- Venue
- Neuropsychiatry
- Publisher
- OMICS Publishing Group
- Published
- 2011-12
- Volume
- 1
- Issue
- 6
- Pages
- 611-623
- ISSN
- 1758-2008 (ISSN-L)
- OpenAlex
- W2037027351
- Cited by
- 7
- References
- 62
- Citations by year
- 2021: 4 · 2020: 1 · 2019: 1 · 2017: 1
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Neuropsychiatry (publishedVersion)
- National University of Singapore (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- depression rating scales, major depressive disorder, item response theory, classical test theory, scale development, scale validation, latent variables, self-report measures, psychometric properties
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review