Measuring depression over time … Or not? Lack of unidimensionality and longitudinal measurement invariance in four common rating scales of depression
Open accessThe DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Abstract
In depression research, symptoms are routinely assessed via rating scales and added to construct sum-scores. These scores are used as a proxy for depression severity in cross-sectional research, and differences in sum-scores over time are taken to reflect changes in an underlying depression construct. To allow for such interpretations, rating scales must (a) measure a single construct, and (b) measure that construct in the same way across time. These requirements are referred to as unidimensionality and measurement invariance. We investigated these 2 requirements in 2 large prospective studies (combined n = 3,509) in which overall depression levels decrease, examining 4 common depression rating scales (1 self-report, 3 clinician-report) with different time intervals between assessments (between 6 weeks and 2 years). A consistent pattern of results emerged. For all instruments, neither unidimensionality nor measurement invariance appeared remotely tenable. At least 3 factors were required to describe each scale, and the factor structure changed over time. Typically, the structure became less multifactorial as depression severity decreased (without however reaching unidimensionality). The decrease in the sum-scores was accompanied by an increase in the variances of the sum-scores, and increases in internal consistency. These findings challenge the common interpretation of sum-scores and their changes as reflecting 1 underlying construct. The violations of common measurement requirements are sufficiently severe to suggest alternative interpretations of depression sum-scores as formative instead of reflective measures. We discuss the possible causes of these violations such as response shift bias, restriction of range, and regression to the mean. (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Specific challenges relevant (but not unique) to typical ACT research contexts range from recruiting sufficient participants to adequately powering the analysis to challenges that emerge as a consequence of psychological intervention (Fried et al., 2016), including participant changes in understanding or attitude toward a construct, and changes in variability in scores on a construct.”
From Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them (2023) · cites this paper as Fried et al., 2016
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · cited 1×
“…factor analysis (CFA) to each instrument at each measurement point to assess the fit of unidimensional models; we used the root mean square error of approximation (RMSEA; ≤ 0.06 indicating a good fit) and the comparative fit index (CFI; ≥ 0.95 indicating a good fit) (Hu & Bentler, 1999).”
InfluentialThe CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267 · cited 1×
“For the Center of The Center for Epidemiologic Studies Depression Scale (CES-D; Radloff, 1977) and the Montgomery-Åsberg depression rating scale (MADRS; Montgomery & Asberg, 1979), 1-4 factors have been extracted (cf. Fried & Nesse, 2015a; Quilty et al., 2013), and the literature is similarly…”
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc-rcessc.v1i1.25 · Cited by 38,891
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 7×
“For the Center of The Center for Epidemiologic Studies Depression Scale (CES-D; Radloff, 1977) and the Montgomery-Åsberg depression rating scale (MADRS; Montgomery & Asberg, 1979), 1-4 factors have been extracted (cf. Fried & Nesse, 2015a; Quilty et al., 2013), and the literature is similarly inconsistent for many oth…”
InfluentialConfirmatory factor analysis for applied research
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,614
Diagnostic and Statistical Manual of Mental Disorders, 5th ed.
Carter, M. J. (2014) · Therapeutic Recreation Journal · Cited by 15,169
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962 · cited 1×
“…the Center of The Center for Epidemiologic Studies Depression Scale (CES-D; Radloff, 1977) and the Montgomery-Åsberg depression rating scale (MADRS; Montgomery & Asberg, 1979), 1-4 factors have been extracted (cf. Fried & Nesse, 2015a; Quilty et al., 2013), and the literature is similarly…”
Cognitive Therapy for Depression: (675542012-001)
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,663
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · cited 1×
“In line with previous papers (Fokkema, Smits, Kelderman, & Cuijpers, 2013; Oort, 2005; Vandenberg & Lance, 2000), we therefore allowed the residuals of each item to be correlated across time.”
Socioeconomic status and child development
Bradley, R. H., & Corwyn, R. F. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135233 · Cited by 5,484 · cited 1×
“SES predicts adverse social and health outcomes in children and adolescents such as growth retardation, disability, injuries, and poverty (Bradley & Corwyn, 2002), and has been identified as the overall strongest and most consistent predictor of both morbidity and mortality in adults (Winkleby,…”
Cognitive Therapy of Depression
HOLLON, S. D., & BECK, A. T. (1979) · Cognitive-Behavioral Interventions · doi:10.1016/b978-0-12-404480-7.50012-5 · Cited by 4,685
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 5×
“…model M3 additionally constrains thresholds to be equal across time, and the strict invariance model M4 forces all residual invariances to be equal on top of all previous constraints. measurement invariance can be established only if M4 is not rejected in this iterative procedure (Meredith, 1993).”
InfluentialNetwork analysis: An integrative approach to the structure of psychopathology
Borsboom, D., & Cramer, A. O. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185608 · Cited by 4,359 · cited 1×
“…-> fatigue -> concentration problems) and residual dependencies among symptoms, but also contrasts with studies demonstrating that symptoms influence each other directly in complex dynamic systems (Borsboom & Cramer, 2013; Bringmann, Lemmens, Huibers, Borsboom, & Tuerlinckx, 2015; Fried, 2015).”
Self-citationO’connor, B. P. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200807 · Cited by 4,116
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618 · cited 2×
“More specifically, reflective latent variable models (Bollen & Lennox, 1991) are used to study mental disorders .”
psych: Procedures for Psychological, Psychometric, and Personality Research
Revelle, W. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.psych · Cited by 2,965
On the use, the misuse, and the very limited usefulness of Cronbach’s alpha
Sijtsma, K. (2009) · Psychometrika · doi:10.1007/s11336-008-9101-0 · Cited by 2,814 · cited 2×
“Although reliability does not bear a direct analytic connection to unidimensionality (Sijtsma, 2009), if these changes occur in the same way as the changes we observed, this suggests that the dimensionality of the data may have decreased in these cases as it did in the ones we studied.”
The Inventory of Depressive Symptomatology (IDS): Psychometric properties
Rush, A. J., Gullion, C. M., Basco, M. R., Jarrett, R. B., & Trivedi, M. H. (1996) · Psychological Medicine · doi:10.1017/s0033291700035558 · Cited by 2,177 · cited 11×
“Second, one study reported the reliability of four different depression scales in two different samples––a mixed sample, including both healthy and depressed participants, and a depressed sample (Rush et al., 1996).”
InfluentialWinkleby, M. A., Jatulis, D. E., Frank, E., & Fortmann, S. P. (1992) · American Journal of Public Health · doi:10.2105/ajph.82.6.816 · Cited by 2,048 · cited 1×
“…health outcomes in children and adolescents such as growth retardation, disability, injuries, and poverty (Bradley & Corwyn, 2002), and has been identified as the overall strongest and most consistent predictor of both morbidity and mortality in adults (Winkleby, Jatulis, Frank, & Fortmann, 1992).”
Regression to the mean: what it is and how to deal with it
Barnett, A. G. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh299 · Cited by 1,988
Marsh, H. W., Morin, A. J. S., Parker, P. D., & Kaur, G. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153700 · Cited by 1,801 · cited 1×
“In ESEM, an EFA is carried out to search for a measurement model that describes the data best, and items are allowed to load on multiple factors (Dolan et al., 2009; Marsh et al., 2014).”
Statistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS, FIFTH EDITION
Abbas, A., & Aminoroaia, M. (2013) · Cited by 1,479
Cuthbert, B. N. (2014) · World Psychiatry · doi:10.1002/wps.20087 · Cited by 1,377 · cited 2×
“…1993; Fried & Nesse, 2015b; Fried, 2015)—or related concepts such as endophenotypes (Hasler & Northoff, 2011; Webb et al., 2015) or dimensions defined by neurobiology and behavioral measures that cut across disorders as proposed by the RDoC framework (Cuthbert, 2014)—promise important insights.”
Ostwald, P. F. (1960) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1960.14.4.817 · Cited by 1,357
The Hamilton Depression Rating Scale: Has the Gold Standard Become a Lead Weight?
Bagby, R. M., Ryder, A. G., Schuller, D. R., & Marshall, M. B. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.12.2163 · Cited by 1,148 · cited 4×
“Extensive reviews reported factor structures ranging from 1 to 7 factors with poor replication across samples, reliability estimates in a range from 0.46 to 0.97, and poor interrater reliability, retest reliability, and content validity (Bagby et al., 2004; Gullion & Rush, 1998).”
InfluentialSequenced treatment alternatives to relieve depression (STAR*D): Rationale and design
Rush, A. J., Fava, M., Wisniewski, S. R., Lavori, P. W., Trivedi, M. H., Sackeim, H. A., Thase, M. E., Nierenberg, A. A., Quitkin, F. M., Kashner, T. M., et al. (2004) · Controlled Clinical Trials · doi:10.1016/s0197-2456(03)00112-0 · Cited by 1,076 · cited 2×
“Further details on the STAR*D study can be found elsewhere (Rush et al., 2004).”
Fried, E. I., & Nesse, R. M. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.10.010 · Cited by 1,043 · cited 7×
“Third, as described in more detail above, depression is a highly heterogeneous disease category (Fried & Nesse, 2015a; Olbert et al., 2014), and the datasets analyzed here encompass a large group of individuals with very different characteristics (in terms of, for instance, age and socioeconomic…”
InfluentialSelf-citationDepression sum-scores don’t add up: why analyzing specific depression symptoms is essential
Fried, E. I., & Nesse, R. M. (2015) · BMC Medicine · doi:10.1186/s12916-015-0325-4 · Cited by 981 · cited 8×
“Third, as described in more detail above, depression is a highly heterogeneous disease category (Fried & Nesse, 2015a; Olbert et al., 2014), and the datasets analyzed here encompass a large group of individuals with very different characteristics (in terms of, for instance, age and socioeconomic…”
InfluentialSelf-citationTRIVEDI, M. H., RUSH, A. J., IBRAHIM, H. M., CARMODY, T. J., BIGGS, M. M., SUPPES, T., CRISMON, M. L., SHORES-WILSON, K., TOPRAC, M. G., DENNEHY, E. B., et al. (2004) · Psychological Medicine · doi:10.1017/s0033291703001107 · Cited by 968 · cited 3×
“…high reliability of MD rating scales have often analyzed the exit time point of clinical trials, i.e. the measurement point for which depression was less severe in the population because a number of remitted (healthy) participants were included (e.g., Rush et al., 2006; Trivedi et al., 2004).”
InfluentialThe Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods
Penninx, B. W. J. H., Beekman, A. T. F., Smit, J. H., Zitman, F. G., Nolen, W. A., Spinhoven, P., Cuijpers, P., De Jong, P. J., Van Marwijk, H. W. J., Assendelft, W. J. J., et al. (2008) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.256 · Cited by 927
Widaman, K. F., Ferrer, E., & Conger, R. D. (2010) · Child Development Perspectives · doi:10.1111/j.1750-8606.2009.00110.x · Cited by 890 · cited 1×
“…important psychometric assumption necessary to interpret changes of sum-scores as changes in depression is that MD is assessed in the same way at multiple occasions, a requirement known as temporal invariance or longitudinal measurement invariance (Meredith, 1993; Widaman, Ferrer, & Conger, 2010).”
Shafer, A. B. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20213 · Cited by 837
Fried, E. I., Epskamp, S., Nesse, R. M., Tuerlinckx, F., & Borsboom, D. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.09.005 · Cited by 751
Self-citationDevelopment and validation of the Inventory of Depression and Anxiety Symptoms (IDAS).
Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A., Gamez, W., & Stuart, S. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.3.253 · Cited by 740 · cited 2×
“standard psychometric approach (Watson et al., 2007); for instance, suicidal ideation is measured with 6 items, and one could construct a more reliable latent variable that accounts for the covariation of the individual suicide items.”
Deconstructing the construct: a network perspective on psychological phenomena
Schmittmann, V. D., Cramer, A. O. J., Waldorp, L. J., Epskamp, S., Kievit, R. A., & Borsboom, D. (2013) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2011.02.007 · Cited by 740 · cited 1×
“A related problematic assumption of reflective models is that correlations among symptoms, such as the relationship between insomnia and fatigue, should vanish once the latent variable is controlled for (i.e., conditional independence) (Schmittmann et al., 2013).”
Self-citationPsychometric perspectives on diagnostic systems
Borsboom, D. (2008) · Journal of Clinical Psychology · doi:10.1002/jclp.20503 · Cited by 691 · cited 2×
“This, in turn, implies that symptoms are unlikely to be measurements of one underlying disorder (Borsboom, 2008; Fried, 2015), which is consistent with research documenting that individual depression symptoms differ in important dimensions such as their risk factors (Fried, Nesse, Zivin, Guille, & Sen, 2014; Lux & Ken…”
Self-citationWhat kinds of things are psychiatric disorders?
Kendler, K. S., Zachar, P., & Craver, C. (2011) · Psychological Medicine · doi:10.1017/s0033291710001844 · Cited by 617 · cited 1×
“Much more crucial is the question how useful such an index score is (Kendler, Zachar, & Craver, 2010; Zachar, 2002).”
(2002) · Cited by 479
Deary, I. J. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100353 · Cited by 467
Fava, M., Evins, A. E., Dorer, D. J., & Schoenfeld, D. A. (2003) · Psychotherapy and Psychosomatics · doi:10.1159/000069738 · Cited by 452 · cited 1×
“RTTM is known to influence the results of antidepressants trials, and, as expected, especially severe in studies with very high severity thresholds (Fava, Evins, Dorer, & Schoenfeld, 2003).”
The Impact of Individual Depressive Symptoms on Impairment of Psychosocial Functioning
Fried, E. I., & Nesse, R. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0090311 · Cited by 424 · cited 3×
“…(e.g., psychomotor agitation is about four times as much impairing as psychomotor retardation; for a review, see Fried & Nesse, 2015b) and are differentially severe in depressed populations (e.g., insomnia is about four times as severe as hypersomnia in STAR*D patients; Fried & Nesse, 2014).”
Self-citationSen, S., Kranzler, H. R., Krystal, J. H., Speller, H., Chan, G., Gelernter, J., & Guille, C. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.41 · Cited by 411 · cited 1×
“Our hope is that future investigations of depression data—especially clinical trials or prospective stress studies (Sen et al., 2010) in which depression sum-scores decrease or increase substantially—will help to eventually identify the culprit.”
How many different ways do patients meet the diagnostic criteria for major depressive disorder?
Zimmerman, M., Ellison, W., Young, D., Chelminski, I., & Dalrymple, K. (2015) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2014.09.007 · Cited by 392 · cited 1×
“Considering the dramatic heterogeneity of the depressive syndrome (Fried & Nesse, 2015a; Olbert, Gala, & Tupler, 2014; Zimmerman, Ellison, Young, Chelminski, & Dalrymple, 2014), multifactorial results in depression instruments cannot come as a surprise.”
Rush, A. J., Bernstein, I. H., Trivedi, M. H., Carmody, T. J., Wisniewski, S., Mundt, J. C., Shores-Wilson, K., Biggs, M. M., Woo, A., Nierenberg, A. A., et al. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.08.022 · Cited by 385 · cited 4×
“, 2004), along with unidimensionality of the 9 symptom domains (Rush et al., 2006).”
InfluentialRevealing the dynamic network structure of the Beck Depression Inventory-II
Bringmann, L. F., Lemmens, L. H. J. M., Huibers, M. J. H., Borsboom, D., & Tuerlinckx, F. (2015) · Psychological Medicine · doi:10.1017/s0033291714001809 · Cited by 371 · cited 1×
“…-> fatigue -> concentration problems) and residual dependencies among symptoms, but also contrasts with studies demonstrating that symptoms influence each other directly in complex dynamic systems (Borsboom & Cramer, 2013; Bringmann, Lemmens, Huibers, Borsboom, & Tuerlinckx, 2015; Fried, 2015).”
Self-citationFried, E. I. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00309 · Cited by 367 · cited 11×
“…-> fatigue -> concentration problems) and residual dependencies among symptoms, but also contrasts with studies demonstrating that symptoms influence each other directly in complex dynamic systems (Borsboom & Cramer, 2013; Bringmann, Lemmens, Huibers, Borsboom, & Tuerlinckx, 2015; Fried, 2015).”
InfluentialSelf-citationLongitudinal Stability of Adult Personality
Costa, P. T., & McCrae, R. R. (1997) · Handbook of Personality Psychology · doi:10.1016/b978-012134645-4/50012-3 · Cited by 316 · cited 1×
“While some constructs, like personality traits and intelligence, appear quite stable within individuals across adulthood (Costa & McCrae, 1997; Deary, 2012), other constructs, such as major depression (MD) can change dramatically: a person may be diagnosed with depression at one time point, but may…”
When Does Measurement Invariance Matter?
Borsboom, D. (2006) · Medical Care · doi:10.1097/01.mlr.0000245143.08679.cc · Cited by 302 · cited 1×
“Borsboom (2006) provides an overview of the way different kinds of test use correspond to different kinds of invariance.”
Self-citationFried, E. I., Nesse, R. M., Zivin, K., Guille, C., & Sen, S. (2014) · Psychological Medicine · doi:10.1017/s0033291713002900 · Cited by 299 · cited 4×
“…(e.g., psychomotor agitation is about four times as much impairing as psychomotor retardation; for a review, see Fried & Nesse, 2015b) and are differentially severe in depressed populations (e.g., insomnia is about four times as severe as hypersomnia in STAR*D patients; Fried & Nesse, 2014).”
InfluentialSelf-citationMeasuring depression: comparison and integration of three scales in the GENDEP study
Uher, R., Farmer, A., Maier, W., Rietschel, M., Hauser, J., Marusic, A., Mors, O., Elkin, A., Williamson, R. J., Schmael, C., et al. (2008) · Psychological Medicine · doi:10.1017/s0033291707001730 · Cited by 293 · cited 4×
“Multifactorial results also emerge when symptoms of several questionnaire are pooled (Uher et al., 2008).”
InfluentialUsing structural equation modeling to detect response shifts and true change
Oort, F. J. (2005) · Quality of Life Research · doi:10.1007/s11136-004-0830-y · Cited by 289 · cited 1×
“While it is much-debated whether the current operationalization of MD as described in the DSM meets orthodox standards for a useful construct (Fried, 2015; Kupfer, First, & Regier, 2002; Kupfer, 2013; Parker, 2005), a more detailed discussion of this topic is beyond the scope of this paper.”
Discovering imaging endophenotypes for major depression
Hasler, G., & Northoff, G. (2011) · Molecular Psychiatry · doi:10.1038/mp.2011.23 · Cited by 274 · cited 2×
“…the emphasis on the study of individual symptoms (Costello, 1993; Fried & Nesse, 2015b; Fried, 2015)—or related concepts such as endophenotypes (Hasler & Northoff, 2011; Webb et al., 2015) or dimensions defined by neurobiology and behavioral measures that cut across disorders as proposed by…”
Side effects of antidepressants during long-term use in a naturalistic setting
Bet, P. M., Hugtenburg, J. G., Penninx, B. W. J. H., & Hoogendijk, W. J. G. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2013.05.001 · Cited by 239 · cited 1×
“All participants in the first treatment stage of STAR*D received citalopram for which adverse side effects are not uncommon (Bet, Hugtenburg, Penninx, & Hoogendijk, 2013), and some individuals in the NESDA sample also took antidepressants (Penninx et al., 2008).”
Wisniewski, S. R., Rush, A. J., Nierenberg, A. A., Gaynes, B. N., Warden, D., Luther, J. F., McGrath, P. J., Lavori, P. W., Thase, M. E., Fava, M., et al. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08071027 · Cited by 223 · cited 1×
“…because most other depression studies examine rather artificial populations, often without any comorbidities, that are not considered to reflect the large majority of depressed patients that seek psychiatric help (Preskorn, Macaluso, & Trivedi, 2015; Wisniewski, Rush, Nierenberg, & Gaynes, 2009).”
Olbert, C. M., Gala, G. J., & Tupler, L. A. (2014) · Journal of Abnormal Psychology · doi:10.1037/a0036068 · Cited by 208
Deconstructing major depression: a validation study of the DSM-IV symptomatic criteria
Lux, V., & Kendler, K. S. (2010) · Psychological Medicine · doi:10.1017/s0033291709992157 · Cited by 204 · cited 1×
“…documenting that individual depression symptoms differ in important dimensions such as their risk factors (Fried, Nesse, Zivin, Guille, & Sen, 2014; Lux & Kendler, 2010), impact on impairment of psychosocial functioning (Fried & Nesse, 2014), antidepressant response (Hieronymus, Emilsson, Nilsson,…”
PARKER, G. (2005) · Psychological Medicine · doi:10.1017/s0033291704004210 · Cited by 201
Hieronymus, F., Emilsson, J. F., Nilsson, S., & Eriksson, E. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.53 · Cited by 201 · cited 1×
“…Zivin, Guille, & Sen, 2014; Lux & Kendler, 2010), impact on impairment of psychosocial functioning (Fried & Nesse, 2014), antidepressant response (Hieronymus, Emilsson, Nilsson, & Eriksson, 2015), and genetic as well as neuroimaging correlates (Kendler, Aggen, & Neale, 2013; Myung et al., 2012;…”
Elhai, J. D., Contractor, A. A., Tamburrino, M., Fine, T. H., Prescott, M. R., Shirley, E. R., Chan, P. K., Slembarski, R., Liberzon, I., Galea, S., et al. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2012.05.018 · Cited by 167 · cited 1×
“…and the Montgomery-Åsberg depression rating scale (MADRS; Montgomery & Asberg, 1979), 1-4 factors have been extracted (cf. Fried & Nesse, 2015a; Quilty et al., 2013), and the literature is similarly inconsistent for many other scales (e.g., Elhai et al., 2012; Shafer, 2006; Wardenaar et al., 2010).”
A longitudinal analysis of anxiety and depressive symptoms.
Wetherell, J. L., Gatz, M., & Pedersen, N. L. (2001) · Psychology and Aging · doi:10.1037//0882-7974.16.2.187 · Cited by 161 · cited 1×
“…from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance (e.g., depressed patients: Uher et al., 2008; Rocca et al., 2002; Galinowski & Lehert, 1995; non-clinical sample of children: Lei et al., 2014; elderly twins: Wetherell, Gatz, & Pedersen, 2001).”
FOCUS ARTICLE: Eight Decades of Measurement in Depression
Santor, D. A., Gregus, M., & Welch, A. (2006) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0403_1 · Cited by 155 · cited 3×
“From a formative point of view, however, it is obvious that the various different symptoms used in different depression scales (Santor et al., 2009; Shafer, 2006) lead to different composite”
Evidence for Multiple Genetic Factors Underlying DSM-IV Criteria for Major Depression
Kendler, K. S., Aggen, S. H., & Neale, M. C. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.751 · Cited by 146
Quilty, L. C., Robinson, J. J., Rolland, J., Fruyt, F. D., Rouillon, F., & Bagby, R. M. (2013) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1388 · Cited by 136 · cited 6×
“In a study by Quilty et al. (2013), the authors examined the efficacy of combined pharmacotherapy and psychotherapy in a sample of 821 depressed outpatients using the MADRS.”
InfluentialWardenaar, K. J., van Veen, T., Giltay, E. J., den Hollander-Gijsman, M. E., Penninx, B. W. J. H., & Zitman, F. G. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.12.020 · Cited by 108 · cited 9×
“This is similar to the decreases in sum-scores by 41% (QIDS-C), 42% (HRSD), 42% (IDS-C), and 30% (IDS-SR) observed in our report.”
InfluentialThe Practical Kinds Model as a Pragmatist Theory of Classification
Zachar, P. (2002) · Philosophy, psychiatry & psychology · doi:10.1353/ppp.2003.0051 · Cited by 108 · cited 1×
“Much more crucial is the question how useful such an index score is (Kendler, Zachar, & Craver, 2010; Zachar, 2002).”
Fokkema, M., Smits, N., Kelderman, H., & Cuijpers, P. (2013) · Psychological Assessment · doi:10.1037/a0031669 · Cited by 105 · cited 5×
“Third, there is some evidence from longitudinal research that dimensionality may decrease (along with an increase in reliability) across the study period of clinical trials for depression (Fokkema et al., 2013; Galinowski & Lehert, 1995; Quilty et al., 2013; Rocca et al., 2002; Rush et al., 2003).”
InfluentialNeural Correlates of Three Promising Endophenotypes of Depression: Evidence from the EMBARC Study
Webb, C. A., Dillon, D. G., Pechtel, P., Goer, F. K., Murray, L., Huys, Q. J., Fava, M., McGrath, P. J., Weissman, M., Parsey, R., et al. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2015.165 · Cited by 103 · cited 3×
“…study of individual symptoms (Costello, 1993; Fried & Nesse, 2015b; Fried, 2015)—or related concepts such as endophenotypes (Hasler & Northoff, 2011; Webb et al., 2015) or dimensions defined by neurobiology and behavioral measures that cut across disorders as proposed by the RDoC framework…”
Toward a generalizable model of symptoms in major depressive disorder
Gullion, C. M., & Rush, A. J. (1998) · Biological Psychiatry · doi:10.1016/s0006-3223(98)00235-2 · Cited by 98 · cited 4×
“Extensive reviews reported factor structures ranging from 1 to 7 factors with poor replication across samples, reliability estimates in a range from 0.46 to 0.97, and poor interrater reliability, retest reliability, and content validity (Bagby et al., 2004; Gullion & Rush, 1998).”
InfluentialThe impact of residual symptoms on outcome of major depression
Kennedy, N., & Foy, K. C. (2005) · Current Psychiatry Reports · doi:10.1007/s11920-005-0065-9 · Cited by 70 · cited 1×
“Furthermore, evidence shows that treatment of depression should strive to achieve full remission, often defined as scoring below a certain cut-off on a rating scales, because patients with remission have a better prognosis than those with remaining symptoms (Kennedy & Foy, 2005).”
Structural validity of MADRS during antidepressant treatment
Galinowski, A., & Lehert, P. (1995) · International Clinical Psychopharmacology · doi:10.1097/00004850-199510030-00004 · Cited by 65 · cited 2×
“…from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance (e.g., depressed patients: Uher et al., 2008; Rocca et al., 2002; Galinowski & Lehert, 1995; non-clinical sample of children: Lei et al., 2014; elderly twins: Wetherell, Gatz, & Pedersen, 2001).”
Ferro, M. A., & Speechley, K. N. (2013) · Archives of Women s Mental Health · doi:10.1007/s00737-013-0331-5 · Cited by 61 · cited 2×
“…a number of prior studies (e.g., non-clinical adolescents samples: Brunet et al., 2014; Motl, 2005; mothers with children suffering from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance (e.g., depressed patients: Uher et al., 2008; Rocca et al.,…”
Number of symptoms, quantification, and qualification of depression
Faravelli, C., Servi, P., Arends, J. A., & Strik, W. K. (1996) · Comprehensive Psychiatry · doi:10.1016/s0010-440x(96)90011-5 · Cited by 60 · cited 1×
“In contrary, the sum of symptoms certainly does provide some information about the general psychopathological burden people carry, and we can safely assume an inverse relation between the number of symptoms and the well-being of a person (e.g., Faravelli, Servi, Arends, & Strik, 1996).”
Testing Measurement Invariance in the Target Rotated Multigroup Exploratory Factor Model
Dolan, C. V., Oort, F. J., Stoel, R. D., & Wicherts, J. M. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510902751416 · Cited by 57 · cited 1×
“In ESEM, an EFA is carried out to search for a measurement model that describes the data best, and items are allowed to load on multiple factors (Dolan et al., 2009; Marsh et al., 2014).”
Factor structure and dimensionality of the two depression scales in STAR*D using level 1 datasets.
Bech, P., Fava, M., Trivedi, M., Wisniewski, S., & Rush, A. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.03.011 · Cited by 54
Motl, R. W., Dishman, R. K., Birnbaum, A. S., & Lytle, L. A. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404266256 · Cited by 54 · cited 4×
“…longitudinal measurement invariance has been established in a number of prior studies (e.g., non-clinical adolescents samples: Brunet et al., 2014; Motl, 2005; mothers with children suffering from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance…”
InfluentialGenetic association study of individual symptoms in depression
Myung, W., Song, J., Lim, S., Won, H., Kim, S., Lee, Y., Kang, H. S., Lee, H., Kim, J., Carroll, B. J., et al. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2011.12.037 · Cited by 53
Zimmerman, M., Martinez, J. H., Friedman, M., Boerescu, D. A., Attiullah, N., & Toba, C. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12m07775 · Cited by 52 · cited 1×
“This also offers an explanation why depression rating scales are often only moderately correlated and lead to idiosyncratic results depending on the particular scale used in a study (Gullion & Rush, 1998; Santor et al., 2009; Zimmerman et al., 2012).”
A comparison of paroxetine and amisulpride in the treatment of dysthymic disorder
Rocca, P., Fonzo, V., Ravizza, L., Rocca, G., Scotta, M., Zanalda, E., & Bogetto, F. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(01)00327-5 · Cited by 49 · cited 2×
“…from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance (e.g., depressed patients: Uher et al., 2008; Rocca et al., 2002; Galinowski & Lehert, 1995; non-clinical sample of children: Lei et al., 2014; elderly twins: Wetherell, Gatz, & Pedersen, 2001).”
Measurement invariance of the depressive symptoms scale during adolescence
Brunet, J., Sabiston, C. M., Chaiton, M., Low, N. C., Contreras, G. A., Barnett, T. A., & O’Loughlin, J. L. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-95 · Cited by 44 · cited 2×
“While longitudinal measurement invariance has been established in a number of prior studies (e.g., non-clinical adolescents samples: Brunet et al., 2014; Motl, 2005; mothers with children suffering from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance…”
Toward a limited realism for psychiatric nosology based on the coherence theory of truth
Kendler, K. S. (2014) · Psychological Medicine · doi:10.1017/s0033291714002177 · Cited by 21 · cited 1×
“In the formative world, the main question is not how ‘real’ a construct is (Kendler, 2015)—SES, for instance, may not have biomarkers, but is an important predictor for well-being nonetheless.”
Preskorn, S., Macaluso, M., & Trivedi, M. (2015) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000082 · Cited by 21
The advantages of the symptom approach to depression.
Costello, C. G. (1993) · Cited by 13
Longitudinal invariance of the Children’s Depression Inventory for urban children in Hunan, China.
Lei, H., Yao, S., Zhang, X., Cai, L., Wu, W.-F., Yang, Y.-J., Tan, F., & Zhu, X.-Z. (2016) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000195 · Cited by 8 · cited 1×
“…from epilepsy: Ferro & Speechley, 2013), other reports detected violations of measurement invariance (e.g., depressed patients: Uher et al., 2008; Rocca et al., 2002; Galinowski & Lehert, 1995; non-clinical sample of children: Lei et al., 2014; elderly twins: Wetherell, Gatz, & Pedersen, 2001).”
Cited by
Moving Forward: Challenges and Directions for Psychopathological Network Theory and Methodology
Fried, E. I., & Cramer, A. O. J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617705892 · Cited by 938
Self-citationNetwork analysis of depression and anxiety symptom relationships in a psychiatric sample
Beard, C., Millner, A. J., Forgeard, M. J. C., Fried, E. I., Hsu, K. J., Treadway, M. T., Leonard, C. V., Kertz, S. J., & Björgvinsson, T. (2016) · Psychological Medicine · doi:10.1017/s0033291716002300 · Cited by 929
Self-citationThe 52 symptoms of major depression: lack of content overlap among seven common depression scales
Fried, E. I. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.019 · Cited by 649
Self-citationUsing Network Analysis to Identify Central Symptoms of Adolescent Depression
Mullarkey, M. C., Marchetti, I., & Beevers, C. G. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1437735 · Cited by 484
How predictable are symptoms in psychopathological networks? A reanalysis of 18 published datasets
Haslbeck, J. M. B., & Fried, E. I. (2017) · Psychological Medicine · doi:10.1017/s0033291717001258 · Cited by 429
“The low predictability of poor appetite is consistent with psychometric studies of depression scales, showing that weight and appetite items often form a distinct cluster of nodes (or factor) and show only weak partial correlations with other depression symptoms (e.g. Fried et al. 2016 a , c ).”
Self-citation
Metadata
- Authors
- Fried, E. I., van Borkulo, C. D., Epskamp, S., Schoevers, R. A., Tuerlinckx, F., & Borsboom, D.
- Affiliations
- KU Leuven (BE)
- University of Amsterdam (NL)
- University Medical Center Groningen (NL)
- Corresponding author
- Fried, Eiko I.
- Venue
- Psychological Assessment
- Published
- 2016-11
- Volume
- 28
- Issue
- 11
- Pages
- 1354-1367
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W2473306823
- Cited by
- 314
- References
- 87
- Citations by year
- 2026: 12 · 2025: 22 · 2024: 27 · 2023: 28 · 2022: 27 · 2021: 56 · 2020: 48 · 2019: 33 · 2018: 22 · 2017: 28 · 2016: 10
- FWCI
- 33.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Psychological Assessment (publishedVersion, other-oa)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion, other-oa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion)
- Lirias (KU Leuven) (submittedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- National Institute of Mental Health (N01MH90003)
- Netherlands Organization for Health Research and Development (10-000-1002)
- Research Foundation Flanders (G.0806.13)
- Interuniversity Attraction Poles program (IAP/P7/06)
- University of Leuven (GOA/15/003)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- depression, depression rating scales, unidimensionality, measurement invariance, longitudinal assessment, factor structure, depression severity, sum scores, response-shift bias, restriction of range, regression to the mean, clinician-rated scales, self-report scale
- MeSH terms
- Adolescent, Adult, Aged, Depression, Major Depressive Disorder, Factor Analysis, Statistical, Female, Humans, Longitudinal Studies, Male, Middle Aged, Psychiatric Status Rating Scales, Reproducibility of Results, Models, Statistical, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.