Response shifts in mental health interventions: An illustration of longitudinal measurement invariance.
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
The efficacy of treatments for depression is often measured by comparing observed total scores on self-report inventories, in both clinical practice and research. However, the occurrence of response shifts (changes in subjects' values, or their standards for measurement) may limit the validity of such comparisons. As most psychological treatments for depression are aimed at changing patients' values and frame of reference, response shifts are likely to occur over the course of such treatments. In this article, we tested whether response shifts occurred over the course of treatment in an influential randomized clinical trial. Using confirmatory factor analysis, measurement models underlying item scores on the Beck Depression Inventory (Beck & Beamesderfer, 1974) of the National Institute of Mental Health Treatment of Depression Collaborative Research Program (Elkin, Parloff, Hadley, & Autry, 1985) were analyzed. Compared with before treatment, after-treatment item scores appeared to overestimate depressive symptomatology, measurement errors were smaller, and correlations between constructs were stronger. These findings indicate a response shift, in the sense that participants seem to get better at assessing their level of depressive symptomatology. Comparing measurement models of patients receiving psychotherapy and medication suggested that the aforementioned effects were more apparent in the psychotherapy groups. Consequently, comparisons of observed total scores on self-report inventories may yield confounded measures of treatment efficacy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
Akaike, H. (1987) · Psychometrika · doi:10.1007/bf02294359 · Cited by 5,264
Cognitive Therapy of Depression
HOLLON, S. D., & BECK, A. T. (1979) · Cognitive-Behavioral Interventions · doi:10.1016/b978-0-12-404480-7.50012-5 · Cited by 4,685
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 1×
“For meaningful comparison of observed group means, full scalar invariance is a prerequisite (Meredith, 1993).”
BackgroundByrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Akaike, H. (1987) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_29 · Cited by 4,027
Elkin, I. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110013002 · Cited by 2,300 · cited 4×
“Using confirmatory factor analysis, measurement models underlying item scores on the Beck Depression Inventory (Beck & Beamesderfer, 1974) of the National Institute of Mental Health Treatment of Depression Collaborative Research Program (Elkin, Parloff, Hadley, & Autry, 1985) were analyzed.”
BackgroundMethodInfluentialPower and sensitivity of alternative fit indices in tests of measurement invariance.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.568 · Cited by 1,668
A practical and theoretical guide to measurement invariance in aging research
Horn, J. L., & Mcardle, J. J. (1992) · Experimental Aging Research · doi:10.1080/03610739208253916 · Cited by 1,592
Statistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554
Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P. (2008) · Sociological Methods & Research · doi:10.1177/0049124108314720 · Cited by 1,538
Shafer, A. B. (2006) · Journal of Clinical Psychology · doi:10.1002/jclp.20213 · Cited by 837
Interpersonal Psychotherapy for Depression: A Meta-Analysis
Cuijpers, P., Geraedts, A. S., van Oppen, P., Andersson, G., Markowitz, J. C., & van Straten, A. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10101411 · Cited by 511
Self-citationYin, P., & Fan, X. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970466 · Cited by 197
Cited by
Fried, E. I., van Borkulo, C. D., Epskamp, S., Schoevers, R. A., Tuerlinckx, F., & Borsboom, D. (2016) · Psychological Assessment · doi:10.1037/pas0000275 · Cited by 314
“Third, there is some evidence from longitudinal research that dimensionality may decrease (along with an increase in reliability) across the study period of clinical trials for depression (Fokkema et al., 2013; Galinowski & Lehert, 1995; Quilty et al., 2013; Rocca et al., 2002; Rush et al., 2003).”
InfluentialRevisiting the theoretical and methodological foundations of depression measurement
Fried, E. I., Flake, J. K., & Robinaugh, D. J. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00050-2 · Cited by 274
Pendergast, L. L., von der Embse, N., Kilgus, S. P., & Eklund, K. R. (2017) · Journal of School Psychology · doi:10.1016/j.jsp.2016.11.002 · Cited by 229
Schema therapy for chronic depression: results of a multiple single case series
Renner, F., Arntz, A., Peeters, F. P. M. L., Lobbestael, J., & Huibers, M. J. H. (2016) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2015.12.001 · Cited by 117
Metadata
- Authors
- Fokkema, M., Smits, N., Kelderman, H., & Cuijpers, P.
- Venue
- Psychological Assessment
- Published
- 2013-06
- Volume
- 25
- Issue
- 2
- Pages
- 520-531
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W2132687561
- Cited by
- 105
- References
- 17
- FWCI
- 8.16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.