The DOI matches its Crossref record; 56 of the 58 references it cites were found in a registry or an index.
Effect sizes for growth-modeling analysis for controlled clinical trials in the same metric as for classical analysis
Open accessAbstract
The use of growth-modeling analysis (GMA)--including hierarchical linear models, latent growth models, and general estimating equations--to evaluate interventions in psychology, psychiatry, and prevention science has grown rapidly over the last decade. However, an effect size associated with the difference between the trajectories of the intervention and control groups that captures the treatment effect is rarely reported. This article first reviews 2 classes of formulas for effect sizes associated with classical repeated-measures designs that use the standard deviation of either change scores or raw scores for the denominator. It then broadens the scope to subsume GMA and demonstrates that the independent groups, within-subjects, pretest-posttest control-group, and GMA designs all estimate the same effect size when the standard deviation of raw scores is uniformly used. Finally, the article shows that the correct effect size for treatment efficacy in GMA--the difference between the estimated means of the 2 groups at end of study (determined from the coefficient for the slope difference and length of study) divided by the baseline standard deviation--is not reported in clinical trials.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Effect sizes for each longitudinal analysis were computed using the formula provided by Feingold (2009) and interpreted using Cohen (1988)’s specifications.”
From Impact of dialectical behavior therapy versus community treatment by experts on emotional experience, expression, and acceptance in borderline personality disorder (2014) · cites this paper as Feingold, 2009
The cited source says what the claim attributes to it.
In the citing paper
“LGCM is accepted as a suitable framework for use in the evaluation of efficacy in psychological interventions [22]”
From Large-scale dissemination of internet-based cognitive behavioral therapy for youth anxiety: Feasibility and acceptability study (2018) · cites this paper as [22]
The cited source says what the claim attributes to it.
In the citing paper
“LGCM is accepted as a suitable framework for use in the evaluation of efficacy in psychological interventions [22] and allows determination of whether the temporal trajectory from the baseline to Session 10 is significant, using data from all participants rather than just the treatment completers [22].”
From Large-scale dissemination of internet-based cognitive behavioral therapy for youth anxiety: Feasibility and acceptability study (2018) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Snedecor, G. W., Cochran, W. G., & STOUT, B. B. (1939) · Soil Science · doi:10.1097/00010694-193902000-00006 · Cited by 19,423
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,773
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
(2002) · Cited by 13,211
Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence
Singer, J. D., & Willett, J. B. (2003) · doi:10.1093/acprof:oso/9780195152968.001.0001 · Cited by 10,647
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Flagged first, then by citations
2 of the 58 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Becker BJ Synthesizing standardized mean-change scores. British Journal of Mathematical and Statistical Psychology 1988 41 257 278
- Gibbons RD Hedeker DR Davis JM Estimation of effect sizes from a series of experiments involving paired comparisons. Journal of Educational Statistics 1993 18 271 279
Cited by
Sorted by citations
Stice, E., Marti, C. N., & Rohde, P. (2013) · Journal of Abnormal Psychology · doi:10.1037/a0030679 · Cited by 822
Bamelis, L. L. M., Evers, S. M. A. A., Spinhoven, P., & Arntz, A. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.12040518 · Cited by 497
Arch, J. J., Eifert, G. H., Davies, C., Vilardaga, J. C. P., Rose, R. D., & Craske, M. G. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028310 · Cited by 443
Twohig, M. P., Hayes, S. C., Plumb, J. C., Pruitt, L. D., Collins, A. B., Hazlett-Stevens, H., & Woidneck, M. R. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0020508 · Cited by 434
“Effect sizes for MMRM outcomes were calculated as specified by Wackerly, Mendenhall, and Scheaffer (2008) and for HLM by examining end-point outcomes as suggested by Feingold (2009).”
MethodNeacsiu, A. D., Eberle, J. W., Kramer, R., Wiesmann, T., & Linehan, M. M. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.05.005 · Cited by 394
Metadata
- Authors
- Feingold, A.
- Affiliations
- Oregon Social Learning Center (US)
- Corresponding author
- Feingold, Alan
- Venue
- Psychological Methods
- Published
- 2009
- Volume
- 14
- Issue
- 1
- Pages
- 43-53
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- PMC
- PMC2712654
- OpenAlex
- W2089811587
- Cited by
- 851
- References
- 58
- Citations by year
- 2026: 56 · 2025: 60 · 2024: 61 · 2023: 54 · 2022: 56 · 2021: 72 · 2020: 61 · 2019: 47 · 2018: 56 · 2017: 51 · 2016: 65 · 2015: 65 · 2014: 63 · 2013: 35 · 2012: 24
- FWCI
- 13.56
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD046364)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- effect size, growth models, latent growth curve models, multilevel analysis, repeated measures designs, change scores, treatment effects, intervention efficacy, pretest-posttest control group design
- MeSH terms
- Humans, Psychology, Social, Research Design, Meta-Analysis as Topic, Reproducibility of Results, Models, Statistical, Linear Models, Treatment Outcome, Controlled Clinical Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review