Cited by 450Statistical Methods and Bayesian InferenceMeta-analysis and systematic reviewsPsychometric Methodologies and Testing

Interpreting effect sizes when controlling for stability effects in longitudinal autoregressive models: Implications for psychological science

Adachi, Paul, Willoughby, Teena·2015·European Journal of Developmental Psychology

Abstract

Effect sizes in longitudinal studies often are dramatically smaller than effect sizes in cross-sectional studies. Indeed, autoregressive models (which are often used in longitudinal studies but not in cross-sectional studies) control for past levels on the outcome (i.e., stability effects) in order to predict change in levels of the outcome over time and thus may greatly reduce the magnitude of the effect of a predictor on the outcome. Unfortunately, however, there have been no attempts to differentiate guidelines for interpreting effect sizes for longitudinal studies versus cross-sectional studies. Consequently, longitudinal effect sizes that fall below the universal guidelines for “small” may be incorrectly dismissed as trivial, when they might be meaningful. In the current paper, we first review the present guidelines for interpreting effect sizes. Next, we discuss several examples of how controlling for stability effects can dramatically attenuate effect sizes of other predictors, in order to support our argument that the current guidelines may be misleading for interpreting longitudinal effects. Finally, we conclude by making recommendations for researchers regarding the interpretation of effect sizes in longitudinal autoregressive models.

Integrity signals

Registry

Crossref · 10.1080/17405629.2014.963549

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

1 of the 28 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Adachi, P., & Willoughby, T.
Affiliations
Brock University (CA)
Corresponding author
Adachi, Paul
Venue
European Journal of Developmental Psychology
Published
2014-09-26
Volume
12
Issue
1
Pages
116-128
ISSN
  • 1740-5610 (ISSN-L)
  • 1740-5629
OpenAlex
W2041605892
Cited by
448
References
28
Citations by year
2026: 41 · 2025: 41 · 2024: 42 · 2023: 47 · 2022: 63 · 2021: 65 · 2020: 36 · 2019: 36 · 2018: 25 · 2017: 25 · 2016: 12 · 2015: 14 · 2014: 1
FWCI
18.32
Type
journal article
Language
en
Open access
closed
Locations
European Journal of Developmental Psychology (publishedVersion)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords
effect size interpretation, measurement stability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review