CoChat

Using a repeated measures ANOVA to analyze the data from a pretest–posttest design: a potentially confusing task

Huck, Schuyler W., McLean, Robert A. · 1975 · Psychological Bulletin

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Abstract

The pretest-posttest control group design (or an extension of it) is a highly prestigious experimental design. A popular analytic strategy involves subjecting the data provided, by this design to a repeated measures analysis of variance (ANOVA). Unfortunately, the statistical results yielded by this type of analysis can easily be misinterpreted, since the score model underlying the analysis is not correct. Examples from recently published articles are used to demonstrate that this statistical procedure has led to (a) incorrect statements regarding treatment effects, (b) completely redundant reanalyses of the same data, and (c) problems with respect to post hoc investigations; Two alternative strategies—gain scores and covariance—are discussed and compared.

Overview

Integrity signals

Registry

Crossref · 10.1037/h0076767

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 465

Metadata

Authors
Huck, S. W., & McLean, R. A.
Affiliations
University of Tennessee at Knoxville (US)
Venue
Psychological Bulletin
Published
1975-07
Volume
82
Issue
4
Pages
511-518
ISSN
  • 0033-2909 (ISSN-L)
  • 1939-1455
OpenAlex
W2072435510
Cited by
449
References
19
Citations by year
2026: 4 · 2025: 12 · 2024: 6 · 2023: 8 · 2022: 13 · 2021: 14 · 2020: 18 · 2019: 17 · 2018: 15 · 2017: 11 · 2016: 21 · 2015: 20 · 2014: 15 · 2013: 20 · 2012: 11
FWCI
15.23
Type
journal article
Language
en
Open access
closed
Locations
Psychological Bulletin (publishedVersion)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
Keywords
pretest-posttest control group design, repeated measures ANOVA, SCORE risk model, treatment effect estimation, misinterpretation of statistical results, reanalysis of data, post hoc comparisons, gain score, covariance analysis, experimental design

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.