A Simulation Study on the Performance of the Simple Difference and Covariance-Adjusted Scores in Randomized Experimental Designs: Power Differences in RCT
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Research by Huck and McLean (1975) demonstrated that the covariance-adjusted score is more powerful than the simple difference score, yet recent reviews indicate researchers are equally likely to use either score type in two-wave randomized experimental designs. A Monte Carlo simulation was conducted to examine the conditions under which the simple difference and covariance-adjusted scores were more or less powerful to detect treatment effects when relaxing certain assumptions made by Huck and McLean (1975). Four factors were manipulated in the design including sample size, normality of the pretest and posttest distributions, the correlation between pretest and posttest, and posttest variance. A 5 × 5 × 4 × 3 mostly crossed design was run with 1,000 replications per condition, resulting in 226,000 unique samples. The gain score was nearly as powerful as the covariance-adjusted score when pretest and posttest variances were equal, and as powerful in fan-spread growth conditions; thus, under certain circumstances the gain score could be used in two-wave randomized experimental designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A paradox in the interpretation of group comparisons.
Lord, F. M. (1967) · Psychological Bulletin · doi:10.1037/h0025105 · Cited by 627
Huck, S. W., & McLean, R. A. (1975) · Psychological Bulletin · doi:10.1037/h0076767 · Cited by 449 · cited 4×
“Research by Huck and McLean (1975) demonstrated that the covariance-adjusted score is more powerful than the simple difference score, yet recent reviews indicate researchers are equally likely to use either score type in two-wave randomized experimental designs.”
BackgroundMethodResultInfluential
Cited by
Different ways to estimate treatment effects in randomised controlled trials
J, T., L, B., T, H., J, R., M, W., & M, H. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.03.008 · Cited by 532
Montoya, A. K. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1088-6 · Cited by 291
Tamm, L., Denton, C. A., Epstein, J. N., Schatschneider, C., Taylor, H., Arnold, L. E., Bukstein, O., Anixt, J., Koshy, A., Newman, N. C., et al. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000170 · Cited by 60
Self-citationFulford, D., Gard, D. E., Mueser, K. T., Mote, J., Gill, K., Leung, L., & Mow, J. (2021) · JMIR Mental Health · doi:10.2196/27475 · Cited by 33
Boutzoukas, E. M., O’Shea, A., Kraft, J. N., Hardcastle, C., Evangelista, N. D., Hausman, H. K., Albizu, A., Van Etten, E. J., Bharadwaj, P. K., Smith, S. G., et al. (2022) · GeroScience · doi:10.1007/s11357-022-00538-y · Cited by 15
Metadata
- Authors
- Petscher, Y., & Schatschneider, C.
- Venue
- Journal of Educational Measurement
- Publisher
- Wiley
- Published
- 2011-03
- Volume
- 48
- Issue
- 1
- Pages
- 31-43
- ISSN
- 0022-0655 (ISSN-L)
- OpenAlex
- W1645064579
- Cited by
- 36
- References
- 2
- FWCI
- 1.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Simulation Study on the Performance of the Simple Difference and Covariance-Adjusted Scores in Randomized Experimental Designs: Power Differences in RCT. https://app.cochat.ai/papers/10.1111/j.1745-3984.2010.00129.x
- The paper
- Petscher, Y., & Schatschneider, C. (2011). A Simulation Study on the Performance of the Simple Difference and Covariance-Adjusted Scores in Randomized Experimental Designs: Power Differences in RCT. Journal of Educational Measurement. https://doi.org/10.1111/j.1745-3984.2010.00129.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.