Using a repeated measures ANOVA to analyze the data from a pretest–posttest design: a potentially confusing task
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
The pretest-posttest control group design (or an extension of it) is a highly prestigious experimental design. A popular analytic strategy involves subjecting the data provided, by this design to a repeated measures analysis of variance (ANOVA). Unfortunately, the statistical results yielded by this type of analysis can easily be misinterpreted, since the score model underlying the analysis is not correct. Examples from recently published articles are used to demonstrate that this statistical procedure has led to (a) incorrect statements regarding treatment effects, (b) completely redundant reanalyses of the same data, and (c) problems with respect to post hoc investigations; Two alternative strategies—gain scores and covariance—are discussed and compared.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sessions will be videotaped and transcribed, and content analysis will be used to identify and code the major themes in the data [108].”
From LIBER8 design and methods: An integrative intervention for loss of control eating among African American and White adolescent girls (2013) · cites this paper as [108]
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Experimental Design in Psychological Research
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0011 · Cited by 2,465
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
Marascuilo, L. A., & Levin, J. R. (1970) · American Educational Research Journal · doi:10.3102/00028312007003397 · Cited by 177
Analysis of Covariance: A Delicate Instrument
ELASHOFF, J. D. (1969) · American Educational Research Journal · doi:10.2307/1161858 · Cited by 176
Leventhal, G. S., Michaels, J. W., & Sanford, C. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0032877 · Cited by 159
A Comparison of the Precision of Three Experimental Designs Employing a Concomitant Variable
Feldt, L. S. (1958) · Psychometrika · doi:10.1007/bf02289783 · Cited by 111 · cited 1×
“1 For a more detailed comparison of covariance versus gain scores regarding the issue of power, see Feldt (1958) and Gourlay (1953).”
BackgroundType IV errors and interactions.
Levin, J. R., & Marascuilo, L. A. (1972) · Psychological Bulletin · doi:10.1037/h0033455 · Cited by 60
ATIQULLAH, M. (1962) · Biometrika · doi:10.1093/biomet/49.1-2.83 · Cited by 59
Cited by
Items 201–300 of 465
Videogame interventions and spatial ability interactions
Redick, T. S., & Webster, S. B. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00183 · Cited by 22
“…in such intervention studies, with various authors pointing out limitations with independent-samples t -tests of gain scores, group by session interactions in ANOVA, and using pre-test scores as covariates in an ANCOVA (Lord, 1967; Huck and McLean, 1975; Miller and Chapman, 2001; Wright, 2006).”
MethodEffects of nicotine deprivation on current pain intensity among daily cigarette smokers.
LaRowe, L. R., Kosiba, J. D., Zale, E. L., & Ditre, J. W. (2018) · Experimental and Clinical Psychopharmacology · doi:10.1037/pha0000218 · Cited by 24
“…using ANCOVA (with pretest score included as a covariate) for testing prepost outcomes (e.g., Dimitrov & Rumrill, 2003), in part because ANCOVA has been shown to yield similar information in a more parsimonious manner than repeated measures ANOVA and gain score analyses (Huck & McLean, 1975).”
Facilitating the process of learning social skills through humanistic physical education
Salamuddin, N., & Harun, M. T. (2010) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2010.12.140 · Cited by 21
Organization Development in Schools: Goal Agreement, Process Skills, and Diffusion of Change
Keys, C. B., & Bartunek, J. M. (1979) · The Journal of Applied Behavioral Science · doi:10.1177/002188637901500106 · Cited by 21
Models for Pretest-Posttest Data: Repeated Measures ANOVA Revisited
Jennings, E. (1988) · Journal of Educational Statistics · doi:10.3102/10769986013003273 · Cited by 21
Goldberg, M. H., van der Linden, S., Ballew, M. T., Rosenthal, S. A., & Leiserowitz, A. (2019) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2h7as · Cited by 25
Bollimbala, A., James, P. S., & Ganguli, S. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101313 · Cited by 21
Marzetta, K. L., Mason, H., & Wee, B. (2018) · Education Sciences · doi:10.3390/educsci8010013 · Cited by 21
In vivo assessment of use-dependent brain plasticity—Beyond the “one trick pony” imaging strategy
Draganski, B., & Kherif, F. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.058 · Cited by 20
“However, there are multiple ways to analyse data, which sometimes can lead to contradictory results (Huck and McLean, 1975).”
Growth effects of experiential movement psychotherapy.
Dosamantes-Alperson, E., & Merrill, N. (1980) · Psychotherapy · doi:10.1037/h0086066 · Cited by 20
Tiegerman, S., & Kassinove, H. (1977) · Psychological Reports · doi:10.2466/pr0.1977.40.2.535 · Cited by 20
Incorrect statistical method in parallel-groups RCT led to unsubstantiated conclusions
Allison, D. B., Antoine, L. H., & George, B. J. (2016) · Lipids in Health and Disease · doi:10.1186/s12944-016-0242-3 · Cited by 21
Morier, D., & Seroy, C. (1994) · Sex Roles · doi:10.1007/bf01544203 · Cited by 17
An Improved Model for Evaluating Change in Randomized Pretest, Posttest, Follow-Up Designs
Mara, C. A., Cribbie, R. A., Flora, D. B., Labrish, C., Mills, L., & Fıksenbaum, L. (2011) · Methodology · doi:10.1027/1614-2241/a000041 · Cited by 20
“When participants are randomly assigned to groups, comparing the groups on the outcome after covarying for the pretest will provide a more powerful test than will an ANOVA on change scores (Huck & McLean, 1975).”
BackgroundWebb, A. F., Vandiver, B. J., & Jeung, S. (2015) · Gifted Child Quarterly · doi:10.1177/0016986215605359 · Cited by 25
“Various approaches exist in analyzing data collected over time, with the focus primarily on the use of repeated measures, analysis of covariance (ANCOVA), or gain score analyses (Dimitrov & Rumrill, 2003; Huck & McLean, 1975; Thomas & Zumbo, 2012).”
Wecht, J. M., Weir, J. P., Katzelnick, C. G., Chiaravalloti, N. D., Kirshblum, S., Dyson‐Hudson, T. A., Weber, E., & Bauman, W. A. (2020) · Spinal Cord · doi:10.1038/s41393-020-0448-0 · Cited by 19
“Because in these 2×2 models, the interaction effect is equivalent to a paired t-test on the change scores (29), we also calculated effect sizes (Cohen’s dz) (30), 95% confidence intervals, Bayes factors and Bayesian credible intervals from the t-test calculations (31).”
Rogers, T. R., Forehand, R., Griest, D. L., Wells, K. C., & McMahon, R. J. (1981) · Journal of Clinical Child Psychology · doi:10.1080/15374418109533024 · Cited by 19
The Industrial Age of Hacking.
Nosco, T., Ziegler, J., Clark, Z., Marrero, D., Finkler, T., Barbarello, A., & Petullo, W. M. (2020) · USENIX Security Symposium · Cited by 18
Student attitudes in an innovative active learning approach in calculus
Castillo, A., Durán, P., Fuller, E. J., Watson, C., Potvin, G., & Kramer, L. (2022) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2021.2023771 · Cited by 23
“Alternative approaches to compare post-test scores such as gain scores and post-test-only analyses were less appropriate, considering that this study was randomized (Huck & McLean, 1975).”
MethodChen, C., & Ringenbach, S. D. R. (2019) · Journal of Intellectual Disability Research · doi:10.1111/jir.12603 · Cited by 19
Stern, M., Ewing, L., Davila, E., Thompson, A. L., Hale, G. A., & Mazzeo, S. E. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.12.018 · Cited by 19
“Using a MLM to implement the RM-ANOVA allows us to use all available data even if a study subject has missing observations [96].”
MethodRisk Versus Effort in the Assessment of Motor Fatigue
Barth, J. L., Holding, D. H., & STAMFORD, B. A. (1976) · Journal of Motor Behavior · doi:10.1080/00222895.1976.10735071 · Cited by 18
Schooling and intelligence: A Methodological and logitudinal study
Lund, T., & Thrane, V. C. (1983) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.1983.tb00489.x · Cited by 21
An Evaluation of Alternative Modes of Child Psychotherapy
Hartmann, D. P., Roper, B. L., & Gelfand, D. M. (1977) · Springer eBooks · doi:10.1007/978-1-4613-9799-1_1 · Cited by 18
Applications of Electrodermal Recording
Boucsein, W. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1126-0_3 · Cited by 18
Mental contrasting with implementation intentions increases study time for university students
Clark, M., Miller, A., Berry, J., & Cheng, K. (2020) · British Journal of Educational Psychology · doi:10.1111/bjep.12396 · Cited by 21
Zhang, D., Wang, Q., Ding, Y., & Liu, J. J. (2013) · Journal of Learning Disabilities · doi:10.1177/0022219413507602 · Cited by 18
“The independent variable (i.e., group with or without GD) is something that already exists in the population, and participants cannot be randomly assigned (Huck & McLean, 1975).”
BackgroundSoares, R. N., Colosio, A. L., Murias, J. M., & Pogliaghi, S. (2019) · Applied Physiology, Nutrition, and Metabolism · doi:10.1139/apnm-2018-0866 · Cited by 18
Detecting Instruction Effects—Deciding Between Covariance Analytical and Change-Score Approach
Köhler, C., Hartig, J., & Naumann, A. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09590-6 · Cited by 18
“The ANCOVA approach would give us the same answer as the CHANGE approach if β2 = 1 (see also Huck and McLean 1975; Wright 2006), which is hardly ever the case (Allison 1990) since it would indicate that the pretest perfectly predicts the posttest (i.e., the teachers are equally effective for all…”
MethodCommunity Placement for Persons with Significant Cognitive Challenges: An Outcome Analysis
Spreat, S., & Conroy, J. W. (2001) · Research and Practice for Persons with Severe Disabilities · doi:10.2511/rpsd.26.2.106 · Cited by 17
The effectiveness of applied relaxation in the treatment of speech anxiety
Osberg, J. W. (1981) · Behavior Therapy · doi:10.1016/s0005-7894(81)80144-x · Cited by 17
Seibold, D. R., Kudsi, S., & Rude, M. (1993) · Journal of Applied Communication Research · doi:10.1080/00909889309365361 · Cited by 17
Saidmamatov, O., Raximov, Q., Rodrigues, P. C. D. S., & Vasconcelos, O. (2021) · Children · doi:10.3390/children8121147 · Cited by 16
Psychological Effects of Group Hypnotherapy on Breast Cancer Patients During Chemotherapy
Téllez, A., Rodríguez-Padilla, C., Martínez-Rodríguez, J. L., García, D. M. J., Cappello, O. S.-A., Sánchez, T. J., Segura, G., & Jaime-Bernal, L. (2017) · American Journal of Clinical Hypnosis · doi:10.1080/00029157.2016.1210497 · Cited by 17
“As recommended by Huck and McLean (1975), a one-way analysis of variance of gained scores for each group was used to adjust for possible differences in the pre-test evaluation.”
MethodTransient sweat response of the human head during cycling
BRUYNE, G. D., Aerts, J., Sloten, J. V., Goffin, J., Verpoest, I., & Berckmans, D. (2010) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2010.02.005 · Cited by 16
Applicant Desirability Influences Reactions to Discovered Résumé Embellishments
Kuhn, K. M., Johnson, T. R., & Miller, D. (2013) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12021 · Cited by 15
The Effect of Hand Grip Strength and Trunk Rotation Strength on Throwing Ball Velocity
Razak, R. A., Kee, K. M., Hussain, R. N. J. R., Kassim, N. A. M., & Othman, N. (2018) · Malaysian Journal of Movement Health & Exercise · doi:10.4103/2600-9404.323057 · Cited by 15
Evaluation of a Church-Based Sexuality Education Program for Adolescents
Powell, L. H., & Jorgensen, S. R. (1985) · Family Relations · doi:10.2307/584007 · Cited by 15
“While a repeated measures design might accomplish the same objective, Huck and McLean (1975) have cautioned against use of repeated measures in a pretestposttest control group design.”
MethodExpressive language recovery in aphasia using the Shewan Spontaneous Language Analysis (SSLA) system
Shewan, C. M. (1988) · Journal of Communication Disorders · doi:10.1016/0021-9924(88)90003-2 · Cited by 15
Effect of Mailbag Design on Musculoskeletal Fatigue and Metabolic Load
Bloswick, D. S., Gerber, A., Sebesta, D., Johnson, S., & Mecham, W. (1994) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600203 · Cited by 15
Stippekohl, B., Walter, B., Winkler, M. H., Mucha, R. F., Pauli, P., Vaitl, D., & Stark, R. M. (2012) · Psychopharmacology · doi:10.1007/s00213-012-2670-8 · Cited by 18
“Following the recommendations of Penny and Henson (2007) and Huck and McLean (1975), interaction tests were carried out using t tests on the within-subject difference contrasts described above.”
MethodTeachers' Questions and Responses during Teacher-Student Feedback Dialogues
Dekker-Groen, A., van der Schaaf, M. F., & Stokking, K. M. (2014) · Scandinavian Journal of Educational Research · doi:10.1080/00313831.2014.937359 · Cited by 16
“To analyse the effects of the training, Ancova was used to control for differences in pre-test percentages of teacher utterances between the training group and the control group (Huck & McLean, 1975).”
MethodDoes Exercise Improve Cognitive Performance? A Conservative Message from Lord's Paradox
Liu, S., Lebeau, J.-C., & Tenenbaum, G. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01092 · Cited by 15
Do Union Mergers Affect the Members? Short- and Long-term Effects on Attitudes and Behaviour
Sverke, M., Chaison, G. N., & Sjöberg, A. (2004) · Economic and Industrial Democracy · doi:10.1177/0143831x04040103 · Cited by 14
“Because a significant group effect (i.e. the union factor) in a pretest–posttest design only indicates that there are overall differences between groups (Huck and McLean, 1975: 512), we interpret a significant interaction effect (i.e. the union time interaction) as an indication of a merger effect.”
BackgroundFisher, W. A., Branscombe, N. R., & Lemery, C. R. (1983) · The Journal of Sex Research · doi:10.1080/00224498309551199 · Cited by 14
Leone, C. T., Minor, S. W., & Baltimore, M. L. (1983) · Cognitive Therapy and Research · doi:10.1007/bf01187172 · Cited by 14
Steel, R. P., Jennings, K. R., & Lindsey, J. T. (1990) · The Journal of Applied Behavioral Science · doi:10.1177/0021886390263010 · Cited by 14
Mecklenburg, L., Lenz, S., & Hempel, G. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282404 · Cited by 13
Effectiveness of Learning Management System for Teaching English Language at Higher Education Level
Salahuddin, A., Ajmal, F., & Saira, S. (2020) · Sir Syed Journal of Education & Social Research (SJESR) · doi:10.36902/sjesr-vol3-iss4-2020(1-9 · Cited by 17
Becker, G. A., & Villanova, P. D. (1995) · The Journal of Psychology · doi:10.1080/00223980.1995.9914955 · Cited by 16
Guo, L., Genaidy, A. M., Warm, J. S., Karwowski, W., & HIDALGO, J. (1992) · Ergonomics · doi:10.1080/00140139208967385 · Cited by 13
Strale, F. (2024) · Cureus · doi:10.7759/cureus.75322 · Cited by 12
Lindsay, W. R., Richardson, I., & Michie, A. M. (1989) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/j.1468-3148.1989.tb00027.x · Cited by 12
Kaluza, G., & Schulze, H.-H. (2000) · Zeitschrift für Gesundheitspsychologie · doi:10.1026//0943-8149.8.1.18 · Cited by 19
Experiences that motivate moral development: The role of cognitive dissonance
Rholes, W. S., Bailey, S., & McMillan, L. (1982) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(82)90071-3 · Cited by 12
Does Taking Developmental Psychology Affect Students' Reactions to Aging?
Moeller, T. G. (1982) · Teaching of Psychology · doi:10.1207/s15328023top0902_8 · Cited by 12
Nonsexist curricula, sex of teacher, and children's sex-role learning
Koblinsky, S. A., & Sugawara, A. I. (1984) · Sex Roles · doi:10.1007/bf00287553 · Cited by 12
Modeling psychiatric patients' treatment decision making.
Rosenfeld, B. D., & Turkheimer, E. N. (1995) · Law and Human Behavior · doi:10.1007/bf01499139 · Cited by 12
“The relationship between changes in cognitive and symptom characteristics and changes in decision making was assessed using a hierarchical multiple regression model incorporating change scores (score at admission minus score at discharge, equivalent to a repeated measures ANOVA for pretestlposttest designs, Huck & McL…”
MethodCross-Education of Muscular Endurance: A Scoping Review
Song, J. S., Yamada, Y., Kataoka, R., Hammert, W. B., Kang, A., & Loenneke, J. P. (2024) · Sports Medicine · doi:10.1007/s40279-024-02042-z · Cited by 11
Hrysomallis, C., McLaughlin, P. A., & Goodman, C. A. (2005) · Journal of science and medicine in sport · doi:10.1016/s1440-2440(05)80028-3 · Cited by 11
Multiplicative treatment effects in randomized pretest-posttest experimental designs.
Liu, Q., & Maxwell, S. E. (2019) · Psychological Methods · doi:10.1037/met0000222 · Cited by 11
Effects of a Remedial Program on Visual-Motor Perception in Spina Bifida Children
Gluckman, S., & Barling, J. I. (1980) · The Journal of Genetic Psychology · doi:10.1080/00221325.1980.10534113 · Cited by 11
Post hoc analysis of repeated measures interactions and gain scores: Whither the inconsistency?
Levin, J. R., & Marascuilo, L. A. (1977) · Psychological Bulletin · doi:10.1037/0033-2909.84.2.247 · Cited by 11
Design and Analysis of Experimental and Quasi‐Experimental Investigations
Greenhoot, A. F. (2003) · Handbook of Research Methods in Clinical Psychology · doi:10.1002/9780470756980.ch6 · Cited by 10
Effect of a Chess Training Program on the Development of the Executive Functions in Primary School
Baig, M., Rostán, C., & Saurina, C. (2025) · Psicología Educativa · doi:10.5093/psed2025a10 · Cited by 11
Lartson, C. A. (2013) · ProQuest LLC eBooks · Cited by 12
Promoting recovery from suicidal ideation through the development of protective factors
Surgenor, P. W. G. (2015) · Counselling and Psychotherapy Research · doi:10.1002/capr.12035 · Cited by 10
Lazy max-sum for allocation of tasks with growing costs
Parker, J., Farinelli, A., & Gini, M. L. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.08.015 · Cited by 10
Personality tailored covert sensitization of heroin abuse
Snowden, L. R. (1978) · Addictive Behaviors · doi:10.1016/0306-4603(78)90010-2 · Cited by 10
Analysis of Data from Pre- and Posttest Designs: A Comment
Humphreys, L. G. (1976) · Psychological Reports · doi:10.2466/pr0.1976.38.2.639 · Cited by 10
“The three methods of analysis of pretest-posttest data discussed by Huck and McLean (1975) are translated into correlational terms.”
MethodBarling, J. I. (1980) · Child Behavior Therapy · doi:10.1300/j473v02n02_03 · Cited by 10
A Critical Review of Learning Gains Methods and Approaches
Rogaten, J., & Rienties, B. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1479-362820210000014003 · Cited by 9
Orman, E. K. (2016) · International Journal of Music Education · doi:10.1177/0255761415619058 · Cited by 9
“A MANCOVA with pretest as covariate (Dimitrov & Rumrill, 2003; Huck & McLean, 1975) was used to determine pre and posttest differences in mean eye contact and directional focus for the entire, slow, and fast portion of the musical selection based upon group assignment.”
MethodHypnosis in Women with Breast Cancer: Its Effects on Cytokines
Téllez, A., Rodríguez-Padilla, C., García, D. M. J., Jaime-Bernal, L., Sánchez-Jáuregui, T. D. J., Castruita, D. A. A., & Vielma-Ramirez, H. J. (2020) · American Journal of Clinical Hypnosis · doi:10.1080/00029157.2019.1611536 · Cited by 9
“A one-way ANOVA with change scores was used to adjust for possible differences in the pre-test evaluation (Huck & McLean, 1975).”
MethodSimple ways to make the results of exercise science studies more informative
Dankel, S. J. (2020) · Journal of Trainology · doi:10.17338/trainology.9.2_43 · Cited by 9
Bollimbala, A., James, P. S., & Ganguli, S. (2022) · Personality and Individual Differences · doi:10.1016/j.paid.2022.111757 · Cited by 10
Friedman, R. M., Filipczak, J., & Fiordaliso, R. (1977) · Behavior Therapy · doi:10.1016/s0005-7894(77)80167-6 · Cited by 9
Li, P., Brown, A. W., Dawson, J. A., Kaiser, K. A., Bohan Brown, M. M., Keith, S. W., Oakes, J. M., & Allison, D. B. (2015) · Obesity Facts · doi:10.1159/000381434 · Cited by 8
Arslan, G., Aydoğdu, U., & Uzun, K. (2025) · Psychiatric Quarterly · doi:10.1007/s11126-025-10145-7 · Cited by 12
“ANCOVA is a robust and powerful technique for assessing group differences in randomized control designs, especially when random assignment is not possible or when there is a significant difference between the groups’ pre-test scores [55, 95].”
Analyzing randomized controlled interventions: Three notes for applied linguists
Vanhove, J. (2015) · Studies in Second Language Learning and Teaching · doi:10.14746/ssllt.2015.5.1.7 · Cited by 10
Kim, J. M. (2009) · New Directions for Institutional Research · doi:10.1002/ir.294 · Cited by 23
Salcedo-Villanueva, G., Anzaldo, E. F., Romo-Aguas, J. C., Lisker-Cervantes, A., González-Dibildox, L. A., Moreno-Páramo, E., Medina-Andrade, A. A., Vélez-Montoya, R., García‐Aguirre, G., Morales-Cantón, V., et al. (2018) · International Ophthalmology · doi:10.1007/s10792-018-1038-4 · Cited by 10
Social Skills Training and Cognitive Restructuring with Sexual Unassertiveness in Women
Hammond, P. D., & Oei, T. P. S. (1982) · Journal of Sex & Marital Therapy · doi:10.1080/00926238208405435 · Cited by 8
Contrast Effects in Performance Ratings: Another Look Across Time
Buckley, M. R., Villanova, P. D., & Benson, P. G. (1989) · Applied Psychology · doi:10.1111/j.1464-0597.1989.tb01205.x · Cited by 10
Modification of Pain through Covert Positive Reinforcement
Stevens, M. J. (1985) · Psychological Reports · doi:10.2466/pr0.1985.56.3.711 · Cited by 8
Vogrin, D., & Kassinove, H. (1979) · Psychology in the Schools · doi:10.1002/1520-6807(197907)16:3<422::aid-pits2310160321>3.0.co;2-x · Cited by 8
Strawitz, B. M., & Malone, M. R. (1987) · Journal of Research in Science Teaching · doi:10.1002/tea.3660240106 · Cited by 8
A critical comment on Kendall and Finch's cognitive-behavioral group comparison study.
Abikoff, H., & Ramsey, P. P. (1979) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.47.6.1104 · Cited by 8
Developing and Testing an Integrated Model of Choking in Sport
Wang, J. (2002) · Victoria University Research Repository (Victoria University) · Cited by 20
Basharpoor, S., Zakibakhsh Mohammadi, N., Heidari, F., Azarkolah, A., Vicario, C. M., & Salehinejad, M. A. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.09.089 · Cited by 7
Filho, L. C. T. C., Pinho, M. F. C., de Carvalho, F. M., Franco, A. L. M. M., Quispe-Enriquez, O. C., Altónaga, F. A., & Lerma, J. L. (2025) · Symmetry · doi:10.3390/sym17030376 · Cited by 7
White, J., Brooks, N. H., & Keenan, M. (1995) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.5640020204 · Cited by 12
The effect of hypnotherapy on the quality of life in women with breast cancer
Téllez, A., García, D. M. J., Jaime-Bernal, L., de la Garza, C. E. M., & Sánchez, T. J. (2017) · Psychology in Russia State of Art · doi:10.11621/pir.2017.0216 · Cited by 7
“A one-way analysis of variance (ANOVA) with a change score was used, as recommended by Huck and McLean (1975), to adjust any possible differences in the pre-test evaluation.”
MethodStatistics for Small Groups: The Power of the Pretest
Cole, D. A. (1988) · Research and Practice for Persons with Severe Disabilities · doi:10.1177/154079698801300303 · Cited by 7
Analysis of Pretest-Posttest Data and the Regression to the Mean: A Review
学, 岩. (2002) · Kodo Keiryogaku (The Japanese Journal of Behaviormetrics) · doi:10.2333/jbhmk.29.247 · Cited by 8
Detecting Scale Recalibration in Survey Research
Buckley, M. R., & Armenakis, A. A. (1987) · Group & Organization Studies · doi:10.1177/105960118701200408 · Cited by 7
The affective dimension in second language programme evaluation
Gardner, R. C., MacIntyre, P. D., & Lysynchuk, L. M. (1990) · Language Culture and Curriculum · doi:10.1080/07908319009525072 · Cited by 9
Professional Education in Understanding and Treating Alcoholism; a Demonstration Project
A Demonstration Project, Kilty, K. M., & Feld, A. (1979) · Journal of Studies on Alcohol · doi:10.15288/jsa.1979.40.929 · Cited by 7
Yu, Y., Yetim, M. A., & Cocieru, O. C. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2588652 · Cited by 9
“This approach follows research highlighting the utility of difference scores (Rogosa & Willett, 1983; Zimmerman & Williams, 1982) and allows us to acknowledge the complexities inherent in analyzing pretest-posttest data solely through repeated-measures (Huck & McLean, 1975).”
Collins, J. D., & Rosch, D. M. (2018) · Journal of Leadership Education · doi:10.12806/v17/i3/r10 · Cited by 6
Metadata
- Authors
- Huck, S. W., & McLean, R. A.
- Affiliations
- University of Tennessee at Knoxville (US)
- Venue
- Psychological Bulletin
- Published
- 1975-07
- Volume
- 82
- Issue
- 4
- Pages
- 511-518
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2072435510
- Cited by
- 449
- References
- 19
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 6 · 2023: 8 · 2022: 13 · 2021: 14 · 2020: 18 · 2019: 17 · 2018: 15 · 2017: 11 · 2016: 21 · 2015: 20 · 2014: 15 · 2013: 20 · 2012: 11
- FWCI
- 15.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- pretest-posttest control group design, repeated measures ANOVA, SCORE risk model, treatment effect estimation, misinterpretation of statistical results, reanalysis of data, post hoc comparisons, gain score, covariance analysis, experimental design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.