Using a repeated measures ANOVA to analyze the data from a pretest–posttest design: a potentially confusing task
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
The pretest-posttest control group design (or an extension of it) is a highly prestigious experimental design. A popular analytic strategy involves subjecting the data provided, by this design to a repeated measures analysis of variance (ANOVA). Unfortunately, the statistical results yielded by this type of analysis can easily be misinterpreted, since the score model underlying the analysis is not correct. Examples from recently published articles are used to demonstrate that this statistical procedure has led to (a) incorrect statements regarding treatment effects, (b) completely redundant reanalyses of the same data, and (c) problems with respect to post hoc investigations; Two alternative strategies—gain scores and covariance—are discussed and compared.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sessions will be videotaped and transcribed, and content analysis will be used to identify and code the major themes in the data [108].”
From LIBER8 design and methods: An integrative intervention for loss of control eating among African American and White adolescent girls (2013) · cites this paper as [108]
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Experimental Design in Psychological Research
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0011 · Cited by 2,465
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
Marascuilo, L. A., & Levin, J. R. (1970) · American Educational Research Journal · doi:10.3102/00028312007003397 · Cited by 177
Analysis of Covariance: A Delicate Instrument
ELASHOFF, J. D. (1969) · American Educational Research Journal · doi:10.2307/1161858 · Cited by 176
Leventhal, G. S., Michaels, J. W., & Sanford, C. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0032877 · Cited by 159
A Comparison of the Precision of Three Experimental Designs Employing a Concomitant Variable
Feldt, L. S. (1958) · Psychometrika · doi:10.1007/bf02289783 · Cited by 111 · cited 1×
“1 For a more detailed comparison of covariance versus gain scores regarding the issue of power, see Feldt (1958) and Gourlay (1953).”
BackgroundType IV errors and interactions.
Levin, J. R., & Marascuilo, L. A. (1972) · Psychological Bulletin · doi:10.1037/h0033455 · Cited by 60
ATIQULLAH, M. (1962) · Biometrika · doi:10.1093/biomet/49.1-2.83 · Cited by 59
Cited by
Items 101–200 of 465
Kim, J., Park, H., Bruce, J. A., Rowles, D. M., Holbrook, J. S., Nardone, B., West, D. P., Laumann, A. E., Roth, E. J., & Ghovanloo, M. (2015) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2015.2405072 · Cited by 55
“To analyze the learning effects of the TDS to control a computer, a PWC, and smartphone applications, a repeated measure analysis of variance (rmANOVA) [36], on the Statistical Package for the Social Sciences (SPSS) v.”
MethodFarmer, H., Maister, L., & Tsakiris, M. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.01016 · Cited by 51
“Participant’s pre-stimulation SC-IAT scores were included as a covariate in order to control for participant’s pre-existing attitudes toward black people (as per Huck and Mclean, 1975; Tabachnick and Fidell, 1996).”
BackgroundKlepac, R. K., Hauge, G., Dowling, J., & McDonald, M. (1981) · Behavior Therapy · doi:10.1016/s0005-7894(81)80128-1 · Cited by 55
The purpose-in-life test in an inmate population: An empirical investigation
Reker, G. T. (1977) · Journal of Clinical Psychology · doi:10.1002/1097-4679(197707)33:3<688::aid-jclp2270330316>3.0.co;2-f · Cited by 94
Chen, C., & Ringenbach, S. D. R. (2016) · Journal of Intellectual Disability Research · doi:10.1111/jir.12258 · Cited by 59
Johnson, T. R. (2016) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.12.3.p253 · Cited by 66
“…it is important to understand the strengths, limitations, and requirements of each method; generally speaking, however, ANCOVA is usually the preferred approach (Bonate, 2000; Dimitrov & Rumrill, 2003; Dugard & Todman, 1995; Huck & McLean, 1975; Knapp & Schafer, 2009; Overall, 1993; Senn, 1994).”
MethodImproving drug treatment in general practice
Schuiling‐Veninga, C. C. M., Denig, P., Zwaagstra, R., & Haaijer‐Ruskamp, F. M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00194-3 · Cited by 66
Corning, A. F., Gondoli, D. M., Bucchianeri, M. M., & Salafia, E. H. B. (2010) · Body Image · doi:10.1016/j.bodyim.2010.08.001 · Cited by 53
Zafra, A. O., Rubio, V. J., Ortega, E., & García-Más, A. (2016) · Physical Therapy in Sport · doi:10.1016/j.ptsp.2016.09.003 · Cited by 58
“According to Huck and McLean (1975) ANCOVA is a more appropriate and powerful model than a split-plot ANOVA to analyze data from a pre-post design with a between-subjects treatment factor, using pretreatment scores as a covariate; when a significant simple effect was found, its effect size was…”
MethodA Cost Analysis of Self‐Management Programs for People with Chronic Illness
Groessl, E. J., & Cronan, T. A. (2000) · American Journal of Community Psychology · doi:10.1023/a:1005184414241 · Cited by 60
Kreuzer, P. M., Goetz, M., Holl, M., Schecklmann, M., Landgrebe, M., Staudinger, S., & Langguth, B. (2012) · BMC Complementary and Alternative Medicine · doi:10.1186/1472-6882-12-235 · Cited by 51
“[24-26].”
Benefits of Positive Psychology-Based Story Reading on Adolescent Mental Health and Well-Being
Arslan, G., Yıldırım, M., Zangeneh, M., & Ak, İ. (2022) · Child Indicators Research · doi:10.1007/s12187-021-09891-4 · Cited by 51
“ANCOVA is a sensitive and useful method to examine differences among groups in a randomized control design, when groups are random assignment to them is not possible (Huck & McLean, 1975; Tabachnick & Fidell, 2013).”
MethodFrom Gain Score t to ANCOVA F (and vice versa)
Knapp, T. R., & Schafer, W. D. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/yke1-k937 · Cited by 51
“Some methodologists advocate the use of repeated-measures analysis of variance (ANOVA) for this same design (see Huck & McLean, 1975).”
MethodAughey, R. J., Gore, C. J., Hahn, A. G., GARNHAM, A. P., Clark, S. A., Petersen, A. C., Roberts, A. D., & McKenna, M. J. (2004) · Journal of Applied Physiology · doi:10.1152/japplphysiol.01335.2003 · Cited by 51
“Maximal 3-O-MFPase activity in resting muscle was normalized to preintervention resting levels, and the change score was contrasted between Con and LHTL with an independent t-test, to account for the small sample size and typical intersubject and intra- and interassay variability (22).”
MethodDevelopmental Changes During Their Supervisees' First Practicum
Borders, L. D. (1991) · The Clinical Supervisor · doi:10.1300/j001v08n02_12 · Cited by 51
Barker, J., Jones, M., & Greenlees, I. (2010) · Journal of Sport and Exercise Psychology · doi:10.1123/jsep.32.2.243 · Cited by 50
“To examine the effect of hypnosis on self-efficacy and performance in the posttest phase, in accordance with the recommendations of Huck and McLean (1975), two separate one-way ANCOVAs were conducted on posttest efficacy and performance scores using pretest score (efficacy and performance,…”
MethodA Comparison of the Effects of Fantasy Play Tutoring and Skills Tutoring in Nursery Classes
Smith, P. K., Dalgleish, M., & Herzmark, G. (1981) · International Journal of Behavioral Development · doi:10.1177/016502548100400403 · Cited by 50
Evaluating the Efficacy of Virtual Reality (VR) Training Devices for Pilot Training
Guthridge, R., & Clinton‐Lisell, V. (2023) · Journal of Aviation Technology and Engineering · doi:10.7771/2159-6670.1286 · Cited by 49
Predicting the Effect of a Predictor When Controlling for Baseline
Sorjonen, K., Melin, B., & Ingre, M. (2019) · Educational and Psychological Measurement · doi:10.1177/0013164418822112 · Cited by 50
“It has been demonstrated algebraically (Huck & McLean, 1975) and through simulations (Petscher & Schatschneider, 2011) that analyzing the effect of X on Y1 while adjusting for Y0 is more powerful than analyzing the crude effect of X on the Y1–Y0 difference, and researchers have been discouraged…”
MethodRobinson, E. H., Stout, J. R., Miramonti, A. A., Fukuda, D. H., Wang, R., Townsend, J. R., Mangine, G. T., Fragala, M. S., & Hoffman, J. R. (2014) · Journal of the International Society of Sports Nutrition · doi:10.1186/1550-2783-11-16 · Cited by 44
“Separate one-way analyses of covariance (ANCOVA) were used to analyze all dependent performance and metabolic variable data based on the recommendations of Huck and McLean [30].”
MethodThe effects of scenario planning on participant decision‐making style
Chermack, T. J., & Nimon, K. (2008) · Human Resource Development Quarterly · doi:10.1002/hrdq.1245 · Cited by 56
Preliminary examination of cognitive reserve theory in closed head injury
Ropacki, M., & Elias, J. W. (2003) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/18.6.643 · Cited by 54
“This lack of difference in the pre-injury OPIE scores is why the main effect for group, which is a combination of pre- and post-injury scores, is underestimated in this design and not interpretable (Huck & McLean, 1975).”
BackgroundMethodZientek, L., Nimon, K. F., & Hammack-Brown, B. (2016) · European journal of training and development · doi:10.1108/ejtd-08-2015-0066 · Cited by 42
Using Retrospective Pre-Ratings to Counteract Response-Shift Confounding
Pohl, N. F. (1982) · The Journal of Experimental Education · doi:10.1080/00220973.1982.11011826 · Cited by 47
Chen, C., Ringenbach, S. D. R., Crews, D. J., Kulinna, P. H., & Amazeen, E. L. (2014) · Journal of Intellectual Disability Research · doi:10.1111/jir.12163 · Cited by 52
Hamilton, S. B., & MacQuiddy, S. L. (1984) · Journal of Clinical Child Psychology · doi:10.1080/15374418409533171 · Cited by 44
Change Scores—Necessarily Anathema?
Maxwell, S. E., & Howard, G. S. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100313 · Cited by 58
“However, it is also the case that the analysis of covariance provides unbiased parameter estimates and tests (see Delaney and Maxwell, 1980) and in general is the most powerful of the three approaches (see Bock, 1975; Huck and McLean, 1975).’”
BackgroundGreer, D. F., Potts, R., Wright, J. C., & Huston, A. C. (1982) · Child Development · doi:10.1111/j.1467-8624.1982.tb03433.x · Cited by 46
A COMPARISON OF THE RELATIONSHIP ENHANCEMENT PROGRAM AND THE MINNESOTA COUPLE COMMUNICATION PROGRAM*
Brock, G. W., & Joanning, H. (1983) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.1983.tb01530.x · Cited by 46
Communicating the Scientific Consensus on Climate Change: Diverse Audiences and Effects Over Time
Goldberg, M. H., Gustafson, A., van der Linden, S., Rosenthal, S. A., & Leiserowitz, A. (2022) · Environment and Behavior · doi:10.1177/00139165221129539 · Cited by 46
“We used a randomized mixed design, often regarded as the gold standard (Huck & McLean, 1975), to test our research questions.”
MethodTidwell, J. W., Dougherty, M. R., Chrabaszcz, J. R., Thomas, R. P., & Mendoza, J. L. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0560-7 · Cited by 45
“Calculating a one-way ANOVA or t test of responder group on transfer difference scores, testing the interaction of session and responder group in a repeated measures ANOVA, and conducting a regression of the mean responder group training difference scores on transfer difference scores all reduce to a test of the corre…”
MethodInfluentialProtzko, J. (2017) · Developmental Review · doi:10.1016/j.dr.2017.05.001 · Cited by 47
“This was done to allow interpretations to be made about changes in constructs and not change scores (also eliminating the statistical problems that occur with change scores, see Huck and McLean, 1975 for an introduction to both points).”
MethodMatsuo, T., So, R., Shimojo, N., & Tanaka, K. (2015) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2015.05.009 · Cited by 49
“When ANCOVA assumptions were violated, unpaired Student ’ s t -tests were performed [23].”
Cárdenas-Moncada, C., Véliz-Campos, M., & Véliz, L. (2020) · Computer-Assisted Language Learning Electronic Journal · Cited by 44
SALEH, N. F., ROOZENBEEK, J., MAKKI, F. A., MCCLANAHAN, W. P., & VAN DER LINDEN, S. (2024) · Behavioural Public Policy · doi:10.1017/bpp.2020.60 · Cited by 42
The Impact of Use of Manipulatives on the Math Scores of Grade 2 Students
Liggett, R. (2017) · Brock Education Journal · doi:10.26522/brocked.v26i2.607 · Cited by 43
“However, Huck and McLean (1975) found that a repeated measures ANOVA was shown to provide unclear results, while gain scores analysis was more straightforward, they concluded that a covariance analysis was a more powerful method.”
MethodResultSome psychological consequences of striking: A six month, longitudinal study
Barling, J. I., & Milligan, J. (1987) · Journal of Organizational Behavior · doi:10.1002/job.4030080204 · Cited by 43
Effectiveness of Stress Management Training for Nurses Working in a Burn Treatment Unit
Von Baeyer, C., & Krause, L. (1984) · The International Journal of Psychiatry in Medicine · doi:10.2190/wpv9-0y55-55tx-fmx1 · Cited by 42
The Effects of Scenario Planning on Participant Perceptions of Creative Organizational Climate
Chermack, T. J., Coons, L. M., Nimon, K., Bradley, P., & Glick, M. B. (2015) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051815582225 · Cited by 42
State Anxiety among Successful and Unsuccessful Competitors Who Differ in Competitive Trait Anxiety
Martens, R., & Gill, D. L. (1976) · Research Quarterly for Exercise and Sport · doi:10.1080/10671315.1976.10616731 · Cited by 42
Treadmill walking effects on grip strength in young men with Down syndrome
Chen, C., Ringenbach, S. D. R., & Snow, M. (2013) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2013.10.032 · Cited by 45
“One-way analysis of covariance (ANCOVA) was applied to examine differences in post-test of grip strength between exercise and control interventions controlling for pretest (Huck & McLean, 1975).”
MethodModification of Pain Threshold by the Covert Reinforcement Procedure and a Cognitive Strategy
Scott, D. S., & Leonard, C. F. (1978) · The Psychological Record · doi:10.1007/bf03394509 · Cited by 41
Individual Differences in the Emotional Reaction to Shock Determine Whether Hypoalgesia Is Observed
Rhudy, J. L., & Meagher, M. W. (2003) · Pain Medicine · doi:10.1046/j.1526-4637.2003.03028.x · Cited by 45
Braver, S. L., Sandler, I. N., Hita, L., & Wheeler, L. A. (2016) · Family Court Review · doi:10.1111/fcre.12225 · Cited by 40
Acute exercise reduces caffeine-induced anxiogenesis
YOUNGSTEDT, S. D., O'CONNOR, P. J., CRABBE, J. B., & DISHMAN, R. K. (1998) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-199805000-00015 · Cited by 38
Relocation of institutionalized elderly.
Nirenberg, T. D. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.5.693 · Cited by 39
Petscher, Y., & Schatschneider, C. (2011) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2010.00129.x · Cited by 36
“Research by Huck and McLean (1975) demonstrated that the covariance-adjusted score is more powerful than the simple difference score, yet recent reviews indicate researchers are equally likely to use either score type in two-wave randomized experimental designs.”
BackgroundMethodResultInfluentialVenter, A., Maxwell, S. E., & Bolig, E. E. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.194 · Cited by 89
The sanctity of p < .05 obfuscates good stuff: A comment on kerr and goss
Andersen, M. B., & Stoove, M. A. (1998) · Journal of Applied Sport Psychology · doi:10.1080/10413209808406384 · Cited by 38
Effects of cognitive training on the structure of intelligence
Protzko, J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1196-1 · Cited by 40
“This suggests we need to take a closer look at what the training is actually doing.5 There are other concerns, which I shall not repeat here, such as over reliance on pre × post interactions (see Huck & McLean, 1975, for a classic criticism) or active versus passive control groups.”
BackgroundSTATISTICAL POWER OF TRAINING EVALUATION DESIGNS
Arvey, R. D., Cole, D. A., Hazucha, J. F., & Hartanto, F. M. (1985) · Personnel Psychology · doi:10.1111/j.1744-6570.1985.tb00556.x · Cited by 44
Snyder, I. (1993) · Australian Journal of Education · doi:10.1177/000494419303700102 · Cited by 37
Fakhoury, R., & Aubert, B. (2017) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.03.004 · Cited by 42
Trías, D., Mels, C., & Martínez, J. A. H. (2021) · Revista Electrónica de Investigación Educativa · doi:10.24320/redie.2021.23.e02.2945 · Cited by 43
Khowaja, K., Salim, S. S., Asemi, A., Ghulamani, S., & Shah, A. (2019) · Universal Access in the Information Society · doi:10.1007/s10209-019-00646-1 · Cited by 41
“We checked the five essential assumptions [78] in factor analysis.”
MethodInfluentialThe effects of social support and education interventions on health care costs
Cronan, T. A., Groessl, E. J., & Kaplan, R. M. (1997) · Arthritis & Rheumatism · doi:10.1002/art.1790100205 · Cited by 36
Use of electromyographic biofeedback and cue-controlled relaxation in the treatment of test anxiety.
Counts, D. K., Hollandsworth, J. G., & Alcorn, J. D. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.5.990 · Cited by 36
Weisz, G., & Bucher, B. D. (1980) · Behavior Therapy · doi:10.1016/s0005-7894(80)80003-7 · Cited by 36
Kohut, T., & Fisher, W. A. (2013) · The Canadian Journal of Human Sexuality · doi:10.3138/cjhs.935 · Cited by 35
Effectiveness of performance feedback from behaviorally anchored rating scales.
Hom, P. W., DeNisi, A. S., Kinicki, A. J., & Bannister, B. D. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.5.568 · Cited by 38
Correlated Denominators in Multiple Regression and Change Analyses
Pendleton, B. F., Warren, R. D., & Chang, H. C. (1979) · Sociological Methods & Research · doi:10.1177/004912417900700406 · Cited by 35
Danjou, P., Hamon, M., Lacomblez, L., Warot, D., Kecskemeti, S., & Puech, A. (1990) · Psychiatry and Psychobiology · doi:10.1017/s0767399x00003357 · Cited by 35
Gepner, Y., Hoffman, J. R., Shemesh, E., Stout, J. R., Church, D. D., Varanoske, A. N., Zelicha, H., Shelef, I., Chen, J., Frankel, H., et al. (2017) · Journal of Applied Physiology · doi:10.1152/japplphysiol.01116.2016 · Cited by 38
“Analyses of covariance (ANCOVAs) were used to analyze all MRI and blood-dependent variables (muscle damage markers and cytokines) based on the recommendations of Huck and McLean (21).”
MethodMethamphetamine and diphenhydramine effects on the rate of cognitive processing
Mohs, R. C., Tinklenberg, J. R., Roth, W. T., & Kopell, B. S. (1978) · Psychopharmacology · doi:10.1007/bf00428024 · Cited by 33
Novel conceptual combination can dynamically reconfigure semantic memory networksPreprint
Kenett, Y. N., & Thompson‐Schill, S. L. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/crp47 · Cited by 33
Keller, J. L., Housh, T. J., Hill, E. C., Smith, C. M., Schmidt, R. J., & Johnson, G. O. (2019) · Journal of the International Society of Sports Nutrition · doi:10.1186/s12970-019-0270-2 · Cited by 42
Tan, F., Gong, X., & Tsang, M. C. (2021) · International Journal of Educational Research · doi:10.1016/j.ijer.2020.101729 · Cited by 35
Heuristics to Evaluate Interactive Systems for Children with Autism Spectrum Disorder (ASD)
Khowaja, K., Salim, S. S., & Asemi, A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132187 · Cited by 40
“The SPANOVA is used to test the differences between two or more independent groups whilst subjecting participants are repeatedly measured [38].”
MethodSheeber, L., Sorensen, E. D., & Howe, S. R. (1996) · Journal of Psychiatric Research · doi:10.1016/0022-3956(96)00012-x · Cited by 32
Varanoske, A. N., Hoffman, J. R., Church, D. D., Coker, N. A., Baker, K. M., Dodd, S. J., Harris, R. C., Oliveira, L., Dawson, V. L., Wang, R., et al. (2018) · Amino Acids · doi:10.1007/s00726-018-2609-4 · Cited by 38
Rupp, C., Jürgens, C., Doebler, P., Andor, F., & Buhlmann, U. (2019) · PLoS ONE · doi:10.1371/journal.pone.0213895 · Cited by 32
Relaxation training and cardiovascular response to experimental stressors.
English, E. H., & Baker, T. B. (1983) · Health Psychology · doi:10.1037/0278-6133.2.3.239 · Cited by 31
Maurissen, J. P. J., & Vidmar, T. J. (2016) · Neurotoxicology and Teratology · doi:10.1016/j.ntt.2016.10.003 · Cited by 34
Herwegen, J. V., Costa, H. M., Nicholson, B., & Donlan, C. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.03.011 · Cited by 30
Atwood, K. A., Kennedy, S. B., Shamblen, S., Taylor, C. H., Quaqua, M., Bee, E. M., Gobeh, M. E., Woods, D. V., & Dennis, B. (2012) · Vulnerable Children and Youth Studies · doi:10.1080/17450128.2011.647773 · Cited by 30
“A one-way ANOVA with Fisher LSD contrasts was performed on the number of days participants were exposed to the intervention using our sexual experience level trichotomy [i.e. not sexually active (dosage M = 6.68), sexually active but no TS (dosage M = 6.27), and TS (dosage M = 6.24)] as the independent measure.”
MethodInfluentialImproving the Historical Knowledge and Writing of Students With or At Risk for LD
Paz, S. D. L., & Wissinger, D. R. (2016) · Journal of Learning Disabilities · doi:10.1177/0022219416659444 · Cited by 35
“To verify the conservative nature of the F test for condition and to improve the statistical detection of treatment effects, we used pretest scores on dependent measures as covariates (Huck & McLean, 1975).”
MethodThe role of proactive interference in working memory training and transfer
Redick, T. S., Wiemers, E. A., & Engle, R. W. (2019) · Psychological Research · doi:10.1007/s00426-019-01172-8 · Cited by 32
Aughey, R. J., Clark, S. A., Gore, C. J., Townsend, N., Hahn, A., Kinsman, T. A., Goodman, C. A., Chow, C. M., Martin, D. T., Hawley, J. A., et al. (2006) · European Journal of Applied Physiology · doi:10.1007/s00421-006-0280-z · Cited by 33
“Maximal 3-O-MFPase activity in resting muscle was normalised to pre-intervention resting levels at d5 and Post and the change score ( Huck and McLean 1975 ) was contrasted between CON and each LHTL group with a repeated measures (day) ANOVA.”
MethodBurns, G. N., Filipkowski, J. N., Morris, M. B., & Shoda, E. A. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.051 · Cited by 33
“ANCOVA was chosen in order to adjust the post-warning means to account for pre-warning differences and to increase the power of the analyses by reducing within-group variability (Huck & McLean, 1975).”
MethodExamining the relations between semantic memory structure and creativity in second language
Fontecha, A. F., & Kenett, Y. N. (2022) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2022.101067 · Cited by 30
Livingston, P. M., Salmon, J., Courneya, K. S., Gaskin, C. J., Craike, M. J., Botti, M., Broadbent, S., & Kent, B. (2011) · BMC Cancer · doi:10.1186/1471-2407-11-237 · Cited by 31
Stanley, D. M., & Cumming, J. (2010) · International Journal of Sport and Exercise Psychology · doi:10.1080/1612197x.2010.9671957 · Cited by 34
“Further rationale for this approach is provided by Huck and McLean (1975) who illustrate that, when using ANOVA in pretest to posttest experimental designs, the F test for the main effects of experimental treatments can be too conservative and, consequently, misleading.”
MethodThe online framing effect: the moderating role of warning, brand familiarity, and product type
Chen, Y., & Chang, S.-H. (2015) · Electronic Commerce Research · doi:10.1007/s10660-015-9206-3 · Cited by 31
Callaghan, R. C., Taylor, L., & Cunningham, J. A. (2007) · Addiction · doi:10.1111/j.1360-0443.2007.01934.x · Cited by 35
Effects of a “Focused Interest” Career Course Approach for College Students
Lent, R. W., Larkin, K. C., & Hasegawa, C. (1986) · Vocational Guidance Quarterly · doi:10.1002/j.2164-585x.1986.tb01117.x · Cited by 27
Next Week, Next Month, Next Year: How Perceived Temporal Boundaries Affect Initiation Expectations
Hennecke, M., & Converse, B. A. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617691099 · Cited by 27
“We therefore applied the more parsimonious gain-score approach (and plot raw means for inspection; Bobko, 1986; Brogan & Kutner, 1980; Huck & McLean, 1975; Strube & Bobko, 1989; Widaman et al., 2012).”
MethodThe effects of goal setting on the arithmetic performance of brain-damaged patients
Gauggel, S., & Billino, J. (2002) · Archives of Clinical Neuropsychology · doi:10.1093/arclin/17.3.283 · Cited by 26
“Following a recommendation by Sheeber, Sorensen, and Howe (1996), an analysis of covariance (ANCOVA) was performed to analyze the data of our pretest–posttest design (see also Huck & McLean, 1975; Stevens, 1990 for similar recommendations).”
MethodCapability Development and Decision Incongruence in Strategic Opportunity Pursuit
Mitchell, J., & Shepherd, D. A. (2012) · Strategic Entrepreneurship Journal · doi:10.1002/sej.1145 · Cited by 25
Effects of non-symbolic arithmetic training on symbolic arithmetic and the approximate number system
Au, J., Jaeggi, S. M., & Buschkuehl, M. (2018) · Acta Psychologica · doi:10.1016/j.actpsy.2018.01.005 · Cited by 27
Low acetylcholine during early sleep is important for motor memory consolidation
Inayat, S., Qandeel, Nazari-Ahangarkolaee, M., Singh, S., McNaughton, B. L., Whishaw, I. Q., & Mohajerani, M. H. (2019) · SLEEP · doi:10.1093/sleep/zsz297 · Cited by 25
Mazzeo, S. E., Kelly, N. R., Stern, M., Gow, R. W., Serdar, K., Evans, R. K., Jones, R. M., & Bulik, C. M. (2012) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.01.003 · Cited by 24
“ANCOVA is a particularly useful statistical technique for studies using a pretest-posttest design with random assignment, because it enhances statistical power by reducing error variance (70).”
MethodBoykin, R. A., & Nelson, R. O. (1981) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1981.14-479 · Cited by 24
Hoffman, J. R., Markus, I., Dubnov‐Raz, G., & Gepner, Y. (2020) · The Journal of Strength and Conditioning Research · doi:10.1519/jsc.0000000000003693 · Cited by 24
“Analyses of covariance (ANCOVA) were used to analyze all and subjective measures of energy, alertness, and mood (11).”
MethodPredicting human behavior: Comparing idiographic, nomothetic, and agentic methodologies.
Howard, G. S., & Myers, P. R. (1990) · Journal of Counseling Psychology · doi:10.1037//0022-0167.37.2.227 · Cited by 23
ANOVA and ANCOVA of Pre- and Post-Test, Ordinal Data
Davison, M. L., & Sharma, A. R. (1994) · Psychometrika · doi:10.1007/bf02294394 · Cited by 25
What are we looking at, and how big is it?
Stoove, M. A., & Andersen, M. B. (2003) · Physical Therapy in Sport · doi:10.1016/s1466-853x(03)00039-7 · Cited by 23
Mazzeo, S. E., Kelly, N. R., Stern, M., Palmberg, A. A., Belgrave, F. Z., Tanofsky-Kraff, M., Latzer, Y., & Bulik, C. M. (2013) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.10.012 · Cited by 22
Ditre, J. W., LaRowe, L. R., Vanable, P. A., Vita, M. J. D., & Zvolensky, M. J. (2018) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.10.013 · Cited by 24
A Component Analysis of Marriage Enrichment: Information and Treatment Modality
Worthington, E. L., Buston, B. G., & HAMMONDS, T. M. (1989) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1989.tb01327.x · Cited by 22
Modification of the paired H reflex through the transcendental meditation and TM-Sidhi program
Wallace, R. K., Mills, P. J., Orme‐Johnson, D. W., Dillbeck, M. C., & And, E. J. (1983) · Experimental Neurology · doi:10.1016/0014-4886(83)90379-5 · Cited by 22
Metadata
- Authors
- Huck, S. W., & McLean, R. A.
- Affiliations
- University of Tennessee at Knoxville (US)
- Venue
- Psychological Bulletin
- Published
- 1975-07
- Volume
- 82
- Issue
- 4
- Pages
- 511-518
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2072435510
- Cited by
- 449
- References
- 19
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 6 · 2023: 8 · 2022: 13 · 2021: 14 · 2020: 18 · 2019: 17 · 2018: 15 · 2017: 11 · 2016: 21 · 2015: 20 · 2014: 15 · 2013: 20 · 2012: 11
- FWCI
- 15.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- pretest-posttest control group design, repeated measures ANOVA, SCORE risk model, treatment effect estimation, misinterpretation of statistical results, reanalysis of data, post hoc comparisons, gain score, covariance analysis, experimental design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.