Using a repeated measures ANOVA to analyze the data from a pretest–posttest design: a potentially confusing task
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
The pretest-posttest control group design (or an extension of it) is a highly prestigious experimental design. A popular analytic strategy involves subjecting the data provided, by this design to a repeated measures analysis of variance (ANOVA). Unfortunately, the statistical results yielded by this type of analysis can easily be misinterpreted, since the score model underlying the analysis is not correct. Examples from recently published articles are used to demonstrate that this statistical procedure has led to (a) incorrect statements regarding treatment effects, (b) completely redundant reanalyses of the same data, and (c) problems with respect to post hoc investigations; Two alternative strategies—gain scores and covariance—are discussed and compared.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Sessions will be videotaped and transcribed, and content analysis will be used to identify and code the major themes in the data [108].”
From LIBER8 design and methods: An integrative intervention for loss of control eating among African American and White adolescent girls (2013) · cites this paper as [108]
Citations
Cites
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Experimental Design in Psychological Research
(2002) · Foundations of Cognitive Psychology · doi:10.7551/mitpress/3080.003.0011 · Cited by 2,465
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
Marascuilo, L. A., & Levin, J. R. (1970) · American Educational Research Journal · doi:10.3102/00028312007003397 · Cited by 177
Analysis of Covariance: A Delicate Instrument
ELASHOFF, J. D. (1969) · American Educational Research Journal · doi:10.2307/1161858 · Cited by 176
Leventhal, G. S., Michaels, J. W., & Sanford, C. (1972) · Journal of Personality and Social Psychology · doi:10.1037/h0032877 · Cited by 159
A Comparison of the Precision of Three Experimental Designs Employing a Concomitant Variable
Feldt, L. S. (1958) · Psychometrika · doi:10.1007/bf02289783 · Cited by 111 · cited 1×
“1 For a more detailed comparison of covariance versus gain scores regarding the issue of power, see Feldt (1958) and Gourlay (1953).”
BackgroundType IV errors and interactions.
Levin, J. R., & Marascuilo, L. A. (1972) · Psychological Bulletin · doi:10.1037/h0033455 · Cited by 60
ATIQULLAH, M. (1962) · Biometrika · doi:10.1093/biomet/49.1-2.83 · Cited by 59
Cited by
Unrealistic optimism about future life events
Weinstein, N. D. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.39.5.806 · Cited by 4,999
“These changes were studied in additional analyses that treated pretreatment event responses as covariates and tested for group differences on treatment and posttreatment events (Huck & McLean, 1975).”
MethodPretest-posttest designs and measurement of change
Dimitrov, D. M., & Rumrill, Jr. (2003) · WORK: A Journal of Prevention, Assessment & Rehabilitation · doi:10.3233/wor-2003-00285 · Cited by 908
“A very little known fact is also that the F statistic for the interaction between the treatment factor and the pretest-posttest factor is identical to the F statistic for the treatment main effect with a one-way ANOVA on gain scores [ 10 ].”
MethodResultSTRATEGIC CHANGE: THE EFFECTS OF FOUNDING AND HISTORY.
Boeker, W. (1989) · Academy of Management Journal · doi:10.2307/256432 · Cited by 833
Howard, G. S., Ralph, K. M., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300101 · Cited by 462
When our identities are mistaken: Reaffirming self-conceptions through social interaction.
Swann, W. B., & Hill, C. A. (1982) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.43.1.59 · Cited by 459
“We report difference-score.analyses instead of the more sensitive analysis of covariance (ANCOVA; e.g., Huck & McLean, 1975), because it allowed us to contrast the effects of consistent versus discrepant feedback directly and clearly.”
MethodSkill training with alcoholics.
Chaney, E. F., O'Leary, M. R., & Marlatt, G. A. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.46.5.1092 · Cited by 413
Smit, H. J., & Rogers, P. J. (2000) · Psychopharmacology · doi:10.1007/s002130000506 · Cited by 339
Davis, C. L., Tomporowski, P. D., Boyle, C. A., Waller, J. L., Miller, P. H., Naglieri, J. A., & Gregoski, M. (2007) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2007.10599450 · Cited by 286
“Analysis of covariance (ANCOVA) was used to examine differences in posttest scores of various cognitive scales among activity groups (control, low- and high-dose exercise) controlling for cohort and pretest score (Huck & McLean, 1975).”
MethodLong-term effectiveness of inoculation against misinformation: Three longitudinal experiments.
Maertens, R., Roozenbeek, J., Basol, M., & van der Linden, S. (2021) · Journal of Experimental Psychology: Applied · doi:10.1037/xap0000315 · Cited by 321
Cupal, D. D., & Brewer, B. W. (2001) · Rehabilitation Psychology · doi:10.1037/0090-5550.46.1.28 · Cited by 300
Use of multiple regression in counseling psychology research: A flexible data-analytic strategy.
Wampold, B. E., & Freund, R. D. (1987) · Journal of Counseling Psychology · doi:10.1037//0022-0167.34.4.372 · Cited by 260
Analysis of Pre‐test‐Post‐test Control Group Designs in Educational Research
Dugard, P., & Todman, J. (1995) · Educational Psychology · doi:10.1080/0144341950150207 · Cited by 232
Effects of Academic Tutoring on the Social Status of Low-Achieving, Socially Rejected Children
Coie, J. D., & Krehbiel, G. (1984) · Child Development · doi:10.2307/1130016 · Cited by 263
Analytic Methods for Questions Pertaining to a Randomized Pretest, Posttest, Follow-Up Design
Rausch, J. R., Maxwell, S. E., & Kelley, K. (2003) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3203_15 · Cited by 238
“As Huck and McLean (1975) have shown, ANCOVA is generally the most appropriate analytic method when testing for group differences in change from the pretest to the posttest in a randomized pre–post design.”
MethodMULTIDIVISIONAL STRUCTURE AND PERFORMANCE: THE CONTINGENCY OF DIVERSIFICATION STRATEGY.
Hoskisson, R. E. (1987) · Academy of Management Journal · doi:10.2307/256152 · Cited by 242
KERN, R. G. (1989) · The Modern Language Journal · doi:10.1111/j.1540-4781.1989.tb02535.x · Cited by 217
Statistical treatment of the Solomon four-group design: A meta-analytic approach.
Braver, M. W., & Braver, S. L. (1988) · Psychological Bulletin · doi:10.1037//0033-2909.104.1.150 · Cited by 205
“Huck and Sandier (1973) modified Campbell and Stanley's (1963) analysis by noting that if the simple effect in the second row (Test C) is significant also (still assuming a significant interaction in Test A), there is evidence that pretest sensitization is present but that it merely enhances the effect of the treatmen…”
BackgroundANCOVA Versus CHANGE From Baseline in Nonrandomized Studies: The Difference
van Breukelen, G. J. P. (2013) · Multivariate Behavioral Research · doi:10.1080/00273171.2013.831743 · Cited by 196
“This was noted by Allison (1990), Huck and McLean (1975), Laird (1983), and Rausch et al. (2003) but seems to be unknown among psychologists (e.g., Jamieson, 2004).”
BackgroundDevelopment and evaluation of a learning strategy training program.
Dansereau, D. F. (1979) · Journal of Educational Psychology · doi:10.1037//0022-0663.71.1.64 · Cited by 211
Intimates as agents of social support: Sources of consolation or despair?
Swann, W. B., & Predmore, S. C. (1985) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.49.6.1609 · Cited by 205
Fostering effective learning strategies in higher education—A mixed-methods study.
Biwer, F., Egbrink, M. G. A. O., Aalten, P., & de Bruin, A. B. H. (2020) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2020.03.004 · Cited by 195
A developmental study of learned helplessness.
Rholes, W. S., Blackwell, J., Jordan, C., & Walters, C. (1980) · Developmental Psychology · doi:10.1037//0012-1649.16.6.616 · Cited by 194
Geller, E. S., Erickson, J. B., & Buttram, B. A. (1983) · Population and Environment · doi:10.1007/bf01362290 · Cited by 183
Emavardhana, T., & Tori, C. D. (1997) · Journal for the Scientific Study of Religion · doi:10.2307/1387552 · Cited by 174
Effectiveness of grief therapy: A meta-analysis.
Allumbaugh, D. L., & Hoyt, W. T. (1999) · Journal of Counseling Psychology · doi:10.1037/0022-0167.46.3.370 · Cited by 185
VACATION AND WELL-BEING: A STUDY OF CHINESE TOURISTS
Chen, Y., Lehto, X. Y., & Cai, L. (2013) · Annals of Tourism Research · doi:10.1016/j.annals.2013.02.003 · Cited by 172
Schroder, K. E. E., Carey, M. P., & Vanable, P. A. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2602_02 · Cited by 178
Perez-Blasco, J., Viguer, P., & Rodrigo, M. F. (2013) · Archives of Women's Mental Health · doi:10.1007/s00737-013-0337-z · Cited by 173
“In general, ANCOVA is the method best suited to testing for between-groups differences pre- and posttest in a randomized pre–post design (Huck and McLean 1975).”
MethodEvaluating an alliance-focused treatment for personality disorders.
Muran, J. C., Safran, J. D., Samstag, L. W., & Winston, A. (2005) · Psychotherapy: Theory, Research, Practice, Training · doi:10.1037/0033-3204.42.4.532 · Cited by 165
“…for Time x Condition, F(16, 199.22) .71 p .79, ES (r) .39.3 Second, in order to increase the precision and reliability of our analysis (see Huck & McClean, 1975), we calculated standardized residual gain scores for all available dependent measures regarding the following intervals: (a)…”
MethodInfluentialTransforming programs and tests in tandem for fault localization
Li, X., & Zhang, L. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133916 · Cited by 155
“…different impacts on fault localization, we further applied the One-way Repeated Measures ANOVA analysis (also denoted as rA-NOVA) [Girden 1992; Huck and McLean 1975; von Ende 2001] on the fault localization results using the 4 di � erent failure types to investigate their statistical di �…”
MethodLane, K. L., Givner, C. C., & Pierson, M. R. (2004) · The Journal of Special Education · doi:10.1177/00224669040380020401 · Cited by 148
“*p < .0001. were not necessary, given that each comparison involved only two groups (Huck & McLean, 1975; Kleinbaum et al., 1998).”
BackgroundAN INVESTIGATION OF THE EFFECT AND ECONOMIC UTILITY OF CORPORATE‐WIDE TRAINING
MORROW, C. C., JARRETT, M. Q., & RUPINSKI, M. T. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00902.x · Cited by 140
Oliveira, J. F., Zanão, T. A., Valiengo, L., Lotufo, P. A., Benseñor, I. M., Fregni, F., & Brunoni, A. R. (2013) · Neuroscience Letters · doi:10.1016/j.neulet.2013.01.023 · Cited by 138
Improving critical thinking skills and metacognitive monitoring through direct infusion
Bensley, D. A., & Spero, R. A. (2014) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2014.02.001 · Cited by 157
Goldberg, M. H., van der Linden, S., Ballew, M. T., Rosenthal, S. A., Gustafson, A., & Leiserowitz, A. (2019) · Science Communication · doi:10.1177/1075547019874361 · Cited by 116
“To maximize power of the experiment (Huck & McLean, 1975), we used a mixed design with three between-subjects conditions (Video vs. Transcript vs. Control) while all measures were within-subjects (pretreatment vs. posttreatment).”
MethodEFFECTS OF TELEVISION MODELING ON RESIDENTIAL ENERGY CONSERVATION
Winett, R. A., Leckliter, I. N., Chinn, D. E., Stahl, B., & Love, S. Q. (1985) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1985.18-33 · Cited by 127
The contribution of work-integrated learning to undergraduate employability skill outcomes
Jackson, D. A. (2013) · Australasian Journal of Paramedicine · Cited by 238
Walker, R. D., Donovan, D. M., Kivlahan, D. R., & O'Leary, M. R. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.6.900 · Cited by 130
Psychological Intervention Programs for Reduction of Injury in Ballet Dancers
Noh, Y.-E., Morris, T., & Andersen, M. B. (2007) · Research in Sports Medicine · doi:10.1080/15438620600987064 · Cited by 109
“Mixed ANOVAs/MANOVAs actually underestimate the magnitude of main effects (Huck and McLean 1975).”
White, J., Keenan, M., & Brooks, N. (1992) · Behavioural Psychotherapy · doi:10.1017/s014134730001689x · Cited by 102
Winett, R. A., Hatcher, J. W., Fort, T. R., Leckliter, I. N., Love, S. Q., Riley, A. W., & Fishback, J. F. (1982) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1982.15-381 · Cited by 115
Webster-Stratton, C. H. (1981) · Behavior Therapy · doi:10.1016/s0005-7894(81)80135-9 · Cited by 113
Davis, A. M., Sampilo, M., Gallagher, K. S., Landrum, Y., & Malone, B. (2013) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jst005 · Cited by 109
“Analysis of covariance (ANCOVA), with corresponding baseline values entered as covariates, was used to assess the primary outcome of child BMIz, as well as all secondary variables (Huck & McLean, 1975).”
Lying because we care: Compassion increases prosocial lying.
Lupoli, M. J., Jampol, L. E., & Oveis, C. (2017) · Journal of Experimental Psychology General · doi:10.1037/xge0000315 · Cited by 140
STOUT, J. R., CRAMER, J. T., MIELKE, M., OʼKROY, J., TOROK, D. J., & ZOELLER, R. F. (2006) · Journal of Strength and Conditioning Research · doi:10.1519/00124278-200611000-00033 · Cited by 108
Teaching and Assessing Critical Thinking Skills for Argument Analysis in Psychology
Bensley, D. A., Crowe, D. S., Bernhardt, P. C., Buckner, C. E., & Allman, A. L. (2010) · Teaching of Psychology · doi:10.1080/00986281003626656 · Cited by 111
“We used a one-way ANOVA to analyze change scores (cf. Huck & McLean, 1975).”
MethodLane, K. L. (1999) · Journal of Emotional and Behavioral Disorders · doi:10.1177/106342669900700403 · Cited by 110
Measuring and enhancing self-efficacy among professional caregivers of individuals with dementia
Mackenzie, C. S., & Peragine, G. (2003) · American Journal of Alzheimer's Disease & Other Dementias® · doi:10.1177/153331750301800507 · Cited by 102
Norm extremity and interpersonal influences on consumer conformity
Lascu, D., Bearden, W. O., & Rose, R. L. (1995) · Journal of Business Research · doi:10.1016/0148-2963(94)00046-h · Cited by 109
Social skills training for juvenile delinquents
Ollendick, T. H., & Hersen, M. (1979) · Behaviour Research and Therapy · doi:10.1016/0005-7967(79)90098-6 · Cited by 103
Active Versus Passive Processing of Spatial Information in a Computer-Simulated Environment
Wilson, P. N., Foreman, N., Gillett, R., & Stanton, D. (1997) · Ecological Psychology · doi:10.1207/s15326969eco0903_3 · Cited by 94
Common scientific and statistical errors in obesity research
George, B. J., Beasley, T. M., Brown, A. W., Dawson, J., Dimova, R., Divers, J., Goldsby, T. U., Heo, M., Kaiser, K. A., Keith, S. W., et al. (2016) · Obesity · doi:10.1002/oby.21449 · Cited by 97
“The second method is readily available in statistical software, is straightforward to run, and typically has more power than endpoint analysis (37-39).”
MethodMolavi, P., Aziziaram, S., Basharpoor, S., Atadokht, A., Nitsche, M. A., & Salehinejad, M. A. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.007 · Cited by 93
Webster-Stratton, C. H. (1982) · Behavior Therapy · doi:10.1016/s0005-7894(82)80026-9 · Cited by 100
Is Severe Obesity a Form of Addiction?: Rationale, Clinical Approach, and Controlled Clinical Trial
Riva, G., Bacchetta, M., Cesa, G., Conti, S., Castelnuovo, G., Mantovani, F., & Molinari, E. (2006) · CyberPsychology & Behavior · doi:10.1089/cpb.2006.9.457 · Cited by 98
Evidence for foot orthoses for adults with flatfoot: a systematic review
Herchenröder, M., Wilfling, D., & Steinhäuser, J. (2021) · Journal of Foot and Ankle Research · doi:10.1186/s13047-021-00499-z · Cited by 95
“This means that each participant will act as their own control [57, 58].”
BackgroundThe Skills of Mothering: A Study of Parent Child Development Centers
Andrews, S. R., Blumenthal, J. B., Johnson, D. L., Kahn, A. J., Ferguson, C. J., Lasater, T. M., Malone, P. E., & Wallace, D. B. (1982) · Monographs of the Society for Research in Child Development · doi:10.2307/1165919 · Cited by 94
O’Gorman, J. G. (1977) · Biological Psychology · doi:10.1016/0301-0511(77)90017-5 · Cited by 93
Kuhn, J., & Holling, H. (2014) · Advances in Cognitive Psychology · doi:10.5709/acp-0157-2 · Cited by 107
Effects of digital video-based feedback environments on pre-service teachers’ feedback competence
Prilop, C. N., Weber, K. E., & Kleinknecht, M. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2019.08.011 · Cited by 77
Rasinski, T., Samuels, S. J., Hiebert, E., Petscher, Y., & Feller, K. (2011) · Reading Psychology · doi:10.1080/02702710903346873 · Cited by 81
“Moreover, it has been well established that results from a one-way ANOVA of gain scores are identical to results from a repeated measures ANOVA with two time points and two groups ( Huck & McLean, 1975 ; Maxwell & Delaney).”
ResultKuan, G., Morris, T., Kueh, Y. C., & Terry, P. C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00014 · Cited by 88
“Performance gain scores among the music conditions were evaluated rather than comparing specific preand post-intervention scores, as recommended by Huck and McLean (1975), as a statistical strategy to minimize the effect of pre-intervention differences between groups.”
MethodAnalysis and Interpretation of Findings Using Multiple Regression Techniques
Hoyt, W. T., Leierer, S. J., & Millington, M. J. (2006) · Rehabilitation Counseling Bulletin · doi:10.1177/00343552060490040401 · Cited by 101
Ma, Y., She, Z., Siu, A. F.-Y., Zeng, X., & Liu, X. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02090 · Cited by 79
Toward a reconceptualization of the law of initial value.
Jin, P. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.111.1.176 · Cited by 88
Zheng, C., Wang, L., & Chai, C. S. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1946562 · Cited by 94
“Huck and McLean (1975) showed that ANCOVA is generally the most appropriate analytic method when testing for group differences in change from the pre-test to the post-test in a randomized pre-post design.”
MethodEvaluating an Educational Intervention to Improve the Treatment of Asthma in Four European Countries
VENINGA, C. C. M., ØV, P. L., WAHLSTRÖM, R., MUSKOVA, M., DENIG, P., BERKHOF, J., KOCHEN, M. M., HAAIJER-RUSKAMP, F. M., & the Drug Education Project Group (1999) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.160.4.9812136 · Cited by 88
Individual differences in self-efficacy development: The effects of goal orientation and affectivity
Gerhardt, M. W., & Brown, K. G. (2005) · Learning and Individual Differences · doi:10.1016/j.lindif.2005.06.006 · Cited by 106
Individual Differences in Multitasking Ability and Adaptability
Morgan, B., D’Mello, S. K., Abbott, R., Radvansky, G. A., Haass, M. J., & Tamplin, A. K. (2013) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720812470842 · Cited by 90
“Although regression-based analyses (including partial correlations) have pitfalls (e.g., Linn & Slinde, 1977), they are generally preferred to other methods (such as analyses on difference scores; Blaikie, 2003; Cribbie & Jamieson, 2004; Flury, 1989; Huck & McLean, 1975).”
Secondary Teachers' Views on Social Competence: Skills Essential for Success
Lane, K. L., Pierson, M. R., & Givner, C. C. (2004) · The Journal of Special Education · doi:10.1177/00224669040380030401 · Cited by 114
“Multiple comparisons were not necessary, given that each comparison involved only two groups (Huck & McLean, 1975; Kleinbaum, Kupper, Muller, & Nizam, 1998).”
BackgroundRoberts, J. K., Henson, R. K., Tharp, B. Z., & Moreno, N. P. (2001) · Journal of Science Teacher Education · doi:10.1023/a:1016708016311 · Cited by 82
Lane, K. L., Pierson, M. R., & Givner, C. C. (2003) · Education and Treatment of Children · Cited by 114
Wu, C., Yang, C.-L., Chuang, L.-L., Lin, K., Chen, H., Chen, M., & Huang, W.-C. (2012) · Physical Therapy · doi:10.2522/ptj.20110282 · Cited by 86
Methods of Analysis with Response-Shift BIAS
Bray, J. H., Maxwell, S. E., & Howard, G. S. (1984) · Educational and Psychological Measurement · doi:10.1177/0013164484444002 · Cited by 76
(2001) · PubMed · Cited by 79
Effects of ‘energy’ drinks on mood and mental performance: critical methodology
Smit, H. J., & Rogers, P. J. (2002) · Food Quality and Preference · doi:10.1016/s0950-3293(02)00044-7 · Cited by 78
Murphy, D. A., Lu, M. C., Martin, D., Hoffman, D., & Marelich, W. D. (2002) · Journal of the Association of Nurses in AIDS care · doi:10.1177/1055329002238026 · Cited by 77
“Change scores (Allison, 1990; Huck & McLean, 1975; Sheeber, Sorensen, & Howe, 1996) were used to evaluate variations in adherence and affective status/ mental health indicators across the baseline, IPIA, and 3-month follow-up assessments.”
MethodAnother look at ANCOVA versus blocking.
Maxwell, S. E., Delaney, H. D., & Dill, C. A. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.1.136 · Cited by 75
Ide, K., Yamada, H., Takuma, N., Kawasaki, Y., Harada, S., Nakase, J., Ukawa, Y., & Sagesaka, Y. M. (2015) · Nutrition Journal · doi:10.1186/s12937-016-0168-7 · Cited by 68
Meditation and flexibility of visual perception and verbal problem solving
Dillbeck, M. C. (1982) · Memory & Cognition · doi:10.3758/bf03197631 · Cited by 72
Amendola, K. L., Weisburd, D., Hamilton, E. E., Jones, G., & Slipka, M. (2011) · Journal of Experimental Criminology · doi:10.1007/s11292-011-9135-7 · Cited by 69
I feel our pain: Antecedents and consequences of emotional self-stereotyping
Moons, W. G., Leonard, D. J., Mackie, D. M., & Smith, E. R. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.04.016 · Cited by 76
“Following recommended analytic procedures for this type of experimental design (Huck & McLean, 1975; Rausch, Maxwell, & Kelley, 2003), baseline group-based anger and fear served as covariates for analysis of emotions reported after the emotion stereotype was presented.”
MethodInfluencing Prescribing for Urinary Tract Infection and Asthma in Primary Care in Sweden
Lundborg, C. S., Wahlström, R., Oké, T., Tomson, G. B., & Diwan, V. K. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00036-0 · Cited by 80
MacEwen, K. E., & Barling, J. I. (1988) · Journal of Organizational Behavior · doi:10.1002/job.4030090304 · Cited by 85
An Evaluation of Cognitive Behavior Therapy for Hyperactive Children
Abikoff, H. (1987) · Springer eBooks · doi:10.1007/978-1-4613-9826-4_5 · Cited by 78
Modifying the Type A coronary-prone behavior pattern.
Levenkron, J. C., Cohen, J. D., Mueller, H. S., & Fisher, E. B. (1983) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.51.2.192 · Cited by 78
Inter-ethnic contact: Attitudinal consequences.
Clément, R., Gardner, R. C., & Smythe, P. C. (1977) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/h0081625 · Cited by 79
Language-Capable Robots may Inadvertently Weaken Human Moral Norms
Jackson, R. B., & Williams, T. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673123 · Cited by 64
“…our current experiment, we performed (a) Bayesian analysis of covariance (ANCOVA) to evaluate posttest results across conditions while controlling for pretest responses, and (b) Bayesian independent samples t-tests for corroborating analysis of gain scores, both with uninformative priors [60]–[62].”
MethodPotential Problems with Peer Ratings
DeNisi, A. S., Randolph, W. A., & Blencoe, A. G. (1983) · Academy of Management Journal · doi:10.5465/256256 · Cited by 74
Maxwell, S. E. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.3.275 · Cited by 71
Moderation of the effects of job enrichment by participation: A longitudinal field experiment
Griffeth, R. W. (1985) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(85)90045-7 · Cited by 63
Trust in Me: Trustworthy Others Are Seen as More Physically Similar to the Self
Farmer, H., McKay, R., & Tsakiris, M. (2013) · Psychological Science · doi:10.1177/0956797613494852 · Cited by 68
“A repeated measures analysis of covariance (as per Huck & McLean, 1975, and Tabachnick & Fidell, 1996), with postgame PSE as dependent variable, pregame PSE as covariate, and trustee trustworthiness as independent variable, revealed a significant difference between trust conditions, F(2, 57) =…”
MethodBullying and school transition: Context or development?
Wang, W., Brittain, H. L., McDougall, P., & Vaillancourt, T. (2015) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.10.004 · Cited by 66
Use of behavioral versus traditional procedures for increasing job interview skills.
Hollandsworth, J. G., Dressel, M. E., & Stevens, J. (1977) · Journal of Counseling Psychology · doi:10.1037//0022-0167.24.6.503 · Cited by 62
Improving Intercultural Competence in the Classroom: A Reflective Development Model
Feng, J. B. (2016) · Journal of Teaching in International Business · doi:10.1080/08975930.2016.1172540 · Cited by 69
Exercise-induced hypoalgesia and pain reduction following blood flow restriction: A brief review
Song, J. S., Spitz, R. W., Yamada, Y., Bell, Z. W., Wong, V. H. Y., Abe, T., & Loenneke, J. P. (2021) · Physical Therapy in Sport · doi:10.1016/j.ptsp.2021.04.005 · Cited by 61
Laforest, M., Bouchard, S., Crétu, A.-M., & Mesly, O. (2016) · Frontiers in ICT · doi:10.3389/fict.2016.00018 · Cited by 60
“1 We chose to use a covariance analysis using the baseline score as a covariable as this approach has the benefit of being conservative (Van Breukelen, 2006), controls for the autocorrelation of observations (Cronbach and Furby, 1970), is considered preferable by some (Huck and McLean, 1975), and is adequate to answer…”
MethodResultSelf-directed activity and cognitive development
Kuhn, D., & Ho, V. (1980) · Journal of Applied Developmental Psychology · doi:10.1016/0193-3973(80)90003-9 · Cited by 58
The effect of asymmetrically focused attention upon subsequent ear differences in dichotic listening
Hiscock, M., & Stewart, C. (1984) · Neuropsychologia · doi:10.1016/0028-3932(84)90080-0 · Cited by 58
Effects of Biofeedback and Cognitive Therapy on Stress in Patients with Breast Cancer
Davis, H. (1986) · Psychological Reports · doi:10.2466/pr0.1986.59.2.967 · Cited by 56
Metadata
- Authors
- Huck, S. W., & McLean, R. A.
- Affiliations
- University of Tennessee at Knoxville (US)
- Venue
- Psychological Bulletin
- Published
- 1975-07
- Volume
- 82
- Issue
- 4
- Pages
- 511-518
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2072435510
- Cited by
- 449
- References
- 19
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 6 · 2023: 8 · 2022: 13 · 2021: 14 · 2020: 18 · 2019: 17 · 2018: 15 · 2017: 11 · 2016: 21 · 2015: 20 · 2014: 15 · 2013: 20 · 2012: 11
- FWCI
- 15.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- pretest-posttest control group design, repeated measures ANOVA, SCORE risk model, treatment effect estimation, misinterpretation of statistical results, reanalysis of data, post hoc comparisons, gain score, covariance analysis, experimental design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.