The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
The analysis of repeated measures designs: A review
Abstract
Repeated measures ANOVA can refer to many different types of analysis. Specifically, this vague term can refer to conventional tests of significance, one of three univariate solutions with adjusted degrees of freedom, two different types of multivariate statistic, or approaches that combine univariate and multivariate tests. Accordingly, it is argued that, by only reporting probability values and referring to statistical analyses as repeated measures ANOVA, authors convey neither the type of analysis that was used nor the validity of the reported probability value, since each of these approaches has its own strengths and weaknesses. The various approaches are presented with a discussion of their strengths and weaknesses, and recommendations are made regarding the ‘best’ choice of analysis. Additional topics discussed include analyses for missing data and tests of linear contrasts.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Under the MAR assumption, the maximum likelihood approach and multiple imputation will yield sensible parameter estimates.62”
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 27,137
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
Littell, R. C. (1996) · Medical Entomology and Zoology · Cited by 10,345
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539
Analysis of Incomplete Multivariate Data
Booth, D. E., & Schafer, J. L. (2000) · Technometrics · doi:10.2307/1271466 · Cited by 5,627
On Methods in the Analysis of Profile Data
Greenhouse, S. W., & Geisser, S. (1959) · Psychometrika · doi:10.1007/bf02289823 · Cited by 4,946
An Approximate Distribution of Estimates of Variance Components
Satterthwaite, F. E. (1946) · Biometrics Bulletin · doi:10.2307/3002019 · Cited by 4,373
Huynh, H., & Feldt, L. S. (1976) · Journal of Educational Statistics · doi:10.3102/10769986001001069 · Cited by 1,701
ON THE COMPARISON OF SEVERAL MEAN VALUES: AN ALTERNATIVE APPROACH
Welch, B. L. (1951) · Biometrika · doi:10.1093/biomet/38.3-4.330 · Cited by 1,531
Box, G. E. P. (1954) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728786 · Cited by 1,528
Modeling the Drop-Out Mechanism in Repeated-Measures Studies
Little, R. J. A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476615 · Cited by 1,522
Designing Experiments and Analysing Data: A Model Comparison Perspective.
Freeman, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Biometrics · doi:10.2307/2532173 · Cited by 1,229
The Generalization of Student’s Ratio
Hotelling, H. (1992) · Springer series in statistics · doi:10.1007/978-1-4612-0919-5_4 · Cited by 1,082
Pattern-Mixture Models for Multivariate Incomplete Data
Little, R. J. A. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10594302 · Cited by 1,026
CERTAIN GENERALIZATIONS IN THE ANALYSIS OF VARIANCE
Wilks, S. S. (1932) · Biometrika · doi:10.1093/biomet/24.3-4.471 · Cited by 1,011
Designing Experiments and Analyzing Data: A Model Comparison Perspective, Third Edition
Maxwell, S. E., & Delaney, H. D. (1999) · Medical Entomology and Zoology · Cited by 975
Huynh, H., & Feldt, L. S. (1970) · Journal of the American Statistical Association · doi:10.1080/01621459.1970.10481187 · Cited by 945
Huynh, H., & Feldt, L. S. (1970) · Journal of the American Statistical Association · doi:10.2307/2284340 · Cited by 945
Application of random-effects pattern-mixture models for missing data in longitudinal studies.
Hedeker, D., & Gibbons, R. D. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.1.64 · Cited by 907
Modified Sequentially Rejective Multiple Test Procedures
Shaffer, J. P. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478341 · Cited by 808
SPSS for Windows: Advanced Statistics Release 5
Norušis, M. J. (1992) · Medical Entomology and Zoology · Cited by 644
On a Heuristic Method of Test Construction and its use in Multivariate Analysis
Roy, S. (1953) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729029 · Cited by 631
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S. F., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., et al. (1998) · Review of Educational Research · doi:10.3102/00346543068003350 · Cited by 630
Self-citationComparative Robustness of Six Tests in Multivariate Analysis of Variance
Olson, C. L. (1974) · Journal of the American Statistical Association · doi:10.1080/01621459.1974.10480224 · Cited by 507
Some New Test Criteria in Multivariate Analysis
Pillai, K. C. S. (1955) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728599 · Cited by 441
A Class of Pattern-Mixture Models for Normal Incomplete Data
Little, R. J. A. (1994) · Biometrika · doi:10.1093/biomet/81.3.471 · Cited by 403
Heterogeneous Variance: Covariance Structures for Repeated Measures
Wolfinger, R. D. (1996) · Journal of Agricultural Biological and Environmental Statistics · doi:10.2307/1400366 · Cited by 398
Bias in the Analysis of Repeated-Measures Designs: Some Alternative Approaches
McCall, R. B., & Appelbaum, M. I. (1973) · Child Development · doi:10.1111/j.1467-8624.1973.tb02174.x · Cited by 393
Informative dropout in longitudinal data analysis (with discussion)
Diggle, P. J., & Kenward, M. G. (1994) · Journal of the Royal Statistical Society Series C (Applied Statistics) · Cited by 341
A Generalized T Test and Measure of Multivariate Dispersion
Hotelling, H. (1951) · University of California Press eBooks · doi:10.1525/9780520411586-004 · Cited by 335
New Designs In Analysis Of Variance
Wilcox, R. R. (1987) · Annual Review of Psychology · doi:10.1146/annurev.ps.38.020187.000333 · Cited by 267
James, G. S. (1951) · Biometrika · doi:10.1093/biomet/38.3-4.324 · Cited by 260
Editorial Policy on Analyses of Variance With Repeated Measures
Jennings, J. R. (1987) · Psychophysiology · doi:10.1111/j.1469-8986.1987.tb00320.x · Cited by 247
Johansen, S. (1980) · Biometrika · doi:10.1093/biomet/67.1.85 · Cited by 199
COMPARISON BETWEEN TREATMENTS IN A REPEATED‐MEASUREMENT DESIGN: ANOVA AND MULTIVARIATE METHODS
Rouanet, H., & Lépine, D. (1970) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1970.tb00440.x · Cited by 198
Analysis of repeated measurements
Rogan, J. C., Keselman, H. J., & Mendoza, J. L. (1979) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1979.tb00598.x · Cited by 189
Self-citationA GENERALIZATION OF FISHER'S z TEST
Lawley, D. N. (1938) · Biometrika · doi:10.1093/biomet/30.1-2.180 · Cited by 181
Repeated-Measures Analysis of Variance in Developmental Research: Selected Issues
Hertzog, C. K., & Rovine, M. J. (1985) · Child Development · doi:10.2307/1130092 · Cited by 172
A note on tests of significance in multivariate analysis
Bartlett, M. S. (1939) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s0305004100020880 · Cited by 160
Collier, R. O., Baker, F. B., Mandeville, G. K., & Hayes, T. F. (1967) · Psychometrika · doi:10.1007/bf02289596 · Cited by 147
Johansen, S. (1980) · Biometrika · doi:10.2307/2335320 · Cited by 132
Estimating sample sizes for repeated measurement designs
Overall, J. E., & Doyle, S. R. (1994) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)90015-9 · Cited by 114
Keselman, H. J., Algina, J. J., Kowalchuk, R. K., & Wolfinger, R. D. (1999) · Communication in Statistics- Theory and Methods · doi:10.1080/03610929908832460 · Cited by 96
Self-citationExploratory Repeated Measures Analysis for Two or More Groups: Review and Update
Looney, S. W., & Stanley, W. B. (1989) · The American Statistician · doi:10.1080/00031305.1989.10475662 · Cited by 85
Decisions in Single Group Repeated Measures Analysis: Statistical Tests and Three Computer Packages
Barcikowski, R. S., & Robey, R. R. (1984) · The American Statistician · doi:10.1080/00031305.1984.10483187 · Cited by 81
DeShon, R. P., & Alexander, R. A. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.3.261 · Cited by 79
Approximate degrees of freedom tests: A unified perspective on testing for mean equality.
Lix, L. M., & Keselman, H. J. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.3.547 · Cited by 79
Self-citationA comparison of recent approaches to the analysis of repeated measurements
Keselman, H. J., Algina, J. J., Kowalchuk, R. K., & Wolfinger, R. D. (1999) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711099158964 · Cited by 78
Self-citationLecoutre, B. (1991) · Journal of Educational Statistics · doi:10.3102/10769986016004371 · Cited by 72
On the Analysis of Repeated-Measurements Experiments
Danford, M. B., Hughes, H. M., & McNee, R. C. (1960) · Biometrics · doi:10.2307/2527761 · Cited by 71
Testing Repeated Measures Hypotheses When Covariance Matrices are Heterogeneous
Keselman, H. J., Carriere, K. C., & Lix, L. M. (1993) · Journal of Educational Statistics · doi:10.3102/10769986018004305 · Cited by 69
Self-citationThe analysis of repeated measurements: A quantitative research synthesis
Keselman, J. C., Lix, L. M., & Keselman, H. J. (1996) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1996.tb01089.x · Cited by 58
Self-citationA Significance Test for Multisample Sphericity
Mendoza, J. L. (1980) · Psychometrika · doi:10.1007/bf02293611 · Cited by 55
Analysing unbalanced repeated measures designs
Keselman, J. C., & Keselman, H. J. (1990) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1990.tb00940.x · Cited by 53
Self-citationQuintana, S. M., & Maxwell, S. E. (1994) · Journal of Educational Statistics · doi:10.3102/10769986019001057 · Cited by 53
Multiple comparison procedures for trimmed means.
Keselman, H. J., Lix, L. M., & Kowalchuk, R. K. (1998) · Psychological Methods · doi:10.1037//1082-989x.3.1.123 · Cited by 48
Self-citationA simulation study of estimators for rates of change in longitudinal studies with attrition
Wang-Clow, F., Lange, M., Laird, N. M., & Ware, J. H. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140307 · Cited by 47
Analysis of variance-repeated measurements.
Kogan, L. S. (1948) · Psychological Bulletin · doi:10.1037/h0063096 · Cited by 45
Keselman, H. J., Algina, J. J., Wilcox, R. R., & Kowa, R. K. (2000) · Educational and Psychological Measurement · doi:10.1177/00131640021970998 · Cited by 41
Self-citationMultiple pairwise comparisons of repeated measures means under violation of multisample sphericity.
Keselman, H. J., Keselman, J. C., & Shaffer, J. P. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.1.162 · Cited by 40
Self-citationAlgina, J. J., & Keselman, H. J. (1998) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986023002152 · Cited by 39
Self-citationType I error rates for Huynh's general approximation and improved general approximation tests
Algina, J. J., & Oshima, T. C. (1994) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1994.tb01029.x · Cited by 37
Self-citationThe analysis of repeated measurements: Univariate tests, multivariate tests, or both?
Keselman, H. J., Keselman, J. C., & Lix, L. M. (1995) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1995.tb01066.x · Cited by 34
Self-citationAn improved general approximation test for the main effect in a split‐plot design
Algina, J. J., & Oshima, T. C. (1995) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1995.tb01055.x · Cited by 33
Self-citationSome Alternative Approximate Tests for a Split Plot Design
Algina, J. J. (1994) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2904_3 · Cited by 32
Self-citationComparing Repeated Measures Means in Factorial Designs
Keselman, H. J., & Keselman, J. C. (1988) · Psychophysiology · doi:10.1111/j.1469-8986.1988.tb01898.x · Cited by 30
Self-citationAlgina, J. J., & Keselman, H. J. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3203_2 · Cited by 25
Self-citationRepeated Measures Analysis Using Mixed Models: Some Simulation Results
Wright, S. P., & Wolfinger, R. D. (1997) · Lecture notes in statistics · doi:10.1007/978-1-4612-0699-6_13 · Cited by 24
Interaction contrasts in repeated measures designs
Lix, L. M., & Keselman, H. J. (1996) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1996.tb01079.x · Cited by 21
Self-citationCorrecting for Heterogeneity of Covariance for Repeated Measures Designs of the Analysis of Variance
Stoloff, P. H. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000411 · Cited by 20
Keselman, H. J., Kowalchuk, R. K., & Boik, R. J. (2000) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711000159178 · Cited by 18
Self-citationAlgina, J. J. (1997) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1997.tb01144.x · Cited by 17
Self-citationRobust Tests of Repeated Measures Means in Educational and Psychological Research
Keselman, H. J., Rogan, J. C., & Games, P. A. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100115 · Cited by 13
Self-citationAnalysis of Repeated Measures Under Second-Stage Sphericity: An Empirical Bayes Approach
Boik, R. J. (1997) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986022002155 · Cited by 9
Cited by
Sorted by citations
Savard, J., Simard, S., Ivers, H., & Morin, C. M. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2005.09.548 · Cited by 507
What You See Is What You Get? Enhancing Methodological Transparency in Management Research
Aguinis, H., Ramani, R. S., & Alabduljader, N. (2017) · Academy of Management Annals · doi:10.5465/annals.2016.0011 · Cited by 517
Linear mixed-effects modeling approach to FMRI group analysis
Chen, G., Saad, Z. S., Britton, J. C., Pine, D. S., & Cox, R. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.01.047 · Cited by 440
Color and emotion: effects of hue, saturation, and brightness
Wilms, L., & Oberfeld, D. (2017) · Psychological Research · doi:10.1007/s00426-017-0880-8 · Cited by 452
An introduction to multiplicity issues in clinical trials: the what, why, when and how
Li, G., Taljaard, M., Van den Heuvel, E. R., Levine, M. A., Cook, D. J., Wells, G. A., Devereaux, P. J., & Thabane, L. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw320 · Cited by 381
Metadata
- Authors
- Keselman, H. J., Algina, J., & Kowalchuk, R. K.
- Affiliations
- University of Manitoba (CA)
- University of Florida (US)
- Corresponding author
- Keselman, H. J.
- ORCID
- Algina, James
- Venue
- British Journal of Mathematical and Statistical Psychology
- Publisher
- Wiley
- Published
- 2001-05
- Volume
- 54
- Issue
- 1
- Pages
- 1-20
- ISSN
- 0007-1102 (ISSN-L)
- 2044-8317
- OpenAlex
- W2125118056
- Cited by
- 306
- References
- 76
- Citations by year
- 2026: 16 · 2025: 18 · 2024: 20 · 2023: 14 · 2022: 8 · 2021: 12 · 2020: 6 · 2019: 6 · 2018: 10 · 2017: 9 · 2016: 13 · 2015: 13 · 2014: 16 · 2013: 18 · 2012: 15
- FWCI
- 12.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- British Journal of Mathematical and Statistical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Life Sciences › Agricultural and Biological Sciences › Agronomy and Crop Science › Agriculture, Soil, Plant Science
- Keywords
- repeated measures ANOVA, multivariate analysis of variance, univariate analysis, missing data, linear contrasts, statistical reporting
- MeSH terms
- Analysis of Variance, Data Interpretation, Statistical, Humans, Probability, Psychometrics, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
