Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs.
Abstract
The editorial policies of several prominent educational and psychological journals require that researchers report some measure of effect size along with tests for statistical significance. In analysis of variance contexts, this requirement might be met by using eta squared or omega squared statistics. Current procedures for computing these measures of effect often do not consider the effect that design features of the study have on the size of these statistics. Because research-design features can have a large effect on the estimated proportion of explained variance, the use of partial eta or omega squared can be misleading. The present article provides formulas for computing generalized eta and omega squared statistics, which provide estimates of effect size that are comparable across a variety of research designs.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The omega squared statistic used to quantify variance explained by spike rate is unbiased.
“We quantified the amount of variance in the task (sample identity) that could be explained by the spike rate of neurons using an unbiased statistic called the omega squared (76).”
From Layer and rhythm specificity for predictive routing (2020) · cites this paper as [76]
The effect sizes observed in this study indicate that the intervention produced meaningful educational benefits.
“Importantly, the effect sizes observed in this study indicate that the intervention produced meaningful educational benefits [21].”
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,600 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,415 · see citing works
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,414 · see citing works
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539 · see citing works
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,857 · see citing works
Experimental Design: Procedures for the Behavioral Sciences.
Addelman, S., & Kirk, R. E. (1969) · Journal of the American Statistical Association · doi:10.2307/2283497 · Cited by 5,241 · see citing works
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,896 · see citing works
Searle, S. R., & Searle, S. R. (1971) · Cited by 3,229 · see citing works
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791 · see citing works
Designing Experiments and Analyzing Data: A Model Comparison Perspective
Maxwell, S., & Delaney, H. D. (1990) · Journal of the American Statistical Association · doi:10.2307/2289744 · Cited by 2,593 · see citing works
Book Review: Design and Analysis: A Researcher's Handbook
Aaker, D. A., & Keppel, G. (1976) · Journal of Marketing Research · doi:10.2307/3150757 · Cited by 2,033 · see citing works
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,887 · see citing works
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · see citing works
Meta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693 · see citing works
Eta-squared and partial eta-squared in fixed factor anova designs
Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300111 · Cited by 1,333 · see citing works
Designing Experiments and Analysing Data: A Model Comparison Perspective.
Freeman, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Biometrics · doi:10.2307/2532173 · Cited by 1,229 · see citing works
Everitt, B. J. (2001) · Psychology Press eBooks · doi:10.4324/9781410605542 · Cited by 1,055 · see citing works
Designing Experiments and Analyzing Data: A Model Comparison Perspective, Third Edition
Maxwell, S. E., & Delaney, H. D. (1999) · Medical Entomology and Zoology · Cited by 975 · see citing works
Experimental design: Procedures for the behavioral sciences (3rd ed.).
Kirk, R. E. (1995) · Cited by 788 · see citing works
Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations
Olejnik, S. F., & Algina, J. J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.2000.1040 · Cited by 703 · see citing works
Self-citationStatistical procedures and their mathematical bases.
Peters, C. C., & Voorhis, W. R. V. (1940) · McGraw-Hill Book Company · doi:10.1037/13596-000 · Cited by 623 · see citing works
Statistics; probability, inference, and decision
Hays, W. L., & Winkler, R. L. (1975) · Medical Entomology and Zoology · Cited by 548 · see citing works
Intermediate Statistics: A Modern Approach
Franklin, C., & Stevens, J. L. (2000) · The American Statistician · doi:10.2307/2685595 · Cited by 494 · see citing works
The Analysis of Multiple Classifications with Unequal Numbers in the Different Classes
Yates, F. (1934) · Journal of the American Statistical Association · doi:10.1080/01621459.1934.10502686 · Cited by 354 · see citing works
Effect-Size Estimates: Issues and Problems in Interpretation
Fern, E. F., & Monroe, K. B. (1996) · Journal of Consumer Research · doi:10.1086/209469 · Cited by 301 · see citing works
Beyond tests of significance: Estimating strength of effects in selected ANOVA designs.
Vaughan, G. M., & Corballis, M. C. (1969) · Psychological Bulletin · doi:10.1037/h0027878 · Cited by 226 · see citing works
Measures of explained variance: Cautions and limitations.
O’Grady, K. E. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.766 · Cited by 195 · see citing works
The consequence of ignoring a nested factor on measures of effect size in analysis of variance.
Wampold, B. E., & Serlin, R. C. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.4.425 · Cited by 186 · see citing works
Computational procedures for estimating magnitude of effect for some analysis of variance designs.
Dodd, D. H., & Schultz, R. F. (1973) · Psychological Bulletin · doi:10.1037/h0034347 · Cited by 158 · see citing works
Measures of strength of association: A comparative examination.
Maxwell, S. E., Camp, C. J., & Arvey, R. D. (1981) · Journal of Applied Psychology · doi:10.1037/0021-9010.66.5.525 · Cited by 125 · see citing works
Richardson, J. T. E. (1996) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03203631 · Cited by 103 · see citing works
The Analysis of Multiple Classifications with Unequal Numbers in the Different Classes
Yates, F. (1934) · Journal of the American Statistical Association · doi:10.2307/2278459 · Cited by 98 · see citing works
Estimating the magnitude of experimental effects.
Fleiss, J. L. (1969) · Psychological Bulletin · doi:10.1037/h0028022 · Cited by 84 · see citing works
Pituch, K. A., Whittaker, T. A., Stevens, J. P., et al. (1999) · Routledge eBooks · doi:10.4324/9781410601643 · Cited by 84 · see citing works
Sampling Characteristics of Kelley's ε and Hays' ω
Carroll, R. M., & Nordholm, L. A. (1975) · Educational and Psychological Measurement · doi:10.1177/001316447503500304 · Cited by 83 · see citing works
Partial Omega Squared for Anova Designs
Keren, G. B., & Lewis, C. (1979) · Educational and Psychological Measurement · doi:10.1177/001316447903900116 · Cited by 74 · see citing works
Analysis of variance and the magnitude of effects: A general approach.
Dwyer, J. H. (1974) · Psychological Bulletin · doi:10.1037/h0036937 · Cited by 68 · see citing works
Keselman, H. J. (1975) · Canadian Psychological Review/Psychologie canadienne · doi:10.1037/h0081789 · Cited by 46 · see citing works
Correcting effect sizes computed from factor analysis of variance for use in meta-analysis.
Morris, S. B., & DeShon, R. P. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.192 · Cited by 37 · see citing works
Halderson, J. S., & Glasnapp, D. R. (1972) · American Educational Research Journal · doi:10.3102/00028312009002301 · Cited by 27 · see citing works
Practical Formulas of Strength of Association Measures
Charter, R. A. (1982) · Educational and Psychological Measurement · doi:10.1177/001316448204200404 · Cited by 6 · see citing works
Halderson, J. S., & Glasnapp, D. R. (1972) · American Educational Research Journal · doi:10.2307/1161690 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303 · see citing works
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199 · see citing works
An effect size primer: A guide for clinicians and researchers.
Ferguson, C. J. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0015808 · Cited by 3,467 · see citing works
A systematic review of systematic review process research in software engineering
Kitchenham, B., & Brereton, P. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.07.010 · Cited by 1,094 · see citing works
Feingold, A. (2009) · Psychological Methods · doi:10.1037/a0014699 · Cited by 851 · see citing works
Gamma and Beta Bursts Underlie Working Memory
Lundqvist, M., Rose, J., Herman, P., Brincat, S. L., Buschman, T. J., & Miller, E. K. (2016) · Neuron · doi:10.1016/j.neuron.2016.02.028 · Cited by 846 · see citing works
Schäfer, T., & Schwarz, M. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00813 · Cited by 774 · see citing works
Standardized or simple effect size: what should be reported?
Baguley, T. (2009) · British Journal of Psychology · doi:10.1348/000712608x377117 · Cited by 619 · see citing works
Long-Term Outcomes of Early Intervention in 6-Year-Old Children With Autism Spectrum Disorder
Estes, A., Munson, J., Rogers, S. J., Greenson, J., Winter, J., & Dawson, G. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2015.04.005 · Cited by 540 · see citing works
Using transcranial direct-current stimulation to treat stroke patients with aphasia
Baker, J. M., Rorden, C., & Fridriksson, J. (2010) · Stroke · doi:10.1161/strokeaha.109.576785 · Cited by 516 · see citing works
The development of symbol-infused joint engagement
Adamson, L. B., Bakeman, R., & Deckner, D. F. (2004) · Child Development · doi:10.1111/j.1467-8624.2004.00732.x · Cited by 370 · see citing works
Gamma and beta bursts during working memory readout suggest roles in its volitional control
Lundqvist, M., Herman, P., Warden, M. R., Brincat, S. L., & Miller, E. K. (2018) · Nature Communications · doi:10.1038/s41467-017-02791-8 · Cited by 299 · see citing works
Layer and rhythm specificity for predictive routing
Bastos, A. M., Lundqvist, M., Waite, A. S., Kopell, N., & Miller, E. K. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2014868117 · Cited by 268 · see citing works
The processes of cognitive behavioral therapy: A review of meta-analyses
Kazantzis, N., Luong, H. K., Usatoff, A. S., Impala, T., Yew, R. Y., & Hofmann, S. G. (2018) · Cognitive Therapy and Research · doi:10.1007/s10608-018-9920-y · Cited by 218 · see citing works
Sleep inertia, sleep homeostatic and circadian influences on higher‐order cognitive functions
Burke, T. M., Scheer, F. A. J. L., Ronda, J. M., Czeisler, C. A., & Wright, K. P. (2015) · Journal of Sleep Research · doi:10.1111/jsr.12291 · Cited by 173 · see citing works
Representation of retrieval confidence by single neurons in the human medial temporal lobe
Rutishauser, U., Ye, S., Koroma, M., Tudusciuc, O., Ross, I. B., Chung, J. M., & Mamelak, A. N. (2015) · Nature Neuroscience · doi:10.1038/nn.4041 · Cited by 147 · see citing works
Mordkoff, J. T. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919855053 · Cited by 122 · see citing works
The primate amygdala combines information about space and value
Peck, C. J., Lau, B., & Salzman, C. D. (2013) · Nature Neuroscience · doi:10.1038/nn.3328 · Cited by 115 · see citing works
Vahey, N. A., Nicholson, E., & Barnes-Holmes, D. (2015) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2015.01.004 · Cited by 92 · see citing works
Waxmonsky, J. G., Waschbusch, D. A., Belin, P., Li, T., Babocsai, L., Humphery, H., Pariseau, M. E., Babinski, D. E., Hoffman, M. T., Haak, J. L., et al. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2015.12.011 · Cited by 87 · see citing works
Guidelines for Meta-Analyses of Counseling Psychology Research
Quintana, S. M., & Minami, T. (2006) · The Counseling Psychologist · doi:10.1177/0011000006286991 · Cited by 83 · see citing works
Preservation and Changes in Oscillatory Dynamics across the Cortical Hierarchy
Lundqvist, M., Bastos, A. M., & Miller, E. K. (2020) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01600 · Cited by 58 · see citing works
Sokka, L., Leinikka, M., Korpela, J., Henelius, A., Ahonen, L., Alain, C., Alho, K., & Huotilainen, M. (2016) · Biological Psychology · doi:10.1016/j.biopsycho.2016.02.010 · Cited by 46 · see citing works
Reaven, J., Moody, E. J., Grofer Klinger, L., Keefer, A., Duncan, A., O'Kelley, S., Meyer, A., Hepburn, S., & Blakeley-Smith, A. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000285 · Cited by 35 · see citing works
Fostering Revision of Argumentative Writing through Structured Peer Assessment
Tsai, Y.-C., & Chuang, M.-T. (2013) · Perceptual and Motor Skills · doi:10.2466/10.23.pms.116.1.210-221 · Cited by 36 · see citing works
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. (2022) · doi:10.31219/osf.io/xhe3u · Cited by 36 · see citing works
Skeletal Response to Soluble Activin Receptor Type IIB in Mouse Models of Osteogenesis Imperfecta
Jeong, Y., Daghlas, S. A., Xie, Y., Hulbert, M. A., Pfeiffer, F. M., Dallas, M. R., Omosule, C. L., Pearsall, R. S., Dallas, S. L., & Phillips, C. L. (2018) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.3473 · Cited by 36 · see citing works
Bachman, P., Niendam, T. A., Jalbrzikowkski, M., Park, C. Y., Daley, M., Cannon, T. D., & Bearden, C. E. (2012) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-011-9592-5 · Cited by 33 · see citing works
Bracht, T., Walther, S., Breit, S., Mertse, N., Federspiel, A., Meyer, A., Soravia, L. M., Wiest, R., & Denier, N. (2023) · Translational Psychiatry · doi:10.1038/s41398-022-02304-2 · Cited by 25 · see citing works
Murray-Swank, A., Goldberg, R., Dickerson, F., Medoff, D., Wohlheiter, K., & Dixon, L. (2007) · Journal of Nervous & Mental Disease · doi:10.1097/01.nmd.0000253801.18367.a5 · Cited by 21 · see citing works
Tarrasch, R., & Berger, R. (2022) · Mindfulness · doi:10.1007/s12671-022-01955-y · Cited by 13 · see citing works
Barbosa, A. B., Mosley, B. A., Galvão, H. M., & Domingues, R. B. (2023) · Microorganisms · doi:10.3390/microorganisms11102559 · Cited by 2 · see citing works
Zhao, C., Zhu, J., Liu, J., Zhao, W., & Pang, Y. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09469-0 · Cited by 1 · see citing works
“Importantly, the effect sizes observed in this study indicate that the intervention produced meaningful educational benefits [21].”
- Authors
- Olejnik, S., & Algina, J.
- Affiliations
- University of Georgia (US)
- University of Florida (US)
- ORCID
- Algina, James
- Venue
- Psychological Methods
- Published
- 2003
- Volume
- 8
- Issue
- 4
- Pages
- 434-447
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2133084664
- Cited by
- 1,622
- References
- 42
- Citations by year
- 2026: 102 · 2025: 119 · 2024: 117 · 2023: 91 · 2022: 114 · 2021: 121 · 2020: 131 · 2019: 104 · 2018: 115 · 2017: 84 · 2016: 96 · 2015: 82 · 2014: 62 · 2013: 54 · 2012: 43
- FWCI
- 12.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- effect size, partial eta squared, analysis of variance, explained variance, research design
- MeSH terms
- Analysis of Variance, Humans, Psychology, Educational, Psychology, Experimental, Psychometrics, Research Design, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
