The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
A Note on Misconceptions Concerning Prospective and Retrospective Power
Abstract
This paper addresses some misconceptions concerning prospective and retrospective power when journal editors, reviewers and readers want to know the observed power of statistical tests within a completed study. In addition, a practical solution to both the problem of computing the power after a study has been conducted and the critical evaluation of null findings is suggested
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Retrospective power analyses are based on the highly questionable assumption that the sample effect size is essentially identical to the effect size in the population from which it was drawn (Zumbo & Hubley, 1998).”
From G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences (2007) · cites this paper as Zumbo & Hubley, 1998
Citations
Cites
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Goodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 658
A Handbook for data analysis in the behavioral sciences: methodological issues
(1993) · Choice Reviews Online · doi:10.5860/choice.31-0602 · Cited by 544
Jacques Bernoulli'sArt of Conjecturing
Hacking, I. (1971) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/22.3.209 · Cited by 77
Cited by
Sorted by citations
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Ellis, P. D. (2010) · doi:10.1017/cbo9780511761676 · Cited by 2,461
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
A Practical Primer To Power Analysis for Simple Experimental Designs
Perugini, M., Gallucci, M., & Costantini, G. (2018) · International Review of Social Psychology · doi:10.5334/irsp.181 · Cited by 482
Lan, L., & Lian, Z. (2009) · Building and Environment · doi:10.1016/j.buildenv.2009.11.002 · Cited by 359
O’Keefe, D. J. (2007) · Communication Methods and Measures · doi:10.1080/19312450701641375 · Cited by 249
Radhakrishnan, J., Moutzouris, D.-A., Ginzler, E. M., Solomons, N., Siempos, I. Ι., & Appel, G. B. (2009) · Kidney International · doi:10.1038/ki.2009.412 · Cited by 206
Bowen, L., Gross, A. S., Gimpel, M., Bruce‐Low, S., & Li, F.-X. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-099422 · Cited by 188
Turner, J., Nicholl, Webber, Cox, Dixon, S., & Yates (2000) · Health Technology Assessment · doi:10.3310/hta4310 · Cited by 160
Understanding statistical power in the context of applied research
Baguley, T. S. (2004) · Applied Ergonomics · doi:10.1016/j.apergo.2004.01.002 · Cited by 148
Simplifying effort estimation based on Use Case Points
Ochodek, M., Nawrocki, J. R., & Kwarciak, K. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.10.005 · Cited by 145
Interpersonal pathoplasticity in individuals with generalized anxiety disorder
Przeworski, A., Newman, M. G., Pincus, A. L., Kasoff, M. B., Yamasaki, A. S., Castonguay, L. G., & Berlin, K. S. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0023334 · Cited by 135
Sleep quality, cortisol levels, and behavioral regulation in toddlers
Scher, A., Hall, W. A., Zaidman‐Zait, A., & Weinberg, J. (2009) · Developmental Psychobiology · doi:10.1002/dev.20410 · Cited by 125
Hubley, A. M., & Russell, L. B. (2009) · International Journal of Behavioral Development · doi:10.1177/0165025408099486 · Cited by 114
Self-citationRequired sample size and nonreplicability thresholds for heterogeneous genetic associations
Moonesinghe, R., Khoury, M. J., Liu, T., & Ioannidis, J. P. A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705554105 · Cited by 107
McCall, A., Dupont, G., & Ekstrand, J. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098473 · Cited by 97
Post hoc power is not informative
Heinsberg, L. W., & Weeks, D. E. (2022) · Genetic Epidemiology · doi:10.1002/gepi.22464 · Cited by 94
Rusticus, S. A., Hubley, A. M., & Zumbo, B. D. (2008) · Assessment · doi:10.1177/1073191107306805 · Cited by 80
Self-citationFernandes-Taylor, S., Hyun, J. K., Reeder, R. N., & Harris, A. H. (2011) · BMC Research Notes · doi:10.1186/1756-0500-4-304 · Cited by 75
Kennealey, P. T., Elias, N., Hertl, M., Ko, D. S. C., Saidi, R. F., Markmann, J. F., Smoot, E. E., Schoenfeld, D., & Kawai, T. (2011) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2011.02.008 · Cited by 75
The test-takers' choice: an investigation of the effect of topic on language-test performance
Jennings, M., Fox, J. D., Graves, B., & Shohamy, E. (1999) · Language Testing · doi:10.1177/026553229901600402 · Cited by 74
Juvenile rheumatoid arthritis affected sibpairs: Extent of clinical phenotype concordance
Moroldo, M. B., Chaudhari, M., Shear, E. S., Thompson, S. D., Glass, D. N., & Giannini, E. H. (2004) · Arthritis & Rheumatism · doi:10.1002/art.20292 · Cited by 73
Investigating the Intra-Individual Variability and Trajectories of Subjective Well-being
Gadermann, A., & Zumbo, B. D. (2006) · Social Indicators Research · doi:10.1007/s11205-006-0015-x · Cited by 57
Self-citationRusticus, S. A., & Hubley, A. M. (2006) · Sex Roles · doi:10.1007/s11199-006-9135-7 · Cited by 52
Self-citationHarris, A. H. S., Reeder, R. N., & Hyun, J. K. (2009) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2009.04.007 · Cited by 50
Pocewicz, A., Gessler, P. E., & Robinson, A. P. (2004) · Canadian Journal of Forest Research · doi:10.1139/x03-215 · Cited by 51
Constructive Criticisms of Methodological and Editorial Practices
Knapp, T. R., & Sawilowsky, S. S. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599498 · Cited by 47
Höllig, A., Weinandy, A., Liu, J., Clusmann, H., Rossaint, R., & Coburn, M. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001561 · Cited by 43
Hubley, A. M., & Jassal, S. (2006) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390500434441 · Cited by 43
Self-citationConditional equivalence testing: An alternative remedy for publication bias
Campbell, H., & Gustafson, P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195145 · Cited by 42
Abbs, B., Gupta, P., & Khetarpal, N. (2008) · Applied Psycholinguistics · doi:10.1017/s0142716408080272 · Cited by 38
Mair, M. M., Kattwinkel, M., Jakoby, O., & Hartig, F. (2020) · Environmental Toxicology and Chemistry · doi:10.1002/etc.4847 · Cited by 34
Phubbed and curious: The relation between partner phubbing and electronic partner surveillance
Schokkenbroek, J., Hardyns, W., & Ponnet, K. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107425 · Cited by 31
Sun, S., Pan, W., & Wang, L. L. (2011) · Methodology · doi:10.1027/1614-2241/a000025 · Cited by 32
Assessing the Reliability of Ecological Monitoring Data: Power Analysis and Alternative Approaches
Morrison, L. W. (2007) · Natural Areas Journal · doi:10.3375/0885-8608(2007)27[83:atroem]2.0.co;2 · Cited by 31
Brown, T. P., Holmes, P., & Harrison, P. T. C. (2010) · Indoor and Built Environment · doi:10.1177/1420326x09342683 · Cited by 30
Power analysis software for educational researchers
Peng, C.-Y. J., Long, H., & Abaci, S. (2012) · The Journal of Experimental Education · doi:10.1080/00220973.2011.647115 · Cited by 59
Outcome of the Pesticides Peer Review Meeting on general recurring issues in ecotoxicology
Authority, E. F. S., Arena, M., Auteri, D., Barmaz, S., Chaideftou, E., Čtveráčková, L., Lentdecker, C. D., Ippolito, A., Kardassi, D., Lythgo, C., et al. (2019) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2019.en-1673 · Cited by 27
Power Approximations for Overall Average Effects in Meta-Analysis With Dependent Effect Sizes
Vembye, M. H., Pustejovsky, J. E., & Pigott, T. (2022) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986221127379 · Cited by 28
Hawkins, R. P. (2005) · Human Communication Research · doi:10.1093/hcr/31.1.162 · Cited by 25
What Produces Television Attention and Attention Style?.
Hawkins, R. P., Pingree, S., Hitchon, J. C. B., Radler, B., Gorham, B. W., Kahlor, L. A., Gilligan, E., Serlin, R. C., Schmidt, T., Kannaovakun, P., et al. (2005) · Human Communication Research · doi:10.1111/j.1468-2958.2005.tb00868.x · Cited by 25
Polymorphism of the ACE gene in Henoch-Schönlein purpura nephritis
Dudley, J., Afifi, E. N. E. D., Gardner, A., Tizard, E. J., & McGraw, M. E. (2000) · Pediatric Nephrology · doi:10.1007/s004670050045 · Cited by 23
Moreno-Pérez, V., Paredes, V., Pastor, D., Nevado-Garrosa, F., Vielcazat, S., Coso, J. D., & Méndez-Villanueva, A. (2021) · Biology of Sport · doi:10.5114/biolsport.2021.100360 · Cited by 21
Outcome of the pesticides peer review meeting on general recurring issues in ecotoxicology
Authority, E. F. S. (2015) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2015.en-924 · Cited by 21
Saito, T. I., Motoki, K., Nouchi, R., Kawashima, R., & Sugiura, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02967 · Cited by 24
Sabiston, C. M., Rusticus, S. A., Brunet, J., McDonough, M. H., Hadd, V., Hubley, A. M., & Crocker, P. R. E. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9680-y · Cited by 24
Self-citationThe self-fulfilling prophecy of post-hoc power calculations
Christogiannis, C., Nikolakopoulos, S., Pandis, N., & Mavridis, D. (2022) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2021.10.008 · Cited by 20
Curriculum-based measurement in reading: A comparison of similar versus challenging material.
Dunn, E. K., & Eckert, T. L. (2002) · School Psychology Quarterly · doi:10.1521/scpq.17.1.24.19904 · Cited by 19
Why it is nonsensical to use retrospective power analyses to conduct a postmortem on your study
Jiroutek, M. R., & Turner, J. R. (2017) · Journal of Clinical Hypertension · doi:10.1111/jch.13173 · Cited by 19
Filter, K. J., Sytsma, M. R., & McIntosh, K. (2016) · Assessment for Effective Intervention · doi:10.1177/1534508416642212 · Cited by 17
Comments on the Statistical Significance Testing Articles
Knapp, T. R. (1998) · Research in the schools · Cited by 17
Advantages of Computer Programs over Power Charts for the Estimation of Power
Gatti, G., & Harwell, M. R. (1998) · Journal of Statistics Education · doi:10.1080/10691898.1998.11910620 · Cited by 17
Neal, K., Williams, J. R., Alfayyadh, A., Capin, J. J., Khandha, A., MANAL, K. T., Snyder‐Mackler, L., & Buchanan, T. S. (2022) · Journal of Orthopaedic Research® · doi:10.1002/jor.25250 · Cited by 16
HAZOP-based identification of events in use cases
Jurkiewicz, J., Nawrocki, J. R., Ochodek, M., & Głowacki, T. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9277-5 · Cited by 16
Peariso, J. F. (2011) · ProQuest LLC eBooks · Cited by 16
Is Market Orientation Affected by the Size and Diversity of Customer Networks?
Ellis, P. D. (2010) · Management International Review · doi:10.1007/s11575-010-0037-0 · Cited by 15
Anderson, T. K., & Sukhdeo, M. V. K. (2013) · Journal of Parasitology · doi:10.1645/ge-2940.1 · Cited by 15
The power of meta-analysis: a challenge for evidence-based medicine
Berchialla, P., Chiffi, D., Valente, G., & Voutilainen, A. (2020) · European Journal for Philosophy of Science · doi:10.1007/s13194-020-00321-w · Cited by 15
Beyond Compliance: Mother–Child Joint Action During a “Do” Task
Zaidman‐Zait, A., Marshall, S. K., Young, R. A., & Hertzman, C. (2013) · Journal of Child and Family Studies · doi:10.1007/s10826-013-9760-z · Cited by 14
Pardo‐Seco, J., Amigo, J., González–Manteiga, W., & Salas, A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073567 · Cited by 13
When lack of control enhances closeness to others: The case of unemployment and economic threat
Bukowski, M., de Lemus, S., Rodríguez‐Bailón, R., Willis, G. B., & Alburquerque, A. (2018) · European Journal of Social Psychology · doi:10.1002/ejsp.2563 · Cited by 13
Papavero, E. M. (2009) · ProQuest Demo Repository · Cited by 13
Barile, F., Ruffilli, A., Fiore, M., Manzetti, M., Geraci, G., Viroli, G., & Faldini, C. (2022) · The International Journal of Spine Surgery · doi:10.14444/8302 · Cited by 12
Using Alternate Forms of the Multidimensional Health Locus of Control Scale: Caveat Emptor
Hubley, A. M., & Wagner, S. L. (2003) · Social Indicators Research · doi:10.1023/a:1025809921592 · Cited by 12
Self-citationFalagas, M. E., Kouranos, V., Michalopoulos, A. S., Rodopoulou, S., Athanasoulia, A. P., & Karageorgopoulos, D. E. (2010) · Clinical Infectious Diseases · doi:10.1086/649929 · Cited by 12
RETR_PWR: An SAS macro for retrospective statistical power analysis
Hogarty, K. Y., & Kromrey, J. D. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195537 · Cited by 12
To treat or not to treat: new evidence for the effectiveness of manual therapy
Sran, M. M. (2004) · British Journal of Sports Medicine · doi:10.1136/bjsm.2003.010876 · Cited by 12
Ten Statistics Commandments That Almost Never Should Be Broken
Knapp, T. R., & Brown, J. K. (2014) · Research in Nursing & Health · doi:10.1002/nur.21605 · Cited by 11
Performance and Management Independence in the ERP Implementations in Spain: A Dynamic View
de Lorca, P. T., & Suárez, J. D. A. (2011) · Information Systems Management · doi:10.1080/10580530.2011.562131 · Cited by 10
Lloyd, J. E. V., & Zumbo, B. D. (2007) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1193889960 · Cited by 10
Self-citationInappropriate use of statistical power
Fraser, R. A. (2023) · Bone Marrow Transplantation · doi:10.1038/s41409-023-01935-3 · Cited by 10
Kwak, H. J., Min, S. K., Yi, I.-K., Chang, Y. J., & Kim, J. Y. (2011) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2011.61.2.133 · Cited by 9
Retrospective Statistical Power: Fallacies and Recommendations
Wang, L. (2010) · Newborn and Infant Nursing Reviews · doi:10.1053/j.nainr.2009.12.012 · Cited by 9
Wallace, D. K., & Melia, M. (2008) · Ophthalmology · doi:10.1016/j.ophtha.2008.06.005 · Cited by 8
Check-In/Check-Out (CICO) in High School: Results From a Small Randomized Controlled Trial
Flannery, K. B., Kato, M. M., Kittelman, A., Sampson, N. K., & McIntosh, K. (2024) · Behavioral Disorders · doi:10.1177/01987429231225461 · Cited by 7
Schimit, P. H. T., Pereira, F. H., & Broom, M. (2022) · Ecological Complexity · doi:10.1016/j.ecocom.2022.101017 · Cited by 7
Jones, R. H., Beber, S. A., Albright, J. C., Bowen, M. A., Edmonds, E. W., Ellington, M. D., Heyworth, B. E., Joughin, E., Latz, K. H., McKay, S. D., et al. (2024) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2024.08.050 · Cited by 7
On some end-user programming constructs and their understandability
Maćkowiak, M., Nawrocki, J. R., & Ochodek, M. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.03.064 · Cited by 6
Lawrence, M. D., Ormsby, R. J., Blyth, B. J., Bezak, E., England, G. M., Newman, M. R., Tilley, W. D., & Sykes, P. J. (2013) · Radiation Research · doi:10.1667/rr3381.2 · Cited by 5
Need for closure and compensatory rule‐based perception: The role of information consistency
Dragon, P., & Kossowska, M. (2018) · European Journal of Social Psychology · doi:10.1002/ejsp.2512 · Cited by 4
Exact sample sizes needed to detect dependence in 2×3 tables
Sánchez, M. S., Basten, C., Ferrenberg, A. M., Asmussen, M. A., & Arnold, J. (2005) · Theoretical Population Biology · doi:10.1016/j.tpb.2005.11.001 · Cited by 4
Teste de hipóteses: perguntas que você sempre quis fazer, mas nunca teve coragem
Hirakata, V. N., Mancuso, A. C. B., & Castro, S. M. D. J. (2019) · Clinical & Biomedical Research · doi:10.4322/2357-9730.93649 · Cited by 3
Testing Homogeneity of VariancePreprint
Wright, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2953900 · Cited by 3
Hypothermia as therapy in cerebral injury
Moran, J. L., & Peake, S. (2002) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)00777-9 · Cited by 3
Atenafu, E. G., Hamid, J. S., Stephens, D., To, T. M., & Beyene, J. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2008.11.005 · Cited by 2
Rami, M. K. (2014) · UND Scholarly Commons (University of North Dakota) · Cited by 2
Power Analysis for the Mean Effect Size
Pigott, T. (2011) · Springer eBooks · doi:10.1007/978-1-4614-2278-5_4 · Cited by 2
Some Remarks of Type III Error for Directional Two-Tailed Test
Trzpiot, G. (2015) · Studia Ekonomiczne / Uniwersytet Ekonomiczny w Katowicach · Cited by 2
Dahlstrom, A. (2012) · UTAS Research Repository · doi:10.25959/23206037 · Cited by 2
Simon, S. D. (2001) · Journal of Andrology · doi:10.1002/j.1939-4640.2001.tb02147.x · Cited by 2
Lenth, R. V. (2001) · Cited by 2
A Response to Some Criticisms of Post Hoc Power
Carle, A. C. (2020) · Journal of Surgical Research · doi:10.1016/j.jss.2020.09.011 · Cited by 2
Hofer, F., Wetter, O. E., Guo, Y., & Schwaninger, A. (2009) · IEEE International Carnahan Conference on Security Technology (ICCST) · doi:10.1109/ccst.2009.5335566 · Cited by 1
Selective digestive decontamination: once again
Moran, J. L., & Solomon, P. J. (2003) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)00856-6 · Cited by 1
Sawilowsky, S. S. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-578-320251017 · Cited by 1
Eating psychopathology and cognitive functioning
Tatsi, E. (2013) · CLOK (University of Central Lancashire)
Mends-Cole, S. J. (2008) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1209615120
Brief Review of Hypothesis Testing Concepts/Issues and Confidence Intervals
Ryan, T. P. (2013) · Wiley series in probability and statistics · doi:10.1002/9781118439241.ch1
Lokshin, I. M. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2555496
Metadata
- Authors
- Zumbo, B. D., & Hubley, A. M.
- Affiliations
- University of Northern British Columbia (CA)
- Venue
- Journal of the Royal Statistical Society: Series D (The Statistician)
- Publisher
- Wiley
- Published
- 1998-07
- Volume
- 47
- Issue
- 2
- Pages
- 385-388
- ISSN
- 0039-0526 (ISSN-L)
- 1467-9884
- OpenAlex
- W2011427590
- Cited by
- 121
- References
- 4
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 1 · 2022: 8 · 2021: 1 · 2020: 4 · 2019: 4 · 2018: 6 · 2017: 3 · 2016: 2 · 2015: 4 · 2014: 2 · 2013: 8 · 2012: 4
- FWCI
- 7.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the Royal Statistical Society Series D (The Statistician) (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- statistical power, negative results, null hypothesis significance testing, statistical misconceptions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review