The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Multiple Testing and Statistical Power with Modified Bonferroni Procedures
Abstract
The difference in statistical power between the original Bonferroni and five modified Bonferroni procedures that control the overall Type I error rate is examined in the context of a correlation matrix where multiple null hypotheses, H 0 : ρ ij = 0 for all i ≠ j, are tested. Using 50 real correlation matrices reported in educational and psychological journals, a difference in the number of hypotheses rejected of less than 4% was observed among the procedures. When simulated data were used, very small differences were found among the six procedures in detecting at least one true relationship, but in detecting all true relationships the power of the modified Bonferroni procedures exceeded that of the original Bonferroni procedure by at least .18 and by as much as .55 when all null hypotheses were false. The power difference decreased as the number of true relationships decreased. Power differences obtained for the average power were of a much smaller magnitude but still favored the modified Bonferroni procedures. For the five modified Bonferroni procedures, power differences less than .05 were typically observed; the Holm procedure had the lowest power, and the Rom procedure had the highest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
More powerful procedures for multiple significance testing
Hochberg, Y., & Benjamini, Y. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090710 · Cited by 2,715
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Cited by
Hidden multiplicity in exploratory multiway ANOVA: Prevalence and remedies
Cramer, A. O. J., van Ravenzwaaij, D., Matzke, D., Steingroever, H., Wetzels, R., Grasman, R. P. P. P., Waldorp, L. J., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0913-5 · Cited by 416
Tropical birds have a slow pace of life
Wiersma, P., Muñoz-Garcia, A., Walker, A., & Williams, J. B. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0702212104 · Cited by 396
Sato, M., & Lyster, R. (2012) · Studies in Second Language Acquisition · doi:10.1017/s0272263112000356 · Cited by 260
Incidence, Outcomes, and Health Services Burden of Very Early Onset Inflammatory Bowel Disease
Benchimol, E. I., Mack, D. R., Nguyen, G. C., Snapper, S. B., Li, W., Mojaverian, N., Quach, P., & Muise, A. M. (2014) · Gastroenterology · doi:10.1053/j.gastro.2014.06.023 · Cited by 255
Anisimova, M., & Yang, Z. (2007) · Molecular Biology and Evolution · doi:10.1093/molbev/msm042 · Cited by 213
Metadata
- Authors
- Olejnik, S., Li, J., Supattathum, S., & Huberty, C. J.
- Venue
- Journal of Educational and Behavioral Statistics
- Published
- 1997
- Volume
- 22
- Issue
- 4
- Pages
- 389
- ISSN
- 1076-9986 (ISSN-L)
- OpenAlex
- W2106834122
- Cited by
- 179
- References
- 2
- FWCI
- 2.56
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multiple Testing and Statistical Power with Modified Bonferroni Procedures. https://app.cochat.ai/papers/10.2307/1165229
- The paper
- Olejnik, S., Li, J., Supattathum, S., & Huberty, C. J. (1997). Multiple Testing and Statistical Power with Modified Bonferroni Procedures. Journal of Educational and Behavioral Statistics. https://doi.org/10.2307/1165229
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.