Adjusted P-Values for Simultaneous Inference
Abstract
This paper proposes that results from simultaneous tests be reported as adjusted P-values such that, if the adjusted P-value for an individual hypothesis is less than the chosen significance level of a, then the hypothesis is rejected with an experimentwise error rate of no more than ax. Examples are given of adjusted P-values for multiple comparisons in the analysis of variance and of adjusted P-values based on the Bonferroni procedure and modifications of that procedure by Holm (1979, Scandinavian Journal of Statistics 6, 65-70), Hochberg (1988, Biometrika 75, 800-802), and Hommel (1988, Biometrika 75, 383-386). The modified Bonferroni-based procedures are much more powerful than the original Bonferroni procedure, and they deserve wider use. In addition to the above, a procedure is outlined for obtaining adjusted P-values for any closed test procedure.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
P values were adjusted for multiple comparisons using the Holm-Bonferroni correction.
“P values were adjusted for multiple comparisons using the Holm‐Bonferroni correction.48”
From Behavioral flexibility in a mouse model for obsessive‐compulsive disorder: Impaired Pavlovian reversal learning in SAPAP3 mutants (2019) · cites this paper as [48]
The citation lists haven’t been fetched yet
References 19 · Cited by 1,026
- Authors
- Wright, S. P.
- Corresponding author
- Wright, S. Paul
- ORCID
- Wright, S. Paul
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1992-12
- Volume
- 48
- Issue
- 4
- Pages
- 1005
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W2317320087
- Cited by
- 1,026
- References
- 19
- Citations by year
- 2026: 27 · 2025: 18 · 2024: 40 · 2023: 38 · 2022: 39 · 2021: 49 · 2020: 40 · 2019: 35 · 2018: 41 · 2017: 52 · 2016: 52 · 2015: 53 · 2014: 40 · 2013: 42 · 2012: 33
- FWCI
- 9.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- adjusted p-values, simultaneous inference, family-wise error rate, multiple comparisons, Bonferroni procedure, Holm procedure, Hochberg procedure, analysis of variance, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
