The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Control of generalized error rates in multiple testing
Open accessAbstract
Consider the problem of testing $s$ hypotheses simultaneously. The usual approach restricts attention to procedures that control the probability of even one false rejection, the familywise error rate (FWER). If $s$ is large, one might be willing to tolerate more than one false rejection, thereby increasing the ability of the procedure to correctly reject false null hypotheses. One possibility is to replace control of the FWER by control of the probability of $k$ or more false rejections, which is called the $k$-FWER. We derive both single-step and step-down procedures that control the $k$-FWER in finite samples or asymptotically, depending on the situation. We also consider the false discovery proportion (FDP) defined as the number of false rejections divided by the total number of rejections (and defined to be 0 if there are no rejections). The false discovery rate proposed by Benjamini and Hochberg [J. Roy. Statist. Soc. Ser. B 57 (1995) 289–300] controls $E$(FDP). Here, the goal is to construct methods which satisfy, for a given $γ$ and $α$, $P\{\mathrm{FDP} \gt γ\} ≤ α$, at least asymptotically. In contrast to the proposals of Lehmann and Romano [Ann. Statist. 33 (2005) 1138–1154], we construct methods that implicitly take into account the dependence structure of the individual test statistics in order to further increase the ability to detect false null hypotheses. This feature is also shared by related work of van der Laan, Dudoit and Pollard [Stat. Appl. Genet. Mol. Biol. 3 (2004) article 15], but our methodology is quite different. Like the work of Pollard and van der Laan [Proc. 2003 International Multi-Conference in Computer Science and Engineering, METMBS’03 Conference (2003) 3–9] and Dudoit, van der Laan and Pollard [Stat. Appl. Genet. Mol. Biol. 3 (2004) article 13], we employ resampling methods to achieve our goals. Some simulations compare finite sample performance to currently available methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Bootstrap Methods and their Application
Davison, A. C., & Hinkley, D. V. (1997) · doi:10.1017/cbo9780511802843 · Cited by 7,350
Shao, J., & Tu, D. (1995) · Springer Series in Statistics · doi:10.1007/978-1-4612-0795-5 · Cited by 1,985
Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing
Romano, J. P., & Wolf, M. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000000539 · Cited by 609
Self-citationTwo Guidelines for Bootstrap Hypothesis Testing
Hall, P., & Wilson, S. R. (1991) · Biometrics · doi:10.2307/2532163 · Cited by 471
Generalizations of the familywise error rate
Lehmann, E. L., & Romano, J. P. (2005) · The Annals of Statistics · doi:10.1214/009053605000000084 · Cited by 320
Self-citation
Cited by
Clarke, R., Ressom, H. W., Wang, A., Xuan, J., Liu, M. C., Gehan, E. A., & Wang, Y. (2008) · Nature Reviews Cancer · doi:10.1038/nrc2294 · Cited by 603
Outcome-Wide Longitudinal Designs for Causal Inference: A New Template for Empirical Studies
VanderWeele, T. J., Mathur, M. B., & Chen, Y. (2020) · Statistical Science · doi:10.1214/19-sts728 · Cited by 310
Anomalies and False Rejections
Chordia, T., Goyal, A., & Saretto, A. (2017) · doi:10.2139/ssrn.3017677 · Cited by 213
Simultaneous confidence bands: Theory, implementation, and an application to SVARs
Montiel Olea, J. L., & Plagborg‐Møller, M. (2019) · Journal of Applied Econometrics · doi:10.1002/jae.2656 · Cited by 153
HEATH, D., RINGGENBERG, M. C., SAMADI, M., & WERNER, I. M. (2023) · The Journal of Finance · doi:10.1111/jofi.13250 · Cited by 133
Metadata
- Authors
- Romano, J. P., & Wolf, M.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2007-08-01
- Volume
- 35
- Issue
- 4
- Pages
- 1378-1408
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2071206313
- Cited by
- 181
- References
- 7
- FWCI
- 10.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Control of generalized error rates in multiple testing. https://app.cochat.ai/papers/10.1214/009053606000001622
- The paper
- Romano, J. P., & Wolf, M. (2007). Control of generalized error rates in multiple testing. The Annals of Statistics. https://doi.org/10.1214/009053606000001622
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.