The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
The Optimal Discovery Procedure: A New Approach to Simultaneous Significance Testing
Abstract
Summary: The Neyman–Pearson lemma provides a simple procedure for optimally testing a single hypothesis when the null and alternative distributions are known. This result has played a major role in the development of significance testing strategies that are used in practice. Most of the work extending single-testing strategies to multiple tests has focused on formulating and estimating new types of significance measures, such as the false discovery rate. These methods tend to be based on p-values that are calculated from each test individually, ignoring information from the other tests. I show here that one can improve the overall performance of multiple significance tests by borrowing information across all the tests when assessing the relative significance of each one, rather than calculating p-values for each test individually. The ‘optimal discovery procedure’ is introduced, which shows how to maximize the number of expected true positive results for each fixed number of expected false positive results. The optimality that is achieved by this procedure is shown to be closely related to optimality in terms of the false discovery rate. The optimal discovery procedure motivates a new approach to testing multiple hypotheses, especially when the tests are related. As a simple example, a new simultaneous procedure for testing several normal means is defined; this is surprisingly demonstrated to outperform the optimal single-test procedure, showing that a method which is optimal for single tests may no longer be optimal for multiple tests. Connections to other concepts in statistics are discussed, including Stein's paradox, shrinkage estimation and the Bayesian approach to hypothesis testing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
Self-citationStein's Estimation Rule and its Competitors—An Empirical Bayes Approach
Efron, B., & Morris, C. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481350 · Cited by 981
Cited by
De novo identification of differentially methylated regions in the human genome
Peters, T. J., Buckley, M. J., Statham, A. L., Pidsley, R., Samaras, K., V Lord, R., Clark, S. J., & Molloy, P. L. (2015) · Epigenetics & Chromatin · doi:10.1186/1756-8935-8-6 · Cited by 969
Bump hunting to identify differentially methylated regions in epigenetic epidemiology studies
Jaffe, A. E., Murakami, P., Lee, H., Leek, J. T., Fallin, M. D., Feinberg, A. P., & Irizarry, R. A. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dyr238 · Cited by 708
Signatures of negative selection in the genetic architecture of human complex traits
Zeng, J., de Vlaming, R., Wu, Y., Robinson, M. R., Lloyd-Jones, L. R., Yengo, L., Yap, C. X., Xue, A., Sidorenko, J., McRae, A. F., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0101-4 · Cited by 391
EDGE: extraction and analysis of differential gene expression
Leek, J. T., Monsen, E., Dabney, A. R., & Storey, J. D. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btk005 · Cited by 253
Self-citation
Metadata
- Authors
- Storey, J. D.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2007-05-22
- Volume
- 69
- Issue
- 3
- Pages
- 347-368
- ISSN
- 1369-7412 (ISSN-L)
- 1467-9868
- OpenAlex
- W2099118166
- Cited by
- 183
- References
- 2
- FWCI
- 14.42
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Optimal Discovery Procedure: A New Approach to Simultaneous Significance Testing. https://app.cochat.ai/papers/10.1111/j.1467-9868.2007.005592.x
- The paper
- Storey, J. D. (2007). The Optimal Discovery Procedure: A New Approach to Simultaneous Significance Testing. Journal of the Royal Statistical Society Series B: Statistical Methodology. https://doi.org/10.1111/j.1467-9868.2007.005592.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.