Genomics, Prior Probability, and Statistical Tests of Multiple Hypotheses
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Genomic methods have made statistical multiple-test methods important to geneticists and molecular biologists. These tests apply to identification of quantitative trait loci and measurement of changes in RNA or DNA abundance by microarray methods. Recently developed multiple-test methods provide more statistical power when many of the tested null hypotheses are false. At the same time, these methods can provide stringent control of errors in cases when most or all of the tested null hypotheses are true. These methods control errors in a different way from previous hypothesis tests, controlling or estimating quantities called the posterior error rate (PER), false discovery rate (FDR), or proportion of false positives (PFP), rather than the type I error. In this study, we attempt to clarify the relationships among these methods and demonstrate how the proportion of true null hypotheses among all tested hypotheses plays an important role.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204
On the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 2,015
Cited by
Chesler, E. J., Lu, L., Shou, S., Qu, Y., Gu, J., Wang, J., Hsu, H. C., Mountz, J. D., Baldwin, N. E., Langston, M. A., et al. (2005) · Nature Genetics · doi:10.1038/ng1518 · Cited by 719
Self-citationEstimation of significance thresholds for genomewide association scans
Dudbridge, F., & Gusnanto, A. (2008) · Genetic Epidemiology · doi:10.1002/gepi.20297 · Cited by 703
“On the one hand, multiple testing issues arise in most studies, whether based on candidate genes or genomewide scans, with attendant issues of how to quantify the multiplicity, what error rate to control and which method to use [Manly et al., 2004].”
MethodStatistical methods for analysis of high-throughput RNA interference screens
Birmingham, A., Selfors, L. M., Forster, T., Wrobel, D., Kennedy, C. J., Shanks, E., Santoyo-Lopez, J., Dunican, D. J., Long, A., Kelleher, D., et al. (2009) · Nature Methods · doi:10.1038/nmeth.1351 · Cited by 586
Needles in stacks of needles: finding disease-causal variants in a wealth of genomic data
Cooper, G. M., & Shendure, J. (2011) · Nature Reviews Genetics · doi:10.1038/nrg3046 · Cited by 575
The state of the art in the analysis of two-dimensional gel electrophoresis images
Berth, M., Moser, F. M., Kolbe, M., & Bernhardt, J. (2007) · Applied Microbiology and Biotechnology · doi:10.1007/s00253-007-1128-0 · Cited by 254
Heritability and Tissue Specificity of Expression Quantitative Trait Loci
Petretto, E., Mangion, J., Dickens, N. J., Cook, S. A., Kumaran, M. K., Lu, H., Fischer, J., Maatz, H., Kren, V., Pravenec, M., et al. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020172 · Cited by 214
“The ability to detect small differences in transcript abundance, or small allelic genetic effects, is partially a function of the power of the study but also relates to the use of corrections for multiple testing of variable stringency that are employed in genome-wide analyses [14].”
BackgroundAnisimova, M., & Yang, Z. (2007) · Molecular Biology and Evolution · doi:10.1093/molbev/msm042 · Cited by 213
“See Manly et al. (2006) for a review of FWER, FDR, and some other criteria useful for multiple test corrections.”
BackgroundCancer Genomics: Technology, Discovery, and Translation
Tran, B., Dancey, J. E., Kamel-Reid, S., McPherson, J. D., Bedard, P. L., Brown, A. M. K., Zhang, T., Shaw, P., Onetto, N., Stein, L., et al. (2012) · Journal of Clinical Oncology · doi:10.1200/jco.2011.39.2316 · Cited by 188
Travelling the world of gene-gene interactions
Van Steen, K. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbr012 · Cited by 177
“For discussions about the utility of the aforementioned multiple testing procedures in genomics applications, we refer to other publications [121–124].”
Jansen, R., & Gerstein, M. (2004) · Current Opinion in Microbiology · doi:10.1016/j.mib.2004.08.012 · Cited by 177
“A consequence of this imbalance is that even experiments with sensitivity and specificity close to 100% may produce a large absolute number of false positive predictions; in this situation, the absolute number of false positives may be larger than that of true positives (Figures 5 and 6) [40 ,41].”
BackgroundFUNC: a package for detecting significant associations between gene sets and ontological annotations
Prüfer, K., Muetzel, B., Do, H.-H., Weiss, G., Khaitovich, P., Rahm, E., Pääbo, S., Lachmann, M., & Enard, W. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-41 · Cited by 173
“…it might instead be more useful to determine the false discovery rate (FDR) [12], i.e. the proportion of false positives among all significant features, since a known proportion of false positives can easily be tolerated for an increase of power in these contexts (see e.g. [13] for an overview).”
BackgroundYang, C., Guo, R., Jie, F., Nettleton, D., Peng, J., Carr, T., Yeakley, J. M., Fan, J.-B., & Whitham, S. A. (2007) · Molecular Plant-Microbe Interactions® · doi:10.1094/mpmi-20-4-0358 · Cited by 158
“Subsequently, a q value was calculated for each gene to estimate the FDR (Benjamini and Hochberg 1995; Manly et al. 2004; Storey and Tibshirani 2003).”
Self-citationCaveats and pitfalls of ROC analysis in clinical microarray research (and how to avoid them)
Berrar, D., & Flach, P. (2012) · Briefings in Bioinformatics · doi:10.1093/bib/bbr008 · Cited by 136
Metadata
- Authors
- Manly, K. F., Nettleton, D., & Hwang, J. T. G.
- Venue
- Genome Research
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2004-06
- Volume
- 14
- Issue
- 6
- Pages
- 997-1001
- ISSN
- 1088-9051 (ISSN-L)
- OpenAlex
- W2075844835
- Cited by
- 86
- References
- 6
- Type
- posted content
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.