A Direct Approach to False Discovery Rates
Abstract
Summary: Multiple-hypothesis testing involves guarding against much more complicated errors than single-hypothesis testing. Whereas we typically control the type I error rate for a single-hypothesis test, a compound error rate is controlled for multiple-hypothesis tests. For example, controlling the false discovery rate FDR traditionally involves intricate sequential p-value rejection methods based on the observed data. Whereas a sequential p-value method fixes the error rate and estimates its corresponding rejection region, we propose the opposite approach—we fix the rejection region and then estimate its corresponding error rate. This new approach offers increased applicability, accuracy and power. We apply the methodology to both the positive false discovery rate pFDR and FDR, and provide evidence for its benefits. It is shown that pFDR is probably the quantity of interest over FDR. Also discussed is the calculation of the q-value, the pFDR analogue of the p-value, which eliminates the need to set the error rate beforehand as is traditionally done. Some simple numerical examples are presented that show that this new approach can yield an increase of over eight times in power compared with the Benjamini–Hochberg FDR method.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The MWAS controlled for multiple testing with q-value <0.05.
“The 2982 MLG that contained over 100 genes were tested for enrichment or depletion in individuals with ACVD (218 ACVD cases and 187 controls) according to the non-parametric method, Wilcoxon rank-sum test, and controlled for multiple testing (q-value <0.05)55, 60.”
From The gut microbiome in atherosclerotic cardiovascular disease (2017) · cites this paper as [60]
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · see citing works
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500 · see citing works
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230 · see citing works
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F. Z., Miled, S. B., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,785 · see citing works
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568 · see citing works
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204 · see citing works
Self-citationEmpirical Bayes analysis of a microarray experiment
Efron, B., Tibshirani, R., Storey, J. D., & Tusher, V. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382129 · Cited by 1,733 · see citing works
Self-citationOn the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 1,349 · see citing works
Yekutieli, D., & Benjamini, Y. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00041-5 · Cited by 738 · see citing works
Benjamini, Y., & Liu, W. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00040-3 · Cited by 242 · see citing works
The role of statistics in the data revolution?
Friedman, J. H. (2001) · International Statistical Review · doi:10.1111/j.1751-5823.2001.tb00474.x · Cited by 64 · see citing works
Responses to Ionizing Radiation
Ichikawa, S. (1981) · Springer eBooks · doi:10.1007/978-3-642-68090-8_8 · Cited by 28 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
clusterProfiler: an R Package for Comparing Biological Themes Among Gene Clusters
Yu, G., Wang, L.-G., Han, Y., & He, Q.-Y. (2012) · OMICS: A Journal of Integrative Biology · doi:10.1089/omi.2011.0118 · Cited by 36,259 · see citing works
MEME SUITE: tools for motif discovery and searching
Bailey, T. L., Boden, M., Buske, F. A., Frith, M., Grant, C. E., Clementi, L., Ren, J., Li, W. W., & Noble, W. S. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp335 · Cited by 10,648 · see citing works
Mootha, V. K., Lindgren, C. M., Eriksson, K.-F., Subramanian, A., Sihag, S., Lehar, J., Puigserver, P., Carlsson, E., Ridderstråle, M., Laurila, E., et al. (2003) · Nature Genetics · doi:10.1038/ng1180 · Cited by 10,197 · see citing works
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692 · see citing works
Self-citationThe Genotype-Tissue Expression (GTEx) pilot analysis: Multitissue gene regulation in humans
The GTEx Consortium, Ardlie, K. G., Deluca, D. S., Segrè, A. V., Sullivan, T. J., Young, T. R., Gelfand, E. T., Trowbridge, C. A., Maller, J. B., Tukiainen, T., et al. (2015) · Science · doi:10.1126/science.1262110 · Cited by 5,062 · see citing works
Vrieze, A., Van Nood, E., Holleman, F., Salojärvi, J., Kootte, R. S., Bartelsman, J. F. W. M., Dallinga–Thie, G. M., Ackermans, M. T., Serlie, M. J., Oozeer, R., et al. (2012) · Gastroenterology · doi:10.1053/j.gastro.2012.06.031 · Cited by 2,913 · see citing works
An integrated catalog of reference genes in the human gut microbiome
MetaHIT Consortium, Li, J., Jia, H., Cai, X., Zhong, H., Feng, Q., Sunagawa, S., Arumugam, M., Kultima, J. R., Prifti, E., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.2942 · Cited by 2,164 · see citing works
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204 · see citing works
Self-citationCapturing Heterogeneity in Gene Expression Studies by Surrogate Variable Analysis
Leek, J. T., & Storey, J. D. (2007) · PLoS Genetics · doi:10.1371/journal.pgen.0030161 · Cited by 1,930 · see citing works
Self-citationEvolution of genes and genomes on the Drosophila phylogeny
Drosophila 12 Genomes Consortium (2007) · Nature · doi:10.1038/nature06341 · Cited by 2,010 · see citing works
The gut microbiome in atherosclerotic cardiovascular disease
Jie, Z., Xia, H., Zhong, S.-L., Feng, Q., Li, S., Liang, S., Zhong, H., Liu, Z., Gao, Y., Zhao, H., et al. (2017) · Nature Communications · doi:10.1038/s41467-017-00900-1 · Cited by 1,638 · see citing works
Distinct soil microbial diversity under long-term organic and conventional farming
Hartmann, M., Frey, B., Mayer, J., Mäder, P., & Widmer, F. (2015) · The ISME Journal · doi:10.1038/ismej.2014.210 · Cited by 1,496 · see citing works
Highly sensitive spatial transcriptomics at near-cellular resolution with Slide-seqV2
Stickels, R. R., Murray, E., Kumar, P., Li, J., Marshall, J. L., Di Bella, D. J., Arlotta, P., Macosko, E. Z., & Chen, F. (2021) · Nature Biotechnology · doi:10.1038/s41587-020-0739-1 · Cited by 1,295 · see citing works
Bretz, F., Hothorn, T., & Westfall, P. (2016) · doi:10.1201/9781420010909 · Cited by 1,233 · see citing works
Activation of proto-oncogenes by disruption of chromosome neighborhoods
Hnisz, D., Weintraub, A. S., Day, D. S., Valton, A.-L., Bak, R. O., Li, C. H., Goldmann, J., Lajoie, B. R., Fan, Z. P., Sigova, A. A., et al. (2016) · Science · doi:10.1126/science.aad9024 · Cited by 1,042 · see citing works
“To correct for multiple hypothesis testing, we converted all the p-values into q-values via pFDR (68) using the Bioconductor qvalue package.”
MethodFat, fibre and cancer risk in African Americans and rural Africans
O’Keefe, S. J. D., Li, J. V., Lahti, L., Ou, J., Carbonero, F., Mohammed, K., Posma, J. M., Kinross, J., Wahl, E., Ruder, E., et al. (2015) · Nature Communications · doi:10.1038/ncomms7342 · Cited by 982 · see citing works
Single-cell mapping of gene expression landscapes and lineage in the zebrafish embryo
Wagner, D. E., Weinreb, C., Collins, Z. M., Briggs, J. A., Megason, S. G., & Klein, A. M. (2018) · Science · doi:10.1126/science.aar4362 · Cited by 849 · see citing works
Saccone, S. F., Hinrichs, A. L., Saccone, N. L., Chase, G. A., Konvicka, K., Madden, P. A. F., Breslau, N., Johnson, E. O., Hatsukami, D., Pomerleau, O., et al. (2007) · Human Molecular Genetics · doi:10.1093/hmg/ddl438 · Cited by 850 · see citing works
Funnel plots for comparing institutional performance
Spiegelhalter, D. J. (2005) · Statistics in Medicine · doi:10.1002/sim.1970 · Cited by 832 · see citing works
Interplay between the human gut microbiome and host metabolism
Visconti, A., Le Roy, C. I., Rosa, F., Rossi, N., Martin, T. C., Mohney, R. P., Li, W., de Rinaldis, E., Bell, J. T., Venter, J. C., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-12476-z · Cited by 782 · see citing works
How does multiple testing correction work?
Noble, W. S. (2009) · Nature Biotechnology · doi:10.1038/nbt1209-1135 · Cited by 772 · see citing works
Comparison and evaluation of statistical error models for scRNA-seq
Choudhary, S., & Satija, R. (2022) · Genome Biology · doi:10.1186/s13059-021-02584-9 · Cited by 634 · see citing works
Assigning Significance to Peptides Identified by Tandem Mass Spectrometry Using Decoy Databases
Käll, L., Storey, J. D., MacCoss, M. J., & Noble, W. S. (2008) · Journal of Proteome Research · doi:10.1021/pr700600n · Cited by 607 · see citing works
Self-citationA survey on filter techniques for feature selection in gene expression microarray analysis
Lazar, C., Taminau, J., Meganck, S., Steenhoff, D., Coletta, A., Molter, C., de Schaetzen, V., Duque, R., Bersini, H., & Nowe, A. (2012) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2012.33 · Cited by 619 · see citing works
Fine-mapping inflammatory bowel disease loci to single-variant resolution
International Inflammatory Bowel Disease Genetics Consortium, Huang, H., Fang, M., Jostins, L., Umićević Mirkov, M., Boucher, G., Anderson, C. A., Andersen, V., Cleynen, I., Cortes, A., et al. (2017) · Nature · doi:10.1038/nature22969 · Cited by 611 · see citing works
Impact of regulatory variation from RNA to protein
Battle, A., Khan, Z., Wang, S. H., Mitrano, A., Ford, M. J., Pritchard, J. K., & Gilad, Y. (2015) · Science · doi:10.1126/science.1260793 · Cited by 471 · see citing works
Spaeth, A. M., Dinges, D. F., & Goel, N. (2013) · Sleep · doi:10.5665/sleep.2792 · Cited by 457 · see citing works
Ni, X., Zhuo, M., Su, Z., Duan, J., Gao, Y., Wang, Z., Zong, C., Bai, H., Chapman, A. R., Zhao, J., et al. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320659110 · Cited by 454 · see citing works
Multi-tissue DNA methylation age predictor in mouse
BI Ageing Clock Team, Stubbs, T. M., Bonder, M. J., Stark, A.-K., Krueger, F., von Meyenn, F., Stegle, O., & Reik, W. (2017) · Genome Biology · doi:10.1186/s13059-017-1203-5 · Cited by 384 · see citing works
Correlation and Large-Scale Simultaneous Significance Testing
Efron, B. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001211 · Cited by 405 · see citing works
Normalization, testing, and false discovery rate estimation for RNA-sequencing data
Li, J., Witten, D. M., Johnstone, I. M., & Tibshirani, R. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr031 · Cited by 369 · see citing works
Tuch, D. S., Salat, D. H., Wisco, J. J., Zaleta, A. K., Hevelone, N. D., & Rosas, H. D. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0407259102 · Cited by 364 · see citing works
Smith, A. K., Kilaru, V., Klengel, T., Mercer, K. B., Bradley, B., Conneely, K. N., Ressler, K. J., & Binder, E. B. (2015) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32278 · Cited by 355 · see citing works
NUFIP1 is a ribosome receptor for starvation-induced ribophagy
Wyant, G. A., Abu-Remaileh, M., Frenkel, E. M., Laqtom, N. N., Dharamdasani, V., Lewis, C. A., Chan, S. H., Heinze, I., Ori, A., & Sabatini, D. M. (2018) · Science · doi:10.1126/science.aar2663 · Cited by 363 · see citing works
Differential immune system DNA methylation and cytokine regulation in post-traumatic stress disorder
Smith, A. K., Conneely, K. N., Kilaru, V., Mercer, K. B., Weiss, T. E., Bradley, B., Tang, Y., Gillespie, C. F., Cubells, J. F., & Ressler, K. J. (2011) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.31212 · Cited by 355 · see citing works
When is hub gene selection better than standard meta-analysis?
Langfelder, P., Mischel, P. S., & Horvath, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061505 · Cited by 313 · see citing works
Xie, H., Guo, R., Zhong, H., Feng, Q., Lan, Z., Qin, B., Ward, K. J., Jackson, M. A., Xia, Y., Chen, X., et al. (2016) · Cell Systems · doi:10.1016/j.cels.2016.10.004 · Cited by 341 · see citing works
Jalanka-Tuovinen, J., Salonen, A., Nikkilä, J., Immonen, O., Kekkonen, R., Lahti, L., Palva, A., & de Vos, W. M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023035 · Cited by 340 · see citing works
An exploration of aspects of Bayesian multiple testing
Scott, J. G., & Berger, J. O. (2006) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2005.08.031 · Cited by 330 · see citing works
Genetic structure is influenced by landscape features: empirical evidence from a roe deer population
COULON, A., GUILLOT, G., COSSON, J. ‐., ANGIBAULT, J. M. A., AULAGNIER, S., CARGNELUTTI, B., GALAN, M., & HEWISON, A. J. M. (2006) · Molecular Ecology · doi:10.1111/j.1365-294x.2006.02861.x · Cited by 310 · see citing works
de Klein, N., Tsai, E. A., Vochteloo, M., Baird, D., Huang, Y., Chen, C.-Y., van Dam, S., Oelen, R., Deelen, P., Bakker, O. B., et al. (2023) · Nature Genetics · doi:10.1038/s41588-023-01300-6 · Cited by 272 · see citing works
Technical trading revisited: False discoveries, persistence tests, and transaction costs
Bajgrowicz, P., & Scaillet, O. (2012) · Journal of Financial Economics · doi:10.1016/j.jfineco.2012.06.001 · Cited by 253 · see citing works
Growth control of the eukaryote cell: a systems biology study in yeast
Castrillo, J. I., Zeef, L. A., Hoyle, D. C., Zhang, N., Hayes, A., Gardner, D. C., Cornell, M. J., Petty, J., Hakes, L., Wardleworth, L., et al. (2007) · Journal of Biology · doi:10.1186/jbiol54 · Cited by 263 · see citing works
Imaging Patterns of Brain Development and their Relationship to Cognition
Erus, G., Battapady, H., Satterthwaite, T. D., Hakonarson, H., Gur, R. E., Davatzikos, C., & Gur, R. C. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht425 · Cited by 226 · see citing works
Thornton, K., & Andolfatto, P. (2006) · Genetics · doi:10.1534/genetics.105.048223 · Cited by 256 · see citing works
McHardy, I. H., Li, X., Tong, M., Ruegger, P., Jacobs, J., Borneman, J., Anton, P., & Braun, J. (2013) · Microbiome · doi:10.1186/2049-2618-1-26 · Cited by 234 · see citing works
Luo, Y., Zeng, B., Zeng, L., Du, X., Li, B., Huo, R., Liu, L., Wang, H., Dong, M., Pan, J., et al. (2018) · Translational Psychiatry · doi:10.1038/s41398-018-0240-5 · Cited by 245 · see citing works
Estimating False Discovery Proportion Under Arbitrary Covariance Dependence
Fan, J., Han, X., & Gu, W. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.720478 · Cited by 227 · see citing works
Genetic influences on schizophrenia and subcortical brain volumes: large-scale proof of concept
Schizophrenia Working Group of the Psychiatric Genomics Consortium, Franke, B., Enigma Consortium, Stein, J. L., Ripke, S., Anttila, V., Hibar, D. P., van Hulzen, K. J. E., Arias-Vasquez, A., Smoller, J. W., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4228 · Cited by 216 · see citing works
Sex and age differences in atrophic rates: an ADNI study with n=1368 MRI scans
Hua, X., Hibar, D. P., Lee, S., Toga, A. W., Jack, C. R., Weiner, M. W., & Thompson, P. M. (2010) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.04.033 · Cited by 234 · see citing works
Wang, J. C., Grucza, R., Cruchaga, C., Hinrichs, A. L., Bertelsen, S., Budde, J. P., Fox, L., Goldstein, E., Reyes, O., Saccone, N., et al. (2009) · Molecular Psychiatry · doi:10.1038/mp.2008.42 · Cited by 226 · see citing works
A statin-dependent QTL for GATM expression is associated with statin-induced myopathy
Mangravite, L. M., Engelhardt, B. E., Medina, M. W., Smith, J. D., Brown, C. D., Chasman, D. I., Mecham, B. H., Howie, B., Shim, H., Naidoo, D., et al. (2013) · Nature · doi:10.1038/nature12508 · Cited by 224 · see citing works
Wang, H.-Q., Tuominen, L. K., & Tsai, C.-J. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btq650 · Cited by 223 · see citing works
Ishimura, R., Nagy, G., Dotu, I., Chuang, J. H., & Ackerman, S. L. (2016) · eLife · doi:10.7554/elife.14295 · Cited by 221 · see citing works
Effects of dependence in high-dimensional multiple testing problems
Kim, K. I., & van de Wiel, M. A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-114 · Cited by 220 · see citing works
“Storey [4] introduces the positive false discovery rate (pFDR) and the q -value. pFDR is known to control error rate under the clumpy dependency condition [5].”
InfluentialThe effect of psyllium husk on intestinal microbiota in constipated patients and healthy controls
Jalanka, J., Major, G., Murray, K., Singh, G., Nowak, A., Kurtz, C., Silos-Santiago, I., Johnston, J. M., de Vos, W. M., & Spiller, R. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20020433 · Cited by 219 · see citing works
Multiple testing corrections in quantitative proteomics: A useful but blunt tool
Pascovici, D., Handler, D. C. L., Wu, J. X., & Haynes, P. A. (2016) · PROTEOMICS · doi:10.1002/pmic.201600044 · Cited by 218 · see citing works
MultipleTesting.com: A tool for life science researchers for multiple hypothesis testing correction
Menyhart, O., Weltz, B., & Győrffy, B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245824 · Cited by 216 · see citing works
Anisimova, M., & Yang, Z. (2007) · Molecular Biology and Evolution · doi:10.1093/molbev/msm042 · Cited by 213 · see citing works
Lombardo, M. V., Moon, H. M., Su, J., Palmer, T. D., Courchesne, E., & Pramparo, T. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.15 · Cited by 201 · see citing works
Kennedy, J. J., Abbatiello, S. E., Kim, K., Yan, P., Whiteaker, J. R., Lin, C., Kim, J. S., Zhang, Y., Wang, X., Ivey, R. G., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2763 · Cited by 184 · see citing works
Labbé, D. P., Zadra, G., Yang, M., Reyes, J. M., Lin, C. Y., Cacciatore, S., Ebot, E. M., Creech, A. L., Giunchi, F., Fiorentino, M., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-12298-z · Cited by 174 · see citing works
Characterization of Distinct Subpopulations of Hepatic Macrophages in HFD/Obese Mice
Morinaga, H., Mayoral, R., Heinrichsdorff, J., Osborn, O., Franck, N., Hah, N., Walenta, E., Bandyopadhyay, G., Pessentheiner, A. R., Chi, T. J., et al. (2015) · Diabetes · doi:10.2337/db14-1238 · Cited by 175 · see citing works
A statistical framework for protein quantitation in bottom-up MS-based proteomics
Karpievitch, Y., Stanley, J., Taverner, T., Huang, J., Adkins, J. N., Ansong, C., Heffron, F., Metz, T. O., Qian, W.-J., Yoon, H., et al. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp362 · Cited by 176 · see citing works
Hundreds of genes experienced convergent shifts in selective pressure in marine mammals
Chikina, M., Robinson, J. D., & Clark, N. L. (2016) · Molecular Biology and Evolution · doi:10.1093/molbev/msw112 · Cited by 171 · see citing works
Narr, K. L., Woods, R. P., Lin, J., Kim, J., Phillips, O. R., Del'Homme, M., Caplan, R., Toga, A. W., McCracken, J. T., & Levitt, J. G. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181b395c0 · Cited by 168 · see citing works
Genetic variant effects on gene expression in human pancreatic islets and their implications for T2D
Viñuela, A., Varshney, A., van de Bunt, M., Prasad, R. B., Asplund, O., Bennett, A., Boehnke, M., Brown, A. A., Erdos, M. R., Fadista, J., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-18581-8 · Cited by 152 · see citing works
Causal associations between modifiable risk factors and the Alzheimer's phenome
Andrews, S. J., Fulton‐Howard, B., O'Reilly, P., Marcora, E., Goate, A. M., & collaborators of the Alzheimer's Disease Genetics Consortium (2021) · Annals of Neurology · doi:10.1002/ana.25918 · Cited by 156 · see citing works
Miri, A., Daie, K., Burdine, R. D., Aksay, E., & Tank, D. W. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00702.2010 · Cited by 138 · see citing works
Arnoriaga-Rodríguez, M., Mayneris-Perxachs, J., Burokas, A., Contreras-Rodríguez, O., Blasco, G., Coll, C., Biarnés, C., Miranda-Olivos, R., Latorre, J., Moreno-Navarrete, J.-M., et al. (2020) · Cell Metabolism · doi:10.1016/j.cmet.2020.09.002 · Cited by 157 · see citing works
Conley, Y. P., Thalamuthu, A., Jakobsdottir, J., Weeks, D. E., Mah, T., Ferrell, R. E., & Gorin, M. B. (2005) · Human Molecular Genetics · doi:10.1093/hmg/ddi204 · Cited by 158 · see citing works
Ellingsen, D.-M., Wessberg, J., Chelnokova, O., Olausson, H., Laeng, B., & Leknes, S. (2014) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.09.017 · Cited by 153 · see citing works
Complex‐centric proteome profiling by SEC‐SWATH‐MS
Heusel, M., Bludau, I., Rosenberger, G., Hafen, R., Frank, M., Banaei‐Esfahani, A., van Drogen, A., Collins, B. C., Gstaiger, M., & Aebersold, R. (2019) · Molecular Systems Biology · doi:10.15252/msb.20188438 · Cited by 141 · see citing works
McCarthy, M. J., Wei, H., Marnoy, Z., Darvish, R. M., McPhie, D. L., Cohen, B. M., & Welsh, D. K. (2013) · Translational Psychiatry · doi:10.1038/tp.2013.90 · Cited by 137 · see citing works
Impairments in Cognitive Function and Brain Connectivity in Severe Asymptomatic Carotid Stenosis
Cheng, H.-L., Lin, C.-J., Soong, B.-W., Wang, P.-N., Chang, F.-C., Wu, Y.-T., Chou, K.-H., Lin, C.-P., Tu, P.-C., & Lee, I.-H. (2012) · Stroke · doi:10.1161/strokeaha.111.645614 · Cited by 128 · see citing works
Teruel, J. R., Heldahl, M. G., Goa, P. E., Pickles, M., Lundgren, S., Bathen, T. F., & Gibbs, P. (2014) · NMR in Biomedicine · doi:10.1002/nbm.3132 · Cited by 131 · see citing works
Transcriptome alterations of prefrontal cortical parvalbumin neurons in schizophrenia
Enwright III, J. F., Huo, Z., Arion, D., Corradi, J. P., Tseng, G., & Lewis, D. A. (2018) · Molecular Psychiatry · doi:10.1038/mp.2017.216 · Cited by 109 · see citing works
Sex and race differences in caloric intake during sleep restriction in healthy adults
Spaeth, A. M., Dinges, D. F., & Goel, N. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.114.086579 · Cited by 118 · see citing works
Agnetti, G., Kaludercic, N., Kane, L. A., Elliott, S. T., Guo, Y., Chakir, K., Samantapudi, D., Paolocci, N., Tomaselli, G. F., Kass, D. A., et al. (2010) · Circulation Cardiovascular Genetics · doi:10.1161/circgenetics.109.871236 · Cited by 117 · see citing works
Adams, S. E., Arnold, D., Murphy, B., Carroll, P., Green, A. K., Smith, A. M., Marsh, P. D., Chen, T., Marriott, R. E., & Brading, M. G. (2017) · Scientific Reports · doi:10.1038/srep43344 · Cited by 111 · see citing works
Gates, K. M., Molenaar, P. C. M., Iyer, S. P., Nigg, J. T., & Fair, D. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091322 · Cited by 107 · see citing works
Joint analysis of SNP and gene expression data in genetic association studies of complex diseases
Huang, Y.-T., VanderWeele, T. J., & Lin, X. (2014) · The Annals of Applied Statistics · doi:10.1214/13-aoas690 · Cited by 88 · see citing works
Cortico-cortical feedback engages active dendrites in visual cortex
Fişek, M., Herrmann, D., Egea-Weiss, A., Cloves, M., Bauer, L., Lee, T.-Y., Russell, L. E., & Häusser, M. (2023) · Nature · doi:10.1038/s41586-023-06007-6 · Cited by 80 · see citing works
Comparing connectomes across subjects and populations at different scales
Meskaldji, D. E., Fischi-Gomez, E., Griffa, A., Hagmann, P., Morgenthaler, S., & Thiran, J.-P. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.084 · Cited by 77 · see citing works
Leskinen, T., Rinnankoski-Tuikka, R., Rintala, M., Seppänen-Laakso, T., Pöllänen, E., Alen, M., Sipilä, S., Kaprio, J., Kovanen, V., Rahkila, P., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012609 · Cited by 75 · see citing works
Profiling bacterial community in upper respiratory tracts
Yi, H., Yong, D., Lee, K., Cho, Y.-J., & Chun, J. (2014) · BMC Infectious Diseases · doi:10.1186/s12879-014-0583-3 · Cited by 75 · see citing works
Species comparison of liver proteomes reveals links to naked mole-rat longevity and human aging
Heinze, I., Bens, M., Calzia, E., Holtze, S., Dakhovnik, O., Sahm, A., Kirkpatrick, J. M., Szafranski, K., Romanov, N., Sama, S. N., et al. (2018) · BMC Biology · doi:10.1186/s12915-018-0547-y · Cited by 65 · see citing works
Combining CRISPRi and metabolomics for functional annotation of compound libraries
Anglada-Girotto, M., Handschin, G., Ortmayr, K., Campos, A. I., Gillet, L., Manfredi, P., Mulholland, C. V., Berney, M., Jenal, U., Picotti, P., et al. (2022) · Nature Chemical Biology · doi:10.1038/s41589-022-00970-3 · Cited by 60 · see citing works
Carr, O., Saunders, K. E. A., Tsanas, A., Bilderbeck, A. C., Palmius, N., Geddes, J. R., Foster, R., Goodwin, G. M., & De Vos, M. (2018) · Scientific Reports · doi:10.1038/s41598-018-19888-9 · Cited by 57 · see citing works
Genetic association analyses of PDYN polymorphisms with heroin and cocaine addiction
Clarke, T. ‐., Ambrose‐Lanci, L., Ferraro, T. N., Berrettini, W. H., Kampman, K. M., Dackis, C. A., Pettinati, H. M., O’Brien, C. P., Oslin, D. W., & Lohoff, F. W. (2012) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2012.00785.x · Cited by 55 · see citing works
Eating patterns and food intake of persons with type 1 diabetes within the T1D Exchange
Powers, M. A., Gal, R. L., Connor, C. G., Mangan, M., Maahs, D. M., Clements, M. A., & Mayer-Davis, E. J. (2018) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2018.05.011 · Cited by 53 · see citing works
Lanz, T. A., Guilmette, E., Gosink, M. M., Fischer, J. E., Fitzgerald, L. W., Stephenson, D. T., & Pletcher, M. T. (2013) · Molecular Autism · doi:10.1186/2040-2392-4-45 · Cited by 52 · see citing works
Chang, E. F., Kurteff, G., & Wilson, S. M. (2018) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01215 · Cited by 52 · see citing works
Comparison of gene expression and DNA copy number changes in a murine model of lung cancer
Sweet‐Cordero, A., Tseng, G. C., You, H., Douglass, M., Huey, B., Albertson, D., & Jacks, T. (2006) · Genes, Chromosomes and Cancer · doi:10.1002/gcc.20296 · Cited by 45 · see citing works
Toll-like receptor gene polymorphisms are associated with allergic rhinitis: a case control study
Nilsson, D., Andiappan, A. K., Halldén, C., De Yun, W., Säll, T., Tim, C. F., & Cardell, L.-O. (2012) · BMC Medical Genetics · doi:10.1186/1471-2350-13-66 · Cited by 43 · see citing works
Loss of hepatocyte cell division leads to liver inflammation and fibrosis
Dewhurst, M. R., Ow, J. R., Zafer, G., van Hul, N. K. M., Wollmann, H., Bisteau, X., Brough, D., Choi, H., & Kaldis, P. (2020) · PLOS Genetics · doi:10.1371/journal.pgen.1009084 · Cited by 42 · see citing works
Castilla-Ortega, E., Rosell-Valle, C., Pedraza, C., Rodríguez de Fonseca, F., Estivill-Torrús, G., & Santín, L. J. (2014) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2013.12.001 · Cited by 41 · see citing works
Quantitative measurement of allele‐specific protein expression in a diploid yeast hybrid by LC‐MS
Khan, Z., Bloom, J. S., Amini, S., Singh, M., Perlman, D. H., Caudy, A. A., & Kruglyak, L. (2012) · Molecular Systems Biology · doi:10.1038/msb.2012.34 · Cited by 37 · see citing works
Liang, Y., Feng, Y., Zong, M., Wei, X., Lee, J., Feng, Y., Li, H., Yang, G., Wu, Z., Fu, X., et al. (2018) · Hepatology · doi:10.1002/hep.29661 · Cited by 36 · see citing works
Maternal aggression: New insights from Egr-1
Hasen, N. S., & Gammie, S. C. (2006) · Brain Research · doi:10.1016/j.brainres.2006.06.007 · Cited by 37 · see citing works
- Authors
- Storey, J. D.
- Affiliations
- Stanford University (US)
- Corresponding author
- Storey, John D.
- ORCID
- Storey, John D.
- Venue
- Journal of the Royal Statistical Society Series B: Statistical Methodology
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-08-01
- Volume
- 64
- Issue
- 3
- Pages
- 479-498
- ISSN
- 1369-7412 (ISSN-L)
- 1467-9868
- OpenAlex
- W2105381419
- Cited by
- 5,603
- References
- 12
- Citations by year
- 2026: 164 · 2025: 183 · 2024: 239 · 2023: 245 · 2022: 201 · 2021: 278 · 2020: 249 · 2019: 249 · 2018: 279 · 2017: 274 · 2016: 297 · 2015: 255 · 2014: 340 · 2013: 348 · 2012: 363
- FWCI
- 96.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the Royal Statistical Society Series B (Statistical Methodology) (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Science Foundation
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Keywords
- false discovery rate, multiple comparisons, Q-value, Benjamini-Hochberg procedure, statistical power
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review