The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Independent filtering increases detection power for high-throughput experiments
Open accessAbstract
With high-dimensional data, variable-by-variable statistical testing is often used to select variables whose behavior differs across conditions. Such an approach requires adjustment for multiple testing, which can result in low statistical power. A two-stage approach that first filters variables by a criterion independent of the test statistic, and then only tests variables which pass the filter, can provide higher power. We show that use of some filter/test statistics pairs presented in the literature may, however, lead to loss of type I error control. We describe other pairs which avoid this problem. In an application to microarray data, we found that gene-by-gene filtering by overall variance followed by a t-test increased the number of discoveries by 50%. We also show that this particular statistic pair induces a lower bound on fold-change among the set of discoveries. Independent filtering—using filter/test pairs that are independent under the null hypothesis but correlated under the alternative—is a general approach that can substantially increase the efficiency of experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the loss can be reduced if genes that have little or no chance of being detected as differentially expressed are omitted from the testing, provided that the criterion for omission is independent of the test statistic under the null hypothesis [22] (see Materials and methods).”
From Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2 (2014) · cites this paper as [22]
In the citing paper
“Independent filtering does not compromise type-I error control as long as the distribution of the test statistic is marginally independent of the filter statistic under the null hypothesis [22]”
From Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2 (2014) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Bioconductor: open software development for computational biology and bioinformatics
Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B., Dettling, M., Dudoit, S., Ellis, B., Gautier, L., Ge, Y., Gentry, J., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-10-r80 · Cited by 12,172
Self-citationSmyth, G. K. (2004) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1027 · Cited by 11,829
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Exploration, normalization, and summaries of high density oligonucleotide array probe level data
Irizarry, R. A. (2003) · Biostatistics · doi:10.1093/biostatistics/4.2.249 · Cited by 10,603
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Bioinformatics and Computational Biology Solutions Using R and Bioconductor
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-29362-0 · Cited by 3,289
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
A Model-Based Background Adjustment for Oligonucleotide Expression Arrays
Wu, Z., Irizarry, R. A., Gentleman, R., Martinez-Murillo, F., & Spencer, F. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000683 · Cited by 1,716
Self-citation
Research works printed but not linked: 3
- 10.1002/sim.3405 · doi:10.1002/sim.3405
- YE Kling Issues of multiple hypothesis testing in statistical process control. (Department of Statistics and Operations Research Tel-Aviv University Ph.D. thesis. (2005).
- 10.2202/1544-6115.1148 · doi:10.2202/1544-6115.1148
Cited by
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
Self-citationGSVA: gene set variation analysis for microarray and RNA-Seq data
Hänzelmann, S., Castelo, R., & Guinney, J. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-7 · Cited by 15,440
Waste Not, Want Not: Why Rarefying Microbiome Data Is Inadmissible
McMurdie, P. J., & Holmes, S. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003531 · Cited by 2,921
RNA sequencing: the teenage years
Stark, R., Grzelak, M., & Hadfield, J. (2019) · Nature Reviews Genetics · doi:10.1038/s41576-019-0150-2 · Cited by 1,915
The Landscape of Circular RNA in Cancer
Vo, J. N., Cieslik, M., Zhang, Y., Shukla, S., Xiao, L., Zhang, Y., Wu, Y.-M., Dhanasekaran, S. M., Engelke, C. G., Cao, X., et al. (2019) · Cell · doi:10.1016/j.cell.2018.12.021 · Cited by 1,738
A step-by-step workflow for low-level analysis of single-cell RNA-seq data with Bioconductor
Lun, A. T. L., McCarthy, D. J., & Marioni, J. C. (2016) · F1000Research · doi:10.12688/f1000research.9501.2 · Cited by 1,574
Detecting differential usage of exons from RNA-seq data
Anders, S., Reyes, A., & Huber, W. (2012) · Genome Research · doi:10.1101/gr.133744.111 · Cited by 1,545
Self-citationMetaboAnalyst 2.0--a comprehensive server for metabolomic data analysis
Xia, J., Mandal, R., Sinelnikov, I. V., Broadhurst, D., & Wishart, D. S. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks374 · Cited by 1,150
Count-based differential expression analysis of RNA sequencing data using R and Bioconductor
Anders, S., McCarthy, D. J., Chen, Y., Okoniewski, M., Smyth, G. K., Huber, W., & Robinson, M. D. (2013) · Nature Protocols · doi:10.1038/nprot.2013.099 · Cited by 1,146
Self-citationMicrobiome differential abundance methods produce different results across 38 datasets
Nearing, J. T., Douglas, G. M., Hayes, M. G., MacDonald, J., Desai, D. K., Allward, N., Jones, C. M. A., Wright, R. J., Dhanani, A. S., Comeau, A. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28034-z · Cited by 992
Translational biomarker discovery in clinical metabolomics: an introductory tutorial
Xia, J., Broadhurst, D. I., Wilson, M., & Wishart, D. S. (2013) · Metabolomics · doi:10.1007/s11306-012-0482-9 · Cited by 953
Orchestrating single-cell analysis with Bioconductor
Amezquita, R. A., Lun, A. T. L., Becht, E., Carey, V. J., Carpp, L. N., Geistlinger, L., Marini, F., Rue-Albrecht, K., Risso, D., Soneson, C., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0654-x · Cited by 945
Self-citationBias, robustness and scalability in single-cell differential expression analysis
Soneson, C., & Robinson, M. D. (2018) · Nature Methods · doi:10.1038/nmeth.4612 · Cited by 770
Parallel single-cell sequencing links transcriptional and epigenetic heterogeneity
Angermueller, C., Clark, S. J., Lee, H. J., Macaulay, I. C., Teng, M. J., Hu, T. X., Krueger, F., Smallwood, S. A., Ponting, C. P., Voet, T., et al. (2016) · Nature Methods · doi:10.1038/nmeth.3728 · Cited by 717
Clark, S. J., Argelaguet, R., Kapourani, C.-A., Stubbs, T. M., Lee, H. J., Alda-Catalinas, C., Krueger, F., Sanguinetti, G., Kelsey, G., Marioni, J. C., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-03149-4 · Cited by 657
Data-driven hypothesis weighting increases detection power in genome-scale multiple testing
Ignatiadis, N., Klaus, B., Zaugg, J. B., & Huber, W. (2016) · Nature Methods · doi:10.1038/nmeth.3885 · Cited by 649
Self-citationBroad defects in the energy metabolism of leukocytes underlie immunoparalysis in sepsis
Cheng, S.-C., Scicluna, B. P., Arts, R. J. W., Gresnigt, M. S., Lachmandas, E., Giamarellos-Bourboulis, E. J., Kox, M., Manjeri, G. R., Wagenaars, J. A. L., Cremer, O. L., et al. (2016) · Nature Immunology · doi:10.1038/ni.3398 · Cited by 637
Melanomas resist T-cell therapy through inflammation-induced reversible dedifferentiation
Landsberg, J., Kohlmeyer, J., Renn, M., Bald, T., Rogava, M., Cron, M., Fatho, M., Lennerz, V., Wölfel, T., Hölzel, M., et al. (2012) · Nature · doi:10.1038/nature11538 · Cited by 632
Petryszak, R., Keays, M., Tang, Y. A., Fonseca, N. A., Barrera, E., Burdett, T., Füllgrabe, A., Fuentes, A. M.-P., Jupp, S., Koskinen, S., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1045 · Cited by 530
Self-citationSykes, D. B., Kfoury, Y. S., Mercier, F. E., Wawer, M. J., Law, J. M., Haynes, M. K., Lewis, T. A., Schajnovitz, A., Jain, E., Lee, D., et al. (2016) · Cell · doi:10.1016/j.cell.2016.08.057 · Cited by 500
Huang, Y. J., Nariya, S., Harris, J. M., Lynch, S. V., Choy, D. F., Arron, J. R., & Boushey, H. (2015) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2015.05.044 · Cited by 519
Regulation of the Arabidopsis CBF regulon by a complex low‐temperature regulatory network
Park, S., Lee, C., Doherty, C. J., Gilmour, S. J., Kim, Y., & Thomashow, M. F. (2015) · The Plant Journal · doi:10.1111/tpj.12796 · Cited by 512
Genomic determinants of coral heat tolerance across latitudes
Dixon, G. B., Davies, S. W., Aglyamova, G. V., Meyer, E., Bay, L. K., & Matz, M. V. (2015) · Science · doi:10.1126/science.1261224 · Cited by 510
Touleimat, N., & Tost, J. (2012) · Epigenomics · doi:10.2217/epi.12.21 · Cited by 507
Comparison of software packages for detecting differential expression in RNA-seq studies
Seyednasrollah, F., Laiho, A., & Elo, L. L. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbt086 · Cited by 421
“This can be done using, for instance, the overall sum of counts independent of the sample groups [16, 25] or the maximum normalized count across samples [26].”
MethodMulti-omics profiling of mouse gastrulation at single-cell resolution
Argelaguet, R., Clark, S. J., Mohammed, H., Stapel, L. C., Krueger, C., Kapourani, C.-A., Imaz-Rosshandler, I., Lohoff, T., Xiang, Y., Hanna, C. W., et al. (2019) · Nature · doi:10.1038/s41586-019-1825-8 · Cited by 457
T H 2 and T H 17 inflammatory pathways are reciprocally regulated in asthma
Choy, D. F., Hart, K. M., Borthwick, L. A., Shikotra, A., Nagarkar, D. R., Siddiqui, S., Jia, G., Ohri, C. M., Doran, E., Vannella, K. M., et al. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3142 · Cited by 450
A practical guide to methods controlling false discoveries in computational biology
Korthauer, K., Kimes, P. K., Duvallet, C., Reyes, A., Subramanian, A., Teng, M., Shukla, C., Alm, E. J., & Hicks, S. C. (2019) · Genome Biology · doi:10.1186/s13059-019-1716-1 · Cited by 436
Rhea: a transparent and modular R pipeline for microbial profiling based on 16S rRNA gene amplicons
Lagkouvardos, I., Fischer, S., Kumar, N., & Clavel, T. (2017) · PeerJ · doi:10.7717/peerj.2836 · Cited by 429
RNA-Seq workflow: gene-level exploratory analysis and differential expression
Love, M. I., Anders, S., Kim, V., & Huber, W. (2015) · F1000Research · doi:10.12688/f1000research.7035.1 · Cited by 412
Self-citationWeischenfeldt, J., Dubash, T., Drainas, A. P., Mardin, B. R., Chen, Y., Stütz, A. M., Waszak, S. M., Bosco, G., Halvorsen, A. R., Raeder, B., et al. (2017) · Nature Genetics · doi:10.1038/ng.3722 · Cited by 404
Synovial phenotypes in rheumatoid arthritis correlate with response to biologic therapeutics
Dennis, G., Holweg, C. T., Kummerfeld, S. K., Choy, D. F., Setiadi, A. F., Hackney, J. A., Haverty, P. M., Gilbert, H., Lin, W. Y., Diehl, L., et al. (2014) · Arthritis Research & Therapy · doi:10.1186/ar4555 · Cited by 380
Multiple hypothesis testing in genomics
Goeman, J. J., & Solari, A. (2014) · Statistics in Medicine · doi:10.1002/sim.6082 · Cited by 375
Untangling the brain’s neuroinflammatory and neurodegenerative transcriptional responses
Srinivasan, K., Friedman, B. A., Larson, J. L., Lauffer, B. E., Goldstein, L. D., Appling, L. L., Borneo, J., Poon, C., Ho, T., Cai, F., et al. (2016) · Nature Communications · doi:10.1038/ncomms11295 · Cited by 336
Genetic Control of Chromatin States in Humans Involves Local and Distal Chromosomal Interactions
Grubert, F., Zaugg, J. B., Kasowski, M., Ursu, O., Spacek, D. V., Martin, A. R., Greenside, P., Srivas, R., Phanstiel, D. H., Pekowska, A., et al. (2015) · Cell · doi:10.1016/j.cell.2015.07.048 · Cited by 319
Direct Comparative Analyses of 10X Genomics Chromium and Smart-Seq2
Wang, X., He, Y., Zhang, Q., Ren, X., & Zhang, Z. (2021) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2020.02.005 · Cited by 320
Effects of Vendor and Genetic Background on the Composition of the Fecal Microbiota of Inbred Mice
Ericsson, A. C., Davis, J. W., Spollen, W., Bivens, N., Givan, S., Hagan, C. E., McIntosh, M., & Franklin, C. L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0116704 · Cited by 311
Shimada, K., Hayano, M., Pagano, N. C., & Stockwell, B. R. (2016) · Cell Chemical Biology · doi:10.1016/j.chembiol.2015.11.016 · Cited by 297
Legchenko, E., Chouvarine, P., Borchert, P., Fernandez-Gonzalez, A., Snay, E., Meier, M., Maegel, L., Mitsialis, S. A., Rog-Zielinska, E. A., Kourembanas, S., et al. (2018) · Science Translational Medicine · doi:10.1126/scitranslmed.aao0303 · Cited by 295
Data-based filtering for replicated high-throughput transcriptome sequencing experiments
Rau, A., Gallopin, M., Celeux, G., & Jaffrézic, F. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt350 · Cited by 272
Machine learning for microbiologists
Asnicar, F., Thomas, A. M., Passerini, A., Waldron, L., & Segata, N. (2024) · Nature Reviews Microbiology · doi:10.1038/s41579-023-00984-1 · Cited by 256
Nrros negatively regulates reactive oxygen species during host defence and autoimmunity
Noubade, R., Wong, K., Ota, N., Rutz, S., Eidenschenk, C., Valdez, P. A., Ding, J., Peng, I., Sebrell, A., Caplazi, P., et al. (2014) · Nature · doi:10.1038/nature13152 · Cited by 246
Observation weights unlock bulk RNA-seq tools for zero inflation and single-cell applications
Van den Berge, K., Perraudeau, F., Soneson, C., Love, M. I., Risso, D., Vert, J.-P., Robinson, M. D., Dudoit, S., & Clement, L. (2018) · Genome Biology · doi:10.1186/s13059-018-1406-4 · Cited by 228
Van den Berge, K., Soneson, C., Robinson, M. D., & Clement, L. (2017) · Genome Biology · doi:10.1186/s13059-017-1277-0 · Cited by 126
scPower accelerates and optimizes the design of multi-sample single cell transcriptomic studies
Schmid, K. T., Höllbacher, B., Cruceanu, C., Böttcher, A., Lickert, H., Binder, E. B., Theis, F. J., & Heinig, M. (2021) · Nature Communications · doi:10.1038/s41467-021-26779-7 · Cited by 108
Koechli, C., Campbell, A. N., Pepe-Ranney, C., & Buckley, D. H. (2019) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2018.12.013 · Cited by 108
Bayesian joint analysis of heterogeneous genomics data
Ray, P., Zheng, L., Lucas, J., & Carin, L. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu064 · Cited by 84
GO-PCA: An Unsupervised Method to Explore Gene Expression Data Using Prior Knowledge
Wagner, F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0143196 · Cited by 35
Polarized Entry of Human Parechoviruses in the Airway Epithelium
Karelehto, E., Cristella, C., Yu, X., Sridhar, A., Hulsdouw, R., de Haan, K., van Eijk, H., Koekkoek, S., Pajkrt, D., de Jong, M. D., et al. (2018) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2018.00294 · Cited by 26
Khatir, I., Brunet, M. A., Meller, A., Amiot, F., Patel, T., Lapointe, X., Avila Lopez, J., Guilloy, N., Castonguay, A., Husain, M. A., et al. (2023) · Cells · doi:10.3390/cells12040615 · Cited by 22
Martin, L. E., Barr, J. S., Cartailler, J.-P., Shrestha, S., Estévez-Lao, T. Y., & Hillyer, J. F. (2025) · Immunity & Ageing · doi:10.1186/s12979-025-00551-7 · Cited by 3
Metadata
- Authors
- Bourgon, R., Gentleman, R., & Huber, W.
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2010-05-11
- Volume
- 107
- Issue
- 21
- Pages
- 9546-9551
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2058358568
- Cited by
- 740
- References
- 29
- FWCI
- 9.10
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.