Robust hyperparameter estimation protects against hypervariable genes and improves power to detect differential expression
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
One of the most common analysis tasks in genomic research is to identify genes that are differentially expressed (DE) between experimental conditions. Empirical Bayes (EB) statistical tests using moderated genewise variances have been very effective for this purpose, especially when the number of biological replicate samples is small. The EB procedures can however be heavily influenced by a small number of genes with very large or very small variances. This article improves the differential expression tests by robustifying the hyperparameter estimation procedure. The robust procedure has the effect of decreasing the informativeness of the prior distribution for outlier genes while increasing its informativeness for other genes. This effect has the double benefit of reducing the chance that hypervariable genes will be spuriously identified as DE while increasing statistical power for the main body of genes. The robust EB algorithm is fast and numerically stable. The procedure allows exact small-sample null distributions for the test statistics and reduces exactly to the original EB procedure when no outlier genes are present. Simulations show that the robustified tests have similar performance to the original tests in the absence of outlier genes but have greater power and robustness when outliers are present. The article includes case studies for which the robust method correctly identifies and downweights genes associated with hidden covariates and detects more genes likely to be scientifically relevant to the experimental conditions. The new procedure is implemented in the limma software package freely available from the Bioconductor repository.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp616 · Cited by 41,364
Self-citationlimma powers differential expression analyses for RNA-sequencing and microarray studies
Ritchie, M. E., Phipson, B., Wu, D., Hu, Y., Law, C. W., Shi, W., & Smyth, G. K. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv007 · Cited by 40,458
Self-citationSmyth, G. K. (2004) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1027 · Cited by 11,829
Self-citationRobust Locally Weighted Regression and Smoothing Scatterplots
Cleveland, W. S. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481038 · Cited by 11,594
Bolstad, B. M., Irizarry, R. A., Åstrand, M., & Speed, T. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.185 · Cited by 8,266
voom: precision weights unlock linear model analysis tools for RNA-seq read counts
Law, C. W., Chen, Y., Shi, W., & Smyth, G. K. (2014) · Genome Biology · doi:10.1186/gb-2014-15-2-r29 · Cited by 6,155
Self-citationTukey, J. W. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704711 · Cited by 1,860
Baldi, P., & Long, A. D. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.6.509 · Cited by 1,618
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448 · cited 8×
“Morris, C. N. (1983). Parametric empirical Bayes inference: theory and applications. Journal of the American Statistical Association 78, 47–55. Murie, C., Woody, O., Lee, A. Y. and Nadon, R. (2009). Comparison of small n statistical tests of differential expression applied to microarrays. BMC Bioinformatics 10, 45. Pi…”
BackgroundInfluentialUnderstanding mechanisms underlying human gene expression variation with RNA sequencing
Pickrell, J. K., Marioni, J. C., Pai, A. A., Degner, J. F., Engelhardt, B. E., Nkadori, E., Veyrieras, J.-B., Stephens, M., Gilad, Y., & Pritchard, J. K. (2010) · Nature · doi:10.1038/nature08872 · Cited by 1,256 · cited 1×
“As part of the International HapMap project, RNA-Seq profiles were made of cell lines derived from B lymphocytes from 69 different Yoruba individuals from Ibadan, Nigeria (Pickrell et al., 2010a,b).”
BackgroundStein's Estimation Rule and its Competitors—An Empirical Bayes Approach
Efron, B., & Morris, C. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481350 · Cited by 981
Testing significance relative to a fold-change threshold is a TREAT
McCarthy, D. J., & Smyth, G. K. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp053 · Cited by 721
Self-citationWright, G. W., & Simon, R. M. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg345 · Cited by 665
An Introduction to Empirical Bayes Data Analysis
Casella, G. (1985) · The American Statistician · doi:10.1080/00031305.1985.10479400 · Cited by 521
Lun, A. T. L., & Smyth, G. K. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1191 · Cited by 497
Self-citationLun, A. T. L., Chen, Y., & Smyth, G. K. (2016) · Methods in Molecular Biology · doi:10.1007/978-1-4939-3578-9_19 · Cited by 418
Self-citationRobustly detecting differential expression in RNA sequencing data using observation weights
Zhou, X., Lindsay, H., & Robinson, M. D. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku310 · Cited by 387
Robust Bayesian analysis: sensitivity to the prior
Berger, J. O. (1990) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(90)90079-a · Cited by 371
Noisy Splicing Drives mRNA Isoform Diversity in Human Cells
Pickrell, J. K., Pai, A. A., Gilad, Y., & Pritchard, J. K. (2010) · PLoS Genetics · doi:10.1371/journal.pgen.1001236 · Cited by 311 · cited 1×
“As part of the International HapMap project, RNA-Seq profiles were made of cell lines derived from B lymphocytes from 69 different Yoruba individuals from Ibadan, Nigeria (Pickrell et al., 2010a,b).”
BackgroundSartor, M. A., Tomlinson, C. R., Wesselkamper, S. C., Sivaganesan, S., Leikauf, G. D., & Medvedovic, M. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-538 · Cited by 263 · cited 1×
“In gene expression experiments, the variance of the log-expression values often depends partly on the magnitude of the expression level (Sartor et al., 2006; Law et al., 2014).”
BackgroundLimiting the Risk of Bayes and Empirical Bayes Estimators—Part II: The Empirical Bayes Case
Efron, B., & Morris, C. (1972) · Journal of the American Statistical Association · doi:10.1080/01621459.1972.10481215 · Cited by 263
Optimizing the noise versus bias trade-off for Illumina Whole Genome Expression Beadchips
Shi, W., Oshlack, A., & Smyth, G. K. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq871 · Cited by 225
Self-citationdiffHic: a Bioconductor package to detect differential genomic interactions in Hi-C data
Lun, A. T. L., & Smyth, G. K. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0683-0 · Cited by 211
Self-citation(2000) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-1306-2 · Cited by 198
Differential Expression Analysis of Complex RNA-seq Experiments Using edgeR
Chen, Y., Lun, A. T. L., & Smyth, G. K. (2014) · Statistical Analysis of Next Generation Sequencing Data · doi:10.1007/978-3-319-07212-8_3 · Cited by 171
Self-citationJeanmougin, M., de Reynies, A., Marisa, L., Paccard, C., Nuel, G., & Guedj, M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012336 · Cited by 154
Polycomb Repressive Complex 2 (PRC2) Restricts Hematopoietic Stem Cell Activity
Majewski, I. J., Blewitt, M. E., de Graaf, C. A., McManus, E. J., Bahlo, M., Hilton, A. A., Hyland, C. D., Smyth, G. K., Corbin, J. E., Metcalf, D., et al. (2008) · PLoS Biology · doi:10.1371/journal.pbio.0060093 · Cited by 143
Self-citationOpposing roles of polycomb repressive complexes in hematopoietic stem and progenitor cells
Majewski, I. J., Ritchie, M. E., Phipson, B., Corbin, J., Pakusch, M., Ebert, A., Busslinger, M., Koseki, H., Hu, Y., Smyth, G. K., et al. (2010) · Blood · doi:10.1182/blood-2009-12-260760 · Cited by 135 · cited 1×
“Majewski et al. (2008, 2010) studied mice with a mutation in the Suz12 gene that results in loss of function of the Suz12 protein and hence PRC2.”
BackgroundComparison of small n statistical tests of differential expression applied to microarrays
Murie, C., Woody, O. Z., Lee, A. Y., & Nadon, R. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-45 · Cited by 98
Bayesian Robust Inference for Differential Gene Expression in Microarrays with Multiple Samples
Gottardo, R., Raftery, A. E., Yee Yeung, K., & Bumgarner, R. E. (2006) · Biometrics · doi:10.1111/j.1541-0420.2005.00397.x · Cited by 94
Significance testing for small microarray experiments
Kooperberg, C. L., Aragaki, A. K., Strand, A. D., & Olson, J. M. (2005) · Statistics in Medicine · doi:10.1002/sim.2109 · Cited by 75
Regulation of germinal center responses and B-cell memory by the chromatin modifier MOZ
Good-Jacobson, K. L., Chen, Y., Voss, A. K., Smyth, G. K., Thomas, T., & Tarlinton, D. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1402485111 · Cited by 64
Self-citationAnalyzing 'omics data using hierarchical models
Ji, H., & Liu, X. S. (2010) · Nature Biotechnology · doi:10.1038/nbt.1619 · Cited by 58
Sheikh, B. N., Downer, N. L., Phipson, B., Vanyai, H. K., Kueh, A. J., McCarthy, D. J., Smyth, G. K., Thomas, T., & Voss, A. K. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1422872112 · Cited by 38
Self-citationFrom reads to regions: a Bioconductor workflow to detect differential binding in ChIP-seq data
Lun, A. T. L., & Smyth, G. K. (2015) · F1000Research · doi:10.12688/f1000research.7016.1 · Cited by 21
Self-citationLiao, J., McMurry, T. L., & Berg, A. S. (2013) · Biostatistics · doi:10.1093/biostatistics/kxt026 · Cited by 5
Cited by
Chen, Y., Lun, A. T. L., & Smyth, G. K. (2016) · F1000Research · doi:10.12688/f1000research.8987.1 · Cited by 1,287
Self-citationMicrobiome differential abundance methods produce different results across 38 datasets
Nearing, J. T., Douglas, G. M., Hayes, M. G., MacDonald, J., Desai, D. K., Allward, N., Jones, C. M. A., Wright, R. J., Dhanani, A. S., Comeau, A. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28034-z · Cited by 992
Chen, Y., Chen, L., Lun, A. T. L., Baldoni, P. L., & Smyth, G. K. (2025) · Nucleic Acids Research · doi:10.1093/nar/gkaf018 · Cited by 816
Self-citationCheckpoint Blockade Immunotherapy Induces Dynamic Changes in PD-1-CD8+ Tumor-Infiltrating T Cells
Kurtulus, S., Madi, A., Escobar, G., Klapholz, M., Nyman, J., Christian, E., Pawlak, M., Dionne, D., Xia, J., Rozenblatt-Rosen, O., et al. (2019) · Immunity · doi:10.1016/j.immuni.2018.11.014 · Cited by 636
IL4I1 Is a Metabolic Immune Checkpoint that Activates the AHR and Promotes Tumor Progression
Sadik, A., Somarribas Patterson, L. F., Öztürk, S., Mohapatra, S. R., Panitz, V., Secker, P. F., Pfänder, P., Loth, S., Salem, H., Prentzell, M. T., et al. (2020) · Cell · doi:10.1016/j.cell.2020.07.038 · Cited by 559
Metadata
- Authors
- Phipson, B., Lee, S., Majewski, I. J., Alexander, W. S., & Smyth, G. K.
- Venue
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2016-06-01
- Volume
- 10
- Issue
- 2
- Pages
- 946-963
- ISSN
- 1932-6157 (ISSN-L)
- OpenAlex
- W2288929640
- Cited by
- 917
- References
- 37
- FWCI
- 25.13
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.