The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Naught all zeros in sequence count data are the same
Open accessPublished version of a preprint
Abstract
Genomic studies feature multivariate count data from high-throughput DNA sequencing experiments, which often contain many zero values. These zeros can cause artifacts for statistical analyses and multiple modeling approaches have been developed in response. Here, we apply different zero-handling models to gene-expression and microbiome datasets and show models can disagree substantially in terms of identifying the most differentially expressed sequences. Next, to rationally examine how different zero handling models behave, we developed a conceptual framework outlining four types of processes that may give rise to zero values in sequence count data. Last, we performed simulations to test how zero handling models behave in the presence of these different zero generating processes. Our simulations showed that simple count models are sufficient across multiple processes, even when the true underlying process is unknown. On the other hand, a common zero handling technique known as "zero-inflation" was only suitable under a zero generating process associated with an unlikely set of biological and experimental conditions. In concert, our work here suggests several specific guidelines for developing and choosing state-of-the-art models for analyzing sparse sequence count data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
Massively parallel digital transcriptional profiling of single cells
Zheng, G. X. Y., Terry, J. M., Belgrader, P., Ryvkin, P., Bent, Z. W., Wilson, R., Ziraldo, S. B., Wheeler, T. D., McDermott, G. P., Zhu, J., et al. (2017) · Nature Communications · doi:10.1038/ncomms14049 · Cited by 7,353
Finak, G., McDavid, A., Yajima, M., Deng, J., Gersuk, V., Shalek, A. K., Slichter, C. K., Miller, H. W., McElrath, M. J., Prlic, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0844-5 · Cited by 3,159
Tackling the widespread and critical impact of batch effects in high-throughput data
Leek, J. T., Scharpf, R. B., Bravo, H. C., Simcha, D., Langmead, B., Johnson, W. E., Geman, D., Baggerly, K., & Irizarry, R. A. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2825 · Cited by 2,196
Fernandes, A. D., Reid, J. N., Macklaim, J. M., McMurrough, T. A., Edgell, D. R., & Gloor, G. B. (2014) · Microbiome · doi:10.1186/2049-2618-2-15 · Cited by 1,329
Computational and analytical challenges in single-cell transcriptomics
Stegle, O., Teichmann, S. A., & Marioni, J. C. (2015) · Nature Reviews Genetics · doi:10.1038/nrg3833 · Cited by 1,170
Pooling across cells to normalize single-cell RNA sequencing data with many zero counts
L. Lun, A. T., Bach, K., & Marioni, J. C. (2016) · Genome Biology · doi:10.1186/s13059-016-0947-7 · Cited by 1,108
Pollen, A. A., Nowakowski, T. J., Shuga, J., Wang, X., Leyrat, A. A., Lui, J. H., Li, N., Szpankowski, L., Fowler, B., Chen, P., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.2967 · Cited by 920
A general and flexible method for signal extraction from single-cell RNA-seq data
Risso, D., Perraudeau, F., Gribkova, S., Dudoit, S., & Vert, J.-P. (2018) · Nature Communications · doi:10.1038/s41467-017-02554-5 · Cited by 718
The Microbiome Quality Control Project Consortium, Sinha, R., Abu-Ali, G., Vogtmann, E., Fodor, A. A., Ren, B., Amir, A., Schwager, E., Crabtree, J., Ma, S., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3981 · Cited by 587
Rapid non-uniform adaptation to conformation-specific KRAS(G12C) inhibition
Xue, J. Y., Zhao, Y., Aronowitz, J., Mai, T. T., Vides, A., Qeriqi, B., Kim, D., Li, C., de Stanchina, E., Mazutis, L., et al. (2020) · Nature · doi:10.1038/s41586-019-1884-x · Cited by 543
Feature selection and dimension reduction for single-cell RNA-Seq based on a multinomial model
Townes, F. W., Hicks, S. C., Aryee, M. J., & Irizarry, R. A. (2019) · Genome Biology · doi:10.1186/s13059-019-1861-6 · Cited by 471
Droplet scRNA-seq is not zero-inflated
Svensson, V. (2019) · doi:10.1101/582064 · Cited by 356
Staphylococcus aureus and the ecology of the nasal microbiome
Liu, C. M., Price, L. B., Hungate, B. A., Abraham, A. G., Larsen, L. A., Christensen, K., Stegger, M., Skov, R., & Andersen, P. S. (2015) · Science Advances · doi:10.1126/sciadv.1400216 · Cited by 253
A two-part mixed-effects model for analyzing longitudinal microbiome compositional data
Chen, E. Z., & Li, H. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw308 · Cited by 234
Observation weights unlock bulk RNA-seq tools for zero inflation and single-cell applications
Van den Berge, K., Perraudeau, F., Soneson, C., Love, M. I., Risso, D., Vert, J.-P., Robinson, M. D., Dudoit, S., & Clement, L. (2018) · Genome Biology · doi:10.1186/s13059-018-1406-4 · Cited by 228
A Logistic Normal Multinomial Regression Model for Microbiome Compositional Data Analysis
Xia, F., Chen, J., Fung, W. K., & Li, H. (2013) · Biometrics · doi:10.1111/biom.12079 · Cited by 144
False signals induced by single-cell imputation
Andrews, T. S., & Hemberg, M. (2018) · F1000Research · doi:10.12688/f1000research.16613.1 · Cited by 142
Single-Cell RNA-Sequencing: Assessment of Differential Expression Analysis Methods
Dal Molin, A., Baruzzo, G., & Di Camillo, B. (2017) · Frontiers in Genetics · doi:10.3389/fgene.2017.00062 · Cited by 107
Research works printed but not linked: 63
- Weiss S., Xu Z.Z., Peddada S., Amir A., Bittinger K., Gonzalez A., Lozupone C., Zaneveld J.R., Vázquez-Baeza Y., Birmingham A., Hyde E.R. and Knight R.: Normalization and microbial differential abundance strategies depend upon data characteristics. Microbiome 2017; 5: 27. · DOI · Paper page
- Kaul A., Mandal S., Davidov O. and Peddada S.D.: Analysis of microbiome data in the presence of excess zeros. Front Microbiol 2017; 8: 2114. · DOI · Paper page
- Zhu L., Lei J., Devlin B. and Roeder K.: A unified statistical framework for single cell and bulk RNA sequencing data. Annals Appl Stat 2018; 12: 609.
- Silverman J.D., Washburne A.D., Mukherjee S. and David L.A.: A phylogenetic transform enhances analysis of compositional microbiota data. eLife 2017; 6: e21887. · DOI · Paper page
- 10.1146/annurev-statistics-010814-020351 · DOI · Paper page
- Gloor G.B., Macklaim J.M., Vu M. and Fernandes A.D.: Compositional uncertainty should not be ignored in high-throughput sequencing data analysis. Austrian J Stat 2016; 45: 73. · DOI
- Thorsen J., Brejnrod A., Mortensen M., Rasmussen M.A., Stokholm J., Al-Soud W.A., Sørensen S., Bisgaard H. and Waage J.: Large-scale benchmarking reveals false discoveries and count transformation sensitivity in 16S rRNA gene amplicon data analysis methods used in microbiome studies. Microbiome 2016; 4: 62. · DOI · Paper page
- Soneson C. and Robinson M.D.: Bias, robustness and scalability in single-cell differential expression analysis. Nature Methods 2018; 15: 255. · DOI · Paper page
- Aitchison J.: The statistical analysis of compositional data. Monographs on statistics and applied probability. London; New York: Chapman and Hall 1986.
- 10.1186/s13059-014-0550-8 · DOI · Paper page
- Aijö T., Mü Ller C.L. and Bonneau R.: Temporal probabilistic modeling of bacterial compositions derived from 16S rRNA sequencing. Bioinformatics 2017; .
- Silverman J.D., Durand H.K., Bloom R.J., Mukherjee S. and David L.A.: Dynamic linear models guide design and analysis of microbiota studies within artificial human guts. Microbiome 2018; 6: 202. · DOI
- Grantham NS Reich BJ Borer ET Gross K. MIMIX: a Bayesian Mixed-Effects Model for Microbiome Data from Designed Experiments. arXiv 2017.
- La Rosa P.S., Brooks J.P., Deych E., Boone E.L., Edwards D.J., Wang Q., Sodergren E., Weinstock G. and Shannon W.D.: Hypothesis testing and power calculations for taxonomic-based human microbiome data. PLOS ONE 2012; 7: 1. · DOI · Paper page
- Wang J., Huang M., Torre E., Dueck H., Shaffer S., Murray J., Raj A., Li M. and Zhang N.R.: Gene expression distribution deconvolution in single-cell RNA sequencing. Proc Nat Acad Sci 2018; 115: E6437.
- 10.1038/nmeth.2967 · DOI · Paper page
- Gong W., Kwak I.-Y., Pota P., Koyano-Nakagawa N. and Garry D.J.: DrImpute: imputing dropout events in single cell rna sequencing data. BMC Bioinform 2018; 19: 220. · DOI · Paper page
- Leote AC Wu X Beyer A. Network-based imputation of dropouts in single-cell RNA sequencing data. bioRxiv; 2019. · DOI
- 10.1186/s13059-017-1188-0 · DOI · Paper page
- 10.1186/s13059-015-0805-z · DOI · Paper page
- Ye C., Speed T.P. and Salim A.: DECENT: differential expression with capture efficiency adjustment for single-cell RNA-seq data. Bioinformatics 2019; 6.
- Alam M., Al Mahi N. and Begum M.: Zero-inflated models for RNA-Seq count data. J Biomed Anal 2018; 1.
- Choi H., Gim J., Won S., Kim Y.J., Kwon S. and Park C.: Network analysis for count data with excess zeros. BMC Genetics 2017; 18: 93. · DOI
- Oh S. and Song S.: Bayesian modeling approaches for temporal dynamics in RNA-seq data. New Insights into Bayesian Inference 2018; : 7.
- Zhou Y., Wan X., Zhang B. and Tong T.: Classifying next-generation sequencing data using a zero-inflated poisson model. Bioinformatics 2017; 34: 1329. · DOI
- 10.7717/peerj.4600 · DOI · Paper page
- Ho N.T., Li F., Wang S. and Kuhn L.: metamicrobiomeR: an R package for analysis of microbiome relative abundance data using zero-inflated beta GAMLSS and meta-analysis across studies using random effects models. BMC Bioinform 2019; 20: 188. · DOI
- Jonsson V., Österlund T., Nerman O. and Kristiansson E.: Modelling of zero-inflation improves inference of metagenomic gene count data. Statistical Methods in Medical Research 2018; . p. 0962280218811354.
- Lee K.H., Coull B.A., Moscicki A.-B., Paster B.J. and Starr J.R.: Bayesian variable selection for multivariate zero-inflated models: Application to microbiome count data. Biostatistics 2018; 12.
- Li Q Jiang S Koh AY Xiao G Zhan X. Bayesian Modeling of Microbiome Data for Differential Abundance Analysis. arXiv e-prints p. arXiv:1902.08741; 2019. · arXiv
- 10.1038/nmeth.2658 · DOI · Paper page
- Peng X., Li G. and Liu Z.: Zero-inflated beta regression for differential abundance analysis with metagenomics data. J Comput Biol 2016; 23: 102. · DOI
- Xia Y., Sun J. and Chen D.-G.: ”Modeling zero-inflated microbiome data,” in Statistical Analysis of Microbiome Data with R. : Springer 2018: 453. · DOI
- 10.1371/journal.pone.0129606 · DOI · Paper page
- Haglund F., Ma R., Huss M., Sulaiman L., Lu M., Nilsson I.-L., Höög A., Juhlin C.C., Hartman J. and Larsson C.: Evidence of a functional estrogen receptor in parathyroid adenomas. J Clin Endocrinol Metab 2012; 97: 4631. · DOI
- McMurrough T.A., Dickson R.J., Thibert S.M., Gloor G.B. and Edgell D.R.: Control of catalytic efficiency by a coevolving network of catalytic and noncatalytic residues. Proc Nat Acad Sci 2014; 111: E2376. · DOI
- 10.1101/gr.126573.111 · DOI · Paper page
- 10.1016/j.chom.2014.02.005 · DOI · Paper page
- 10.1093/bioinformatics/btp616 · DOI · Paper page
- Forsyth A., Raslan K., Lyashenko C., Bona S., Snow M., Khor B., Herrman E., Ortiz S., Choi D., Maier T. et al: Children with autism spectrum disorder: Pilot studies examining the salivary microbiome and implications for gut metabolism and social behavior. Human Microbiome J 2020; 15: 100066. · DOI
- 10.1371/journal.pbio.3000711 · DOI
- 10.1080/02713683.2019.1697453 · DOI
- Benjamini Y. and Speed T.P.: Summarizing and correcting the GC content bias in high-throughput sequencing. Nucleic Acids Res 2012; 40. pp. e72–e72. · DOI · Paper page
- 10.1186/gb-2011-12-2-r18 · DOI · Paper page
- Shen S.-Q., Yan X.-W., Li P.-T. and Ji X.-H.: Analysis of differential gene expression by RNA-seq data in abcg1 knockout mice. Gene 2019; 689: 24. · DOI
- Farris M. and Olson J.: Detection of actinobacteria cultivated from environmental samples reveals bias in universal primers. Lett Appl Microbiol 2007; 45: 376. · DOI
- 10.1128/AEM.64.10.3724-3730.1998 · DOI · Paper page
- 10.1128/AEM.71.12.8966-8969.2005 · DOI · Paper page
- Silverman J.D., Bloom R.J., Jiang S, Durand H.K., Mukherjee S and David L.A.: Measuring and mitigating PCR bias in microbiome data. bioRxiv 2019; : 604025.
- Pinto A.J. and Raskin L.: PCR biases distort bacterial and archaeal community structure in pyrosequencing datasets. PloS ONE 2012; 7. · DOI · Paper page
- 10.1111/1462-2920.14091 · DOI
- Eddy S.R.: What is Bayesian statistics?. Nature Biotechnol 2004; 22: 1177. · DOI
- McMurdie P.J. and Holmes S.: Waste Not, Want Not: Why Rarefying Microbiome Data Is Inadmissible. PLoS Comput Biol 2014; 10. · DOI · Paper page
- Quinn T.P., Crowley T.M. and Richardson M.F.: Benchmarking differential expression analysis tools for RNA-seq: normalization-based vs. log-ratio transformation-based methods. BMC Bioinform 2018; 19: 274. · DOI
- 10.1038/nmeth.4150 · DOI · Paper page
- Silverman JD Roche K Holmes ZC David LA Mukherjee S. Bayesian multinomial logistic normal models through marginally latent matrix-T processes. arXiv e-prints p. arXiv:1903.11695; 2019. · arXiv
- Ren X Kuan PF. Negative binomial additive model for RNA-Seq data analysis. bioRxiv; 2019. · doi:10.1101/599811
- Holmes I., Harris K. and Quince C.: Dirichlet multinomial mixtures: generative models for microbial metagenomics. PLOS ONE 2012; 7: 1. · DOI · Paper page
- Gao X., Lin H. and Dong Q.: A Dirichlet-multinomial Bayes classifier for disease diagnosis with microbial compositions. mSphere 2017; 2.
- Dong K., Zhao H., Tong T. and Wan X.: NBLDA: negative binomial linear discriminant analysis for RNA-seq data. BMC Bioinform Sep 2016; 17: 369. · DOI
- Baruzzo G., Hayer K.E., Kim E.J., Di Camillo B., FitzGerald G.A. and Grant G.R.: Simulation-based comprehensive benchmarking of RNA-seq aligners. Nature Methods 2017; 14: 135. · DOI · Paper page
- 10.1038/s41598-017-01617-3 · DOI · Paper page
- 10.3102/1076998615606113 · DOI · Paper page
Cited by
Statistics or biology: the zero-inflation controversy about scRNA-seq data
Jiang, R., Sun, T., Song, D., & Li, J. J. (2022) · Genome Biology · doi:10.1186/s13059-022-02601-5 · Cited by 614
Estaki, M., Jiang, L., Bokulich, N. A., McDonald, D., González, A., Kosciolek, T., Martino, C., Zhu, Q., Birmingham, A., Vázquez‐Baeza, Y., et al. (2020) · Current Protocols in Bioinformatics · doi:10.1002/cpbi.100 · Cited by 565
A Novel Sparse Compositional Technique Reveals Microbial Perturbations
Martino, C., Morton, J. T., Marotz, C. A., Thompson, L. R., Tripathi, A., Knight, R., & Zengler, K. (2019) · mSystems · doi:10.1128/msystems.00016-19 · Cited by 556
Host-Viral Infection Maps Reveal Signatures of Severe COVID-19 Patients
Bost, P., Giladi, A., Liu, Y., Bendjelal, Y., Xu, G., David, E., Blecher-Gonen, R., Cohen, M., Medaglia, C., Li, H., et al. (2020) · Cell · doi:10.1016/j.cell.2020.05.006 · Cited by 471
Feature selection and dimension reduction for single-cell RNA-Seq based on a multinomial model
Townes, F. W., Hicks, S. C., Aryee, M. J., & Irizarry, R. A. (2019) · Genome Biology · doi:10.1186/s13059-019-1861-6 · Cited by 471
Metadata
- Authors
- Silverman, J. D., Roche, K., Mukherjee, S., & David, L. A.
- Venue
- Computational and Structural Biotechnology Journal
- Published
- 2020
- Volume
- 18
- Pages
- 2789-2798
- ISSN
- 2001-0370 (ISSN-L)
- OpenAlex
- W3091376159
- Cited by
- 174
- References
- 19
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 254 d)
- Funders
- National Institutes of Health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.