Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 174

The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.

Naught all zeros in sequence count data are the same

Open access
Silverman, Justin D., Roche, Kimberly, Mukherjee, Sayan, David, Lawrence A. · 2020 · Computational and Structural Biotechnology Journal

Published version of a preprint

Abstract

Genomic studies feature multivariate count data from high-throughput DNA sequencing experiments, which often contain many zero values. These zeros can cause artifacts for statistical analyses and multiple modeling approaches have been developed in response. Here, we apply different zero-handling models to gene-expression and microbiome datasets and show models can disagree substantially in terms of identifying the most differentially expressed sequences. Next, to rationally examine how different zero handling models behave, we developed a conceptual framework outlining four types of processes that may give rise to zero values in sequence count data. Last, we performed simulations to test how zero handling models behave in the presence of these different zero generating processes. Our simulations showed that simple count models are sufficient across multiple processes, even when the true underlying process is unknown. On the other hand, a common zero handling technique known as "zero-inflation" was only suitable under a zero generating process associated with an unlikely set of biological and experimental conditions. In concert, our work here suggests several specific guidelines for developing and choosing state-of-the-art models for analyzing sparse sequence count data.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.csbj.2020.09.014

Cites

19 of 19 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 19 references

Research works printed but not linked: 63

  1. Weiss S., Xu Z.Z., Peddada S., Amir A., Bittinger K., Gonzalez A., Lozupone C., Zaneveld J.R., Vázquez-Baeza Y., Birmingham A., Hyde E.R. and Knight R.: Normalization and microbial differential abundance strategies depend upon data characteristics. Microbiome 2017; 5: 27. · DOI · Paper page
  2. Kaul A., Mandal S., Davidov O. and Peddada S.D.: Analysis of microbiome data in the presence of excess zeros. Front Microbiol 2017; 8: 2114. · DOI · Paper page
  3. Zhu L., Lei J., Devlin B. and Roeder K.: A unified statistical framework for single cell and bulk RNA sequencing data. Annals Appl Stat 2018; 12: 609.
  4. Silverman J.D., Washburne A.D., Mukherjee S. and David L.A.: A phylogenetic transform enhances analysis of compositional microbiota data. eLife 2017; 6: e21887. · DOI · Paper page
  5. 10.1146/annurev-statistics-010814-020351 · DOI · Paper page
  6. Gloor G.B., Macklaim J.M., Vu M. and Fernandes A.D.: Compositional uncertainty should not be ignored in high-throughput sequencing data analysis. Austrian J Stat 2016; 45: 73. · DOI
  7. Thorsen J., Brejnrod A., Mortensen M., Rasmussen M.A., Stokholm J., Al-Soud W.A., Sørensen S., Bisgaard H. and Waage J.: Large-scale benchmarking reveals false discoveries and count transformation sensitivity in 16S rRNA gene amplicon data analysis methods used in microbiome studies. Microbiome 2016; 4: 62. · DOI · Paper page
  8. Soneson C. and Robinson M.D.: Bias, robustness and scalability in single-cell differential expression analysis. Nature Methods 2018; 15: 255. · DOI · Paper page
  9. Aitchison J.: The statistical analysis of compositional data. Monographs on statistics and applied probability. London; New York: Chapman and Hall 1986.
  10. 10.1186/s13059-014-0550-8 · DOI · Paper page
  11. Aijö T., Mü Ller C.L. and Bonneau R.: Temporal probabilistic modeling of bacterial compositions derived from 16S rRNA sequencing. Bioinformatics 2017; .
  12. Silverman J.D., Durand H.K., Bloom R.J., Mukherjee S. and David L.A.: Dynamic linear models guide design and analysis of microbiota studies within artificial human guts. Microbiome 2018; 6: 202. · DOI
  13. Grantham NS Reich BJ Borer ET Gross K. MIMIX: a Bayesian Mixed-Effects Model for Microbiome Data from Designed Experiments. arXiv 2017.
  14. La Rosa P.S., Brooks J.P., Deych E., Boone E.L., Edwards D.J., Wang Q., Sodergren E., Weinstock G. and Shannon W.D.: Hypothesis testing and power calculations for taxonomic-based human microbiome data. PLOS ONE 2012; 7: 1. · DOI · Paper page
  15. Wang J., Huang M., Torre E., Dueck H., Shaffer S., Murray J., Raj A., Li M. and Zhang N.R.: Gene expression distribution deconvolution in single-cell RNA sequencing. Proc Nat Acad Sci 2018; 115: E6437.
  16. 10.1038/nmeth.2967 · DOI · Paper page
  17. Gong W., Kwak I.-Y., Pota P., Koyano-Nakagawa N. and Garry D.J.: DrImpute: imputing dropout events in single cell rna sequencing data. BMC Bioinform 2018; 19: 220. · DOI · Paper page
  18. Leote AC Wu X Beyer A. Network-based imputation of dropouts in single-cell RNA sequencing data. bioRxiv; 2019. · DOI
  19. 10.1186/s13059-017-1188-0 · DOI · Paper page
  20. 10.1186/s13059-015-0805-z · DOI · Paper page
  21. Ye C., Speed T.P. and Salim A.: DECENT: differential expression with capture efficiency adjustment for single-cell RNA-seq data. Bioinformatics 2019; 6.
  22. Alam M., Al Mahi N. and Begum M.: Zero-inflated models for RNA-Seq count data. J Biomed Anal 2018; 1.
  23. Choi H., Gim J., Won S., Kim Y.J., Kwon S. and Park C.: Network analysis for count data with excess zeros. BMC Genetics 2017; 18: 93. · DOI
  24. Oh S. and Song S.: Bayesian modeling approaches for temporal dynamics in RNA-seq data. New Insights into Bayesian Inference 2018; : 7.
  25. Zhou Y., Wan X., Zhang B. and Tong T.: Classifying next-generation sequencing data using a zero-inflated poisson model. Bioinformatics 2017; 34: 1329. · DOI
  26. 10.7717/peerj.4600 · DOI · Paper page
  27. Ho N.T., Li F., Wang S. and Kuhn L.: metamicrobiomeR: an R package for analysis of microbiome relative abundance data using zero-inflated beta GAMLSS and meta-analysis across studies using random effects models. BMC Bioinform 2019; 20: 188. · DOI
  28. Jonsson V., Österlund T., Nerman O. and Kristiansson E.: Modelling of zero-inflation improves inference of metagenomic gene count data. Statistical Methods in Medical Research 2018; . p. 0962280218811354.
  29. Lee K.H., Coull B.A., Moscicki A.-B., Paster B.J. and Starr J.R.: Bayesian variable selection for multivariate zero-inflated models: Application to microbiome count data. Biostatistics 2018; 12.
  30. Li Q Jiang S Koh AY Xiao G Zhan X. Bayesian Modeling of Microbiome Data for Differential Abundance Analysis. arXiv e-prints p. arXiv:1902.08741; 2019. · arXiv
  31. 10.1038/nmeth.2658 · DOI · Paper page
  32. Peng X., Li G. and Liu Z.: Zero-inflated beta regression for differential abundance analysis with metagenomics data. J Comput Biol 2016; 23: 102. · DOI
  33. Xia Y., Sun J. and Chen D.-G.: ”Modeling zero-inflated microbiome data,” in Statistical Analysis of Microbiome Data with R. : Springer 2018: 453. · DOI
  34. 10.1371/journal.pone.0129606 · DOI · Paper page
  35. Haglund F., Ma R., Huss M., Sulaiman L., Lu M., Nilsson I.-L., Höög A., Juhlin C.C., Hartman J. and Larsson C.: Evidence of a functional estrogen receptor in parathyroid adenomas. J Clin Endocrinol Metab 2012; 97: 4631. · DOI
  36. McMurrough T.A., Dickson R.J., Thibert S.M., Gloor G.B. and Edgell D.R.: Control of catalytic efficiency by a coevolving network of catalytic and noncatalytic residues. Proc Nat Acad Sci 2014; 111: E2376. · DOI
  37. 10.1101/gr.126573.111 · DOI · Paper page
  38. 10.1016/j.chom.2014.02.005 · DOI · Paper page
  39. 10.1093/bioinformatics/btp616 · DOI · Paper page
  40. Forsyth A., Raslan K., Lyashenko C., Bona S., Snow M., Khor B., Herrman E., Ortiz S., Choi D., Maier T. et al: Children with autism spectrum disorder: Pilot studies examining the salivary microbiome and implications for gut metabolism and social behavior. Human Microbiome J 2020; 15: 100066. · DOI
  41. 10.1371/journal.pbio.3000711 · DOI
  42. 10.1080/02713683.2019.1697453 · DOI
  43. Benjamini Y. and Speed T.P.: Summarizing and correcting the GC content bias in high-throughput sequencing. Nucleic Acids Res 2012; 40. pp. e72–e72. · DOI · Paper page
  44. 10.1186/gb-2011-12-2-r18 · DOI · Paper page
  45. Shen S.-Q., Yan X.-W., Li P.-T. and Ji X.-H.: Analysis of differential gene expression by RNA-seq data in abcg1 knockout mice. Gene 2019; 689: 24. · DOI
  46. Farris M. and Olson J.: Detection of actinobacteria cultivated from environmental samples reveals bias in universal primers. Lett Appl Microbiol 2007; 45: 376. · DOI
  47. 10.1128/AEM.64.10.3724-3730.1998 · DOI · Paper page
  48. 10.1128/AEM.71.12.8966-8969.2005 · DOI · Paper page
  49. Silverman J.D., Bloom R.J., Jiang S, Durand H.K., Mukherjee S and David L.A.: Measuring and mitigating PCR bias in microbiome data. bioRxiv 2019; : 604025.
  50. Pinto A.J. and Raskin L.: PCR biases distort bacterial and archaeal community structure in pyrosequencing datasets. PloS ONE 2012; 7. · DOI · Paper page
  51. 10.1111/1462-2920.14091 · DOI
  52. Eddy S.R.: What is Bayesian statistics?. Nature Biotechnol 2004; 22: 1177. · DOI
  53. McMurdie P.J. and Holmes S.: Waste Not, Want Not: Why Rarefying Microbiome Data Is Inadmissible. PLoS Comput Biol 2014; 10. · DOI · Paper page
  54. Quinn T.P., Crowley T.M. and Richardson M.F.: Benchmarking differential expression analysis tools for RNA-seq: normalization-based vs. log-ratio transformation-based methods. BMC Bioinform 2018; 19: 274. · DOI
  55. 10.1038/nmeth.4150 · DOI · Paper page
  56. Silverman JD Roche K Holmes ZC David LA Mukherjee S. Bayesian multinomial logistic normal models through marginally latent matrix-T processes. arXiv e-prints p. arXiv:1903.11695; 2019. · arXiv
  57. Ren X Kuan PF. Negative binomial additive model for RNA-Seq data analysis. bioRxiv; 2019. · doi:10.1101/599811
  58. Holmes I., Harris K. and Quince C.: Dirichlet multinomial mixtures: generative models for microbial metagenomics. PLOS ONE 2012; 7: 1. · DOI · Paper page
  59. Gao X., Lin H. and Dong Q.: A Dirichlet-multinomial Bayes classifier for disease diagnosis with microbial compositions. mSphere 2017; 2.
  60. Dong K., Zhao H., Tong T. and Wan X.: NBLDA: negative binomial linear discriminant analysis for RNA-seq data. BMC Bioinform Sep 2016; 17: 369. · DOI
  61. Baruzzo G., Hayer K.E., Kim E.J., Di Camillo B., FitzGerald G.A. and Grant G.R.: Simulation-based comprehensive benchmarking of RNA-seq aligners. Nature Methods 2017; 14: 135. · DOI · Paper page
  62. 10.1038/s41598-017-01617-3 · DOI · Paper page
  63. 10.3102/1076998615606113 · DOI · Paper page

Cited by

See all 174

Metadata

Authors
Silverman, J. D., Roche, K., Mukherjee, S., & David, L. A.
Venue
Computational and Structural Biotechnology Journal
Published
2020
Volume
18
Pages
2789-2798
ISSN
2001-0370 (ISSN-L)
OpenAlex
W3091376159
Cited by
174
References
19
FWCI
5.81
Type
journal article
Language
en
Open access
gold
Licence
Funders
National Institutes of Health

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Naught all zeros in sequence count data are the same. https://app.cochat.ai/papers/10.1016/j.csbj.2020.09.014
The paper
Silverman, J. D., Roche, K., Mukherjee, S., & David, L. A. (2020). Naught all zeros in sequence count data are the same. Computational and Structural Biotechnology Journal. https://doi.org/10.1016/j.csbj.2020.09.014

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.