Effects of Rare Microbiome Taxa Filtering on Statistical Analysis
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Background: The accuracy of microbial community detection in 16S rRNA marker-gene and metagenomic studies suffers from contamination and sequencing errors that lead to either falsely identifying microbial taxa that were not in the sample or misclassifying the taxa of DNA fragment reads. Removing contaminants and filtering rare features are two common approaches to deal with this problem. While contaminant detection methods use auxiliary sequencing process information to identify known contaminants, filtering methods remove taxa that are present in a small number of samples and have small counts in the samples where they are observed. The latter approach reduces the extreme sparsity of microbiome data and has been shown to correctly remove contaminant taxa in cultured “mock” datasets, where the true taxa compositions are known. Although filtering is frequently used, careful evaluation of its effect on the data analysis and scientific conclusions remains unreported. Here, we assess the effect of filtering on the alpha and beta diversity estimation as well as its impact on identifying taxa that discriminate between disease states. Results: The effect of filtering on microbiome data analysis is illustrated on four datasets: two mock quality control datasets where the same cultured samples with known microbial composition are processed at different labs and two disease study datasets. Results show that in microbiome quality control datasets, filtering reduces the magnitude of differences in alpha diversity and alleviates technical variability between labs while preserving the between samples similarity (beta diversity). In the disease study datasets, DESeq2 and linear discriminant analysis Effect Size (LEfSe) methods were used to identify taxa that are differentially abundant across groups of samples, and random forest models were used to rank features with the largest contribution toward disease classification. Results reveal that filtering retains significant taxa and preserves the model classification ability measured by the area under the receiver operating characteristic curve (AUC). The comparison between the filtering and the contaminant removal method shows that they have complementary effects and are advised to be used in conjunction. Conclusions: Filtering reduces the complexity of microbiome data while preserving their integrity in downstream analysis. This leads to mitigation of the classification methods' sensitivity and reduction of technical variability, allowing researchers to generate more reproducible and comparable results in microbiome data analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
DADA2: High–resolution sample inference from Illumina amplicon data
Callahan, B. J., McMurdie, P. J., Rosen, M. J., Han, A. W., Johnson, A. J. A., & Holmes, S. P. (2016) · Nature Methods · doi:10.1038/nmeth.3869 · Cited by 35,698
Metagenomic biomarker discovery and explanation
Segata, N., Izard, J., Waldron, L., Gevers, D., Miropolsky, L., Garrett, W. S., & Huttenhower, C. (2011) · Genome Biology · doi:10.1186/gb-2011-12-6-r60 · Cited by 16,192 · cited 1×
“To identify differentially abundant taxa, DESeq2 (Love et al., 2014) and linear discriminant analysis effect size (LEfSe) (Segata et al., 2011) were used.”
MethodDavis, N. M., Proctor, D. M., Holmes, S. P., Relman, D. A., & Callahan, B. J. (2018) · Microbiome · doi:10.1186/s40168-018-0605-2 · Cited by 3,493 · cited 10×
“…recommended filtering without a thorough evaluation of its effects (Goodrich et al., 2014; Cullen et al., 2020), or focused on the number of taxa removed from the mock artificial community studies (Smirnova et al., 2019) and on contaminant identification (Knights et al., 2011; Davis et al., 2018).”
BackgroundMethodInfluentialReagent and laboratory contamination can critically impact sequence-based microbiome analyses
Salter, S. J., Cox, M. J., Turek, E. M., Calus, S. T., Cookson, W. O., Moffatt, M. F., Turner, P., Parkhill, J., Loman, N. J., & Walker, A. W. (2014) · BMC Biology · doi:10.1186/s12915-014-0087-z · Cited by 3,463 · cited 6×
“Davis et al. (2018) addressed this problem by introducing the R package decontam that identifies contaminants by: (1) inversely correlating taxa frequencies with sample DNA concentration and (2) using the prevalence of sequenced negative controls (Salter et al., 2014).”
BackgroundMethodInfluentialMulti-omics of the gut microbial ecosystem in inflammatory bowel diseases
Lloyd-Price, J., Arze, C., Ananthakrishnan, A. N., Schirmer, M., Avila-Pacheco, J., Poon, T. W., Andrews, E., Ajami, N. J., Bonham, K. S., Brislawn, C. J., et al. (2019) · Nature · doi:10.1038/s41586-019-1237-9 · Cited by 3,143 · cited 3×
“The initial findings and multi-omic datasets from these studies were published in the Nature family of journals in May and June of 2019 (Lloyd-Price et al., 2019), and 16S data are publicly available through the HMP Data Coordination Center (HMP-DACC) and HMP2Data Bioconductor package (Stansfield et…”
MethodTemporal and spatial variation of the human microbiota during pregnancy
DiGiulio, D. B., Callahan, B. J., McMurdie, P. J., Costello, E. K., Lyell, D. J., Robaczewska, A., Sun, C. L., Goltsman, D. S. A., Wong, R. J., Shaw, G., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1502875112 · Cited by 1,129 · cited 1×
“…an important role in the development of multiple diseases, including inflammatory bowel disease (Huttenhower et al., 2014), diabetes (Proctor, 2014; Pascale et al., 2019), preterm birth (DiGiulio et al., 2015; Callahan et al., 2017), and liver diseases (Puri et al., 2018; Smirnova et al., 2020 ).”
BackgroundGoodrich, J. K., Di Rienzi, S. C., Poole, A. C., Koren, O., Walters, W. A., Caporaso, J. G., Knight, R., & Ley, R. E. (2014) · Cell · doi:10.1016/j.cell.2014.06.037 · Cited by 714
(2014) · Cell Host & Microbe · doi:10.1016/j.chom.2014.08.014 · Cited by 536 · cited 2×
“, 2014), diabetes (Proctor, 2014; Pascale et al., 2019), preterm birth (DiGiulio et al.”
BackgroundThe truth about metagenomics: quantifying and counteracting bias in 16S rRNA studies
Vaginal Microbiome Consortium (additional members), Brooks, J. P., Edwards, D. J., Harwich, M. D., Rivera, M. C., Fettweis, J. M., Serrano, M. G., Reris, R. A., Sheth, N. U., Huang, B., et al. (2015) · BMC Microbiology · doi:10.1186/s12866-015-0351-6 · Cited by 528 · cited 1×
“…the PERFect approach proposed by Smirnova et al. (2019) and tested on two datasets acquired from mock community experiments carried out at Virginia Commonwealth University (VCU) (Fettweis et al., 2012; Brooks et al., 2015) and a reagent and laboratory contamination dataset ( Salter et al., 2014).”
MethodCallahan, B. J., DiGiulio, D. B., Goltsman, D. S. A., Sun, C. L., Costello, E. K., Jeganathan, P., Biggio, J. R., Wong, R. J., Druzin, M. L., Shaw, G. M., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1705899114 · Cited by 391
Inflammatory Bowel Disease as a Model for Translating the Microbiome
Huttenhower, C., Kostic, A. D., & Xavier, R. J. (2014) · Immunity · doi:10.1016/j.immuni.2014.05.013 · Cited by 332
The lung mycobiome: an emerging field of the human respiratory microbiome
Nguyen, L. D. N., Viscogliosi, E., & Delhaes, L. (2015) · Frontiers in Microbiology · doi:10.3389/fmicb.2015.00089 · Cited by 260 · cited 1×
“Studies of microbiota association and human disease states have received increasing attention over the last decade (Nguyen et al., 2015).”
Background
Cited by
Computational methods and challenges in analyzing intratumoral microbiome data
Wang, Q., Liu, Z., Ma, A., Li, Z., Liu, B., & Ma, Q. (2023) · Trends in Microbiology · doi:10.1016/j.tim.2023.01.011 · Cited by 37
“decontam Simple statistical methods to identify and remove contaminant sequences in marker-gene and metagenomic data Easy integration with existing metagenomic sequencing workflows Auxiliary data from DNA quantitation and negative control data are required R [41,81]”
MethodMicrobiome depiction through user-adapted bioinformatic pipelines and parameters
Nayman, E. I., Schwartz, B. A., Polanco, F. C., Firek, A. K., Gumabong, A. C., Hofstee, N. J., Narasimhan, G., Cickovski, T., & Mathee, K. (2023) · Journal of Medical Microbiology · doi:10.1099/jmm.0.001756 · Cited by 6
Metadata
- Authors
- Cao, Q., Sun, X., Rajesh, K., Chalasani, N., Gelow, K., Katz, B., Shah, V. H., Sanyal, A. J., & Smirnova, E.
- Venue
- Frontiers in Microbiology
- Publisher
- Frontiers Media SA
- Published
- 2021-01-12
- Volume
- 11
- Pages
- 607325-607325
- ISSN
- 1664-302X (ISSN-L)
- OpenAlex
- W3120414327
- Cited by
- 198
- References
- 15
- FWCI
- 8.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.