The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index; none of the 30 sources its claims cite is checked for support yet.
Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium
Open accessAbstract
In order for human microbiome studies to translate into actionable outcomes for health, meta-analysis of reproducible data from population-scale cohorts is needed. Achieving sufficient reproducibility in microbiome research has proven challenging. We report a baseline investigation of variability in taxonomic profiling for the Microbiome Quality Control (MBQC) project baseline study (MBQC-base). Blinded specimen sets from human stool, chemostats, and artificial microbial communities were sequenced by 15 laboratories and analyzed using nine bioinformatics protocols. Variability depended most on biospecimen type and origin, followed by DNA extraction, sample handling environment, and bioinformatics. Analysis of artificial community specimens revealed differences in extraction efficiency and bioinformatic classification. These results may guide researchers in experimental design choices for gut microbiome studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 30 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The experiments we report find that differences in DNA extraction, amplification protocol, and bioinformatics sometimes (but not always) result in effects comparable to those of biological differences”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Variability depended most on biospecimen type and origin, followed by DNA extraction, sample handling environment, and bioinformatics.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Analysis of artificial community specimens particularly revealed differences in extraction efficiency and bioinformatic classification.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“differences induced by bioinformatics pipelines were typically smaller than those arising from data generation”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“relative (rather than absolute) computational measures were typically more reliable than absolute measures in resolving these differences among protocols.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“almost half of the participating wet-laboratories produced variable results for positive control artificial communities.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A qualitative overview of sample beta-diversity values (Fig. 2) revealed that biological, experimental, and bioinformatics variables all contribute to facets of between-sample variation”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“in almost all cases, the range of differences between samples was greatest for the 18 human-derived specimens.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation in taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Differences owing to sample handling in laboratories were generally larger than the effect size of sample type, especially in those labs that handled samples extracted centrally and in other locations”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation in taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There was no single bioinformatics pipeline that was consistently either the least or most conservative in estimating the effects of handling laboratory on measures of community structure such as alpha diversity”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation among biospecimens
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- It may state two separate claims as one. 63
- Probably not a substantial claim. 45
- The quote only partly states this claim. 2
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“both types of effects can differ per sample (and sometimes interact)”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“At least one OTU was reported in 342 of these samples, with the observed number ranging from 1 to ~130 at low (1,000 sequences) rarefaction and almost 200 in all sequences”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Negative controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Negative control buffer aliquots are expected to contain no microbial DNA or OTUs, so any OTUs detected in them indicate contamination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Beta diversities between locally- versus centrally-extracted samples were specimen-specific, with some samples showing little effect and others differing significantly primarily based on this single handling protocol variable”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation due to extraction protocol
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Comparing centrally extracted DNA with locally extracted DNA isolates the effect of DNA extraction from PCR and sequencing effects.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Chimeric reads represented another ~1–5% of mismatched reads across all labs, although this rate did not vary monotonically with number of PCR thermal cycles”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Approximately 50–80% of 16S amplicon reads matched one of the 20 or 22 fecal/oral reference sequences exactly, with most labs varying only slightly (typically <10%) between samples.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This produced comparable taxonomic profiles to MBQC-base bioinformatics, shifted significantly (but with modest effect size) to deplete some clades that were dominant in protocols BL-1 to 9 (genus Fusobacterium, unclassified Enterobacteriaceae, most species-level assignments, etc.) and enriching the otherwise less-abundant Firmicutes”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall taxonomic profiles were also sensitive to handling protocol, bioinformatics, and to the interaction of these variables, although all estimates of OTU richness were high (means ~30–35 for centrally and locally extracted samples, respectively) and neared 100 OTUs in one case (HL-E handling, BL-6 bioinformatics), despite an expectation of 20 and 22 (fecal and oral, respectively) and low raref”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This resulted in complex interactions between handling and bioinformatics protocol choices: some sample diversity estimates agreed across handling labs and bioinformatics protocols, while others differed significantly across handling, bioinformatics, or both”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation among biospecimens
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The most abundant contaminant OTU was an unidentified Bacteroides at 1.6 s.d. 7.0%, which was detected in 22.6% of negative control samples and was also abundant in stool samples (average 1.2 s.d. 3.7%).”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Negative controls
Strength:plain· not yet calibratedn = 345Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Negative control buffer aliquots are expected to contain no microbial DNA or OTUs, so any OTUs detected in them indicate contamination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Some samples, e.g. artificial communities, were minimally affected by different sample handling protocols, and there was no statistically significant variation in measures of diversity (e.g. Simpson’s diversity) associated with a handling laboratory.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation among biospecimens
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most human- and chemostat-derived samples cluster together, with the biologically distinct artificial communities and a subset of human-derived samples forming outgroups.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“handling laboratories generated a total of ~215M sequence reads spanning 2,250 samples”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Sample handling and bioinformatics protocols
Strength:hedged· not yet calibratedn = 2,250Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The two labs using fully open-reference OTU calling found high variance in their per-sample QC criteria, because in some, but not all, samples many reads were captured only by de novo OTUs.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Absolute levels of diversity varied among laboratories (Supplementary Fig. 2–3), although relative correlations between community profiles in the 22 primary specimens across laboratories remained high (min. Spearman r=0.9”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation in taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using arcsine-square root transformed phylum-level taxonomic abundances as a readout, the greatest variability in microbiome profiling was assigned to biological differences between specimen sources and handling laboratories, as in the univariate whole-community models above.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Multivariate quantification of variation
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Single base error accounted for many of the remainder, at a rate of 0.15–0.2% per nucleotide, while two labs (HL-C and HL-N, two of only three labs using single-indexed 8nt barcodes) also generated 1–3% mismatched sequences due to single base gaps at the barcode/linker.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“this experiment supported the expected ground truth and further confirmed the variability of laboratory and bioinformatics protocols when reading out even these low-complexity communities.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
What the sources say
- Not checked yetcites [22] Segata, N. et al. Metagenomic microbial community profiling using unique clade-specific marker genes. Nat. Methods 9, 811–814 (2012). source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“read-level error rates did not correlate with handling labs’ diversity averages. Instead, inflated diversity arose from other handling (e.g. contamination) or bioinformatics sources, although such errors do decrease absolute accuracy in taxonomic profile assessment”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three labs that used single 8nt barcodes (HL-C, HL-N, and HL-I) had the highest proportion of these reads, although this factor was not directly associated with diversity rates (see Supplementary Fig. 12) or absolute accuracy”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, DNA extraction method was the individual protocol variable of greatest effect, also as observed in univariate analyses.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Multivariate quantification of variation
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the top 100 most abundant false positive Greengenes identifiers (average relative abundances ranging from 0.2% to 1.5%), 34% were from genera Bacteroides; Faecalibacterium prausnitzii also comprised 9% of the top 100 IDs, genus Pseudomonas 7%, and family Enterobacteriaceae 6%”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Negative controls
Strength:plain· not yet calibratedn = 345Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Negative control buffer aliquots are expected to contain no microbial DNA or OTUs, so any OTUs detected in them indicate contamination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In total, 345 negative controls were fully processed.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Negative controls
Strength:plain· not yet calibratedn = 345Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fusobacterium was only substantively detected in HL-A samples by the BL-2 and BL-6 pipelines, for example, or by BL-1, BL-4, and BL-9A in the sole HiSeq laboratory, HL-L.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Sample handling and bioinformatics protocols had an effect on community profile accuracy (Fig. 4A–B), but the largest contributor to variability was contamination or omissions owing to microbes whose DNA was not extracted”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Negative control buffer aliquots are expected to contain no microbial DNA or OTUs, so any OTUs detected in them indicate contamination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Differences induced by a subset of computational protocols are readily visible (e.g. BL-8), with those arising from sample handling protocol choices more difficult to see in this visualization but nevertheless present”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fecal and oral microbes were depleted in all bioinformatics protocols in the handling lab using V3-4 primers (HL-A), in favor of genus Lactobacillus.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Human-derived samples averaged 383 ±326 OTUs, with 325 ±244 in chemostat-derived samples, 187 ±200 in positive control artificial communities, and 302 ±283 in negative controls”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Quantitative alpha diversity was relatively robust to protocol differences (Fig. 3A), although both bioinformatics and sample handling protocols tended to affect the median observed diversity more than biological specimen type.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation in taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While each bioinformatics laboratory induced a modest overall shift in a samples’ microbial profile, only one laboratory (BL-8) resulted in a consistent, large shift in the sample composition.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation in taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The combination of read-level QC and OTU assignment yielded an average of ~40M reads per sample handling laboratory and ~35,000 ±43,700 reads/sample, for a total of 15,749 filtered samples”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedn = 15,749Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Sources of contamination varied, including one lab with samples comprising mainly Lactobacillus (HL-A), three labs with Pseudomonas (possibly reagent contamination23 , HL-B, HL-F, and HL-D), and sequence, bioinformatic, and/or physical contamination from gut-derived samples in all laboratories.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Negative controls
What the sources say
- Not checked yetcites [23] Salter, S.J. et al. Reagent and laboratory contamination can critically impact sequence-based microbiome analyses. BMC Biol. 12, 87 (2014). source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: Negative control buffer aliquots are expected to contain no microbial DNA or OTUs, so any OTUs detected in them indicate contamination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reads and QC together produced 27,211 OTUs with Greengenes v13.5 identifiers”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Centrally extracted (pre-extracted) samples were associated with higher abundances of Bacteroidetes; since all pre-extracted samples were extracted using a MO-BIO kit, these results are consistent with reports showing that the MO-BIO based HMP protocol generated data enriched for genera within the Bacteroidetes24.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Multivariate quantification of variation
What the sources say
- Not checked yetcites [24] Wesolowska-Andersen, A. et al. Choice of bacterial DNA extraction method from fecal material influences community structure as evaluated by metagenomic analysis. Microbiome 2, 19 (2014). source
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“from the four phyla present in at least half of all subjects (Bacteroidetes, Firmicutes, Actinobacteria, and Proteobacteria).”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“only one laboratory did not use paired end reads.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Fourteen of the fifteen laboratories used V4 forward primer 515F (GTGCCAGCMGCCGCGGTAA) and all the laboratories used reverse primer number 806R (GGACTACHVGGGTWTCTAAT); the remaining laboratory used V3-4 forward primer 318F (ACTCCTACGGGAGGCAGCAG)6–8.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > 16S rRNA gene amplification primers
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Overlapping reads were stitched (and often filtered) using QIIME9, UPARSE10, FLASH11, PANDAseq12, or custom software.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Three labs reported filtering OTUs from the resulting table for quality control after creation, and one reported filtering samples.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedn = 4Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Only methods included in QIIME (N=6) or UPARSE (N=4) were used for OTU creation, although taxonomic assignments in some cases also used the RDP classification 13 or custom software.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedn = 6Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In the laboratories that froze the extracted DNA, it remained frozen anywhere from 1 day to 45 days.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > 16S rRNA gene amplification primers
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For the MiSeq runs, Illumina chemistry V2 was used most often, with 2 laboratories using V3 chemistry and one laboratory using V4 chemistry.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Four laboratories used a sequencing read length of 150 base pairs, 1 used a sequencing read length of 175 base pairs, 1 used a sequencing read of 210 base pairs, 6 used a sequencing read length of 250 base pairs, and 2 used a sequencing read length of 300 base pairs.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After PCR amplification, samples were frozen in all laboratories except for two at 4 °C or −20 °C for anywhere from 1 day to 39 days.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“During sequencing, the fraction of PhiX ranged from 0 to 0.25”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Most (N=7) also included a minimum (or percent) length threshold to retain reads, and many (N=5) performed explicit chimera checking as well.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedn = 7Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the fraction of quality bases (using the Illumina default Q=15) ranged from 0.573 to 0.961”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The Illumina MiSeq was used for sequencing in all laboratories except for one, which used the HiSeq;”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sequencing
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All bioinformatic protocols removed a subset of raw reads based on low-quality base trimming, although exact criteria varied (Q threshold, from end vs. within window, etc.)”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After DNA was extracted, most laboratories froze the samples at 4 °C, −20 °C, or −80 °C prior to amplification, except for one which began amplification the day of DNA extraction.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > 16S rRNA gene amplification primers
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Re-blinded data were analyzed by nine bioinformatics labs, to produce more than 16,000 taxonomic profiles”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Introduction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Blinded specimen sets from human stool, chemostats and artificial microbial communities were sequenced by 15 laboratories and analyzed using nine bioinformatics protocols.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This baseline MBQC was carried out by volunteer laboratories; all samples were provided by a central repository, blinded, and handled by 15 laboratories.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Introduction
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Near-balanced replicates/triplicates (54 vs. 42 aliquots, respectively) and raw aliquots (53 raw vs. 43 pre-extracted) were the best-powered in our simulations and hence yielded the final aliquot set design.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Specimen selection, set design, and blinding
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“estimates of absolute diversity are not comparable among laboratories even when processed using the same bioinformatics pipeline, whereas relative diversity levels are on average consistent among similar sample types.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation among biospecimens
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The resulting combination of specimens and extracted DNA comprised 96 aliquots with 60% duplicates and 40% triplicates.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Specimen selection, set design, and blinding
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Handling laboratories each received one or more blinded copies of the 96-aliquot set and processed them within a small number of fixed constraints.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > MBQC-base study design
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“choices of 16S rRNA gene variable region primers may enable improved detection or differentiation of microbes16; for example, Propionibacterium spp. abundant on the skin are often undetected by V4 primers29, and Lactobacillus spp. in the vagina are better differentiated by including V321.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Discussion
What the sources say
- Not checked yetcites [16] Soergel, D.A., Dey, N., Knight, R. & Brenner, S.E. Selection of primers for optimal taxonomic classification of environmental 16S rRNA gene sequences. ISME J. 6, 1440–1444 (2012). source
- Not checked yetcites [29] Nelson, M.C., Morrison, H.G., Benjamino, J., Grim, S.L. & Graf, J. Analysis, optimization and verification of Illumina-generated 16S rRNA gene amplicon surveys. PLoS One 9, e94249 (2014). source
- Not checked yetcites [21] Fadrosh, D.W. et al. An improved dual-indexing approach for multiplexed 16S rRNA gene sequencing on the Illumina MiSeq platform. Microbiome 2, 6 (2014). source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Grossly different beta-diversity profiles were generally caused by a subset of samples that were strikingly dissimilar, rather than consistent differences in all of the samples, indicating that a handful of samples may have been contaminated, mislabeled, or otherwise altered in these laboratories.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation in taxonomic profiles
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Fifteen laboratories carried out extraction and/or 16S amplicon sequencing, and the raw sequence data were re-blinded and distributed for processing to nine bioinformatics labs”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > MBQC-base study design
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the MBQC-base sample size is too small to quantify the relative sizes of these effects, sequencing error, extraction efficiency, computational stringency, bar-hopping, and contamination may all have detectable and combinatorial roles in taxonomic profiling errors.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All aliquots in the set were assigned blinded identifiers prior to distribution, such that handling labs received no information linking aliquots either to replicates or to specimens of origin.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Specimen selection, set design, and blinding
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This agrees with our observation that relative diversity levels remain consistent (Supplementary Fig. 2–4), because each protocol will have a set of biases that affect all samples equally.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Variation among biospecimens
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“aliquots of the 22 specimens were extracted at a central facility using the MO-BIO PowerSoil kit.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Specimen selection, set design, and blinding
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Each sample handling laboratory deposited demultiplexed FASTQ files containing the resulting data at the DACC, which were then re-blinded for distribution to bioinformatics participants”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Sample handling and bioinformatics protocols
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“different human host cohorts may harbor remarkably different Gram-negative versus Gram-positive diversity3, 30, and a protocol appropriate for one type of community may work well in one study but not in another.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Discussion
What the sources say
- Not checked yetcites [3] Yatsunenko, T. et al. Human gut microbiome viewed across age and geography. Nature 486, 222–227 (2012). source
- Not checked yetcites [30] De Filippo, C. et al. Impact of diet in shaping gut microbiota revealed by a comparative study in children from Europe and rural Africa. Proc. Natl. Acad. Sci. USA 107, 14691–14696 (2010). source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“human- and chemostat-derived samples do not segregate substantially in this high-level overview, highlighting the latter’s value as biologically-realistic positive controls.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Taxonomic profiles
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A per-barcode synthesis error rate comparable to the per-read errors above (~0.2%) is sufficient to explain much of this effect, leading to a non-negligible fraction of reads being assigned to the wrong sample through barcode hopping (“bar-hopping”).”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > Positive controls
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A subset of specimens were centrally extracted and replicated or triplicated into 96-sample aliquot sets that were shipped to handling laboratories”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Results > MBQC-base study design
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“All sample types, metadata, and phenotypes remained blinded to participants until consolidated data release at the end of the baseline experiment.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sample sets
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values for fixed and random effects were calculated using a likelihood-ratio test and adjusted using the Benjamini-Hochberg-Yekutieli method across all four phyla per model.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We first fit a full model with fixed effects for pre-extraction, collapsed specimen type, collapsed health status, PCR primer, read length, collapsed sequencing chemistry version, PhiX fraction, fraction quality bases, log read count, collapsed OTU software, OTU clustering, taxonomic assignment method, and OTU filtering”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Participating labs were blinded to sample collection methods or sample types.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sample sets
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one. The quote only partly states this claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Separate accounts were created for each bioinformatics laboratory with separate document roots so that each laboratory would not have visibility into the data uploaded by its peers.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Arcsine-square root transformed abundances (for variance stabilization) were used as outcomes”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“Artificial communities were developed from in-house isolates representative of the range of bacterial genera found within the oral or gut habitats, including both Gram positive and Gram negative bacteria with a range of genomic G+C ratios (Supplementary Table 1).”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Biological specimens
What the sources say
- Not checked yetcites Supplementary Table 1
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“many studies, including ours, agree that DNA extraction (particularly bead beating), 16S rRNA gene primer selection, and negative control contamination have large effects on variation.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Previous results have been mixed in their characterization of sequencing platform effects; we included Illumina MiSeq and HiSeq 16S data, but earlier evaluations capture these, Roche 454, Ion Torrent, Pacific Biosciences, and other technologies (including comparisons of amplicon and shotgun metagenomic sequencing).”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Discussion
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Sample sets were designed by simulation under the constraints that, of 96 total samples, 40–60% should be pre-extracted DNA (the remainder raw specimens), 40–60% should represent duplicates, and 40–60% triplicates.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sample sets
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one. The quote only partly states this claim.
In the paper
“All strains were originally isolated from human subjects, and HMP genome reference strains were included where available5.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Biological specimens
What the sources say
- Not checked yetcites [5] Vatanen, T. et al. Variation in microbiome LPS immunogenicity contributes to autoimmunity in humans. Cell 165, 842–853 (2016). source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“After the data uploads were completed and an initial round of quality control performed, the document root names belonging to each laboratory were renamed to randomly generated strings so that each dataset was anonymized.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Sequencing data for positive controls diverge in almost every published study28, including ours (Supplementary Dataset 1), which confirms that relative, not absolute, measures are comparable between protocols.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Discussion
What the sources say
- Not checked yetcites [28] Morgan, J.L., Darling, A.E. & Eisen, J.A. Metagenomic sequencing of an in vitro-simulated microbial community. PLoS One 5, e10209 (2010). source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“and a random effect for specimen number.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“and random effects for specimen number, handling laboratory, and bioinformatics laboratory.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We also fit a simplified model with fixed effects for handling laboratory, bioinformatics laboratory, and pre-extraction”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Data Integration
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“one of the several sample configurations that near-equally maximized power to partition variance (as described below by multivariate modeling) was selected for construction and distribution.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Sample sets
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Since this protocol was run centrally post-hoc, it was not recorded formally nor included in most systematic, blinded analyses.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Bioinformatics
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“newly diagnosed cases with adenocarcinoma of the colon or rectum were recruited prior to surgery and treatment during 1985–19891, 2. Controls were patients awaiting elective surgery for non-oncologic, non-gastrointestinal conditions at these hospitals during the same period.”
§ Assessment of variation in microbial community amplicon sequencing by the Microbiome Quality Control (MBQC) project consortium > Online Methods > Biological specimens
What the sources say
- Not checked yetcites [1] Human Microbiome Project Consortium. Structure, function and diversity of the healthy human microbiome. Nature 486, 207–214 (2012). source
- Not checked yetcites [2] Qin, J. et al. A human gut microbial gene catalogue established by metagenomic sequencing. Nature 464, 59–65 (2010). source
Strength:plain· not yet calibratedn = 4Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
Negative control buffer aliquots are expected to contain no microbial DNA or OTUs, so any OTUs detected in them indicate contamination.
“We included Tris-HCl buffer aliquots as negative control samples (two per 96-sample set)”
“At least one OTU was reported in 342 of these samples”
The paper relies on this without support.
Comparing centrally extracted DNA with locally extracted DNA isolates the effect of DNA extraction from PCR and sequencing effects.
“We separated variation caused by DNA extraction from variation owing to PCR and sequencing by comparing centrally- versus locally-extracted samples”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The central analysis of samples in this study was another important element because both wet-laboratory processing and computational pipelines are critical factors in the reproducibility and quality of microbiota data.45”
From Microbiota as Predictor of Mortality in Allogeneic Hematopoietic-Cell Transplantation (2020) · cites this paper as [45]
In the citing paper
“analogous to the Microbiome Quality Control consortium's analysis of fecal amplicon sequencing among 15 laboratories and nine bioinformatic protocols (163).”
From The microbiome and human cancer (2021) · cites this paper as [163]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
The stated slurry volume exceeds the volume prepared
MajorThe procedure prepares a slurry using 50 mL of medium, then says 100 mL of supernatant from the resulting slurry was added to each vessel. No additional slurry preparation is described.
“A 10% (w/v) fecal slurry was prepared by homogenizing 5 g of feces in 50 mL of pre-reduced growth medium for 1 min using a stomacher (Tekmar Stomacher Lab Blender, Seward; Worthing, West Sussex, UK).”
“The resulting slurry was centrifuged for 10 min at 175 ×g to remove large food particles4, and 100 mL of the supernatant slurry was added to 300 mL of sterile growth medium in each vessel.”
The modeled phylum is named inconsistently
MinorThe results list Bacteroides among the four phyla modeled, whereas the methods list Bacteroidetes in its place. These names identify different taxonomic ranks.
“the four major gut phyla (Actinobacteria, Bacteroides, Firmicutes, and Proteobacteria; see Methods; Supplementary Table 8, Supplementary Fig. 15, Fig. 5)”
“the four phyla present in at least half of all subjects (Bacteroidetes, Firmicutes, Actinobacteria, and Proteobacteria)”
Six laboratories are incorrectly described as a majority
MinorThe paper identifies fifteen handling laboratories, so six laboratories constitute 40%, not a majority.
“The majority of laboratories (N=6) used the MO-BIO PowerSoil kit for DNA extraction and one used the MO-BIO PowerMag kit.”
“Fifteen laboratories carried out extraction and/or 16S amplicon sequencing”
Citations
Cites
Trimmomatic: a flexible trimmer for Illumina sequence data
Bolger, A. M., Lohse, M., & Usadel, B. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu170 · Cited by 65,548
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887
Self-citationSchloss, P. D., Westcott, S. L., Ryabin, T., Hall, J. R., Hartmann, M., Hollister, E. B., Lesniewski, R. A., Oakley, B. B., Parks, D. H., Robinson, C. J., et al. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01541-09 · Cited by 21,481
UPARSE: highly accurate OTU sequences from microbial amplicon reads
Edgar, R. C. (2013) · Nature Methods · doi:10.1038/nmeth.2604 · Cited by 16,770
FLASH: fast length adjustment of short reads to improve genome assemblies
Magoč, T., & Salzberg, S. L. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr507 · Cited by 15,366
Structure, function and diversity of the healthy human microbiome
The Human Microbiome Project Consortium (2012) · Nature · doi:10.1038/nature11234 · Cited by 11,726
A human gut microbial gene catalogue established by metagenomic sequencing
MetaHIT Consortium, Qin, J., Li, R., Raes, J., Arumugam, M., Burgdorf, K. S., Manichanh, C., Nielsen, T., Pons, N., Levenez, F., et al. (2010) · Nature · doi:10.1038/nature08821 · Cited by 11,624
Ultra-high-throughput microbial community analysis on the Illumina HiSeq and MiSeq platforms
Caporaso, J. G., Lauber, C. L., Walters, W. A., Berg-Lyons, D., Huntley, J., Fierer, N., Owens, S. M., Betley, J., Fraser, L., Bauer, M., et al. (2012) · The ISME Journal · doi:10.1038/ismej.2012.8 · Cited by 8,839
Self-citationHuman gut microbiome viewed across age and geography
Yatsunenko, T., Rey, F. E., Manary, M. J., Trehan, I., Dominguez-Bello, M. G., Contreras, M., Magris, M., Hidalgo, G., Baldassano, R. N., Anokhin, A. P., et al. (2012) · Nature · doi:10.1038/nature11053 · Cited by 7,815
Self-citationKozich, J. J., Westcott, S. L., Baxter, N. T., Highlander, S. K., & Schloss, P. D. (2013) · Applied and Environmental Microbiology · doi:10.1128/aem.01043-13 · Cited by 7,219
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–200 of 586
Deep learning in microbiome analysis: a comprehensive review of neural network models
Przymus, P., Rykaczewski, K., Martín‐Segura, A., Truu, J., Pau, E. C. D. S., Kolev, M., Naskinova, I., Gruca, A., Sampri, A., Frohme, M., et al. (2025) · Frontiers in Microbiology · doi:10.3389/fmicb.2024.1516667 · Cited by 93
Gunter, M. J., Alhomoud, S. J., Arnold, M., Brenner, H., Burn, J., Casey, G., Chan, A. T., Cross, A. J., Giovannucci, E. L., Hoover, R. N., et al. (2019) · Annals of Oncology · doi:10.1093/annonc/mdz044 · Cited by 73
Self-citationVogtmann, E., Han, Y., Caporaso, J. G., Bokulich, N. A., Mohamadkhani, A., Moayyedkazemi, A., Hua, X., Kamangar, F., Wan, Y., Suman, S., et al. (2019) · Cancer Medicine · doi:10.1002/cam4.2660 · Cited by 79
Self-citationIntestinal microbiome and metal toxicity
Assefa, S., & Köhler, G. A. (2019) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2019.09.009 · Cited by 74
Challenges and opportunities in sharing microbiome data and analyses
Huttenhower, C., Finn, R. D., & McHardy, A. C. (2023) · Nature Microbiology · doi:10.1038/s41564-023-01484-x · Cited by 74
Self-citationQuantitative Microbial Risk Assessment (QMRA) and Molecular Biology - Paths to Integration.
Haas, C. (2020) · Environmental Science and Technology · doi:10.1021/acs.est.0c00664 · Cited by 59
A critical review on the effect of nitrate pollution in aquatic invertebrates and fish
Banerjee, P., Garai, P., Saha, N. C., Saha, S., Sharma, P., & Maiti, A. K. (2023) · Water Air & Soil Pollution · doi:10.1007/s11270-023-06260-5 · Cited by 79
Anslan, S., Nilsson, R. H., Wurzbacher, C., Baldrián, P., Tedersoo, L., & Bahram, M. (2018) · MycoKeys · doi:10.3897/mycokeys.39.28109 · Cited by 72
Forry, S. P., Servetas, S. L., Kralj, J. G., Soh, K., Hadjithomas, M., Cano, R. J., Carlin, M. R., de Amorim, M. G., Auch, B., Bakker, M. G., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-57981-4 · Cited by 92
Self-citationDrinking Water Microbiome Project: Is it Time?
Hull, N. M., Ling, F., Pinto, A. J., Albertsen, M., Jang, H., Hong, P., Konstantinidis, K. T., LeChevallier, M. W., Colwell, R. R., & Liu, W. (2019) · Trends in Microbiology · doi:10.1016/j.tim.2019.03.011 · Cited by 66
Ducarmon, Q. R., Hornung, B., Geelen, A. R., Kuijper, E. J., & Zwittink, R. D. (2020) · mSystems · doi:10.1128/msystems.00547-19 · Cited by 63
Evaluation of fecal DNA extraction protocols for human gut microbiome studies
Lim, M. Y., Park, Y., Kim, J., & Nam, Y. (2020) · BMC Microbiology · doi:10.1186/s12866-020-01894-5 · Cited by 75
Zouiouich, S., Loftfield, E., Huybrechts, I., Viallon, V., Louca, P., Vogtmann, E., Wells, P. M., Steves, C. J., Herzig, K., Menni, C., et al. (2021) · Diabetologia · doi:10.1007/s00125-021-05464-w · Cited by 62
Self-citationJackson, M. A., Bonder, M. J., Kuncheva, Z., Zierer, J., Fu, J., Kurilshikov, A., Wijmenga, C., Zhernakova, A., Bell, J. T., Spector, T. D., et al. (2018) · PeerJ · doi:10.7717/peerj.4303 · Cited by 66
Tumor-Associated Microbiome: Where Do We Stand?
Oliva, M., Mulet-Margalef, N., Ochoa-de-Olza, M., Napoli, S., Mas-Lloret, J., Laquente, B., Alemany, L., Duell, E. J., Nuciforo, P. G., & Moreno, V. R. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22031446 · Cited by 63
Nikodémová, M., Holzhausen, E. A., Deblois, C. L., Barnet, J. H., Peppard, P. E., Suen, G., & Malecki, K. M. C. (2023) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2023.1165295 · Cited by 62
Shallow shotgun sequencing reduces technical variation in microbiome analysis
Reau, A. J. L., Strom, N., Filvaroff, E. H., Mavrommatis, K., Ward, T., & Knights, D. (2023) · Scientific Reports · doi:10.1038/s41598-023-33489-1 · Cited by 60
Streamlining data-intensive biology with workflow systems
Reiter, T. E., Brooks, P., Irber, L. C., Joslin, S. E. K., Reid, C., Scott, C., Brown, C. T., & Pierce‐Ward, N. T. (2021) · GigaScience · doi:10.1093/gigascience/giaa140 · Cited by 59
Zhang, W., Li, J., Lu, S., Han, N., Miao, J., Zhang, T., Qiang, Y., Kong, Y., Wang, H., Gao, T., et al. (2019) · Scientific Reports · doi:10.1038/s41598-018-36318-y · Cited by 62
Toward Accurate and Robust Environmental Surveillance Using Metagenomics
Shen, J., McFarland, A. G., Young, V. B., Hayden, M. K., & Hartmann, E. M. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.600111 · Cited by 49
Zhang, B., Brock, M., Arana, C., Dende, C., van Oers, N. S. C., Hooper, L. V., & Raj, P. (2021) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2021.678522 · Cited by 56
A study of the correlation between obesity and intestinal flora in school-age children
Gao, X., Jia, R., Xie, L., Kuang, L., Feng, L., & Wan, C. (2018) · Scientific Reports · doi:10.1038/s41598-018-32730-6 · Cited by 61
Filling the gap between collection, transport and storage of the human gut microbiota
Martínez, N., Hidalgo-Cantabrana, C., Delgado, S., Margollés, A., & Sánchez, B. (2019) · Scientific Reports · doi:10.1038/s41598-019-44888-8 · Cited by 53
Frankel‐Bricker, J., Song, M. J., Benner, M. J., & Schaack, S. (2019) · Microbial Ecology · doi:10.1007/s00248-019-01412-9 · Cited by 55
Gut microbiota and probiotic therapy in ADHD: A review of current knowledge
Kalenik, A. M., Kardaś, K., Rahnama, A., Sirojć, K., & Wolańczyk, T. (2021) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2021.110277 · Cited by 58
Abbas‐Egbariya, H., Haberman, Y., Braun, T., Hadar, R., Denson, L. A., Gal‐Mor, O., & Amir, A. (2022) · Genome biology · doi:10.1186/s13059-022-02637-7 · Cited by 49
Self-citationGanda, E., Beck, K. L., Haiminen, N., Silverman, J. D., Kawas, B., Cronk, B. D., Anderson, R. R., Goodman, L. B., & Wiedmann, M. (2021) · mSystems · doi:10.1128/msystems.00619-21 · Cited by 49
Time of sample collection is critical for the replicability of microbiome analyses
Allaband, C., Lingaraju, A., Ramos, S. F., Kumar, T., Javaheri, H., Tiu, M. D., Machado, A. C. D., Richter, R. A., Elijah, E. O., Haddad, G. G., et al. (2024) · Nature Metabolism · doi:10.1038/s42255-024-01064-1 · Cited by 61
Self-citationPaulson, J. N., Williams, B. L., Hehnly, C., Mishra, N., Sinnar, S. A., Zhang, L., Ssentongo, P., Mbabazi-Kabachelor, E., Wijetunge, D. S. S., von Bredow, B., et al. (2020) · Science Translational Medicine · doi:10.1126/scitranslmed.aba0565 · Cited by 48
The human microbiome in clinical translation: from bench to bedside
Bautista, J., Echeverría, C. E., Maldonado-Noboa, I., Ojeda-Mosquera, S., Hidalgo-Tinoco, C., & López-Cortés, A. (2025) · Frontiers in Microbiology · doi:10.3389/fmicb.2025.1632435 · Cited by 55
Zhang, Y., & Liu, W. (2019) · Critical Reviews in Environmental Science and Technology · doi:10.1080/10643389.2019.1571351 · Cited by 53
Milan, M., Maroso, F., Rovere, G. D., et al. (2019) · Food Chemistry · doi:10.1016/j.foodchem.2019.02.037 · Cited by 54
Challenges in Human Skin Microbial Profiling for Forensic Science: A Review
Neckovic, A., van Oorschot, R. A. H., Szkuta, B., & Durdle, A. (2020) · Genes · doi:10.3390/genes11091015 · Cited by 56
Holzhausen, E. A., Nikodémová, M., Deblois, C. L., Barnet, J. H., Peppard, P. E., Suen, G., & Malecki, K. M. C. (2021) · Gut Pathogens · doi:10.1186/s13099-021-00470-0 · Cited by 41
Thompson, K. N., Bonham, K. S., Ilott, N. E., Britton, G. J., Colmenero, P., Bullers, S. J., McIver, L. J., Ma, S., Nguyen, L. H., Filer, A. D., et al. (2023) · Science Translational Medicine · doi:10.1126/scitranslmed.abn4722 · Cited by 57
Self-citationFernández-Pato, A., Sinha, T., Gaćeša, R., Andreu‐Sánchez, S., Gois, M. F. B., Gelderloos-Arends, J., Jansen, D. B. H., Kruk, M., Jaeger, M., Joosten, L. A. B., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-54353-w · Cited by 56
redbiom: a Rapid Sample Discovery and Feature Characterization System
McDonald, D., Kaehler, B., González, A., DeReus, J., Ackermann, G., Marotz, C., Huttley, G., & Knight, R. (2019) · mSystems · doi:10.1128/msystems.00215-19 · Cited by 45
Self-citationMethods in microbiome research: Past, present, and future
Gotschlich, E. C., Colbert, R. A., & Gill, T. (2019) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2020.101498 · Cited by 58
Elie, C., Perret, M., Hage, H., Sentausa, E., Hesketh, A., Louis, K., Fritah-Lafont, A., Leissner, P., Vachon, C., Rostaing, H., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-33959-6 · Cited by 58
Schlaberg, R. (2019) · Clinical Chemistry · doi:10.1373/clinchem.2019.303248 · Cited by 50
Boix-Amorós, A., Badri, M. H., Manasson, J., Blank, R. B., Haberman, R. H., Neimann, A. L., Girija, P. V., Hernández, A. J., Heguy, A., Koralov, S. B., et al. (2022) · Annals of the Rheumatic Diseases · doi:10.1136/ard-2022-223389 · Cited by 50
McGovern, E., Waters, S. M., Blackshields, G., & McCabe, M. S. (2018) · Frontiers in Microbiology · doi:10.3389/fmicb.2018.01365 · Cited by 48
Gavriliuc, S., Stothart, M. R., Henry, A., & Poissant, J. (2021) · PeerJ · doi:10.7717/peerj.10837 · Cited by 36
The environmental microbiome, allergic disease, and asthma
Kelly, M. S., Bunyavanich, S., Phipatanakul, W., & Lai, P. S. (2022) · The Journal of Allergy and Clinical Immunology: In Practice · doi:10.1016/j.jaip.2022.06.006 · Cited by 47
Combrink, L., Humphreys, I. R., Washburn, Q., Arnold, H. K., Stagaman, K., Kasschau, K. D., Jolles, A. E., Beechler, B. R., & Sharpton, T. J. (2023) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1092216 · Cited by 54
Zhang, X., Irajizad, E., Hoffman, K. L., Fahrmann, J. F., Li, F., Seo, Y. D., Browman, G. J., Dennison, J. B., Vykoukal, J. V., Luna, P. N., et al. (2023) · EBioMedicine · doi:10.1016/j.ebiom.2023.104873 · Cited by 56
Huang, M., Ji, Q., Huang, H., Wang, X., & Wang, L. (2025) · Gut Microbes · doi:10.1080/19490976.2025.2486519 · Cited by 53
Swann, J. R., Rajilić-Stojanović, M. D., Salonen, A., Sakwińska, O., Gill, C. M., Meynier, A., Fança‐Berthon, P., Schelkle, B., Segata, N., Shortt, C., et al. (2020) · European Journal of Nutrition · doi:10.1007/s00394-020-02232-1 · Cited by 48
Integrating the human microbiome in the forensic toolkit: Current bottlenecks and future solutions
López, C. D., Vidaki, A., & Kayser, M. (2021) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2021.102627 · Cited by 49
Tegegne, H. A., & Savidge, T. (2025) · Gut Microbes · doi:10.1080/19490976.2025.2569739 · Cited by 59
Refinement of 16S rRNA gene analysis for low biomass biospecimens
Villette, R., Autaa, G., Hind, S., Holm, J. B., Sabater, A. M., & Larsen, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-90226-2 · Cited by 44
Tourlousse, D. M., Narita, K., Miura, T., Ohashi, A., Matsuda, M., Ohyama, Y., Shimamura, M., Furukawa, M., Kasahara, K., Kameyama, K., et al. (2022) · Microbiology Spectrum · doi:10.1128/spectrum.01915-21 · Cited by 42
Greengenes2 enables a shared data universe for microbiome studiesPreprint
McDonald, D. T., Jiang, Y., Balaban, M., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.19.520774 · Cited by 44
Self-citationTian, S., Zhan, D., Yu, Y., Wang, Y., Liu, M., Tan, S., Li, Y., Song, L., Qin, Z., Li, X., et al. (2023) · Genome Biology · doi:10.1186/s13059-023-03048-y · Cited by 43
A microbial signature following bariatric surgery is robustly consistent across multiple cohorts
Fouladi, F., Carroll, I. M., Sharpton, T. J., Bulik‐Sullivan, E. C., Heinberg, L. J., Steffen, K. J., & Fodor, A. A. (2021) · Gut Microbes · doi:10.1080/19490976.2021.1930872 · Cited by 44
Self-citationLu, S., Wang, C., Ma, J., & Wang, Y. (2024) · Frontiers in Immunology · doi:10.3389/fimmu.2024.1456030 · Cited by 49
Temporal Variability and Stability of the Fecal Microbiome: The Multiethnic Cohort Study
Fu, B. C., Randolph, T. W., Lim, U., Monroe, K. R., Cheng, I. C., Wilkens, L. R., Marchand, L. L., Lampe, J. W., & Hullar, M. A. J. (2018) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-18-0348 · Cited by 43
Marsh, R. L., Aho, C., Beissbarth, J., Bialasiewicz, S., Binks, M., Cervin, A., Kirkham, L. S., Lemon, K. P., Slack, M., & Smith‐Vaughan, H. (2019) · International Journal of Pediatric Otorhinolaryngology · doi:10.1016/j.ijporl.2019.109836 · Cited by 37
Morales, E., Hanson, B., Greathouse, K. L., Cruz-Munoz, N. F. D. L., & Messiah, S. E. (2020) · Obesity Reviews · doi:10.1111/obr.13025 · Cited by 44
LogMPIE, pan-India profiling of the human gut microbiome using 16S rRNA sequencing
Dubey, A. K., Uppadhyaya, N., Nilawe, P., Chauhan, N., Kumar, S., Gupta, U. A., & Bhaduri, A. (2018) · Scientific Data · doi:10.1038/sdata.2018.232 · Cited by 42
Wirbel, J., Essex, M., Forslund, S. K., & Zeller, G. (2024) · Genome biology · doi:10.1186/s13059-024-03390-9 · Cited by 57
Popova, M., Guyader, J., Silberberg, M., Seradj, A. R., Saro, C., Bernard, A., Gérard, C., Martin, C., & Morgavi, D. P. (2018) · Applied and Environmental Microbiology · doi:10.1128/aem.02657-18 · Cited by 45
The promise and challenge of cancer microbiome research
Manzoor, S. S., Doedens, A. M., & Burns, M. B. (2020) · Genome biology · doi:10.1186/s13059-020-02037-9 · Cited by 42
Consistent and correctable bias in metagenomic sequencing experimentsPreprint
McLaren, M. R., Willis, A. D., & Callahan, B. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/559831 · Cited by 41
Gut microbiome and amyotrophic lateral sclerosis: a systematic review of current evidence
Sun, J., Huang, T., Debelius, J. W., & Fang, F. (2021) · Journal of Internal Medicine · doi:10.1111/joim.13336 · Cited by 43
Diao, Z., Lai, H., Han, D., Yang, B., Zhang, R., & Li, J. (2022) · Microbiology Spectrum · doi:10.1128/spectrum.03812-22 · Cited by 40
Oral Microbiome Profile of the US Population
Chaturvedi, A. K., Vogtmann, E., Shi, J., Yano, Y., Blaser, M. J., Bokulich, N. A., Caporaso, J. G., Gillison, M. L., Graubard, B. I., Hua, X., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.8283 · Cited by 49
Self-citationSiegwald, L., Caboche, S., Even, G., Viscogliosi, É., Audebert, C., & Chabé, M. (2019) · Microorganisms · doi:10.3390/microorganisms7100393 · Cited by 41
Shared and Distinct Gut Microbiota in Spondyloarthritis, Acute Anterior Uveitis, and Crohn's Disease
Essex, M., Rodríguez, V. R., Rademacher, J., Proft, F. N., Löber, U., Markó, L., Pleyer, U., Strowig, T., Marchand, J., Kirwan, J., et al. (2023) · Arthritis & Rheumatology · doi:10.1002/art.42658 · Cited by 45
Kang, W., Anslan, S., Börner, N., Schwarz, A., Schmidt, R. H., Künzel, S., Rioual, P., Galindo, P. G. E., Miguel Vences, B., Wang, J., et al. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.107070 · Cited by 38
Amos, G. C. A., Sergaki, C., Logan, A., Iriarte, R., Bannaga, A., Chandrapalan, S., Wellington, E. M. H., Rijpkema, S. G. T., & Arasaradnam, R. P. (2021) · Scientific Reports · doi:10.1038/s41598-021-96942-z · Cited by 44
Gu, X., Zhang, S., Ma, W., Wang, Q., Li, Y., Xia, C., Xu, Y., Zhang, T., Yang, L., & Zhou, M. (2022) · Frontiers in Microbiology · doi:10.3389/fmicb.2022.778512 · Cited by 37
Konishi, Y., Okumura, S., Matsumoto, T., Itatani, Y., Nishiyama, T., Okazaki, Y., Shibutani, M., Ohtani, N., Nagahara, H., Obama, K., et al. (2022) · Cancer Medicine · doi:10.1002/cam4.4671 · Cited by 37
Current understanding of the human microbiome in glioma
Liang, J., Li, T., Zhao, J., Wang, C., & Sun, H. (2022) · Frontiers in Oncology · doi:10.3389/fonc.2022.781741 · Cited by 37
Unveiling the intratumoral microbiota within cancer landscapes
Che, S., Yan, Z., Feng, Y., & Hai, Z. (2024) · iScience · doi:10.1016/j.isci.2024.109893 · Cited by 41
Zacharias, H. U., Kaleta, C., Cossais, F., Schaeffer, E., Berndt, H., Best, L., Dost, T., Glüsing, S., Groussin, M., Poyet, M., et al. (2022) · Metabolites · doi:10.3390/metabo12121222 · Cited by 38
Long-term taxonomic and functional stability of the gut microbiome from human fecal samples
Kim, J. H., Jeon, J., Im, Y., Ha, N., Kim, J.-K., Moon, S. J., & Kim, M. (2023) · Scientific Reports · doi:10.1038/s41598-022-27033-w · Cited by 36
Liao, T., Wei, Y., Luo, M., Zhao, G., & Zhou, H. (2019) · Genome biology · doi:10.1186/s13059-019-1871-4 · Cited by 31
Fidler, G., Szilágyi-Tolnai, E., Stágel, A., Remenyik, J., Stündl, L., Gal, F., Bíró, S., & Paholcsek, M. (2020) · Scientific Reports · doi:10.1038/s41598-020-60304-y · Cited by 35
Smith, P. E., Waters, S. M., Expósito, R. G., Smidt, H., Carberry, C. A., & McCabe, M. S. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.606825 · Cited by 38
Gut Microbiome in Health and Disease
Lavelle, A., & Hill, C. (2019) · Gastroenterology Clinics of North America · doi:10.1016/j.gtc.2019.02.003 · Cited by 35
TIPP2: metagenomic taxonomic profiling using phylogenetic markers
Shah, N., Molloy, E. K., Pop, M., & Warnow, T. J. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab023 · Cited by 33
Evaluating replicability in microbiome data
Clausen, D. S., & Willis, A. D. (2021) · Biostatistics · doi:10.1093/biostatistics/kxab048 · Cited by 32
Wirbel, J., Zych, K., Essex, M., Karcher, N., Kartal, E., Salazar, G., Peer Bork, B., Sunagawa, S., & Zeller, G. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.02.06.931808 · Cited by 33
Greathouse, K. L., White, J. R., Padgett, R. N., Perrotta, B. G., Jenkins, G. D., Chia, N., & Chen, J. (2019) · BMJ Open Gastroenterology · doi:10.1136/bmjgast-2018-000247 · Cited by 35
Wu, Z., Hullings, A. G., Ghanbari, R., Etemadi, A., Wan, Y., Zhu, B., Poustchi, H., Bagheri-Fahraji, B., Sakhvidi, M. J. Z., Shi, J., et al. (2021) · BMC Microbiology · doi:10.1186/s12866-021-02387-9 · Cited by 21
Self-citationMoossavi, S., Engen, P. A., Ghanbari, R., Green, S. J., Naqib, A. D., Bishehsari, F., Merat, S., Poustchi, H., Keshavarzian, A., & Malekzadeh, R. (2019) · BMC Microbiology · doi:10.1186/s12866-019-1519-2 · Cited by 34
Ma, J., Sheng, L., Hong, Y., Xi, C., Gu, Y., Zheng, N., Li, M., Chen, L., Wu, G., Li, Y., et al. (2020) · Frontiers in Microbiology · doi:10.3389/fmicb.2020.00972 · Cited by 34
The Gut Microbiome and Xenobiotics: Identifying Knowledge Gaps
Sutherland, V. L., McQueen, C. A., Mendrick, D. L., Gulezian, D., Cerniglia, C. E., Foley, S. L., Forry, S., Khare, S., Liang, X., Manautou, J. E., et al. (2020) · Toxicological Sciences · doi:10.1093/toxsci/kfaa060 · Cited by 33
Method development for cross-study microbiome data mining: Challenges and opportunities
Su, X., Jing, G., Zhang, Y., & Wu, S. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.07.020 · Cited by 31
Wu, Z., Byrd, D. A., Wan, Y., Ansong, D., Clegg‐Lamptey, J., Wiafe‐Addai, B., Edusei, L., Adjei, E. K., Titiloye, N. A., Dedey, F., et al. (2022) · International Journal of Cancer · doi:10.1002/ijc.34145 · Cited by 34
Self-citationNaught all zeros in sequence count data are the samePreprint
Silverman, J. D., Roche, K. E., Mukherjee, S., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/477794 · Cited by 34
Sepich‐Poore, G. D., Guccione, C., Laplane, L., Pradeu, T., Curtius, K., & Knight, R. (2022) · BioEssays · doi:10.1002/bies.202100252 · Cited by 33
Self-citationFrom microbiome to metabolism: Bridging a two-decade translational gap
Hul, M. V., & Cani, P. D. (2025) · Cell Metabolism · doi:10.1016/j.cmet.2025.10.011 · Cited by 47
Developing whole cell standards for the microbiome field
Sergaki, C., Anwar, S., Fritzsche, M., Mate, R., Francis, R. J., MacLellan‐Gibson, K., Logan, A., & Amos, G. C. A. (2022) · Microbiome · doi:10.1186/s40168-022-01313-z · Cited by 36
Zhuang, Y.-P., Zhou, H., Chen, H., Zheng, M.-Y., Liang, Y., Gu, Y.-T., Li, W., Qiu, W., & Zhou, H. (2023) · Biomedicine & Pharmacotherapy · doi:10.1016/j.biopha.2023.115040 · Cited by 34
Rare Plankton Subcommunities Are Far More Affected by DNA Extraction Kits Than Abundant Plankton
Liu, M., Xue, Y., & Yang, J. (2019) · Frontiers in Microbiology · doi:10.3389/fmicb.2019.00454 · Cited by 36
Microbiome and Cancers of the Esophagus: A Review
Yano, Y., Etemadi, A., & Abnet, C. C. (2021) · Microorganisms · doi:10.3390/microorganisms9081764 · Cited by 33
Self-citationSinha, R. R., Ahsan, H., Blaser, M. J., Caporaso, J. G., Carmical, J. R., Chan, A. T., Fodor, A. A., Gail, M. H., Harris, C. C., Helzlsouer, K. J., et al. (2018) · Microbiome · doi:10.1186/s40168-018-0596-z · Cited by 31
Self-citationBatool, M., Blazier, J. C., Rogovska, Y. V., Wang, J., Liu, S., Nebogatkin, I. V., & Rogovskyy, A. S. (2021) · Ticks and Tick-borne Diseases · doi:10.1016/j.ttbdis.2021.101768 · Cited by 24
Metadata
- Authors
- The Microbiome Quality Control Project Consortium, Sinha, R., Abu-Ali, G., Vogtmann, E., Fodor, A. A., Ren, B., Amir, A., Schwager, E., Crabtree, J., Ma, S., Abnet, C. C., Knight, R., White, O., & Huttenhower, C.
- Affiliations
- National Cancer Institute (US)
- Broad Institute (US)
- University of North Carolina at Charlotte (US)
- Harvard University (US)
- University of California San Diego (US)
- University of Maryland, Baltimore (US)
- Corresponding author
- Huttenhower, Curtis
- ORCID
- Venue
- Nature Biotechnology
- Published
- 2017-10-02
- Volume
- 35
- Issue
- 11
- Pages
- 1077-1086
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC5839636
- OpenAlex
- W2762425175
- Semantic Scholar
- a253c43fc33ed458f6d9051ba718eb95e6e7ba1a
- Cited by
- 587
- References
- 64
- Citations by year
- 2026: 104 · 2025: 50 · 2024: 56 · 2023: 60 · 2022: 66 · 2021: 84 · 2020: 60 · 2019: 59 · 2018: 44 · 2017: 3
- FWCI
- 18.45
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Human Genome Research Institute (U01HG004866, R01HG005969, U01HG006537, R01HG004872, R01HG005220)
- National Cancer Institute (R01CA179243)
- National Institute of Diabetes and Digestive and Kidney Diseases (P30DK043351)
- National Institute of Dental and Craniofacial Research (U54DE023798)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gut microbiota and health
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
- Keywords
- human gut microbiome, taxonomic profiling, chemostat, DNA extraction, sample handling, bioinformatics protocols, meta-analysis, experimental design
- MeSH terms
- Gastrointestinal Microbiome, Bacteria, DNA, Bacterial, Humans, Reference Standards, Research Design, Nucleic Acid Amplification Techniques, Microbiota
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review