Cited by 272Gut microbiota and healthGenomics and Phylogenetic StudiesMicrobial Community Ecology and Physiology

Comparing Apples and Oranges?: Next Generation Sequencing and Its Impact on Microbiome Analysis

Open access
Clooney, Adam G., Fouhy, Fiona, Sleator, Roy D., O’ Driscoll, Aisling, Stanton, Catherine, Cotter, Paul D., Claesson, Marcus J.·2016·PLOS ONE

Abstract

Rapid advancements in sequencing technologies along with falling costs present widespread opportunities for microbiome studies across a vast and diverse array of environments. These impressive technological developments have been accompanied by a considerable growth in the number of methodological variables, including sampling, storage, DNA extraction, primer pairs, sequencing technology, chemistry version, read length, insert size, and analysis pipelines, amongst others. This increase in variability threatens to compromise both the reproducibility and the comparability of studies conducted. Here we perform the first reported study comparing both amplicon and shotgun sequencing for the three leading next-generation sequencing technologies. These were applied to six human stool samples using Illumina HiSeq, MiSeq and Ion PGM shotgun sequencing, as well as amplicon sequencing across two variable 16S rRNA gene regions. Notably, we found that the factor responsible for the greatest variance in microbiota composition was the chosen methodology rather than the natural inter-individual variance, which is commonly one of the most significant drivers in microbiome studies. Amplicon sequencing suffered from this to a large extent, and this issue was particularly apparent when the 16S rRNA V1-V2 region amplicons were sequenced with MiSeq. Somewhat surprisingly, the choice of taxonomic binning software for shotgun sequences proved to be of crucial importance with even greater discriminatory power than sequencing technology and choice of amplicon. Optimal N50 assembly values for the HiSeq was obtained for 10 million reads per sample, whereas the applied MiSeq and PGM sequencing depths proved less sufficient for shotgun sequencing of stool samples. The latter technologies, on the other hand, provide a better basis for functional gene categorisation, possibly due to their longer read lengths. Hence, in addition to highlighting methodological biases, this study demonstrates the risks associated with comparing data generated using different strategies. We also recommend that laboratories with particular interests in certain microbes should optimise their protocols to accurately detect these taxa using different techniques.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0148028

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Differences in protocols make pooling data from two different studies more complicated.

    “This makes pooling the data from two different studies more complicated (Clooney et al., 2016)”

    From The Microbiota-Gut-Brain Axis (2019) · cites this paper as Clooney et al., 2016

  • 16S sequencing and whole genome shotgun sequencing provide complementary readouts that can inform each other.

    “While the techniques are arguably similar, they are not mutually exclusive but provide complementary readouts that can inform each other (Clooney et al., 2016), see Fig. 2.”

    From The Microbiota-Gut-Brain Axis (2019) · cites this paper as Clooney et al., 2016

  • Almost all cases in which sequencing platforms differed specifically investigated Ion Torrent 16S amplicon sequencing.

    “Almost all cases in which platforms differed31–33 specifically investigated Ion Torrent 16S amplicon sequencing”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Clooney, A. G., Fouhy, F., Sleator, R. D., O’ Driscoll, A., Stanton, C., Cotter, P. D., & Claesson, M. J.
Affiliations
  • University College Cork (IE)
  • Teagasc - The Irish Agriculture and Food Development Authority (IE)
Corresponding author
  • Cotter, Paul D.
  • Claesson, Marcus J.
Venue
PLOS ONE
Published
2016-02-05
Volume
11
Issue
2
Pages
e0148028
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2260059978
Cited by
270
References
38
Citations by year
2026: 9 · 2025: 15 · 2024: 18 · 2023: 25 · 2022: 18 · 2021: 42 · 2020: 37 · 2019: 34 · 2018: 38 · 2017: 21 · 2016: 13
FWCI
18.26
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, public-domain)
  • PubMed Central (publishedVersion, public-domain)
  • PubMed (publishedVersion)
  • T-Stór (Teagasc) (acceptedVersion)
  • Arrow@dit (Dublin Institute of Technology) (submittedVersion, cc-by-nc-sa)
  • Arrow@dit (Dublin Institute of Technology) (submittedVersion, public-domain)
  • Cork Open Research Archive (University College Cork, Ireland) (submittedVersion, public-domain)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
Funders
  • European Commission (603038)
  • Science Foundation Ireland (SFI/12/RC/, 11/PI/1137, 12/RC/2273, 12/RC/, SFI/12/RC/2273.)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gut microbiota and health
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
Keywords
microbiome analysis, next-generation sequencing, amplicon sequencing, shotgun sequencing, 16S rRNA gene, stool microbiome, sequencing platform comparison, methodological bias, reproducibility, sequencing depth, read length, human gut microbiome
MeSH terms
Aged, Feces, Humans, RNA, Ribosomal, 16S, Sequence Analysis, RNA, DNA Primers, Metagenomics, High-Throughput Nucleotide Sequencing, Microbiota

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review