Cited by 114Genomics and Phylogenetic StudiesEnvironmental DNA in Biodiversity StudiesMicrobial Community Ecology and Physiology

Testing the advantages and disadvantages of short- and long- read eukaryotic metagenomics using simulated reads

Open access
Pearman, William S., Freed, Nikki E., Silander, Olin K.·2020·BMC Bioinformatics

Published version of a preprint

Abstract

Background: The first step in understanding ecological community diversity and dynamics is quantifying community membership. An increasingly common method for doing so is through metagenomics. Because of the rapidly increasing popularity of this approach, a large number of computational tools and pipelines are available for analysing metagenomic data. However, the majority of these tools have been designed and benchmarked using highly accurate short read data (i.e. Illumina), with few studies benchmarking classification accuracy for long error-prone reads (PacBio or Oxford Nanopore). In addition, few tools have been benchmarked for non-microbial communities. Results: Here we compare simulated long reads from Oxford Nanopore and Pacific Biosciences (PacBio) with high accuracy Illumina read sets to systematically investigate the effects of sequence length and taxon type on classification accuracy for metagenomic data from both microbial and non-microbial communities. We show that very generally, classification accuracy is far lower for non-microbial communities, even at low taxonomic resolution (e.g. family rather than genus). We then show that for two popular taxonomic classifiers, long reads can significantly increase classification accuracy, and this is most pronounced for non-microbial communities. Conclusions: This work provides insight on the expected accuracy for metagenomic analyses for different taxonomic groups, and establishes the point at which read length becomes more important than error rate for assigning the correct taxon.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12859-020-3528-4

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Long-read technology provides more read-length but at the cost of higher error rates.

    “By contrast, long‐read technology provides more read‐length but at the cost of higher error rates.82”
  • Short-read technology provides abundant sequencing data that is less error prone than long-read technology; however, it can be difficult to assemble complete genomes using short read-lengths due to limitations in distinguishing repetitive elements.

    “short‐read technology provides abundant sequencing data that is less error prone than long‐read technology; however, it can be difficult to assemble complete genomes using short read‐lengths due to limitations in the technology to distinguish repetitive elements.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [16]Pearman W, Smith ANH, Breckell G, Dale J, Freed NE, Silander OK. New tools for diet analyses: nanopore sequencing of metagenomic DNA from stomach contents to quantify diet in an invasive population of rats. bioRxiv. 2018:363622 [Cited 2018 Aug 8]. Available from: https://www.biorxiv.org/content/early/2018/07/06/363622.

Cited by

Sorted by citations

Authors
Pearman, W. S., Freed, N. E., & Silander, O. K.
Affiliations
Massey University (NZ)
Corresponding author
  • Pearman, William S.
  • Silander, Olin K.
Venue
BMC Bioinformatics
Published
2020-05-29
Volume
21
Issue
1
Pages
220-220
ISSN
1471-2105 (ISSN-L)
OpenAlex
W3031621849
Cited by
114
References
50
Citations by year
2026: 7 · 2025: 20 · 2024: 18 · 2023: 20 · 2022: 29 · 2021: 13 · 2020: 5 · 2019: 1 · 2018: 1
FWCI
5.43
Type
journal article
Language
en
Open access
Locations
  • BMC Bioinformatics (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • Research Square (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • ResearchSpace (University of Auckland) (submittedVersion, cc-by)
Funders
Massey University (RM21565)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Physical Sciences › Environmental Science › Ecology › Environmental DNA in Biodiversity Studies
  • Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
Keywords
metagenomics, long-read sequencing, short-read sequencing, taxonomic classification, classification accuracy, simulated reads, Oxford Nanopore, PacBio, eukaryotic communities, read length, error rate, taxonomic resolution, benchmarking
MeSH terms
Nanopore Sequencing, Computer Simulation, Sequence Analysis, DNA, Metagenomics, Eukaryota, High-Throughput Nucleotide Sequencing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review