CoChat

The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.

RefSeq database growth influences the accuracy of k-mer-based lowest common ancestor species identification

Open access

Published version of a preprint

Abstract

Accurate species-level taxonomic classification and profiling of complex microbial communities remains a challenge due to homologous regions shared among closely related species and a sparse representation of non-human associated microbes in the database. Although the database undoubtedly has a strong influence on the sensitivity of taxonomic classifiers and profilers, to date, no study has carefully explored this topic on historical RefSeq releases and explored its impact on accuracy. In this study, we examined the influence of the database, over time, on k -mer based sequence classification and profiling. We present three major findings: ( i ) database growth over time resulted in more classified reads, but fewer species-level classifications and more species-level misclassifications; ( ii ) Bayesian re-estimation of abundance helped to recover species-level classifications when the exact target strain was present; and ( iii ) Bayesian reestimation struggled when the database lacked the target strain, resulting in a notable decrease in accuracy. In summary, our findings suggest that the growth of RefSeq over time has strongly influenced the accuracy of k -mer based classification and profiling methods, resulting in different classification results depending on the particular database used. These results suggest a need for new algorithms specially adapted for large genome collections and better measures of classification uncertainty.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13059-018-1554-6

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 The diversity of genera has decreased in the majority of releases since November 2013. a The number of observed species has outpaced the number of observed genera, which has in turn outpaced the number of families as RefSeq has grown. b The ratio of strains-to-species has tended to decrease while the ratio of species-to-genera has tended to increase as RefSeq has grown. c Simpson’s diversity index of species in bacterial RefSeq has tended to increase every release (appearing to have plateaued recently), while Simpson’s diversity of genera tended to increase until November 2013, where it has tended to decrease
Fig. 1 The diversity of genera has decreased in the majority of releases since November 2013. a The number of observed species has outpaced the number of observed genera, which has in turn outpaced the number of families as RefSeq has grown. b The ratio of strains-to-species has tended to decrease while the ratio of species-to-genera has tended to increase as RefSeq has grown. c Simpson’s diversity index of species in bacterial RefSeq has tended to increase every release (appearing to have plateaued recently), while Simpson’s diversity of genera tended to increase until November 2013, where it has tended to decreaseCC BY · PubMed Central
Fig. 2 Fraction of correct species classifications (right) decreases in more recent RefSeq database versions and instead are classified at the genus level (left). Kraken classification results of simulated reads from known genomes against nine versions of the bacterial RefSeq database and the MiniKraken database. Misclassifications at the genus and species levels remain consistently low across database versions
Fig. 2 Fraction of correct species classifications (right) decreases in more recent RefSeq database versions and instead are classified at the genus level (left). Kraken classification results of simulated reads from known genomes against nine versions of the bacterial RefSeq database and the MiniKraken database. Misclassifications at the genus and species levels remain consistently low across database versionsCC BY · PubMed Central
Fig. 3 Species-level classifications decreased, and genus-level classifications increased, as bacterial RefSeq grew. Fraction of simulated reads classified at different taxonomic levels, regardless of accuracy, using Kraken against ten databases. The circles below indicate when each genome’s species/strain is in a database. Although the MiniKraken database contains all 10 genomes, it yields results comparable to bacterial RefSeq version 40
Fig. 3 Species-level classifications decreased, and genus-level classifications increased, as bacterial RefSeq grew. Fraction of simulated reads classified at different taxonomic levels, regardless of accuracy, using Kraken against ten databases. The circles below indicate when each genome’s species/strain is in a database. Although the MiniKraken database contains all 10 genomes, it yields results comparable to bacterial RefSeq version 40CC BY · PubMed Central
Fig. 4 The fraction of reads classified among Bacillus species varied depending on which RefSeq version was used. a Classifying B. cereus VD118 reads with Kraken (left) and Bracken (right) against different versions of RefSeq. Species-level classifications varied, and the fraction of unclassified reads decreased with Kraken, as the database grew. Once B. cereus VD118 appeared in the database (ver. 60), Bracken correctly classified every read. b Species-level classifications decrease with Kraken as RefSeq grows using real reads from an environmental Bacillus cereus not in RefSeq. Fraction of B. cereus ISSFR-23F reads classified using Kraken ver. 1.0 (left) and Bracken ver. 1.0.0 (right) against different versions of bacterial RefSeq. Bracken classification pushed all reads to a species-level call, though these classifications were often for other Bacillus species
Fig. 4 The fraction of reads classified among Bacillus species varied depending on which RefSeq version was used. a Classifying B. cereus VD118 reads with Kraken (left) and Bracken (right) against different versions of RefSeq. Species-level classifications varied, and the fraction of unclassified reads decreased with Kraken, as the database grew. Once B. cereus VD118 appeared in the database (ver. 60), Bracken correctly classified every read. b Species-level classifications decrease with Kraken as RefSeq grows using real reads from an environmental Bacillus cereus not in RefSeq. Fraction of B. cereus ISSFR-23F reads classified using Kraken ver. 1.0 (left) and Bracken ver. 1.0.0 (right) against different versions of bacterial RefSeq. Bracken classification pushed all reads to a species-level call, though these classifications were often for other Bacillus speciesCC BY · PubMed Central
Fig. 5 Species-level resolution increased and then tended to decrease in human-associated metagenomes amidst RefSeq growth. Fraction of metagenomic reads classified at different taxonomic levels, regardless of accuracy, using Kraken against nine bacterial RefSeq databases. The human oral metagenome (a) exhibited patterns seen in the simulated metagenome (Fig. 3): an increase in species-level classifications, followed by an increase in genus-level classifications. The human gut metagenome (b) exhibited a different trend, as species- and genus-level classifications fluctuated and classifications at the family level, and beyond, increased
Fig. 5 Species-level resolution increased and then tended to decrease in human-associated metagenomes amidst RefSeq growth. Fraction of metagenomic reads classified at different taxonomic levels, regardless of accuracy, using Kraken against nine bacterial RefSeq databases. The human oral metagenome (a) exhibited patterns seen in the simulated metagenome (Fig. 3): an increase in species-level classifications, followed by an increase in genus-level classifications. The human gut metagenome (b) exhibited a different trend, as species- and genus-level classifications fluctuated and classifications at the family level, and beyond, increasedCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 52 references

Research works printed but not linked: 2

  1. Parks DH, Chuvochina M, Waite DW, Rinke C, Skarshewski A, Chaumeil P-A, et al. A proposal for a standardized bacterial taxonomy based on genome phylogeny. bioRxiv. 2018;256800. · DOI
  2. NBACC. Genome sequencing and assembly of 11 Bacillus cereus sensu lato isolates from various quarters of the International Space Station. [Data set] https://www.ncbi.nlm.nih.gov/sra/?term=SRR3954740 . Accessed 13 July 2018.

Cited by

See all 170

Metadata

Authors
Nasko, D. J., Koren, S., Phillippy, A. M., & Treangen, T. J.
Affiliations
  • University of Maryland, College Park (US)
  • National Institutes of Health (US)
Corresponding author
Treangen, Todd J.
Venue
Genome Biology
Published
2018-10-30
Volume
19
Issue
1
Pages
165-165
ISSN
  • 1465-6906 (ISSN-L)
  • 1474-760X
OpenAlex
W2897603717
Cited by
170
References
51
Citations by year
2026: 16 · 2025: 23 · 2024: 30 · 2023: 14 · 2022: 19 · 2021: 23 · 2020: 23 · 2019: 15 · 2018: 7
FWCI
6.05
Type
journal article
Language
en
Open access
Licence
Locations
  • Genome biology (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Rice Research Repository (Rice University) (submittedVersion, cc-by)
Funders
Army Research Office (W911NF-17-2-0089)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Physical Sciences › Environmental Science › Ecology › Environmental DNA in Biodiversity Studies
  • Physical Sciences › Environmental Science › Ecology › Microbial Community Ecology and Physiology
Keywords
NCBI RefSeq, lowest common ancestor, species-level classification, metagenomic reads
MeSH terms
Algorithms, Bacillus, Computer Simulation, Species Specificity, Time Factors, Genetic Variation, Sequence Analysis, DNA, Databases, Genetic, Metagenome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: RefSeq database growth influences the accuracy of k-mer-based lowest common ancestor species identification. https://app.cochat.ai/papers/10.1186/s13059-018-1554-6
The paper
Nasko, D. J., Koren, S., Phillippy, A. M., & Treangen, T. J. (2018). RefSeq database growth influences the accuracy of k-mer-based lowest common ancestor species identification. Genome Biology. https://doi.org/10.1186/s13059-018-1554-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.