Benchmarking tools for the alignment of functional noncoding DNA
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Numerous tools have been developed to align genomic sequences. However, their relative performance in specific applications remains poorly characterized. Alignments of protein-coding sequences typically have been benchmarked against "correct" alignments inferred from structural data. For noncoding sequences, where such independent validation is lacking, simulation provides an effective means to generate "correct" alignments with which to benchmark alignment tools. RESULTS: Using rates of noncoding sequence evolution estimated from the genus Drosophila, we simulated alignments over a range of divergence times under varying models incorporating point substitution, insertion/deletion events, and short blocks of constrained sequences such as those found in cis-regulatory regions. We then compared "correct" alignments generated by a modified version of the ROSE simulation platform to alignments of the simulated derived sequences produced by eight pairwise alignment tools (Avid, BlastZ, Chaos, ClustalW, DiAlign, Lagan, Needle, and WABA) to determine the off-the-shelf performance of each tool. As expected, the ability to align noncoding sequences accurately decreases with increasing divergence for all tools, and declines faster in the presence of insertion/deletion evolution. Global alignment tools (Avid, ClustalW, Lagan, and Needle) typically have higher sensitivity over entire noncoding sequences as well as in constrained sequences. Local tools (BlastZ, Chaos, and WABA) have lower overall sensitivity as a consequence of incomplete coverage, but have high specificity to detect constrained sequences as well as high sensitivity within the subset of sequences they align. Tools such as DiAlign, which generate both local and global outputs, produce alignments of constrained sequences with both high sensitivity and specificity for divergence distances in the range of 1.25-3.0 substitutions per site. CONCLUSION: For species with genomic properties similar to Drosophila, we conclude that a single pair of optimally diverged species analyzed with a high performance alignment tool can yield accurate and specific alignments of functionally constrained noncoding sequences. Further algorithm development, optimization of alignment parameters, and benchmarking studies will be necessary to extract the maximal biological information from alignments of functional noncoding DNA.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MAFFT: a novel method for rapid multiple sequence alignment based on fast Fourier transform
Katoh, K. (2002) · Nucleic Acids Research · doi:10.1093/nar/gkf436 · Cited by 17,027 · cited 1×
“Yet only a few studies to date have exploited simulated data to benchmark alignment tools [11-18], and currently none have done so explicitly for the purposes of functional noncoding sequence alignment.”
BackgroundEMBOSS: the European molecular biology open software suite.
Rice, P., Longden, I., & Bleasby, A. (2000) · Trends in Genetics · doi:10.1016/s0168-9525(00)02024-2 · Cited by 9,466
Dating of the human–ape splitting by a molecular clock of mitochondrial DNA.
Hasegawa, M., Kishino, H., & Yano, T.-A. (1985) · Journal of Molecular Evolution · doi:10.1007/bf02101694 · Cited by 8,687
Weir, B. S. (1997) · Biometrics · doi:10.2307/2533134 · Cited by 2,263
BLAST 2 Sequences, a new tool for comparing protein and nucleotide sequences
Tatusova, T. A., & Madden, T. L. (1999) · FEMS Microbiology Letters · doi:10.1111/j.1574-6968.1999.tb13575.x · Cited by 1,789
LAGAN and Multi-LAGAN: Efficient tools for large-scale multiple alignment of genomic DNA
Brudno, M., Do, C. B., Cooper, G. M., Kim, M. F., Davydov, E., Program, N. C. S., Green, E. D., Sidow, A., & Batzoglou, S. (2003) · Genome Research · doi:10.1101/gr.926603 · Cited by 1,115
Fast algorithms for large-scale genome alignment and comparison
Delcher, A. L. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.11.2478 · Cited by 1,036
DIALIGN 2: improvement of the segment-to-segment approach to multiple sequence alignment.
Morgenstern, B. (1999) · Bioinformatics · doi:10.1093/bioinformatics/15.3.211 · Cited by 678 · cited 1×
“DiAlign (v. 2.1) [ 68 ] is a segment-to-segment alignment algorithm.”
InfluentialPhylogenetic Shadowing of Primate Sequences to Find Functional Regions of the Human Genome
Boffelli, D., McAuliffe, J., Ovcharenko, D., Lewis, K. D., Ovcharenko, I., Pachter, L., & Rubin, E. M. (2003) · Science · doi:10.1126/science.1081331 · Cited by 516
Bergman, C. M., & Kreitman, M. (2001) · Genome Research · doi:10.1101/gr.178701 · Cited by 165
Self-citation
Cited by
VISTA: computational tools for comparative genomics
Frazer, K. A., Pachter, L., Poliakov, A., Rubin, E. M., & Dubchak, I. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh458 · Cited by 2,798
Aligning Multiple Genomic Sequences With the Threaded Blockset Aligner
Blanchette, M., Kent, W. J., Riemer, C., Elnitski, L., Smit, A. F. A., Roskin, K. M., Baertsch, R., Rosenbloom, K., Clawson, H., Green, E. D., et al. (2004) · Genome Research · doi:10.1101/gr.1933104 · Cited by 1,452
How to usefully compare homologous plant genes and chromosomes as DNA sequences
Lyons, E., & Freeling, M. (2008) · The Plant Journal · doi:10.1111/j.1365-313x.2007.03326.x · Cited by 509
PhyloGibbs: A Gibbs Sampling Motif Finder That Incorporates Phylogeny
Siddharthan, R., Siggia, E. D., & van Nimwegen, E. (2005) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0010067 · Cited by 276
A benchmark of multiple sequence alignment programs upon structural RNAs
Gardner, P. P. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki541 · Cited by 273
Metadata
- Authors
- Pollard, D. A., Bergman, C. M., Stoye, J., Celniker, S. E., & Eisen, M. B.
- Venue
- BMC Bioinformatics
- Published
- 2004-01-21
- Volume
- 5
- Issue
- 1
- Pages
- 6-6
- ISSN
- 1471-2105 (ISSN-L)
- OpenAlex
- W2161387979
- Cited by
- 120
- References
- 10
- FWCI
- 8.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benchmarking tools for the alignment of functional noncoding DNA. https://app.cochat.ai/papers/10.1186/1471-2105-5-6
- The paper
- Pollard, D. A., Bergman, C. M., Stoye, J., Celniker, S. E., & Eisen, M. B. (2004). Benchmarking tools for the alignment of functional noncoding DNA. BMC Bioinformatics. https://doi.org/10.1186/1471-2105-5-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.