The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
OXBench: A benchmark for evaluation of protein multiple sequence alignment accuracy
Open accessAbstract
BACKGROUND: The alignment of two or more protein sequences provides a powerful guide in the prediction of the protein structure and in identifying key functional residues, however, the utility of any prediction is completely dependent on the accuracy of the alignment. In this paper we describe a suite of reference alignments derived from the comparison of protein three-dimensional structures together with evaluation measures and software that allow automatically generated alignments to be benchmarked. We test the OXBench benchmark suite on alignments generated by the AMPS multiple alignment method, then apply the suite to compare eight different multiple alignment algorithms. The benchmark shows the current state-of-the art for alignment accuracy and provides a baseline against which new alignment algorithms may be judged. RESULTS: The simple hierarchical multiple alignment algorithm, AMPS, performed as well as or better than more modern methods such as CLUSTALW once the PAM250 pair-score matrix was replaced by a BLOSUM series matrix. AMPS gave an accuracy in Structurally Conserved Regions (SCRs) of 89.9% over a set of 672 alignments. The T-COFFEE method on a data set of families with <8 sequences gave 91.4% accuracy, significantly better than CLUSTALW (88.9%) and all other methods considered here. The complete suite is available from http://www.compbio.dundee.ac.uk. CONCLUSIONS: The OXBench suite of reference alignments, evaluation software and results database provide a convenient method to assess progress in sequence alignment techniques. Evaluation measures that were dependent on comparison to a reference alignment were found to give good discrimination between methods. The STAMP Sc Score which is independent of a reference alignment also gave good discrimination. Application of OXBench in this paper shows that with the exception of T-COFFEE, the majority of the improvement in alignment accuracy seen since 1985 stems from improved pair-score matrices rather than algorithmic refinements. The maximum theoretical alignment accuracy obtained by pooling results over all methods was 94.5% with 52.5% accuracy for alignments in the 0-10 percentage identity range. This suggests that further improvements in accuracy will be possible in the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PROCHECK: a program to check the stereochemical quality of protein structures
Laskowski, R. A., MacArthur, M. W., Moss, D. S., & Thornton, J. M. (1993) · Journal of Applied Crystallography · doi:10.1107/s0021889892009944 · Cited by 24,581
Kabsch, W., & Sander, C. (1983) · Biopolymers · doi:10.1002/bip.360221211 · Cited by 15,320
Needleman, S. B., & Wunsch, C. D. (1970) · Journal of Molecular Biology · doi:10.1016/0022-2836(70)90057-4 · Cited by 11,288
Comparative Protein Structure Modeling of Genes and Genomes
Martí-Renom, M. A., Stuart, A. C., Fiser, A., Sánchez, R., Melo, F., & Šali, A. (2000) · Annual Review of Biophysics and Biomolecular Structure · doi:10.1146/annurev.biophys.29.1.291 · Cited by 3,169
Protein sequence alignments: a strategy for the hierarchical analysis of residue conservation
Livingstone, C. D., & Barton, G. J. (1993) · Bioinformatics · doi:10.1093/bioinformatics/9.6.745 · Cited by 550
Self-citation
Cited by
Jalview Version 2—a multiple sequence alignment editor and analysis workbench
Waterhouse, A. M., Procter, J. B., Martin, D. M. A., Clamp, M., & Barton, G. J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp033 · Cited by 10,235
Self-citationMAFFT version 5: improvement in accuracy of multiple sequence alignment
Katoh, K. (2005) · Nucleic Acids Research · doi:10.1093/nar/gki198 · Cited by 4,837
Unified rational protein engineering with sequence-based deep representation learning
Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M., & Church, G. M. (2019) · Nature Methods · doi:10.1038/s41592-019-0598-1 · Cited by 1,131
“To confirm our cluster assignments, we picked a small set of three cytochromeoxidase (1,2,3) families from OXBench, eight proteins in total.”
InfluentialParallelization of MAFFT for large-scale multiple sequence alignments
Nakamura, T., Yamada, K. D., Tomii, K., & Katoh, K. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty121 · Cited by 1,038
MAFFT-DASH: integrated protein sequence and structural alignment
Rozewicki, J., Li, S., Amada, K. M., Standley, D. M., & Katoh, K. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz342 · Cited by 814
Metadata
- Authors
- Raghava, G., Searle, S. M., Audley, P. C., Barber, J. D., & Barton, G. J.
- Venue
- BMC Bioinformatics
- Published
- 2003-10-10
- Volume
- 4
- Issue
- 1
- Pages
- 47-47
- ISSN
- 1471-2105 (ISSN-L)
- OpenAlex
- W1567621547
- Cited by
- 199
- References
- 5
- FWCI
- 2.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: OXBench: A benchmark for evaluation of protein multiple sequence alignment accuracy. https://app.cochat.ai/papers/10.1186/1471-2105-4-47
- The paper
- Raghava, G., Searle, S. M., Audley, P. C., Barber, J. D., & Barton, G. J. (2003). OXBench: A benchmark for evaluation of protein multiple sequence alignment accuracy. BMC Bioinformatics. https://doi.org/10.1186/1471-2105-4-47
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.