Evaluating Ortholog Prediction Algorithms in a Yeast Model Clade
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Accurate identification of orthologs is crucial for evolutionary studies and for functional annotation. Several algorithms have been developed for ortholog delineation, but so far, manually curated genome-scale biological databases of orthologous genes for algorithm evaluation have been lacking. We evaluated four popular ortholog prediction algorithms (MultiParanoid; and OrthoMCL; RBH: Reciprocal Best Hit; RSD: Reciprocal Smallest Distance; the last two extended into clustering algorithms cRBH and cRSD, respectively, so that they can predict orthologs across multiple taxa) against a set of 2,723 groups of high-quality curated orthologs from 6 Saccharomycete yeasts in the Yeast Gene Order Browser. RESULTS: Examination of sensitivity [TP/(TP+FN)], specificity [TN/(TN+FP)], and accuracy [(TP+TN)/(TP+TN+FP+FN)] across a broad parameter range showed that cRBH was the most accurate and specific algorithm, whereas OrthoMCL was the most sensitive. Evaluation of the algorithms across a varying number of species showed that cRBH had the highest accuracy and lowest false discovery rate [FP/(FP+TP)], followed by cRSD. Of the six species in our set, three descended from an ancestor that underwent whole genome duplication. Subsequent differential duplicate loss events in the three descendants resulted in distinct classes of gene loss patterns, including cases where the genes retained in the three descendants are paralogs, constituting 'traps' for ortholog prediction algorithms. We found that the false discovery rate of all algorithms dramatically increased in these traps. CONCLUSIONS: These results suggest that simple algorithms, like cRBH, may be better ortholog predictors than more complex ones (e.g., OrthoMCL and MultiParanoid) for evolutionary and functional genomics studies where the objective is the accurate inference of single-copy orthologs (e.g., molecular phylogenetics), but that all algorithms fail to accurately predict orthologs when paralogy is rampant.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dujon, B., Sherman, D., Fischer, G., Durrens, P., Casaregola, S., Lafontaine, I., de Montigny, J., Marck, C., Neuvéglise, C., Talla, E., et al. (2004) · Nature · doi:10.1038/nature02579 · Cited by 1,623 · cited 1×
“The test dataset consists of 31,012 proteins from the proteomes of the following six Saccharomycete yeasts: Saccharomyces cerevisiae, Candida glabrata (also known as Nakaseomyces glabrata [36]), Naumovia castellii (also known as Saccharomyces castellii [36]), Lachancea waltii (also known as Kluyveromyces waltii [36]),…”
BackgroundGenome-scale approaches to resolving incongruence in molecular phylogenies.
Rokas, A., Williams, B. L., King, N., & Carroll, S. B. (2003) · Nature · doi:10.1038/nature02053 · Cited by 1,512 · cited 1×
“However, orthologous genes are not always functionally similar [2], and single-gene phylogenies frequently yield erroneous results [29,30].”
BackgroundSelf-citationDistinguishing Homologous from Analogous Proteins
Fitch, W. M. (1970) · Systematic Zoology · doi:10.2307/2412448 · Cited by 1,503
Orthologs, Paralogs, and Evolutionary Genomics
Koonin, E. V. (2005) · Annual Review of Genetics · doi:10.1146/annurev.genet.39.073003.114725 · Cited by 1,323 · cited 3×
“Accurate determination of orthologs and paralogs is fundamental to molecular evolution analyses, the first step in any comparative molecular biology study, and incredibly useful for functional prediction and annotation [2,3,4,5,6].”
BackgroundNatural history and evolutionary principles of gene duplication in fungi
Wapinski, I., Pfeffer, A., Friedman, N., & Regev, A. (2007) · Nature · doi:10.1038/nature06107 · Cited by 614 · cited 3×
“For example, the SYNERGY algorithm [19,56], which integrates information from similarity searches, gene trees, and synteny in its orthogroup predictions has been shown to be more accurate than RBH [19], and likely to be a much better choice for evolutionary genomics and functional studies.”
MethodResult
Cited by
eggNOG v4.0: nested orthology inference across 3686 organisms
Powell, S., Forslund, K., Szklarczyk, D., Trachana, K., Roth, A., Huerta-Cepas, J., Gabaldón, T., Rattei, T., Creevey, C., Kuhn, M., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1253 · Cited by 652
Tempo and Mode of Genome Evolution in the Budding Yeast Subphylum
Shen, X.-X., Opulente, D. A., Kominek, J., Zhou, X., Steenwyk, J. L., Buh, K. V., Haase, M. A. B., Wisecaver, J. H., Wang, M., Doering, D. T., et al. (2018) · Cell · doi:10.1016/j.cell.2018.10.023 · Cited by 619
Self-citationInferring ancient divergences requires genes with strong phylogenetic signals
Salichos, L., & Rokas, A. (2013) · Nature · doi:10.1038/nature12130 · Cited by 616
Self-citationStreamlining and Core Genome Conservation among Highly Divergent Members of the SAR11 Clade
Grote, J., Thrash, J. C., Huggett, M. J., Landry, Z. C., Carini, P., Giovannoni, S. J., & Rappé, M. S. (2012) · mBio · doi:10.1128/mbio.00252-12 · Cited by 296
Standardized benchmarking in the quest for orthologs
Quest for Orthologs consortium, Altenhoff, A. M., Boeckmann, B., Capella-Gutierrez, S., Dalquen, D. A., DeLuca, T., Forslund, K., Huerta-Cepas, J., Linard, B., Pereira, C., et al. (2016) · Nature Methods · doi:10.1038/nmeth.3830 · Cited by 214
Metadata
- Authors
- Salichos, L., & Rokas, A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-04-13
- Volume
- 6
- Issue
- 4
- Pages
- e18755
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2075171145
- Cited by
- 80
- References
- 5
- FWCI
- 3.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.