The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Phylogenetic and Functional Assessment of Orthologs Inference Projects and Methods
Open accessAbstract
Accurate genome-wide identification of orthologs is a central problem in comparative genomics, a fact reflected by the numerous orthology identification projects developed in recent years. However, only a few reports have compared their accuracy, and indeed, several recent efforts have not yet been systematically evaluated. Furthermore, orthology is typically only assessed in terms of function conservation, despite the phylogeny-based original definition of Fitch. We collected and mapped the results of nine leading orthology projects and methods (COG, KOG, Inparanoid, OrthoMCL, Ensembl Compara, Homologene, RoundUp, EggNOG, and OMA) and two standard methods (bidirectional best-hit and reciprocal smallest distance). We systematically compared their predictions with respect to both phylogeny and function, using six different tests. This required the mapping of millions of sequences, the handling of hundreds of millions of predicted pairs of orthologs, and the computation of tens of thousands of trees. In phylogenetic analysis or in functional analysis where high specificity is required, we find that OMA and Homologene perform best. At lower functional specificity but higher coverage level, OrthoMCL outperforms Ensembl Compara, and to a lesser extent Inparanoid. Lastly, the large coverage of the recent EggNOG can be of interest to build broad functional grouping, but the method is not specific enough for phylogenetic or detailed function analyses. In terms of general methodology, we observe that the more sophisticated tree reconstruction/reconciliation approach of Ensembl Compara was at times outperformed by pairwise comparison approaches, even in phylogenetic tests. Furthermore, we show that standard bidirectional best-hit often outperforms projects with more complex algorithms. First, the present study provides guidance for the broad community of orthology data users as to which database best suits their needs. Second, it introduces new methodology to verify orthology. And third, it sets performance standards for current and future approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
RAxML-VI-HPC: maximum likelihood-based phylogenetic analyses with thousands of taxa and mixed models
Stamatakis, A. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl446 · Cited by 15,582
Database resources of the National Center for Biotechnology Information: update
Wheeler, D. L. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh073 · Cited by 10,641
Identification of common molecular subsequences
Smith, T. F., & Waterman, M. S. (1981) · Journal of Molecular Biology · doi:10.1016/0022-2836(81)90087-5 · Cited by 9,940
MUSCLE: a multiple sequence alignment method with reduced time and space complexity
Edgar, R. C. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-113 · Cited by 8,970
OrthoMCL: Identification of Ortholog Groups for Eukaryotic Genomes
Li, L., Stoeckert, C. J., & Roos, D. S. (2003) · Genome Research · doi:10.1101/gr.1224503 · Cited by 5,707 · cited 10×
“It appears that COG, EggNOG and OrthoMCL suffer from comparatively high falsepositive rates, which is reflected in the significantly reduced amount of correctly reconstructed gene trees.”
MethodInfluentialThe Gene Ontology (GO) database and informatics resource
Gene Ontology Consortium (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh036 · Cited by 4,579
The COG database: an updated version includes eukaryotes
Tatusov, R. L., Fedorova, N. D., Jackson, J. D., Jacobs, A. R., Kiryutin, B., Koonin, E. V., Krylov, D. M., Mazumder, R., Mekhedov, S. L., Nikolskaya, A. N., et al. (2003) · BMC Bioinformatics · doi:10.1186/1471-2105-4-41 · Cited by 4,430
An Information-Theoretic Definition of Similarity
Lin, D. (1998) · International Conference on Machine Learning · Cited by 3,790
A Genomic Perspective on Protein Families
Tatusov, R. L., Koonin, E. V., & Lipman, D. J. (1997) · Science · doi:10.1126/science.278.5338.631 · Cited by 3,590
Comparison of phylogenetic trees
Robinson, D. F., & Foulds, L. R. (1981) · Mathematical Biosciences · doi:10.1016/0025-5564(81)90043-2 · Cited by 2,701
Research works printed but not linked: 2
- W Fitch, 2000, Homology a personal view on some of the problems., Trends Genet, 16, 227
- M Marron, 2004, Genomic distances under deletions and insertions., Theor Comput Sci, 325, 347, 10.1016/j.tcs.2004.02.039 · doi:10.1016/j.tcs.2004.02.039
Cited by
An integrative approach to ortholog prediction for disease-focused and other functional studies
Hu, Y., Flockhart, I., Vinayagam, A., Bergwitz, C., Berger, B., Perrimon, N., & Mohr, S. E. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-357 · Cited by 848
eggNOG v4.0: nested orthology inference across 3686 organisms
Powell, S., Forslund, K., Szklarczyk, D., Trachana, K., Roth, A., Huerta-Cepas, J., Gabaldón, T., Rattei, T., Creevey, C., Kuhn, M., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1253 · Cited by 652
Functional and evolutionary implications of gene orthology
Gabaldón, T., & Koonin, E. V. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3456 · Cited by 643
InParanoid 7: new algorithms and tools for eukaryotic orthology analysis
Ostlund, G., Schmitt, T., Forslund, K., Kostler, T., Messina, D. N., Roopra, S., Frings, O., & Sonnhammer, E. L. L. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp931 · Cited by 623
eggNOG v3.0: orthologous groups covering 1133 organisms at 41 different taxonomic ranges
Powell, S., Szklarczyk, D., Trachana, K., Roth, A., Kuhn, M., Muller, J., Arnold, R., Rattei, T., Letunic, I., Doerks, T., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr1060 · Cited by 574
InParanoid 8: orthology analysis between 273 proteomes, mostly eukaryotic
Sonnhammer, E. L. L., & Östlund, G. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku1203 · Cited by 477
OrthoList: A Compendium of C. elegans Genes with Human Orthologs
Shaye, D. D., & Greenwald, I. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020085 · Cited by 467
Deubiquitylases From Genes to Organism
Clague, M. J., Barsukov, I., Coulson, J. M., Liu, H., Rigden, D. J., & Urbé, S. (2013) · Physiological Reviews · doi:10.1152/physrev.00002.2013 · Cited by 425
EDGAR: A software framework for the comparative analysis of prokaryotic genomes
Blom, J., Albaum, S. P., Doppmeier, D., Pühler, A., Vorhölter, F.-J., Zakrzewski, M., & Goesmann, A. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-154 · Cited by 411
De Smet, R., Adams, K. L., Vandepoele, K., Van Montagu, M. C. E., Maere, S., & Van de Peer, Y. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1300127110 · Cited by 403
A multidimensional systems biology analysis of cellular senescence in aging and disease
Avelar, R. A., Ortega, J. G., Tacutu, R., Tyler, E. J., Bennett, D., Binetti, P., Budovsky, A., Chatsirisupachai, K., Johnson, E., Murray, A., et al. (2020) · Genome Biology · doi:10.1186/s13059-020-01990-9 · Cited by 399
“The orthologous pairs (homologous genes related by speciation events) are clustered into OrthoGroups (OG) [94]; this was done at the Centre for Genomic Research computing cluster (Linux-based) at the University of Liver-pool.”
MethodError, signal, and the placement of Ctenophora sister to all other animals
Whelan, N. V., Kocot, K. M., Moroz, L. L., & Halanych, K. M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1503453112 · Cited by 331
“distantly related species can be difficult (20, 21).”
BackgroundOrthoList 2: A New Comparative Genomic Analysis of Human and Caenorhabditis elegans Genes
Kim, W., Underwood, R. S., Greenwald, I., & Shaye, D. D. (2018) · Genetics · doi:10.1534/genetics.118.301307 · Cited by 309
Inglis, D. O., Binkley, J., Skrzypek, M. S., Arnaud, M. B., Cerqueira, G. C., Shah, P., Wymore, F., Wortman, J. R., & Sherlock, G. (2013) · BMC Microbiology · doi:10.1186/1471-2180-13-91 · Cited by 293
Microbial genome analysis: the COG approach
Galperin, M. Y., Kristensen, D. M., Makarova, K. S., Wolf, Y. I., & Koonin, E. V. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbx117 · Cited by 287
En route to a genome-based classification of Archaea and Bacteria?
Klenk, H.-P., & Göker, M. (2010) · Systematic and Applied Microbiology · doi:10.1016/j.syapm.2010.03.003 · Cited by 275
Altenhoff, A. M., Studer, R. A., Robinson-Rechavi, M., & Dessimoz, C. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002514 · Cited by 248
Self-citationGene family innovation, conservation and loss on the animal stem lineage
(2018) · doi:10.7554/elife.34226 · Cited by 226
PhylomeDB v4: zooming into the plurality of evolutionary histories of a genome
Huerta-Cepas, J., Capella-Gutiérrez, S., Pryszcz, L. P., Marcet-Houben, M., & Gabaldón, T. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1177 · Cited by 217
OMA 2011: orthology inference among 1000 complete genomes
Altenhoff, A. M., Schneider, A., Gonnet, G. H., & Dessimoz, C. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq1238 · Cited by 215
Self-citationStandardized benchmarking in the quest for orthologs
Quest for Orthologs consortium, Altenhoff, A. M., Boeckmann, B., Capella-Gutierrez, S., Dalquen, D. A., DeLuca, T., Forslund, K., Huerta-Cepas, J., Linard, B., Pereira, C., et al. (2016) · Nature Methods · doi:10.1038/nmeth.3830 · Cited by 214
Self-citationKocot, K. M., Citarella, M. R., Moroz, L. L., & Halanych, K. M. (2013) · Evolutionary Bioinformatics · doi:10.4137/ebo.s12813 · Cited by 166
Inferring Orthology and Paralogy
Altenhoff, A. M., Glover, N. M., & Dessimoz, C. (2019) · Methods in Molecular Biology · doi:10.1007/978-1-4939-9074-0_5 · Cited by 148
Self-citationOrthology prediction methods: A quality assessment using curated protein families
Trachana, K., Larsson, T. A., Powell, S., Chen, W., Doerks, T., Muller, J., & Bork, P. (2011) · BioEssays · doi:10.1002/bies.201100062 · Cited by 139
(2016) · doi:10.1093/sysbio/syw041 · Cited by 120
Train, C.-M., Glover, N. M., Gonnet, G. H., Altenhoff, A. M., & Dessimoz, C. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx229 · Cited by 96
“…compared with most other methods, the OMA algorithm has been shown to have high precision (i.e. low false-positive rate) but low recall (i.e. high false-negative rate) in several benchmark studies (Altenhoff and Dessimoz, 2009; Altenhoff et al., 2016; Boeckmann et al., 2011; Trachana et al., 2011).”
ResultSelf-citationBidirectional Best Hits Miss Many Orthologs in Duplication-Rich Clades such as Plants and Animals
Dalquen, D. A., & Dessimoz, C. (2013) · Genome Biology and Evolution · doi:10.1093/gbe/evt132 · Cited by 86
Self-citationDey, G., Jaimovich, A., Collins, S. R., Seki, A., & Meyer, T. (2015) · Cell Reports · doi:10.1016/j.celrep.2015.01.025 · Cited by 77
Joining forces in the quest for orthologs
Gabaldón, T., Dessimoz, C., Huxley-Jones, J., Vilella, A. J., Sonnhammer, E. L., & Lewis, S. (2009) · Genome Biology · doi:10.1186/gb-2009-10-9-403 · Cited by 74
“…of Pennsylvania, Philadelphia, USA) and Adrian Altenhoff (ETH Zurich, Switzerland) introduced novel comparison strategies - based on latent class analysis and species-tree concordance, respectively [9,10] - that complement existing approaches based on gene order and functional conservation [11].”
Self-citationOrthoInspector: comprehensive orthology analysis and visual exploration
Linard, B., Thompson, J. D., Poch, O., & Lecompte, O. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-11 · Cited by 64
“In general, comparative studies [14,15] have shown that phylogenetic reconstructions have higher sensitivity and lower specificity than graph-based methods, particularly for distant organisms.”
BackgroundComparative Analysis of RNA Families Reveals Distinct Repertoires for Each Domain of Life
Hoeppner, M. P., Gardner, P. P., & Poole, A. M. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002752 · Cited by 62
Vazquez, J. M., & Lynch, V. J. (2021) · eLife · doi:10.7554/elife.65041 · Cited by 61
Orthology inference at scale with FastOMA
Majidian, S., Nevers, Y., Yazdizadeh Kharrazi, A., Warwick Vesztrocy, A., Pascarelli, S., Moi, D., Glover, N., Altenhoff, A. M., & Dessimoz, C. (2025) · Nature Methods · doi:10.1038/s41592-024-02552-8 · Cited by 30
“We then submitted the results to the QfO benchmarking service 4,10,31,34 and obtained the results on the 11 available benchmarks.”
Self-citation
Metadata
- Authors
- Altenhoff, A. M., & Dessimoz, C.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2009-01-16
- Volume
- 5
- Issue
- 1
- Pages
- e1000262
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2009234149
- Cited by
- 420
- References
- 41
- FWCI
- 15.72
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.