The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Assessing Performance of Orthology Detection Strategies Applied to Eukaryotic Genomes
Open accessAbstract
Orthology detection is critically important for accurate functional annotation, and has been widely used to facilitate studies on comparative and evolutionary genomics. Although various methods are now available, there has been no comprehensive analysis of performance, due to the lack of a genomic-scale 'gold standard' orthology dataset. Even in the absence of such datasets, the comparison of results from alternative methodologies contains useful information, as agreement enhances confidence and disagreement indicates possible errors. Latent Class Analysis (LCA) is a statistical technique that can exploit this information to reasonably infer sensitivities and specificities, and is applied here to evaluate the performance of various orthology detection methods on a eukaryotic dataset. Overall, we observe a trade-off between sensitivity and specificity in orthology detection, with BLAST-based methods characterized by high sensitivity, and tree-based methods by high specificity. Two algorithms exhibit the best overall balance, with both sensitivity and specificity>80%: INPARANOID identifies orthologs across two species while OrthoMCL clusters orthologs from multiple species. Among methods that permit clustering of ortholog groups spanning multiple genomes, the (automated) OrthoMCL algorithm exhibits better within-group consistency with respect to protein function and domain architecture than the (manually curated) KOG database, and the homolog clustering algorithm TribeMCL as well. By way of using LCA, we are also able to comprehensively assess similarities and statistical dependence between various strategies, and evaluate the effects of parameter settings on performance. In summary, we present a comprehensive evaluation of orthology detection on a divergent set of eukaryotic genomes, thus providing insights and guides for method selection, tuning and development for different applications. Many biological questions have been addressed by multiple tests yielding binary (yes/no) outcomes but no clear definition of truth, making LCA an attractive approach for computational biology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs
Altschul, S. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.17.3389 · Cited by 73,302
Thompson, J. D., Higgins, D. G., & Gibson, T. J. (1994) · Nucleic Acids Research · doi:10.1093/nar/22.22.4673 · Cited by 64,617
OrthoMCL: Identification of Ortholog Groups for Eukaryotic Genomes
Li, L., Stoeckert, C. J., & Roos, D. S. (2003) · Genome Research · doi:10.1101/gr.1224503 · Cited by 5,707 · cited 6×
“KOG groups generally encompass OrthoMCL groups, rather than the reverse (note that in a previous analysis, OrthoMCL groups were found to generally encompass EGO groups [18,34]).”
BackgroundMethodResultSelf-citationThe COG database: a tool for genome-scale analysis of protein functions and evolution
Tatusov, R. L. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.33 · Cited by 4,520
The COG database: an updated version includes eukaryotes
Tatusov, R. L., Fedorova, N. D., Jackson, J. D., Jacobs, A. R., Kiryutin, B., Koonin, E. V., Krylov, D. M., Mazumder, R., Mekhedov, S. L., Nikolskaya, A. N., et al. (2003) · BMC Bioinformatics · doi:10.1186/1471-2105-4-41 · Cited by 4,430
A Genomic Perspective on Protein Families
Tatusov, R. L., Koonin, E. V., & Lipman, D. J. (1997) · Science · doi:10.1126/science.278.5338.631 · Cited by 3,590
An efficient algorithm for large-scale detection of protein families
Enright, A. J. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.7.1575 · Cited by 3,588
The COG database: new developments in phylogenetic classification of proteins from complete genomes
Tatusov, R. L. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.22 · Cited by 1,895
Graph Clustering by Flow Simulation
van Dongen, S. M. (2000) · Centrum Wiskunde & Informatica (CWI), the national research institute for mathematics and computer science in the Netherlands · Cited by 1,595
Distinguishing Homologous from Analogous Proteins
Fitch, W. M. (1970) · Systematic Zoology · doi:10.2307/2412448 · Cited by 1,503
The SAGE Handbook of Quantitative Methodology for the Social Sciences
Kaplan, D. (2004) · doi:10.4135/9781412986311 · Cited by 1,454
Orthologs, Paralogs, and Evolutionary Genomics
Koonin, E. V. (2005) · Annual Review of Genetics · doi:10.1146/annurev.genet.39.073003.114725 · Cited by 1,323
Automatic clustering of orthologs and in-paralogs from pairwise species comparisons
Remm, M., Storm, C. E. V., & Sonnhammer, E. L. L. (2001) · Journal of Molecular Biology · doi:10.1006/jmbi.2000.5197 · Cited by 1,174
A comprehensive evolutionary classification of proteins encoded in complete eukaryotic genomes
Koonin, E. V., Fedorova, N. D., Jackson, J. D., Jacobs, A. R., Krylov, D. M., Makarova, K. S., Mazumder, R., Mekhedov, S. L., Nikolskaya, A. N., Rao, B. S., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-2-r7 · Cited by 1,092
OrthoMCL-DB: querying a comprehensive multi-species collection of ortholog groups
Chen, F. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj123 · Cited by 884
Self-citationInparanoid: a comprehensive database of eukaryotic orthologs
O'Brien, K. P. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki107 · Cited by 742
Vermunt, J. K., & Magidson, J. (2005) · Data Archiving and Networked Services (DANS) · Cited by 677
Self-citationFitch, W. M. (2000) · Trends in Genetics · doi:10.1016/s0168-9525(00)02005-9 · Cited by 592
THE MULTIPLICITY OF DOMAINS IN PROTEINS
Doolittle, R. F. (1995) · Annual Review of Biochemistry · doi:10.1146/annurev.bi.64.070195.001443 · Cited by 513
The Closest BLAST Hit Is Often Not the Nearest Neighbor
Koski, L. B., & Golding, G. B. (2001) · Journal of Molecular Evolution · doi:10.1007/s002390010184 · Cited by 466
Random Effects Models in Latent Class Analysis for Evaluating Accuracy of Diagnostic Tests
Qu, Y., Tan, M., & Kutner, M. H. (1996) · Biometrics · doi:10.2307/2533043 · Cited by 449
Gene Families: The Taxonomy of Protein Paralogs and Chimeras
Henikoff, S., Greene, E. A., Pietrokovski, S., Bork, P., Attwood, T. K., & Hood, L. (1997) · Science · doi:10.1126/science.278.5338.609 · Cited by 389
Orthology, paralogy and proposed classification for paralog subtypes
Sonnhammer, E. L. L., & Koonin, E. V. (2002) · Trends in Genetics · doi:10.1016/s0168-9525(02)02793-2 · Cited by 379
Vermunt, J. K. (2010) · International Encyclopedia of Education · doi:10.1016/b978-0-08-044894-7.01340-3 · Cited by 373
Self-citationCreating a honey bee consensus gene set
Elsik, C. G., Mackey, A. J., Reese, J. T., Milshina, N. V., Roos, D. S., & Weinstock, G. M. (2007) · Genome Biology · doi:10.1186/gb-2007-8-1-r13 · Cited by 326
Self-citationWall, D. P., Fraser, H. B., & Hirsh, A. E. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg213 · Cited by 289
Life with 25,000 Genes: Figure 1.
Poethig, R. S. (2001) · Genome Research · doi:10.1101/gr · Cited by 278
Evaluation of diagnostic tests without gold standards
Hui, S. L., & Zhou, X. H. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700404 · Cited by 252
Automatic clustering of orthologs and inparalogs shared by multiple proteomes
Alexeyenko, A., Tamas, I., Liu, G., & Sonnhammer, E. L. L. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl213 · Cited by 248
A simple algorithm to infer gene duplication and speciation events on a gene tree
Zmasek, C. M., & Eddy, S. R. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.9.821 · Cited by 205
RIO: Analyzing proteomes by automated phylogenomics using resampled inference of orthologs
Zmasek, C. M., & Eddy, S. R. (2002) · BMC Bioinformatics · doi:10.1186/1471-2105-3-14 · Cited by 190
Systematic identification of functional orthologs based on protein network comparison
Bandyopadhyay, S., Sharan, R., & Ideker, T. (2006) · Genome Research · doi:10.1101/gr.4526006 · Cited by 189
Automated ortholog inference from phylogenetic trees and calculation of orthology reliability
Storm, C. E. V., & Sonnhammer, E. L. L. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.1.92 · Cited by 183
Benchmarking ortholog identification methods using functional genomics data
Hulsen, T., Huynen, M. A., de Vlieg, J., & Groenen, P. M. (2006) · Genome Biology · doi:10.1186/gb-2006-7-4-r31 · Cited by 171
BioLayout—an automatic graph layout algorithm for similarity visualization
Enright, A. J., & Ouzounis, C. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.9.853 · Cited by 168
Cross-Referencing Eukaryotic Genomes: TIGR Orthologous Gene Alignments (TOGA)Preprint
Lee, Y., Sultana, R., Pertea, G. M., Cho, J., Karamycheva, S. A., Tsai, J., Parvizi, B., Cheung, F., Antonescu, V., White, J., et al. (2002) · Genome Research · doi:10.1101/gr.212002 · Cited by 153
Annotation Transfer for Genomics: Measuring Functional Divergence in Multi-Domain ProteinsPreprint
Hegyi, H., & Gerstein, M. (2001) · Genome Research · doi:10.1101/gr.183801 · Cited by 135
Roundup: a multi-genome repository of orthologs and evolutionary distances
DeLuca, T. F., Wu, I., Jian, P., Monaghan, T. K., Peshkin, L., Singh, S. R., & Wall, D. P. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl286 · Cited by 109
A Biomedical Application of Latent Class Models with Random Effects
Hadgu, A., & Qu, Y. (1998) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00131 · Cited by 95
Whole genome protein domain analysis using a new method for domain clustering
Gouzy, J., Corpet, F., & Kahn, D. (1999) · Computers & Chemistry · doi:10.1016/s0097-8485(99)00011-x · Cited by 78
Comprehensive Analysis of Orthologous Protein Domains Using the HOPS DatabasePreprint
Storm, C. E. V., & Sonnhammer, E. L. L. (2003) · Genome Research · doi:10.1101/gr1305203 · Cited by 52
Cited by
Genome sequence and analysis of the tuber crop potato
The Potato Genome Sequencing Consortium (2011) · Nature · doi:10.1038/nature10158 · Cited by 2,065
The Ecoresponsive Genome of Daphnia pulex
Colbourne, J. K., Pfrender, M. E., Gilbert, D., Thomas, W. K., Tucker, A., Oakley, T. H., Tokishita, S., Aerts, A., Arnold, G. J., Basu, M. K., et al. (2011) · Science · doi:10.1126/science.1197761 · Cited by 1,211
An integrative approach to ortholog prediction for disease-focused and other functional studies
Hu, Y., Flockhart, I., Vinayagam, A., Bergwitz, C., Berger, B., Perrimon, N., & Mohr, S. E. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-357 · Cited by 848
Assessing the root of bilaterian animals with scalable phylogenomic methods
Hejnol, A., Obst, M., Stamatakis, A., Ott, M., Rouse, G. W., Edgecombe, G. D., Martinez, P., Baguñà, J., Bailly, X., Jondelius, U., et al. (2009) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2009.0896 · Cited by 747
BLAST-EXPLORER helps you building datasets for phylogenetic analysis
Dereeper, A., Audic, S., Claverie, J.-M., & Blanc, G. (2010) · BMC Evolutionary Biology · doi:10.1186/1471-2148-10-8 · Cited by 744
Metadata
- Authors
- Chen, F., Mackey, A. J., Vermunt, J. K., & Roos, D. S.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-04-18
- Volume
- 2
- Issue
- 4
- Pages
- e383
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2143335572
- Cited by
- 382
- References
- 41
- FWCI
- 9.82
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.