Cited by 209Genomics and Phylogenetic StudiesChromosomal and Genetic VariationsBioinformatics and Genomic Networks

The DOI matches its Crossref record; 68 of the 69 references it cites were found in a registry or an index; 53 of the 58 sources its claims cite were checked for support.

Integrating gene annotation with orthology inference at scale

Open access
Kirilenko, Bogdan M., Munegowda, Chetan, Osipova, Ekaterina, Jebb, David, Sharma, Virag, Blumer, Moritz, Morales, Ariadna E., Ahmed, Alexis-Walid, Kontopoulos, Dimitrios-Georgios, Hilgers, Leon, Lindblad-Toh, Kerstin, Karlsson, Elinor K., Zoonomia Consortium‡, Hiller, Michael, Andrews, Gregory, Armstrong, Joel C., Bianchi, Matteo, Birren, Bruce W., Bredemeyer, Kevin R., Breit, Ana M., Christmas, Matthew J., Clawson, Hiram, Damas, Joana, Di Palma, Federica, Diekhans, Mark, Dong, Michael X., Eizirik, Eduardo, Fan, Kaili, Fanter, Cornelia, Foley, Nicole M., Forsberg-Nilsson, Karin, Garcia, Carlos J., Gatesy, John, Gazal, Steven, Genereux, Diane P., Goodman, Linda, Grimshaw, Jenna, Halsey, Michaela K., Harris, Andrew J., Hickey, Glenn, Hiller, Michael, Hindle, Allyson G., Hubley, Robert M., Hughes, Graham M., Johnson, Jeremy, Juan, David, Kaplow, Irene M., Karlsson, Elinor K., Keough, Kathleen C., Kirilenko, Bogdan, Koepfli, Klaus-Peter, Korstian, Jennifer M., Kowalczyk, Amanda, Kozyrev, Sergey V., Lawler, Alyssa J., Lawless, Colleen, Lehmann, Thomas, Levesque, Danielle L., Lewin, Harris A., Li, Xue, Lind, Abigail, Lindblad-Toh, Kerstin, Mackay-Smith, Ava, Marinescu, Voichita D., Marques-Bonet, Tomas, Mason, Victor C., Meadows, Jennifer R. S., Meyer, Wynn K., Moore, Jill E., Moreira, Lucas R., Moreno-Santillan, Diana D., Morrill, Kathleen M., Muntané, Gerard, Murphy, William J., Navarro, Arcadi, Nweeia, Martin, Ortmann, Sylvia, Osmanski, Austin, Paten, Benedict, Paulat, Nicole S., Pfenning, Andreas R., Phan, BaDoi N., Pollard, Katherine S., Pratt, Henry E., Ray, David A., Reilly, Steven K., Rosen, Jeb R., Ruf, Irina, Ryan, Louise, Ryder, Oliver A., Sabeti, Pardis C., Schäffer, Daniel E., Serres, Aitor, Shapiro, Beth, Smit, Arian F. A., Springer, Mark, Srinivasan, Chaitanya, Steiner, Cynthia, Storer, Jessica M., Sullivan, Kevin A. M., Sullivan, Patrick F., Sundström, Elisabeth, Supple, Megan A., Swofford, Ross, Talbot, Joy-El, Teeling, Emma, Turner-Maier, Jason, Valenzuela, Alejandro, Wagner, Franziska, Wallerman, Ola, Wang, Chao, Wang, Juehan, Weng, Zhiping, Wilder, Aryn P., Wirthlin, Morgan E., Xue, James R., Zhang, Xiaomeng·2023·Science

Published version of a preprint

Abstract

Annotating coding genes and inferring orthologs are two classical challenges in genomics and evolutionary biology that have traditionally been approached separately, limiting scalability. We present TOGA (Tool to infer Orthologs from Genome Alignments), a method that integrates structural gene annotation and orthology inference. TOGA implements a different paradigm to infer orthologous loci, improves ortholog detection and annotation of conserved genes compared with state-of-the-art methods, and handles even highly fragmented assemblies. TOGA scales to hundreds of genomes, which we demonstrate by applying it to 488 placental mammal and 501 bird assemblies, creating the largest comparative gene resources so far. Additionally, TOGA detects gene losses, enables selection screens, and automatically provides a superior measure of mammalian genome quality. TOGA is a powerful and scalable method to annotate and compare genes in the genomic era.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

TOGA integrates structural gene annotation and orthology inference by using genome alignments and machine learning to project reference genes to query genomes. Applied to 488 placental mammal and 501 bird assemblies, it improves conserved-gene annotation, detects gene losses, joins fragmented genes, and provides a genome-quality measure.

Key findings

  • TOGA detected orthologs at scale: with human GENCODE 38 (19,464 genes) as reference, median 19,192 orthologs in six Hominoidea and 18,049 in the remaining 482 placental mammal assemblies; with mouse GENCODE M25 (22,257 genes), median 20,918 in 20 Muridae and 18,115 in the remaining 466; with chicken (18,039 genes), median 14,058 across 501 bird assemblies.
  • Compared with Ensembl Compara, TOGA detected 97.6%, 98.9%, and 96.5% of human orthologs for rat, cow, and elephant, and found 1,532, 1,711, and 2,174 additional orthologs; gene-loss specificity was 99.80–99.89% on 11,161 conserved genes (21 mouse, 22 rat, 12 cow, 21 dog misclassified).
  • TOGA improved BUSCO completeness of conserved genes: with human reference for 97% of Ensembl and 91.5% of NCBI species, average +4.1% (~377 genes) and +0.7% (~64 genes); with mouse reference for 98.5% Ensembl and 64% NCBI species. In fragmented sperm whale, joined genes reached 97% of human CDS length vs 59% for the largest fragment; Steller’s sea cow improved from 28% to 70%.
  • TOGA’s ancestral-gene completeness correlated with BUSCO genome completeness (Pearson r = 0.73, P = 10−81) but had larger dynamic range; e.g., *R. ferrumequinum* vs *R. sinicus* BUSCO 96.4% vs 96.3% but TOGA 94.4% vs 88.2%, and gaur vs cow inactivating mutations 14.2% vs 4.3% despite BUSCO 95.8% vs 95.5%.

Methods

  • TOGA takes a reference gene annotation and pairwise whole-genome alignment chains; classifies orthologous chains with XGBoost using features from coding, intronic, intergenic, flanking alignments and synteny; aligns exons with CESAR 2.0; classifies transcripts as intact, partially intact, missing, uncertain loss, or lost; infers orthology type and resolves weak many:many relationships with a graph approach.
  • Data: human GENCODE 38, mouse GENCODE M25, and chicken RefSeq references; applied to 488 placental mammal assemblies (427 species) and 501 bird assemblies (476 species); benchmarks against Ensembl Compara, NCBI annotations, BUSCO odb10, and 11,161 conserved genes; generalized linear models for ortholog counts.
  • Analyses included BUSCO protein/genome mode, EVidenceModeler annotation tests in six bats, gene-joining evaluation in sperm whale/pygmy sperm whale, and an ancestral placental mammal gene set of 18,430 genes.

Limitations

  • Stated: TOGA requires “alignable” genomes, generally ~0.6 substitutions per neutral site; for marsupials/monotremes human is not a powerful reference; homology-based TOGA cannot annotate orthologs of genes absent from the reference, and lineage-specific exons/genes require transcriptomics or ab initio predictions; non-mammalian use may need retraining, new features, and adjusted alignment/CESAR parameters.
  • Stated/evident: reference annotation quality and transcript filtering affect results; the classifier is trained on human-mouse orthologs and uses thresholds (e.g., orthology score ≥0.5, exon %identity ≥45%, %BLOSUM ≥20%) that may not generalize.
  • Evident: gene-loss specificity was benchmarked on 11,161 conserved genes after excluding short-intron genes, and assembly gaps/base errors can cause missing or inactivated classifications; performance depends on alignment sensitivity and assembly quality.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1126/science.abn3107

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

53 of 58 cited sources checked · 28 supported · 0 flagged · accuracy not yet measured

Show all 80 claims

  • Probably not a substantial claim. 31
  • It may state two separate claims as one. 45
  • The quote only partly states this claim. 1
69 of 69
  • The paper relies on this without support.

    Generating high-quality annotations is time-consuming and typically requires comprehensive transcriptomics data, leading to a growing gap between genome sequencing and annotation, including orthology inference.

    “Second, generating high-quality annotations is time-consuming and typically requires comprehensive transcriptomics (gene expression) data, leading to a growing gap between genome sequencing and annotation, including orthology inference.”
  • The paper relies on this without support.

    Alignment chains capture both orthologous gene loci as well as loci containing paralogs or processed pseudogenes.

    “These alignment chains capture both orthologous gene loci as well as loci containing paralogs or processed pseudogenes (Fig. 1A).”
  • The paper relies on this without support.

    Genes split between different scaffolds are often missed or annotated as fragments, hampering downstream analyses.

    “Genes split between different scaffolds are often missed or annotated as fragments, hampering downstream analyses.”
  • The paper relies on this without support.

    Sequences of orthologous but not paralogous genes from closely related species are expected to be highly similar.

    “To evaluate the accuracy of this procedure, we leveraged that sequences of orthologous but not paralogous genes from closely related species are expected to be highly similar.”
  • The paper relies on this without support.

    BUSCO’s fragmented or missing gene classification indicates how much of the gene was detected, but does not distinguish between assembly incompleteness that results in missing gene sequence and assembly base errors that destroy the reading frame.

    “BUSCO’s fragmented or missing gene classification indicates how much of the gene was detected, but does not distinguish between the two major underlying reasons: assembly incompleteness that results in missing gene sequence vs. assembly base errors that destroy the reading frame.”
  • The authors state this as an assumption.

    Missing codons in the unknown query sequence correspond to sense codons.

    “To distinguish between “uncertain loss” and “lost” transcripts, we count missing sequence as aligning codons, making the conservative assumption that missing codons correspond to sense codons in the unknown query sequence (fig. S13), since this procedure results in a consistent classification of transcripts that have the same inactivating mutations and only differ in the amount of missing sequence”
  • The paper relies on this without support.

    Artificially rearranged chain-gene pairs used as positive training data are representative of real orthologous genes that underwent genomic rearrangements.

    “Since we aimed at also accurately detecting orthologous genes that underwent genomic rearrangements, we enriched the positive training dataset with artificially rearranged chain-gene pairs, generated by trimming long syntenic chains to new single gene-covering chains.”
  • The paper relies on this without support.

    Human hg38 and mouse mm10 assemblies contain alternative haplotypes and structural variants.

    “The assemblies of human (hg38) and mouse (mm10) also contain alternative haplotypes and structural variants (e.g. chr22_KI270876v1_alt).”
  • The paper relies on this without support.

    Even for highly fragmented genome assemblies, low-scoring chains are extremely unlikely to represent orthologous parts of genes.

    “Even for highly fragmented genome assemblies, low-scoring chains are extremely unlikely to represent orthologous parts of genes.”
  • The paper relies on this without support.

    Evolutionary distance to human and divergence time to human are strongly positively correlated.

    “To account for the strong positive correlation between evolutionary distance and divergence time, we specified both variables not as separate but as interacting predictors in models that included both.”
  • The paper relies on this without support.

    Micro-introns shorter than 20 bp are often used to mask frameshifting mutations.

    “Fifth, we excluded isoforms that have introns shorter than 20 bp, as such micro-introns are often used to mask frameshifting mutations.”
11 of 11

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Conserved-gene benchmark is called both sensitivity and specificity testing

    Minor

    The methods label the conserved-gene benchmark a sensitivity evaluation, but the results call it a specificity benchmark. Treating losses among genes presumed conserved as false positives evaluates specificity, not sensitivity.

  • 509 mammalian alignments are described as placental

    Minor

    The methods call all 509 mammalian alignment chains placental, whereas the paper elsewhere distinguishes 488 placental from 21 non-placental mammal assemblies.

  • Loss precedence conflicts with the all-transcripts-loss rule

    Minor

    Putting "lost" ahead of "missing" would classify a locus with one lost and one missing transcript as lost. The stated rule says a locus is lost if and only if all its annotated transcripts are lost.

3 of 3

Citations

Cites

Flagged first, then by citations

Show all 69 references

1 of the 69 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. T. Chen C. Guestrin paper presented at the Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining San Francisco CA 13–17 August 2016.
  2. R. S. Harris Thesis The Pennsylvania State University (2007).

Cited by

Sorted by citations

Items 201–208 of 208

Metadata

Authors
Kirilenko, B. M., Munegowda, C., Osipova, E., Jebb, D., Sharma, V., Blumer, M., Morales, A. E., Ahmed, A.-W., Kontopoulos, D.-G., Hilgers, L., Lindblad-Toh, K., Karlsson, E. K., Zoonomia Consortium‡, Hiller, M., Andrews, G., Armstrong, J. C., Bianchi, M., Birren, B. W., Bredemeyer, K. R., Breit, A. M., Christmas, M. J., Clawson, H., Damas, J., Di Palma, F., Diekhans, M., Dong, M. X., Eizirik, E., Fan, K., Fanter, C., Foley, N. M., Forsberg-Nilsson, K., Garcia, C. J., Gatesy, J., Gazal, S., Genereux, D. P., Goodman, L., Grimshaw, J., Halsey, M. K., Harris, A. J., Hickey, G., Hiller, M., Hindle, A. G., Hubley, R. M., Hughes, G. M., Johnson, J., Juan, D., Kaplow, I. M., Karlsson, E. K., Keough, K. C., Kirilenko, B., Koepfli, K.-P., Korstian, J. M., Kowalczyk, A., Kozyrev, S. V., Lawler, A. J., Lawless, C., Lehmann, T., Levesque, D. L., Lewin, H. A., Li, X., Lind, A., Lindblad-Toh, K., Mackay-Smith, A., Marinescu, V. D., Marques-Bonet, T., Mason, V. C., Meadows, J. R. S., Meyer, W. K., Moore, J. E., Moreira, L. R., Moreno-Santillan, D. D., Morrill, K. M., Muntané, G., Murphy, W. J., Navarro, A., Nweeia, M., Ortmann, S., Osmanski, A., Paten, B., Paulat, N. S., Pfenning, A. R., Phan, B. N., Pollard, K. S., Pratt, H. E., Ray, D. A., Reilly, S. K., Rosen, J. R., Ruf, I., Ryan, L., Ryder, O. A., Sabeti, P. C., Schäffer, D. E., Serres, A., Shapiro, B., Smit, A. F. A., Springer, M., Srinivasan, C., Steiner, C., Storer, J. M., Sullivan, K. A. M., Sullivan, P. F., Sundström, E., Supple, M. A., Swofford, R., Talbot, J.-E., Teeling, E., Turner-Maier, J., Valenzuela, A., Wagner, F., Wallerman, O., Wang, C., Wang, J., Weng, Z., Wilder, A. P., Wirthlin, M. E., Xue, J. R., & Zhang, X.
Affiliations
  • Max Planck Institute of Molecular Cell Biology and Genetics, 01307 Dresden, Germany.
  • Goethe University Frankfurt (DE)
  • Max Planck Institute for the Physics of Complex Systems (DE)
  • Broad Institute (US)
ORCID
Venue
Science
Published
2023-04-28
Volume
380
Issue
6643
Pages
eabn3107-eabn3107
ISSN
  • 0036-8075 (ISSN-L)
  • 1095-9203
OpenAlex
W4367173676
Cited by
209
References
69
Citations by year
2026: 68 · 2025: 68 · 2024: 51 · 2023: 21
FWCI
18.46
Type
journal article
Language
en
Open access
Licence
cc-by-nd
Locations
  • Science (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nd)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • Repositori digital de la UPF (Universitat Pompeu Fabra) (submittedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
  • DIGITAL.CSIC (Spanish National Research Council (CSIC)) (submittedVersion)
Funders
  • Deutsche Forschungsgemeinschaft (HI1423/5-1, HI1423/4-1)
  • Hessisches Ministerium für Wissenschaft und Kunst
  • Max-Planck-Gesellschaft
  • Max-Planck-Institut für Physik Komplexer Systeme
  • National Institutes of Health
  • National Human Genome Research Institute (R01HG010485, R01HG008742, U24HG007234)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Chromosomal and Genetic Variations
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
Keywords
orthology inference, genome annotation, TOGA, genome alignment, conserved genes, placental mammals, birds, comparative genomics, genome assembly quality
MeSH terms
Eutheria, Animals, Birds, Female, Genome, Genomics, Mice, Molecular Sequence Annotation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-02, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-02 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review