TM-Vec: template modeling vectors for fast homology detection and alignment
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Exploiting sequence-structure-function relationships in molecular biology and computational modeling relies on detecting proteins with high sequence similarities. However, the most commonly used sequence alignment-based methods, such as BLAST, frequently fail on proteins with low sequence similarity to previously annotated proteins. We developed a deep learning method, TM-Vec, that uses sequence alignments to learn structural features that can then be used to search for structure-structure similarities in large sequence databases. We train TM-Vec to accurately predict TM-scores as a metric of structural similarity for pairs of structures directly from sequence pairs without the need for intermediate computation or solution of structures. For remote homologs (sequence similarity ≤ 10%) that are highly structurally similar (TM-score ? 0.6), we predict TM-scores within 0.026 of their value computed by TM-align. TM-Vec outperforms traditional sequence alignment methods and performs similar to structure-based alignment methods. TM-Vec was trained on the CATH and SwissModel structural databases and it has been tested on carefully curated structure-structure alignment databases that were designed specifically to test very remote homology detection methods. It scales sub-linearly for search against large protein databases and is well suited for discovering remotely homologous proteins.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280 · cited 2×
“Multiple studies have shown the merits of these models when performing protein structure prediction, remote homology and protein design [29, 55, 28, 31, 30, 32, 33].”
BackgroundSIGNATURE VERIFICATION USING A “SIAMESE” TIME DELAY NEURAL NETWORK
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1994) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/9789812797926_0003 · Cited by 2,350
The InterPro protein families and domains database: 20 years on
Blum, M., Chang, H.-Y., Chuguransky, S., Grego, T., Kandasaamy, S., Mitchell, A., Nuka, G., Paysan-Lafosse, T., Qureshi, M., Raj, S., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa977 · Cited by 2,231 · cited 1×
“Over the last 50 years, sequence homology has enabled a wide array of applications, from annotating protein functions [3, 4, 5, 6, 7], predicting protein structure and protein interactions [8, 9, 10, 11, 12, 13], aiding protein design [14] and modeling evolutionary relationships [1].”
BackgroundScaling laws predict global microbial diversity
Locey, K. J., & Lennon, J. T. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521291113 · Cited by 1,184
Unified rational protein engineering with sequence-based deep representation learning
Alley, E. C., Khimulya, G., Biswas, S., AlQuraishi, M., & Church, G. M. (2019) · Nature Methods · doi:10.1038/s41592-019-0598-1 · Cited by 1,131 · cited 2×
“Multiple studies have shown the merits of these models when performing protein structure prediction, remote homology and protein design [29, 55, 28, 31, 30, 32, 33].”
BackgroundDisease variant prediction with deep generative models of evolutionary data
Frazer, J., Notin, P., Dias, M., Gomez, A., Min, J. K., Brock, K., Gal, Y., & Marks, D. S. (2021) · Nature · doi:10.1038/s41586-021-04043-8 · Cited by 791
Mutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775 · cited 1×
“From a benchmark using the VIPUR dataset, TM-Vec was unable to detect structural differences caused by both deleterious and synonymous point mutations in proteins [50, 51, 52, 53, 54, 14].”
MethodEvaluating Protein Transfer Learning with TAPE
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · doi:10.1101/676825 · Cited by 719 · cited 3×
“Multiple studies have shown the merits of these models when performing protein structure prediction, remote homology and protein design [29, 55, 28, 31, 30, 32, 33].”
BackgroundModeling the language of life – Deep Learning Protein Sequences
Heinzinger, M., Elnaggar, A., Wang, Y., Dallago, C., Nechaev, D., Matthes, F., & Rost, B. (2019) · doi:10.1101/614313 · Cited by 606
Modeling aspects of the language of life through transfer-learning protein sequences
Heinzinger, M., Elnaggar, A., Wang, Y., Dallago, C., Nechaev, D., Matthes, F., & Rost, B. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-3220-8 · Cited by 606 · cited 2×
“Multiple studies have shown the merits of these models when performing protein structure prediction, remote homology and protein design [29, 55, 28, 31, 30, 32, 33].”
BackgroundCATH: increased structural coverage of functional space
Sillitoe, I., Bordin, N., Dawson, N., Waman, V. P., Ashford, P., Scholes, H. M., Pang, C. S. M., Woodridge, L., Rauer, C., Sen, N., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1079 · Cited by 509
Single-sequence protein structure prediction using language models from deep learning
Chowdhury, R., Bouatta, N., Biswas, S., Rochereau, C., Church, G. M., Sorger, P. K., & AlQuraishi, M. (2021) · doi:10.1101/2021.08.02.454840 · Cited by 455 · cited 1×
“Over the last 50 years, sequence homology has enabled a wide array of applications, from annotating protein functions [3, 4, 5, 6, 7], predicting protein structure and protein interactions [8, 9, 10, 11, 12, 13], aiding protein design [14] and modeling evolutionary relationships [1].”
BackgroundSingle-sequence protein structure prediction using a language model and deep learning
Chowdhury, R., Bouatta, N., Biswas, S., Floristean, C., Kharkar, A., Roy, K., Rochereau, C., Ahdritz, G., Zhang, J., Church, G. M., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01432-w · Cited by 455
Learning protein sequence embeddings using information from structure
Bepler, T., & Berger, B. (2019) · arXiv · doi:10.48550/arxiv.1902.08661 · Cited by 219 · cited 4×
“Here, we have used the pretrained LSTM PFam model from [27].”
BackgroundMethodInfluential
Research works printed but not linked: 60
- 10.1006/jmbi.1990.9999 · doi:10.1006/jmbi.1990.9999 · Paper page
- 10.1093/nar/gkr367 · DOI · Paper page
- 10.1038/75556 · DOI · Paper page
- 10.1093/nar/gkm960 · DOI · Paper page
- 10.1093/nar/gky1085 · DOI · Paper page
- 10.1186/gb-2009-10-2-207 · DOI · Paper page
- 2019, Nature Communications, 10, 3977
- 2020, Nature, 577, 706
- 2022, Nature Methods, 19, 679
- 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
- 2021, Nature Communications, 12, 2403
- 10.1093/nar/gki524 · DOI · Paper page
- Chiara Vanni , Matthew S Schechter , Silvia Acinas , Albert Barberán , Pier Luigi Buttigieg , Emilio O Casamayor , Tom O Delmont , Carlos M Duarte , A Murat Eren , Robert D Finn , et al. Light into the darkness: Unifying the known and unknown coding sequence space in microbiome analyses. BioRxiv, 2020. · DOI
- Liisa Holm , Sakari Kääriäinen , Chris Wilton , and Dariusz Plewczynski . Using Dali for Structural Comparison of Proteins. Current Protocols in Bioinformatics, pages 1–24, 2006. · DOI · Paper page
- 2005, FAST: A novel protein structure alignment algorithm, Proteins: Structure, Function and Genetics, 58, 618, 10.1002/prot.20331 · DOI · Paper page
- 10.1110/ps.0215902 · DOI · Paper page
- 10.1142/S0219720003000186 · DOI · Paper page
- Vladimir Gligorijevic , P Douglas Renfrew , Tomasz Kosciolek , Julia Koehler Leman , Daniel Berenberg , Tommi Vatanen , Chris Chandler , Bryn C Taylor , Ian M Fisk , Hera Vlamakis , et al. Structure-based function prediction using graph convolutional networks. bioRxiv, page 786236, 2020. · DOI · Paper page
- 10.1093/nar/gkt1069 · DOI · Paper page
- 2022, Folding the unfoldable: using alphafold to explore spurious proteins, Bioinformatics Advances, 2, vbab043, 10.1093/bioadv/vbab043 · DOI · Paper page
- Charlotte Tumescheit Milot Mirdita Johannes Söding Martin Steinegger Michel van Kempen , Stephanie S. Kim . Foldseek: fast and accurate protein structure search. bioRxiv, 2022.
- Felipe Llinares-López , Quentin Berthet , Mathieu Blondel , Olivier Teboul , and Jean-Philippe Vert . Deep embedding and alignment of protein sequences. November 2021. · doi:10.1101/2021.11.15.468653
- Michael Heinzinger , Maria Littmann , Ian Sillitoe , Nicola Bordin , Christine Orengo , and Burkhard Rost . Contrastive learning on protein embeddings enlightens midnight zone at lightning speed. bioRxiv, 2021. · DOI · Paper page
- Tristan Bepler and Bonnie Berger . Learning protein sequence embeddings using information from structure. 7th International Conference on Learning Representations, ICLR 2019, pages 1–17, 2019.
- Ahmed Elnaggar , Michael Heinzinger , Christian Dallago , Ghalia Rihawi , Yu Wang , Llion Jones , Tom Gibbs , Tamas Feher , Christoph Angerer , Debsindhu Bhowmik , et al. Prottrans: Towards cracking the language of life’s code through self-supervised deep learning and high performance computing. arXiv preprint arXiv:2007.06225, 2020. · DOI · Paper page
- Amy X Lu , Haoran Zhang , Marzyeh Ghassemi , and Alan Moses . Self-supervised contrastive learning of protein representations by mutual information maximization. bioRxiv, 2020.
- 2008, MALISAM: A database of structurally analogous motifs in proteins, Nucleic Acids Research, 36, 211
- 2008, MALIDUP: A database of manually constructed structure alignments for duplicated domain pairs, Proteins: Structure, Function and Genetics, 70, 1162, 10.1002/prot.21783 · DOI
- 10.1093/nar/gkz1064 · DOI · Paper page
- 10.1016/S0969-2126(97)00260-8 · DOI · Paper page
- 2018, Critical assessment of methods of protein structure prediction (casp)—round xii, Proteins: Structure, Function, and Bioinformatics, 86, 7, 10.1002/prot.25415 · DOI · Paper page
- Richard Durbin , Sean R Eddy , Anders Krogh , and Graeme Mitchison . Biological sequence analysis: probabilistic models of proteins and nucleic acids. Cambridge university press, 1998. · DOI · Paper page
- 10.1016/0022-2836(85)90137-8 · DOI · Paper page
- 1996, Synonymous nucleotide divergence: what is “saturation”?, Genetics, 142, 1033, 10.1093/genetics/142.3.1033 · doi:10.1093/genetics/142.3.1033
- Julia Koehler Leman , Pawel Szczerbiak , P. Douglas Renfrew , Vladimir Gligorijevic , Daniel Berenberg , Tommi Vatanen , Bryn C. Taylor , Chris Chandler , Stefan Janssen , Andras Pataki , Nick Carriero , Ian Fisk , Ramnik J. Xavier , Rob Knight , Richard Bonneau , and Tomasz Kosciolek . Sequence-structure-function relationships in the microbial protein universe. March 2022. · DOI
- 2021, Nature Methods, 18, 366
- 10.1093/nar/gkt391 · DOI · Paper page
- 2015, A large scale prediction of bacteriocin gene blocks suggests a wide functional spectrum for bacteriocins, BMC Bioinformatics, 16, 381, 10.1186/s12859-015-0792-9 · DOI · Paper page
- 2018, Identifying antimicrobial peptides using word embedding with deep recurrent neural networks, Bioinformatics, 35, 2009
- 10.1093/nar/gkw120 · DOI
- Christian Dallago , Jody Mou , Kadina E. Johnston , Bruce J. Wittmann , Nicholas Bhattacharya , Samuel Goldman , Ali Madani , and Kevin K. Yang . FLIP: Benchmark tasks in fitness landscape inference for proteins. January 2022. Pages: 2021.11.09.467890 Section: New Results. · DOI · Paper page
- 2018, Nature Methods, 15, 816
- Jonathan Frazer , Pascal Notin , Mafalda Dias , Aidan Gomez , Kelly Brock , Yarin Gal , and Debora S. Marks . Large-scale clinical interpretation of genetic variants using evolutionary data and deep learning. December 2020. · DOI
- Adam J Riesselman , Jung-Eun Shin , Aaron W Kollasch , Conor McMahon , Elana Simon , Chris Sander , Aashish Manglik , Andrew C Kruse , and Debora S Marks . Accelerating protein design using autoregressive generative models. bioRxiv, page 757252, 2019.
- Marco Cuturi and Mathieu Blondel . Soft-dtw: a differentiable loss function for time-series. arXiv preprint arXiv:1703.01541, 2017. · arXiv
- 2018, Differentiable dynamic programming for structured prediction and attention, 35th International Conference on Machine Learning, ICML 2018, 8, 5540
- 2018, Neural edit operations for biological sequences, Advances in Neural Information Processing Systems, 2018-Decem, 4960
- 10.1186/1471-2105-9-1 · DOI · Paper page
- 10.1093/nar/gkl971 · DOI · Paper page
- 10.1093/nar/gki524 · DOI · Paper page
- 10.1093/bioinformatics/btq572 · DOI · Paper page
- James T Morton , Charlie EM Strauss , Robert Blackwell , Daniel Berenberg , Vladimir Gligorijevic , and Richard Bonneau . Protein structural alignments from sequence. BioRxiv, 2020. · DOI · Paper page
- 2017, Scientific Reports, 7, 14890
- 10.1093/bioinformatics/btt717 · DOI · Paper page
- 2017, Improving protein fold recognition by extracting fold-specific features from predicted residue–residue contacts, Bioinformatics, 33, 3749, 10.1093/bioinformatics/btx514 · DOI
- Thomas N. Kipf and Max Welling . Semi-supervised classification with graph convolutional networks. CoRR, abs/1609.02907, 2016. · arXiv
- Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , et al. Pytorch: An imperative style, high-performance deep learning library. In Advances in neural information processing systems, pages 8026–8037, 2019.
- 10.1093/bioinformatics/btp163 · DOI · Paper page
- 2020, Scipy 1.0: fundamental algorithms for scientific computing in python, Nature methods, 17, 261, 10.1038/s41592-019-0686-2 · DOI · Paper page
- Charles R Harris , K Jarrod Millman , Stéfan J van der Walt , Ralf Gommers , Pauli Virtanen , David Cournapeau , Eric Wieser , Julian Taylor , Sebastian Berg , Nathaniel J Smith , et al. Array programming with numpy. arXiv preprint arXiv:2006.10256, 2020. · DOI · Paper page
Cited by
Pantolini, L., Studer, G., Pereira, J., Durairaj, J., Tauriello, G., & Schwede, T. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btad786 · Cited by 55
Pantolini, L., Studer, G., Pereira, J., Durairaj, J., & Schwede, T. (2022) · doi:10.1101/2022.12.13.520313 · Cited by 55
(2024) · doi:10.7554/elife.91415.3 · Cited by 3
Johnson, S. R., Peshwa, M., & Sun, Z. (2024) · doi:10.7554/elife.91415.2 · Cited by 2
Lyu, Q., Wei, H., Chen, S., Peng, Z., & Yang, J. (2025) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5c02385 · Cited by 1
Metadata
- Authors
- Hamamsy, T., Morton, J. T., Berenberg, D., Carriero, N., Gligorijevic, V., Blackwell, R., Strauss, C. E. M., Leman, J. K., Cho, K., & Bonneau, R.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2022-07-27
- OpenAlex
- W4288077714
- Cited by
- 17
- References
- 18
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.