Analysis of several key factors influencing deep learning-based inter-residue contact prediction
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Motivation: Deep learning has become the dominant technology for protein contact prediction. However, the factors that affect the performance of deep learning in contact prediction have not been systematically investigated. Results: We analyzed the results of our three deep learning-based contact prediction methods (MULTICOM-CLUSTER, MULTICOM-CONSTRUCT and MULTICOM-NOVEL) in the CASP13 experiment and identified several key factors [i.e. deep learning technique, multiple sequence alignment (MSA), distance distribution prediction and domain-based contact integration] that influenced the contact prediction accuracy. We compared our convolutional neural network (CNN)-based contact prediction methods with three coevolution-based methods on 75 CASP13 targets consisting of 108 domains. We demonstrated that the CNN-based multi-distance approach was able to leverage global coevolutionary coupling patterns comprised of multiple correlated contacts for more accurate contact prediction than the local coevolution-based methods, leading to a substantial increase of precision by 19.2 percentage points. We also tested different alignment methods and domain-based contact prediction with the deep learning contact predictors. The comparison of the three methods showed deeper sequence alignments and the integration of domain-based contact prediction with the full-length contact prediction improved the performance of contact prediction. Moreover, we demonstrated that the domain-based contact prediction based on a novel ab initio approach of parsing domains from MSAs alone without using known protein structures was a simple, fast approach to improve contact prediction. Finally, we showed that predicting the distribution of inter-residue distances in multiple distance intervals could capture more structural information and improve binary contact prediction. Availability and implementation: https://github.com/multicom-toolbox/DNCON2/. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets
Steinegger, M., & Söding, J. (2017) · Nature Biotechnology · doi:10.1038/nbt.3988 · Cited by 4,840
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
Protein 3D Structure Computed from Evolutionary Sequence Variation
Marks, D. S., Colwell, L. J., Sheridan, R., Hopf, T. A., Pagnani, A., Zecchina, R., & Sander, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028766 · Cited by 1,144
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Wang, S., Sun, S., Li, Z., Zhang, R., & Xu, J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005324 · Cited by 931
Clustering huge protein sequence sets in linear time
Steinegger, M., & Söding, J. (2018) · Nature Communications · doi:10.1038/s41467-018-04964-5 · Cited by 875 · cited 1×
“6 billion metagenomic sequence fragments with 50% sequence identity (Steinegger and Soding, 2018).”
BackgroundImproved contact prediction in proteins: using pseudolikelihoods to infer Potts models
Ekeberg, M., Lövkvist, C., Lan, Y., Weigt, M., & Aurell, E. (2013) · Physical Review E · doi:10.1103/physreve.87.012707 · Cited by 661
Protein structure determination using metagenome sequence data
Ovchinnikov, S., Park, H., Varghese, N., Huang, P.-S., Pavlopoulos, G. A., Kim, D. E., Kamisetty, H., Kyrpides, N. C., & Baker, D. (2017) · Science · doi:10.1126/science.aah4043 · Cited by 520
Li, Y., Hu, J., Zhang, C., Yu, D.-J., & Zhang, Y. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz291 · Cited by 158
DESTINI: A deep-learning approach to contact-driven protein structure prediction
Gao, M., Zhou, H., & Skolnick, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-40314-1 · Cited by 61
Research works printed but not linked: 28
- Adhikari, 2018, CONFOLD2: improved contact-driven ab initio protein structure modeling, BMC Bioinformatics, 19, 22, 10.1186/s12859-018-2032-6 · DOI · Paper page
- Adhikari, 2016, ConEVA: a toolbox for comprehensive assessment of protein contacts, BMC Bioinformatics, 17, 517., 10.1186/s12859-016-1404-z · DOI
- Adhikari, 2018, DNCON2: improved protein contact prediction using two-level deep convolutional neural networks, Bioinformatics, 34, 1466, 10.1093/bioinformatics/btx781 · DOI · Paper page
- Altschuh, 1988, Coordinated amino acid changes in homologous protein families, Protein Eng, 2, 193, 10.1093/protein/2.3.193 · DOI · Paper page
- Brunger, 1998, Crystallography & NMR system: a new software suite for macromolecular structure determination, Acta Crystallogr. D Biol. Crystallogr, 54 (Pt 5), 905, 10.1107/S0907444998003254 · DOI · Paper page
- Buchan, 2018, Improved protein contact predictions with the MetaPSICOV2 server in CASP12, Proteins, 86 (Suppl. 1), 78, 10.1002/prot.25379 · DOI · Paper page
- Di Lena, 2012, Deep architectures for protein contact map prediction, Bioinformatics, 28, 2449, 10.1093/bioinformatics/bts475 · DOI · Paper page
- Eickholt, 2012, Predicting protein residue-residue contacts using deep networks and boosting, Bioinformatics, 28, 3066, 10.1093/bioinformatics/bts598 · DOI · Paper page
- Gobel, 1994, Correlated mutations and residue contacts in proteins, Proteins, 18, 309, 10.1002/prot.340180402 · DOI · Paper page
- Hanson, 2018, Accurate prediction of protein contact maps by coupling residual two-dimensional bidirectional long short-term memory with convolutional neural networks, Bioinformatics, 34, 4039, 10.1093/bioinformatics/bty481 · DOI · Paper page
- Hou, 2019, Protein tertiary structure modeling driven by deep learning and contact distance prediction in CASP13, Proteins: Struct., Funct., Bioinf., 10.1002/prot.25697 · DOI · Paper page
- Johnson, 2010, Hidden Markov model speed heuristic and iterative HMM search procedure, BMC Bioinformatics, 11, 431, 10.1186/1471-2105-11-431 · DOI · Paper page
- Jones, 2018, High precision in protein contact prediction using fully convolutional neural networks and minimal sequence features, Bioinformatics, 34, 3308, 10.1093/bioinformatics/bty341 · DOI · Paper page
- Jones, 2012, PSICOV: precise structural contact prediction using sparse inverse covariance estimation on large multiple sequence alignments, Bioinformatics, 28, 184, 10.1093/bioinformatics/btr638 · DOI · Paper page
- Jones, 2015, MetaPSICOV: combining coevolution methods for accurate prediction of contacts and long range hydrogen bonding in proteins, Bioinformatics, 31, 999, 10.1093/bioinformatics/btu791 · DOI · Paper page
- Kajan, 2014, FreeContact: fast and free software for protein contact prediction from residue co-evolution, BMC Bioinformatics, 15, 85., 10.1186/1471-2105-15-85 · DOI · Paper page
- Kamisetty, 2013, Assessing the utility of coevolution-based residue-residue contact predictions in a sequence- and structure-rich era, Proc. Natl. Acad. Sci. U. S. A, 110, 15674, 10.1073/pnas.1314045110 · DOI · Paper page
- Kandathil, 2019, Prediction of inter-residue contacts with DeepMetaPSICOV in CASP13, bioRxiv, 586800
- Meyer, 2008, The metagenomics RAST server—a public resource for the automatic phylogenetic and functional analysis of metagenomes, BMC Bioinformatics, 9, 386., 10.1186/1471-2105-9-386 · DOI · Paper page
- Michel, 2017, Large-scale structure prediction by improved contact predictions and model quality assessment, Bioinformatics, 33, i23, 10.1093/bioinformatics/btx239 · DOI · Paper page
- Monastyrskyy, 2014, Evaluation of residue–residue contact prediction in CASP10, Funct. Bioinformatics, 82, 138, 10.1002/prot.24340 · DOI
- Pollastri, 2002, Prediction of contact maps by GIOHMMs and recurrent neural networks using lateral propagation from all four cardinal corners, Bioinformatics, 18 (Suppl. 1), S62, 10.1093/bioinformatics/18.suppl_1.S62 · DOI · Paper page
- Seemayer, 2014, CCMpred—fast and precise prediction of protein residue-residue contacts from correlated mutations, Bioinformatics, 30, 3128, 10.1093/bioinformatics/btu500 · DOI · Paper page
- Skwark, 2014, Improved contact predictions using the recognition of protein like contact patterns, PLoS Comput. Biol, 10, e1003889., 10.1371/journal.pcbi.1003889 · DOI · Paper page
- Tegge, 2009, NNcon: improved protein contact map prediction using 2D-recursive neural networks, Nucleic Acids Res, 37, W515, 10.1093/nar/gkp305 · DOI · Paper page
- Weigt, 2009, Identification of direct residue contacts in protein-protein interaction by message passing, Proc. Natl. Acad. Sci. USA, 106, 67, 10.1073/pnas.0805923106 · DOI · Paper page
- Wilke, 2016, The MG-RAST metagenomics database and portal in 2015, Nucleic Acids Res, 44, D590, 10.1093/nar/gkv1322 · DOI · Paper page
- Xu, 2019, Analysis of distance-based protein structure prediction by deep learning in CASP13, bioRxiv, 624460
Cited by
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Abramson, J., Adler, J., Dunger, J., Evans, R., Green, T., Pritzel, A., Ronneberger, O., Willmore, L., Ballard, A. J., Bambrick, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07487-w · Cited by 15,861
“Per-residue N eff values were obtained by counting the number of non-gap residues in the MSA for this position and weighting the sequences using the N eff scheme 49 with a threshold of 80% sequence identity measured on the region that is non-gap in either sequence.”
MethodAccurate proteome-wide missense variant effect prediction with AlphaMissense
Cheng, J., Novati, G., Pan, J., Bycroft, C., Žemgulytė, A., Applebaum, T., Pritzel, A., Wong, L. H., Zielinski, M., Sargeant, T., et al. (2023) · Science · doi:10.1126/science.adg7492 · Cited by 2,163
Self-citationDeep learning methods in protein structure prediction
Torrisi, M., Pollastri, G., & Le, Q. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2019.12.011 · Cited by 284
AlphaFold predictions of fold-switched conformations are driven by structure memorization
Chakravarty, D., Schafer, J. W., Chen, E. A., Thole, J. F., Ronish, L. A., Lee, M., & Porter, L. L. (2024) · Nature Communications · doi:10.1038/s41467-024-51801-z · Cited by 159
Metadata
- Authors
- Wu, T., Hou, J., Adhikari, B., & Cheng, J.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-08-30
- Volume
- 36
- Issue
- 4
- Pages
- 1091-1098
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2970594786
- Cited by
- 40
- References
- 9
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- NIH
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysis of several key factors influencing deep learning-based inter-residue contact prediction. https://app.cochat.ai/papers/10.1093/bioinformatics/btz679
- The paper
- Wu, T., Hou, J., Adhikari, B., & Cheng, J. (2020). Analysis of several key factors influencing deep learning-based inter-residue contact prediction. Bioinformatics. https://doi.org/10.1093/bioinformatics/btz679
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.