The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
PSICOV: precise structural contact prediction using sparse inverse covariance estimation on large multiple sequence alignments
Open accessAbstract
Motivation: The accurate prediction of residue–residue contacts, critical for maintaining the native fold of a protein, remains an open problem in the field of structural bioinformatics. Interest in this long-standing problem has increased recently with algorithmic improvements and the rapid growth in the sizes of sequence families. Progress could have major impacts in both structure and function prediction to name but two benefits. Sequence-based contact predictions are usually made by identifying correlated mutations within multiple sequence alignments (MSAs), most commonly through the information-theoretic approach of calculating mutual information between pairs of sites in proteins. These predictions are often inaccurate because the true covariation signal in the MSA is often masked by biases from many ancillary indirect-coupling or phylogenetic effects. Here we present a novel method, PSICOV, which introduces the use of sparse inverse covariance estimation to the problem of protein contact prediction. Our method builds on work which had previously demonstrated corrections for phylogenetic and entropic correlation noise and allows accurate discrimination of direct from indirectly coupled mutation correlations in the MSA. Results: PSICOV displays a mean precision substantially better than the best performing normalized mutual information approach and Bayesian networks. For 118 out of 150 targets, the L/5 (i.e. top-L/5 predictions for a protein of length L) precision for long-range contacts (sequence separation >23) was ≥0.5, which represents an improvement sufficient to be of significant benefit in protein structure prediction or model quality assessment. Availability: The PSICOV source code can be downloaded from http://bioinf.cs.ucl.ac.uk/downloads/PSICOV Contact: d.jones@cs.ucl.ac.uk Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Pfam protein families database
Finn, R. D., Mistry, J., Tate, J., Coggill, P., Heger, A., Pollington, J. E., Gavin, O. L., Gunasekaran, P., Ceric, G., Forslund, K., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp985 · Cited by 2,694
Correlated mutations in models of protein sequences: phylogenetic and structural effects
Lapedes, A. S., Giraud, B., Liu, L., & Stormo, G. D. (1999) · Institute of Mathematical Statistics Lecture Notes - Monograph Series · doi:10.1214/lnms/1215455556 · Cited by 124
Research works printed but not linked: 40
- Ashkenazy, 2010, Reducing phylogenetic bias in correlated mutation analysis, Protein Eng. Des. Sel., 23, 321, 10.1093/protein/gzp078 · DOI
- Banerjee, 2008, Model selection through sparse maximum likelihood estimation, J. Mach. Learn. Res., 9, 485
- Berman, 2000, The protein data bank, Nucleic Acids Res., 28, 235, 10.1093/nar/28.1.235 · DOI · Paper page
- Bühlmann, 2011, Statistics for High-Dimensional Data: Methods, Theory and Applications., 10.1007/978-3-642-20192-9 · DOI
- Burger, 2010, Disentangling direct from indirect co-evolution of residues in protein alignments, PLoS Comput. Biol., 6, e1000633, 10.1371/journal.pcbi.1000633 · DOI
- Buslje, 2009, Correction for phylogeny, small number of observations and data redundancy improves the identification of coevolving amino acid pairs using mutual information, Bioinformatics, 25, 1125, 10.1093/bioinformatics/btp135 · DOI
- Dunn, 2008, Mutual information without the influence of phylogeny or entropy dramatically improves residue contact prediction, Bioinformatics, 24, 333, 10.1093/bioinformatics/btm604 · DOI
- Ezkurdia, 2009, Assessment of domain boundary predictions and the prediction of intramolecular contacts in CASP8, Proteins, 77, 196, 10.1002/prot.22554 · DOI
- Fariselli, 2001, Prediction of contact maps with neural networks and correlated mutations, Protein Eng., 14, 835, 10.1093/protein/14.11.835 · DOI
- Fischer, 2001, CAFASP2: the second critical assessment of fully automated structure prediction methods, Proteins, 45, 171, 10.1002/prot.10036 · DOI
- Friedman, 2008, Sparse inverse covariance estimation with the graphical Lasso, Biostatistics, 9, 432, 10.1093/biostatistics/kxm045 · DOI · Paper page
- Gobel, 1994, Correlated mutations and residue contacts in proteins, Proteins, 18, 309, 10.1002/prot.340180402 · DOI · Paper page
- Graña, 2005, CASP6 assessment of contact prediction, Proteins, 61, 214, 10.1002/prot.20739 · DOI
- Graña, 2005, EVAcon: a protein contact prediction evaluation service, Nucleic Acids Res., 33, W347, 10.1093/nar/gki411 · DOI
- Gromiha, 2004, Inter-residue interactions in protein folding and stability, Prog. Biophys. Mol. Biol., 86, 235, 10.1016/j.pbiomolbio.2003.09.003 · DOI · Paper page
- Halabi, 2009, Protein sectors: evolutionary units of three-dimensional structure, Cell, 138, 774, 10.1016/j.cell.2009.07.038 · DOI · Paper page
- Hamilton, 2008, An introduction to protein contact prediction, Methods Mol. Biol., 453, 87, 10.1007/978-1-60327-429-6_3 · DOI
- Hamilton, 2004, Protein contact prediction using patterns of correlation, Proteins, 56, 679, 10.1002/prot.20160 · DOI
- Henikoff, 1992, Amino acid substitution matrices from protein blocks, Proc. Natl Acad. Sci. USA, 89, 10915, 10.1073/pnas.89.22.10915 · DOI · Paper page
- Henikoff, 1994, Position-based sequence weights, J. Mol. Biol., 243, 574, 10.1016/0022-2836(94)90032-9 · DOI · Paper page
- Horner, 2008, Correlated substitution analysis and the prediction of amino acid structural contacts, Brief. Bioinform., 9, 46, 10.1093/bib/bbm052 · DOI
- Ledoit, 2003, Improved estimation of the covariance matrix of stock returns with an application to portfolio selection, J. Empir. Finance, 10, 603, 10.1016/S0927-5398(03)00007-0 · DOI · Paper page
- Lena, 2011, Is there an optimal substitution matrix for contact prediction with correlated mutations?, IEEE/ACM Trans. Comput. Biol. Bioinform., 8, 1017, 10.1109/TCBB.2010.91 · DOI
- Ma, 2007, Supervised group Lasso with applications to microarray data analysis, BMC Bioinformatics, 8, 60, 10.1186/1471-2105-8-60 · DOI
- MacCallum, 2004, Striped sheets and protein contact prediction, Bioinformatics, 20, i224, 10.1093/bioinformatics/bth913 · DOI
- Magrane, 2011, UniProt knowledgebase: a hub of integrated protein data, Database, 2011, bar009, 10.1093/database/bar009 · DOI
- Martin, 2005, Using information theory to search for co-evolving residues in proteins, Bioinformatics, 21, 4116, 10.1093/bioinformatics/bti671 · DOI
- McLachlan, 1971, Tests for comparing related amino-acid sequences. cytochrome c and cytochrome c 551, J. Mol. Biol., 61, 409, 10.1016/0022-2836(71)90390-1 · DOI
- Meinshausen, 2006, High dimensional graphs and variable selection with the Lasso, Ann. Stat., 34, 1436, 10.1214/009053606000000281 · DOI · Paper page
- Miller, 2008, Using inferred residue contacts to distinguish between correct and incorrect protein models, Bioinformatics, 24, 1575, 10.1093/bioinformatics/btn248 · DOI
- Neher, 1994, How frequent are correlated changes in families of protein sequences?, Proc. Natl Acad. Sci. USA, 91, 98, 10.1073/pnas.91.1.98 · DOI
- Olmea, 1997, Improving contact predictions by the combination of correlated mutations and other sources of sequence information, Fold Des., 2, S25, 10.1016/S1359-0278(97)00060-6 · DOI
- Pollastri, 2002, Prediction of contact maps by giohmms and recurrent neural networks using lateral propagation from all four cardinal corners, Bioinformatics, 18, S62, 10.1093/bioinformatics/18.suppl_1.S62 · DOI
- Pollock, 1997, Effectiveness of correlation analysis in identifying protein residues undergoing correlated evolution, Protein Eng., 10, 647, 10.1093/protein/10.6.647 · DOI
- Punta, 2005, PROFcon: novel prediction of long-range contacts, Bioinformatics, 21, 2960, 10.1093/bioinformatics/bti454 · DOI
- Shao, 2003, Predicting interresidue contacts using templates and pathways, Proteins, 53, 497, 10.1002/prot.10539 · DOI
- Weigt, 2009, Identification of direct residue contacts in protein-protein interaction by message passing, Proc. Natl Acad. Sci. USA, 106, 67, 10.1073/pnas.0805923106 · DOI · Paper page
- Xue, 2009, Predicting residue-residue contact maps by a two-layer, integrated neural-network method, Proteins, 76, 176, 10.1002/prot.22329 · DOI
- Yuan, 2005, Better prediction of protein contact number using a support vector regression analysis of amino acid sequence, BMC Bioinformatics, 6, 248, 10.1186/1471-2105-6-248 · DOI
- Yuan, 2007, Model selection and estimation in the gaussian graphical model, Biometrika, 91, 19, 10.1093/biomet/asm018 · DOI · Paper page
Cited by
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
Improved protein structure prediction using potentials from deep learning
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Žídek, A., Nelson, A. W. R., Bridgland, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1923-7 · Cited by 3,378
Self-citationSparse and Compositionally Robust Inference of Microbial Ecological Networks
Kurtz, Z. D., Müller, C. L., Miraldi, E. R., Littman, D. R., Blaser, M. J., & Bonneau, R. A. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004226 · Cited by 1,799
The Protein-Folding Problem, 50 Years On
Dill, K. A., & MacCallum, J. L. (2012) · Science · doi:10.1126/science.1219021 · Cited by 1,699
Accurate De Novo Prediction of Protein Contact Map by Ultra-Deep Learning Model
Wang, S., Sun, S., Li, Z., Zhang, R., & Xu, J. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005324 · Cited by 931
Advances in protein structure prediction and design
Kuhlman, B., & Bradley, P. (2019) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-019-0163-x · Cited by 806
Mutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775
Language models enable zero-shot prediction of the effects of mutations on protein function
Meier, J., Rao, R., Verkuil, R., Liu, J., Sercu, T., & Rives, A. (2021) · doi:10.1101/2021.07.09.450648 · Cited by 635
Protein structure prediction from sequence variation
Marks, D. S., Hopf, T. A., & Sander, C. (2012) · Nature Biotechnology · doi:10.1038/nbt.2419 · Cited by 622
Improved contact prediction in proteins: using pseudolikelihoods to infer Potts models
Ekeberg, M., Lövkvist, C., Lan, Y., Weigt, M., & Aurell, E. (2013) · Physical Review E · doi:10.1103/physreve.87.012707 · Cited by 661
Ovchinnikov, S., Kamisetty, H., & Baker, D. (2014) · eLife · doi:10.7554/elife.02030 · Cited by 629
Emerging methods in protein co-evolution
de Juan, D., Pazos, F., & Valencia, A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3414 · Cited by 607
Protein structure determination using metagenome sequence data
Ovchinnikov, S., Park, H., Varghese, N., Huang, P.-S., Pavlopoulos, G. A., Kim, D. E., Kamisetty, H., Kyrpides, N. C., & Baker, D. (2017) · Science · doi:10.1126/science.aah4043 · Cited by 520
Sequence co-evolution gives 3D contacts and structures of protein complexes
Hopf, T. A., Schärfe, C. P. I., Rodrigues, J. P. G. L. M., Green, A. G., Kohlbacher, O., Sander, C., Bonvin, A. M. J. J., & Marks, D. S. (2014) · eLife · doi:10.7554/elife.03430 · Cited by 515
Distance-based protein folding powered by deep learning
Xu, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1821309116 · Cited by 401
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280
High-resolution de novo structure prediction from primary sequence
Wu, R., Ding, F., Wang, R., Shen, R., Zhang, X., Luo, S., Su, C., Wu, Z., Xie, Q., Berger, B., et al. (2022) · doi:10.1101/2022.07.21.500999 · Cited by 392
Drug–target affinity prediction using graph neural network and contact maps
Jiang, M., Li, Z., Zhang, S., Wang, S., Wang, X., Yuan, Q., & Wei, Z. (2020) · RSC Advances · doi:10.1039/d0ra02297g · Cited by 372
Rao, R., Liu, J., Verkuil, R., Meier, J., Canny, J. F., Abbeel, P., Sercu, T., & Rives, A. (2021) · doi:10.1101/2021.02.12.430858 · Cited by 350
Transformer protein language models are unsupervised structure learners
Rao, R., Meier, J., Sercu, T., Ovchinnikov, S., & Rives, A. (2020) · doi:10.1101/2020.12.15.422761 · Cited by 341
State-of-the-Art Estimation of Protein Model Accuracy Using AlphaFold
Roney, J. P., & Ovchinnikov, S. (2022) · Physical Review Letters · doi:10.1103/physrevlett.129.238101 · Cited by 281
Deep Learning in Protein Structural Modeling and Design
Gao, W., Mahajan, S. P., Sulam, J., & Gray, J. J. (2020) · Patterns · doi:10.1016/j.patter.2020.100142 · Cited by 227
Large-scale determination of previously unsolved protein structures using evolutionary information
Ovchinnikov, S., Kinch, L., Park, H., Liao, Y., Pei, J., Kim, D. E., Kamisetty, H., Grishin, N. V., & Baker, D. (2015) · eLife · doi:10.7554/elife.09248 · Cited by 222
Origins of coevolution between residues distant in protein 3D structures
Anishchenko, I., Ovchinnikov, S., Kamisetty, H., & Baker, D. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1702664114 · Cited by 185
Greener, J. G., Kandathil, S. M., & Jones, D. T. (2019) · Nature Communications · doi:10.1038/s41467-019-11994-0 · Cited by 178
Self-citationAssessment of contact predictions in CASP12: Co‐evolution and deep learning coming of age
Schaarschmidt, J., Monastyrskyy, B., Kryshtafovych, A., & Bonvin, A. M. J. J. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25407 · Cited by 177
Li, Y., Hu, J., Zhang, C., Yu, D.-J., & Zhang, Y. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz291 · Cited by 158
Protein language model embeddings for fast, accurate, alignment-free protein structure prediction
Weissenow, K., Heinzinger, M., & Rost, B. (2021) · doi:10.1101/2021.07.31.454572 · Cited by 139
Deep learning techniques have significantly impacted protein structure prediction and protein design
Pearce, R., & Zhang, Y. (2021) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2021.01.007 · Cited by 127
Deep learning in biomedical data science
Baldi, P. (2018) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-080917-013343 · Cited by 119
Enhancing Evolutionary Couplings with Deep Convolutional Neural Networks
Liu, Y., Palmedo, P., Ye, Q., Berger, B., & Peng, J. (2018) · Cell Systems · doi:10.1016/j.cels.2017.11.014 · Cited by 114
Li, Y., Zhang, C., Bell, E. W., Yu, D., & Zhang, Y. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25798 · Cited by 94
rawMSA: End-to-end Deep Learning using raw Multiple Sequence Alignments
Mirabello, C., & Wallner, B. (2019) · PLOS ONE · doi:10.1371/journal.pone.0220182 · Cited by 105
AlphaFold and the amyloid landscape
Pinheiro, F., Santos, J., & Ventura, S. (2021) · Journal of Molecular Biology · doi:10.1016/j.jmb.2021.167059 · Cited by 88
Inter-residue, inter-protein and inter-family coevolution: bridging the scales
Szurmant, H., & Weigt, M. (2018) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2017.10.014 · Cited by 81
Novel machine learning approaches revolutionize protein knowledge
Bordin, N., Dallago, C., Heinzinger, M., Kim, S., Littmann, M., Rauer, C., Steinegger, M., Rost, B., & Orengo, C. (2023) · Trends in Biochemical Sciences · doi:10.1016/j.tibs.2022.11.001 · Cited by 72
DESTINI: A deep-learning approach to contact-driven protein structure prediction
Gao, M., Zhou, H., & Skolnick, J. (2019) · Scientific Reports · doi:10.1038/s41598-019-40314-1 · Cited by 61
End-to-end learning of multiple sequence alignments with differentiable Smith–Waterman
Petti, S., Bhattacharya, N., Rao, R., Dauparas, J., Thomas, N., Zhou, J., Rush, A. M., Koo, P., & Ovchinnikov, S. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btac724 · Cited by 54
Roy, R. S., Quadir, F., Soltanikazemi, E., & Cheng, J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac063 · Cited by 45
Chen, C., Wu, T., Guo, Z., & Cheng, J. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26052 · Cited by 44
Protein sequence‐to‐structure learning: Is this the end(‐to‐end revolution)?
Laine, E., Eismann, S., Elofsson, A., & Grudinin, S. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26235 · Cited by 44
Molecular replacement: tricks and treats
Abergel, C. (2013) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s0907444913015291 · Cited by 36
Deep learning methods for 3D structural proteome and interactome modeling
Lee, D., Xiong, D., Wierbowski, S., Li, L., Liang, S., & Yu, H. (2022) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2022.102329 · Cited by 26
Can Protein Structure Prediction Methods Capture Alternative Conformations of Membrane Transporters?
Xie, T., & Huang, J. (2024) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01936 · Cited by 23
The role of local versus nonlocal physicochemical restraints in determining protein native structure
Skolnick, J., & Gao, M. (2021) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2020.10.008 · Cited by 21
Wang, L., Zhang, J., Wang, D., & Song, C. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009972 · Cited by 18
Deep learning reveals many more inter-protein residue-residue contacts than direct coupling analysis
Zhou, T.-M., Wang, S., & Xu, J. (2017) · doi:10.1101/240754 · Cited by 25
DisCovER : distance‐ and orientation‐based covariational threading for weakly homologous proteins
Bhattacharya, S., Roche, R., Moussad, B., & Bhattacharya, D. (2022) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26254 · Cited by 15
Kulikova, A. V., Diaz, D. J., Chen, T., Cole, T. J., Ellington, A. D., & Wilke, C. O. (2023) · Scientific Reports · doi:10.1038/s41598-023-40247-w · Cited by 15
Metadata
- Authors
- Jones, D. T., Buchan, D. W. A., Cozzetto, D., & Pontil, M.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-11-17
- Volume
- 28
- Issue
- 2
- Pages
- 184-190
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2166701319
- Cited by
- 770
- References
- 2
- FWCI
- 12.58
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.