The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Critical assessment of methods of protein structure prediction (CASP)—Round XII
Open accessAbstract
This article reports the outcome of the 12th round of Critical Assessment of Structure Prediction (CASP12), held in 2016. CASP is a community experiment to determine the state of the art in modeling protein structure from amino acid sequence. Participants are provided sequence information and in turn provide protein structure models and related information. Analysis of the submitted structures by independent assessors provides a comprehensive picture of the capabilities of current methods, and allows progress to be identified. This was again an exciting round of CASP, with significant advances in 4 areas: (i) The use of new methods for predicting three‐dimensional contacts led to a two‐fold improvement in contact accuracy. (ii) As a consequence, model accuracy for proteins where no template was available improved dramatically. (iii) Models based on a structural template showed overall improvement in accuracy. (iv) Methods for estimating the accuracy of a model continued to improve. CASP continued to develop new areas: (i) Assessing methods for building quaternary structure models, including an expansion of the collaboration between CASP and CAPRI. (ii) Modeling with the aid of experimental data was extended to include SAXS data, as well as again using chemical cross‐linking information. (iii) A team of assessors evaluated the suitability of models for a range of applications, including mutation interpretation, analysis of ligand binding properties, and identification of interfaces. This article describes the experiment and summarizes the results. The rest of this special issue of PROTEINS contains papers describing CASP12 results and assessments in more detail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Global landscape of protein complexes in the yeast Saccharomyces cerevisiae
Krogan, N. J., Cagney, G., Yu, H., Zhong, G., Guo, X., Ignatchenko, A., Li, J., Pu, S., Datta, N., Tikuisis, A. P., et al. (2006) · Nature · doi:10.1038/nature04670 · Cited by 2,952
HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment
Remmert, M., Biegert, A., Hauser, A., & Söding, J. (2012) · Nature Methods · doi:10.1038/nmeth.1818 · Cited by 2,288
The MIntAct project—IntAct as a common curation platform for 11 molecular interaction databases
Orchard, S., Ammari, M., Aranda, B., Breuza, L., Briganti, L., Broackes-Carter, F., Campbell, N. H., Chavali, G., Chen, C., del-Toro, N., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1115 · Cited by 1,831
The SWISS-MODEL Repository—new features and functionality
Bienert, S., Waterhouse, A., de Beer, T. A. P., Tauriello, G., Studer, G., Bordoli, L., & Schwede, T. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw1132 · Cited by 1,745
Self-citationProtein Structure Prediction and Structural Genomics
Baker, D., & Sali, A. (2001) · Science · doi:10.1126/science.1065659 · Cited by 1,587
The SWISS-MODEL Repository: new features and functionalities
Kopp, J. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj056 · Cited by 1,006
Emerging methods in protein co-evolution
de Juan, D., Pazos, F., & Valencia, A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3414 · Cited by 607
Fast and accurate automatic structure prediction with HHpred
Hildebrand, A., Remmert, M., Biegert, A., & Söding, J. (2009) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.22499 · Cited by 469
Ab Initio Protein Structure Prediction: Progress and Prospects
Bonneau, R., & Baker, D. (2001) · Annual Review of Biophysics and Biomolecular Structure · doi:10.1146/annurev.biophys.30.1.173 · Cited by 318
Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A. (2016) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25064 · Cited by 232
Self-citation
Cited by
Rives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2016239118 · Cited by 3,286
ProteinBERT: a universal deep-learning model of protein sequence and function
Brandes, N., Ofer, D., Peleg, Y., Rappoport, N., & Linial, M. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac020 · Cited by 1,009
QMEANDisCo—distance constraints applied on model quality estimation
Studer, G., Rempfer, C., Waterhouse, A. M., Gumienny, R., Haas, J., & Schwede, T. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz828 · Cited by 1,032
Self-citationEvaluating Protein Transfer Learning with TAPE
Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · doi:10.1101/676825 · Cited by 719
A Review on Applications of Computational Methods in Drug Screening and Design
Lin, X., Li, X., & Lin, X. (2020) · Molecules · doi:10.3390/molecules25061375 · Cited by 718
The trRosetta server for fast and accurate protein structure prediction
Du, Z., Su, H., Wang, W., Ye, L., Wei, H., Peng, Z., Anishchenko, I., Baker, D., & Yang, J. (2021) · Nature Protocols · doi:10.1038/s41596-021-00628-9 · Cited by 715
Critical assessment of methods of protein structure prediction (CASP)—Round XIII
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J. (2019) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25823 · Cited by 506
Self-citationRives, A., Meier, J., Sercu, T., Goyal, S., Lin, Z., Liu, J., Guo, D., Ott, M., Zitnick, C. L., Ma, J., et al. (2019) · doi:10.1101/622803 · Cited by 3,280
“The Test (59) and CASP11 (60) test sets evaluate with sequence identity holdout at 25%, the CASP12 (61) test set implements a temporal holdout with the structural training data, and the CASP13 (58) experiment implements a full temporal holdout of both the pretraining and training data.”
End-to-End Differentiable Learning of Protein Structure
AlQuraishi, M. (2019) · Cell Systems · doi:10.1016/j.cels.2019.03.006 · Cited by 371
BERTology Meets Biology: Interpreting Attention in Protein Language Models
Vig, J., Madani, A., Varshney, L. R., Xiong, C., Socher, R., & Rajani, N. F. (2020) · doi:10.1101/2020.06.26.174417 · Cited by 338
Large-Scale Assessment of Binding Free Energy Calculations in Active Drug Discovery Projects
Schindler, C. E. M., Baumann, H., Blum, A., Böse, D., Buchstaller, H.-P., Burgdorf, L., Cappel, D., Chekler, E., Czodrowski, P., Dorsch, D., et al. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00900 · Cited by 303
Deep Learning in Protein Structural Modeling and Design
Gao, W., Mahajan, S. P., Sulam, J., & Gray, J. J. (2020) · Patterns · doi:10.1016/j.patter.2020.100142 · Cited by 227
Haas, J., Barbato, A., Behringer, D., Studer, G., Roth, S., Bertoni, M., Mostaguir, K., Gumienny, R., & Schwede, T. (2018) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25431 · Cited by 168
Self-citationAdvances in coarse-grained modeling of macromolecular complexes
Pak, A. J., & Voth, G. A. (2018) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2018.11.005 · Cited by 145
Protein language model embeddings for fast, accurate, alignment-free protein structure prediction
Weissenow, K., Heinzinger, M., & Rost, B. (2021) · doi:10.1101/2021.07.31.454572 · Cited by 139
(2022) · doi:10.1016/j.str.2022.05.001 · Cited by 139
Amino acid encoding methods for protein sequences: a comprehensive review and assessment
Jing, X., Dong, Q., Hong, D., & Lu, R. (2020) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2019.2911677 · Cited by 97
AlphaFold and the amyloid landscape
Pinheiro, F., Santos, J., & Ventura, S. (2021) · Journal of Molecular Biology · doi:10.1016/j.jmb.2021.167059 · Cited by 88
Current structure predictors are not learning the physics of protein folding
Outeiral, C., Nissley, D. A., & Deane, C. M. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab881 · Cited by 82
Kagaya, Y., Zhang, Z., Ibtehaz, N., Wang, X., Nakamura, T., Punuru, P. D., & Kihara, D. (2025) · Nature Communications · doi:10.1038/s41467-025-56261-7 · Cited by 70
Deep embedding and alignment of protein sequences
Llinares-López, F., Berthet, Q., Blondel, M., Teboul, O., & Vert, J.-P. (2023) · Nature Methods · doi:10.1038/s41592-022-01700-2 · Cited by 58
DeepUMQA: Ultrafast Shape Recognition-based Protein Model Quality Assessment using Deep Learning
Guo, S.-S., Liu, J., Zhou, X.-G., & Zhang, G.-J. (2021) · doi:10.1101/2021.10.02.462491 · Cited by 53
DeepUMQA: ultrafast shape recognition-based protein model quality assessment using deep learning
Guo, S.-S., Liu, J., Zhou, X.-G., & Zhang, G.-J. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac056 · Cited by 53
Feature Reuse and Scaling: Understanding Transfer Learning with Protein Language Models
Li, F.-Z., Amini, A. P., Yue, Y., Yang, K. K., & Lu, A. X. (2024) · doi:10.1101/2024.02.05.578959 · Cited by 51
Nithin, C., Ghosh, P., & Bujnicki, J. M. (2018) · Genes · doi:10.3390/genes9090432 · Cited by 48
Computational models in the service of X‐ray and cryo‐ electron microscopy structure determination
Kryshtafovych, A., Moult, J., Albrecht, R., Chang, G. A., Chao, K., Fraser, A., Greenfield, J., Hartmann, M. D., Herzberg, O., Josts, I., et al. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26223 · Cited by 45
Self-citationOn the possible origin of protein homochirality, structure, and biochemical function
Skolnick, J., Zhou, H., & Gao, M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1908241116 · Cited by 45
Geffen, Y., Ofran, Y., & Unger, R. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac474 · Cited by 40
CASP13 target classification into tertiary structure prediction categories
Kinch, L. N., Kryshtafovych, A., Monastyrskyy, B., & Grishin, N. V. (2019) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.25775 · Cited by 36
Self-citationImproving protein tertiary structure prediction by deep learning and distance prediction in CASP14
Liu, J., Wu, T., Guo, Z., Hou, J., & Cheng, J. (2022) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26186 · Cited by 32
Liu, J., Zhao, K., & Zhang, G. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbac507 · Cited by 25
Zhang, C., Lane, L., Omenn, G. S., & Zhang, Y. (2019) · Journal of Proteome Research · doi:10.1021/acs.jproteome.9b00537 · Cited by 22
Essential guidelines for computational method benchmarking
Weber, L. M., Saelens, W., Cannoodt, R., Soneson, C., Hapfelmeier, A., Gardner, P. P., Boulesteix, A.-L., Saeys, Y., & Robinson, M. D. (2019) · Genome Biology · doi:10.1186/s13059-019-1738-8 · Cited by 21
Alignment-based Protein Mutational Landscape Prediction: Doing More with Less
Abakarova, M., Marquet, C., Rera, M., Rost, B., & Laine, E. (2023) · Genome Biology and Evolution · doi:10.1093/gbe/evad201 · Cited by 14
MULAN: multimodal protein language model for sequence and structure encoding
Frolova, D., Pak, M., Litvin, A., Sharov, I., Ivankov, D., & Oseledets, I. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf117 · Cited by 12
BIAS: Transparent reporting of biomedical image analysis challenges
Maier-Hein, L., Reinke, A., Kozubek, M., Martel, A. L., Arbel, T., Eisenmann, M., Hanbury, A., Jannin, P., Müller, H., Onogur, S., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101796 · Cited by 9
Alignment-based protein mutational landscape prediction: doing more with less
(2022) · doi:10.1101/2022.12.13.520259 · Cited by 4
SPAED: harnessing AlphaFold output for accurate segmentation of phage endolysin domains
Boulay, A., Cremelie, E., Galiez, C., Briers, Y., Rousseau, E., & Vázquez, R. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf531 · Cited by 4
Metadata
- Authors
- Moult, J., Fidelis, K., Kryshtafovych, A., Schwede, T., & Tramontano, A.
- Venue
- Proteins: Structure, Function, and Bioinformatics
- Publisher
- Wiley
- Published
- 2017-12-15
- Volume
- 86
- Issue
- S1
- Pages
- 7-15
- ISSN
- 0887-3585 (ISSN-L)
- 1097-0134
- OpenAlex
- W3198971594
- Cited by
- 326
- References
- 44
- FWCI
- 17.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.