Cited by 148Protein Structure and DynamicsEnzyme Structure and FunctionMachine Learning in Bioinformatics

Critical assessment of methods of protein structure prediction ( CASP )—Round XV

Open access
Kryshtafovych, Andriy, Schwede, Torsten, Topf, Maya, Fidelis, Krzysztof, Moult, John·2023·Proteins: Structure, Function, and Bioinformatics

Published version of a preprint

Abstract

Computing protein structure from amino acid sequence information has been a long‐standing grand challenge. Critical assessment of structure prediction (CASP) conducts community experiments aimed at advancing solutions to this and related problems. Experiments are conducted every 2 years. The 2020 experiment (CASP14) saw major progress, with the second generation of deep learning methods delivering accuracy comparable with experiment for many single proteins. There is an expectation that these methods will have much wider application in computational structural biology. Here we summarize results from the most recent experiment, CASP15, in 2022, with an emphasis on new deep learning‐driven progress. Other papers in this special issue of proteins provide more detailed analysis. For single protein structures, the AlphaFold2 deep learning method is still superior to other approaches, but there are two points of note. First, although AlphaFold2 was the core of all the most successful methods, there was a wide variety of implementation and combination with other methods. Second, using the standard AlphaFold2 protocol and default parameters only produces the highest quality result for about two thirds of the targets, and more extensive sampling is required for the others. The major advance in this CASP is the enormous increase in the accuracy of computed protein complexes, achieved by the use of deep learning methods, although overall these do not fully match the performance for single proteins. Here too, AlphaFold2 based method perform best, and again more extensive sampling than the defaults is often required. Also of note are the encouraging early results on the use of deep learning to compute ensembles of macromolecular structures. Critically for the usability of computed structures, for both single proteins and protein complexes, deep learning derived estimates of both local and global accuracy are of high quality, however the estimates in interface regions are slightly less reliable. CASP15 also included computation of RNA structures for the first time. Here, the classical approaches produced better agreement with experiment than the new deep learning ones, and accuracy is limited. Also, for the first time, CASP included the computation of protein–ligand complexes, an area of special interest for drug design. Here too, classical methods were still superior to deep learning ones. Many new approaches were discussed at the CASP conference, and it is clear methods will continue to advance.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/prot.26617

Cites

46 of 46 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Lin Z, 2023, Language models of protein sequences at the scale of evolution enable accurate structure prediction, bioRxiv

Cited by

Sorted by citations

Authors
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J.
Affiliations
  • University of California, Davis (US)
  • SIB Swiss Institute of Bioinformatics (CH)
  • Leibniz Institute of Virology (LIV) (DE)
  • Institute for Bioscience and Biotechnology Research (US)
Corresponding author
Moult, John
Venue
Proteins: Structure, Function, and Bioinformatics
Publisher
Wiley
Published
2023-11-02
Volume
91
Issue
12
Pages
1539-1549
ISSN
  • 0887-3585 (ISSN-L)
  • 1097-0134
OpenAlex
W4388302761
Cited by
148
References
40
Citations by year
2026: 45 · 2025: 65 · 2024: 32 · 2023: 4 · 2022: 2
FWCI
12.98
Type
journal article
Language
en
Open access
Locations
  • Proteins Structure Function and Bioinformatics (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • eScholarship (California Digital Library) (submittedVersion, cc-by)
Funders
National Institute of General Medical Sciences (R01GM100482)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Physical Sciences › Materials Science › Materials Chemistry › Enzyme Structure and Function
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
Keywords
protein structure prediction, CASP15, AlphaFold2, deep learning, protein complexes, protein-ligand complex, RNA structure prediction, structure ensemble, accuracy estimation, protein interfaces, drug design
MeSH terms
Amino Acid Sequence, Models, Molecular, Protein Conformation, Proteins, Computational Biology

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review