PreprintCited by 335Protein Structure and DynamicsMachine Learning in BioinformaticsEnzyme Structure and Function

Benchmarking AlphaFold for protein complex modeling reveals accuracy determinants

Open access
Yin, Rui, Feng, Brandon Y., Varshney, Amitabh, Pierce, Brian G.·2021·Protein Science

Preprint — published as 10.1002/pro.4379 · Paper page

Abstract

High resolution experimental structural determination of protein-protein interactions has led to valuable mechanistic insights, yet due to the massive number of interactions and experimental limitations there is a need for computational methods that can accurately model their structures. Here we explore the use of the recently developed deep learning method, AlphaFold, to predict structures of protein complexes from sequence. With a benchmark of 152 diverse heterodimeric protein complexes, multiple implementations and parameters of AlphaFold were tested for accuracy. Remarkably, many cases had highly accurate models generated as top-ranked predictions, greatly surpassing the performance of unbound protein-protein docking, whereas antibody-antigen docking was largely unsuccessful. While AlphaFold-generated accuracy predictions were able to discriminate near-native models, previously developed scoring protocols improved performance. Our study demonstrates that end-to-end deep learning can accurately model transient protein complexes, and identifies areas for improvement to guide future developments to reliably model any protein-protein interaction of interest.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2021.10.23.465575

Cites

80 of 80 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Yin, R., Feng, B. Y., Varshney, A., & Pierce, B. G.
Affiliations
  • Institute for Bioscience and Biotechnology Research (US)
  • University of Maryland, College Park (US)
  • University of Maryland, Baltimore (US)
Corresponding author
Pierce, Brian G.
Venue
Protein Science
Publisher
openRxiv
Published
2021-10-24
Volume
31
Issue
8
Pages
e4379-e4379
ISSN
0961-8368 (ISSN-L)
OpenAlex
W4285392187
Cited by
335
References
80
Citations by year
2026: 47 · 2025: 67 · 2024: 111 · 2023: 90 · 2022: 19 · 2013: 1
FWCI
23.42
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Protein Science (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nd)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • University Libraries (University of Maryland) (submittedVersion)
  • Digital Repository at the University of Maryland (University of Maryland College Park)
Funders
  • National Institutes of Health (NIH-R01)
  • National Institute of General Medical Sciences (R01GM126299, R35GM144083)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
  • Physical Sciences › Materials Science › Materials Chemistry › Enzyme Structure and Function
Keywords
AlphaFold, AlphaFold-Multimer, protein complex structure prediction, protein-protein interaction, immune complexes, protein-protein docking, benchmarking, multiple sequence alignment, deep learning
MeSH terms
Algorithms, Protein Binding, Protein Conformation, Proteins, Sequence Alignment, Molecular Docking Simulation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review