CoChat

Comparative studies of AlphaFold, RoseTTAFold and Modeller: a case study involving the use of G-protein-coupled receptors

Open access
Lee, Chien, Su, Bo-Han, Tseng, Yufeng Jane · 2022 · Briefings in Bioinformatics
Cited by 125

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

Neural network (NN)-based protein modeling methods have improved significantly in recent years. Although the overall accuracy of the two non-homology-based modeling methods, AlphaFold and RoseTTAFold, is outstanding, their performance for specific protein families has remained unexamined. G-protein-coupled receptor (GPCR) proteins are particularly interesting since they are involved in numerous pathways. This work directly compares the performance of these novel deep learning-based protein modeling methods for GPCRs with the most widely used template-based software—Modeller. We collected the experimentally determined structures of 73 GPCRs from the Protein Data Bank. The official AlphaFold repository and RoseTTAFold web service were used with default settings to predict five structures of each protein sequence. The predicted models were then aligned with the experimentally solved structures and evaluated by the root-mean-square deviation (RMSD) metric. If only looking at each program’s top-scored structure, Modeller had the smallest average modeling RMSD of 2.17 Å, which is better than AlphaFold’s 5.53 Å and RoseTTAFold’s 6.28 Å, probably since Modeller already included many known structures as templates. However, the NN-based methods (AlphaFold and RoseTTAFold) outperformed Modeller in 21 and 15 out of the 73 cases with the top-scored model, respectively, where no good templates were available for Modeller. The larger RMSD values generated by the NN-based methods were primarily due to the differences in loop prediction compared to the crystal structures.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/bib/bbac308

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 17

  1. Callaway, 2015, The revolution will not be crystallized: a new method sweeps through structural biology, Nature, 525, 172, 10.1038/525172a · DOI · Paper page
  2. Webb, 2016, Comparative protein structure modeling using MODELLER, Curr Protoc Bioinformatics, 54, 5.6.1-5.6.37, 10.1002/cpbi.3 · DOI · Paper page
  3. Wu, 2021, Deep template-based protein structure prediction, PLoS Comput Biol, 17, e1008954, 10.1371/journal.pcbi.1008954 · DOI · Paper page
  4. Chien, 2010, Structure of the human dopamine D3 receptor in complex with a D2/D3 selective antagonist, Science, 330, 1091, 10.1126/science.1197410 · DOI · Paper page
  5. Doerr, 2010, NMR and the elusive GPCR, Nat Methods, 7, 581, 10.1038/nmeth0810-580b · doi:10.1038/nmeth0810-580b
  6. Yang, 2021, G protein-coupled receptors: structure-and function-based drug discovery, Signal Transduct Target Ther, 6, 1, 10.1038/s41392-020-00435-w · DOI · Paper page
  7. Sokoloff, 2006, The dopamine D3 receptor: a therapeutic target for the treatment of neuropsychiatric disorders, CNS Neurol Disord-Drug Targets (Formerly Currt Drug Targets-CNS Neurol Disord), 5, 25
  8. Maeda, 2020, Structure and selectivity engineering of the M(1) muscarinic receptor toxin complex, Science, 369, 161, 10.1126/science.aax2517 · DOI
  9. Thal, 2016, Crystal structures of the M1 and M4 muscarinic acetylcholine receptors, Nature, 531, 335, 10.1038/nature17188 · DOI · Paper page
  10. Weinert, 2017, Serial millisecond crystallography for routine room-temperature structure determination at synchrotrons, Nat Commun, 8, 1, 10.1038/s41467-017-00630-4 · DOI · Paper page
  11. Lera, 2014, Adenosine A2A receptor as a drug discovery target, J Med Chem, 57, 3623, 10.1021/jm4011669 · DOI · Paper page
  12. Sun, 2017, Crystal structure of the adenosine A2A receptor bound to an antagonist reveals a potential allosteric pocket, Proc Natl Acad Sci, 114, 2066, 10.1073/pnas.1621423114 · DOI
  13. Zhou, 2017, Identification of phosphorylation codes for arrestin recruitment by G protein-coupled receptors, Cell, 170, 457, 10.1016/j.cell.2017.07.002 · DOI · Paper page
  14. Lenahan, 2020, A potential biomarker for neurodegenerative diseases, Front Neurosci, 15, 326, 10.3389/fnins.2020.00326 · DOI
  15. Zemla, 1999, Processing and analysis of CASP3 protein structure predictions, Proteins Struct Funct Bioinform, 37, 22, 10.1002/(SICI)1097-0134(1999)37:3+<22::AID-PROT5>3.0.CO;2-W · DOI · Paper page
  16. Olechnovič, 2019, Comparative analysis of methods for evaluation of protein models against native structures, Bioinformatics, 35, 937, 10.1093/bioinformatics/bty760 · DOI · Paper page
  17. Burley, 2021, Predicting proteome-scale protein structure with artificial intelligence, N Engl J Med, 385, 2191, 10.1056/NEJMcibr2113027 · DOI · Paper page

Cited by

Metadata

Authors
Lee, C., Su, B.-H., & Tseng, Y. J.
Venue
Briefings in Bioinformatics
Published
2022-08-09
Volume
23
Issue
5
ISSN
  • 1467-5463 (ISSN-L)
  • 1477-4054
OpenAlex
W4292458166
Cited by
125
References
11
FWCI
6.97
Type
journal article
Language
en
Open access
hybrid
Funders
  • Taiwan Ministry of Science and Technology (MOST 109-2627-M-002-003-, MOST 110-2320-B-002-038-, MOST 111-2119-M-033-001-)
  • Taiwan Food and Drug Administration (MOHW110-FDA-D-114-000611, MOHW111-FDA-D-114-000611)
  • National Taiwan University (NTU-CC-110L890803, NTU-110L8809, NTU-CC-111L890203, NTU-111L8809)
  • Toxic and Chemical Substances Bureau, Environmental Protection Administration, Executive Yuan (110A022)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.