CoChat
Sign Up
PreprintCited by 686Advanced Electron Microscopy Techniques and ApplicationsProtein Structure and DynamicsEnzyme Structure and Function

The DOI matches its Crossref record; 67 of the 72 references it cites were found in a registry or an index.

Automated model building and protein identification in cryo-EM maps

Open access
Jamali, Kiarash, Käll, Lukas, Zhang, Rui, Brown, Alan, Kimanius, Dari, Scheres, Sjors H.W.·2023·Nature
DOI 10.1101/2023.05.16.541002PMC PMC11006616

Preprint — published as 10.1038/s41586-024-07215-4 · Paper page

Open this paper in CoChat — free accountOpen PDF

Abstract

Interpreting electron cryo-microscopy (cryo-EM) maps with atomic models requires high levels of expertise and labour-intensive manual intervention. We present ModelAngelo, a machine-learning approach for automated atomic model building in cryo-EM maps. By combining information from the cryo-EM map with information from protein sequence and structure in a single graph neural network, ModelAngelo builds atomic models for proteins that are of similar quality as those generated by human experts. For nucleotides, ModelAngelo builds backbones with similar accuracy as humans. By using its predicted amino acid probabilities for each residue in hidden Markov model sequence searches, ModelAngelo outperforms human experts in the identification of proteins with unknown sequences. ModelAngelo will thus remove bottlenecks and increase objectivity in cryo-EM structure determination.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1101/2023.05.16.541002

Cites

67 of 67 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Atomic modelling in ModelAngelo. a, ModelAngelo builds atomic models in three steps: (1) a CNN predicts protein and nucleic acid residue positions; (2) a GNN optimizes these positions and orientations (shown in b); (3) post-processing of the optimized graph leads to a complete atomic model. b, The GNN, which is arranged in eight layers with three modules, uses a feature vector per residue that is passed through MLP and integrated with additional data through attention mechanisms that have query (Q), key (K) and value (V) vectors. The cryo-EM module also produces a feature vector (C) used for residue prediction. The IPA module uses query points (Qpoints) and their distances to the neighbouring residues (Dq) for attention. Stable gradient propagation is ensured by residual connections with layer norms (Add LN)51. Residue feature vectors are used to update residue positions and orientations. They are also used to predict torsion angles, confidence scores and residue identities at the end of each layer.
Fig. 1 Atomic modelling in ModelAngelo. a, ModelAngelo builds atomic models in three steps: (1) a CNN predicts protein and nucleic acid residue positions; (2) a GNN optimizes these positions and orientations (shown in b); (3) post-processing of the optimized graph leads to a complete atomic model. b, The GNN, which is arranged in eight layers with three modules, uses a feature vector per residue that is passed through MLP and integrated with additional data through attention mechanisms that have query (Q), key (K) and value (V) vectors. The cryo-EM module also produces a feature vector (C) used for residue prediction. The IPA module uses query points (Qpoints) and their distances to the neighbouring residues (Dq) for attention. Stable gradient propagation is ensured by residual connections with layer norms (Add LN)51. Residue feature vectors are used to update residue positions and orientations. They are also used to predict torsion angles, confidence scores and residue identities at the end of each layer.CC BY · PubMed Central
Fig. 2 Performance of ModelAngelo for proteins. a, The backbone r.m.s.d. and model completeness plotted as a function of the target model Q-scores. b, Histograms of the Q-scores of residues in the deposited models, comparing those built by ModelAngelo with those not built. c, Q-score comparison between ModelAngelo-predicted models and the deposited models. d, Model-to-map Fourier shell correlation (FSC), as calculated by Servalcat37 after refining both models and using only residues present in both ModelAngelo and deposited models. e, Model completeness for various automated model-building software for different local-resolution ranges in the maps. f, Model completeness for ModelAngelo and versions of ModelAngelo in which its sequence and/or IPA modules were ablated. For a–d, the data relate to the test set of 177 structures; for e and f, the data relate to the subset of 27 structures.
Fig. 2 Performance of ModelAngelo for proteins. a, The backbone r.m.s.d. and model completeness plotted as a function of the target model Q-scores. b, Histograms of the Q-scores of residues in the deposited models, comparing those built by ModelAngelo with those not built. c, Q-score comparison between ModelAngelo-predicted models and the deposited models. d, Model-to-map Fourier shell correlation (FSC), as calculated by Servalcat37 after refining both models and using only residues present in both ModelAngelo and deposited models. e, Model completeness for various automated model-building software for different local-resolution ranges in the maps. f, Model completeness for ModelAngelo and versions of ModelAngelo in which its sequence and/or IPA modules were ablated. For a–d, the data relate to the test set of 177 structures; for e and f, the data relate to the subset of 27 structures.CC BY · PubMed Central
Fig. 3 Performance of ModelAngelo for nucleic acids. a, Escherichia coli ribosome built by ModelAngelo (with ribosomal RNA in green and proteins in blue) compared with the deposited model (PDB: 7S1G, black outline)52. b, Magnified view with nucleotide bases showing high accuracy compared with the deposited model (orange). c, ModelAngelo model of the V-K CAST transpososome from S. hofmanni compared with the deposited model (PDB: 8EA4)42. Sections that were not built by ModelAngelo (black outline) are in regions of low Q-score (as shown in g). d, Magnified view comparing the nucleotide bases of both models, showing a sequence that was incorrectly identified by ModelAngelo. e, Backbone r.m.s.d., backbone completeness and sequence completeness were plotted against the deposited Q-score for six ribosome structures. f,g, Deposited models for the structures in a and c, respectively, coloured by Q-score, with low-Q-score regions indicated by boxes.
Fig. 3 Performance of ModelAngelo for nucleic acids. a, Escherichia coli ribosome built by ModelAngelo (with ribosomal RNA in green and proteins in blue) compared with the deposited model (PDB: 7S1G, black outline)52. b, Magnified view with nucleotide bases showing high accuracy compared with the deposited model (orange). c, ModelAngelo model of the V-K CAST transpososome from S. hofmanni compared with the deposited model (PDB: 8EA4)42. Sections that were not built by ModelAngelo (black outline) are in regions of low Q-score (as shown in g). d, Magnified view comparing the nucleotide bases of both models, showing a sequence that was incorrectly identified by ModelAngelo. e, Backbone r.m.s.d., backbone completeness and sequence completeness were plotted against the deposited Q-score for six ribosome structures. f,g, Deposited models for the structures in a and c, respectively, coloured by Q-score, with low-Q-score regions indicated by boxes.CC BY · PubMed Central
Fig. 4 Examples of protein identification using ModelAngelo. a, The ModelAngelo model of the single-PBS–PSII–PSI–LHC supercomplex (grey) showing the positions, models and map densities of six newly identified proteins (green). Backbone traces in the deposited model (PDB: 7Y5E) are shown in orange. b, Atomic model of the central apparatus microtubule C1 showing the positions, models and map densities of two identified proteins—FAP92 and FAP374. The orange cartoons represent poly(UNK) chains deposited in the original model (PDB: 7SQC). c, An atomic model of radial spokes 1 and 2 (RS1 and RS2) bound to a doublet microtubule (grey) showing the positions, models and map densities of four proteins (RSP24–27, green) identified by ModelAngelo. Only RSP27 had a backbone trace in the deposited model (orange). C, C terminus; N, N terminus.
Fig. 4 Examples of protein identification using ModelAngelo. a, The ModelAngelo model of the single-PBS–PSII–PSI–LHC supercomplex (grey) showing the positions, models and map densities of six newly identified proteins (green). Backbone traces in the deposited model (PDB: 7Y5E) are shown in orange. b, Atomic model of the central apparatus microtubule C1 showing the positions, models and map densities of two identified proteins—FAP92 and FAP374. The orange cartoons represent poly(UNK) chains deposited in the original model (PDB: 7SQC). c, An atomic model of radial spokes 1 and 2 (RS1 and RS2) bound to a doublet microtubule (grey) showing the positions, models and map densities of four proteins (RSP24–27, green) identified by ModelAngelo. Only RSP27 had a backbone trace in the deposited model (orange). C, C terminus; N, N terminus.CC BY · PubMed Central
Extended Data Fig. 1 Identified proteins in the phycobilisome. Atomic models built by ModelAngelo (green) for the six proteins that were identified by ModelAngelo. Side chain densities in the cryo-EM map (transparent grey) are in agreement with those of the atomic models.
Extended Data Fig. 1 Identified proteins in the phycobilisome. Atomic models built by ModelAngelo (green) for the six proteins that were identified by ModelAngelo. Side chain densities in the cryo-EM map (transparent grey) are in agreement with those of the atomic models.CC BY · PubMed Central
Extended Data Fig. 2 Models by ModelAngelo and AlphaFold for identified proteins in the phycobilisome. Models built by ModelAngelo (green) are shown next to predictions of the corresponding sequences by AlphaFold (coloured by AlphaFold’s confidence from high in blue, to low in red).
Extended Data Fig. 2 Models by ModelAngelo and AlphaFold for identified proteins in the phycobilisome. Models built by ModelAngelo (green) are shown next to predictions of the corresponding sequences by AlphaFold (coloured by AlphaFold’s confidence from high in blue, to low in red).CC BY · PubMed Central
Extended Data Fig. 3 Performance around cofactors in the phycobilisome. a, Cartoon representation of protein backbones (orange) and stick representation of a phycocyanobilin co-factor (pink) in the cryo-EM density (transparent grey) for the deposited phycobilisome structure. b, as in panel a, but for the model built by ModelAngelo (green). ModelAngelo leaves the cofactor density empty. c, d, as in panels a, b but for a phycoerythrobilin cofactor.
Extended Data Fig. 3 Performance around cofactors in the phycobilisome. a, Cartoon representation of protein backbones (orange) and stick representation of a phycocyanobilin co-factor (pink) in the cryo-EM density (transparent grey) for the deposited phycobilisome structure. b, as in panel a, but for the model built by ModelAngelo (green). ModelAngelo leaves the cofactor density empty. c, d, as in panels a, b but for a phycoerythrobilin cofactor.CC BY · PubMed Central
Extended Data Fig. 4 Models by ModelAngelo and AlphaFold for identified proteins in the ciliary axoneme. Models built by ModelAngelo (green) are shown next to predictions of the corresponding sequences by AlphaFold (coloured by AlphaFold’s confidence from high in blue, to low in red). These are split between a, the radial spoke proteins, and b, the central apparatus microtubule proteins.
Extended Data Fig. 4 Models by ModelAngelo and AlphaFold for identified proteins in the ciliary axoneme. Models built by ModelAngelo (green) are shown next to predictions of the corresponding sequences by AlphaFold (coloured by AlphaFold’s confidence from high in blue, to low in red). These are split between a, the radial spoke proteins, and b, the central apparatus microtubule proteins.CC BY · PubMed Central
Extended Data Fig. 5 Identified proteins in the ciliary axoneme. Atomic models built by ModelAngelo (green) for the six proteins that were identified by ModelAngelo. Side chain densities in the cryo-EM map (transparent grey) are in agreement with those of the atomic models. These are split between a, the radial spoke proteins, and b, the central apparatus microtubule proteins.
Extended Data Fig. 5 Identified proteins in the ciliary axoneme. Atomic models built by ModelAngelo (green) for the six proteins that were identified by ModelAngelo. Side chain densities in the cryo-EM map (transparent grey) are in agreement with those of the atomic models. These are split between a, the radial spoke proteins, and b, the central apparatus microtubule proteins.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 72 references

Research works printed but not linked: 3

  1. 14. Lin, Z., et al. Language models of protein sequences at the scale of evolution enable accurate structure prediction. bioRxiv (2022). URL https://www.biorxiv.org/content/early/2022/07/21/2022.07.20.500902. https://www.biorxiv.org/content/early/2022/07/21/2022.07.20.500902.full.pdf.
  2. Jamali, K. , Kimanius, D. & Scheres, S. H . A graph neural network approach to automated model building in cryo-EM maps. In The Eleventh International Conference on Learning Representations (2023). URL https://openreview.net/forum?id=65XDF_nwI61.
  3. 2019, Macromolecular structure determination using x-rays, neutrons and electrons: recent developments in phenix, Acta Crystallographica Section D: Structural Biology, 75, 861, 10.1107/S2059798319011471 · DOI · Paper page

Cited by

Sorted by citations

See all 686

Related

Metadata

Authors
Jamali, K., Käll, L., Zhang, R., Brown, A., Kimanius, D., & Scheres, S. H. W.
Affiliations
  • MRC Laboratory of Molecular Biology (GB)
  • Science for Life Laboratory (SE)
  • Washington University in St. Louis (US)
  • Harvard University (US)
Corresponding author
  • Jamali, Kiarash
  • Kimanius, Dari
  • Scheres, Sjors H.W.
ORCID
Venue
Nature
Publisher
openRxiv
Published
2023-05-16
Volume
628
Issue
8007
Pages
450-457
ISSN
0028-0836 (ISSN-L)
DOI
10.1101/2023.05.16.541002
PMC
PMC11006616
OpenAlex
W4392155415
Cited by
686
References
72
Citations by year
2026: 259 · 2025: 264 · 2024: 134 · 2023: 28
FWCI
120.08
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Nature (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Apollo (University of Cambridge) (acceptedVersion, cc-by)
  • PubMed Central (submittedVersion, cc-by)
  • Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Zenodo (CERN European Organization for Nuclear Research) (submittedVersion, cc-by)
Funders
  • European Commission (HORIZON2020, 895412)
  • Knut och Alice Wallenbergs Stiftelse (2022.0032)
  • National Institutes of Health
  • Medical Research Council (MC_UP_A025_1013)
  • National Institute of General Medical Sciences (R01GM138854, R01GM141109)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Advanced Electron Microscopy Techniques and Applications
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Structural Biology › Enzyme Structure and Function
Keywords
cryo-EM density maps, protein identification, graph neural networks, protein structure determination, machine learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review