Sparse generative modeling via parameter reduction of Boltzmann machines: Application to protein-sequence families
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Boltzmann machines (BMs) are widely used as generative models. For example, pairwise Potts models (PMs), which are instances of the BM class, provide accurate statistical models of families of evolutionarily related protein sequences. Their parameters are the local fields, which describe site-specific patterns of amino acid conservation, and the two-site couplings, which mirror the coevolution between pairs of sites. This coevolution reflects structural and functional constraints acting on protein sequences during evolution. The most conservative choice to describe the coevolution signal is to include all possible two-site couplings into the PM. This choice, typical of what is known as Direct Coupling Analysis, has been successful for predicting residue contacts in the three-dimensional structure, mutational effects, and generating new functional sequences. However, the resulting PM suffers from important overfitting effects: many couplings are small, noisy, and hardly interpretable; the PM is close to a critical point, meaning that it is highly sensitive to small parameter perturbations. In this work, we introduce a general parameter-reduction procedure for BMs, via a controlled iterative decimation of the less statistically significant couplings, identified by an information-based criterion that selects either weak or statistically unsupported couplings. For several protein families, our procedure allows one to remove more than 90% of the PM couplings, while preserving the predictive and generative properties of the original dense PM, and the resulting model is far away from criticality, hence more robust to noise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Pfam: The protein families database in 2021
Mistry, J., Chuguransky, S., Williams, L., Qureshi, M., Salazar, G. A., Sonnhammer, E. L. L., Tosatto, S. C. E., Paladin, L., Raj, S., Richardson, L. J., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa913 · Cited by 7,452
The Protein-Folding Problem, 50 Years On
Dill, K. A., & MacCallum, J. L. (2012) · Science · doi:10.1126/science.1219021 · Cited by 1,699
Morcos, F., Pagnani, A., Lunt, B., Bertolino, A., Marks, D. S., Sander, C., Zecchina, R., Onuchic, J. N., Hwa, T., & Weigt, M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1111471108 · Cited by 1,434
Self-citationDill, K. A., Ozkan, S. B., Shell, M. S., & Weikl, T. R. (2008) · Annual Review of Biophysics · doi:10.1146/annurev.biophys.37.092707.153558 · Cited by 1,163
Mutation effects predicted from sequence co-variation
Hopf, T. A., Ingraham, J. B., Poelwijk, F. J., Schärfe, C. P. I., Springer, M., Sander, C., & Marks, D. S. (2017) · Nature Biotechnology · doi:10.1038/nbt.3769 · Cited by 775 · cited 1×
“The DCA parameters can be obtained via inference or learning procedures [9–12], and they can be used to extract useful information on molecular structure [13–16] and function [17, 18], on the effects of mutations [19, 20], and to generate new artificially-designed molecules with specific properties [21, 22].”
Are Biological Systems Poised at Criticality?
Mora, T., & Bialek, W. (2011) · Journal of Statistical Physics · doi:10.1007/s10955-011-0229-4 · Cited by 734 · cited 1×
“[31], but results from the over-fitting in the learning procedure.”
BackgroundEmpirical fitness landscapes and the predictability of evolution
de Visser, J. A. G. M., & Krug, J. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3744 · Cited by 715
Improved contact prediction in proteins: using pseudolikelihoods to infer Potts models
Ekeberg, M., Lövkvist, C., Lan, Y., Weigt, M., & Aurell, E. (2013) · Physical Review E · doi:10.1103/physreve.87.012707 · Cited by 661
Self-citationProtein structure prediction from sequence variation
Marks, D. S., Hopf, T. A., & Sander, C. (2012) · Nature Biotechnology · doi:10.1038/nbt.2419 · Cited by 622
Emerging methods in protein co-evolution
de Juan, D., Pazos, F., & Valencia, A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3414 · Cited by 607
Cited by
Direct coupling analysis and the attention mechanism
(2025) · doi:10.1186/s12859-025-06062-y · Cited by 5
(2026) · doi:10.1371/journal.pcbi.1013996 · Cited by 1
Metadata
- Authors
- Barrat-Charlaix, P., Muntoni, A. P., Shimagaki, K., Weigt, M., & Zamponi, F.
- Venue
- Physical Review E
- Publisher
- American Physical Society (APS)
- Published
- 2021-08-06
- Volume
- 104
- Issue
- 2
- Pages
- 024407-024407
- ISSN
- 2470-0045 (ISSN-L)
- 2470-0053
- OpenAlex
- W3129222977
- Cited by
- 22
- References
- 15
- FWCI
- 1.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.