Efficient sampling of high-dimensional free energy landscapes using adaptive reinforced dynamics
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Enhanced sampling methods such as metadynamics and umbrella sampling have become essential tools for exploring the configuration space of molecules and materials. At the same time, they have long faced a number of issues such as the inefficiency when dealing with a large number of collective variables (CVs) or systems with high free energy barriers. Here we show that, with clustering and adaptive tuning techniques, the reinforced dynamics (RiD) scheme can be used to efficiently explore the configuration space and free energy landscapes with a large number of CVs or systems with high free energy barriers. We illustrate this by studying various representative and challenging examples. First we demonstrate the efficiency of adaptive RiD compared with other methods and construct the nine-dimensional (9D) free energy landscape of a peptoid trimer, which has energy barriers of more than 8 kcal mol−1. We then study the folding of the protein chignolin using 18 CVs. In this case, both the folding and unfolding rates are observed to be 4.30 μs−1. Finally, we propose a protein structure refinement protocol based on RiD. This protocol allows us to efficiently employ more than 100 CVs for exploring the landscape of protein structures and it gives rise to an overall improvement of 14.6 units over the initial global distance test–high accuracy (GDT-HA) score. The authors have developed an adaptive reinforced dynamics approach, which improves the efficiency when exploring the configurational space and free energy landscape of large biomolecules, such as proteins.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Abraham, M. J., Murtola, T., Schulz, R., Páll, S., Smith, J. C., Hess, B., & Lindahl, E. (2015) · SoftwareX · doi:10.1016/j.softx.2015.06.001 · Cited by 27,190
Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling
Torrie, G. M., & Valleau, J. P. (1977) · Journal of Computational Physics · doi:10.1016/0021-9991(77)90121-8 · Cited by 6,091
Laio, A., & Parrinello, M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.202427399 · Cited by 5,626 · cited 7×
“In this Article, we first consider a simple peptoid, s(1)phenyl ethyl (s1pe), obtained from Weiser’s work33.”
BackgroundMethodInfluentialHow fast-folding proteins fold
Lindorff-Larsen, K., Piana, S., Dror, R. O., & Shaw, D. E. (2011) · Science · doi:10.1126/science.1208351 · Cited by 1,980
LGA: a method for finding 3D similarities in protein structures
Zemla, A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg571 · Cited by 1,069 · cited 9×
“In the refinement category of the CASP13 competition, in which the goal is to generate a better predicted structure using the given decoys as starting points, the FEIGLAB, using MD simulations, achieved the best results with an average improvement of GDT-HA scores of about 3.99 units.”
BackgroundInfluentialVariational Approach to Enhanced Sampling and Free Energy Calculations
Valsson, O., & Parrinello, M. (2014) · Physical Review Letters · doi:10.1103/physrevlett.113.090601 · Cited by 336
Abrams, J. B., & Tuckerman, M. E. (2008) · The Journal of Physical Chemistry B · doi:10.1021/jp805039u · Cited by 221 · cited 1×
“The integration in equation (5) or (6) is computed by MCMC.”
MethodAccelerated molecular dynamics simulations of protein folding
Miao, Y., Feixas, F., Eun, C., & McCammon, J. A. (2015) · Journal of Computational Chemistry · doi:10.1002/jcc.23964 · Cited by 202 · cited 1×
“[25] Yinglong Miao, Ferran Feixas, Changsun Eun, and J Andrew McCammon.”
BackgroundExploration, Sampling, And Reconstruction of Free Energy Surfaces with Gaussian Process Regression
Mones, L., Bernstein, N., & Csányi, G. (2016) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.6b00553 · Cited by 91 · cited 1×
“[4] L Mones, N Bernstein, and G Csányi.”
Background
Research works printed but not linked: 51
- Barducci, A., Bussi, G. & Parrinello, M. Well-tempered metadynamics: a smoothly converging and tunable free-energy method. Phys. Rev. Lett. 100, 020603 (2008). · DOI · Paper page
- Rosso, L., Mináry, P., Zhu, Z. & Tuckerman, M. E. On the use of the adiabatic molecular dynamics technique in the calculation of free energy profiles. J. Chem. Phys. 116, 4389–4402 (2002). · DOI · Paper page
- Maragliano, L. & Vanden-Eijnden, E. A temperature accelerated method for sampling free energy and determining reaction pathways in rare events simulations. Chem. Phys. Lett. 426, 168–175 (2006). · DOI · Paper page
- Abrams, C. F. & Vanden-Eijnden, E. Large-scale conformational sampling of proteins using temperature-accelerated molecular dynamics. Proc. Natl Acad. Sci. USA 107, 4961–4966 (2010). · DOI · Paper page
- Maragliano, L. & Vanden-Eijnden, E. Single-sweep methods for free energy calculations. J. Chem. Phys. 128, 184110 (2008). · DOI · Paper page
- Piana, S. & Laio, A. A bias-exchange approach to protein folding. J. Phys. Chem. B 111, 4553–4559 (2007). · DOI · Paper page
- Pfaendtner, J. & Bonomi, M. Efficient sampling of high-dimensional free-energy landscapes with parallel bias metadynamics. J. Chem. Theory Comput. 11, 5062–5067 (2015). · DOI · Paper page
- Arushi, P., Fu, C. D., Massimiliano, B. & Jim, P. Biasing smarter, not harder, by partitioning collective variables into families in parallel bias metadynamics. J. Chem. Theory Comput. 14, 4985–4990 (2018). · DOI
- Schneider, E., Dai, L., Topper, R. Q., Drechsel-Grau, C. & Tuckerman, M. E. Stochastic neural network approach for learning high-dimensional free energy surfaces. Phys. Rev. Lett. 119, 150601 (2017). · DOI · Paper page
- Zhang, L., Wang, H. & E, W. Reinforced dynamics for enhanced sampling in large atomic and molecular systems. J. Chem. Phys. 148, 124113 (2018). · DOI
- Sidky, H. & Whitmer, J. K. Learning free energy landscapes using artificial neural networks. J. Chem. Phys. 148, 104111 (2018). · DOI · Paper page
- Guo, A. Z. et al. Adaptive enhanced sampling by force-biasing using neural networks. J. Chem. Phys. 148, 134108 (2018). · DOI
- Sultan, M. M., Wayment-Steele, H. K. & Pande, V. S. Transferable neural networks for enhanced sampling of protein dynamics. J. Chem. Theory Comput. 14, 1887–1894 (2018). · DOI · Paper page
- Bonati, L., Zhang, Y.-Y. & Parrinello, M. Neural networks-based variationally enhanced sampling. Proc. Natl Acad. Sci. USA 116, 17641–17647 (2019). · DOI · Paper page
- Sevgen, E., Guo, A., Sidky, H., Whitmer, J. K. & de Pablo, J. J. Combined force-frequency sampling for simulation of systems having rugged free energy landscapes. J. Chem. Theory Comput. 16, 1448–1455 (2020). · DOI
- Shaffer, P., Valsson, O. & Parrinello, M. Enhanced, targeted sampling of high-dimensional free-energy landscapes using variationally enhanced sampling, with an application to chignolin. Proc. Natl Acad. Sci. USA 113, 1150–1155 (2016). · DOI
- Cendagorta, J. R., Tolpin, J., Schneider, E., Topper, R. Q. & Tuckerman, M. E. Comparison of the performance of machine learning models in representing high-dimensional free energy surfaces and generating observables. J. Phys. Chem. B 124, 3647–3660 (2020). · DOI
- Sugita, Y. & Okamoto, Y. Replica-exchange molecular dynamics method for protein folding. Chem. Phys. Lett. 314, 141–151 (1999). · DOI · Paper page
- Ducheyne, P. Comprehensive Biomaterials Vol. 1 (Elsevier, 2015). · DOI
- Sun, J. & Zuckermann, R. N. Peptoid polymers: a highly designable bioinspired material. ACS Nano 7, 4715–4732 (2013). · DOI · Paper page
- Mojsoska, B., Zuckermann, R. N. & Jenssen, H. Structure–activity relationship study of novel peptoids that mimic the structure of antimicrobial peptides. Antimicrob. Agents Chemother. 59, 4112–4120 (2015). · DOI
- Li, N. et al. Blockade of CD28 by a synthetical peptoid inhibits T-cell proliferation and attenuates graft-versus-host disease. Cell. Mol. Immunol. 7, 133–142 (2010). · doi:10.1038/cmi.2009.120
- Luo, Y. et al. Aβ42-binding peptoids as amyloid aggregation inhibitors and detection ligands. ACS Chem. Neurosci. 4, 952–962 (2013). · DOI
- Mirijanian, D. T., Mannige, R. V., Zuckermann, R. N. & Whitelam, S. Development and use of an atomistic CHARMM-based forcefield for peptoid simulation. J. Comput. Chem. 35, 360–370 (2014). · DOI
- Mukherjee, S., Zhou, G., Michel, C. & Voelz, V. A. Insights into peptoid helix folding cooperativity from an improved backbone potential. J. Phys. Chem. B 119, 15407–15417 (2015). · DOI
- Weiser, L. J. & Santiso, E. E. Molecular modeling studies of peptoid polymers. AIMS Mater. Sci. 4, 1029–1051 (2017). · DOI
- Weiser, L. J. & Santiso, E. E. A CGenFF-based force field for simulations of peptoids with both cis and trans peptide bonds. J. Comput. Chem. 40, 1946–1956 (2019). · DOI
- Gorske, B. C., Stringer, J. R., Bastian, B. L., Fowler, S. A. & Blackwell, H. E. New strategies for the design of folded peptoids revealed by a survey of noncovalent interactions in model systems. J. Am. Chem. Soc. 131, 16555–16567 (2009). · DOI · Paper page
- Honda, S. et al. Crystal structure of a ten-amino acid protein. J. Am. Chem. Soc. 130, 15327–15331 (2008). · DOI · Paper page
- Kührová, P., De Simone, A., Otyepka, M. & Best, R. B. Force-field dependence of chignolin folding and misfolding: comparison with experiment and redesign. Biophys. J. 102, 1897–1906 (2012). · DOI
- Zhang, T., Nguyen, P. H., Nasica-Labouze, J., Mu, Y. & Derreumaux, P. Folding atomistic proteins in explicit solvent using simulated tempering. J. Phys. Chem. B 119, 6941–6951 (2015). · DOI
- Raval, A., Piana, S., Eastwood, M. P., Dror, R. O. & Shaw, D. E. Refinement of protein structure homology models via long, all-atom molecular dynamics simulations. Proteins 80, 2071–2079 (2012). · DOI · Paper page
- Feig, M. & Mirjalili, V. Protein structure refinement via molecular-dynamics simulations: what works and what does not? Proteins 84, 282–292 (2016). · DOI
- Heo, L. & Feig, M. Experimental accuracy in protein structure refinement via molecular dynamics simulations. Proc. Natl Acad. Sci. USA 115, 13276–13281 (2018). · DOI · Paper page
- Park, H., Ovchinnikov, S., Kim, D. E., DiMaio, F. & Baker, D. Protein homology model refinement by large-scale energy optimization. Proc. Natl Acad. Sci. USA 115, 3054–3059 (2018). · DOI · Paper page
- Park, H. et al. High-accuracy refinement using Rosetta in CASP13. Proteins 87, 1276–1282 (2019). · DOI · Paper page
- Heo, L., Arbour, C. F. & Feig, M. Driven to near-experimental accuracy by refinement via molecular dynamics simulations. Proteins 87, 1263–1275 (2019). · DOI · Paper page
- Zhang, J. & Zhang, Y. A novel side-chain orientation dependent potential derived from random-walk reference state for protein fold selection and structure prediction. PLoS ONE 5, e15386 (2010). · DOI · Paper page
- Jing, X. & Xu, J. Improved protein model quality assessment by integrating sequential and pairwise features using deep learning. Bioinformatics 36, 5361–5367 (2020). · DOI
- Tribello, G. A., Bonomi, M., Branduardi, D., Camilloni, C. & Bussi, G. PLUMED 2: new feathers for an old bird. Comput. Phys. Commun. 185, 604–613 (2014). · DOI · Paper page
- Bussi, G., Donadio, D. & Parrinello, M. Canonical sampling through velocity rescaling. J. Chem. Phys. 126, 014101 (2007). · DOI · Paper page
- Parrinello, M. & Rahman, A. Polymorphic transitions in single crystals: a new molecular dynamics method. J. Appl. Phys. 52, 7182 (1981). · DOI · Paper page
- Darden, T., York, D. & Pedersen, L. Particle mesh Ewald: an Nlog(N) method for Ewald sums in large systems. J. Chem. Phys. 98, 10089–10092 (1993). · DOI · Paper page
- Hess, B., Bekker, H., Berendsen, H. & Fraaije, J. LINCS: a linear constraint solver for molecular simulations. J. Comput. Chem. 18, 1463–1472 (1997). · DOI · Paper page
- Jorgensen, W. L., Chandrasekhar, J., Madura, J. D., Impey, R. W. & Klein, M. L. Comparison of simple potential functions for simulating liquid water. J. Chem. Phys. 79, 926–935 (1983). · DOI · Paper page
- Abadi, M. et al. Tensorflow: a system for large-scale machine learning. In Proc. 12th USENIX Conference on Operating Systems Design and Implementation OSDI’16 265–283 (USENIX Association, 2016).
- Kingma, D. & Ba, J. Adam: a method for stochastic optimization. In Proc. 3rd International Conference on Learning Representations (ICLR, 2015).
- Patriksson, A. & van der Spoel, D. A temperature predictor for parallel tempering simulations. Phys. Chem. Chem. Phys. 10, 2073–2077 (2008). · DOI · Paper page
- Piana, S., Lindorff-Larsen, K. & Shaw, D. E. How robust are protein folding simulations with respect to force field parameterization? Biophys. J. 100, L47–L49 (2011). · DOI · Paper page
- Paissoni, C. & Camilloni, C. How to determine accurate conformational ensembles by metadynamics metainference: a chignolin study case. Front. Mol. Biosci. 8, 694130 (2021). · DOI
- Huang, J. et al. CHARMM36m: an improved force field for folded and intrinsically disordered proteins. Nat. Methods 14, 71–73 (2017). · DOI · Paper page
Cited by
Scientific discovery in the age of artificial intelligence.
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06221-2 · Cited by 1,823
“Wang et al. 169 used a neural-network-based uncertainty estimator to guide the addition of potentials that compensate for the original potential energy, allowing the system to escape local minima (in grey) and explore a configuration space more rapidly.”
Self-citationStatistical Mechanics: Theory and Molecular Simulation
Tuckerman, M. E. (2023) · doi:10.1093/oso/9780198825562.001.0001 · Cited by 973
Direct generation of protein conformational ensembles via machine learning
Janson, G., Valdes-Garcia, G., Heo, L., & Feig, M. (2023) · Nature Communications · doi:10.1038/s41467-023-36443-x · Cited by 192
Markov State Model Approach to Simulate Self-Assembly
Trubiano, A., & Hagan, M. F. (2024) · Physical Review X · doi:10.1103/physrevx.14.041063 · Cited by 7
Metadata
- Authors
- Wang, D., Wang, Y., Chang, J., Zhang, L., Wang, H., & E., W.
- Venue
- Nature Computational Science
- Published
- 2021-12-24
- Volume
- 2
- Issue
- 1
- Pages
- 20-29
- ISSN
- 2662-8457 (ISSN-L)
- OpenAlex
- W3146547718
- Cited by
- 77
- References
- 11
- FWCI
- 3.76
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Funders
- DOE | Advanced Research Projects Agency - Energy (DE-SC0019394)
- National Natural Science Foundation of China (11871110)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Efficient sampling of high-dimensional free energy landscapes using adaptive reinforced dynamics. https://app.cochat.ai/papers/10.1038/s43588-021-00173-1
- The paper
- Wang, D., Wang, Y., Chang, J., Zhang, L., Wang, H., & E., W. (2021). Efficient sampling of high-dimensional free energy landscapes using adaptive reinforced dynamics. Nature Computational Science. https://doi.org/10.1038/s43588-021-00173-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.