A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems
Open accessThe DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Abstract
The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due to the sampling problems. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the dominant eigenfunctions and eigenvalues of the propagator. To this end, a variational principle is derived that is based on the maximization of a Rayleigh coefficient. It is shown that this Rayleigh coefficient can be estimated from statistical observables that can be obtained from short distributed simulations starting from different parts of state space. The approach forms a basis for the development of adaptive and efficient computational algorithms for simulating and analyzing metastable Markov processes while avoiding the sampling problem. Since any stochastic process with finite memory can be transformed into a Markov process, the approach is applicable to a wide range of processes relevant for modeling complex real-world phenomena.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“It was recently discovered that the Rayleigh-Ritz variational principle—a fundamental concept in quantum chemistry—has an analog in molecular conformation dynamics, and that the eigenfunction approximation problem that appears in constructing MSMs can be cast as a generalized eigenproblem [14].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“This formulation implies that MSM-derived relaxation timescales are always underestimated except when linear combinations of the true eigenfunctions of the Markov operator are used as basis functions.”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Standard “crisp paritioning” MSMs based on clustering simulation data were shown to be a special case in which the basis set used in variational optimization is chosen to be a set of functions that are constant on the discrete MSM states [14].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reaction-rate theory: fifty years after Kramers
Hänggi, P., Talkner, P., & Borkovec, M. (1990) · Reviews of Modern Physics · doi:10.1103/revmodphys.62.251 · Cited by 6,154 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
The Activated Complex in Chemical Reactions
Eyring, H. (1935) · The Journal of Chemical Physics · doi:10.1063/1.1749604 · Cited by 5,828 · cited 1×
“Examples are rate theories that describe the passage rate of a process across a surface that separates metastable states [15, 20], pathway-based theories and methods that describe the transition dynamics of a system from a subset A to a subset B of state space [14, 3, 25] and network-based approaches that attempt to c…”
BackgroundNew Developments in Molecular Orbital Theory
Roothaan, C. C. J. (1951) · Reviews of Modern Physics · doi:10.1103/revmodphys.23.69 · Cited by 5,519
Szabó, A. (1982) · Cited by 2,620
Random perturbations of dynamical systems
(1997) · Translations of Mathematical Monographs · doi:10.1090/mmono/161/03 · Cited by 2,584
T RANSITION P ATH S AMPLING : Throwing Ropes Over Rough Mountain Passes, in the Dark
Bolhuis, P. G., Chandler, D., Dellago, C., & Geissler, P. L. (2002) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.53.082301.113146 · Cited by 1,972
Atomic-level characterization of the structural dynamics of proteins
Shaw, D. E., Maragakis, P., Lindorff-Larsen, K., Piana, S., Dror, R. O., Eastwood, M. P., Bank, J. A., Jumper, J. M., Salmon, J. K., Shan, Y., et al. (2010) · Science · doi:10.1126/science.1187409 · Cited by 1,923 · cited 1×
“An extreme example is the atomistic simulation of solvated biomolecules which would require the propagation of a system with 10(4) − 10(6) particles for 10(7) − 10(10) time-steps, a task that is intractable or hardly tractable even with specialpurpose supercomputers [39].”
Random Perturbations of Dynamical Systems
Freidlin, M. I., & Wentzell, A. D. (1984) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-1-4684-0176-9 · Cited by 1,622 · cited 1×
“In these cases, the mathematical analysis can be based on large deviation estimates and variational principles [16, 14].”
BackgroundSǐnanoğlu, O., & DeRocco, A. G. (1967) · doi:10.1119/1.1973756 · Cited by 898 · cited 2×
“For this, the formalism introduced above is used to formulate the Rayleigh variational principle used in quantum mechanics [43] for Markov processes.”
BackgroundMethodConstructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations
Noé, F., Schütte, C., Vanden-Eijnden, E., Reich, L., & Weikl, T. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905466106 · Cited by 820
Self-citationÜber eine neue Methode zur Lösung gewisser Variationsprobleme der mathematischen Physik.
Ritz, W. (1909) · crll · doi:10.1515/crll.1909.135.1 · Cited by 753 · cited 1×
“The Ritz method is a systematic approach to find the best possible approximation to the m first eigenfunctions of an operator simultaneously in terms of a linear combination of orthonormal functions [32].”
MethodPredicting slow structural transitions in macromolecular systems: Conformational flooding
Grubmüller, H. (1995) · Physical Review E · doi:10.1103/physreve.52.2893 · Cited by 687 · cited 1×
“Empirically, it has been found that the stationary densities of biomolecules in the essential subspace is often clustered [18].”
BackgroundChodera, J. D., Singhal, N., Pande, V. S., Dill, K. A., & Swope, W. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2714538 · Cited by 640 · cited 2×
“Applications include conformational rearrangements and folding of peptides, proteins and RNA [9, 29, 6, 28, 45, 27].”
BackgroundThe molecular orbital theory of chemical valency VIII. A method of calculating ionization potentials
Hall, G. G. (1951) · Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences · doi:10.1098/rspa.1951.0048 · Cited by 593 · cited 1×
“The Roothaan-Hall method is a generalization of the Ritz method used for solving the linear parameter optimization problem for the case when the basis set is not orthogonal [33, 19].”
MethodMolecular Simulation of ab Initio Protein Folding for a Millisecond Folder NTL9(1−39)
Voelz, V. A., Bowman, G. R., Beauchamp, K., & Pande, V. S. (2010) · Journal of the American Chemical Society · doi:10.1021/ja9090353 · Cited by 503
Coarse master equations for peptide folding dynamics
Buchete, N.-V., & Hummer, G. (2008) · The Journal of Physical Chemistry B · doi:10.1021/jp0761665 · Cited by 477
Describing Protein Folding Kinetics by Molecular Dynamics Simulations. 1. Theory
Swope, W. C., Pitera, J. W., & Suits, F. (2004) · The Journal of Physical Chemistry B · doi:10.1021/jp037421y · Cited by 430 · cited 1×
“MSMs have been recently used a lot to model molecular dynamics processes, especially in conjunction with large amounts of distributedly simulated trajectories [42, 40, 9, 27, 8, 28].”
MethodBowman, G. R., Beauchamp, K. A., Boxer, G., & Pande, V. S. (2009) · The Journal of Chemical Physics · doi:10.1063/1.3216567 · Cited by 396 · cited 1×
“Applications include conformational rearrangements and folding of peptides, proteins and RNA [9, 29, 6, 28, 45, 27].”
BackgroundA Direct Approach to Conformational Dynamics Based on Hybrid Monte Carlo
Schütte, C., Fischer, A., Huisinga, W., & Deuflhard, P. (1999) · Journal of Computational Physics · doi:10.1006/jcph.1999.6231 · Cited by 393 · cited 10×
“In macromolecules, such slowly-exchanging sets are called conformations, hence the union of the slowest dynamical processes are there termed conformation dynamics [35, 37].”
BackgroundMethodInfluentialNoé, F., Horenko, I., Schütte, C., & Smith, J. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2714539 · Cited by 393 · cited 1×
“Markov state models have been recently used a lot to model molecular dynamics processes, especially in conjunction with large amounts of distributedly simulated trajectories [42, 40, 9, 26, 8, 28].”
Self-citationIdentification of almost invariant aggregates in reversible nearly uncoupled Markov chains
Deuflhard, P., Huisinga, W., Fischer, A., & Schütte, C. (2000) · Linear Algebra and its Applications · doi:10.1016/s0024-3795(00)00095-1 · Cited by 319
Metastability in Reversible Diffusion Processes I: Sharp Asymptotics for Capacities and Exit Times
Bovier, A., Eckhoff, M., Gayrard, V., & Klein, M. (2004) · Journal of the European Mathematical Society · doi:10.4171/jems/14 · Cited by 311 · cited 10×
“4.2c and d, a nearly perfect approximation of both eigenvalues and eigenfunctions is obtained even though the number of basis functions used is identical to the MSM approach of the previous section.”
BackgroundMethodInfluentialCoordinate-dependent diffusion in protein folding
Best, R. B., & Hummer, G. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910390107 · Cited by 289
Markov state models based on milestoning
Schütte, C., Noé, F., Lu, J., Sarich, M., & Vanden-Eijnden, E. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3590108 · Cited by 228 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
Self-citationStochastic Processes in Physics and Chemistry
Ebeling, W. (1995) · Zeitschrift für Physikalische Chemie · doi:10.1524/zpch.1995.188.part_1_2.310a · Cited by 227 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
Metastability in reversible diffusion processes II: precise asymptotics for small eigenvalues
Bovier, A., Gayrard, V., & Klein, M. (2005) · Journal of the European Mathematical Society · doi:10.4171/jems/22 · Cited by 210
Illustration of transition path theory on a collection of simple examples
Metzner, P., Schütte, C., & Vanden-Eijnden, E. (2006) · The Journal of Chemical Physics · doi:10.1063/1.2335447 · Cited by 206
Limiting Exit Location Distributions in the Stochastic Exit Problem
Maier, R. S., & Stein, D. L. (1997) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139994271753 · Cited by 191 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
On the Approximation Quality of Markov State Models
Sarich, M., Noé, F., & Schütte, C. (2010) · Multiscale Modeling & Simulation · doi:10.1137/090764049 · Cited by 182
Self-citationError analysis and efficient sampling in Markovian state models for molecular dynamics
Singhal, N., & Pande, V. S. (2005) · The Journal of Chemical Physics · doi:10.1063/1.2116947 · Cited by 173 · cited 1×
“Markov state models have been recently used a lot to model molecular dynamics processes, especially in conjunction with large amounts of distributedly simulated trajectories [42, 40, 9, 26, 8, 28].”
Stationary points and dynamics in high-dimensional systems
Wales, D. J., & Doye, J. P. K. (2003) · The Journal of Chemical Physics · doi:10.1063/1.1625644 · Cited by 170 · cited 1×
“Examples are rate theories that describe the passage rate of a process across a surface that separates metastable states [15, 20], pathway-based theories and methods that describe the transition dynamics of a system from a subset A to a subset B of state space [14, 3, 25] and network-based approaches that attempt to c…”
BackgroundBuilding Markov state models along pathways to determine free energies and rates of transitions
Pan, A. C., & Roux, B. (2008) · The Journal of Chemical Physics · doi:10.1063/1.2959573 · Cited by 159
EMMA: A Software Package for Markov Model Building and Analysis
Senne, M., Trendelkamp-Schroer, B., Mey, A. S. J. S., Schütte, C., & Noé, F. (2012) · Journal of Chemical Theory and Computation · doi:10.1021/ct300274u · Cited by 148 · cited 1×
“Application of the Roothaan-Hall method with Gaussian basis functions to a one-dimensional diffusion process, compared to a 100-set MSM discretization computed with the EMMA package [38].”
MethodSelf-citationAtomistic Folding Simulations of the Five-Helix Bundle Protein λ6−85
Bowman, G. R., Voelz, V. A., & Pande, V. S. (2011) · Journal of the American Chemical Society · doi:10.1021/ja106936n · Cited by 137
Diffusional Encounter of Barnase and Barstar
Spaar, A., Dammer, C., Gabdoulline, R. R., Wade, R. C., & Helms, V. (2005) · Biophysical Journal · doi:10.1529/biophysj.105.075507 · Cited by 125 · cited 1×
“Examples include macroscopic phenomena including the evolution of financial and climate systems [24, 30], as well as microscopic dynamics such as the diffusion of cells in liquids [1], the diffusion of biomolecules within cells [41], the stochastic reaction dynamics of chemicals at surfaces [31], and the stochastic dy…”
BackgroundNoé, F., Doose, S., Daidone, I., Löllmann, M., Sauer, M., Chodera, J. D., & Smith, J. C. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1004646108 · Cited by 116
Self-citationAnguige, K., & Schmeiser, C. (2008) · Journal of Mathematical Biology · doi:10.1007/s00285-008-0197-8 · Cited by 110 · cited 1×
“Examples include macroscopic phenomena including the evolution of financial and climate systems [24, 30], as well as microscopic dynamics such as the diffusion of cells in liquids [1], the diffusion of biomolecules within cells [41], the stochastic reaction dynamics of chemicals at surfaces [31], and the stochastic dy…”
BackgroundPhase transitions and metastability in Markovian and molecular systems
Huisinga, W., Meyn, S., & Schütte, C. (2004) · The Annals of Applied Probability · doi:10.1214/aoap/1075828057 · Cited by 97 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
Mechanisms of protein–ligand association and its modulation by protein mutations
Held, M., Metzner, P., Prinz, J.-H., & Noé, F. (2011) · Biophysical Journal · doi:10.1016/j.bpj.2010.12.3699 · Cited by 77 · cited 1×
“For example, in macromolecular systems, the slowest events often correspond to functional conformational changes such as folding, binding or catalysis [28, 45, 7, 21].”
BackgroundSelf-citationMetastable States of Symmetric Markov Semigroups II
Davies, E. (1982) · Journal of the London Mathematical Society · doi:10.1112/jlms/s2-26.3.541 · Cited by 64 · cited 1×
“In particular, [10, 11] established fundamental relations between the eigenvalues and -functions of P and metastable sets.”
BackgroundEstimating the Eigenvalue Error of Markov State Models
Djurdjevac, N., Sarich, M., & Schütte, C. (2012) · Multiscale Modeling & Simulation · doi:10.1137/100798910 · Cited by 63
Metastable States of Symmetric Markov Semigroups I
Davies, E. (1982) · Proceedings of the London Mathematical Society · doi:10.1112/plms/s3-45.1.133 · Cited by 55 · cited 1×
“In particular, [10, 11] established fundamental relations between the eigenvalues and -functions of P and metastable sets.”
BackgroundMeshless Methods in Conformation Dynamics
Weber, M. (2006) · Cited by 54
Rieger, M., Rogal, J., & Reuter, K. (2008) · Physical Review Letters · doi:10.1103/physrevlett.100.016105 · Cited by 46 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
Metastability and Dominant Eigenvalues of Transfer Operators
Huisinga, W., & Schmidt, B. G. (2006) · Springer eBooks · doi:10.1007/3-540-31618-3_11 · Cited by 44
Mean Field Approximation in Conformation Dynamics
Friesecke, G., Junge, O., & Koltai, P. (2009) · Multiscale Modeling & simulation · doi:10.1137/080745262 · Cited by 14 · cited 1×
“An interesting alternative approach is to build the basis set upon weakly coupled subsets of internal molecular coordinates, as suggested in the mean field approach developed in [17].”
BackgroundFitting Diffusion Models in Finance
McLeish, D., & Kolkiewicz, A. W. (1997) · doi:10.1214/lnms/1215455054 · Cited by 10 · cited 1×
“Examples include macroscopic phenomena such as the evolution of financial and climate systems [24, 30], as well as microscopic dynamics such as the diffusion of cells in liquids [1], the diffusion of biomolecules within cells [41], the stochastic reaction dynamics of chemicals at surfaces [31], and the stochastic dyna…”
BackgroundSchütte, C., Noé, F., Meerbach, E., Metzner, P., & Hartmann, C. (2008) · doi:10.4171/056-1/15 · Cited by 7 · cited 1×
“In macromolecules, such slowly-exchanging sets are called conformations, hence the union of the slowest dynamical processes are there termed conformation dynamics [35, 37].”
BackgroundSelf-citationA Stochastic Diffusion Model of Climate ChangePreprint
Pelletier, J. (1995) · arXiv (Cornell University) · doi:10.48550/arxiv.ao-sci/9510001 · Cited by 1 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
Research works printed but not linked: 4
- W. E, 2004, Berlin, 38
- Huisinga W., 2006, Berlin, 167
- Schütte C., 2009, EMS Publishing House, 297
- D. J. Wales, Energy Landscapes , Cambridge University Press, Cambridge, UK, 2003.
Cited by
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
Deep learning for universal linear embeddings of nonlinear dynamics
Lusch, B., Kutz, J. N., & Brunton, S. L. (2018) · Nature Communications · doi:10.1038/s41467-018-07210-0 · Cited by 1,424
Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690 · Cited by 1,154
PyEMMA 2: A Software Package for Estimation, Validation, and Analysis of Markov Models
Scherer, M. K., Trendelkamp-Schroer, B., Paul, F., Pérez-Hernández, G., Hoffmann, M., Plattner, N., Wehmeyer, C., Prinz, J.-H., & Noé, F. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00743 · Cited by 1,163
Self-citation
Metadata
- Authors
- Noé, F., & Nüske, F.
- Venue
- Multiscale Modeling & Simulation
- Published
- 2013-01
- Volume
- 11
- Issue
- 2
- Pages
- 635-655
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W2089842282
- Cited by
- 327
- References
- 50
- Citations by year
- 2026: 17 · 2025: 23 · 2024: 28 · 2023: 27 · 2022: 28 · 2021: 30 · 2020: 23 · 2019: 49 · 2018: 34 · 2017: 23 · 2016: 12 · 2015: 13 · 2014: 8 · 2013: 8
- FWCI
- 11.91
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Multiscale Modeling and Simulation (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Deutsche Forschungsgemeinschaft
- Freie Universität Berlin
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Mathematical Physics › Stochastic processes and statistical mechanics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Keywords
- slow processes, variational principle, Rayleigh coefficient, sampling problems, distributed simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.