A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems
Open accessThe DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Abstract
The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due to the sampling problems. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the dominant eigenfunctions and eigenvalues of the propagator. To this end, a variational principle is derived that is based on the maximization of a Rayleigh coefficient. It is shown that this Rayleigh coefficient can be estimated from statistical observables that can be obtained from short distributed simulations starting from different parts of state space. The approach forms a basis for the development of adaptive and efficient computational algorithms for simulating and analyzing metastable Markov processes while avoiding the sampling problem. Since any stochastic process with finite memory can be transformed into a Markov process, the approach is applicable to a wide range of processes relevant for modeling complex real-world phenomena.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“It was recently discovered that the Rayleigh-Ritz variational principle—a fundamental concept in quantum chemistry—has an analog in molecular conformation dynamics, and that the eigenfunction approximation problem that appears in constructing MSMs can be cast as a generalized eigenproblem [14].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“This formulation implies that MSM-derived relaxation timescales are always underestimated except when linear combinations of the true eigenfunctions of the Markov operator are used as basis functions.”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Standard “crisp paritioning” MSMs based on clustering simulation data were shown to be a special case in which the basis set used in variational optimization is chosen to be a set of functions that are constant on the discrete MSM states [14].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reaction-rate theory: fifty years after Kramers
Hänggi, P., Talkner, P., & Borkovec, M. (1990) · Reviews of Modern Physics · doi:10.1103/revmodphys.62.251 · Cited by 6,154 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
The Activated Complex in Chemical Reactions
Eyring, H. (1935) · The Journal of Chemical Physics · doi:10.1063/1.1749604 · Cited by 5,828 · cited 1×
“Examples are rate theories that describe the passage rate of a process across a surface that separates metastable states [15, 20], pathway-based theories and methods that describe the transition dynamics of a system from a subset A to a subset B of state space [14, 3, 25] and network-based approaches that attempt to c…”
BackgroundNew Developments in Molecular Orbital Theory
Roothaan, C. C. J. (1951) · Reviews of Modern Physics · doi:10.1103/revmodphys.23.69 · Cited by 5,519
Szabó, A. (1982) · Cited by 2,620
Random perturbations of dynamical systems
(1997) · Translations of Mathematical Monographs · doi:10.1090/mmono/161/03 · Cited by 2,584
T RANSITION P ATH S AMPLING : Throwing Ropes Over Rough Mountain Passes, in the Dark
Bolhuis, P. G., Chandler, D., Dellago, C., & Geissler, P. L. (2002) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.53.082301.113146 · Cited by 1,972
Atomic-level characterization of the structural dynamics of proteins
Shaw, D. E., Maragakis, P., Lindorff-Larsen, K., Piana, S., Dror, R. O., Eastwood, M. P., Bank, J. A., Jumper, J. M., Salmon, J. K., Shan, Y., et al. (2010) · Science · doi:10.1126/science.1187409 · Cited by 1,923 · cited 1×
“An extreme example is the atomistic simulation of solvated biomolecules which would require the propagation of a system with 10(4) − 10(6) particles for 10(7) − 10(10) time-steps, a task that is intractable or hardly tractable even with specialpurpose supercomputers [39].”
Random Perturbations of Dynamical Systems
Freidlin, M. I., & Wentzell, A. D. (1984) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-1-4684-0176-9 · Cited by 1,622 · cited 1×
“In these cases, the mathematical analysis can be based on large deviation estimates and variational principles [16, 14].”
BackgroundSǐnanoğlu, O., & DeRocco, A. G. (1967) · doi:10.1119/1.1973756 · Cited by 898 · cited 2×
“For this, the formalism introduced above is used to formulate the Rayleigh variational principle used in quantum mechanics [43] for Markov processes.”
BackgroundMethodConstructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations
Noé, F., Schütte, C., Vanden-Eijnden, E., Reich, L., & Weikl, T. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905466106 · Cited by 820
Self-citation
Research works printed but not linked: 4
- W. E, 2004, Berlin, 38
- Huisinga W., 2006, Berlin, 167
- Schütte C., 2009, EMS Publishing House, 297
- D. J. Wales, Energy Landscapes , Cambridge University Press, Cambridge, UK, 2003.
Cited by
Machine Learning for Fluid Mechanics
Brunton, S. L., Noack, B. R., & Koumoutsakos, P. (2020) · Annual Review of Fluid Mechanics · doi:10.1146/annurev-fluid-010719-060214 · Cited by 3,063
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
Deep learning for universal linear embeddings of nonlinear dynamics
Lusch, B., Kutz, J. N., & Brunton, S. L. (2018) · Nature Communications · doi:10.1038/s41467-018-07210-0 · Cited by 1,424
Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690 · Cited by 1,154
PyEMMA 2: A Software Package for Estimation, Validation, and Analysis of Markov Models
Scherer, M. K., Trendelkamp-Schroer, B., Paul, F., Pérez-Hernández, G., Hoffmann, M., Plattner, N., Wehmeyer, C., Prinz, J.-H., & Noé, F. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00743 · Cited by 1,163
Self-citation
Metadata
- Authors
- Noé, F., & Nüske, F.
- Venue
- Multiscale Modeling & Simulation
- Published
- 2013-01
- Volume
- 11
- Issue
- 2
- Pages
- 635-655
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W2089842282
- Cited by
- 327
- References
- 50
- Citations by year
- 2026: 17 · 2025: 23 · 2024: 28 · 2023: 27 · 2022: 28 · 2021: 30 · 2020: 23 · 2019: 49 · 2018: 34 · 2017: 23 · 2016: 12 · 2015: 13 · 2014: 8 · 2013: 8
- FWCI
- 11.91
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Multiscale Modeling and Simulation (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Deutsche Forschungsgemeinschaft
- Freie Universität Berlin
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Mathematical Physics › Stochastic processes and statistical mechanics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Keywords
- slow processes, variational principle, Rayleigh coefficient, sampling problems, distributed simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems. https://app.cochat.ai/papers/10.1137/110858616
- The paper
- Noé, F., & Nüske, F. (2013). A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems. Multiscale Modeling & Simulation. https://doi.org/10.1137/110858616
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.