A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems
Open accessThe DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Abstract
The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due to the sampling problems. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the dominant eigenfunctions and eigenvalues of the propagator. To this end, a variational principle is derived that is based on the maximization of a Rayleigh coefficient. It is shown that this Rayleigh coefficient can be estimated from statistical observables that can be obtained from short distributed simulations starting from different parts of state space. The approach forms a basis for the development of adaptive and efficient computational algorithms for simulating and analyzing metastable Markov processes while avoiding the sampling problem. Since any stochastic process with finite memory can be transformed into a Markov process, the approach is applicable to a wide range of processes relevant for modeling complex real-world phenomena.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“It was recently discovered that the Rayleigh-Ritz variational principle—a fundamental concept in quantum chemistry—has an analog in molecular conformation dynamics, and that the eigenfunction approximation problem that appears in constructing MSMs can be cast as a generalized eigenproblem [14].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“This formulation implies that MSM-derived relaxation timescales are always underestimated except when linear combinations of the true eigenfunctions of the Markov operator are used as basis functions.”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Standard “crisp paritioning” MSMs based on clustering simulation data were shown to be a special case in which the basis set used in variational optimization is chosen to be a set of functions that are constant on the discrete MSM states [14].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reaction-rate theory: fifty years after Kramers
Hänggi, P., Talkner, P., & Borkovec, M. (1990) · Reviews of Modern Physics · doi:10.1103/revmodphys.62.251 · Cited by 6,154 · cited 1×
“71 03 v1 [ m at hph ] 2 9 N ov 2 01 2”
The Activated Complex in Chemical Reactions
Eyring, H. (1935) · The Journal of Chemical Physics · doi:10.1063/1.1749604 · Cited by 5,828 · cited 1×
“Examples are rate theories that describe the passage rate of a process across a surface that separates metastable states [15, 20], pathway-based theories and methods that describe the transition dynamics of a system from a subset A to a subset B of state space [14, 3, 25] and network-based approaches that attempt to c…”
BackgroundNew Developments in Molecular Orbital Theory
Roothaan, C. C. J. (1951) · Reviews of Modern Physics · doi:10.1103/revmodphys.23.69 · Cited by 5,519
Szabó, A. (1982) · Cited by 2,620
Random perturbations of dynamical systems
(1997) · Translations of Mathematical Monographs · doi:10.1090/mmono/161/03 · Cited by 2,584
T RANSITION P ATH S AMPLING : Throwing Ropes Over Rough Mountain Passes, in the Dark
Bolhuis, P. G., Chandler, D., Dellago, C., & Geissler, P. L. (2002) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.53.082301.113146 · Cited by 1,972
Atomic-level characterization of the structural dynamics of proteins
Shaw, D. E., Maragakis, P., Lindorff-Larsen, K., Piana, S., Dror, R. O., Eastwood, M. P., Bank, J. A., Jumper, J. M., Salmon, J. K., Shan, Y., et al. (2010) · Science · doi:10.1126/science.1187409 · Cited by 1,923 · cited 1×
“An extreme example is the atomistic simulation of solvated biomolecules which would require the propagation of a system with 10(4) − 10(6) particles for 10(7) − 10(10) time-steps, a task that is intractable or hardly tractable even with specialpurpose supercomputers [39].”
Random Perturbations of Dynamical Systems
Freidlin, M. I., & Wentzell, A. D. (1984) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-1-4684-0176-9 · Cited by 1,622 · cited 1×
“In these cases, the mathematical analysis can be based on large deviation estimates and variational principles [16, 14].”
BackgroundSǐnanoğlu, O., & DeRocco, A. G. (1967) · doi:10.1119/1.1973756 · Cited by 898 · cited 2×
“For this, the formalism introduced above is used to formulate the Rayleigh variational principle used in quantum mechanics [43] for Markov processes.”
BackgroundMethodConstructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations
Noé, F., Schütte, C., Vanden-Eijnden, E., Reich, L., & Weikl, T. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905466106 · Cited by 820
Self-citation
Research works printed but not linked: 4
- W. E, 2004, Berlin, 38
- Huisinga W., 2006, Berlin, 167
- Schütte C., 2009, EMS Publishing House, 297
- D. J. Wales, Energy Landscapes , Cambridge University Press, Cambridge, UK, 2003.
Cited by
Items 301–324 of 324
Backward Kolmogorov Transport: Sampling Invariant Laws of Reversible Diffusions from Trajectory Data
Xu, Y.-C., & Ishikawa, I. (2026) · doi:10.48550/arxiv.2609.32664
“The theory of Koopman and transfer operators provides estimators of the generator from trajectories, with error bounds (Williams et al., 2015; Klus et al., 2020; No´e & N¨uske, 2013; Wu & No´e, 2020; Kostic et al., 2023; 2024; Colbrook et al., 2023; Kostic et al., 2022; Meanti et al., 2023).”
Verma, M., Benner, P., & Nüske, F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.06446
“The MSM approach was generalized by the variational approach to conformational dynamics (VAC), 9,10 which enabled the use of general non-linear basis functions instead of set-discretizations, and provided a rigorously defined scalar objective function to assess model quality.”
Self-citationLearning multistate kinetics with a variational multistate committor networkPreprint
Tang, C., Chen, C. G., Roux, B., & Chipot, C. J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.04449
“Markov state models (MSMs), 27–30 Perron-cluster cluster analysis (PCCA), 31 the variational approach for Markov processes (VAMPs), 32,33 and related transfer-operator methods are powerful tools for extracting long-time kinetics from molecular-dynamics (MD) trajectories, but their inferred…”
Blassel, N., Lelièvre, T., & Stoltz, G. (2026) · Journal de Mathématiques Pures et Appliquées · doi:10.1016/j.matpur.2026.103996 · Cited by 3
Variational estimation of generator invariant subspaces
Donati, L., FKh, S., Chewle, S., & Weber, M. (2026) · The Journal of Chemical Physics · doi:10.1063/5.0341109
Learning Collective Variables That Reproduce Transition Rates
Sule, S., Mehta, A., & Cameron, M. (2026) · Multiscale Modeling and Simulation · doi:10.1137/25m177093x · Cited by 2
Optimization of randomized neural networks for transfer operator approximation
Tabish, M., & Klus, S. (2026) · arXiv.org · doi:10.48550/arxiv.2605.23689
“Existing data-driven methods such as extended dynamic mode decomposition (EDMD) [2, 3] and the variational approach of conformation dynamics (VAC) [4, 5] learn a finite-dimensional representation of transfer operators using a fixed set of basis functions, also known as a dictionary.”
Detecting Metastable Basins in High Dimensions via Marginal Trajectory Distribution Discrimination
Jones-McCormick, T. (2026) · arXiv.org · doi:10.48550/arxiv.2605.24136
“In continuous systems, related ideas appear in transfer-operator methods such as diffusion maps [7], Markov state models (MSMs) [28], and variational approaches including VAMP and VAMPnet [24, 19].”
Mean Extinction Times in Multi-Metastable Systems: A Discrete Coarse-Grained Approach
Kudtarkar, S. (2026) · Physics · doi:10.3390/physics8010030
Nepveu-Traversy, M.-É., Hassanzadeh, M., Bruneau‐Cossette, L., Besserer‐Offroy, É., Brouillette, R. L., Morissette, S., Traboulsi, H., Kirby, K., Murza, A., Longpré, J., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-66030-1 · Cited by 1
“The tICA projection dimension waschosen by a slope-average test of implied timescales to retain only the slowest, most signi fi cant modes 41 .”
Upper-Order TICA and Fractional Non-Markovian Process to Model Anomalous Dynamic Regimes
Rapallo, A. (2025) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5c00540
Learning collective variables that preserve transition rates
Sule, S., Mehta, A., & Cameron, M. K. (2025) · arXiv.org · doi:10.48550/arxiv.2506.01222
Koopman-based Control for Stochastic Systems: Application to Enhanced Sampling
Guo, L., Heiland, J., & Nüske, F. (2025) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2025.03.049 · Cited by 1
Self-citationZhang, Z., Guo, L., & Wu, H. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.15981 · Cited by 1
“To investigate system behavior over time scales longer than those accessible through direct simulation, a variety of model reduction methods have been developed (e.g., [10, 21, 11, 20]).”
MethodTemporal Subspace Clustering for Molecular Dynamics Data
Beer, A., Heinrigs, M., Plant, C., & Assent, I. (2024) · arXiv.org · doi:10.48550/arxiv.2408.00056
“The VAC allows the approximation of eigenvalues and eigenfunctions with statistical observables [13].”
MethodtICA-Metadynamics for Identifying Slow Dynamics in Membrane Permeation
Oh, M., da Hora, G. C. A., & Swanson, J. M. J. (2023) · bioRxiv · doi:10.1101/2023.08.16.553477
Feng, J.-Y., Selvam, B., & Shukla, D. (2020) · bioRxiv · doi:10.1101/2020.06.02.130773
Probability based enhanced sampling
Debnath, J., & Parrinello, M. (2019) · doi:10.48550/arxiv.1909.07773
Regression and Model Selection
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690.005 · Cited by 1
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690.001 · Cited by 1
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690.016
Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690.014
(2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690.015
Computational and Technical Aspects
Baldovin, M. (2020) · Springer theses · doi:10.1007/978-3-030-51170-8_6
Metadata
- Authors
- Noé, F., & Nüske, F.
- Venue
- Multiscale Modeling & Simulation
- Published
- 2013-01
- Volume
- 11
- Issue
- 2
- Pages
- 635-655
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W2089842282
- Cited by
- 327
- References
- 50
- Citations by year
- 2026: 17 · 2025: 23 · 2024: 28 · 2023: 27 · 2022: 28 · 2021: 30 · 2020: 23 · 2019: 49 · 2018: 34 · 2017: 23 · 2016: 12 · 2015: 13 · 2014: 8 · 2013: 8
- FWCI
- 11.91
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- Multiscale Modeling and Simulation (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Deutsche Forschungsgemeinschaft
- Freie Universität Berlin
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Mathematical Physics › Stochastic processes and statistical mechanics
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Keywords
- slow processes, variational principle, Rayleigh coefficient, sampling problems, distributed simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.