On the Approximation Quality of Markov State Models
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
We consider a continuous-time Markov process on a large continuous or discrete state space. The process is assumed to have strong enough ergodicity properties and to exhibit a number of metastable sets. Markov state models (MSMs) are designed to represent the effective dynamics of such a process by a Markov chain that jumps between the metastable sets with the transition rates of the original process. MSMs have been used for a number of applications, including molecular dynamics, for more than a decade. Their approximation quality, however, has not yet been fully understood. In particular, it would be desirable to have a sharp error bound for the difference in propagation of probability densities between the MSM and the original process on long timescales. Here, we provide such a bound for a rather general class of Markov processes ranging from diffusions in energy landscapes to Markov jump processes on large discrete spaces. Furthermore, we discuss how this result provides formal support or shows the limitations of algorithmic strategies that have been found to be useful for the construction of MSMs. Our findings are illustrated by numerical experiments.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent theoretical work has shown it is more useful to instead consider the MSM as a discrete approximation to the dynamics of the Markov operator (transfer operator or dynamical propagator) in the full state space of positions and velocities [8, 7, 5].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [8]
In the citing paper
“A key finding is that good MSMs are able to accurately approximate long-time molecular kinetics because their eigenvectors closely approximate the corresponding eigenfunctions of the Markov operator associated with large eigenvalues [8, 7, 5].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [8]
Citations
Cites
Random perturbations of dynamical systems
(1997) · Translations of Mathematical Monographs · doi:10.1090/mmono/161/03 · Cited by 2,584
Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantization
McDonnell, M. D., Stocks, N. G., Pearce, C. E. M., & Abbott, D. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511535239 · Cited by 2,403
Constructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations
Noé, F., Schütte, C., Vanden-Eijnden, E., Reich, L., & Weikl, T. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905466106 · Cited by 820
Self-citationChodera, J. D., Singhal, N., Pande, V. S., Dill, K. A., & Swope, W. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2714538 · Cited by 640
INTRODUCTION TO THE KINETIC MONTE CARLO METHOD
Voter, A. F. (2007) · NATO Science Series · doi:10.1007/978-1-4020-5295-8_1 · Cited by 508
Robust Perron cluster analysis in conformation dynamics
Deuflhard, P., & Weber, M. (2005) · Linear Algebra and its Applications · doi:10.1016/j.laa.2004.10.026 · Cited by 506
Transition networks for modeling the kinetics of conformational change in macromolecules
Noé, F., & Fischer, S. (2008) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2008.01.008 · Cited by 481
Self-citationCoarse master equations for peptide folding dynamics
Buchete, N.-V., & Hummer, G. (2008) · The Journal of Physical Chemistry B · doi:10.1021/jp0761665 · Cited by 477 · cited 1×
“Recently the interest in MSMs has drastically increased since it has been demonstrated that MSMs can be constructed even for very high-dimensional systems [2] and have been especially useful for modeling the interesting slow dynamics of biomolecules [5, 6, 7, 8, 9, 10] and materials [11] (there under the name “kinetic…”
BackgroundA Direct Approach to Conformational Dynamics Based on Hybrid Monte Carlo
Schütte, C., Fischer, A., Huisinga, W., & Deuflhard, P. (1999) · Journal of Computational Physics · doi:10.1006/jcph.1999.6231 · Cited by 393
Self-citationNoé, F., Horenko, I., Schütte, C., & Smith, J. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2714539 · Cited by 393
Self-citationRao, F., & Caflisch, A. (2004) · Journal of Molecular Biology · doi:10.1016/j.jmb.2004.06.063 · Cited by 358
Hidden complexity of free energy surfaces for peptide (protein) folding
Krivov, S. V., & Karplus, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0406234101 · Cited by 358
Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains
Deuflhard, P., Huisinga, W., Fischer, A., & Schütte, C. (2000) · Linear Algebra and its Applications · doi:10.1016/s0024-3795(00)00095-1 · Cited by 319
Self-citationMetastability in Reversible Diffusion Processes I: Sharp Asymptotics for Capacities and Exit Times
Bovier, A., Eckhoff, M., Gayrard, V., & Klein, M. (2004) · Journal of the European Mathematical Society · doi:10.4171/jems/14 · Cited by 311
Metastability in reversible diffusion processes II: precise asymptotics for small eigenvalues
Bovier, A., Gayrard, V., & Klein, M. (2005) · Journal of the European Mathematical Society · doi:10.4171/jems/22 · Cited by 210
Metastability and Low Lying Spectra¶in Reversible Markov Chains
Bovier, A., Eckhoff, M., Gayrard, V., & Klein, M. (2002) · Communications in Mathematical Physics · doi:10.1007/s002200200609 · Cited by 208
Limiting Exit Location Distributions in the Stochastic Exit Problem
Maier, R. S., & Stein, D. L. (1997) · SIAM Journal on Applied Mathematics · doi:10.1137/s0036139994271753 · Cited by 191
Error analysis and efficient sampling in Markovian state models for molecular dynamics
Singhal, N., & Pande, V. S. (2005) · The Journal of Chemical Physics · doi:10.1063/1.2116947 · Cited by 173
Building Markov state models along pathways to determine free energies and rates of transitions
Pan, A. C., & Roux, B. (2008) · The Journal of Chemical Physics · doi:10.1063/1.2959573 · Cited by 159
Probability distributions of molecular observables computed from Markov models
Noé, F. (2008) · The Journal of Chemical Physics · doi:10.1063/1.2916718 · Cited by 135 · cited 1×
“There are several approaches to estimation of the statistical error ‖P k − P̃ k‖ [29, 30, 31].”
MethodSelf-citationPeptide folding kinetics from replica exchange molecular dynamics
Buchete, N.-V., & Hummer, G. (2008) · Physical Review E · doi:10.1103/physreve.77.030902 · Cited by 121 · cited 1×
“For example, in molecular systems, one usually ignores the solvent coordinates [8, 26, 6] and may even further consider only a subset of solute coordinates such as torsion angles [26, 6].”
BackgroundConformational Dynamics: Modelling, Theory, Algorithm, and Application to Biomolecules
Schütte, C. (1999) · Cited by 106
Self-citationComputation of Essential Molecular Dynamics by Subdivision Techniques
Deuflhard, P., Dellnitz, M., Junge, O., & Schütte, C. (1996) · Computational Molecular Dynamics · doi:10.1007/978-3-642-58360-5_5 · Cited by 97
Self-citationPhase transitions and metastability in Markovian and molecular systems
Huisinga, W., Meyn, S., & Schütte, C. (2004) · The Annals of Applied Probability · doi:10.1214/aoap/1075828057 · Cited by 97
Self-citationBiomolecular conformations can be identified as metastable sets of molecular dynamics
Schütte, C., & Huisinga, W. (2003) · Handbook of numerical analysis · doi:10.1016/s1570-8659(03)10013-0 · Cited by 85
Self-citationMetastability, conformation dynamics, and transition pathways in complex systems
Weinan, E., & Vanden‐Eijnden, E. (2004) · Lecture notes in computational science and engineering · doi:10.1007/978-3-642-18756-8_3 · Cited by 66
Meshless Methods in Conformation Dynamics
Weber, M. (2006) · Cited by 54
Huisinga, W. (2001) · Cited by 41
Tunnel Effect for Kramers-Fokker-Planck Type Operators: Return to Equilibrium and Applications
Hérau, F., Hitrik, M., & Sjöstrand, J. (2008) · International Mathematics Research Notices · doi:10.1093/imrn/rnn057 · Cited by 32
An Averaging Principle for Fast Degrees of Freedom Exhibiting Long-Term Correlations
Schütte, C., Walter, J., Hartmann, C., & Huisinga, W. (2004) · Multiscale Modeling and Simulation · doi:10.1137/030600308 · Cited by 25
Self-citationSpectral properties of metastable Markov semigroups
Davies, E. B. (1983) · Journal of Functional Analysis · doi:10.1016/0022-1236(83)90071-x · Cited by 24
Statistical error estimation and grid-free hierarchical refinement in conformation dynamics
Röblitz, S. (2009) · Universitätsbibliothek der FU Berlin Hochschulschriftenstelle u. Dokumentenserver · doi:10.17169/refubium-12330 · Cited by 19
Research works printed but not linked: 2
- I. Pavlyukevich, Stochastic Resonance , Ph.D. thesis, HU Berlin, Berlin, 2002.
- N. Singhal Hinrichs and V. S. Pande, Bayesian metrics for the comparison of Markovian state models for molecular dynamics simulations , in Proceedings of the International Conference on Research in Computational Molecular Biology, 2007, submitted.
Cited by
Markov models of molecular kinetics: Generation and validation
Prinz, J.-H., Wu, H., Sarich, M., Keller, B., Senne, M., Held, M., Chodera, J. D., Schütte, C., & Noé, F. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3565032 · Cited by 1,275
Self-citationPyEMMA 2: A Software Package for Estimation, Validation, and Analysis of Markov Models
Scherer, M. K., Trendelkamp-Schroer, B., Paul, F., Pérez-Hernández, G., Hoffmann, M., Plattner, N., Wehmeyer, C., Prinz, J.-H., & Noé, F. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00743 · Cited by 1,163
Self-citationIdentification of slow molecular order parameters for Markov model construction
Pérez-Hernández, G., Paul, F., Giorgino, T., De Fabritiis, G., & Noé, F. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4811489 · Cited by 990
Self-citationMachine Learning for Molecular Simulation
Noé, F., Tkatchenko, A., Müller, K.-R., & Clementi, C. (2020) · Annual Review of Physical Chemistry · doi:10.1146/annurev-physchem-042018-052331 · Cited by 956
“(10) We can express the transition density (10) as the action of the Markov propagator in continuous-space, and by its spectral decomposition [72, 73]:”
BackgroundSelf-citationMarkov State Models: From an Art to a Science
Husic, B. E., & Pande, V. S. (2018) · Journal of the American Chemical Society · doi:10.1021/jacs.7b12191 · Cited by 886
Metadata
- Authors
- Sarich, M., Noé, F., & Schütte, C.
- Venue
- Multiscale Modeling & Simulation
- Published
- 2010-01
- Volume
- 8
- Issue
- 4
- Pages
- 1154-1177
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W1988220126
- Cited by
- 182
- References
- 0
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 1 · 2023: 6 · 2022: 1 · 2021: 13 · 2020: 7 · 2019: 7 · 2018: 10 · 2017: 17 · 2016: 23 · 2015: 19 · 2014: 11 · 2013: 22 · 2012: 13
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multiscale Modeling and Simulation (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Physical Sciences › Mathematics › Applied Mathematics › Advanced Mathematical Modeling in Engineering
- Keywords
- Markov state models, approximation error bounds, continuous-time Markov chains, effective dynamics, ergodicity, molecular dynamics, multiscale modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.