On the Approximation Quality of Markov State Models
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
We consider a continuous-time Markov process on a large continuous or discrete state space. The process is assumed to have strong enough ergodicity properties and to exhibit a number of metastable sets. Markov state models (MSMs) are designed to represent the effective dynamics of such a process by a Markov chain that jumps between the metastable sets with the transition rates of the original process. MSMs have been used for a number of applications, including molecular dynamics, for more than a decade. Their approximation quality, however, has not yet been fully understood. In particular, it would be desirable to have a sharp error bound for the difference in propagation of probability densities between the MSM and the original process on long timescales. Here, we provide such a bound for a rather general class of Markov processes ranging from diffusions in energy landscapes to Markov jump processes on large discrete spaces. Furthermore, we discuss how this result provides formal support or shows the limitations of algorithmic strategies that have been found to be useful for the construction of MSMs. Our findings are illustrated by numerical experiments.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recent theoretical work has shown it is more useful to instead consider the MSM as a discrete approximation to the dynamics of the Markov operator (transfer operator or dynamical propagator) in the full state space of positions and velocities [8, 7, 5].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [8]
In the citing paper
“A key finding is that good MSMs are able to accurately approximate long-time molecular kinetics because their eigenvectors closely approximate the corresponding eigenfunctions of the Markov operator associated with large eigenvalues [8, 7, 5].”
From Markov state models of biomolecular conformational dynamics (2014) · cites this paper as [8]
Citations
Cites
Random perturbations of dynamical systems
(1997) · Translations of Mathematical Monographs · doi:10.1090/mmono/161/03 · Cited by 2,584
Stochastic Resonance: From Suprathreshold Stochastic Resonance to Stochastic Signal Quantization
McDonnell, M. D., Stocks, N. G., Pearce, C. E. M., & Abbott, D. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511535239 · Cited by 2,403
Constructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations
Noé, F., Schütte, C., Vanden-Eijnden, E., Reich, L., & Weikl, T. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905466106 · Cited by 820
Self-citationChodera, J. D., Singhal, N., Pande, V. S., Dill, K. A., & Swope, W. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2714538 · Cited by 640
INTRODUCTION TO THE KINETIC MONTE CARLO METHOD
Voter, A. F. (2007) · NATO Science Series · doi:10.1007/978-1-4020-5295-8_1 · Cited by 508
Robust Perron cluster analysis in conformation dynamics
Deuflhard, P., & Weber, M. (2005) · Linear Algebra and its Applications · doi:10.1016/j.laa.2004.10.026 · Cited by 506
Transition networks for modeling the kinetics of conformational change in macromolecules
Noé, F., & Fischer, S. (2008) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2008.01.008 · Cited by 481
Self-citationCoarse master equations for peptide folding dynamics
Buchete, N.-V., & Hummer, G. (2008) · The Journal of Physical Chemistry B · doi:10.1021/jp0761665 · Cited by 477 · cited 1×
“Recently the interest in MSMs has drastically increased since it has been demonstrated that MSMs can be constructed even for very high-dimensional systems [2] and have been especially useful for modeling the interesting slow dynamics of biomolecules [5, 6, 7, 8, 9, 10] and materials [11] (there under the name “kinetic…”
BackgroundA Direct Approach to Conformational Dynamics Based on Hybrid Monte Carlo
Schütte, C., Fischer, A., Huisinga, W., & Deuflhard, P. (1999) · Journal of Computational Physics · doi:10.1006/jcph.1999.6231 · Cited by 393
Self-citationNoé, F., Horenko, I., Schütte, C., & Smith, J. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2714539 · Cited by 393
Self-citation
Research works printed but not linked: 2
- I. Pavlyukevich, Stochastic Resonance , Ph.D. thesis, HU Berlin, Berlin, 2002.
- N. Singhal Hinrichs and V. S. Pande, Bayesian metrics for the comparison of Markovian state models for molecular dynamics simulations , in Proceedings of the International Conference on Research in Computational Molecular Biology, 2007, submitted.
Cited by
Markov models of molecular kinetics: Generation and validation
Prinz, J.-H., Wu, H., Sarich, M., Keller, B., Senne, M., Held, M., Chodera, J. D., Schütte, C., & Noé, F. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3565032 · Cited by 1,275
Self-citationPyEMMA 2: A Software Package for Estimation, Validation, and Analysis of Markov Models
Scherer, M. K., Trendelkamp-Schroer, B., Paul, F., Pérez-Hernández, G., Hoffmann, M., Plattner, N., Wehmeyer, C., Prinz, J.-H., & Noé, F. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00743 · Cited by 1,163
Self-citationIdentification of slow molecular order parameters for Markov model construction
Pérez-Hernández, G., Paul, F., Giorgino, T., De Fabritiis, G., & Noé, F. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4811489 · Cited by 990
Self-citationMachine Learning for Molecular Simulation
Noé, F., Tkatchenko, A., Müller, K.-R., & Clementi, C. (2020) · Annual Review of Physical Chemistry · doi:10.1146/annurev-physchem-042018-052331 · Cited by 956
“(10) We can express the transition density (10) as the action of the Markov propagator in continuous-space, and by its spectral decomposition [72, 73]:”
BackgroundSelf-citationMarkov State Models: From an Art to a Science
Husic, B. E., & Pande, V. S. (2018) · Journal of the American Chemical Society · doi:10.1021/jacs.7b12191 · Cited by 886
Markov state models of biomolecular conformational dynamics
Chodera, J. D., & Noé, F. (2014) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2014.04.002 · Cited by 776
Self-citationVAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · Nature Communications · doi:10.1038/s41467-017-02388-1 · Cited by 497
“However, since any Markovian model of MD can be only approximate [8, 64], Eq.”
BackgroundSelf-citationEverything you wanted to know about Markov State Models but were afraid to ask
Pande, V. S., Beauchamp, K., & Bowman, G. R. (2010) · Methods · doi:10.1016/j.ymeth.2010.06.002 · Cited by 698
Schwantes, C. R., & Pande, V. S. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct300878a · Cited by 597
VAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · RePEc: Research Papers in Economics · doi:10.17169/refubium-964 · Cited by 465
Self-citationFuzzy spectral clustering by PCCA+: application to Markov state models and data classification
Röblitz, S., & Weber, M. (2013) · Advances in Data Analysis and Classification · doi:10.1007/s11634-013-0134-6 · Cited by 371
“Today it is often referred to as Markov state modelling (MSM), see Chodera et al. (2007), Bowman et al. (2009), Sarich et al. (2010), Prinz et al. (2011).”
BackgroundMSMBuilder2: Modeling Conformational Dynamics on the Picosecond to Millisecond Scale
Beauchamp, K. A., Bowman, G. R., Lane, T. J., Maibaum, L., Haque, I. S., & Pande, V. S. (2011) · Journal of Chemical Theory and Computation · doi:10.1021/ct200463m · Cited by 372
A Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems
Noé, F., & Nüske, F. (2013) · Multiscale Modeling & Simulation · doi:10.1137/110858616 · Cited by 327
Self-citationUnsupervised Learning Methods for Molecular Simulation Data
Glielmo, A., Husic, B. E., Rodriguez, A., Clementi, C., Noé, F., & Laio, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01195 · Cited by 402
“327 Because the VAC de fi nes a scoring function, it enables us to optimize the model ’ s description of the true system ’ s global kinetics by variationally maximizing eq 51.”
BackgroundMethodSelf-citationVariational approach to molecular kinetics
Nüske, F., Keller, B. G., Pérez-Hernández, G., Mey, A. S. J. S., & Noé, F. (2014) · Journal of Chemical Theory and Computation · doi:10.1021/ct4009156 · Cited by 308
Self-citationPartial differential equations and stochastic methods in molecular dynamics
Lelièvre, T., & Stoltz, G. (2016) · Acta Numerica · doi:10.1017/s0962492916000039 · Cited by 178
Markov state models based on milestoning
Schütte, C., Noé, F., Lu, J., Sarich, M., & Vanden-Eijnden, E. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3590108 · Cited by 228
Self-citationKinetic Distance and Kinetic Maps from Molecular Dynamics Simulation
Noé, F., & Clementi, C. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00553 · Cited by 219
“The first question has been answered: building on conformation dynamics theory [29, 28, 24, 15] it has been shown that the eigenfunctions of the backward Markov propagator underlying the MD are the optimal reaction coordinates: Projecting the dynamics upon these eigenfunctions will give rise to a maximum estimate of t…”
BackgroundSelf-citationVariational cross-validation of slow dynamical modes in molecular kinetics
McGibbon, R. T., & Pande, V. S. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4916292 · Cited by 189
Taming the complexity of protein folding
Bowman, G. R., Voelz, V. A., & Pande, V. S. (2011) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2010.10.006 · Cited by 170
“For example, by requiring that two conformations be able to interconvert on a nanosecond timescale for them to be grouped in the same state, one can build a very high-resolution model with many small states that would be appropriate for making a quantitative comparison with experiments [17,19,55].”
BackgroundNoé, F., Wu, H., Prinz, J.-H., & Plattner, N. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4828816 · Cited by 173
Self-citationSimple few-state models reveal hidden complexity in protein folding
Beauchamp, K. A., McGibbon, R., Lin, Y.-S., & Pande, V. S. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1201810109 · Cited by 161
“The second difficulty with MSM approaches is that imperfect state decompositions can lead to non-Markovian dynamics, or memory (8, 17, 18), which can bias rate predictions.”
BackgroundBachmayr, M., Schneider, R., & Uschmajew, A. (2016) · Foundations of Computational Mathematics · doi:10.1007/s10208-016-9317-9 · Cited by 173
Noé, F., & Clementi, C. (2017) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2017.02.006 · Cited by 167
Self-citationEstimation and uncertainty of reversible Markov models
Trendelkamp-Schroer, B., Wu, H., Paul, F., & Noé, F. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4934536 · Cited by 134
Self-citationWu, H., Nüske, F., Paul, F., Klus, S., Koltai, P., & Noé, F. (2017) · The Journal of Chemical Physics · doi:10.1063/1.4979344 · Cited by 139
Self-citationEMMA: A Software Package for Markov Model Building and Analysis
Senne, M., Trendelkamp-Schroer, B., Mey, A. S. J. S., Schütte, C., & Noé, F. (2012) · Journal of Chemical Theory and Computation · doi:10.1021/ct300274u · Cited by 148
Self-citationProtein-peptide association kinetics beyond the seconds timescale from atomistic simulations
Paul, F., Wehmeyer, C., Abualrous, E. T., Wu, H., Crabtree, M. D., Schöneberg, J., Clarke, J., Freund, C., Weikl, T. R., & Noé, F. (2017) · Nature Communications · doi:10.1038/s41467-017-01163-6 · Cited by 158
Self-citationPerspective: Identification of collective variables and metastable states of protein dynamics
Sittel, F., & Stock, G. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5049637 · Cited by 150
Prinz, J.-H., Keller, B., & Noé, F. (2011) · Physical Chemistry Chemical Physics · doi:10.1039/c1cp21258c · Cited by 120
Self-citationNoé, F., Doose, S., Daidone, I., Löllmann, M., Sauer, M., Chodera, J. D., & Smith, J. C. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1004646108 · Cited by 116
Self-citationMarkov State Models to Study the Functional Dynamics of Proteins in the Wake of Machine Learning
Konovalov, K. A., Unarta, I. C., Cao, S., Goonetilleke, E. C., & Huang, X. (2021) · JACS Au · doi:10.1021/jacsau.1c00254 · Cited by 120
Optimal Feedback Controlled Assembly of Perfect Crystals
Tang, X., Rupp, B. B., Yang, Y., Edwards, T. D., Grover, M. A., & Bevan, M. A. (2016) · ACS Nano · doi:10.1021/acsnano.6b02400 · Cited by 109
Witek, J., Keller, B. G., Blatter, M., Meissner, A., Wagner, T., & Riniker, S. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00251 · Cited by 116
Votapka, L. W., Jagger, B. R., Heyneman, A. L., & Amaro, R. E. (2017) · The Journal of Physical Chemistry B · doi:10.1021/acs.jpcb.6b09388 · Cited by 96
Wu, H., Mey, A. S. J. S., Rosta, E., & Noé, F. (2014) · The Journal of Chemical Physics · doi:10.1063/1.4902240 · Cited by 98
Self-citationPerspective: Markov models for long-timescale biomolecular dynamics
Schwantes, C. R., McGibbon, R. T., & Pande, V. S. (2014) · The Journal of Chemical Physics · doi:10.1063/1.4895044 · Cited by 87
Galerkin approximation of dynamical quantities using trajectory data
Thiede, E. H., Giannakis, D., Dinner, A. R., & Weare, J. (2019) · The Journal of Chemical Physics · doi:10.1063/1.5063730 · Cited by 90
Network models for molecular kinetics and their initial applications to human health
Bowman, G. R., Huang, X., & Pande, V. S. (2010) · Cell Research · doi:10.1038/cr.2010.57 · Cited by 59
Complex RNA Folding Kinetics Revealed by Single-Molecule FRET and Hidden Markov Models
Keller, B. G., Kobitski, A., Jäschke, A., Nienhaus, G. U., & Noé, F. (2014) · Journal of the American Chemical Society · doi:10.1021/ja4098719 · Cited by 84
Self-citationDynamic properties of force fields.
Vitalini, F., Mey, A., Noé, F., & Keller, B. (2015) · Journal of Chemical Physics · doi:10.1063/1.4909549 · Cited by 80
Self-citationNüske, F., Wu, H., Prinz, J.-H., Wehmeyer, C., Clementi, C., & Noé, F. (2017) · The Journal of Chemical Physics · doi:10.1063/1.4976518 · Cited by 61
“(23) can be written as These matrices contain the MSM projections of the true eigenfunctions, i.e. their approximations by step functions, that is extensively discussed in [1, 14].”
BackgroundDeep Generative Markov State Models
Wu, H., Mardt, A., Pasquali, L., & Noé, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07601 · Cited by 35
“In practice, the long-time behavior of dynamical systems can be accurately described in a Markovian model when suitable features or variables are used, and when the time resolution of the model is sufficiently coarse such that the time-evolution can be represented with a manageable number of dynamical modes [24, 11].”
BackgroundSelf-citationEffective dynamics along given reaction coordinates, and reaction rate theory
Zhang, W., Hartmann, C., & Schütte, C. (2016) · Faraday Discussions · doi:10.1039/c6fd00147e · Cited by 88
Self-citationDensity-based cluster algorithms for the identification of core sets
Lemke, O., & Keller, B. G. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4965440 · Cited by 70
Perspective: Computer simulations of long time dynamics
Elber, R. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4940794 · Cited by 70
Pérez-Hernández, G., & Noé, F. (2016) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.6b00738 · Cited by 77
Self-citationEstimating the Eigenvalue Error of Markov State Models
Djurdjevac, N., Sarich, M., & Schütte, C. (2012) · Multiscale Modeling & Simulation · doi:10.1137/100798910 · Cited by 63
Self-citationVariational tensor approach for approximating the rare-event kinetics of macromolecular systems.
Nüske, F., Schneider, R., Vitalini, F., & Noé, F. (2016) · Journal of Chemical Physics · doi:10.1063/1.4940774 · Cited by 65
“A particularly interesting result from this line of research is that the essential information of the molecule’s stationary and kinetic quantities is contained in the dominant eigenvalues and eigenfunctions of the dynamical operator of the molecular dynamics [2], and that the eigenvalues and eigenvectors of a Markov m…”
BackgroundSelf-citationRevisiting and Computing Reaction Coordinates with Directional Milestoning
Kırmızıaltın, S., & Elber, R. (2011) · The Journal of Physical Chemistry A · doi:10.1021/jp111093c · Cited by 78
Suárez, E., Wiewiora, R. P., Wehmeyer, C., Noé, F., Chodera, J. D., & Zuckerman, D. M. (2021) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.0c01154 · Cited by 65
Self-citationSuárez, E., Wiewiora, R. P., Wehmeyer, C., Noé, F., Chodera, J. D., & Zuckerman, D. M. (2020) · doi:10.1101/2020.11.09.374496 · Cited by 65
Self-citationVariational selection of features for molecular kinetics
Scherer, M. K., Husic, B. E., Hoffmann, M., Paul, F., Wu, H., & Noé, F. (2019) · The Journal of Chemical Physics · doi:10.1063/1.5083040 · Cited by 61
“The second generation of MSM methodology is characterized by the finding that the predictive power of an MSM depends upon its states being chosen such that a good discretization of the Markov operator eigenfunctions is obtained 12,27 .”
BackgroundMethodInfluentialSelf-citationOptimized parameter selection reveals trends in Markov state models for protein folding
Husic, B. E., McGibbon, R. T., Sultan, M. M., & Pande, V. S. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4967809 · Cited by 65
Markov models and dynamical fingerprints: Unraveling the complexity of molecular kinetics
Keller, B. G., Prinz, J.-H., & Noé, F. (2012) · Chemical Physics · doi:10.1016/j.chemphys.2011.08.021 · Cited by 59
Self-citationCommute Maps: Separating Slowly Mixing Molecular Configurations for Kinetic Modeling
Noé, F., Banisch, R., & Clementi, C. (2016) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.6b00762 · Cited by 61
Self-citationJump Markov models and transition state theory: the quasi-stationary distribution approach
Gesù, G. D., Tony Lelièvre, A., Peutrec, D. L., & Nectoux, B. (2016) · Faraday Discussions · doi:10.1039/c6fd00120c · Cited by 59
Investigating Molecular Kinetics by Variationally Optimized Diffusion Maps
Boninsegna, L., Gobbo, G., Noé, F., & Clementi, C. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00749 · Cited by 60
Self-citationCárdenas, A. E., Jas, G. S., DeLeon‐Pennell, K. Y., Hegefeld, W. A., Kuczera, K., & Elber, R. (2012) · The Journal of Physical Chemistry B · doi:10.1021/jp2102447 · Cited by 60
Quantifying the rebinding effect in multivalent chemical ligand-receptor systems
Weber, M., Bujotzek, A., & Haag, R. (2012) · The Journal of Chemical Physics · doi:10.1063/1.4739501 · Cited by 56
Introduction to Markov state modeling with the PyEMMA software [Article v1.0]
Wehmeyer, C., Scherer, M. K., Hempel, T., Husic, B. E., Olsson, S., & Noé, F. (2019) · Living Journal of Computational Molecular Science · doi:10.33011/livecoms.1.1.5965 · Cited by 64
Self-citationPrinz, J.-H., Chodera, J. D., Pande, V. S., Swope, W. C., Smith, J. C., & Noé, F. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3592153 · Cited by 52
Self-citationHow Effectively Can Adaptive Sampling Methods Capture Spontaneous Ligand Binding?
Betz, R. M., & Dror, R. O. (2019) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.8b00913 · Cited by 55
Witek, J., Mühlbauer, M. E., Keller, B. G., Blatter, M., Meissner, A., Wagner, T., & Riniker, S. (2017) · ChemPhysChem · doi:10.1002/cphc.201700995 · Cited by 64
Abate, A. (2013) · Hybrid Autonomous Systems@ETAPS · doi:10.1016/j.entcs.2013.12.002 · Cited by 47
“Related to this works, [58] has proposed explicit error bounds on a time and space discretization of a Markov process with certain ergodic properties.”
BackgroundBittracher, A., Koltai, P., Klus, S., Banisch, R., Dellnitz, M., & Schütte, C. (2017) · Journal of Nonlinear Science · doi:10.1007/s00332-017-9415-0 · Cited by 65
“and it has been studied in detail under which condition this can be achieved [20, 65].”
BackgroundSelf-citationLearning Kinetic Distance Metrics for Markov State Models of Protein Conformational Dynamics.
McGibbon, R. T., & Pande, V. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct400132h · Cited by 44
Chodera, J. D., & Noé, F. (2010) · The Journal of Chemical Physics · doi:10.1063/1.3463406 · Cited by 42
Self-citationA Square Root Approximation of Transition Rates for a Markov State Model
Lie, H. C., Fackeldey, K., & Weber, M. (2013) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/120899959 · Cited by 35
“Methods based on Markov state models [24, 26, 15] seek to identify the metastabilities and study the coarse scale dynamics by constructing a Markov chain on a finite”
BackgroundMethodPrinz, J.-H., Held, M., Smith, J. C., & Noé, F. (2011) · Multiscale Modeling & Simulation · doi:10.1137/100789191 · Cited by 42
Self-citationSimulations of allosteric transitions
Elber, R. (2011) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2011.01.012 · Cited by 47
Influence of protein crowder size on hydration structure and dynamics in macromolecular crowding
Wang, P.-H., Yu, I., Feig, M., & Sugita, Y. (2017) · Chemical Physics Letters · doi:10.1016/j.cplett.2017.01.012 · Cited by 46
Efficient Bayesian estimation of Markov model transition matrices with given stationary distribution
Trendelkamp-Schroer, B., & Noé, F. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4801325 · Cited by 39
Self-citationOptimal Data-Driven Estimation of Generalized Markov State Models for Non-Equilibrium Dynamics
Koltai, P., Wu, H., Noé, F., & Schütte, C. (2018) · De Computis · doi:10.3390/computation6010022 · Cited by 39
“…of the MSM. Note, however, that for this approximation to reproduce the dominant time scales well, i.e., to have t i ≈ (cid:98) t i , i = 1, . . . , k , we need a strong separation of time scales in the sense that t k t k + 1 has to hold, and the lag time τ needs to be chosen sufficiently large [7].”
BackgroundSelf-citationEfficient maximum likelihood parameterization of continuous-time Markov processes.
McGibbon, R. T., & Pande, V. (2015) · Journal of Chemical Physics · doi:10.1063/1.4926516 · Cited by 37
Two Mathematical Tools to Analyze Metastable Stochastic Processes
Tony Lelièvre, A. (2012) · Springer eBooks · doi:10.1007/978-3-642-33134-3_83 · Cited by 26
A critical appraisal of Markov state models
Schütte, C., & Sarich, M. (2015) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2015-02421-0 · Cited by 39
Self-citationEfficient Estimation of Rare-Event Kinetics
Trendelkamp-Schroer, B., & Noé, F. (2016) · Physical Review X · doi:10.1103/physrevx.6.011009 · Cited by 41
Self-citationOptimal control of molecular dynamics using Markov state models
Schütte, C., Winkelmann, S., & Hartmann, C. (2012) · Mathematical Programming · doi:10.1007/s10107-012-0547-6 · Cited by 37
“For appropriately chosen core sets, the entries of M−1 L̂ are known to approximate the transition rates of the underlying dynamics between the main metastable sets while its eigenvalues 0 = λ̂1 > · · · ≥ λ̂m are close approximations of the leading eigenvalues 0 = λ1 > · · · ≥ λm of the infinitesimal generator L [32].”
Self-citationShmilovich, K., & Ferguson, A. L. (2023) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.3c00505 · Cited by 35
Machine Learning for Molecular Dynamics on Long Timescales
Noé, F. (2020) · Lecture notes in physics · doi:10.1007/978-3-030-40245-7_16 · Cited by 76
Self-citationFunctional Macromolecular Systems: Kinetic Pathways to Obtain Tailored Structures
Abetz, V., Kremer, K., Müller, M., & Reiter, G. (2018) · Macromolecular Chemistry and Physics · doi:10.1002/macp.201800334 · Cited by 38
A new paradigm for atomically detailed simulations of kinetics in biophysical systems
Elber, R. (2017) · Quarterly Reviews of Biophysics · doi:10.1017/s0033583517000063 · Cited by 52
Mechanistic Models of Chemical Exchange Induced Relaxation in Protein NMR
Olsson, S., & Noé, F. (2017) · Journal of the American Chemical Society · doi:10.1021/jacs.6b09460 · Cited by 37
Self-citationMarkov State Models for Rare Events in Molecular Dynamics
Sarich, M., Banisch, R., Hartmann, C., & Schütte, C. (2013) · Entropy · doi:10.3390/e16010258 · Cited by 42
“From above, it is clear that, in general, we have X̂k 6= X̃k, and in [24] it was analyzed how these two processes relate in terms of density propagation.”
BackgroundSelf-citationViolation of local detailed balance upon lumping despite a clear timescale separation
Hartich, D., & Godec, A. (2023) · Physical Review Research · doi:10.1103/physrevresearch.5.l032017 · Cited by 43
“1(a) inherently leads to non-Markovian jump dynamics in continuous time [44,45] due to fast recrossings in the transition region between A and B. Notably, these can nowadays be experimentally resolved [46–51] and are therefore important practically.”
Variational Identification of Markovian Transition States
Martini, L., Kells, A., Covino, R., Hummer, G., Buchete, N., & Rosta, E. (2017) · Physical Review X · doi:10.1103/physrevx.7.031060 · Cited by 40
“Analogously, it has also been shown previously that adding states at the transition region reduces the discretization error in constructing Markov models [58,59].”
BackgroundEfficient approximation of molecular kinetics using random Fourier features
Nüske, F., & Klus, S. (2023) · The Journal of Chemical Physics · doi:10.1063/5.0162619 · Cited by 22
“Since timescales are independent of the lag time in the absence of projection and estimation error 36 , we monitor convergence of implied timescales with increasing lag time t in order to select an optimal lag time 11 .”
MethodMathematical modeling of spatio-temporal population dynamics and application to epidemic spreading
Winkelmann, S., Zonker, J., Schütte, C., & Conrad, N. D. (2021) · Mathematical Biosciences · doi:10.1016/j.mbs.2021.108619 · Cited by 31
“Given the assumptions of well-mixed behavior, we will make use of the approach given in [18] and construct a Markov state model with respect to the movements of the agents by applying a Galerkin projection Q (derived from the metastable partition) to the generator L + G defined in (7), see also [17].”
Self-citationDynamical coring of Markov state models
Nagel, D., Weber, A., Lickert, B., & Stock, G. (2019) · The Journal of Chemical Physics · doi:10.1063/1.5081767 · Cited by 36
Winkelmann, S., & Schütte, C. (2016) · The Journal of Chemical Physics · doi:10.1063/1.4971163 · Cited by 25
“Fortunately, for MSM’s there exist methods to validate the model and to quantify the statistical error, allowing to rerun simulations in case of high uncertainty (so called adaptive sampling).[4, 23, 25] The development of standards for the number and length of simulations needed for a statistically reliable modeling…”
MethodSelf-citationKeller, B., Hünenberger, P., & van Gunsteren, W. F. (2011) · Journal of Chemical Theory and Computation · doi:10.1021/ct200069c · Cited by 25
Common Nearest Neighbor Clustering—A Benchmark
Lemke, O., & Keller, B. G. (2018) · Algorithms · doi:10.3390/a11020019 · Cited by 26
“The transition matrix is however only a model of the true dynamics, and the approximation error depends sensitively on the discretization [56].”
BackgroundImplicit Transfer Operator Learning: Multiple Time-Resolution Surrogates for Molecular DynamicsPreprint
Schreiner, M., Winther, O., & Olsson, S. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2305.18046 · Cited by 27
“In general, we expect robustness to sparsely observed representations as long as the input representations are sufficient to span the eigenfunctions of T ⌦ [23, 24].”
BackgroundAnalysis and optimization of weighted ensemble sampling
Aristoff, D. (2017) · ESAIM Mathematical Modelling and Numerical Analysis · doi:10.1051/m2an/2017046 · Cited by 22
“This stance allows us, in principle at least, to define a Markov state model [20, 21] on the bins.”
Building Markov State Models for Periodically Driven Non-Equilibrium Systems
Wang, H., & Schütte, C. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/ct500997y · Cited by 23
Self-citationDiffusion maps, clustering and fuzzy Markov modeling in peptide folding transitions
Nedialkova, L. V., Amat, M. A., Kevrekidis, I. G., & Hummer, G. (2014) · The Journal of Chemical Physics · doi:10.1063/1.4893963 · Cited by 35
A Basis Set for Peptides for the Variational Approach to Conformational Kinetics
Vitalini, F., Noé, F., & Keller, B. G. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00498 · Cited by 31
Self-citationOn Markov State Models for Metastable Processes
Djurdjevac, N., Sarich, M., & Schütte, C. (2011) · International Congress of Mathematicians (ICM) · doi:10.1142/9789814324359_0182 · Cited by 25
“In this case we find in [19] an error bound for the approximation error from (31) ‖QTQ − (QTQ)‖.”
BackgroundInfluentialSelf-citationDynamic neutron scattering from conformational dynamics. I. Theory and Markov models
Lindner, B., Yi, Z., Prinz, J.-H., Smith, J. C., & Noé, F. (2013) · The Journal of Chemical Physics · doi:10.1063/1.4824070 · Cited by 23
Self-citation
Metadata
- Authors
- Sarich, M., Noé, F., & Schütte, C.
- Venue
- Multiscale Modeling & Simulation
- Published
- 2010-01
- Volume
- 8
- Issue
- 4
- Pages
- 1154-1177
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W1988220126
- Cited by
- 182
- References
- 0
- Citations by year
- 2026: 2 · 2025: 6 · 2024: 1 · 2023: 6 · 2022: 1 · 2021: 13 · 2020: 7 · 2019: 7 · 2018: 10 · 2017: 17 · 2016: 23 · 2015: 19 · 2014: 11 · 2013: 22 · 2012: 13
- FWCI
- 15.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multiscale Modeling and Simulation (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Model Reduction and Neural Networks
- Physical Sciences › Mathematics › Applied Mathematics › Advanced Mathematical Modeling in Engineering
- Keywords
- Markov state models, approximation error bounds, continuous-time Markov chains, effective dynamics, ergodicity, molecular dynamics, multiscale modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.