Markov state models from short non-equilibrium simulations—Analysis and correction of estimation bias
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Many state-of-the-art methods for the thermodynamic and kinetic characterization of large and complex biomolecular systems by simulation rely on ensemble approaches, where data from large numbers of relatively short trajectories are integrated. In this context, Markov state models (MSMs) are extremely popular because they can be used to compute stationary quantities and long-time kinetics from ensembles of short simulations, provided that these short simulations are in “local equilibrium” within the MSM states. However, over the last 15 years since the inception of MSMs, it has been controversially discussed and not yet been answered how deviations from local equilibrium can be detected, whether these deviations induce a practical bias in MSM estimation, and how to correct for them. In this paper, we address these issues: We systematically analyze the estimation of MSMs from short non-equilibrium simulations, and we provide an expression for the error between unbiased transition probabilities and the expected estimate from many short simulations. We show that the unbiased MSM estimate can be obtained even from relatively short non-equilibrium simulations in the limit of long lag times and good discretization. Further, we exploit observable operator model (OOM) theory to derive an unbiased estimator for the MSM transition matrix that corrects for the effect of starting out of equilibrium, even when short lag times are used. Finally, we show how the OOM framework can be used to estimate the exact eigenvalues or relaxation time scales of the system without estimating an MSM transition matrix, which allows us to practically assess the discretization quality of the MSM. Applications to model systems and molecular dynamics simulation data of alanine dipeptide are included for illustration. The improved MSM estimator is implemented in PyEMMA of version 2.3.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How fast-folding proteins fold
Lindorff-Larsen, K., Piana, S., Dror, R. O., & Shaw, D. E. (2011) · Science · doi:10.1126/science.1208351 · Cited by 1,980 · cited 1×
“This offers an explanation why MSMs built from ultra-long simulations [28, 29] are quite well-behaved and have been extensively used for benchmarking and method validation.”
MethodAtomic-level characterization of the structural dynamics of proteins
Shaw, D. E., Maragakis, P., Lindorff-Larsen, K., Piana, S., Dror, R. O., Eastwood, M. P., Bank, J. A., Jumper, J. M., Salmon, J. K., Shan, Y., et al. (2010) · Science · doi:10.1126/science.1187409 · Cited by 1,923
Markov models of molecular kinetics: Generation and validation
Prinz, J.-H., Wu, H., Sarich, M., Keller, B., Senne, M., Held, M., Chodera, J. D., Schütte, C., & Noé, F. (2011) · The Journal of Chemical Physics · doi:10.1063/1.3565032 · Cited by 1,275 · cited 10×
“Dependence of bias on the discretization error : The above formula reflects the well-known insight that Markov models are free of bias if the discretization perfectly approximates the dominant eigenfunctions, meaning that the eigenfunctions are constant on the states S i [1, 5].”
BackgroundInfluentialSelf-citationConstructing the equilibrium ensemble of folding pathways from short off-equilibrium simulations
Noé, F., Schütte, C., Vanden-Eijnden, E., Reich, L., & Weikl, T. R. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0905466106 · Cited by 820
Self-citationCoarse master equations for peptide folding dynamics
Buchete, N.-V., & Hummer, G. (2008) · The Journal of Physical Chemistry B · doi:10.1021/jp0761665 · Cited by 477
Bowman, G. R., Beauchamp, K. A., Boxer, G., & Pande, V. S. (2009) · The Journal of Chemical Physics · doi:10.1063/1.3216567 · Cited by 396 · cited 1×
“(19), such as estimators obeying detailed balance [1, 10, 27].”
BackgroundA Variational Approach to Modeling Slow Processes in Stochastic Dynamical Systems
Noé, F., & Nüske, F. (2013) · Multiscale Modeling & Simulation · doi:10.1137/110858616 · Cited by 327 · cited 1×
“…a model-free estimate of the eigenvalues and relaxation timescales can be used to assess the discretization quality: According to the variational principle of conformation dynamics [24], the exact system eigenvalues provide an upper bound to the eigenvalues of the equilibrium transition matrix T .”
MethodSelf-citationVariational approach to molecular kinetics
Nüske, F., Keller, B. G., Pérez-Hernández, G., Mey, A. S. J. S., & Noé, F. (2014) · Journal of Chemical Theory and Computation · doi:10.1021/ct4009156 · Cited by 308 · cited 2×
“[25, 35] and many others.”
ResultSelf-citationOn the Approximation Quality of Markov State Models
Sarich, M., Noé, F., & Schütte, C. (2010) · Multiscale Modeling & Simulation · doi:10.1137/090764049 · Cited by 182 · cited 3×
“(23) can be written as These matrices contain the MSM projections of the true eigenfunctions, i.e. their approximations by step functions, that is extensively discussed in [1, 14].”
BackgroundProbability distributions of molecular observables computed from Markov models
Noé, F. (2008) · The Journal of Chemical Physics · doi:10.1063/1.2916718 · Cited by 135
Self-citation
Cited by
Markov State Models: From an Art to a Science
Husic, B. E., & Pande, V. S. (2018) · Journal of the American Chemical Society · doi:10.1021/jacs.7b12191 · Cited by 886
Machine Learning of Coarse-Grained Molecular Dynamics Force Fields
Wang, J., Olsson, S., Wehmeyer, C., Pérez, A., Charron, N. E., de Fabritiis, G., Noé, F., & Clementi, C. (2019) · ACS Central Science · doi:10.1021/acscentsci.8b00913 · Cited by 524
Self-citationVAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · Nature Communications · doi:10.1038/s41467-017-02388-1 · Cited by 497
Self-citationVAMPnets for deep learning of molecular kinetics
Mardt, A., Pasquali, L., Wu, H., & Noé, F. (2018) · RePEc: Research Papers in Economics · doi:10.17169/refubium-964 · Cited by 465
Self-citationTime-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics
Wehmeyer, C., & Noé, F. (2018) · The Journal of Chemical Physics · doi:10.1063/1.5011399 · Cited by 401
Self-citation
Metadata
- Authors
- Nüske, F., Wu, H., Prinz, J.-H., Wehmeyer, C., Clementi, C., & Noé, F.
- Venue
- The Journal of Chemical Physics
- Publisher
- AIP Publishing
- Published
- 2017-03-02
- Volume
- 146
- Issue
- 9
- ISSN
- 0021-9606 (ISSN-L)
- 1089-7690
- OpenAlex
- W2577671591
- Cited by
- 61
- References
- 12
- FWCI
- 2.72
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Markov state models from short non-equilibrium simulations—Analysis and correction of estimation bias. https://app.cochat.ai/papers/10.1063/1.4976518
- The paper
- Nüske, F., Wu, H., Prinz, J.-H., Wehmeyer, C., Clementi, C., & Noé, F. (2017). Markov state models from short non-equilibrium simulations—Analysis and correction of estimation bias. The Journal of Chemical Physics. https://doi.org/10.1063/1.4976518
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.