The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Diffusion Maps, Reduction Coordinates, and Low Dimensional Representation of Stochastic Systems
Abstract
The concise representation of complex high dimensional stochastic systems via a few reduced coordinates is an important problem in computational physics, chemistry, and biology. In this paper we use the first few eigenfunctions of the backward Fokker–Planck diffusion operator as a coarse-grained low dimensional representation for the long-term evolution of a stochastic system and show that they are optimal under a certain mean squared error criterion. We denote the mapping from physical space to these eigenfunctions as the diffusion map. While in high dimensional systems these eigenfunctions are difficult to compute numerically by conventional methods such as finite differences or finite elements, we describe a simple computational data-driven method to approximate them from a large set of simulated data. Our method is based on defining an appropriately weighted graph on the set of simulated data and computing the first few eigenvectors and eigenvalues of the corresponding random walk matrix on this graph. Thus, our algorithm incorporates the local geometry and density at each point into a global picture that merges data from different simulation runs in a natural way. Furthermore, we describe lifting and restriction operators between the diffusion map space and the original space. These operators facilitate the description of the coarse-grained dynamics, possibly in the form of a low dimensional effective free energy surface parameterized by the diffusion map reduction coordinates. They also enable a systematic exploration of such effective free energy surfaces through the design of additional “intelligently biased” computational experiments. We conclude by demonstrating our method in a few examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
Henkelman, G., & Jónsson, H. (2000) · The Journal of Chemical Physics · doi:10.1063/1.1323224 · Cited by 9,523
The Fokker-Planck Equation: Methods of Solution and Applications
Risken, H. (1996) · Springer Series in Synergetics · doi:10.1007/978-3-642-61544-3 · Cited by 9,056
Stochastic Processes in Physics and Chemistry
(2007) · Elsevier eBooks · doi:10.1016/b978-0-444-52965-7.x5000-4 · Cited by 8,692
Methods of Mathematical Physics
Courant, R., & Hilbert, D. (1989) · Wiley eBooks · doi:10.1002/9783527617210 · Cited by 8,067
Handbook of Stochastic Methods
Gardiner, C. W. (1983) · Springer Series in Synergetics · doi:10.1007/978-3-662-02377-8 · Cited by 5,961
Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering
Belkin, M., & Niyogi, P. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0080 · Cited by 4,412
Heat Kernels and Spectral Theory
Davies, E. B. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511566158 · Cited by 2,363
Stochastic Differential Equations: Theory and Applications.
Whittle, P., & Arnold, L. (1976) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344856 · Cited by 2,351
Coifman, R. R., & Lafon, S. (2006) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2006.04.006 · Cited by 2,342
Self-citationCoifman, R. R., Lafon, S., Lee, A. B., Maggioni, M., Nadler, B., Warner, F., & Zucker, S. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500334102 · Cited by 1,675
Self-citationString method for the study of rare events
E, W., Ren, W., & Vanden-Eijnden, E. (2002) · Physical Review B · doi:10.1103/physrevb.66.052301 · Cited by 1,308
The Numerical Treatment of Integral Equations
Baker, C. T. H., & Taylor, R. L. (1979) · Journal of Applied Mechanics · doi:10.1115/1.3424708 · Cited by 1,168
Bungartz, H.-J., & Griebel, M. (2004) · Acta Numerica · doi:10.1017/s0962492904000182 · Cited by 1,063
Diffusion maps, spectral clustering and reaction coordinates of dynamical systems
Nadler, B., Lafon, S., Coifman, R. R., & Kevrekidis, I. G. (2006) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2005.07.004 · Cited by 990
Self-citationNonequilibrium statistical mechanics
(2018) · Physics Subject Headings (PhySH) · doi:10.29172/7dd874c05ab04de4991910775f22748a · Cited by 898
Gear, C. W., Hyman, J. M., Kevrekidid, P. G., Kevrekidis, I. G., Runborg, O., & Theodoropoulos, C. (2003) · Communications in Mathematical Sciences · doi:10.4310/cms.2003.v1.n4.a5 · Cited by 776
Self-citationMethods of Mathematical Physics
Diaz, J. B., Courant, R., & Hilbert, D. (1964) · Mathematics of Computation · doi:10.2307/2002966 · Cited by 732
Segmentation using eigenvectors: a unifying view
Weiss, Y. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790354 · Cited by 729
Extending the Time Scale in Atomistic Simulation of Materials
Voter, A. F., Montalenti, F., & Germann, T. C. (2002) · Annual Review of Materials Research · doi:10.1146/annurev.matsci.32.112601.141541 · Cited by 700
Hummer, G. (2005) · New Journal of Physics · doi:10.1088/1367-2630/7/1/034 · Cited by 527
Reaction coordinates and rates from transition paths
Best, R. B., & Hummer, G. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0408098102 · Cited by 511
Robust Perron cluster analysis in conformation dynamics
Deuflhard, P., & Weber, M. (2005) · Linear Algebra and its Applications · doi:10.1016/j.laa.2004.10.026 · Cited by 506 · cited 3×
“Our computational approach is closely related to the transfer operator approach [46], which also computes an approximation to the eigenfunctions of the FP operator [27], and to Perron cluster analysis [18, 19].”
BackgroundMethodA Direct Approach to Conformational Dynamics Based on Hybrid Monte Carlo
Schütte, C., Fischer, A., Huisinga, W., & Deuflhard, P. (1999) · Journal of Computational Physics · doi:10.1006/jcph.1999.6231 · Cited by 393
Efficient transition path sampling: Application to Lennard-Jones cluster rearrangements
Dellago, C., Bolhuis, P. G., & Chandler, D. (1998) · The Journal of Chemical Physics · doi:10.1063/1.476378 · Cited by 363
Equation‐free: The computer‐aided analysis of complex multiscale systems
Kevrekidis, I. G., Gear, C. W., & Hummer, G. (2004) · AIChE Journal · doi:10.1002/aic.10106 · Cited by 363
Self-citationExtracting macroscopic dynamics: model problems and algorithms
Givon, D., Kupferman, R., & Stuart, A. (2004) · Nonlinearity · doi:10.1088/0951-7715/17/6/r01 · Cited by 363
Learning Eigenfunctions Links Spectral Embedding and Kernel PCA
Bengio, Y., Delalleau, O., Roux, N. L., Paiement, J.-F., Vincent, P., & Ouimet, M. (2004) · Neural Computation · doi:10.1162/0899766041732396 · Cited by 345
Das, P., Moll, M., Stamati, H., Kavraki, L. E., & Clementi, C. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0603553103 · Cited by 331
Identification of almost invariant aggregates in reversible nearly uncoupled Markov chains
Deuflhard, P., Huisinga, W., Fischer, A., & Schütte, C. (2000) · Linear Algebra and its Applications · doi:10.1016/s0024-3795(00)00095-1 · Cited by 319
From graph to manifold Laplacian: The convergence rate
Singer, A. (2006) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2006.03.004 · Cited by 316
Diffusion Maps, Spectral Clustering and Eigenfunctions of Fokker-Planck operators
Nadler, B., Lafon, S., Coifman, R. R., & Kevrekidis, I. G. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0506090 · Cited by 294
Self-citationFrom Graphs to Manifolds – Weak and Strong Pointwise Consistency of Graph Laplacians
Hein, M., Audibert, J.-Y., & von Luxburg, U. (2005) · Lecture Notes in Computer Science · doi:10.1007/11503415_32 · Cited by 270
Hummer, G., & Kevrekidis, I. G. (2003) · The Journal of Chemical Physics · doi:10.1063/1.1574777 · Cited by 235
Self-citationE, W., Ren, W., & Vanden-Eijnden, E. (2005) · Chemical Physics Letters · doi:10.1016/j.cplett.2005.07.084 · Cited by 227
Coifman, R. R., Lafon, S., Lee, A. B., Maggioni, M., Nadler, B., Warner, F., & Zucker, S. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500896102 · Cited by 222
Self-citationConvergence of Laplacian Eigenmaps
Belkin, M., & Niyogi, P. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0021 · Cited by 222
Rate constants for diffusive processes by partial path sampling
Moroni, D., Bolhuis, P. G., & van Erp, T. S. (2004) · The Journal of Chemical Physics · doi:10.1063/1.1644537 · Cited by 206
Markowich, P. A., & Villani, C. (2004) · Cited by 137
Fundamental Limitations of Spectral Clustering
Nadler, B., & Galun, M. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0132 · Cited by 132
Self-citationCoarse Master Equation from Bayesian Analysis of Replica Molecular Dynamics Simulations
Sriraman, S., Kevrekidis, I. G., & Hummer, G. (2005) · The Journal of Physical Chemistry B · doi:10.1021/jp046448u · Cited by 127
Self-citationPhase transitions and metastability in Markovian and molecular systems
Huisinga, W., Meyn, S., & Schütte, C. (2004) · The Annals of Applied Probability · doi:10.1214/aoap/1075828057 · Cited by 109
Coarse-grained kinetic computations for rare events: Application to micelle formation
Kopelevich, D. I., Panagiotopoulos, A. Z., & Kevrekidis, I. G. (2005) · The Journal of Chemical Physics · doi:10.1063/1.1839174 · Cited by 93
Self-citationReaction paths based on mean first-passage times
Park, S., Şener, M., Lu, D., & Schulten, K. (2003) · The Journal of Chemical Physics · doi:10.1063/1.1570396 · Cited by 86
Efficient schemes to compute diffusive barrier crossing rates
Ruiz-Montero, M. J., Frenkel, D., & Brey, J. J. (1997) · Molecular Physics · doi:10.1080/00268979709482677 · Cited by 82
Extracting macroscopic stochastic dynamics: Model problems
Huisinga, W., Schütte, C., & Stuart, A. M. (2002) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.10057 · Cited by 38
Graph Algorithms for Dynamical Systems
Dellnitz, M., Molo, M. H.-V., Metzner, P., Preis, R., & Schütte, C. (2006) · Springer eBooks · doi:10.1007/3-540-35657-6_23 · Cited by 35
Cited by
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
Rupp, M., Tkatchenko, A., Müller, K.-R., & von Lilienfeld, O. A. (2012) · Physical Review Letters · doi:10.1103/physrevlett.108.058301 · Cited by 2,312
Enhancing Important Fluctuations: Rare Events and Metadynamics from a Conceptual Viewpoint
Valsson, O., Tiwary, P., & Parrinello, M. (2016) · Annual Review of Physical Chemistry · doi:10.1146/annurev-physchem-040215-112229 · Cited by 647
destiny : diffusion maps for large-scale single-cell data in R
Angerer, P., Haghverdi, L., Büttner, M., Theis, F. J., Marr, C., & Buettner, F. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv715 · Cited by 640
Modern Koopman Theory for Dynamical Systems
Brunton, S. L., Budišić, M., Kaiser, E., & Kutz, J. N. (2022) · SIAM Review · doi:10.1137/21m1401243 · Cited by 576
(2018) · IEEE Control Systems · doi:10.1109/mcs.2018.2810460 · Cited by 518
Metadata
- Authors
- Coifman, R. R., Kevrekidis, I. G., Lafon, S., Maggioni, M., & Nadler, B.
- Venue
- Multiscale Modeling & Simulation
- Published
- 2008-01
- Volume
- 7
- Issue
- 2
- Pages
- 842-864
- ISSN
- 1540-3459 (ISSN-L)
- 1540-3467
- OpenAlex
- W1987236926
- Cited by
- 279
- References
- 47
- FWCI
- 4.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.