The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Diffusion maps, spectral clustering and reaction coordinates of dynamical systems
Open accessAbstract
A central problem in data analysis is the low dimensional representation of high dimensional data and the concise description of its underlying geometry and density. In the analysis of large scale simulations of complex dynamical systems, where the notion of time evolution comes into play, important problems are the identification of slow variables and dynamically meaningful reaction coordinates that capture the long time evolution of the system. In this paper we provide a unifying view of these apparently different tasks, by considering a family of diffusion maps, defined as the embedding of complex (high dimensional) data onto a low dimensional Euclidean space, via the eigenvectors of suitably defined random walks defined on the given datasets. Assuming that the data is randomly sampled from an underlying general probability distribution p ( x ) = e − U ( x ) , we show that as the number of samples goes to infinity, the eigenvectors of each diffusion map converge to the eigenfunctions of a corresponding differential operator defined on the support of the probability distribution. Different normalizations of the Markov chain on the graph lead to different limiting differential operators. Specifically, the normalized graph Laplacian leads to a backward Fokker–Planck operator with an underlying potential of 2 U ( x ) , best suited for spectral clustering. A different anisotropic normalization of the random walk leads to the backward Fokker–Planck operator with the potential U ( x ) , best suited for the analysis of the long time asymptotics of high dimensional stochastic systems governed by a stochastic differential equation with the same potential U ( x ) . Finally, yet another normalization leads to the eigenfunctions of the Laplace–Beltrami (heat) operator on the manifold in which the data resides, best suited for the analysis of the geometry of the dataset regardless of its possibly non-uniform density.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Messiah, A. (1961) · Cited by 16,012
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
The Fokker-Planck Equation: Methods of Solution and Applications
Risken, H. (1996) · Springer Series in Synergetics · doi:10.1007/978-3-642-61544-3 · Cited by 9,056
On Spectral Clustering: Analysis and an algorithm
Ng, A. Y., Jordan, M. I., & Weiss, Y. (2001) · Cited by 8,159
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
Lecture Notes in Artificial Intelligence
Brézillon, P., & Bouquet, P. (1999) · Cited by 7,473
Chung, F. (1996) · CBMS Regional Conference Series in Mathematics · doi:10.1090/cbms/092 · Cited by 5,524
Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences
Gardiner, C. W. (1985) · Springer Series in Synergetics · doi:10.1007/978-3-662-02452-2 · Cited by 3,703
Coifman, R. R., Lafon, S., Lee, A. B., Maggioni, M., Nadler, B., Warner, F., & Zucker, S. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500334102 · Cited by 1,675
Self-citation
Cited by
(2008) · Journal of Machine Learning Research · Cited by 33,051
Fortunato, S. (2010) · Physics Reports · doi:10.1016/j.physrep.2009.11.002 · Cited by 11,293
“B) and in a recent analysis by Nadler et al. (Nadler et al., 2006), one defined a dissimilarity measure called “diffusion distance”, which is derived from the probability that the walker visits the target after a fixed number of steps.”
Advances In Deep Learning On Graphs (Gsp'18 Workshop)
Defferrard, M. (2016) · Figshare · doi:10.5281/zenodo.1286817 · Cited by 4,613
Coifman, R. R., & Lafon, S. (2006) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2006.04.006 · Cited by 2,342
Self-citationA Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
Williams, M. O., Kevrekidis, I. G., & Rowley, C. W. (2015) · Journal of Nonlinear Science · doi:10.1007/s00332-015-9258-5 · Cited by 1,945
Self-citationCoifman, R. R., Lafon, S., Lee, A. B., Maggioni, M., Nadler, B., Warner, F., & Zucker, S. W. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0500334102 · Cited by 1,675
Self-citationNonlocal Operators with Applications to Image Processing
Gilboa, G., & Osher, S. (2009) · Multiscale Modeling & Simulation · doi:10.1137/070698592 · Cited by 1,423
Visualizing structure and transitions in high-dimensional biological data
Moon, K. R., van Dijk, D., Wang, Z., Gigante, S., Burkhardt, D. B., Chen, W. S., Yim, K., Elzen, A. V. D., Hirn, M. J., Coifman, R. R., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0336-3 · Cited by 1,065
Self-citationShape google: Geometric words and expressions for invariant shape retrieval
Bronstein, A. M., Bronstein, M. M., Guibas, L. J., & Ovsjanikov, M. (2011) · ACM Transactions on Graphics · doi:10.1145/1899404.1899405 · Cited by 810
Scale-invariant heat kernel signatures for non-rigid shape recognition
Bronstein, M. M., & Kokkinos, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539838 · Cited by 686
Missing data and technical variability in single-cell RNA-sequencing experiments
Hicks, S. C., Townes, F. W., Teng, M., & Irizarry, R. A. (2018) · Biostatistics · doi:10.1093/biostatistics/kxx053 · Cited by 635
Vos de Wael, R., Benkarim, O., Paquola, C., Lariviere, S., Royer, J., Tavakol, S., Xu, T., Hong, S.-J., Langs, G., Valk, S., et al. (2020) · Communications Biology · doi:10.1038/s42003-020-0794-7 · Cited by 653
(2015) · Chapman & Hall/CRC eBooks · doi:10.1201/b19706 · Cited by 643
Lafon, S., & Lee, A. B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.184 · Cited by 609
Self-citationModern Koopman Theory for Dynamical Systems
Brunton, S. L., Budišić, M., Kaiser, E., & Kutz, J. N. (2022) · SIAM Review · doi:10.1137/21m1401243 · Cited by 576
A review of predictive nonlinear theories for multiscale modeling of heterogeneous materials
Matouš, K., Geers, M. G. D., Kouznetsova, V. G., & Gillman, A. (2017) · Journal of Computational Physics · doi:10.1016/j.jcp.2016.10.070 · Cited by 493
Nonlocal Linear Image Regularization and Supervised Segmentation
Gilboa, G., & Osher, S. (2007) · Multiscale Modeling & Simulation · doi:10.1137/060669358 · Cited by 468
Transition states and cell fate decisions in epigenetic landscapes
Moris, N., Pina, C., & Arias, A. M. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.98 · Cited by 456
Lin, T., & Zha, H. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70735 · Cited by 446
Unsupervised Learning Methods for Molecular Simulation Data
Glielmo, A., Husic, B. E., Rodriguez, A., Clementi, C., Noé, F., & Laio, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.0c01195 · Cited by 402
Fuzzy spectral clustering by PCCA+: application to Markov state models and data classification
Röblitz, S., & Weber, M. (2013) · Advances in Data Analysis and Classification · doi:10.1007/s11634-013-0134-6 · Cited by 371
Linear Dimensionality Reduction: Survey, Insights, and Generalizations
Cunningham, J. P., & Ghahramani, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.0873 · Cited by 357
Angular synchronization by eigenvectors and semidefinite programming
Singer, A. (2011) · Applied and Computational Harmonic Analysis · doi:10.1016/j.acha.2010.02.001 · Cited by 329
Data Fusion and Multicue Data Matching by Diffusion Maps
Lafon, S., Keller, Y., & Coifman, R. R. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.223 · Cited by 312
Self-citationWhat Is High-Throughput Virtual Screening? A Perspective from Organic Materials Discovery
Pyzer-Knapp, E. O., Suh, C., Gómez-Bombarelli, R., Aguilera-Iparraguirre, J., & Aspuru-Guzik, A. (2015) · Annual Review of Materials Research · doi:10.1146/annurev-matsci-070214-020823 · Cited by 299
Geodesics in heat: A new approach to computing distance based on heat flow
Crane, K., Weischedel, C., & Wardetzky, M. (2013) · ACM Transactions on Graphics · doi:10.1145/2516971.2516977 · Cited by 297
Diffusion Maps, Spectral Clustering and Eigenfunctions of Fokker-Planck operators
Nadler, B., Lafon, S., Coifman, R. R., & Kevrekidis, I. G. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0506090 · Cited by 294
Self-citationEquation-Free Multiscale Computation: Algorithms and Applications
Kevrekidis, I. G., & Samaey, G. (2009) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.59.032607.093610 · Cited by 280
Self-citationDiffusion Maps, Reduction Coordinates, and Low Dimensional Representation of Stochastic Systems
Coifman, R. R., Kevrekidis, I. G., Lafon, S., Maggioni, M., & Nadler, B. (2008) · Multiscale Modeling & Simulation · doi:10.1137/070696325 · Cited by 279
Self-citationFrom Graphs to Manifolds – Weak and Strong Pointwise Consistency of Graph Laplacians
Hein, M., Audibert, J.-Y., & von Luxburg, U. (2005) · Lecture Notes in Computer Science · doi:10.1007/11503415_32 · Cited by 270
Ten quick tips for effective dimensionality reduction
Nguyen, L. H., & Holmes, S. (2019) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006907 · Cited by 270
Bronstein, A. M., Bronstein, M. M., Kimmel, R., Mahmoudi, M., & Sapiro, G. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0301-6 · Cited by 267
Multiscale modeling of emergent materials: biological and soft matter
Murtola, T., Bunker, A., Vattulainen, I., Deserno, M., & Karttunen, M. (2009) · Physical Chemistry Chemical Physics · doi:10.1039/b818051b · Cited by 264
Data-Driven Model Reduction and Transfer Operator Approximation
Klus, S., Nüske, F., Koltai, P., Wu, H., Kevrekidis, I., Schütte, C., & Noé, F. (2018) · Journal of Nonlinear Science · doi:10.1007/s00332-017-9437-7 · Cited by 263
Self-citationGlobal waves synchronize the brain’s functional systems with fluctuating arousal
Raut, R. V., Snyder, A. Z., Mitra, A., Yellin, D., Fujii, N., Malach, R., & Raichle, M. E. (2021) · Science Advances · doi:10.1126/sciadv.abf2709 · Cited by 260
Rohrdanz, M. A., Zheng, W., & Clementi, C. (2013) · Annual Review of Physical Chemistry · doi:10.1146/annurev-physchem-040412-110006 · Cited by 242
Quantifying the effect of experimental perturbations at single-cell resolution
Burkhardt, D. B., Stanley, J. S., Tong, A., Perdigoto, A. L., Gigante, S. A., Herold, K. C., Wolf, G., Giraldez, A. J., van Dijk, D., & Krishnaswamy, S. (2021) · Nature Biotechnology · doi:10.1038/s41587-020-00803-5 · Cited by 226
Using sketch-map coordinates to analyze and bias molecular dynamics simulations
Tribello, G. A., Ceriotti, M., & Parrinello, M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1201152109 · Cited by 202
Systematic determination of order parameters for chain dynamics using diffusion maps
Ferguson, A. L., Panagiotopoulos, A. Z., Debenedetti, P. G., & Kevrekidis, I. G. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1003293107 · Cited by 165
Self-citationMissing Data and Technical Variability in Single-Cell RNA-Sequencing Experiments
Hicks, S. C., Townes, F. W., Teng, M., & Irizarry, R. A. (2015) · doi:10.1101/025528 · Cited by 625
Dynamic quantum clustering: A method for visual exploration of structures in data
Weinstein, M., & Horn, D. (2009) · Physical Review E · doi:10.1103/physreve.80.066117 · Cited by 51
Uncovering axes of variation among single-cell cancer specimens
Chen, W. S., Zivanovic, N., van Dijk, D., Wolf, G., Bodenmiller, B., & Krishnaswamy, S. (2020) · Nature Methods · doi:10.1038/s41592-019-0689-z · Cited by 48
Mansbach, R. A., & Ferguson, A. L. (2015) · The Journal of Chemical Physics · doi:10.1063/1.4914144 · Cited by 39
Metadata
- Authors
- Nadler, B., Lafon, S., Coifman, R. R., & Kevrekidis, I. G.
- Venue
- Applied and Computational Harmonic Analysis
- Publisher
- Elsevier BV
- Published
- 2006-07
- Volume
- 21
- Issue
- 1
- Pages
- 113-127
- ISSN
- 1063-5203 (ISSN-L)
- OpenAlex
- W2117684310
- Cited by
- 990
- References
- 31
- FWCI
- 42.03
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.