Persistent Clustering and a Theorem of J. Kleinberg
Open accessAbstract
We construct a framework for studying clustering algorithms, which includes two key ideas: persistence and functoriality. The first encodes the idea that the output of a clustering scheme should carry a multiresolution structure, the second the idea that one should be able to compare the results of clustering algorithms as one varies the data set, for example by adding points or by applying functions to it. We show that within this framework, one can prove a theorem analogous to one of J. Kleinberg, in which one obtains an existence and uniqueness theorem instead of a non-existence result. We explore further properties of this unique scheme, stability and convergence are established.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
There is a unique Mgen-functorial persistent clustering algorithm Ξ that is scale invariant and satisfies Ξ(E)=P, where E is a metric space with two points at distance 1 and P is the persistent set with two points for r<1, one point for r≥1, and surjective maps.
“There is a unique M gen -functorial persistent clustering algorithm Ξ which is scale invariant and which satisfies the requirement that Ξ(E) = P .”
From Topology and data (2009) · cites this paper as [9]
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredIn [9], a context is developed that is not dependent on the choice of a cost function but is dependent on structural criteria similar to Kleinberg's requirements.
“In [9], such a context is developed which is not dependent on the choice of a cost function but is rather dependent on”
From Topology and data (2009) · cites this paper as [9]
The algorithm Ξ is the algorithm that associates to a finite metric space (X,dX) the persistent set {π0(VR(X,ε))}_{ε≥0}.
“The algorithm Ξ is the algorithm which associates to a finite metric space (X, d X ) the persistent set {π 0 (V R(X, ))} ≥0 .”
From Topology and data (2009) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602 · see citing works
A tutorial on spectral clustering
von Luxburg, U. (2007) · Statistics and Computing · doi:10.1007/s11222-007-9033-z · Cited by 10,519 · see citing works
Algorithms for Clustering Data
Sarle, W. S., Jain, A. K., & Dubes, R. C. (1990) · Technometrics · doi:10.2307/1268876 · Cited by 7,893 · see citing works
Burago, D., Burago, Y., & Ivanov, S. (2001) · Graduate Studies in Mathematics · doi:10.1090/gsm/033 · Cited by 2,598 · see citing works
Homotopy Limits, Completions and Localizations
Bousfield, A. K., & Kan, D. M. (1972) · Lecture notes in mathematics · doi:10.1007/978-3-540-38117-4 · Cited by 1,809 · see citing works
Barcodes: the persistent topology of data
Ghrist, R. (2007) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-07-01191-3 · Cited by 1,236 · cited 1× · see citing works
“However, there turns out to be (see below) a readily computable analogue of the persistence barcode, [ Ghr08 , ZC04].”
Background(1974) · Andalas University Repository (Andalas University) · Cited by 973 · see citing works
(2002) · Cited by 542 · see citing works
Topological Methods for the Analysis of High Dimensional Data Sets and 3D Object Recognition
Singh, G., Memoli, F., & Carlsson, G. (2007) · The Eurographics Association · doi:10.2312/spbg/spbg07/091-100 · Cited by 514 · see citing works
Self-citationOn the Local Behavior of Spaces of Natural Images
Carlsson, G., Ishkhanov, T., de Silva, V., & Zomorodian, A. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0056-x · Cited by 477 · see citing works
Self-citationRepresentations of Finite-Dimensional Algebras
Gabriel, P., & Roiter, A. V. (1997) · Encyclopaedia of Mathematical Sciences · doi:10.1007/978-3-642-58097-0 · Cited by 390 · see citing works
Six theorems about injective metric spaces
Isbell, J. R. (1964) · Commentarii Mathematici Helvetici · doi:10.1007/bf02566944 · Cited by 361 · see citing works
The theory of multidimensional persistence
Carlsson, G., & Zomorodian, A. (2007) · Proceedings of the twenty-third annual symposium on Computational geometry - SCG '07 · doi:10.1145/1247069.1247105 · Cited by 299 · see citing works
Self-citationZomorodian, A., & Carlsson, G. (2004) · Proceedings of the twentieth annual symposium on Computational geometry · doi:10.1145/997817.997870 · Cited by 264 · see citing works
Self-citationMcCullagh, P. (2002) · The Annals of Statistics · doi:10.1214/aos/1035844977 · Cited by 248 · cited 1× · see citing works
“In [ McC02 ], the idea of using categorical and functorial ideas in statistics has been proposed as a formalism for defining what is meant by statistical models.”
BackgroundA Sober Look at Clustering Stability
Ben-David, S., von Luxburg, U., & Pál, D. (2006) · Lecture notes in computer science · doi:10.1007/11776420_4 · Cited by 221 · see citing works
Consistency of Single Linkage for High-Density Clusters
Hartigan, J. A. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477658 · Cited by 195 · see citing works
Approaches for measuring the stability of clustering methods
Raghavan, V. V. (1982) · ACM SIGIR Forum · doi:10.1145/1095460.1095461 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Carlsson, G. (2009) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-09-01249-x · Cited by 2,302 · see citing works
Self-citationPersistent Brain Network Homology From the Perspective of Dendrogram
Lee, H.-K., Kang, H., Chung, M. K., Kim, B.-N., & Lee, D. S. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2219590 · Cited by 260 · see citing works
Characterization, Stability and Convergence of Hierarchical Clustering MethodsPreprint
Carlsson, G., & Mémoli, F. (2010) · Cited by 239 · see citing works
Self-citationPersistent Homology in Sparse Regression and Its Application to Brain Morphometry
Chung, M. K., Hanson, J. L., Ye, J., Davidson, R. J., & Pollak, S. D. (2014) · Cited by 77 · see citing works
Exact topological inference of the resting-state brain networks in twins
Chung, M. K., Lee, H., DiChristofano, A., Ombao, H., & Solo, V. (2019) · Network Neuroscience · doi:10.1162/netn_a_00091 · Cited by 63 · see citing works
Classifying Clustering Schemes
Carlsson, G., & Mémoli, F. (2013) · Foundations of Computational Mathematics · doi:10.1007/s10208-012-9141-9 · Cited by 63 · see citing works
Self-citationA functorial Dowker theorem and persistent homology of asymmetric networks
Chowdhury, S., & Mémoli, F. (2018) · Journal of Applied and Computational Topology · doi:10.1007/s41468-018-0020-6 · Cited by 57 · see citing works
Integrated multimodal network approach to PET and MRI based on multidimensional persistent homology
Lee, H., Kang, H., Chung, M. K., Lim, S., Kim, B., & Lee, D. S. (2016) · Human Brain Mapping · doi:10.1002/hbm.23461 · Cited by 47 · see citing works
Connectivity in fMRI: Blind Spots and Breakthroughs
Solo, V., Poline, J., Lindquist, M. A., Simpson, S. L., Bowman, F. D., Chung, M. K., & Cassidy, B. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2831261 · Cited by 40 · see citing works
Kuang, L., Han, X., Chen, K., Caselli, R. J., Reiman, E. M., Wang, Y., & Initiative, A. D. N. (2018) · Human Brain Mapping · doi:10.1002/hbm.24383 · Cited by 33 · see citing works
Multiparameter Hierarchical Clustering Methods
Carlsson, G., & Mémoli, F. (2010) · Studies in classification, data analysis, and knowledge organization · doi:10.1007/978-3-642-10745-0_6 · Cited by 31 · see citing works
Self-citationA fast algorithm for constructing topological structure in large data
Liu, X., Xie, Z. Y., & Yi, D. (2012) · Homology Homotopy and Applications · doi:10.4310/hha.2012.v14.n1.a11 · Cited by 30 · see citing works
Statistical Inference on the Number of Cycles in Brain Networks
Chung, M. K., Huang, S.-G., Gritsenko, A., Shen, L., & Lee, H. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759222 · Cited by 22 · see citing works
Ghahremani, M., Yoo, J., Chung, S. J., Yoo, K., Ye, J. C., & Jeong, Y. (2018) · Journal of Movement Disorders · doi:10.14802/jmd.17061 · Cited by 15 · see citing works
Chung, M. K., Garcia‐Ramos, C., de Paiva, F. B., Mathis, J. R., Prabhakaran, V., Nair, V. A., Meyerand, M. E., Hermann, B. P., Binder, J. R., & Struck, A. F. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120436 · Cited by 11 · see citing works
On the Properties of α-Unchaining Single Linkage Hierarchical Clustering
Martínez-Pérez, Á. (2016) · Journal of Classification · doi:10.1007/s00357-016-9198-2 · Cited by 10 · see citing works
Category Theory in Machine LearningPreprint
Shiebler, D., Gavranović, B., & Wilson, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.07032 · Cited by 10 · see citing works
A Density-Sensitive Hierarchical Clustering Method
Martínez-Pérez, Á. (2018) · Journal of Classification · doi:10.1007/s00357-018-9266-x · Cited by 9 · see citing works
Dynamic topological data analysis of functional human brain networks
Chung, M. K., Das, S. R., & Ombao, H. (2023) · Foundations of Data Science · doi:10.3934/fods.2023013 · Cited by 8 · see citing works
Hierarchically clustered navigation of distinct Euclidean particles
Arslan, Ö., Guralnik, D. P., & Koditschek, D. E. (2012) · Allerton Conference on Communication, Control, and Computing · doi:10.1109/allerton.2012.6483320 · Cited by 8 · see citing works
Chung, M. K., Azizi, T., Hanson, J. L., Alexander, A. L., Pollak, S. D., & Davidson, R. J. (2023) · Network Neuroscience · doi:10.1162/netn_a_00355 · Cited by 6 · see citing works
Topological Distances between Networks and Its Application to Brain ImagingPreprint
Lee, H., Ma, Z., Wang, Y., & Chung, M. K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.04171 · Cited by 6 · see citing works
Metric Structures on Datasets: Stability and Classification of Algorithms
Mémoli, F. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23678-5_1 · Cited by 4 · see citing works
Towards continuous consistency axiom
Kłopotek, M. A., & Kłopotek, R. A. (2022) · Applied Intelligence · doi:10.1007/s10489-022-03710-1 · Cited by 3 · see citing works
Statistical estimation for Single Linkage Hierarchical Clustering
Zhu, D., Dan, G., Wang, X., Li, X., & Moran, B. (2015) · IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems · doi:10.1109/cyber.2015.7288035 · Cited by 2 · see citing works
Topological Brain Network DistancesPreprint
Chung, M. K., Lee, H., Gritsenko, A., DiChristofano, A., Pluta, D., Ombao, H., & Solo, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03878 · Cited by 2 · see citing works
Linear Embedding of Large-Scale Brain Networks for Twin fMRI.Preprint
Chung, M. K., Villalta‐Gil, V., Rathouz, P. J., Lahey, B. B., & Zald, D. H. (2015) · arXiv (Cornell University) · Cited by 1 · see citing works
- Authors
- Carlsson, G., & Memoli, F.
- ORCID
- Carlsson, Gunnar
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2008
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 0808.2241
- OpenAlex
- W1659060676
- Cited by
- 28
- References
- 18
- Citations by year
- 2023: 3 · 2022: 1 · 2021: 1 · 2019: 2 · 2018: 6 · 2017: 1 · 2016: 2 · 2015: 2 · 2014: 1 · 2013: 1 · 2012: 4
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Clustering Algorithms Research
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Topological and Geometric Data Analysis
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- clustering algorithms, persistence, functoriality, existence and uniqueness of solutions, stability, convergence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review