SAFE-clustering: Single-cell Aggregated (from Ensemble) clustering for single-cell RNA-seq data
Open accessPublished version of a preprint
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Motivation: Accurately clustering cell types from a mass of heterogeneous cells is a crucial first step for the analysis of single-cell RNA-seq (scRNA-Seq) data. Although several methods have been recently developed, they utilize different characteristics of data and yield varying results in terms of both the number of clusters and actual cluster assignments. Results: Here, we present SAFE-clustering, single-cell aggregated (From Ensemble) clustering, a flexible, accurate and robust method for clustering scRNA-Seq data. SAFE-clustering takes as input, results from multiple clustering methods, to build one consensus solution. SAFE-clustering currently embeds four state-of-the-art methods, SC3, CIDR, Seurat and t-SNE + k-means; and ensembles solutions from these four methods using three hypergraph-based partitioning algorithms. Extensive assessment across 12 datasets with the number of clusters ranging from 3 to 14, and the number of single cells ranging from 49 to 32, 695 showcases the advantages of SAFE-clustering in terms of both cluster number (18.2–58.1% reduction in absolute deviation to the truth) and cluster assignment (on average 36.0% improvement, and up to 18.5% over the best of the four methods, measured by adjusted rand index). Moreover, SAFE-clustering is computationally efficient to accommodate large datasets, taking <10 min to process 28 733 cells. Availability and implementation: SAFEclustering, including source codes and tutorial, is freely available at https://github.com/yycunc/SAFEclustering. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881
Hubert, L., & Arabie, P. (1985) · Journal of Classification · doi:10.1007/bf01908075 · Cited by 8,219
Massively parallel digital transcriptional profiling of single cells
Zheng, G. X. Y., Terry, J. M., Belgrader, P., Ryvkin, P., Bent, Z. W., Wilson, R., Ziraldo, S. B., Wheeler, T. D., McDermott, G. P., Zhu, J., et al. (2017) · Nature Communications · doi:10.1038/ncomms14049 · Cited by 7,353
Trapnell, C., Cacchiarelli, D., Grimsby, J., Pokharel, P., Li, S., Morse, M., Lennon, N. J., Livak, K. J., Mikkelsen, T. S., & Rinn, J. L. (2014) · Nature Biotechnology · doi:10.1038/nbt.2859 · Cited by 7,314
Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets.
Macosko, E. Z., Basu, A., Satija, R., Nemesh, J., Shekhar, K., Goldman, M., Tirosh, I., Bialas, A. R., Kamitaki, N., Martersteck, E. M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.002 · Cited by 7,110
Spatial reconstruction of single-cell gene expression data
Satija, R., Farrell, J. A., Gennert, D., Schier, A. F., & Regev, A. (2015) · Nature Biotechnology · doi:10.1038/nbt.3192 · Cited by 7,055
Population Structure and Eigenanalysis
Patterson, N., Price, A. L., & Reich, D. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020190 · Cited by 5,280
Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq
Zeisel, A., Muñoz-Manchado, A. B., Codeluppi, S., Lönnerberg, P., La Manno, G., Juréus, A., Marques, S., Munguba, H., He, L., Betsholtz, C., et al. (2015) · Science · doi:10.1126/science.aaa1934 · Cited by 3,124
Massively parallel single-cell RNA-seq for marker-free decomposition of tissues into cell types
Jaitin, D. A., Kenigsberg, E., Keren-Shaul, H., Elefant, N., Paul, F., Zaretsky, I., Mildner, A., Cohen, N., Jung, S., Tanay, A., et al. (2014) · Science · doi:10.1126/science.1247651 · Cited by 1,795
Single-cell RNA-Seq profiling of human preimplantation embryos and embryonic stem cells
Yan, L., Yang, M., Guo, H., Yang, L., Wu, J., Li, R., Liu, P., Lian, Y., Zheng, X., Yan, J., et al. (2013) · Nature Structural & Molecular Biology · doi:10.1038/nsmb.2660 · Cited by 1,740
Research works printed but not linked: 27
- Arsenio, 2014, Early specification of CD8+ T lymphocyte fates during adaptive immunity revealed by single-cell gene-expression analyses, Nat. Immunol, 15, 365, 10.1038/ni.2842 · DOI · Paper page
- Biase, 2014, Cell fate inclination within 2-cell and 4-cell mouse embryos revealed by single-cell RNA sequencing, Genome Res, 24, 1787, 10.1101/gr.177725.114 · DOI · Paper page
- Buganim, 2012, Single-cell expression analyses during cellular reprogramming reveal an early stochastic and a late hierarchic phase, Cell, 150, 1209, 10.1016/j.cell.2012.08.023 · DOI · Paper page
- Calinski, 1974, A dendrite method for cluster analysis, Commun. Stat. Methods, 3, 1, 10.1080/03610927408827101 · DOI · Paper page
- Darmanis, 2015, A survey of human brain transcriptome diversity at the single cell level, Proc. Natl. Acad. Sci, 112, 7285, 10.1073/pnas.1507125112 · DOI · Paper page
- Freytag, 2017, Cluster headache: comparing clustering tools for 10X single cell sequencing data, bioRxiv
- Ghosh, 2011, Cluster ensembles, WIREs Data Mining Knowl. Discov, 1, 305, 10.1002/widm.32 · DOI · Paper page
- Hubner, 2005, High-resolution protein folding with a transferable potential, Proc. Natl. Acad. Sci. USA, 102, 18914, 10.1073/pnas.0502181102 · DOI
- Jia, 2017, Accounting for technical noise in differential expression analysis of single-cell RNA sequencing data, Nucleic Acids Res, 45, 10978, 10.1093/nar/gkx754 · DOI
- Kalisky, 2011, Single-cell genomics, Nat. Methods, 8, 311, 10.1038/nmeth0411-311 · DOI · Paper page
- Karypis, 1999, Multilevel hypergraph partitioning: applications in VLSI domain, IEEE Trans. Very Large Scale Integr. Syst, 7, 69, 10.1109/92.748202 · DOI · Paper page
- Karypis, 1998, A fast and high quality multilevel scheme for partitioning irregular graphs, SIAM J. Sci. Comput, 20, 359, 10.1137/S1064827595287997 · DOI · Paper page
- Kuepfer, 2007, Ensemble modeling for analysis of cell signaling dynamics, Nat. Biotechnol, 25, 1001, 10.1038/nbt1330 · DOI · Paper page
- Lin, 2017, CIDR: ultrafast and accurate clustering through imputation for single-cell RNA-seq data, Genome Biol, 18, 59., 10.1186/s13059-017-1188-0 · DOI · Paper page
- Mahata, 2014, Single-cell RNA sequencing reveals T helper cells synthesizing steroids de novo to contribute to immune homeostasis, Cell Rep, 7, 1130, 10.1016/j.celrep.2014.04.011 · DOI · Paper page
- Punera, 2008, Consensus-based ensembles of soft clusterings, Appl. Artif. Intell, 22, 780, 10.1080/08839510802170546 · DOI
- Shin, 2015, Single-cell RNA-seq with waterfall reveals molecular cascades underlying adult neurogenesis, Cell Stem Cell, 17, 360, 10.1016/j.stem.2015.07.013 · DOI · Paper page
- Strehl, 2002, Aaai/Iaai, 93
- Sun, 2018, DIMM-SC: a Dirichlet mixture model for clustering droplet-based single cell transcriptomic data, Bioinformatics, 34, 139, 10.1093/bioinformatics/btx490 · DOI
- Tang, 2010, Tracing the derivation of embryonic stem cells from the inner cell mass by single-cell RNA-Seq analysis, Cell Stem Cell, 6, 468, 10.1016/j.stem.2010.03.015 · DOI · Paper page
- Ting, 2014, Single-cell RNA sequencing identifies extracellular matrix gene expression by pancreatic circulating tumor cells, Cell Rep, 8, 1905, 10.1016/j.celrep.2014.08.029 · DOI · Paper page
- Tracy, 1994, Level-spacing distributions and the Airy kernel, Commun. Math. Phys, 159, 151, 10.1007/BF02100489 · DOI · Paper page
- Van der Maaten, 2008, Visualizing data using t-sne, J. Mach. Learn. Res, 9, 2579
- Wang, 2017, Visualization and analysis of single-cell RNA-seq data by kernel-based similarity learning, Nat. Methods, 14, 414, 10.1038/nmeth.4207 · DOI · Paper page
- Wang, 2017, Fast clustering using adaptive density peak detection, Stat. Methods Med. Res, 26, 2800, 10.1177/0962280215609948 · DOI
- Zhang, 2018, An interpretable framework for clustering single-cell RNA-Seq datasets, BMC Bioinformatics, 19, 93, 10.1186/s12859-018-2092-7 · DOI · Paper page
- Zhu, 2017, A unified statistical framework for single cell and bulk RNA sequencing data, bioRxiv, 206532
Cited by
A systematic performance evaluation of clustering methods for single-cell RNA-seq data
Duò, A., Robinson, M. D., & Soneson, C. (2018) · F1000Research · doi:10.12688/f1000research.15666.2 · Cited by 296
CHOIR improves significance-based detection of cell types and states from single-cell data
Sant, C., Mucke, L., & Corces, M. R. (2025) · Nature Genetics · doi:10.1038/s41588-025-02148-8 · Cited by 18
Metadata
- Authors
- Yang, Y., Huh, R., Culpepper, H. W., Lin, Y., Love, M. I., & Li, Y.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-09-08
- Volume
- 35
- Issue
- 8
- Pages
- 1269-1277
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2949329924
- Cited by
- 129
- References
- 20
- FWCI
- 4.08
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Funders
- National Institutes of Health (R01HG006292, R01HL129132, P01CA142538)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: SAFE-clustering: Single-cell Aggregated (from Ensemble) clustering for single-cell RNA-seq data. https://app.cochat.ai/papers/10.1093/bioinformatics/bty793
- The paper
- Yang, Y., Huh, R., Culpepper, H. W., Lin, Y., Love, M. I., & Li, Y. (2019). SAFE-clustering: Single-cell Aggregated (from Ensemble) clustering for single-cell RNA-seq data. Bioinformatics. https://doi.org/10.1093/bioinformatics/bty793
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.