Selecting single cell clustering parameter values using subsampling-based robustness metrics
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Background: Generating and analysing single-cell data has become a widespread approach to examine tissue heterogeneity, and numerous algorithms exist for clustering these datasets to identify putative cell types with shared transcriptomic signatures. However, many of these clustering workflows rely on user-tuned parameter values, tailored to each dataset, to identify a set of biologically relevant clusters. Whereas users often develop their own intuition as to the optimal range of parameters for clustering on each data set, the lack of systematic approaches to identify this range can be daunting to new users of any given workflow. In addition, an optimal parameter set does not guarantee that all clusters are equally well-resolved, given the heterogeneity in transcriptomic signatures in most biological systems. Results: Here, we illustrate a subsampling-based approach (chooseR) that simultaneously guides parameter selection and characterizes cluster robustness. Through bootstrapped iterative clustering across a range of parameters, chooseR was used to select parameter values for two distinct clustering workflows (Seurat and scVI). In each case, chooseR identified parameters that produced biologically relevant clusters from both well-characterized (human PBMC) and complex (mouse spinal cord) datasets. Moreover, it provided a simple “robustness score” for each of these clusters, facilitating the assessment of cluster quality. Conclusion: chooseR is a simple, conceptually understandable tool that can be used flexibly across clustering algorithms, workflows, and datasets to guide clustering parameter selection and characterize cluster robustness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881
From Louvain to Leiden: guaranteeing well-connected communities
Traag, V. A., Waltman, L., & van Eck, N. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-41695-z · Cited by 5,635
Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq
Zeisel, A., Muñoz-Manchado, A. B., Codeluppi, S., Lönnerberg, P., La Manno, G., Juréus, A., Marques, S., Munguba, H., He, L., Betsholtz, C., et al. (2015) · Science · doi:10.1126/science.aaa1934 · Cited by 3,124
Deep generative modeling for single-cell transcriptomics
Lopez, R., Regier, J., Cole, M. B., Jordan, M. I., & Yosef, N. (2018) · Nature Methods · doi:10.1038/s41592-018-0229-2 · Cited by 2,530
Adult mouse cortical cell taxonomy revealed by single cell transcriptomics
Tasic, B., Menon, V., Nguyen, T. N., Kim, T. K., Jarsky, T., Yao, Z., Levi, B., Gray, L. T., Sorensen, S. A., Dolbeare, T., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4216 · Cited by 1,714
Self-citationSC3: consensus clustering of single-cell RNA-seq data
Kiselev, V. Y., Kirschner, K., Schaub, M. T., Andrews, T., Yiu, A., Chandra, T., Natarajan, K. N., Reik, W., Barahona, M., Green, A. R., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4236 · Cited by 1,500
Single-cell profiling of the developing mouse brain and spinal cord with split-pool barcoding
Rosenberg, A. B., Roco, C. M., Muscat, R. A., Kuchina, A., Sample, P., Yao, Z., Graybuck, L. T., Peeler, D. J., Mukherjee, S., Chen, W., et al. (2018) · Science · doi:10.1126/science.aam8999 · Cited by 1,422
Comprehensive Classification of Retinal Bipolar Neurons by Single-Cell Transcriptomics
Shekhar, K., Lapan, S. W., Whitney, I. E., Tran, N. M., Macosko, E. Z., Kowalczyk, M., Adiconis, X., Levin, J. Z., Nemesh, J., Goldman, M., et al. (2016) · Cell · doi:10.1016/j.cell.2016.07.054 · Cited by 1,176
Massively parallel single-nucleus RNA-seq with DroNc-seq
Habib, N., Avraham-Davidi, I., Basu, A., Burks, T., Shekhar, K., Hofree, M., Choudhury, S. R., Aguet, F., Gelfand, E., Ardlie, K., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4407 · Cited by 1,069
Integrative single-cell analysis of transcriptional and epigenetic states in the human adult brain
Lake, B. B., Chen, S., Sos, B. C., Fan, J., Kaeser, G. E., Yung, Y. C., Duong, T. E., Gao, D., Chun, J., Kharchenko, P. V., et al. (2018) · Nature Biotechnology · doi:10.1038/nbt.4038 · Cited by 983
Cited by
A harmonized atlas of mouse spinal cord cell types and their spatial organization
Russ, D. E., Cross, R. B. P., Li, L., Koch, S. C., Matson, K. J. E., Yadav, A., Alkaslasi, M. R., Lee, D. I., Le Pichon, C. E., Menon, V., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-25125-1 · Cited by 255
Self-citationHematopoietic stem cell heterogeneity and age-associated platelet bias are evolutionarily conserved
Aksöz, M., Gafencu, G.-A., Stoilova, B., Buono, M., Zhang, Y., Turkalj, S., Meng, Y., Jakobsen, N. A., Metzner, M., Clark, S.-A., et al. (2024) · Science Immunology · doi:10.1126/sciimmunol.adk3469 · Cited by 40
Hachey, S. J., Hatch, C. J., Gaebler, D., Mocherla, A., Nee, K., Kessenbrock, K., & Hughes, C. C. W. (2024) · Breast Cancer Research · doi:10.1186/s13058-023-01760-y · Cited by 24
“A modified version of the chooseR R package [66] was used to generate silhouette scores for selecting the resolution.”
Method
Metadata
- Authors
- Patterson-Cross, R. B., Levine, A. J., & Menon, V.
- Venue
- BMC Bioinformatics
- Published
- 2021-02-01
- Volume
- 22
- Issue
- 1
- Pages
- 39-39
- ISSN
- 1471-2105 (ISSN-L)
- OpenAlex
- W3128290568
- Cited by
- 81
- References
- 12
- FWCI
- 4.16
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Selecting single cell clustering parameter values using subsampling-based robustness metrics. https://app.cochat.ai/papers/10.1186/s12859-021-03957-4
- The paper
- Patterson-Cross, R. B., Levine, A. J., & Menon, V. (2021). Selecting single cell clustering parameter values using subsampling-based robustness metrics. BMC Bioinformatics. https://doi.org/10.1186/s12859-021-03957-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.