clusterExperiment and RSEC: A Bioconductor package and framework for clustering of single-cell and other large gene expression datasets
Open accessPublished version of a preprint
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Clustering of genes and/or samples is a common task in gene expression analysis. The goals in clustering can vary, but an important scenario is that of finding biologically meaningful subtypes within the samples. This is an application that is particularly appropriate when there are large numbers of samples, as in many human disease studies. With the increasing popularity of single-cell transcriptome sequencing (RNA-Seq), many more controlled experiments on model organisms are similarly creating large gene expression datasets with the goal of detecting previously unknown heterogeneity within cells. It is common in the detection of novel subtypes to run many clustering algorithms, as well as rely on subsampling and ensemble methods to improve robustness. We introduce a Bioconductor R package, clusterExperiment, that implements a general and flexible strategy we entitle Resampling-based Sequential Ensemble Clustering (RSEC). RSEC enables the user to easily create multiple, competing clusterings of the data based on different techniques and associated tuning parameters, including easy integration of resampling and sequential clustering, and then provides methods for consolidating the multiple clusterings into a final consensus clustering. The package is modular and allows the user to separately apply the individual components of the RSEC procedure, i.e., apply multiple clustering algorithms, create a consensus clustering or choose tuning parameters, and merge clusters. Additionally, clusterExperiment provides a variety of visualization tools for the clustering process, as well as methods for the identification of possible cluster signatures or biomarkers. The R package clusterExperiment is publicly available through the Bioconductor Project, with a detailed manual (vignette) as well as well documented help pages for each function.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
Finak, G., McDavid, A., Yajima, M., Deng, J., Gersuk, V., Shalek, A. K., Slichter, C. K., Miller, H. W., McElrath, M. J., Prlic, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0844-5 · Cited by 3,159
Slingshot: cell lineage and pseudotime inference for single-cell transcriptomics
Street, K., Risso, D., Fletcher, R. B., Das, D., Ngai, J., Yosef, N., Purdom, E., & Dudoit, S. (2018) · BMC Genomics · doi:10.1186/s12864-018-4772-0 · Cited by 3,159
Self-citationMonti, S., Tamayo, P., Mesirov, J., & Golub, T. (2003) · Machine Learning · doi:10.1023/a:1023949509487 · Cited by 2,116
SC3: consensus clustering of single-cell RNA-seq data
Kiselev, V. Y., Kirschner, K., Schaub, M. T., Andrews, T., Yiu, A., Chandra, T., Natarajan, K. N., Reik, W., Barahona, M., Green, A. R., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4236 · Cited by 1,500
Single-cell messenger RNA sequencing reveals rare intestinal cell types
Grün, D., Lyubimova, A., Kester, L., Wiebrands, K., Basak, O., Sasaki, N., Clevers, H., & van Oudenaarden, A. (2015) · Nature · doi:10.1038/nature14966 · Cited by 1,234
Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis
Efron, B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000089 · Cited by 1,005
Single-Cell RNA-Seq with Waterfall Reveals Molecular Cascades underlying Adult Neurogenesis
Shin, J., Berg, D. A., Zhu, Y., Shin, J. Y., Song, J., Bonaguidi, M. A., Enikolopov, G., Nauen, D. W., Christian, K. M., Ming, G.-L., et al. (2015) · Cell Stem Cell · doi:10.1016/j.stem.2015.07.013 · Cited by 784
Single-Cell RNA-Seq Reveals Hypothalamic Cell Diversity
Chen, R., Wu, X., Jiang, L., & Zhang, Y. (2017) · Cell Reports · doi:10.1016/j.celrep.2017.03.004 · Cited by 592
Identification of cell types from single-cell transcriptomes using a novel clustering method
Xu, C., & Su, Z. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv088 · Cited by 559
Observation weights unlock bulk RNA-seq tools for zero inflation and single-cell applications
Van den Berge, K., Perraudeau, F., Soneson, C., Love, M. I., Risso, D., Vert, J.-P., Robinson, M. D., Dudoit, S., & Clement, L. (2018) · Genome Biology · doi:10.1186/s13059-018-1406-4 · Cited by 228
Self-citation
Research works printed but not linked: 24
- J Žurauskienė, 2016, pcaReduce: hierarchical clustering of single cell transcriptional profiles, BMC Bioinformatics, 17, 140, 10.1186/s12859-016-0984-y · DOI · Paper page
- EZ Macosko, 2015, Highly Parallel Genome-wide Expression Profiling of Individual Cells Using Nanoliter Droplets, Cell, 161, 1202, 10.1016/j.cell.2015.05.002 · DOI · Paper page
- V Ntranos, 2016, Fast and accurate single-cell RNA-seq analysis by clustering of transcript-compatibility counts, Genome biology, 17, 1396, 10.1186/s13059-016-0970-8 · DOI · Paper page
- M Guo, 2015, SINCERA: A Pipeline for Single-Cell RNA-Seq Profiling Analysis, PLoS computational biology, 11, e1004575, 10.1371/journal.pcbi.1004575 · DOI · Paper page
- GC Tseng, 2005, Tight clustering: a resampling-based approach for identifying stable and tight patterns in data, Biometrics, 61, 10, 10.1111/j.0006-341X.2005.031032.x · DOI · Paper page
- Abul O, Lo A, Alhajj R, Systems FP, and M, 2003. Cluster validity analysis using subsampling. In: 44th Hawaii International Conference on System Sciences; 2003.
- Li HG, Wu GQ, Hu XG, Zhang J, Li L, Wu X. K-means clustering with bagging and mapreduce. In: 44th Hawaii International Conference on System Sciences; 2011.
- J Jia, 2011, Bagging-based spectral clustering ensemble selection, Pattern Recognition Letters, 32, 1456, 10.1016/j.patrec.2011.04.008 · DOI
- B Minaei-Bidgoli, 2011, Effects of resampling method and adaptation on clustering ensemble efficacy, Artificial Intelligence Review, 41, 27, 10.1007/s10462-011-9295-x · DOI
- M Smolkin, 2003, Cluster stability scores for microarray data in cancer studies, BMC Bioinformatics, 4, 36, 10.1186/1471-2105-4-36 · DOI
- S Dudoit, 2003, Bagging to improve the accuracy of a clustering procedure, Bioinformatics, 19, 1090, 10.1093/bioinformatics/btg038 · DOI · Paper page
- R Tibshirani, 2012, Cluster Validation by Prediction Strength, Journal of Computational and Graphical Statistics, 14, 511, 10.1198/106186005X59243 · DOI · Paper page
- MD Robinson, 2010, edgeR: a Bioconductor package for differential expression analysis of digital gene expression data, Bioinformatics (Oxford, England), 26, 139, 10.1093/bioinformatics/btp616 · DOI · Paper page
- J Storey, 2002, A Direct Approach to False Discovery Rates, Journal of the Royal Statistical Society Series B (Statistical Methodology), 64, 479, 10.1111/1467-9868.00346 · DOI · Paper page
- S Pounds, 2004, Improving false discovery rate estimation, Bioinformatics (Oxford, England), 20, 1737, 10.1093/bioinformatics/bth160 · DOI · Paper page
- N Meinshausen, 2005, Lower bounds for the number of false null hypotheses for multiple testing of associations under general dependence structures, Biometrika, 92, 893, 10.1093/biomet/92.4.893 · DOI
- Jiashun Jin, 2007, Estimating the Null and the Proportion of Nonnull Effects in Large-Scale Multiple Comparisons, Journal of the American Statistical Association, 102, 495, 10.1198/016214507000000167 · DOI
- CW Law, 2014, voom: Precision weights unlock linear model analysis tools for RNA-seq read counts, Genome Biology, 15, R29, 10.1186/gb-2014-15-2-r29 · DOI · Paper page
- R Gaujoux, 2010, A flexible R package for nonnegative matrix factorization, BMC Bioinformatics, 11, 367, 10.1186/1471-2105-11-367 · DOI · Paper page
- MD Wilkerson, 2010, ConsensusClusterPlus: a class discovery tool with confidence assessments and item tracking, Bioinformatics (Oxford, England), 26, 1572, 10.1093/bioinformatics/btq170 · DOI · Paper page
- RB Fletcher, 2017, Deconstructing Olfactory Stem Cell Trajectories at Single-Cell Resolution, Cell stem cell, 20, 817, 10.1016/j.stem.2017.04.003 · DOI · Paper page
- A Butler, 2018, Integrating single-cell transcriptomic data across different conditions, technologies, and species, Nature Biotechnology
- Z Ji, 2016, TSCAN: Pseudo-time reconstruction and evaluation in single-cell RNA-seq analysis, Nucleic acids research, 44, e117, 10.1093/nar/gkw430 · DOI · Paper page
- F Perraudeau, 2017, Bioconductor workflow for single-cell RNA sequencing: Normalization, dimensionality reduction, clustering, and lineage inference, F1000Research, 6, 10.12688/f1000research.12122.1 · DOI
Cited by
Slingshot: cell lineage and pseudotime inference for single-cell transcriptomics
Street, K., Risso, D., Fletcher, R. B., Das, D., Ngai, J., Yosef, N., Purdom, E., & Dudoit, S. (2018) · BMC Genomics · doi:10.1186/s12864-018-4772-0 · Cited by 3,159
Self-citationBrann, D. H., Tsukahara, T., Weinreb, C., Lipovsek, M., Van den Berge, K., Gong, B., Chance, R., Macaulay, I. C., Chou, H.-J., Fletcher, R. B., et al. (2020) · Science Advances · doi:10.1126/sciadv.abc5801 · Cited by 1,198
Self-citationHabermann, A. C., Gutierrez, A. J., Bui, L. T., Yahn, S. L., Winters, N. I., Calvi, C. L., Peter, L., Chung, M.-I., Taylor, C. J., Jetter, C., et al. (2020) · Science Advances · doi:10.1126/sciadv.aba1972 · Cited by 1,129
Orchestrating single-cell analysis with Bioconductor
Amezquita, R. A., Lun, A. T. L., Becht, E., Carey, V. J., Carpp, L. N., Geistlinger, L., Marini, F., Rue-Albrecht, K., Risso, D., Soneson, C., et al. (2020) · Nature Methods · doi:10.1038/s41592-019-0654-x · Cited by 945
Self-citationTrajectory-based differential expression analysis for single-cell sequencing data
Van den Berge, K., Roux de Bézieux, H., Street, K., Saelens, W., Cannoodt, R., Saeys, Y., Dudoit, S., & Clement, L. (2020) · Nature Communications · doi:10.1038/s41467-020-14766-3 · Cited by 828
Self-citation
Metadata
- Authors
- Risso, D., Purvis, L., Fletcher, R. B., Das, D., Ngai, J., Dudoit, S., & Purdom, E.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-09-04
- Volume
- 14
- Issue
- 9
- Pages
- e1006378
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2951337536
- Cited by
- 63
- References
- 12
- FWCI
- 2.67
- Type
- journal article
- Language
- en
- Update notices
- Open access
- gold
- Funders
- National Institutes of Health (U19 MH114830, U01 MH105979)
- National Institutes of Health (US) (U19 MH114830, U01 MH105979)
- Chan Zuckerberg Initiative DAF (2018-183201)
- The Chan Zuckerberg Initiative DAF (2018-183201)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.