Combinatorial prediction of marker panels from single‐cell transcriptomic data
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Single-cell transcriptomic studies are identifying novel cell populations with exciting functional roles in various in vivo contexts, but identification of succinct gene marker panels for such populations remains a challenge. In this work, we introduce COMET, a computational framework for the identification of candidate marker panels consisting of one or more genes for cell populations of interest identified with single-cell RNA-seq data. We show that COMET outperforms other methods for the identification of single-gene panels and enables, for the first time, prediction of multi-gene marker panels ranked by relevance. Staining by flow cytometry assay confirmed the accuracy of COMET's predictions in identifying marker panels for cellular subtypes, at both the single- and multi-gene levels, validating COMET's applicability and accuracy in predicting favorable marker panels from transcriptomic input. COMET is a general non-parametric statistical framework and can be used as-is on various high-throughput datasets in addition to single-cell RNA-sequencing data. COMET is available for use via a web interface (http://www.cometsc.com/) or a stand-alone software package (https://github.com/MSingerLab/COMETSC).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881 · cited 1×
“single-cell RNA-seq Subject Categories Chromatin, Transcription & Genomics; Computational Biology DOI 10.15252/msb.20199005 | Received 14 May 2019 | Revised 18 September 2019 | Accepted 20 September 2019 Mol Syst Biol. (2019) 15: e9005 Introduction”
BackgroundInfluentialSpatial reconstruction of single-cell gene expression data
Satija, R., Farrell, J. A., Gennert, D., Schier, A. F., & Regev, A. (2015) · Nature Biotechnology · doi:10.1038/nbt.3192 · Cited by 7,055
Self-citationFinak, G., McDavid, A., Yajima, M., Deng, J., Gersuk, V., Shalek, A. K., Slichter, C. K., Miller, H. W., McElrath, M. J., Prlic, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0844-5 · Cited by 3,159 · cited 1×
“COMET was compared to several gene differential expression (DE) tests frequently used to identify single-gene marker panels (Finak et al , 2015; Satija et al , 2015; Ntranos et al , 2019).”
Simultaneous epitope and transcriptome measurement in single cells
Stoeckius, M., Hafemeister, C., Stephenson, W., Houck-Loomis, B., Chattopadhyay, P. K., Swerdlow, H., Satija, R., & Smibert, P. (2017) · Nature Methods · doi:10.1038/nmeth.4380 · Cited by 3,098
Single-cell transcriptomics of 20 mouse organs creates a Tabula Muris
The Tabula Muris Consortium, coordination, O., coordination, L., processing, O. C. A., sequencing, L. P. A., analysis, C. D., annotation, C. T., Writing group, Supplemental text writing group, & Principal investigators (2018) · Nature · doi:10.1038/s41586-018-0590-4 · Cited by 2,842 · cited 1×
“To assess COMET’s ability to predict successful marker panels for cell subpopulations, we experimentally validated COMET’s predictions for one of four splenic B-cell clusters identified in mouse spleen in the Tabula Muris dataset (Tabula Muris Consortium, 2018) (Fig 5A).”
MethodSingle-cell RNA-seq reveals new types of human blood dendritic cells, monocytes, and progenitors
Villani, A.-C., Satija, R., Reynolds, G., Sarkizova, S., Shekhar, K., Fletcher, J., Griesbeck, M., Butler, A., Zheng, S., Lazo, S., et al. (2017) · Science · doi:10.1126/science.aah4573 · Cited by 2,413 · cited 1×
“…populations within various in vivo contexts (Paul et al , 2015; Satija et al , 2015; Baron et al , 2016; Shekhar et al , 2016; Singer et al , 2016; Villani et al , 2017; Jia et al , 2018; Kernfeld et al , 2018; Vento-Tormo et al , 2018; Chapuy et al , 2019; Kurtulus et al , 2019; Spallanzani et…”
BackgroundSelf-citationSingle-cell reconstruction of the early maternal–fetal interface in humans
Vento-Tormo, R., Efremova, M., Botting, R. A., Turco, M. Y., Vento-Tormo, M., Meyer, K. B., Park, J.-E., Stephenson, E., Polański, K., Goncalves, A., et al. (2018) · Nature · doi:10.1038/s41586-018-0698-6 · Cited by 2,358 · cited 2×
“…a ranked list of genes based on their upregulation in the cluster of choice and/or expression fold-change estimates (Paul et al , 2015; Satija et al , 2015; Baron et al , 2016; Shekhar et al , 2016; Kernfeld et al , 2018; Vento-Tormo et al , 2018; Kurtulus et al , 2019; Luecken & Theis, 2019).”
BackgroundMerad, M., Sathe, P., Helft, J., Miller, J., & Mortha, A. (2013) · Annual Review of Immunology · doi:10.1146/annurev-immunol-020711-074950 · Cited by 2,309
Regev, A., Teichmann, S. A., Lander, E. S., Amit, I., Benoist, C., Birney, E., Bodenmiller, B., Campbell, P., Carninci, P., Clatworthy, M., et al. (2017) · eLife · doi:10.7554/elife.27041 · Cited by 2,232
Self-citationCurrent best practices in single-cell RNA-seq analysis: a tutorial
Luecken, M. D., & Theis, F. J. (2019) · Molecular Systems Biology · doi:10.15252/msb.20188746 · Cited by 2,231 · cited 1×
“…a ranked list of genes based on their upregulation in the cluster of choice and/or expression fold-change estimates (Paul et al , 2015; Satija et al , 2015; Baron et al , 2016; Shekhar et al , 2016; Kernfeld et al , 2018; Vento-Tormo et al , 2018; Kurtulus et al , 2019; Luecken & Theis, 2019).”
BackgroundInferring Regulatory Networks from Expression Data Using Tree-Based Methods
Huynh-Thu, V. A., Irrthum, A., Wehenkel, L., & Geurts, P. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012776 · Cited by 2,131
Mapping the Mouse Cell Atlas by Microwell-Seq
Han, X., Wang, R., Zhou, Y., Fei, L., Sun, H., Lai, S., Saadatpour, A., Zhou, Z., Chen, H., Ye, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.02.001 · Cited by 1,597
Baron, M., Veres, A., Wolock, S. L., Faust, A. L., Gaujoux, R., Vetere, A., Ryu, J. H., Wagner, B. K., Shen-Orr, S. S., Klein, A. M., et al. (2016) · Cell Systems · doi:10.1016/j.cels.2016.08.011 · Cited by 1,508
A Cancer Cell Program Promotes T Cell Exclusion and Resistance to Checkpoint Blockade
Jerby-Arnon, L., Shah, P., Cuoco, M. S., Rodman, C., Su, M.-J., Melms, J. C., Leeson, R., Kanodia, A., Mei, S., Lin, J.-R., et al. (2018) · Cell · doi:10.1016/j.cell.2018.09.006 · Cited by 1,429 · cited 2×
“Recent works have highlighted the annotation of cellular transcriptional programs (by, e.g., NNMF and topic modeling) as a means of identifying important features of variance within single-cell RNA-seq data-sets (preprint: Bielecki et al , 2018; Filbin et al , 2018; Jerby-Arnon et al , 2018).”
BackgroundSelf-citationComprehensive Classification of Retinal Bipolar Neurons by Single-Cell Transcriptomics
Shekhar, K., Lapan, S. W., Whitney, I. E., Tran, N. M., Macosko, E. Z., Kowalczyk, M., Adiconis, X., Levin, J. Z., Nemesh, J., Goldman, M., et al. (2016) · Cell · doi:10.1016/j.cell.2016.07.054 · Cited by 1,176 · cited 2×
“…a ranked list of genes based on their upregulation in the cluster of choice and/or expression fold-change estimates (Paul et al , 2015; Satija et al , 2015; Baron et al , 2016; Shekhar et al , 2016; Kernfeld et al , 2018; Vento-Tormo et al , 2018; Kurtulus et al , 2019; Luecken & Theis, 2019).”
BackgroundSelf-citationValidation of noise models for single-cell transcriptomics
Grün, D., Kester, L., & van Oudenaarden, A. (2014) · Nature Methods · doi:10.1038/nmeth.2930 · Cited by 721
Discovering motifs in ranked lists of DNA sequences
Eden, E., Lipson, D., Yogev, S., & Yakhini, Z. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030039 · Cited by 696 · cited 7×
“COMET implements the XL-minimal Hypergeometric test (XL-mHG test) (Eden et al., 2007; Wagner, 2015) to binarize gene expression data in a gene-specific and cluster-specific manner, assessing for each gene G and cluster K, the extent to which gene G could be a good marker for All rights reserved.”
MethodInfluentialCheckpoint Blockade Immunotherapy Induces Dynamic Changes in PD-1-CD8+ Tumor-Infiltrating T Cells
Kurtulus, S., Madi, A., Escobar, G., Klapholz, M., Nyman, J., Christian, E., Pawlak, M., Dionne, D., Xia, J., Rozenblatt-Rosen, O., et al. (2019) · Immunity · doi:10.1016/j.immuni.2018.11.014 · Cited by 636 · cited 2×
“…a ranked list of genes based on their upregulation in the cluster of choice and/or expression fold-change estimates (Paul et al , 2015; Satija et al , 2015; Baron et al , 2016; Shekhar et al , 2016; Kernfeld et al , 2018; Vento-Tormo et al , 2018; Kurtulus et al , 2019; Luecken & Theis, 2019).”
BackgroundSelf-citationAllman, D., & Pillai, S. (2008) · Current Opinion in Immunology · doi:10.1016/j.coi.2008.03.014 · Cited by 536
Induction and transcriptional regulation of the co-inhibitory gene module in T cells
Chihara, N., Madi, A., Kondo, T., Zhang, H., Acharya, N., Singer, M., Nyman, J., Marjanovic, N. D., Kowalczyk, M. S., Wang, C., et al. (2018) · Nature · doi:10.1038/s41586-018-0206-z · Cited by 438 · cited 1×
“Single-cell data for the spleen tissue from the Mouse Cell Atlas (Han et al , 2018) were processed using COMET for a curated list of murine cell surface proteins (Chihara et al , 2018) (a default gene list used by COMET unless specified by the user).”
MethodSelf-citationGO-PCA: An Unsupervised Method to Explore Gene Expression Data Using Prior Knowledge
Wagner, F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0143196 · Cited by 35
Cited by
Stem-like intestinal Th17 cells give rise to pathogenic effector T cells during autoimmunity
Schnell, A., Huang, L., Singer, M., Singaraju, A., Barilla, R. M., Regan, B. M. L., Bollhagen, A., Thakore, P. I., Dionne, D., Delorey, T. M., et al. (2021) · Cell · doi:10.1016/j.cell.2021.11.018 · Cited by 268
Self-citationThe yin and yang of co-inhibitory receptors: toward anti-tumor immunity without autoimmunity
Schnell, A., Bod, L., Madi, A., & Kuchroo, V. K. (2020) · Cell Research · doi:10.1038/s41422-020-0277-x · Cited by 224
“Additional studies using novel unbiased computational methods are going to be required in the future to identify and test mediators of T-cell exhaustion in the treatment of autoimmune diseases.(124) Furthermore, a better analysis of the tissue-specific molecular and cellular pathways inducing T-cell exhaustion remains…”
BackgroundSelf-citationA comparison of marker gene selection methods for single-cell RNA sequencing data
Pullin, J. M., & McCarthy, D. J. (2022) · doi:10.1101/2022.05.09.490241 · Cited by 122
Sparsely-connected autoencoder (SCA) for single cell RNAseq data mining
Alessandri, L., Cordero, F., Beccuti, M., Licheri, N., Arigoni, M., Olivero, M., Di Renzo, M. F., Sapino, A., & Calogero, R. (2021) · npj Systems Biology and Applications · doi:10.1038/s41540-020-00162-6 · Cited by 40
Metadata
- Authors
- Delaney, C., Schnell, A., Cammarata, L. V., Yao‐Smith, A., Regev, A., Kuchroo, V. K., & Singer, M.
- Venue
- Molecular Systems Biology
- Published
- 2019-10
- Volume
- 15
- Issue
- 10
- Pages
- e9005-e9005
- ISSN
- 1744-4292 (ISSN-L)
- OpenAlex
- W2982231537
- Cited by
- 91
- References
- 21
- FWCI
- 3.08
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.