The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Tutorial: guidelines for annotating single-cell transcriptomic maps using automated and manual methods
Open accessAbstract
Single-cell transcriptomics can profile thousands of cells in a single experiment and identify novel cell types, states and dynamics in a wide variety of tissues and organisms. Standard experimental protocols and analysis workflows have been developed to create single-cell transcriptomic maps from tissues. This tutorial focuses on how to interpret these data to identify cell types, states and other biologically relevant patterns with the objective of creating an annotated map of cells. We recommend a three-step workflow including automatic cell annotation (wherever possible), manual cell annotation and verification. Frequently encountered challenges are discussed, as well as strategies to address them. Guiding principles and specific recommendations for software tools and resources that can be used for each step are covered, and an R notebook is included to help run the recommended workflow. Basic familiarity with computer software is assumed, and basic knowledge of programming (e.g., in the R language) is recommended.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Comprehensive Integration of Single-Cell Data
Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., Hao, Y., Stoeckius, M., Smibert, P., & Satija, R. (2019) · Cell · doi:10.1016/j.cell.2019.05.031 · Cited by 15,453
GSVA: gene set variation analysis for microarray and RNA-Seq data
Hänzelmann, S., Castelo, R., & Guinney, J. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-7 · Cited by 15,440
Tissue-based map of the human proteome
Uhlén, M., Fagerberg, L., Hallström, B. M., Lindskog, C., Oksvold, P., Mardinoglu, A., Sivertsson, Å., Kampf, C., Sjöstedt, E., Asplund, A., et al. (2015) · Science · doi:10.1126/science.1260419 · Cited by 15,286
Gene Expression Omnibus: NCBI gene expression and hybridization array data repository
Edgar, R. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.207 · Cited by 13,288
Integrating single-cell transcriptomic data across different conditions, technologies, and species
Butler, A., Hoffman, P., Smibert, P., Papalexi, E., & Satija, R. (2018) · Nature Biotechnology · doi:10.1038/nbt.4096 · Cited by 13,174
Fast, sensitive and accurate integration of single-cell data with Harmony
Korsunsky, I., Millard, N., Fan, J., Slowikowski, K., Zhang, F., Wei, K., Baglaenko, Y., Brenner, M., Loh, P.-R., & Raychaudhuri, S. (2019) · Nature Methods · doi:10.1038/s41592-019-0619-0 · Cited by 10,488
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826
SCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881
OrthoFinder: phylogenetic orthology inference for comparative genomics
Emms, D. M., & Kelly, S. (2019) · Genome Biology · doi:10.1186/s13059-019-1832-y · Cited by 7,676
Massively parallel digital transcriptional profiling of single cells
Zheng, G. X. Y., Terry, J. M., Belgrader, P., Ryvkin, P., Bent, Z. W., Wilson, R., Ziraldo, S. B., Wheeler, T. D., McDermott, G. P., Zhu, J., et al. (2017) · Nature Communications · doi:10.1038/ncomms14049 · Cited by 7,353
Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets.
Macosko, E. Z., Basu, A., Satija, R., Nemesh, J., Shekhar, K., Goldman, M., Tirosh, I., Bialas, A. R., Kamitaki, N., Martersteck, E. M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.002 · Cited by 7,110
Spatial reconstruction of single-cell gene expression data
Satija, R., Farrell, J. A., Gennert, D., Schier, A. F., & Regev, A. (2015) · Nature Biotechnology · doi:10.1038/nbt.3192 · Cited by 7,055
Scenic: single-cell regulatory network inference and clustering.
Aibar, S., González-Blas, C. B., Moerman, T., Huynh-Thu, V. A., Imrichova, H., Hulselmans, G., Rambow, F., Marine, J.-C., Geurts, P., Aerts, J., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4463 · Cited by 6,520
Aran, D., Looney, A. P., Liu, L., Wu, E., Fong, V., Hsu, A., Chak, S., Naikawadi, R. P., Wolters, P. J., Abate, A. R., et al. (2019) · Nature Immunology · doi:10.1038/s41590-018-0276-y · Cited by 4,984
Dissecting the multicellular ecosystem of metastatic melanoma by single-cell RNA-seq
Tirosh, I., Izar, B., Prakadan, S. M., Wadsworth, M. H., Treacy, D., Trombetta, J. J., Rotem, A., Rodman, C., Lian, C., Murphy, G., et al. (2016) · Science · doi:10.1126/science.aad0501 · Cited by 4,944 · cited 1×
“HoneyBADGER 77 and CaSpER 78 methods predict CNVs using other cells in the data as a reference, whereas InferCNV 79,80 uses a given set of normal cells.”
MethodMcGinnis, C. S., Murrow, L. M., & Gartner, Z. J. (2019) · Cell Systems · doi:10.1016/j.cels.2019.03.003 · Cited by 4,521
The Human Transcription Factors
Lambert, S. A., Jolma, A., Campitelli, L. F., Das, P. K., Yin, Y., Albu, M., Chen, X., Taipale, J., Hughes, T. R., & Weirauch, M. T. (2018) · Cell · doi:10.1016/j.cell.2018.01.029 · Cited by 3,399
Droplet barcoding for single-cell transcriptomics applied to embryonic stem cells
Klein, A. M., Mazutis, L., Akartuna, I., Tallapragada, N., Veres, A., Li, V., Peshkin, L., Weitz, D. A., & Kirschner, M. W. (2015) · Cell · doi:10.1016/j.cell.2015.04.044 · Cited by 3,356
Spatially resolved, highly multiplexed RNA profiling in single cells
Chen, K. H., Boettiger, A. N., Moffitt, J. R., Wang, S., & Zhuang, X. (2015) · Science · doi:10.1126/science.aaa6090 · Cited by 2,969
Single-cell transcriptomics of 20 mouse organs creates a Tabula Muris
The Tabula Muris Consortium, coordination, O., coordination, L., processing, O. C. A., sequencing, L. P. A., analysis, C. D., annotation, C. T., Writing group, Supplemental text writing group, & Principal investigators (2018) · Nature · doi:10.1038/s41586-018-0590-4 · Cited by 2,842
Scrublet: computational identification of cell doublets in single-cell transcriptomic data
Wolock, S. L., Lopez, R., & Klein, A. M. (2018) · doi:10.1101/357368 · Cited by 2,758
Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors
Haghverdi, L., Lun, A. T. L., Morgan, M. D., & Marioni, J. C. (2018) · Nature Biotechnology · doi:10.1038/nbt.4091 · Cited by 2,416 · cited 1×
“MNN approaches, such as mnnCorrect/FastMNN 107 or Seurat v3 21 , identify the most similar cells (MNNs), called ‘ anchors ’ , across data sets that are used to estimate and correct the cell type – speci fi c batch effects.”
MethodWhat is principal component analysis?
Ringnér, M. (2008) · Nature Biotechnology · doi:10.1038/nbt0308-303 · Cited by 2,407 · cited 1×
“6b) performs a linear transformation of normalized and scaled scRNA-seq data, to identify independent principal components (PCs) that capture major axes of variation in the data, which could represent biological factors, like cell types and states, or technical factors 115 .”
BackgroundRegev, A., Teichmann, S. A., Lander, E. S., Amit, I., Benoist, C., Birney, E., Bodenmiller, B., Campbell, P., Carninci, P., Clatworthy, M., et al. (2017) · eLife · doi:10.7554/elife.27041 · Cited by 2,232
Current best practices in single-cell RNA-seq analysis: a tutorial
Luecken, M. D., & Theis, F. J. (2019) · Molecular Systems Biology · doi:10.15252/msb.20188746 · Cited by 2,231
Single-Cell Map of Diverse Immune Phenotypes in the Breast Tumor Microenvironment
Azizi, E., Carr, A. J., Plitas, G., Cornish, A. E., Konopacki, C., Prabhakaran, S., Nainys, J., Wu, K., Kiseliovas, V., Setty, M., et al. (2018) · Cell · doi:10.1016/j.cell.2018.05.060 · Cited by 1,976
Reimand, J., Isserlin, R., Voisin, V., Kucera, M., Tannus-Lopes, C., Rostamianfar, A., Wadi, L., Meyer, M., Wong, J., Xu, C., et al. (2019) · Nature Protocols · doi:10.1038/s41596-018-0103-9 · Cited by 1,970
Self-citationConserved cell types with divergent features in human versus mouse cortex
Hodge, R. D., Bakken, T. E., Miller, J. A., Smith, K. A., Barkan, E. R., Graybuck, L. T., Close, J. L., Long, B., Johansen, N., Penn, O., et al. (2019) · Nature · doi:10.1038/s41586-019-1506-7 · Cited by 1,775 · cited 1×
“Typically, one-to-one orthologs are used 100,121 , which better ensures the conservation of function, although it is possible to use one-to-many and many-to-many relationships to increase gene coverage.”
BackgroundSoupX removes ambient RNA contamination from droplet-based single-cell RNA sequencing data
Young, M. D., & Behjati, S. (2020) · GigaScience · doi:10.1093/gigascience/giaa151 · Cited by 1,739 · cited 1×
“It is possible to estimate and correct the background contamination using methods such as SoupX 88 , which looks for nonspeci fi c expression of cell-type markers, or CellBender 89 , which uses machine learning to learn and correct cell expression pro fi les.”
MethodSoupX removes ambient RNA contamination from droplet based single-cell RNA sequencing data
Young, M. D., & Behjati, S. (2018) · doi:10.1101/303727 · Cited by 1,648
Single cell RNA sequencing of human liver reveals distinct intrahepatic macrophage populations
MacParland, S. A., Liu, J. C., Ma, X.-Z., Innes, B. T., Bartczak, A. M., Gage, B. K., Manuel, J., Khuu, N., Echeverri, J., Linares, I., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-06318-7 · Cited by 1,552
Self-citationComparative Analysis of Single-Cell RNA Sequencing Methods
Ziegenhain, C., Vieth, B., Parekh, S., Reinius, B., Guillaumet-Adkins, A., Smets, M., Leonhardt, H., Heyn, H., Hellmann, I., & Enard, W. (2017) · Molecular Cell · doi:10.1016/j.molcel.2017.01.023 · Cited by 1,494
A scalable SCENIC workflow for single-cell gene regulatory network analysis
Van de Sande, B., Flerin, C., Davie, K., De Waegeneer, M., Hulselmans, G., Aibar, S., Seurinck, R., Saelens, W., Cannoodt, R., Rouchon, Q., et al. (2020) · Nature Protocols · doi:10.1038/s41596-020-0336-2 · Cited by 1,494
Cao, J., Packer, J. S., Ramani, V., Cusanovich, D. A., Huynh, C., Daza, R., Qiu, X., Lee, C., Furlan, S. N., Steemers, F. J., et al. (2017) · doi:10.1101/104844 · Cited by 1,402
Single-cell messenger RNA sequencing reveals rare intestinal cell types
Grün, D., Lyubimova, A., Kester, L., Wiebrands, K., Basak, O., Sasaki, N., Clevers, H., & van Oudenaarden, A. (2015) · Nature · doi:10.1038/nature14966 · Cited by 1,234 · cited 1×
“In particular, single-cell RNA sequencing (scRNA-seq) and single-nuclei RNA sequencing can be used to measure single-cell transcriptomes and map novel cell types 6 , states 7 and dynamics 8 in a wide variety of tissues and organisms.”
MethodA benchmark of batch-effect correction methods for single-cell RNA sequencing data
Tran, H. T. N., Ang, K. S., Chevrier, M., Zhang, X., Lee, N. Y. S., Goh, M., & Chen, J. (2020) · Genome Biology · doi:10.1186/s13059-019-1850-9 · Cited by 1,113
Construction of a human cell landscape at single-cell level
Han, X., Zhou, Z., Fei, L., Sun, H., Wang, R., Chen, Y., Chen, H., Wang, J., Tang, H., Ge, W., et al. (2020) · Nature · doi:10.1038/s41586-020-2157-4 · Cited by 1,087
A mitochondrial specific stress response in mammalian cells
Zhao, Q., Wang, J., Levichkin, I. V., Stasinopoulos, S., Ryan, M. T., & Hoogenraad, N. J. (2002) · The EMBO Journal · doi:10.1093/emboj/cdf445 · Cited by 1,026
Schiebinger, G., Shu, J., Tabaka, M., Cleary, B., Subramanian, V., Solomon, A., Gould, J., Liu, S., Lin, S., Berube, P., et al. (2019) · Cell · doi:10.1016/j.cell.2019.01.006 · Cited by 829
Bias, robustness and scalability in single-cell differential expression analysis
Soneson, C., & Robinson, M. D. (2018) · Nature Methods · doi:10.1038/nmeth.4612 · Cited by 770
Quantitative assessment of single-cell RNA-sequencing methods
Wu, A. R., Neff, N. F., Kalisky, T., Dalerba, P., Treutlein, B., Rothenberg, M. E., Mburu, F. M., Mantalas, G. L., Sim, S., Clarke, M. F., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2694 · Cited by 696
A comparison of automatic cell identification methods for single-cell RNA sequencing data
Abdelaal, T., Michielsen, L., Cats, D., Hoogduin, D., Mei, H., Reinders, M. J. T., & Mahfouz, A. (2019) · Genome Biology · doi:10.1186/s13059-019-1795-z · Cited by 628
The human body at cellular resolution: the NIH Human Biomolecular Atlas Program
HuBMAP Consortium, Writing Group, Snyder, M. P., Lin, S., Posgai, A., Atkinson, M., Regev, A., Rood, J., Rozenblatt-Rosen, O., Gaffney, L., et al. (2019) · Nature · doi:10.1038/s41586-019-1629-x · Cited by 595
Cross-Species Single-Cell Analysis Reveals Divergence of the Primate Microglia Program
Geirsdottir, L., David, E., Keren-Shaul, H., Weiner, A., Bohlen, S. C., Neuber, J., Balic, A., Giladi, A., Sheban, F., Dutertre, C.-A., et al. (2019) · Cell · doi:10.1016/j.cell.2019.11.010 · Cited by 496
Mapping the Mouse Cell Atlas by Microwell-Seq
Han, X., Wang, R., Zhou, Y., Fei, L., Sun, H., Lai, S., Saadatpour, A., Zhou, Z., Chen, H., Ye, F., et al. (2018) · Cell · doi:10.1016/j.cell.2018.05.012 · Cited by 384
High-Throughput Mapping of B Cell Receptor Sequences to Antigen Specificity
Setliff, I., Shiakolas, A. R., Pilewski, K. A., Murji, A. A., Mapengo, R. E., Janowska, K., Richardson, S., Oosthuysen, C., Raju, N., Ronsard, L., et al. (2019) · Cell · doi:10.1016/j.cell.2019.11.003 · Cited by 314
scds: computational annotation of doublets in single-cell RNA sequencing data
Bais, A. S., & Kostka, D. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz698 · Cited by 308
A systematic performance evaluation of clustering methods for single-cell RNA-seq data
Duò, A., Robinson, M. D., & Soneson, C. (2018) · F1000Research · doi:10.12688/f1000research.15666.2 · Cited by 296
Single-cell transcriptome sequencing: recent advances and remaining challenges
Liu, S., & Trapnell, C. (2016) · F1000Research · doi:10.12688/f1000research.7223.1 · Cited by 230 · cited 1×
“Expression gradients indicate continuous differences that are present in the cell population, which could represent states like the cell cycle 62 , immune activation 63 , spatial patterning 64 or transient developmental stages 65,66 .”
BackgroundTutorial: guidelines for the experimental design of single-cell RNA sequencing studies
Lafzi, A., Moutinho, C., Picelli, S., & Heyn, H. (2018) · Nature Protocols · doi:10.1038/s41596-018-0073-y · Cited by 218
Continuous and Discrete Neuron Types of the Adult Murine Striatum
Stanley, G., Gokce, O., Malenka, R. C., Südhof, T. C., & Quake, S. R. (2020) · Neuron · doi:10.1016/j.neuron.2019.11.004 · Cited by 158
Schiebinger, G., Shu, J., Tabaka, M., Cleary, B., Subramanian, V., Solomon, A., Gould, J., Liu, S., Lin, S., Berube, P., et al. (2019) · Cell · doi:10.1016/j.cell.2019.02.026 · Cited by 139
Representation and relative abundance of cell-type selective markers in whole-kidney RNA-Seq data
Clark, J. Z., Chen, L., Chou, C.-L., Jung, H. J., Lee, J. W., & Knepper, M. A. (2019) · Kidney International · doi:10.1016/j.kint.2018.11.028 · Cited by 136
Single-Cell RNA-Sequencing: Assessment of Differential Expression Analysis Methods
Dal Molin, A., Baruzzo, G., & Di Camillo, B. (2017) · Frontiers in Genetics · doi:10.3389/fgene.2017.00062 · Cited by 107
Cited by
Single‐cell RNA sequencing technologies and applications: A brief overview
Jovic, D., Liang, X., Zeng, H., Lin, L., Xu, F., & Luo, Y. (2022) · Clinical and Translational Medicine · doi:10.1002/ctm2.694 · Cited by 1,271
Best practices for single-cell analysis across modalities
Heumos, L., Schaar, A. C., Lance, C., Litinetskaya, A., Drost, F., Zappia, L., Lücken, M. D., Strobl, D. C., Henao, J., Curion, F., et al. (2023) · Nature Reviews Genetics · doi:10.1038/s41576-023-00586-w · Cited by 1,051
“To this end, enrichment frameworks such as decou-pleR 103 provide access to different databases and methods in a single tool.”
MethodFleming, S. J., Chaffin, M. D., Arduini, A., Akkad, A.-D., Banks, E., Marioni, J. C., Philippakis, A. A., Ellinor, P. T., & Babadi, M. (2023) · Nature Methods · doi:10.1038/s41592-023-01943-7 · Cited by 867
Program, C. C. S., Abdulla, S., Aevermann, B., Assis, P., Badajoz, S., Bell, S. M., Bezzi, E., Cakir, B., Chaffer, J., Chambers, S., et al. (2025) · Nucleic Acids Research · doi:10.1093/nar/gkae1142 · Cited by 399
Fleming, S. J., Chaffin, M. D., Arduini, A., Akkad, A.-D., Banks, E., Marioni, J. C., Philippakis, A. A., Ellinor, P. T., & Babadi, M. (2019) · doi:10.1101/791699 · Cited by 164
Metadata
- Authors
- Clarke, Z. A., Andrews, T. S., Atif, J., Pouyabahar, D., Innes, B. T., MacParland, S. A., & Bader, G. D.
- Venue
- Nature Protocols
- Published
- 2021-05-24
- Volume
- 16
- Issue
- 6
- Pages
- 2749-2764
- ISSN
- 1750-2799 (ISSN-L)
- 1754-2189
- OpenAlex
- W3165190053
- Cited by
- 226
- References
- 56
- FWCI
- 9.33
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.