The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Comparison and evaluation of statistical error models for scRNA-seq
Open accessPublished version of a preprint
Abstract
Background: Heterogeneity in single-cell RNA-seq (scRNA-seq) data is driven by multiple sources, including biological variation in cellular state as well as technical variation introduced during experimental processing. Deconvolving these effects is a key challenge for preprocessing workflows. Recent work has demonstrated the importance and utility of count models for scRNA-seq analysis, but there is a lack of consensus on which statistical distributions and parameter settings are appropriate. Results: Here, we analyze 59 scRNA-seq datasets that span a wide range of technologies, systems, and sequencing depths in order to evaluate the performance of different error models. We find that while a Poisson error model appears appropriate for sparse datasets, we observe clear evidence of overdispersion for genes with sufficient sequencing depth in all biological systems, necessitating the use of a negative binomial model. Moreover, we find that the degree of overdispersion varies widely across datasets, systems, and gene abundances, and argues for a data-driven approach for parameter estimation. Conclusions: Based on these analyses, we provide a set of recommendations for modeling variation in scRNA-seq data, particularly when using generalized linear models or likelihood-based approaches for preprocessing and downstream analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Fig. 3 A modified regularization procedure improves the robustness of parameter estimates. A Left: Estimated parameter estimates for θ on the Fetal sci-RNA-seq3 dataset [76], using the original regularization procedure from [9] (v1 regularization). Regularized estimates were learned using all cells (purple line), or downsampled cell subsets. Right: Same as (A), but using a modified procedure where the GLM slope was fixed, and genes where σ2≤μ and μ<0.001 were excluded from regularization (v2 regularization) which improves robustness, and enables us to learn parameter estimates from a subsample of 2,000 cells. B Correlation of Pearson residual variance after applying a NB GLM with v2 regularization where parameters were estimated from all 377,456 cells (x-axis), and a subsample of 2000 cells (y-axis). C Green curve: total sctransform run time as a function of dataset size, using all cells to estimate parameters. Orange curve: total runtime when using a subsample of 2000 cells, which increases computational efficiency for large datasets](https://figures.cochat.ai/paper-figures/364603e4ff8843e2bf95d91fc6cf1b84/comparison-and-evaluation-of-statistical-error-models-for-scrna-seq-figure-3.jpg)
![Fig. 4 Benchmarking on variable feature selection and differential expression analysis. A Proportion overlap (median) of cluster marker genes and identified variable features using fixed θ={100,10}, sctransform v1, and sctransform v2. Marker genes were identified using presto [65], based on unsupervised clustering of log normalized data. Additional plots are shown in Additional file 1: Figure S22. B Comparison of variable features selected by θ={100,10} and our v1 and v2 regularization procedure on a PBMC (ChromiumV3) dataset. The bottom sub-panel represents the top 3000 variable genes identified by four different methods, and groups genes into categories based on the methods where they were identified. Top sub-panel shows the distribution of logarithmic gene mean within each category, with the median value marked in red. Middle sub-panel shows the number of genes within each category, and their overlap with cluster markers. C Benchmarking differential expression analysis. Observed overall true-positive rate (TPR) and false discovery rate (FDR) values for DE genes at FDR cutoffs of 1%, 5%, and 10% using a Wilcoxon rank-sum test (Additional DE methods are indicated in Additional file 1: Figure S23). Dashed vertical lines indicate desired FDRs. Methods that control FDR at their desired level should fall to the left of the corresponding dashed line. Performances were averaged across three simulation replicates. Data was simulated with muscat [79] using three annotated cell types (CD4 T, monocytes, and natural killer cells) from a Smart-seq3 and a Drop-seq PBMC dataset. Titles indicate simulated proportion of DE genes. D Number of differentially expressed genes identified between two groups of biological identical NK cells (PBMC Smart-seq3) where one group was randomly downsampled to 20% sequencing depth. Additional DE methods are indicated in Additional file 1: Figure S24. SCT = sctransform; LogNorm = standard log-normalization](https://figures.cochat.ai/paper-figures/1022aafebd46422589dd275dc75c3885/comparison-and-evaluation-of-statistical-error-models-for-scrna-seq-figure-4.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“After merging, the samples were evaluated for potential batch effects.”
From cGAS–STING drives ageing-related inflammation and neurodegeneration (2023) · cites this paper as [61]
Experimental — accuracy not yet measuredIn the citing paper
“The different single-nucleus datasets were integrated in a single object using the sctransform v2.0 approach 101 for dealing with experimental and biological confounding factors and removing batch effects.”
From AAV vectors trigger DNA damage response-dependent pro-inflammatory signalling in human iPSC-derived CNS models and mouse brain (2025) · cites this paper as [101]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp616 · Cited by 41,364
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
Integrated analysis of multimodal single-cell data
Hao, Y., Hao, S., Andersen-Nissen, E., Mauck, W. M., Zheng, S., Butler, A., Lee, M. J., Wilk, A. J., Darby, C., Zagar, M., et al. (2020) · doi:10.1101/2020.10.12.335331 · Cited by 15,508
Self-citationComprehensive Integration of Single-Cell Data
Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., Hao, Y., Stoeckius, M., Smibert, P., & Satija, R. (2019) · Cell · doi:10.1016/j.cell.2019.05.031 · Cited by 15,453
Self-citationSCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881
Massively parallel digital transcriptional profiling of single cells
Zheng, G. X. Y., Terry, J. M., Belgrader, P., Ryvkin, P., Bent, Z. W., Wilson, R., Ziraldo, S. B., Wheeler, T. D., McDermott, G. P., Zhu, J., et al. (2017) · Nature Communications · doi:10.1038/ncomms14049 · Cited by 7,353
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
Stochastic Gene Expression in a Single Cell
Elowitz, M. B., Levine, A. J., Siggia, E. D., & Swain, P. S. (2002) · Science · doi:10.1126/science.1070919 · Cited by 5,441
McCarthy, D. J., Chen, Y., & Smyth, G. K. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks042 · Cited by 5,195
Research works printed but not linked: 2
- Wilcoxon F. Individual comparisons by ranking methods In: Kotz S, Johnson NL, editors. Breakthroughs in Statistics: Methodology and Distribution. New York: Springer: 1992. p. 196–202.
- Crowell HL, Soneson C, Germain P-L, Calini D, Collin L, Raposo C, Malhotra D, Robinson MD. Muscat detects subpopulation-specific state transitions from multi-sample multi-condition single-cell transcriptomics data. Nat Commun. 2020; 11(1):1–12. · DOI · Paper page
Cited by
cGAS–STING drives ageing-related inflammation and neurodegeneration
Gulen, M. F., Samson, N., Keller, A., Schwabenland, M., Liu, C., Glück, S., Thacker, V. V., Favre, L., Mangeat, B., Kroese, L. J., et al. (2023) · Nature · doi:10.1038/s41586-023-06373-1 · Cited by 1,104
DestVI identifies continuums of cell types in spatial transcriptomics data
Lopez, R., Li, B., Keren-Shaul, H., Boyeau, P., Kedmi, M., Pilzer, D., Jelinski, A., Yofe, I., David, E., Wagner, A., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01272-8 · Cited by 276
“However, the negative binomial has been shown to perform well in modeling scRNA-seq data 23,56 .”
MethodLong somatic DNA-repeat expansion drives neurodegeneration in Huntington’s disease
Handsaker, R. E., Kashin, S., Reed, N. M., Tan, S., Lee, W.-S., McDonald, T. M., Morris, K., Kamitaki, N., Mullally, C. D., Morakabati, N. R., et al. (2025) · Cell · doi:10.1016/j.cell.2024.11.038 · Cited by 205
Slide-tags enables single-nucleus barcoding for multimodal spatial genomics
Russell, A. J. C., Weir, J. A., Nadaf, N. M., Shabet, M., Kumar, V., Kambhampati, S., Raichur, R., Marrero, G. J., Liu, S., Balderrama, K. S., et al. (2024) · Nature · doi:10.1038/s41586-023-06837-4 · Cited by 225
Molecular and cellular dynamics of the developing human neocortex
Wang, L., Wang, C., Moriano, J. A., Chen, S., Zuo, G., Cebrián-Silla, A., Zhang, S., Mukhtar, T., Wang, S., Song, M., et al. (2025) · Nature · doi:10.1038/s41586-024-08351-7 · Cited by 167
Metadata
- Authors
- Choudhary, S., & Satija, R.
- Affiliations
- New York Genome Center (US)
- Corresponding author
- Satija, Rahul
- Venue
- Genome Biology
- Published
- 2022-01-18
- Volume
- 23
- Issue
- 1
- Pages
- 27-27
- ISSN
- 1465-6906 (ISSN-L)
- 1474-760X
- PMC
- PMC8764781
- OpenAlex
- W4225343266
- Cited by
- 634
- References
- 78
- Citations by year
- 2026: 168 · 2025: 209 · 2024: 156 · 2023: 75 · 2022: 25
- FWCI
- 38.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Genome biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- chan zuckerberg initiative (EOSS-0000000082)
- national human genome research institute (RM1HG011014-02, DP2HG009623-01)
- chan zuckerburg initiative (HCA-A-1704-01895)
- nih office of the director (1OT2OD026673-01)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- single-cell RNA sequencing, count data models, overdispersion, negative binomial distribution, Poisson distribution, data preprocessing, generalized linear models, likelihood methods, parameter estimation, gene expression variation
- MeSH terms
- Likelihood Functions, Sequence Analysis, RNA, Gene Expression Profiling, Workflow, Single-Cell Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparison and evaluation of statistical error models for scRNA-seq. https://app.cochat.ai/papers/10.1186/s13059-021-02584-9
- The paper
- Choudhary, S., & Satija, R. (2022). Comparison and evaluation of statistical error models for scRNA-seq. Genome Biology. https://doi.org/10.1186/s13059-021-02584-9
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.