Batch effects and the effective design of single-cell gene expression studies
Open accessPublished version of a preprint
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index; 4 of the 18 sources its claims cite were checked for support.
Abstract
Single-cell RNA sequencing (scRNA-seq) can be used to characterize variation in gene expression levels at high resolution. However, the sources of experimental noise in scRNA-seq are not yet well understood. We investigated the technical variation associated with sample processing using the single-cell Fluidigm C1 platform. To do so, we processed three C1 replicates from three human induced pluripotent stem cell (iPSC) lines. We added unique molecular identifiers (UMIs) to all samples, to account for amplification bias. We found that the major source of variation in the gene expression data was driven by genotype, but we also observed substantial variation between the technical replicates. We observed that the conversion of reads to molecules using the UMIs was impacted by both biological and technical variation, indicating that UMI counts are not an unbiased estimator of gene expression levels. Based on our results, we suggest a framework for effective scRNA-seq studies.
Overview
CoChat Summary
TL;DR
Using three human iPSC lines processed across multiple Fluidigm C1 replicates with ERCC spike-ins and UMIs, this study finds that genotype is the largest source of expression variation but that C1 batch effects are substantial and affect both endogenous genes and ERCC controls. The authors recommend balanced mixed-individual C1 designs and at least 75 cells per condition at ≥1.5 million reads per cell, and show that ERCC spike-ins cannot fully correct batch effects.
Key findings
- Individual/genotype was the major source of variation, but C1 batch effects were also substantial: median variance due to individual was 8% versus 4% due to C1 batch (Kruskal-Wallis, P < 0.001), and cells within a batch were more correlated than cells from the same individual in different batches (P < 0.001).
- ERCC spike-ins were affected by both technical and biological variation and could not effectively account for C1 batch effects: total ERCC molecule counts differed between C1 batches (F-test, P < 0.001) and across individuals (LRT, P = 0.08); per-gene ERCC variance was larger for individual (median 9%) than batch (median 5%; P < 0.001). Read-to-molecule conversion efficiency showed batch effects for ERCC (P < 0.05) and endogenous genes (P < 0.001), and individual effects for endogenous (P < 0.01) and ERCC (P < 0.01).
- UMI-based molecule counts were not an unbiased estimator of gene expression: read and molecule counts correlated at r = 0.99 for ERCC spike-ins but r = 0.92 for endogenous genes, with lower correlation for lowly expressed genes.
- After batch correction, 560 genes had significantly different regulatory noise across individuals (empirical P < 0.0001), enriched for translation, protein disassembly, and biosynthetic processes; among them were pluripotency genes KLF4 and DPPA2. Only 95 of the 1,000 most highly variable genes were common to all three individuals, whereas 887 of the 1,000 most highly expressed genes were common.
Methods
- scRNA-seq was performed on three Yoruba iPSC lines using the Fluidigm C1 platform, with three independent C1 collections per individual, matching bulk samples, ERCC spike-in controls, and 5-bp random-sequence UMIs. After quality control, 564 high-quality single cells were retained across eight replicates from three individuals (NA19098: 142, NA19101: 201, NA19239: 221).
- Reads were mapped, filtered, and converted to molecule counts using UMI-tools; analyses included PCA, nested linear mixed models with individual fixed effects and batch random effects, variance component estimation, likelihood ratio tests, F-tests, Kruskal-Wallis tests, and subsampling of cells and reads.
- Normalization included UMI collision correction, log2 counts-per-million transformation, ERCC-based Poisson GLM correction, and batch-effect removal using a limma-like linear mixed model. Regulatory noise was measured as adjusted coefficient of variation, with differential noise genes identified by median absolute deviation and permutation (300,000 permutations).
Limitations
- Stated: the batch correction assumes the technical batch effect is identical across individuals with no interaction, and the small number of individuals prevented explicit testing of a first-order batch-by-individual interaction.
- Stated: ERCC controls do not experience all processing steps of endogenous samples, have shorter polyA tails and are shorter than mammalian mRNAs, only about half of the 92 controls are typically detected, and they are affected by biological as well as technical variation; the authors recommend an alternative control such as Drosophila RNA for human single-cell studies.
- Evident from the text: the study is a small pilot with only three individuals, one C1 replicate was excluded because of a pipetting error, and the conclusions about study design and noise are based on this limited sample.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
3 Valid · 0 Not valid · 7 Not checked · 88 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of the biggest limitations of using the C1 system, however, is that single cell capture and preparation from different conditions are fully independent23.”
§ Batch effects and the effective design of single-cell gene expression studies > Abstract
What the sources say
- Partly supportedcites [23] Hicks, S. C., Teng, M. & Irizarry, R. A. et al. On the widespread and critical impact of systematic bias and batch effects in single-cell RNA-seq data. bioRxiv doi: 10.1101/025528 (2015). sourceExperimental — accuracy not yet measured
Our copy states the underlying point in general terms: batch effects arise 'when cells from one biological group or condition are cultured, captured and sequenced separate from cells in a second condition' and 'due to the nature of certain experimental scRNA-seq protocols, which restrict the way cells are captured and sequenced separately, sometimes standard balanced experimental designs are not possible' (Introduction), and the Discussion calls this 'experimental limitation' a challenge that makes it 'difficult to impossible to parse technical from biological variation' (p. 4). However, the paper never names the C1/Fluidigm platform (searched: Fluidigm, C1, microfluidic; Table 1 lists single-cell technologies only in a truncated table caption), so the attribution of this as 'one of the biggest limitations of the C1 system' specifically is not supported by our copy — the source speaks about scRNA-seq protocols in general, not about C1. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“We computed a measure of gene expression noise that is independent of RNA abundance across individuals4647.”
§ Batch effects and the effective design of single-cell gene expression studies > Methods > Measurement of gene expression noise
What the sources say
- Supportedcites [46] Kolodziejczyk, K., A. A. & Marioni, J. C. et al. Single cell RNA-sequencing of pluripotent states unlocks modular transcriptional variation. Cell Stem Cell 17, 471–485 (2015). source
In Results, under “Transcriptome-wide Cell-to-Cell Variation Is Similar across the Three Culture Conditions,” the paper says its distance-to-the-median measure accounts for the dependence of gene-expression variability on mean expression level. This supports the claim that the computed noise measure is normalized for RNA abundance across the individual cells studied. (LLM, conf=0.88)
- Not checked yetcites [47] Newman, G., J. R. S. & Weissman, J. S. et al. Single-cell proteomic analysis of s. cerevisiae reveals the architecture of biological noise. Nature 441, 840–846 (2006). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“at this level of subsampling for individual NA19239, we were able to detect a mean of 6068 genes out of 6097 genes expressed in the bulk samples (the bottom 50%; Fig. 2b)”
§ Batch effects and the effective design of single-cell gene expression studies > Results > Study design and quality control
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Indeed, we observed that total ERCC molecule-counts are significantly different between C1 batches (F-test; P < 0.001).”
§ Batch effects and the effective design of single-cell gene expression studies > Results > Batch effects associated with UMI-based single cell data
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“but we also observed substantial variation between the technical replicates.”
- Also stated in: § Batch effects associated with UMI-based single cell data · plain
“Yet, variation due to C1 batch is also substantial - data from single cell samples within a batch are more correlated than that from single cells from the same individual but different batches”
§ Batch effects and the effective design of single-cell gene expression studies > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Batch effects associated with UMI-based single cell data · plain
70 more claims
Create a free account to see all 98 claims and to verify the 14 references still open.
- It may state two separate claims as one. 10
- Probably not a substantial claim. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The presence of variability between replicates is unavoidable, and can be attributed to both technical factors and intrinsic biological differences 22 .”
From Confronting false discoveries in single-cell differential expression (2021) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Increasing biological replicates through sample pooling prior to library preparation followed by demultiplexing (i.e., identifying and isolating the sequencing data related to each sample within the pool) to the original biological sample is an effective strategy to overcome these issues as well as reduce batch effects [5–9].”
From Benchmarking of computational demultiplexing methods for single-nucleus RNA sequencing data (2025) · cites this paper as [6]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Within the same experimental condition, replicates exhibit inherent differences in gene expression, which reflect both biological and technical factors 22 .”
From Confronting false discoveries in single-cell differential expression (2021) · cites this paper as [22]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The analysis of multiplexed dscRNA-seq data recovers cell type-specific gene regulatory programs affected by interferon stimulation consistent with published IFN-β signatures in mouse and humans29.”
From Multiplexed droplet single-cell RNA-sequencing using natural genetic variation (2018) · cites this paper as [29]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“We found significant individual differences (LRT; P < 10−5) in gene-specific dropout rates between individuals in more than 10% (1,214 of 13,058) of expressed endogenous genes.”
§ Batch effects and the effective design of single-cell gene expression studies > Results > Measuring regulatory noise in single-cell gene expression data
Reported 10 · recomputed 9.296983
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041 · cited 1×
“First, we combined all reads for a given 404 single cell using samtools [42].”
Methodlimma powers differential expression analyses for RNA-sequencing and microarray studies
Ritchie, M. E., Phipson, B., Wu, D., Hu, Y., Law, C. W., Shi, W., & Smyth, G. K. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv007 · Cited by 40,458 · cited 1×
“series function of the limma package [45].”
featureCounts: an efficient general purpose program for assigning sequence reads to genomic features
Liao, Y., Smyth, G. K., & Shi, W. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt656 · Cited by 27,219 · cited 1×
“To obtain gene-level counts, we assigned reads to protein-coding genes (Ensembl 397 GRCh37 release 82) and the ERCC spike-in genes using featureCounts [41].”
MethodGene Expression Omnibus: NCBI gene expression and hybridization array data repository
Edgar, R. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.207 · Cited by 13,288
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets.
Macosko, E. Z., Basu, A., Satija, R., Nemesh, J., Shekhar, K., Goldman, M., Tirosh, I., Bialas, A. R., Kamitaki, N., Martersteck, E. M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.002 · Cited by 7,110 · cited 2×
“The automated C1 microfluidic 52 platform (Fluidigm), while more expensive per sample, has been shown to confer several 53 advantages over platforms that make use of droplets to capture single cells [3,21].”
BackgroundResultA haplotype map of the human genome
The International HapMap Consortium (2005) · Nature · doi:10.1038/nature04226 · Cited by 5,858
Droplet barcoding for single-cell transcriptomics applied to embryonic stem cells
Klein, A. M., Mazutis, L., Akartuna, I., Tallapragada, N., Veres, A., Li, V., Peshkin, L., Weitz, D. A., & Kirschner, M. W. (2015) · Cell · doi:10.1016/j.cell.2015.04.044 · Cited by 3,356
Finak, G., McDavid, A., Yajima, M., Deng, J., Gersuk, V., Shalek, A. K., Slichter, C. K., Miller, H. W., McElrath, M. J., Prlic, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0844-5 · Cited by 3,159
The Subread aligner: fast, accurate and scalable read mapping by seed-and-vote
Liao, Y., Smyth, G. K., & Shi, W. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt214 · Cited by 3,064 · cited 2×
“We then mapped reads to human genome hg19 (only including chromosomes 1-22, X, and Y, plus the ERCC sequences) with Subjunc [40], discarding non-uniquely mapped reads (option-u).”
Smith, T., Heger, A., & Sudbery, I. (2017) · Genome Research · doi:10.1101/gr.209601.116 · Cited by 2,143
Normalization of RNA-seq data using factor analysis of control genes or samples
Risso, D., Ngai, J., Speed, T. P., & Dudoit, S. (2014) · Nature Biotechnology · doi:10.1038/nbt.2931 · Cited by 2,052 · cited 1×
“315 More generally, it is inherently difficult to model unknown sources of technical variation 316 using so few genes [30] (only approximately half of the 92 ERCC controls are detected in typical 317 single cell experiments), and the ERCC controls are also strongly impacted by technical sources 318 of variation even i…”
BackgroundMassively parallel single-cell RNA-seq for marker-free decomposition of tissues into cell types
Jaitin, D. A., Kenigsberg, E., Keren-Shaul, H., Elefant, N., Paul, F., Zaretsky, I., Mildner, A., Cohen, N., Jung, S., Tanay, A., et al. (2014) · Science · doi:10.1126/science.1247651 · Cited by 1,795
Noise in Gene Expression: Origins, Consequences, and Control
Raser, J. M., & O'Shea, E. K. (2005) · Science · doi:10.1126/science.1105891 · Cited by 1,750 · cited 1×
“Our goal was to identify inter-individual 227 differences in the amount of variation in gene expression levels across single cells, or in other 228 words, to identify differences between individuals in the amount of regulatory noise [25].”
BackgroundDe novo assembly of bacterial transcriptomes from RNA-seq data
Tjaden, B. (2015) · Genome Biology · doi:10.1186/s13059-014-0572-2 · Cited by 1,717
Smith, T. S., Heger, A., & Sudbery, I. (2016) · bioRxiv · doi:10.1101/051755 · Cited by 1,517
Single-cell proteomic analysis of S. cerevisiae reveals the architecture of biological noise
Newman, J. R. S., Ghaemmaghami, S., Ihmels, J., Breslow, D. K., Noble, M., DeRisi, J. L., & Weissman, J. S. (2006) · Nature · doi:10.1038/nature04785 · Cited by 1,483 · cited 1×
“We computed a measure of gene expression noise that is independent 567 of RNA abundance across individuals [46,47].”
MethodChemically defined conditions for human iPSC derivation and culture
Chen, G., Gulbranson, D. R., Hou, Z., Bolin, J. M., Ruotti, V., Probasco, M. D., Smuga-Otto, K., Howden, S. E., Diol, N. R., Propson, N. E., et al. (2011) · Nature Methods · doi:10.1038/nmeth.1593 · Cited by 1,447
Use of within-array replicate spots for assessing differential expression in microarray experiments
Smyth, G. K., Michaud, J., & Scott, H. S. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti270 · Cited by 1,405 · cited 2×
“Our approach is similar in 217 principle to limma, which was initially developed for adjusting within-replicate correlations in 218 microarray data [24].”
Methodzoo : S3 Infrastructure for Regular and Irregular Time Series
Zeileis, A., & Grothendieck, G. (2005) · Journal of Statistical Software · doi:10.18637/jss.v014.i06 · Cited by 1,243 · cited 1×
“The computation was 578 performed with the rollapply function of the R zoo package [48].”
MethodSingle-cell transcriptomics reveals bimodality in expression and splicing in immune cells
Shalek, A. K., Satija, R., Adiconis, X., Gertner, R. S., Gaublomme, J. T., Raychowdhury, R., Schwartz, S., Yosef, N., Malboeuf, C., Lu, D., et al. (2013) · Nature · doi:10.1038/nature12172 · Cited by 1,190 · cited 2×
“Indeed, single cell gene expression data have already 19 been used to study and provide unique insight into a wide range of research topics, including 20 differentiation and tissue development [3–5], the innate immune response [6,7], and 21 pharmacogenomics [8,9].”
BackgroundQuantitative single-cell RNA-seq with unique molecular identifiers
Islam, S., Zeisel, A., Joost, S., La Manno, G., Zajac, P., Kasper, M., Lönnerberg, P., & Linnarsson, S. (2014) · Nature Methods · doi:10.1038/nmeth.2772 · Cited by 1,183 · cited 9×
“Both endogenous and ERCC spike-in control CV patterns approximately 565 followed an over-dispersed Poisson distribution (Figure S10A-C), which is consistent with 566 previous studies [11,20].”
BackgroundMethodResultInfluentialComputational and analytical challenges in single-cell transcriptomics
Stegle, O., Teichmann, S. A., & Marioni, J. C. (2015) · Nature Reviews Genetics · doi:10.1038/nrg3833 · Cited by 1,170 · cited 2×
“22 Yet, there are a number of outstanding challenges that arose in parallel with the 23 application of single cell technology [10].”
BackgroundCounting absolute numbers of molecules using unique molecular identifiers
Kivioja, T., Vähärautio, A., Karlsson, K., Bonke, M., Enge, M., Linnarsson, S., & Taipale, J. (2012) · Nature Methods · doi:10.1038/nmeth.1778 · Cited by 1,010
SEQC/MAQC-III Consortium (2014) · Nature Biotechnology · doi:10.1038/nbt.2957 · Cited by 983 · cited 1×
“315 More generally, it is inherently difficult to model unknown sources of technical variation 316 using so few genes [30] (only approximately half of the 92 ERCC controls are detected in typical 317 single cell experiments), and the ERCC controls are also strongly impacted by technical sources 318 of variation even i…”
BackgroundAccounting for technical noise in single-cell RNA-seq experiments
Brennecke, P., Anders, S., Kim, J. K., Kołodziejczyk, A. A., Zhang, X., Proserpio, V., Baying, B., Benes, V., Teichmann, S. A., Marioni, J. C., et al. (2013) · Nature Methods · doi:10.1038/nmeth.2645 · Cited by 979
Tn5 transposase and tagmentation procedures for massively scaled sequencing projects
Picelli, S., Björklund, Å. K., Reinius, B., Sagasser, S., Winberg, G., & Sandberg, R. (2014) · Genome Research · doi:10.1101/gr.177881.114 · Cited by 973
Characterization of the single-cell transcriptional landscape by highly multiplex RNA-seq
Islam, S., Kjällquist, U., Moliner, A., Zajac, P., Fan, J.-B., Lönnerberg, P., & Linnarsson, S. (2011) · Genome Research · doi:10.1101/gr.110882.110 · Cited by 949 · cited 1×
“Specifically, the reverse transcription primer and the 1:50,000 359 Ambion® ERCC Spike-In Mix1 (Life Technologies) were added to the lysis buffer, and the 360 template-switching RNA oligos which contain the UMI (5-bp random sequence) were included in 361 the reverse transcription mix [20,35,36].”
MethodPollen, A. A., Nowakowski, T. J., Shuga, J., Wang, X., Leyrat, A. A., Lui, J. H., Li, N., Szpankowski, L., Fowler, B., Chen, P., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.2967 · Cited by 920
Single-cell RNA-seq: advances and future challenges
Saliba, A.-E., Westermann, A. J., Gorski, S. A., & Vogel, J. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku555 · Cited by 847 · cited 1×
“μ α ε = + + + y b , (2) g ijk g g i g ij g ijk , , , ,”
Validation of noise models for single-cell transcriptomics
Grün, D., Kester, L., & van Oudenaarden, A. (2014) · Nature Methods · doi:10.1038/nmeth.2930 · Cited by 721 · cited 6×
“3 To better account for technical variability in scRNA-seq experiments, it has become 31 common to add spike-in RNA standards of known abundance to the endogenous samples 32 [11,12].”
BackgroundMethodResultInfluentialPhipson, B., & Smyth, G. K. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1585 · Cited by 712
RNA-Seq of single prostate CTCs implicates noncanonical Wnt signaling in antiandrogen resistance
Miyamoto, D. T., Zheng, Y., Wittner, B. S., Lee, R. J., Zhu, H., Broderick, K. T., Desai, R., Fox, D. B., Brannigan, B. W., Trautwein, J., et al. (2015) · Science · doi:10.1126/science.aab0917 · Cited by 705 · cited 1×
“Indeed, single cell gene expression data have already 19 been used to study and provide unique insight into a wide range of research topics, including 20 differentiation and tissue development [3–5], the innate immune response [6,7], and 21 pharmacogenomics [8,9].”
Quantitative assessment of single-cell RNA-sequencing methods
Wu, A. R., Neff, N. F., Kalisky, T., Dalerba, P., Treutlein, B., Rothenberg, M. E., Mburu, F. M., Mantalas, G. L., Sim, S., Clarke, M. F., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2694 · Cited by 696 · cited 2×
“The automated C1 microfluidic 52 platform (Fluidigm), while more expensive per sample, has been shown to confer several 53 advantages over platforms that make use of droplets to capture single cells [3,21].”
BackgroundMethodConsensusPathDB: toward a more complete picture of cell biology
Kamburov, A., Pentchev, K., Galicka, H., Wierling, C., Lehrach, H., & Herwig, R. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq1156 · Cited by 671 · cited 2×
“Gene enrichment analysis We used ConsensusPATHDB [50] to identify GO terms that are over-represented for genes whose variation in single cell expression levels were significantly difference between individuals.”
MethodSynthetic spike-in standards for RNA-seq experiments
Jiang, L., Schlesinger, F., Davis, C. A., Zhang, Y., Li, R., Salit, M., Gingeras, T. R., & Oliver, B. (2011) · Genome Research · doi:10.1101/gr.121095.111 · Cited by 653 · cited 1×
“The most commonly used spike-in was developed by the External RNA Controls 33 Consortium (ERCC) [13]; comprising of a set of 96 RNA controls of varying length and GC 34 content.”
MethodMissing data and technical variability in single-cell RNA-sequencing experiments
Hicks, S. C., Townes, F. W., Teng, M., & Irizarry, R. A. (2018) · Biostatistics · doi:10.1093/biostatistics/kxx053 · Cited by 635
Missing Data and Technical Variability in Single-Cell RNA-Sequencing Experiments
Hicks, S. C., Townes, F. W., Teng, M., & Irizarry, R. A. (2015) · doi:10.1101/025528 · Cited by 625
Single Cell RNA-Sequencing of Pluripotent States Unlocks Modular Transcriptional Variation
Kolodziejczyk, A. A., Kim, J. K., Tsang, J. C. H., Ilicic, T., Henriksson, J., Natarajan, K. N., Tuck, A. C., Gao, X., Bühler, M., Liu, P., et al. (2015) · Cell Stem Cell · doi:10.1016/j.stem.2015.09.011 · Cited by 570 · cited 1×
“We computed a measure of gene expression noise that is independent 567 of RNA abundance across individuals [46,47].”
MethodA Nondegenerate Penalized Likelihood Estimator for Variance Parameters in Multilevel Models
Chung, Y., Rabe-Hesketh, S., Dorie, V., Gelman, A., & Liu, J. (2013) · Psychometrika · doi:10.1007/s11336-013-9328-2 · Cited by 554
Jun, G., Flickinger, M., Hetrick, K. N., Romm, J. M., Doheny, K. F., Abecasis, G. R., Boehnke, M., & Kang, H. M. (2012) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2012.09.004 · Cited by 484
Rapid, accurate particle tracking by calculation of radial symmetry centers
Parthasarathy, R. (2012) · Nature Methods · doi:10.1038/nmeth.2071 · Cited by 447
Identification of Genetic Variants That Affect Histone Modifications in Human Cells
McVicker, G., van de Geijn, B., Degner, J. F., Cain, C. E., Banovich, N. E., Raj, A., Lewellen, N., Myrthil, M., Gilad, Y., & Pritchard, J. K. (2013) · Science · doi:10.1126/science.1242429 · Cited by 436 · cited 1×
“The genotypes included the HapMap SNPs with the 1000 Genomes 604 Project SNPs [51] imputed, as previously described [52].”
MethodSelf-citationSingle Cell Genomics: Advances and Future Perspectives
Macaulay, I. C., & Voet, T. (2014) · PLoS Genetics · doi:10.1371/journal.pgen.1004126 · Cited by 384 · cited 1×
“Single-cell genomic technologies can be used to study the regulation of gene expression 14 at unprecedented resolution [1,2].”
BackgroundBASiCS: Bayesian Analysis of Single-Cell Sequencing Data
Vallejos, C. A., Marioni, J. C., & Richardson, S. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004333 · Cited by 302 · cited 3×
“The limitations of the ERCC spike-in controls 298 The ERCC spike-in controls have been used in previous scRNA-seq studies to identify 299 low quality single cell samples, infer the absolute total number of molecules per cell, and model 300 the technical variability across cells [11,12,14,15].”
BackgroundMethodShiroguchi, K., Jia, T. Z., Sims, P. A., & Xie, X. S. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1118018109 · Cited by 276
Highly multiplexed and strand-specific single-cell RNA 5′ end sequencing
Islam, S., Kjällquist, U., Moliner, A., Zajac, P., Fan, J.-B., Lönnerberg, P., & Linnarsson, S. (2012) · Nature Protocols · doi:10.1038/nprot.2012.022 · Cited by 272 · cited 1×
“Specifically, the reverse transcription primer and the 1:50,000 359 Ambion® ERCC Spike-In Mix1 (Life Technologies) were added to the lysis buffer, and the 360 template-switching RNA oligos which contain the UMI (5-bp random sequence) were included in 361 the reverse transcription mix [20,35,36].”
MethodKim, K.-T., Lee, H. W., Lee, H.-O., Kim, S. C., Seo, Y. J., Chung, W., Eum, H. H., Nam, D.-H., Kim, J., Joo, K. M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0692-3 · Cited by 268 · cited 1×
“Indeed, single cell gene expression data have already 19 been used to study and provide unique insight into a wide range of research topics, including 20 differentiation and tissue development [3–5], the innate immune response [6,7], and 21 pharmacogenomics [8,9].”
Distinct myeloid progenitor–differentiation pathways identified through single-cell RNA sequencing
Drissen, R., Buza-Vidas, N., Woll, P., Thongjuea, S., Gambardella, A., Giustacchini, A., Mancini, E., Zriwil, A., Lutteropp, M., Grover, A., et al. (2016) · Nature Immunology · doi:10.1038/ni.3412 · Cited by 230
A method for counting PCR template molecules with application to next-generation sequencing
Casbon, J. A., Osborne, R. J., Brenner, S., & Lichtenstein, C. P. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr217 · Cited by 161
Counting individual DNA molecules by the stochastic attachment of diverse labels
Fu, G. K., Hu, J., Wang, P., & Fodor, S. P. A. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017621108 · Cited by 149 · cited 1×
“As a first step, we adjusted the raw molecule counts by using a Poisson 202 approximation to account for the random use of identical UMI sequences in molecules from 203 highly expressed genes (this was previously termed a correction for the UMI ‘collision 204 probability’ [17]).”
MethodBiased Allelic Expression in Human Primary Fibroblast Single Cells
Borel, C., Ferreira, P. G., Santoni, F., Delaneau, O., Fort, A., Popadin, K. Y., Garieri, M., Falconnet, E., Ribaux, P., Guipponi, M., et al. (2015) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2014.12.001 · Cited by 120 · cited 1×
“Outlook 326 Single cell experiments are ideally suited to study gene regulatory noise and robustness 327 [32,33].”
BackgroundHandel, A. E., Chintawar, S., Lalic, T., Whiteley, E. S., Vowles, J., Giustacchini, A., Argoud, K., Sopp, P., Nakanishi, M., Bowden, R. J., et al. (2016) · Human Molecular Genetics · doi:10.1093/hmg/ddv637 · Cited by 114 · cited 1×
“= = MAD Median Median adjCV (adjCV ) (4) g i g i i g i 1,2,3 , 1,2,3 ,”
Normalization and noise reduction for single cell RNA-seq experiments
Ding, B., Zheng, L., Zhu, Y., Li, N., Jia, H., Ai, R., Wildberg, A., & Wang, W. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv122 · Cited by 100 · cited 2×
“The limitations of the ERCC spike-in controls 298 The ERCC spike-in controls have been used in previous scRNA-seq studies to identify 299 low quality single cell samples, infer the absolute total number of molecules per cell, and model 300 the technical variability across cells [11,12,14,15].”
BackgroundMethodNatural sequence variants of yeast environmental sensors confer cell‐to‐cell expression variability
Fehrmann, S., Duplus‐Bottin, H., Leonidou, A., Mollereau, E., Barthelaix, A., Wei, W., Steinmetz, L. M., & Yvert, G. (2013) · Molecular Systems Biology · doi:10.1038/msb.2013.53 · Cited by 35
Brown, J., Hesselberth, J. R., & Blischak, J. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.34933 · Cited by 2
Self-citationBrown, J., Hesselberth, J., & Blischak, J. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.594347 · Cited by 1
Self-citation
Cited by
Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors
Haghverdi, L., Lun, A. T. L., Morgan, M. D., & Marioni, J. C. (2018) · Nature Biotechnology · doi:10.1038/nbt.4091 · Cited by 2,416
“All of these factors result in batch effects [5] [6], where the expression of genes in one batch differs systematically from those in another batch.”
Cao, J., Packer, J. S., Ramani, V., Cusanovich, D. A., Huynh, C., Daza, R., Qiu, X., Lee, C., Furlan, S. N., Steemers, F. J., et al. (2017) · doi:10.1101/104844 · Cited by 1,402
Accelerating Medicines Partnership Rheumatoid Arthritis and Systemic Lupus Erythematosus (AMP RA/SLE) Consortium, Zhang, F., Wei, K., Slowikowski, K., Fonseka, C. Y., Rao, D. A., Kelly, S., Goodman, S. M., Tabechian, D., Hughes, L. B., et al. (2019) · Nature Immunology · doi:10.1038/s41590-019-0378-1 · Cited by 1,367
A single-cell transcriptomic atlas characterizes ageing tissues in the mouse
The Tabula Muris Consortium, Almanzar, N., Antony, J., Baghel, A. S., Bakerman, I., Bansal, I., Barres, B. A., Beachy, P. A., Berdnik, D., Bilen, B., et al. (2020) · Nature · doi:10.1038/s41586-020-2496-1 · Cited by 1,247
Multiplexed droplet single-cell RNA-sequencing using natural genetic variation
Kang, H. M., Subramaniam, M., Targ, S., Nguyen, M., Maliskova, L., McCarthy, E., Wan, E., Wong, S., Byrnes, L., Lanata, C. M., et al. (2018) · Nature Biotechnology · doi:10.1038/nbt.4042 · Cited by 1,101
Metadata
- Authors
- Tung, P.-Y., Blischak, J. D., Hsiao, C. J., Knowles, D. A., Burnett, J. E., Pritchard, J. K., & Gilad, Y.
- Affiliations
- University of Chicago (US)
- Stanford Medicine (US)
- Howard Hughes Medical Institute (US)
- Corresponding author
- Gilad, Yoav
- Venue
- Scientific Reports
- Published
- 2017-01-03
- Volume
- 7
- Issue
- 1
- Pages
- 39921-39921
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC5206706
- OpenAlex
- W2951638683
- Cited by
- 356
- References
- 55
- Citations by year
- 2026: 23 · 2025: 35 · 2024: 32 · 2023: 22 · 2022: 38 · 2021: 41 · 2020: 52 · 2019: 42 · 2018: 36 · 2017: 31
- FWCI
- 18.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Howard Hughes Medical Institute
- National Institutes of Health
- National Heart, Lung, and Blood Institute (R01HL092206, T32HL007381)
- National Institute of General Medical Sciences (T32GM007197)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- single-cell RNA sequencing, batch effects, technical variability, unique molecular identifiers, amplification bias, gene expression quantification, induced pluripotent stem cells, genotypic variation, research design
- MeSH terms
- Humans, RNA, Gene Expression, Sequence Analysis, RNA, Principal Component Analysis, Induced Pluripotent Stem Cells, Single-Cell Analysis, High-Throughput Nucleotide Sequencing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.