Batch effects and the effective design of single-cell gene expression studies
Open accessPublished version of a preprint
The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index; 4 of the 18 sources its claims cite were checked for support.
Abstract
Single-cell RNA sequencing (scRNA-seq) can be used to characterize variation in gene expression levels at high resolution. However, the sources of experimental noise in scRNA-seq are not yet well understood. We investigated the technical variation associated with sample processing using the single-cell Fluidigm C1 platform. To do so, we processed three C1 replicates from three human induced pluripotent stem cell (iPSC) lines. We added unique molecular identifiers (UMIs) to all samples, to account for amplification bias. We found that the major source of variation in the gene expression data was driven by genotype, but we also observed substantial variation between the technical replicates. We observed that the conversion of reads to molecules using the UMIs was impacted by both biological and technical variation, indicating that UMI counts are not an unbiased estimator of gene expression levels. Based on our results, we suggest a framework for effective scRNA-seq studies.
Overview
CoChat Summary
TL;DR
Using three human iPSC lines processed across multiple Fluidigm C1 replicates with ERCC spike-ins and UMIs, this study finds that genotype is the largest source of expression variation but that C1 batch effects are substantial and affect both endogenous genes and ERCC controls. The authors recommend balanced mixed-individual C1 designs and at least 75 cells per condition at ≥1.5 million reads per cell, and show that ERCC spike-ins cannot fully correct batch effects.
Key findings
- Individual/genotype was the major source of variation, but C1 batch effects were also substantial: median variance due to individual was 8% versus 4% due to C1 batch (Kruskal-Wallis, P < 0.001), and cells within a batch were more correlated than cells from the same individual in different batches (P < 0.001).
- ERCC spike-ins were affected by both technical and biological variation and could not effectively account for C1 batch effects: total ERCC molecule counts differed between C1 batches (F-test, P < 0.001) and across individuals (LRT, P = 0.08); per-gene ERCC variance was larger for individual (median 9%) than batch (median 5%; P < 0.001). Read-to-molecule conversion efficiency showed batch effects for ERCC (P < 0.05) and endogenous genes (P < 0.001), and individual effects for endogenous (P < 0.01) and ERCC (P < 0.01).
- UMI-based molecule counts were not an unbiased estimator of gene expression: read and molecule counts correlated at r = 0.99 for ERCC spike-ins but r = 0.92 for endogenous genes, with lower correlation for lowly expressed genes.
- After batch correction, 560 genes had significantly different regulatory noise across individuals (empirical P < 0.0001), enriched for translation, protein disassembly, and biosynthetic processes; among them were pluripotency genes KLF4 and DPPA2. Only 95 of the 1,000 most highly variable genes were common to all three individuals, whereas 887 of the 1,000 most highly expressed genes were common.
Methods
- scRNA-seq was performed on three Yoruba iPSC lines using the Fluidigm C1 platform, with three independent C1 collections per individual, matching bulk samples, ERCC spike-in controls, and 5-bp random-sequence UMIs. After quality control, 564 high-quality single cells were retained across eight replicates from three individuals (NA19098: 142, NA19101: 201, NA19239: 221).
- Reads were mapped, filtered, and converted to molecule counts using UMI-tools; analyses included PCA, nested linear mixed models with individual fixed effects and batch random effects, variance component estimation, likelihood ratio tests, F-tests, Kruskal-Wallis tests, and subsampling of cells and reads.
- Normalization included UMI collision correction, log2 counts-per-million transformation, ERCC-based Poisson GLM correction, and batch-effect removal using a limma-like linear mixed model. Regulatory noise was measured as adjusted coefficient of variation, with differential noise genes identified by median absolute deviation and permutation (300,000 permutations).
Limitations
- Stated: the batch correction assumes the technical batch effect is identical across individuals with no interaction, and the small number of individuals prevented explicit testing of a first-order batch-by-individual interaction.
- Stated: ERCC controls do not experience all processing steps of endogenous samples, have shorter polyA tails and are shorter than mammalian mRNAs, only about half of the 92 controls are typically detected, and they are affected by biological as well as technical variation; the authors recommend an alternative control such as Drosophila RNA for human single-cell studies.
- Evident from the text: the study is a small pilot with only three individuals, one C1 replicate was excluded because of a pipetting error, and the conclusions about study design and noise are based on this limited sample.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
3 Valid · 0 Not valid · 7 Not checked · 88 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“One of the biggest limitations of using the C1 system, however, is that single cell capture and preparation from different conditions are fully independent23.”
§ Batch effects and the effective design of single-cell gene expression studies > Abstract
What the sources say
- Partly supportedcites [23] Hicks, S. C., Teng, M. & Irizarry, R. A. et al. On the widespread and critical impact of systematic bias and batch effects in single-cell RNA-seq data. bioRxiv doi: 10.1101/025528 (2015). sourceExperimental — accuracy not yet measured
Our copy states the underlying point in general terms: batch effects arise 'when cells from one biological group or condition are cultured, captured and sequenced separate from cells in a second condition' and 'due to the nature of certain experimental scRNA-seq protocols, which restrict the way cells are captured and sequenced separately, sometimes standard balanced experimental designs are not possible' (Introduction), and the Discussion calls this 'experimental limitation' a challenge that makes it 'difficult to impossible to parse technical from biological variation' (p. 4). However, the paper never names the C1/Fluidigm platform (searched: Fluidigm, C1, microfluidic; Table 1 lists single-cell technologies only in a truncated table caption), so the attribution of this as 'one of the biggest limitations of the C1 system' specifically is not supported by our copy — the source speaks about scRNA-seq protocols in general, not about C1. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“We computed a measure of gene expression noise that is independent of RNA abundance across individuals4647.”
§ Batch effects and the effective design of single-cell gene expression studies > Methods > Measurement of gene expression noise
What the sources say
- Supportedcites [46] Kolodziejczyk, K., A. A. & Marioni, J. C. et al. Single cell RNA-sequencing of pluripotent states unlocks modular transcriptional variation. Cell Stem Cell 17, 471–485 (2015). source
In Results, under “Transcriptome-wide Cell-to-Cell Variation Is Similar across the Three Culture Conditions,” the paper says its distance-to-the-median measure accounts for the dependence of gene-expression variability on mean expression level. This supports the claim that the computed noise measure is normalized for RNA abundance across the individual cells studied. (LLM, conf=0.88)
- Not checked yetcites [47] Newman, G., J. R. S. & Weissman, J. S. et al. Single-cell proteomic analysis of s. cerevisiae reveals the architecture of biological noise. Nature 441, 840–846 (2006). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“at this level of subsampling for individual NA19239, we were able to detect a mean of 6068 genes out of 6097 genes expressed in the bulk samples (the bottom 50%; Fig. 2b)”
§ Batch effects and the effective design of single-cell gene expression studies > Results > Study design and quality control
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Indeed, we observed that total ERCC molecule-counts are significantly different between C1 batches (F-test; P < 0.001).”
§ Batch effects and the effective design of single-cell gene expression studies > Results > Batch effects associated with UMI-based single cell data
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“but we also observed substantial variation between the technical replicates.”
- Also stated in: § Batch effects associated with UMI-based single cell data · plain
“Yet, variation due to C1 batch is also substantial - data from single cell samples within a batch are more correlated than that from single cells from the same individual but different batches”
§ Batch effects and the effective design of single-cell gene expression studies > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Batch effects associated with UMI-based single cell data · plain
70 more claims
Create a free account to see all 98 claims and to verify the 14 references still open.
- It may state two separate claims as one. 10
- Probably not a substantial claim. 14
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The presence of variability between replicates is unavoidable, and can be attributed to both technical factors and intrinsic biological differences 22 .”
From Confronting false discoveries in single-cell differential expression (2021) · cites this paper as [22]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Increasing biological replicates through sample pooling prior to library preparation followed by demultiplexing (i.e., identifying and isolating the sequencing data related to each sample within the pool) to the original biological sample is an effective strategy to overcome these issues as well as reduce batch effects [5–9].”
From Benchmarking of computational demultiplexing methods for single-nucleus RNA sequencing data (2025) · cites this paper as [6]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Within the same experimental condition, replicates exhibit inherent differences in gene expression, which reflect both biological and technical factors 22 .”
From Confronting false discoveries in single-cell differential expression (2021) · cites this paper as [22]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The analysis of multiplexed dscRNA-seq data recovers cell type-specific gene regulatory programs affected by interferon stimulation consistent with published IFN-β signatures in mouse and humans29.”
From Multiplexed droplet single-cell RNA-sequencing using natural genetic variation (2018) · cites this paper as [29]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“We found significant individual differences (LRT; P < 10−5) in gene-specific dropout rates between individuals in more than 10% (1,214 of 13,058) of expressed endogenous genes.”
§ Batch effects and the effective design of single-cell gene expression studies > Results > Measuring regulatory noise in single-cell gene expression data
Reported 10 · recomputed 9.296983
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041 · cited 1×
“First, we combined all reads for a given 404 single cell using samtools [42].”
Methodlimma powers differential expression analyses for RNA-sequencing and microarray studies
Ritchie, M. E., Phipson, B., Wu, D., Hu, Y., Law, C. W., Shi, W., & Smyth, G. K. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv007 · Cited by 40,458 · cited 1×
“series function of the limma package [45].”
featureCounts: an efficient general purpose program for assigning sequence reads to genomic features
Liao, Y., Smyth, G. K., & Shi, W. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt656 · Cited by 27,219 · cited 1×
“To obtain gene-level counts, we assigned reads to protein-coding genes (Ensembl 397 GRCh37 release 82) and the ERCC spike-in genes using featureCounts [41].”
MethodGene Expression Omnibus: NCBI gene expression and hybridization array data repository
Edgar, R. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.207 · Cited by 13,288
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Highly parallel genome-wide expression profiling of individual cells using nanoliter droplets.
Macosko, E. Z., Basu, A., Satija, R., Nemesh, J., Shekhar, K., Goldman, M., Tirosh, I., Bialas, A. R., Kamitaki, N., Martersteck, E. M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.002 · Cited by 7,110 · cited 2×
“The automated C1 microfluidic 52 platform (Fluidigm), while more expensive per sample, has been shown to confer several 53 advantages over platforms that make use of droplets to capture single cells [3,21].”
BackgroundResultA haplotype map of the human genome
The International HapMap Consortium (2005) · Nature · doi:10.1038/nature04226 · Cited by 5,858
Droplet barcoding for single-cell transcriptomics applied to embryonic stem cells
Klein, A. M., Mazutis, L., Akartuna, I., Tallapragada, N., Veres, A., Li, V., Peshkin, L., Weitz, D. A., & Kirschner, M. W. (2015) · Cell · doi:10.1016/j.cell.2015.04.044 · Cited by 3,356
Finak, G., McDavid, A., Yajima, M., Deng, J., Gersuk, V., Shalek, A. K., Slichter, C. K., Miller, H. W., McElrath, M. J., Prlic, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0844-5 · Cited by 3,159
The Subread aligner: fast, accurate and scalable read mapping by seed-and-vote
Liao, Y., Smyth, G. K., & Shi, W. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt214 · Cited by 3,064 · cited 2×
“We then mapped reads to human genome hg19 (only including chromosomes 1-22, X, and Y, plus the ERCC sequences) with Subjunc [40], discarding non-uniquely mapped reads (option-u).”
Cited by
Items 101–200 of 356
Measuring and Modelling the Epithelial- Mesenchymal Hybrid State in Cancer: Clinical Implications
Jolly, M. K., Murphy, R. J., Bhatia, S., Whitfield, H. J., Redfern, A. D., Davis, M. J., & Thompson, E. W. (2021) · Cells Tissues Organs · doi:10.1159/000515289 · Cited by 50
Spatial Transcriptomics: Molecular Maps of the Mammalian Brain
Ortiz, C., Carlén, M., & Meletis, K. (2021) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-100520-082639 · Cited by 52
Das, S., Rai, A. K., & Rai, S. N. (2022) · Entropy · doi:10.3390/e24070995 · Cited by 57
Causal machine learning for single-cell genomics
Tejada-Lapuerta, A., Bertin, P., Bauer, S., Aliee, H., Bengio, Y., & Theis, F. J. (2025) · Nature Genetics · doi:10.1038/s41588-025-02124-2 · Cited by 102
“https://doi.org/10.1038/s41588-025-02124-2 available for how to account for technical covariates and integrate different datasets 3,35–37 , which can be leveraged to build training sets for causal models when required.”
InfluentialLavagi, I., Krebs, S., Simmet, K., Beck, A. H., Zakhartchenko, V., Wolf, E., & Blum, H. (2018) · Scientific Reports · doi:10.1038/s41598-018-22248-2 · Cited by 57
Chen, W., Zhang, S., Williams, J., Ju, B., Shaner, B., Easton, J., Wu, G., & Chen, X. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.03.026 · Cited by 44
“…for differential expression (DE) analysis of scRNA-seq data, because cells from different experimental groups/conditions are typically captured separately, and this produces large collections of cells with batch effects (technical variations) embedded with underlying biological differences [8,9].”
BackgroundMethodThe shaky foundations of simulating single-cell RNA sequencing data
Crowell, H. L., Leonardo, S. X. M., Soneson, C., & Robinson, M. D. (2023) · Genome biology · doi:10.1186/s13059-023-02904-1 · Cited by 66
How many markers are needed to robustly determine a cell's type?
Fischer, S., & Gillis, J. (2021) · iScience · doi:10.1016/j.isci.2021.103292 · Cited by 55
“, 2018), but they are subject to batch effects (Tung et al., 2017) and discard expression variability.”
BackgroundThe Human Cell Atlas: Technical approaches and challenges
Hon, C.-C., Shin, J. W., Carninci, P., & Stubbington, M. J. T. (2017) · Briefings in Functional Genomics · doi:10.1093/bfgp/elx029 · Cited by 44
“Even after normalization, other confounders, notably batch effects [80] and biological factors such as the cell cycle [81], may still obscure the signal of interest.”
BackgroundMethods for Single-Cell Isolation and Preparation
Pensold, D., & Zimmer‐Bensch, G. (2020) · Advances in experimental medicine and biology · doi:10.1007/978-981-15-4494-1_2 · Cited by 49
scBatch: batch-effect correction of RNA-seq data through sample distance matrix adjustment
Fei, T., & Yu, T. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa097 · Cited by 41
Single-cell RNA and protein profiling of immune cells from the mouse brain and its border tissues
Scheyltjens, I., Hove, H. V., Vlaminck, K. D., Kancheva, D., Bastos, J., Vara‐Pérez, M., Antunes, A. R. P., Martens, L., Scott, C. L., Ginderachter, J. A. V., et al. (2022) · Nature Protocols · doi:10.1038/s41596-022-00716-4 · Cited by 45
Muciño-Olmos, E. A., Vázquez-Jiménez, A., de León, U. A.-P., Matadamas-Guzman, M. L., Maldonado, V., López-Santaella, T., Hernández‐Hernández, A., & Reséndis-Antonio, O. (2020) · Scientific Reports · doi:10.1038/s41598-020-69026-7 · Cited by 39
Weber, L. M., Hippen, A. A., Hickey, P. F., Berrett, K. C., Gertz, J., Doherty, J. A., Greene, C. S., & Hicks, S. C. (2021) · GigaScience · doi:10.1093/gigascience/giab062 · Cited by 37
Das, S., Rai, A., Merchant, M. L., Cave, M. C., & Rai, S. N. (2021) · Genes · doi:10.3390/genes12121947 · Cited by 35
“The addition of UMIs during library preparation step reduces the inherent amplification bias [6] but has no effect on the noises.”
BackgroundComputational approaches for high‐throughput single‐cell data analysis
Todorov, H., & Saeys, Y. (2018) · FEBS Journal · doi:10.1111/febs.14613 · Cited by 37
Quantile normalization of single-cell RNA-seq read counts without unique molecular identifiers
Townes, F. W., & Irizarry, R. A. (2020) · Genome biology · doi:10.1186/s13059-020-02078-0 · Cited by 45
Embedding to reference t-SNE space addresses batch effects in single-cell classification
Poličar, P. G., Stražar, M., & Zupan, B. (2021) · Machine Learning · doi:10.1007/s10994-021-06043-1 · Cited by 45
“It has been well documented that even small differences in the experimental setup of cell-dissociation, handling protocols, librarypreparation technologies, or sequencing platforms can significantly affect the resulting gene-expression measurements (Tung et al., 2017; Hicks et al., 2018).”
BackgroundFast identification of differential distributions in single-cell RNA-sequencing data with waddR
Schefzik, R., Flesch, J., & Gonçalves, Â. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab226 · Cited by 51
“To mimic bulk values from the single-cell dataset in Vento-Tormo et al. (2018), we compute for each gene and for each replicate separately the sum of the expression values (counts) over all respective cells and take this as a bulk input for edgeR.”
MethodInduced Pluripotent Stem Cells in Psychiatry: An Overview and Critical Perspective
Angeles, A. D. L., Fernando, M. B., Hall, N., Brennand, K., Harrison, P. J., Maher, B. J., Weinberger, D. R., & Tunbridge, E. M. (2021) · Biological Psychiatry · doi:10.1016/j.biopsych.2021.04.008 · Cited by 38
“Therefore, large iPSC studies will likely involve staggered differentiations, which in turn necessitates the careful control of batch effects (59) and limits the number of distinct lines that can feasibly be included in a single experiment.”
Mika, K. M., Whittington, C. M., McAllan, B. M., & Lynch, V. J. (2022) · eLife · doi:10.7554/elife.74297 · Cited by 41
“…sources of experimental noise such as technical variation in library preparation, sequencing, or batch effects ( Gilad and Mizrahi-Man, 2015 ; Tung et al., 2017 ), variation in cell-type composition of a tissue ( Price et al., 2022 ), sampling different timepoints in development or only a…”
BCseq: accurate single cell RNA-seq quantification with bias correction
Chen, L., & Zheng, S. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky308 · Cited by 31
“The public scRNA-seq data used in this study are from the NCBI GEO database (https://www.ncbi.nlm.nih.gov/ geo/) including GSE63576 (Li et al., 2016), GSE77288 (Tung et al., 2017), and GSE60361 (Zeisel et al., 2015).”
BackgroundMethodInfluentialSingle-Cell mRNA Sequencing in Cancer Research: Integrating the Genomic Fingerprint
Müller, S., & Diaz, A. A. (2017) · Frontiers in Genetics · doi:10.3389/fgene.2017.00073 · Cited by 32
“Not surprisingly, batch effects have been observed when comparing batches of cells captured in separate assays (Tung et al., 2017).”
BackgroundStatistical significance of cluster membership for unsupervised evaluation of cell identities
Chung, N. C. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa087 · Cited by 31
Single cell transcriptome sequencing: A new approach for the study of mammalian sex determination
Stévant, I., & Nef, S. (2018) · Molecular and Cellular Endocrinology · doi:10.1016/j.mce.2018.01.013 · Cited by 37
Derbois, C., Palomares, M.-A., Deleuze, J., Cabannes, É., & Bonnet, É. (2023) · Scientific Data · doi:10.1038/s41597-023-02348-z · Cited by 29
Supervised Adversarial Alignment of Single-Cell RNA-seq Data
Ge, S., Wang, H., Alavi, A., Xing, E. P., & Bar‐Joseph, Z. (2021) · Journal of Computational Biology · doi:10.1089/cmb.2020.0439 · Cited by 34
“Furthermore, similar to other high throughput genomic assays, scRNA-seq suffers from batch effects which can make cells profiled in one lab look very different from the same cells profiled at another lab [37, 36].”
SNV identification from single-cell RNA sequencing data
Schnepp, P. M., Chen, M., Keller, E. T., & Zhou, X. (2019) · Human Molecular Genetics · doi:10.1093/hmg/ddz207 · Cited by 30
“We obtained bulk and single-cell RNA-seq data for three individual human samples with three replicates each in the NCBI’s Gene Expression Omnibus (38) (accession number GSE77288) (18).”
MethodPei, G., Yan, F., Simon, L. M., Dai, Y., Jia, P., & Zhao, Z. (2022) · Genomics Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.04.001 · Cited by 31
“Due to the stochasticity and inefficient mRNA capture in scRNA-seq, varying sequencing depth across batches is a major driver of batch effects [7,58].”
St‐Pierre, M., VanderZwaag, J., Loewen, S. M., & Tremblay, M. (2022) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2022.932572 · Cited by 29
distinct: A novel approach to differential distribution analyses
Tiberi, S., Crowell, H. L., Samartsidis, P., Weber, L. M., & Robinson, M. D. (2023) · The Annals of Applied Statistics · doi:10.1214/22-aoas1689 · Cited by 29
Inter-embryo gene expression variability recapitulates the hourglass pattern of evo-devo
Liu, J., Frochaux, M., Gardeux, V., Deplancke, B., & Robinson‐Rechavi, M. (2020) · BMC Biology · doi:10.1186/s12915-020-00842-z · Cited by 32
Evidence for Multiple Subpopulations of Herpesvirus-Latently Infected Cells
Landis, J. T., Tuck, R. H., Pan, Y., Mosso, C. N., Eason, A. B., Moorad, R., Marron, J. S., & Dittmer, D. P. (2022) · mBio · doi:10.1128/mbio.03473-21 · Cited by 25
“than ideal statistical properties (68, 69).”
iMyoblasts for ex vivo and in vivo investigations of human myogenesis and disease modeling
Guo, D., Daman, K., Chen, J. J., Shi, M.-J., Yan, J., Matijasevic, Z., Rickard, A. M., Bennett, M. H., Kiselyov, A., Zhou, H., et al. (2022) · eLife · doi:10.7554/elife.70341 · Cited by 26
Thomson, E., Tran, M., Robevska, G., Ayers, K. L., van den Bergen, J., Bhaskaran, P. G., Haan, E., Cereghini, S., Vash‐Margita, A., Margetts, M., et al. (2022) · Human Molecular Genetics · doi:10.1093/hmg/ddac262 · Cited by 31
“Differential gene expression between conditions was performed with an ‘pseudo-bulk’ expression approach (86).”
Emerging approaches and technologies in transplantation: the potential game changers
Dangi, A., Yu, S., & Luo, X. (2019) · Cellular and Molecular Immunology · doi:10.1038/s41423-019-0207-3 · Cited by 26
The accuracy of absolute differential abundance analysis from relative count data
Roche, K. E., & Mukherjee, S. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010284 · Cited by 27
“While several papers have expressed confidence in 57 the utility of spike-ins [11, 12, 13, 14, 15], the doubt cast by reports of widespread batch effects [16] 58 and technical noise [17] have had the effect of reducing researcher confidence in their use.”
BackgroundA transcriptomic atlas of astrocyte heterogeneity across space and time in mouse and marmoset
Schroeder, M. E., McCormack, D. M., Metzner, L. R., Kang, J., Li, K. X., Yu, E., Melamed, L., Levandowski, K. M., Zaniewski, H., Zhang, Q., et al. (2025) · Neuron · doi:10.1016/j.neuron.2025.09.011 · Cited by 33
Practical Considerations for Single‐Cell Genomics
Regan, C., & Preall, J. B. (2022) · Current Protocols · doi:10.1002/cpz1.498 · Cited by 27
PmVAE: learning interpretable single-cell representations with pathway modules
Gut, G., Stark, S. G., Rätsch, G., & Davidson, N. R. (2021) · doi:10.1101/2021.01.28.428664 · Cited by 24
deepMc: Deep Matrix Completion for Imputation of Single-Cell RNA-seq Data
Mongia, A., Sengupta, D., & Majumdar, A. (2019) · Journal of Computational Biology · doi:10.1089/cmb.2019.0278 · Cited by 24
Immunotherapy for Hepatocellular Carcinoma: New Prospects for the Cancer Therapy
Fasano, R., Shadbad, M. A., Brunetti, O., Argentiero, A., Calabrese, A., Nardulli, P., Calbi, R., Baradaran, B., & Silvestris, N. (2021) · Life · doi:10.3390/life11121355 · Cited by 25
Detecting hidden batch factors through data-adaptive adjustment for biological effects
Yi, H., Raman, A. T., Zhang, H., Allen, G. I., & Liu, Z. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx635 · Cited by 28
Modeling group heteroscedasticity in single-cell RNA-seq pseudo-bulk data
You, Y., Dong, X., Wee, Y. K., Maxwell, M. J., Alhamdoosh, M., Smyth, G. K., Hickey, P. F., Ritchie, M. E., & Law, C. W. (2023) · Genome biology · doi:10.1186/s13059-023-02949-2 · Cited by 31
“Another analysis strategy performs DE analysis on pseudo-bulk samples that are created by cell aggregation [12].”
MethodMatrix Denoising for Weighted Loss Functions and Heterogeneous Signals
Leeb, W. (2021) · SIAM Journal on Mathematics of Data Science · doi:10.1137/20m1319577 · Cited by 22
Heaton, H., Talman, A. M., Knights, A. J., Imaz, M., Gaffney, D. J., Durbin, R. M., Hemberg, M., & Lawniczak, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/699637 · Cited by 23
Exploring dimension-reduced embeddings with Sleepwalk
Ovchinnikova, S., & Anders, S. (2020) · Genome Research · doi:10.1101/gr.251447.119 · Cited by 23
Arora, D., & Robey, P. G. (2022) · PubMed Central · doi:10.12336/biomatertransl.2022.01.002 · Cited by 24
Kannan, S., Miyamoto, M., Zhu, R., Lynott, M. R., Guo, J., Chen, E. Z., Colas, A. R., Lin, B. L., & Kwon, C. (2023) · Cell Reports · doi:10.1016/j.celrep.2023.112330 · Cited by 24
DELVE: feature selection for preserving biological trajectories in single-cell data
Ranek, J. S., Stallaert, W., Milner, J. J., Redick, M. A., Wolff, S. C., Beltrán, A. S., Stanley, N., & Purvis, J. E. (2024) · Nature Communications · doi:10.1038/s41467-024-46773-z · Cited by 21
Delineating biological and technical variance in single cell expression data
Arzalluz-Luque, Á., Devailly, G., Mantsoki, A., & Joshi, A. (2017) · The International Journal of Biochemistry & Cell Biology · doi:10.1016/j.biocel.2017.07.006 · Cited by 23
“This poses a great challenge, as it was recently proven that the conversion of reads to molecules using UMIs is impacted by both biological and technical variation, indicating that UMI counts are not an unbiased estimator of gene expression levels (Tung et al., 2017).”
BackgroundData-driven characterization of molecular phenotypes across heterogeneous sample collections
Mehtonen, J., Pölönen, P., Häyrynen, S., Dufva, O., Lin, J., Liuksiala, T., Granberg, K. J., Lohi, O., Hautamäki, V., Nykter, M., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz281 · Cited by 22
“For example, in context of single-cell RNA-seq the challenge of batch effects has been recognized (35), and new data sets are becoming increasingly available.”
BackgroundCLEAR: coverage-based limiting-cell experiment analysis for RNA-seq
Walker, L. A., Sovic, M. G., Chiang, C., Hu, E. Y., Denninger, J. K., Chen, X., Kirby, E. D., Byrd, J. C., Muthusamy, N., Bundschuh, R. A., et al. (2020) · Journal of Translational Medicine · doi:10.1186/s12967-020-02247-6 · Cited by 21
Single-cell mapping of focused ultrasound-transfected brain
Mathew, A. S., Gorick, C. M., & Price, R. J. (2021) · Gene Therapy · doi:10.1038/s41434-021-00226-0 · Cited by 21
“This approach is common [44, 45] and has been shown to mitigate batch effects and improve statistical power [46, 47].”
New horizons in the stormy sea of multimodal single-cell data integration
Jackson, C. A., & Vogel, C. (2022) · Molecular Cell · doi:10.1016/j.molcel.2021.12.012 · Cited by 26
Legouis, D., Rinaldi, A., Malpetti, D., Arnoux, G., Verissimo, T., Faivre, A., Mangili, F., Rinaldi, A., Ruinelli, L., Pugin, J., et al. (2024) · iScience · doi:10.1016/j.isci.2024.109271 · Cited by 24
Osorio, D., Capasso, A., Eckhardt, S. G., Giri, U. P., Somma, A. J., Pitts, T. M., Lieu, C. H., Messersmith, W. A., Bagby, S. M., Singh, H., et al. (2024) · Nature Computational Science · doi:10.1038/s43588-024-00597-5 · Cited by 27
“Pseudo-bulk profiles are frequently calculated in differential gene expression analysis to take into account biological variation between samples (16, 17).”
BackgroundMesomelic dysplasias associated with the HOXD locus are caused by regulatory reallocations
Bolt, C. C., Lopez‐Delisle, L., Mascrez, B., & Duboule, D. (2021) · Nature Communications · doi:10.1038/s41467-021-25330-y · Cited by 19
“In single cell RNA seq experiments, the proportion of zeros is highly anti-correlated with the mean expression value of the gene (Tung et al., 2017).”
BackgroundThe use of single-cell RNA-seq to study heterogeneity at varying levels of virus–host interactions
Swaminath, S., & Russell, A. B. (2024) · PLoS Pathogens · doi:10.1371/journal.ppat.1011898 · Cited by 22
“Regression analyses often find that replicate number is a significant source of signal in single cell analyses [74].”
BackgroundData Denoising and Post-Denoising Corrections in Single Cell RNA Sequencing
Agarwal, D., Wang, J., & Zhang, N. R. (2020) · Statistical Science · doi:10.1214/19-sts7560 · Cited by 26
“However, researchers have shown that the technical bias for spike-ins can be quite different from that for real genes (Tung et al., 2017), which has limited their practical utility.”
BackgroundDissecting the human immune system with single cell RNA sequencing technology
Xu, G., Liu, Y., Li, H., Liu, L., Zhang, S., & Zhang, Z. (2019) · Journal of Leukocyte Biology · doi:10.1002/jlb.5mr1019-179r · Cited by 19
Huang, I. J., Dheilly, N. M., Sirotkin, H. I., & McElroy, A. E. (2020) · Ecotoxicology and Environmental Safety · doi:10.1016/j.ecoenv.2020.110934 · Cited by 21
Recovery of biological signals lost in single-cell batch integration with CellANOVA
Zhang, Z., Mathew, D., Lim, T., Mason, K., Martinez, C. M., Huang, S., Wherry, E. J., Suszták, K., Minn, A. J., Ma, Z., et al. (2024) · Nature Biotechnology · doi:10.1038/s41587-024-02463-1 · Cited by 40
Fonseka, C. Y., Rao, D. A., & Raychaudhuri, S. (2017) · Current Opinion in Immunology · doi:10.1016/j.coi.2017.08.005 · Cited by 19
Huang, M. C., Zhang, Z., & Zhang, N. R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.03.234765 · Cited by 15
Dong, Z., & Alterovitz, G. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa669 · Cited by 22
scAllele: A versatile tool for the detection and analysis of variants in scRNA-seq
Quinones-Valdez, G., Fu, T., Chan, T. W., & Xiao, X. G. (2022) · Science Advances · doi:10.1126/sciadv.abn6398 · Cited by 17
Castaldo, R., Brancato, V., Cavaliere, C., Trama, F., Illiano, E., Costantini, E., Ragozzino, A., Salvatore, M., Nicolai, E., & Franzese, M. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm12010140 · Cited by 17
“Variations of mixed effect models include the nested fixed effect models and nested mixed effect models, which were designed for scRNAseq, and they belong to the single-gene-based methods, which ignore potential common information shared among all genes, which in turn might result in a loss of power [42].”
MethodSingle cell RNA-sequencing: replicability of cell types
Crow, M., & Gillis, J. (2019) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2018.12.002 · Cited by 18
Normalization by distributional resampling of high throughput single-cell RNA-sequencing data
Brown, J., Ni, Z., Mohanty, C., Bacher, R. L., & Kendziorski, C. M. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab450 · Cited by 18
Koot, E., Arnst, E., Taane, M., Goldsmith, K., Thrimawithana, A., Reihana, K., González-Martínez, S. C., Goldsmith, V., Houliston, G. J., & Chagné, D. (2022) · Horticulture Research · doi:10.1093/hr/uhab012 · Cited by 17
psupertime: supervised pseudotime inference for single cell RNA-seq data with sequential labelsPreprint
Macnair, W., & Claassen, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/622001 · Cited by 15
“[6] P.”
BackgroundCombination antiretroviral therapy and MCL-1 inhibition mitigate HTLV-1 infection in vivo
Cooney, J. P., Hirons, A., Jansz, N., Allison, C. C., Hickey, P. F., Teh, C. E., Tan, T., Dagley, L. F., Yousef, J. M., Yurick, D., et al. (2025) · Cell · doi:10.1016/j.cell.2025.06.023 · Cited by 18
Katayama, S., Skoog, T., Söderhäll, C., Einarsdóttir, E., Krjutškov, K., & Kere, J. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-3017-9 · Cited by 16
Shen, H., Shen, X., Feng, M., Wu, D., Zhang, C., Yang, Y., Yang, M., Hu, J., Liu, J., Wang, W., et al. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab573 · Cited by 20
Yekula, A., Tracz, J. A., Rincón-Torroella, J., Azad, T. D., & Bettegowda, C. (2022) · Brain Sciences · doi:10.3390/brainsci12070812 · Cited by 18
“Arguably, this is the greatest source of technical variation, contamination, and batch effect in any single cell study [26].”
BackgroundHDMC: a novel deep learning-based framework for removing batch effects in single-cell RNA-seq data
Wang, X., Wang, J., Zhang, H., Huang, S., & Yin, Y. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab821 · Cited by 16
He, Z., Pan, Y., Shao, F., & Wang, H. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.616686 · Cited by 17
Aliaghaei, M., & Haun, J. B. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2022.841046 · Cited by 19
“Traditional diagnostic methods provide information about biological traits that have been averaged over an entire population of cells, which masks cellto-cell variability and the presence of rare cell populations (Tung et al., 2017).”
MethodRaman Microscopic Identification of Microorganisms on Metal Surfaces via Support Vector Machines
Tewes, T. J., Kerst, M., Platte, F., & Bockmühl, D. P. (2022) · Microorganisms · doi:10.3390/microorganisms10030556 · Cited by 15
“Novel, culture-free methods such as single-cell sequencing [1,2] still have the disadvantage of requiring specific labels.”
MethodOne Cell At a Time (OCAT): a unified framework to integrate and analyze single-cell RNA-seq data
Wang, C. X., Zhang, L., & Wang, B. (2022) · Genome biology · doi:10.1186/s13059-022-02659-1 · Cited by 14
“Datasets generated by different sequencing platforms and technologies have inherent technical differences [14, 15], posing greater challenge to the integration task as the distributions of gene expressions vary significantly across the five datasets.”
BackgroundCharacterization and Optimization of Multiomic Single-Cell Epigenomic Profiling
Sandoval, L., Ismail, W. M., Mazzone, A., Dumbravă, M., Fernandez, J. A., Munankarmy, A., Lasho, T. L., Binder, M., Simon, V. A., Kim, K., et al. (2023) · Genes · doi:10.3390/genes14061245 · Cited by 16
“While the preparation process of working with scRNA-seq data is a significant source of variability [49], nuclei provide greater RNA stability and have a reproducible expression of transcripts when compared to whole cells [50].”
BackgroundSingle-Cell RNA-Sequencing: Opening New Horizons for Breast Cancer Research
Xiang, L., Rao, J., Yuan, J., Xie, T., & Yan, H. (2024) · International Journal of Molecular Sciences · doi:10.3390/ijms25179482 · Cited by 21
“Two popular microfluidic systems are the 10 × Genomics Chromium and FluidigmC1 systems, which have been demonstrated to provide multiple advantages over platforms that utilize droplets for capturing single cells [28,29].”
MethodDas, S., & Rai, S. N. (2021) · Genomics · doi:10.1016/j.ygeno.2021.02.014 · Cited by 16
Comparison of Scanpy-based algorithms to remove the batch effect from single-cell RNA-seq data
Li, J., Yu, C., Ma, L., Wang, J., & Guo, G. (2020) · Cell Regeneration · doi:10.1186/s13619-020-00041-9 · Cited by 15
Isolating and cryopreserving pig skin cells for single-cell RNA sequencing study
Han, L., Jara, C. P., Wang, O., Shi, Y., Wu, X., Thibivilliers, S., Wóycicki, R. K., Carlson, M. A., Velander, W. H., ARAUJO, E. P. D., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263869 · Cited by 13
Kannan, S., Farid, M., Lin, B. L., Miyamoto, M., & Kwon, C. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.04.02.022632 · Cited by 16
SCRIP: an accurate simulator for single-cell RNA sequencing data
Qin, F., Luo, X., Xiao, F., & Cai, G. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab824 · Cited by 12
Wang, X., Zhang, C., Zhang, Y., Meng, X., Zhang, Z., Shi, X., & Song, T. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23042082 · Cited by 15
Characterizing and inferring quantitative cell cycle phase in single-cell RNA-seq data analysisPreprint
Hsiao, C. J., Tung, P., Blischak, J., Burnett, J. E., Barr, K., Dey, K. K., Stephens, M., & Gilad, Y. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/526848 · Cited by 15
Self-citationModeling expression ranks for noise-tolerant differential expression analysis of scRNA-seq data
Gupta, K., Lalit, M., Biswas, A., Sanada, C. D., Greene, C., Hukari, K. W., Maulik, U., Bandyopadhyay, S., Ramalingam, N., Ahuja, G., et al. (2021) · Genome Research · doi:10.1101/gr.267070.120 · Cited by 15
“Tung data consist of single-cell transcriptomes of iPSCs generated from three different individuals, marked as NA19098, NA19101, and NA19239, respectively (Tung et al. 2017).”
BackgroundMethodInfluentialSarkar, S., & Ghosh, R. (2025) · BBA Advances · doi:10.1016/j.bbadva.2025.100169 · Cited by 17
“Sample preparation is crucial to getting a physiologically realistic depiction of the single-cell lipidome [45].”
Single-Cell RNA-Seq Technologies and Computational Analysis Tools: Application in Cancer Research
Song, Q., & Liu, L. (2022) · Methods in molecular biology · doi:10.1007/978-1-0716-1896-7_23 · Cited by 13
Rao, S., Zahm, M., Casemayou, A., Buléon, M., Faguer, S., Feuillet, G., Iacovoni, J. S., Joffre, O. P., Gonzalez-Fuentes, I., Lhuillier, É., et al. (2023) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfad199 · Cited by 16
Xie, J., Ruan, S., Tu, M., Yuan, Z., Hu, J., Li, H., & Li, S. (2024) · Oncogene · doi:10.1038/s41388-024-03074-5 · Cited by 12
A pheromone receptor in cichlid fish mediates attraction to females but inhibits male parental care
Li, C., Bowers, J. M., Alexander, T. A., Behrens, K. A., Jackson, P., Amini, C. J., & Juntti, S. A. (2024) · Current Biology · doi:10.1016/j.cub.2024.07.029 · Cited by 13
Worm Perturb-Seq: massively parallel whole-animal RNAi and RNA-seq
Zhang, H., Li, X., Song, D., Yukselen, O., Nanda, S., Küçükural, A., Li, J. J., Garber, M. G., & Walhout, A. J. M. (2025) · Nature Communications · doi:10.1038/s41467-025-60154-0 · Cited by 13
Application of single-cell transcriptomics to kinetoplastid research
Briggs, E. M., Warren, F., Matthews, K. R., McCulloch, R., & Otto, T. D. (2021) · Parasitology · doi:10.1017/s003118202100041x · Cited by 12
“…droplet-based methods, the cost can be reduced by mixing species with distinct transcriptomes that can be easily separated bioinformatically (Tung et al., 2017; Kang et al., 2018), as has been done with P. berghei and P. knowlesi (Reid et al., 2018; Howick et al., 2019), and T. brucei and…”
Vermillion, K. L., Bacher, R. L., Tannenbaum, A. P., Swanson, S. A., Jiang, P., Chu, L., Stewart, R. M., Thomson, J. A., & Vereide, D. T. (2018) · Developmental Biology · doi:10.1016/j.ydbio.2018.04.007 · Cited by 10
JIND: joint integration and discrimination for automated single-cell annotation
Goyal, M., Serrano, G., Argemí, J., Shomorony, I., Hernáez, M., & Ochoa, I. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac140 · Cited by 11
Metadata
- Authors
- Tung, P.-Y., Blischak, J. D., Hsiao, C. J., Knowles, D. A., Burnett, J. E., Pritchard, J. K., & Gilad, Y.
- Affiliations
- University of Chicago (US)
- Stanford Medicine (US)
- Howard Hughes Medical Institute (US)
- Corresponding author
- Gilad, Yoav
- Venue
- Scientific Reports
- Published
- 2017-01-03
- Volume
- 7
- Issue
- 1
- Pages
- 39921-39921
- ISSN
- 2045-2322 (ISSN-L)
- PMC
- PMC5206706
- OpenAlex
- W2951638683
- Cited by
- 356
- References
- 55
- Citations by year
- 2026: 23 · 2025: 35 · 2024: 32 · 2023: 22 · 2022: 38 · 2021: 41 · 2020: 52 · 2019: 42 · 2018: 36 · 2017: 31
- FWCI
- 18.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientific Reports (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Howard Hughes Medical Institute
- National Institutes of Health
- National Heart, Lung, and Blood Institute (R01HL092206, T32HL007381)
- National Institute of General Medical Sciences (T32GM007197)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- single-cell RNA sequencing, batch effects, technical variability, unique molecular identifiers, amplification bias, gene expression quantification, induced pluripotent stem cells, genotypic variation, research design
- MeSH terms
- Humans, RNA, Gene Expression, Sequence Analysis, RNA, Principal Component Analysis, Induced Pluripotent Stem Cells, Single-Cell Analysis, High-Throughput Nucleotide Sequencing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.