Normalization of single-cell RNA-seq counts by log( x + 1) or log(1 + x )
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
(a) Changes in ACE2 expression in the lungs of eight 3-month old mice and seven 24-month old mice after log1p transformation of the raw counts on the cells with non-zero ACE2 expression. The P-value was computed using a t-test. (b) Changes in ACE2 expression as determined by the fraction of ACE2 positive cells. The P-value was computed using a t-test. (c) A comparison of the naïve estimate of the expectation of log1p (red) to the Taylor approximation of the expectation of log1p (blue), with the dashed black line of slope 1 showing the asymptomatic behavior log(1+λ)≈ log(λ) (a) Changes in ACE2 expression in the lungs of eight 3-month old mice and seven 24-month old mice after log1p transformation of the raw counts on the cells with non-zero ACE2 expression. The P-value was computed using a t-test. (b) Changes in ACE2 expression as determined by the fraction of ACE2 positive cells. The P-value was computed using a t-test. (c) A comparison of the naïve estimate of the expectation of log1p (red) to the Taylor approximation of the expectation of log1p (blue), with the dashed black line of slope 1 showing the asymptomatic behavior log(1+λ)≈ log(λ) While this is approximately λ when λ is large, it is close to 1 when λ is small (de L’Hospital, 1768). Figure 1b shows the fraction of cells containing at least one copy of ACE2 (Booeshaghi and Pachter, 2020). Evidently, Figure 1a creates a misleading impression. While it may appear that average ACE2 expression is similar between young and old mice, when comparing the fraction of cells with non-zero expression of ACE2 it is clear that ACE2 has significantly lower mRNA expression in the lungs of aged mice than young mice. Since f is approximately equal to this expression when f is small, this provides an interpretation of the fraction of cells with at least one copy of a low-abundance gene as an estimate of the rate parameter λ in a Poisson distribution. Another mistake that we’ve found to be common in reporting ACE2 expression has to do with the log transformation, frequently used as part of a normalization of counts. Counts are log transformed for two reasons: the first is to stabilize the variance, as the log transform has the property that it stabilizes the variance for random variables whose variance is quadratic in the mean (Bartlett, 1947; Yeo and Johnson, 2000). There are two main considerations for this step: first when performing PCA on the gene expression matrix to find a reduced-dimensional representation that captures the variance, it is desirable that all genes contribute equally. The second consideration for the log transform is that it converts multiplicative relative changes to additive differences. In the context of PCA, this allows for interpreting the projection axes in terms of relative, rather than absolute, abundances of genes. This shows that for low-expressed genes, the average log1p expression can differ considerably from log(λ), with the maximum difference according to the Taylor approximation at λ≈1. (see Fig. 1c). Thus, while a 2-fold change for large λ translates to a log(2) difference after log1p, that is not the case for small λ. In summary, while single-cell RNA-seq atlases offer detailed information about the transcriptomic profiles of distinct cell types, their use to examine specific genes, as has been done recently in the study of SARS-CoV-2 infection related genes, requires care. Methods should not be used unless their limitations are understood. For example, while it does not matter whether one uses log(x+1) or log(1+x), the filtering and normalization applied to counts can affect comparative estimates in non-intuitive ways. For example, the SCnorm normalization (Bacher et al., 2017) is based on a preliminary filter for all cells with at least one count, thus subjecting the method to the problem seen in Figure 1a and b. Indeed, there have been reports of problems with SCnorm when applying the method to sparse datasets with many zeroes (Tian et al., 2019), leading to the development of methods that account for this (Hafemeister and Satija, 2019). Moreover, there are subtle problems that arise when working with small counts that transcend the elementary issues we have raised (Lun, 2018; Warton, 2018). These matters are not theoretical; we leave the identification of published preprints and papers that have ignored the issues we’ve raised, and hence reported misleading results, as another exercise for the reader. The authors thank Charles Herring, Michael Hoffman, Johan Gustafsson, Harold Pimentel, Jeffrey Spence and Valentine Svensson for helpful comments. Data and code that reproduce the results in this paper are available here: https://github.com/pachterlab/BP_2021_2. A.S.B. and L.P. were partially funded by National Institutes of Health [U19MH114830]. Conflict of Interest: none declared.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hafemeister, C., & Satija, R. (2019) · Genome Biology · doi:10.1186/s13059-019-1874-1 · Cited by 4,479
Zhang, H., Penninger, J. M., Li, Y., Zhong, N., & Slutsky, A. S. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-05985-9 · Cited by 2,684
RNA virus interference via CRISPR/Cas13a system in plants
Aman, R., Ali, Z., Butt, H., Mahas, A., Aljedaani, F., Khan, M. Z., Ding, S., & Mahfouz, M. (2018) · Genome Biology · doi:10.1186/s13059-017-1381-1 · Cited by 1,497
SCnorm: robust normalization of single-cell RNA-seq data
Bacher, R., Chu, L.-F., Leng, N., Gasch, A. P., Thomson, J. A., Stewart, R. M., Newton, M., & Kendziorski, C. (2017) · Nature Methods · doi:10.1038/nmeth.4263 · Cited by 282
Observation weights unlock bulk RNA-seq tools for zero inflation and single-cell applications
Van den Berge, K., Perraudeau, F., Soneson, C., Love, M. I., Risso, D., Vert, J.-P., Robinson, M. D., Dudoit, S., & Clement, L. (2018) · Genome Biology · doi:10.1186/s13059-018-1406-4 · Cited by 228
UCSC Genome Browser enters 20th year
Lee, C. M., Barber, G. P., Casper, J., Clawson, H., Diekhans, M., Gonzalez, J. N., Hinrichs, A. S., Lee, B. T., Nassar, L. R., Powell, C. C., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz1012 · Cited by 191
Cited by
Does the human placenta express the canonical cell entry mediators for SARS-CoV-2?
Pique-Regi, R., Romero, R., Tarca, A. L., Luca, F., Xu, Y., Alazizi, A., Leng, Y., Hsu, C.-D., & Gomez-Lopez, N. (2020) · eLife · doi:10.7554/elife.58716 · Cited by 283
CellVGAE: an unsupervised scRNA-seq analysis workflow with graph attention networks
Buterez, D., Bica, I., Tariq, I., Andrés-Terré, H., & Liò, P. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab804 · Cited by 44
Normalization for sampled count data
Booeshaghi, A. S., Hallgrímsdóttir, I. B., Gálvez-Merchán, Á., & Pachter, L. (2022) · doi:10.1101/2022.05.06.490859 · Cited by 39
Self-citationBai, D., Mo, S., Zhang, R., Luo, Y., Gao, J., Yang, J. P., Wu, Q., Rahmani, H., Amariuta, T., Grotjahn, D., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-69102-y · Cited by 15
Metadata
- Authors
- Booeshaghi, A. S., & Pachter, L.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-03-02
- Volume
- 37
- Issue
- 15
- Pages
- 2223-2224
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W3134779741
- Cited by
- 77
- References
- 6
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.