The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Selecting between-sample RNA-Seq normalization methods from the perspective of their assumptions
Open accessAbstract
RNA-Seq is a widely used method for studying the behavior of genes under different biological conditions. An essential step in an RNA-Seq study is normalization, in which raw data are adjusted to account for factors that prevent direct comparison of expression measures. Errors in normalization can have a significant impact on downstream analysis, such as inflated false positives in differential expression analysis. An underemphasized feature of normalization is the assumptions on which the methods rely and how the validity of these assumptions can have a substantial impact on the performance of the methods. In this article, we explain how assumptions provide the link between raw RNA-Seq read counts and meaningful measures of gene expression. We examine normalization methods from the perspective of their assumptions, as an understanding of methodological assumptions is necessary for choosing methods appropriate for the data at hand. Furthermore, we discuss why normalization methods perform poorly when their assumptions are violated and how this causes problems in subsequent analysis. To analyze a biological experiment, researchers must select a normalization method with assumptions that are met and that produces a meaningful measure of expression for the given experiment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp616 · Cited by 41,364
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
Trapnell, C., Williams, B. A., Pertea, G., Mortazavi, A., Kwan, G., van Baren, M. J., Salzberg, S. L., Wold, B. J., & Pachter, L. (2010) · Nature Biotechnology · doi:10.1038/nbt.1621 · Cited by 15,556
Mapping and quantifying mammalian transcriptomes by RNA-Seq
Mortazavi, A., Williams, B. A., McCue, K., Schaeffer, L., & Wold, B. (2008) · Nature Methods · doi:10.1038/nmeth.1226 · Cited by 13,696
RNA-Seq: a revolutionary tool for transcriptomics
Wang, Z., Gerstein, M., & Snyder, M. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2484 · Cited by 13,174
Bolstad, B. M., Irizarry, R. A., Åstrand, M., & Speed, T. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.185 · Cited by 8,266
A scaling normalization method for differential expression analysis of RNA-seq data
Robinson, M. D., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-3-r25 · Cited by 7,876
voom: precision weights unlock linear model analysis tools for RNA-seq read counts
Law, C. W., Chen, Y., Shi, W., & Smyth, G. K. (2014) · Genome Biology · doi:10.1186/gb-2014-15-2-r29 · Cited by 6,155
Differential analysis of gene regulation at transcript resolution with RNA-seq
Trapnell, C., Hendrickson, D. G., Sauvageau, M., Goff, L., Rinn, J. L., & Pachter, L. (2013) · Nature Biotechnology · doi:10.1038/nbt.2450 · Cited by 3,492
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204
Normalization of RNA-seq data using factor analysis of control genes or samples
Risso, D., Ngai, J., Speed, T. P., & Dudoit, S. (2014) · Nature Biotechnology · doi:10.1038/nbt.2931 · Cited by 2,052
Bullard, J. H., Purdom, E., Hansen, K. D., & Dudoit, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-94 · Cited by 1,680 · cited 10×
“Normalization for qRT-PCR often relies on housekeeping genes [10, 37, 38].”
BackgroundMethodInfluentialTranscriptional Amplification in Tumor Cells with Elevated c-Myc
Lin, C. Y., Lovén, J., Rahl, P. B., Paranal, R. M., Burge, C. B., Bradner, J. E., Lee, T. I., & Young, R. A. (2012) · Cell · doi:10.1016/j.cell.2012.08.026 · Cited by 1,513
Dillies, M.-A., Rau, A., Aubert, J., Hennequet-Antier, C., Jeanmougin, M., Servant, N., Keime, C., Marot, G., Castel, D., Estelle, J., et al. (2013) · Briefings in Bioinformatics · doi:10.1093/bib/bbs046 · Cited by 1,298
c-Myc Is a Universal Amplifier of Expressed Genes in Lymphocytes and Embryonic Stem Cells
Nie, Z., Hu, G., Wei, G., Cui, K., Yamane, A., Resch, W., Wang, R., Green, D. R., Tessarollo, L., Casellas, R., et al. (2012) · Cell · doi:10.1016/j.cell.2012.08.033 · Cited by 1,075
SEQC/MAQC-III Consortium (2014) · Nature Biotechnology · doi:10.1038/nbt.2957 · Cited by 983
GC-Content Normalization for RNA-Seq Data
Risso, D., Schwartz, K., Sherlock, G., & Dudoit, S. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-480 · Cited by 867
Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data
Rapaport, F., Khanin, R., Liang, Y., Pirun, M., Krek, A., Zumbo, P., Mason, C. E., Socci, N. D., & Betel, D. (2013) · Genome Biology · doi:10.1186/gb-2013-14-9-r95 · Cited by 733
From RNA-seq reads to differential expression results
Oshlack, A., Robinson, M. D., & Young, M. D. (2010) · Genome Biology · doi:10.1186/gb-2010-11-12-220 · Cited by 698
Synthetic spike-in standards for RNA-seq experiments
Jiang, L., Schlesinger, F., Davis, C. A., Zhang, Y., Li, R., Salit, M., Gingeras, T. R., & Oliver, B. (2011) · Genome Research · doi:10.1101/gr.121095.111 · Cited by 653
Revisiting Global Gene Expression Analysis
Lovén, J., Orlando, D. A., Sigova, A. A., Lin, C. Y., Rahl, P. B., Burge, C. B., Levens, D. L., Lee, T. I., & Young, R. A. (2012) · Cell · doi:10.1016/j.cell.2012.10.012 · Cited by 616
Transcript length bias in RNA-seq data confounds systems biology
Oshlack, A., & Wakefield, M. J. (2009) · Biology Direct · doi:10.1186/1745-6150-4-14 · Cited by 497 · cited 1×
“To convert raw read counts into informative measures of gene expression, normalization is needed to account for factors that affect the number of reads mapped to a gene, like length [5], GC-content [6] and sequencing depth [7].”
MethodNormalization, testing, and false discovery rate estimation for RNA-sequencing data
Li, J., Witten, D. M., Johnstone, I. M., & Tibshirani, R. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr031 · Cited by 369 · cited 2×
“Normalization by testing: PoissonSeq [30] uses an iterative process that alternates between estimating a set of non-differentially expressed genes, and estimating the scaling factor for each sample using that set.”
MethodLee, P. D., Sladek, R., Greenwood, C. M. T., & Hudson, T. J. (2002) · Genome Research · doi:10.1101/gr.217802 · Cited by 369
The beginning of the end for microarrays?
Shendure, J. (2008) · Nature Methods · doi:10.1038/nmeth0708-585 · Cited by 331
Hu, Z., Chen, K., Xia, Z., Chavez, M., Pal, S., Seol, J.-H., Chen, C.-C., Li, W., & Tyler, J. K. (2014) · Genes & Development · doi:10.1101/gad.233221.113 · Cited by 330
RNA-seq: technical variability and sampling
McIntyre, L. M., Lopiano, K. K., Morse, A. M., Amin, V., Oberg, A. L., Young, L. J., & Nuzhdin, S. V. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-293 · Cited by 285
The Overlooked Fact: Fundamental Need for Spike-In Control for Virtually All Genome-Wide Analyses
Chen, K., Hu, Z., Xia, Z., Zhao, D., Li, W., & Tyler, J. K. (2016) · Molecular and Cellular Biology · doi:10.1128/mcb.00970-14 · Cited by 210
Li, P., Piao, Y., Shon, H. S., & Ryu, K. H. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0778-7 · Cited by 187
Lin, Y., Golovnina, K., Chen, Z.-X., Lee, H. N., Negron, Y. L. S., Sultana, H., Oliver, B., & Harbison, S. T. (2016) · BMC Genomics · doi:10.1186/s12864-015-2353-z · Cited by 171
Comparison of normalization methods for differential gene expression analysis in RNA-Seq experiments
Maza, É., Frasse, P., Senin, P., Bouzayen, M., & Zouine, M. (2013) · Communicative & Integrative Biology · doi:10.4161/cib.25849 · Cited by 146
The Impact of Normalization Methods on RNA-Seq Data Analysis
Zyprych-Walczak, J., Szabelska‐Beręsewicz, A., Handschuh, L., Górczak, K., Klamecka, K., Figlerowicz, M., & Siatkowski, I. (2015) · BioMed Research International · doi:10.1155/2015/621690 · Cited by 127
A normalization strategy for comparing tag count data
Kadota, K., Nishiyama, T., & Shimizu, K. (2012) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-7-5 · Cited by 108
"Per cell" normalization method for mRNA measurement by quantitative PCR and microarrays
Kanno, J., Aisaki, K., Igarashi, K., et al. (2006) · BMC Genomics · doi:10.1186/1471-2164-7-64 · Cited by 100
Dormant non-culturable Mycobacterium tuberculosis retains stable low-abundant mRNA
Ignatov, D., Salina, E. G., Fursov, M. V., Skvortsov, T., Azhikina, T. L., & Kaprelyants, A. S. (2015) · BMC Genomics · doi:10.1186/s12864-015-2197-6 · Cited by 95
Variation in transcriptome size: are we getting the message?
Coate, J. E., & Doyle, J. J. (2014) · Chromosoma · doi:10.1007/s00412-014-0496-3 · Cited by 77
Qing, T., Yu, Y., Du, T., & Shi, L. M. (2013) · Science China Life Sciences · doi:10.1007/s11427-013-4437-9 · Cited by 45
Differential expression--the next generation and beyond
Auer, P. L., Srivastava, S., & Doerge, R. W. (2011) · Briefings in Functional Genomics · doi:10.1093/bfgp/elr041 · Cited by 40
Systematic comparison of RNA-Seq normalization methods using measurement error models
Sun, Z., & Zhu, Y. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts497 · Cited by 29
Cited by
Zhao, Y., Li, M.-C., Konaté, M. M., Chen, L., Das, B., Karlovich, C., Williams, P. M., Evrard, Y. A., Doroshow, J. H., & McShane, L. M. (2021) · Journal of Translational Medicine · doi:10.1186/s12967-021-02936-w · Cited by 489
Misuse of RPKM or TPM normalization when comparing across samples and sequencing protocols
Zhao, S., Ye, Z., & Stanton, R. (2020) · RNA · doi:10.1261/rna.074922.120 · Cited by 460
Benchmarking of cell type deconvolution pipelines for transcriptomics data
Avila Cobos, F., Alquicira-Hernandez, J., Powell, J. E., Mestdagh, P., & De Preter, K. (2020) · Nature Communications · doi:10.1038/s41467-020-19015-1 · Cited by 446
zUMIs - A fast and flexible pipeline to process RNA sequencing data with UMIs
Parekh, S., Ziegenhain, C., Vieth, B., Enard, W., & Hellmann, I. (2018) · GigaScience · doi:10.1093/gigascience/giy059 · Cited by 380
A systematic evaluation of single cell RNA-seq analysis pipelines
Vieth, B., Parekh, S., Ziegenhain, C., Enard, W., & Hellmann, I. (2019) · Nature Communications · doi:10.1038/s41467-019-12266-7 · Cited by 265
Metadata
- Authors
- Evans, C., Hardin, J., & Stoebel, D. M.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-27
- Volume
- 19
- Issue
- 5
- Pages
- 776-792
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W2511704020
- Cited by
- 374
- References
- 41
- FWCI
- 7.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.