The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
A comprehensive evaluation of normalization methods for Illumina high-throughput RNA sequencing data analysis
Open accessAbstract
During the last 3 years, a number of approaches for the normalization of RNA sequencing data have emerged in the literature, differing both in the type of bias adjustment and in the statistical strategy adopted. However, as data continue to accumulate, there has been no clear consensus on the appropriate normalization method to be used or the impact of a chosen method on the downstream analysis. In this work, we focus on a comprehensive comparison of seven recently proposed normalization methods for the differential analysis of RNA-seq data, with an emphasis on the use of varied real and simulated datasets involving different species and experimental designs to represent data characteristics commonly observed in practice. Based on this comparison study, we propose practical recommendations on the appropriate normalization method to be used and its impact on the differential analysis of RNA-seq data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome
Li, B., & Dewey, C. N. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-323 · Cited by 22,179
Full-length transcriptome assembly from RNA-Seq data without a reference genome
Grabherr, M. G., Haas, B. J., Yassour, M., Levin, J. Z., Thompson, D. A., Amit, I., Adiconis, X., Fan, L., Raychowdhury, R., Zeng, Q., et al. (2011) · Nature Biotechnology · doi:10.1038/nbt.1883 · Cited by 21,039
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
Trapnell, C., Williams, B. A., Pertea, G., Mortazavi, A., Kwan, G., van Baren, M. J., Salzberg, S. L., Wold, B. J., & Pachter, L. (2010) · Nature Biotechnology · doi:10.1038/nbt.1621 · Cited by 15,556
Mapping and quantifying mammalian transcriptomes by RNA-Seq
Mortazavi, A., Williams, B. A., McCue, K., Schaeffer, L., & Wold, B. (2008) · Nature Methods · doi:10.1038/nmeth.1226 · Cited by 13,696
RNA-Seq: a revolutionary tool for transcriptomics
Wang, Z., Gerstein, M., & Snyder, M. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2484 · Cited by 13,174
Gene expression profiling predicts clinical outcome of breast cancer
van 't Veer, L. J., Dai, H., van de Vijver, M. J., He, Y. D., Hart, A. A. M., Mao, M., Peterse, H. L., van der Kooy, K., Marton, M. J., Witteveen, A. T., et al. (2002) · Nature · doi:10.1038/415530a · Cited by 9,536
Bolstad, B. M., Irizarry, R. A., Åstrand, M., & Speed, T. P. (2003) · Bioinformatics · doi:10.1093/bioinformatics/19.2.185 · Cited by 8,266
A scaling normalization method for differential expression analysis of RNA-seq data
Robinson, M. D., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-3-r25 · Cited by 7,876
Gene ontology analysis for RNA-seq: accounting for selection bias
Young, M. D., Wakefield, M. J., Smyth, G. K., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-2-r14 · Cited by 7,107
limma: Linear Models for Microarray Data
Smyth, G. K. (2005) · Statistics for Biology and Health · doi:10.1007/0-387-29362-0_23 · Cited by 5,796
Repeated observation of breast tumor subtypes in independent gene expression data sets
Sørlie, T., Tibshirani, R., Parker, J., Hastie, T., Marron, J. S., Nobel, A., Deng, S., Johnsen, H., Pesich, R., Geisler, S., et al. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0932692100 · Cited by 5,429
Alternative isoform regulation in human tissue transcriptomes
Wang, E. T., Sandberg, R., Luo, S., Khrebtukova, I., Zhang, L., Mayr, C., Kingsmore, S. F., Schroth, G. P., & Burge, C. B. (2008) · Nature · doi:10.1038/nature07509 · Cited by 5,181
Pan, Q., Shai, O., Lee, L. J., Frey, B. J., & Blencowe, B. J. (2008) · Nature Genetics · doi:10.1038/ng.259 · Cited by 3,951
A gene atlas of the mouse and human protein-encoding transcriptomes
Su, A. I., Wiltshire, T., Batalov, S., Lapp, H., Ching, K. A., Block, D., Zhang, J., Soden, R., Hayakawa, M., Kreiman, G., et al. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0400782101 · Cited by 3,475
Bioinformatics and Computational Biology Solutions Using R and Bioconductor
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-29362-0 · Cited by 3,289
Microarray data normalization and transformation
Quackenbush, J. (2002) · Nature Genetics · doi:10.1038/ng1032 · Cited by 1,975
Bullard, J. H., Purdom, E., Hansen, K. D., & Dudoit, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-94 · Cited by 1,680
Detecting differential usage of exons from RNA-seq data
Anders, S., Reyes, A., & Huber, W. (2012) · Genome Research · doi:10.1101/gr.133744.111 · Cited by 1,545
Oases:robust de novo RNA-seq assembly across the dynamic range of expression levels
Schulz, M. H., Zerbino, D. R., Vingron, M., & Birney, E. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts094 · Cited by 1,424
Understanding mechanisms underlying human gene expression variation with RNA sequencing
Pickrell, J. K., Marioni, J. C., Pai, A. A., Degner, J. F., Engelhardt, B. E., Nkadori, E., Veyrieras, J.-B., Stephens, M., Gilad, Y., & Pritchard, J. K. (2010) · Nature · doi:10.1038/nature08872 · Cited by 1,256
Guttman, M., Garber, M., Levin, J. Z., Donaghey, J., Robinson, J., Adiconis, X., Fan, L., Koziol, M. J., Gnirke, A., Nusbaum, C., et al. (2010) · Nature Biotechnology · doi:10.1038/nbt.1633 · Cited by 1,253
De novo assembly and analysis of RNA-seq data
Robertson, G., Schein, J., Chiu, R., Corbett, R., Field, M., Jackman, S. D., Mungall, K., Lee, S., Okada, H. M., Qian, J. Q., et al. (2010) · Nature Methods · doi:10.1038/nmeth.1517 · Cited by 998
Transcriptome sequencing to detect gene fusions in cancer
Maher, C. A., Kumar-Sinha, C., Cao, X., Kalyana-Sundaram, S., Han, B., Jing, X., Sam, L., Barrette, T., Palanisamy, N., & Chinnaiyan, A. M. (2009) · Nature · doi:10.1038/nature07638 · Cited by 900
GC-Content Normalization for RNA-Seq Data
Risso, D., Schwartz, K., Sherlock, G., & Dudoit, S. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-480 · Cited by 867
Comprehensive comparative analysis of strand-specific RNA sequencing methods
Levin, J. Z., Yassour, M., Adiconis, X., Nusbaum, C., Thompson, D. A., Friedman, N., Gnirke, A., & Regev, A. (2010) · Nature Methods · doi:10.1038/nmeth.1491 · Cited by 753
Human housekeeping genes are compact
Eisenberg, E., & Levanon, E. Y. (2003) · Trends in Genetics · doi:10.1016/s0168-9525(03)00140-9 · Cited by 698
From RNA-seq reads to differential expression results
Oshlack, A., Robinson, M. D., & Young, M. D. (2010) · Genome Biology · doi:10.1186/gb-2010-11-12-220 · Cited by 698
Removing technical variability in RNA-seq data using conditional quantile normalization
Hansen, K. D., Irizarry, R. A., & WU, Z. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr054 · Cited by 607
RNA-seq: from technology to biology
Marguerat, S., & Bähler, J. (2010) · Cellular and Molecular Life Sciences · doi:10.1007/s00018-009-0180-6 · Cited by 531
Transcript length bias in RNA-seq data confounds systems biology
Oshlack, A., & Wakefield, M. J. (2009) · Biology Direct · doi:10.1186/1745-6150-4-14 · Cited by 497 · cited 2×
“Even in cases where a strong positive association between gene counts and length is observed, scaling counts by gene length with RPKM is not sufficient for removing this bias [16, 20].”
BackgroundJeffery, I. B., Higgins, D. G., & Culhane, A. C. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-359 · Cited by 355
Strub, T., Giuliano, S., Ye, T., Bonet, C., Keime, C., Kobi, D., Le Gras, S., Cormont, M., Ballotti, R., Bertolotto, C., et al. (2011) · Oncogene · doi:10.1038/onc.2010.612 · Cited by 269
Self-citationJeanmougin, M., de Reyniès, A., Marisa, L., Paccard, C., Nuel, G., & Guedj, M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012336 · Cited by 182
Self-citationEvaluation of normalization methods for microarray data
Park, T., Yi, S.-G., Kang, S.-H., Lee, S., Lee, Y.-S., & Simon, R. (2003) · BMC Bioinformatics · doi:10.1186/1471-2105-4-33 · Cited by 174
Hoffmann, R. F. G., Seidl, T., & Dugas, M. (2002) · Genome biology · doi:10.1186/gb-2002-3-7-research0033 · Cited by 157
Liu, S., Lin, L., Jiang, P., Wang, D., & Xing, Y. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq817 · Cited by 146
A Two-Stage Poisson Model for Testing RNA-Seq Data
Auer, P. L., & Doerge, R. W. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1627 · Cited by 139
Normalization for two-color cDNA microarray data
Yang, J. Y. H., & Thorne, N. (2003) · Lecture notes-monograph series · doi:10.1214/lnms/1215091155 · Cited by 139
Shedden, K., Chen, W., Kuick, R. D., Ghosh, D., MacDonald, J. W., Cho, K. R., Giordano, T. J., Gruber, S. B., Fearon, E. R., Taylor, J. M. G., et al. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-26 · Cited by 130
A normalization strategy for comparing tag count data
Kadota, K., Nishiyama, T., & Shimizu, K. (2012) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-7-5 · Cited by 127
Evaluation of methods for oligonucleotide array data via quantitative real-time PCR
Qin, L., Beyer, R. P., Hudson, F. N., Linford, N. J., Morris, D. E., & Kerr, K. F. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-23 · Cited by 113
Deep sequencing-based analysis of the anaerobic stimulon in Neisseria gonorrhoeae
Isabella, V. M., & Clark, V. L. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-51 · Cited by 84
Science and Statistics: A Festschrift for Terry Speed
Goldstein, D. R. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 52
Consolidated strategy for the analysis of microarray spike-in data
McCall, M. N., & Irizarry, R. A. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn430 · Cited by 34
Genetic Linkage Analysis in the Presence of Germline Mosaicism
Weissbrod, O., & Geiger, D. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1709 · Cited by 22
Normalization of Gene-Expression Microarray Data
Calza, S., & Yudi Pawitan, Y. (2010) · Methods in molecular biology · doi:10.1007/978-1-60761-842-3_3 · Cited by 18
Research works printed but not linked: 11
- 2010, 11, 909
- 2009, Nature; Physical Science (London), 4587234, 97
- 2010, 79, 709
- 2010, Cellular and molecular life sciences : CMLS, 674, 569
- 2010, Genome biology, 11106, R106
- Jaffrezic, 2007, Genetical research, 89, 19, 10.1017/S0016672307008646 · DOI
- 2003, Trends in genetics : TIG, 197, 362
- 2004, PNAS, 10116, 6062
- 2011, 10, 1
- 2002, Genome biology, 3, research0033, 10.1186/gb-2002-3-7-reports0033 · doi:10.1186/gb-2002-3-7-reports0033
- 2010, Genome biology, 112, R14
Cited by
jvenn: an interactive Venn diagram viewer
Bardou, P., Mariette, J., Escudié, F., Djemiel, C., & Klopp, C. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-293 · Cited by 2,489
Early allopolyploid evolution in the post-Neolithic Brassica napus oilseed genome
Chalhoub, B., Denoeud, F., Liu, S., Parkin, I. A. P., Tang, H., Wang, X., Chiquet, J., Belcram, H., Tong, C., Samans, B., et al. (2014) · Science · doi:10.1126/science.1253435 · Cited by 2,479
Current best practices in single-cell RNA-seq analysis: a tutorial
Luecken, M. D., & Theis, F. J. (2019) · Molecular Systems Biology · doi:10.15252/msb.20188746 · Cited by 2,231
Normalization of RNA-seq data using factor analysis of control genes or samples
Risso, D., Ngai, J., Speed, T. P., & Dudoit, S. (2014) · Nature Biotechnology · doi:10.1038/nbt.2931 · Cited by 2,052
Normalization and microbial differential abundance strategies depend upon data characteristics
Weiss, S., Xu, Z. Z., Peddada, S., Amir, A., Bittinger, K., Gonzalez, A., Lozupone, C., Zaneveld, J. R., Vázquez-Baeza, Y., Birmingham, A., et al. (2017) · Microbiome · doi:10.1186/s40168-017-0237-y · Cited by 2,051
Metadata
- Authors
- Dillies, M.-A., Rau, A., Aubert, J., Hennequet-Antier, C., Jeanmougin, M., Servant, N., Keime, C., Marot, G., Castel, D., Estelle, J., Guernec, G., Jagla, B., Jouneau, L., Laloe, D., Le Gall, C., Schaeffer, B., Le Crom, S., Guedj, M., Jaffrezic, F., & on behalf of The French StatOmique Consortium
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-09-17
- Volume
- 14
- Issue
- 6
- Pages
- 671-683
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W2165909549
- Cited by
- 1,298
- References
- 48
- FWCI
- 30.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.