The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
A Comparative Study of Techniques for Differential Expression Analysis on RNA-Seq Data
Open accessAbstract
Recent advances in next-generation sequencing technology allow high-throughput cDNA sequencing (RNA-Seq) to be widely applied in transcriptomic studies, in particular for detecting differentially expressed genes between groups. Many software packages have been developed for the identification of differentially expressed genes (DEGs) between treatment groups based on RNA-Seq data. However, there is a lack of consensus on how to approach an optimal study design and choice of suitable software for the analysis. In this comparative study we evaluate the performance of three of the most frequently used software tools: Cufflinks-Cuffdiff2, DESeq and edgeR. A number of important parameters of RNA-Seq technology were taken into consideration, including the number of replicates, sequencing depth, and balanced vs. unbalanced sequencing depth within and between groups. We benchmarked results relative to sets of DEGs identified through either quantitative RT-PCR or microarray. We observed that edgeR performs slightly better than DESeq and Cuffdiff2 in terms of the ability to uncover true positives. Overall, DESeq or taking the intersection of DEGs from two or more tools is recommended if the number of false positives is a major concern in the study. In other circumstances, edgeR is slightly preferable for differential expression analysis at the expense of potentially introducing more false positives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Sequence Alignment/Map format and SAMtools
Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R., & 1000 Genome Project Data Processing Subgroup (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp352 · Cited by 62,041
Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp616 · Cited by 41,364
RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome
Li, B., & Dewey, C. N. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-323 · Cited by 22,179
Full-length transcriptome assembly from RNA-Seq data without a reference genome
Grabherr, M. G., Haas, B. J., Yassour, M., Levin, J. Z., Thompson, D. A., Amit, I., Adiconis, X., Fan, L., Raychowdhury, R., Zeng, Q., et al. (2011) · Nature Biotechnology · doi:10.1038/nbt.1883 · Cited by 21,039
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
Trapnell, C., Williams, B. A., Pertea, G., Mortazavi, A., Kwan, G., van Baren, M. J., Salzberg, S. L., Wold, B. J., & Pachter, L. (2010) · Nature Biotechnology · doi:10.1038/nbt.1621 · Cited by 15,556
RNA-Seq: a revolutionary tool for transcriptomics
Wang, Z., Gerstein, M., & Snyder, M. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2484 · Cited by 13,174
Trapnell, C., Roberts, A., Goff, L., Pertea, G., Kim, D., Kelley, D. R., Pimentel, H., Salzberg, S. L., Rinn, J. L., & Pachter, L. (2012) · Nature Protocols · doi:10.1038/nprot.2012.016 · Cited by 12,116
TopHat: discovering splice junctions with RNA-Seq
Trapnell, C., Pachter, L., & Salzberg, S. L. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp120 · Cited by 11,617
A scaling normalization method for differential expression analysis of RNA-seq data
Robinson, M. D., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-3-r25 · Cited by 7,876
Alternative isoform regulation in human tissue transcriptomes
Wang, E. T., Sandberg, R., Luo, S., Khrebtukova, I., Zhang, L., Mayr, C., Kingsmore, S. F., Schroth, G. P., & Burge, C. B. (2008) · Nature · doi:10.1038/nature07509 · Cited by 5,181
Pan, Q., Shai, O., Lee, L. J., Frey, B. J., & Blencowe, B. J. (2008) · Nature Genetics · doi:10.1038/ng.259 · Cited by 3,951
Differential analysis of gene regulation at transcript resolution with RNA-seq
Trapnell, C., Hendrickson, D. G., Sauvageau, M., Goff, L., Rinn, J. L., & Pachter, L. (2013) · Nature Biotechnology · doi:10.1038/nbt.2450 · Cited by 3,492
RNA-seq: An assessment of technical reproducibility and comparison with gene expression arrays
Marioni, J. C., Mason, C. E., Mane, S. M., Stephens, M., & Gilad, Y. (2008) · Genome Research · doi:10.1101/gr.079558.108 · Cited by 2,771
The Transcriptional Landscape of the Yeast Genome Defined by RNA Sequencing
Nagalakshmi, U., Wang, Z., Waern, K., Shou, C., Raha, D., Gerstein, M., & Snyder, M. (2008) · Science · doi:10.1126/science.1158441 · Cited by 2,479
MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126
Bullard, J. H., Purdom, E., Hansen, K. D., & Dudoit, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-94 · Cited by 1,680
Differential expression in RNA-seq: A matter of depth
Tarazona, S., García-Alcalde, F., Dopazo, J., Ferrer, A., & Conesa, A. (2011) · Genome Research · doi:10.1101/gr.124321.111 · Cited by 1,632
Detecting differential usage of exons from RNA-seq data
Anders, S., Reyes, A., & Huber, W. (2012) · Genome Research · doi:10.1101/gr.133744.111 · Cited by 1,545
Oases:robust de novo RNA-seq assembly across the dynamic range of expression levels
Schulz, M. H., Zerbino, D. R., Vingron, M., & Birney, E. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts094 · Cited by 1,424
Understanding mechanisms underlying human gene expression variation with RNA sequencing
Pickrell, J. K., Marioni, J. C., Pai, A. A., Degner, J. F., Engelhardt, B. E., Nkadori, E., Veyrieras, J.-B., Stephens, M., Gilad, Y., & Pritchard, J. K. (2010) · Nature · doi:10.1038/nature08872 · Cited by 1,256
De novo assembly and analysis of RNA-seq data
Robertson, G., Schein, J., Chiu, R., Corbett, R., Field, M., Jackman, S. D., Mungall, K., Lee, S., Okada, H. M., Qian, J. Q., et al. (2010) · Nature Methods · doi:10.1038/nmeth.1517 · Cited by 998
A comparison of methods for differential expression analysis of RNA-seq data
Soneson, C., & Delorenzi, M. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-91 · Cited by 887
Ballgown bridges the gap between transcriptome assembly and expression analysis
Frazee, A. C., Pertea, G., Jaffe, A. E., Langmead, B., Salzberg, S. L., & Leek, J. T. (2015) · Nature Biotechnology · doi:10.1038/nbt.3172 · Cited by 867
Moderated statistical tests for assessing differences in tag abundance
Robinson, M. D., & Smyth, G. K. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm453 · Cited by 856
baySeq: Empirical Bayesian methods for identifying differential expression in sequence count data
Hardcastle, T. J., & Kelly, K. A. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-422 · Cited by 756
Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data
Rapaport, F., Khanin, R., Liang, Y., Pirun, M., Krek, A., Zumbo, P., Mason, C. E., Socci, N. D., & Betel, D. (2013) · Genome Biology · doi:10.1186/gb-2013-14-9-r95 · Cited by 733
Biases in Illumina transcriptome sequencing caused by random hexamer priming
Hansen, K. D., Brenner, S. E., & Dudoit, S. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq224 · Cited by 713 · cited 1×
“biases introduced during library preparation, nucleotide-specific and read-position specific biases in sequence quality and error rate) [16,17]; 2) biases of abundance measures due to the effects of nucleotide composition and the varying length of genes or transcripts [5]; 3) undetermined effects of both sequencing de…”
BackgroundFrom RNA-seq reads to differential expression results
Oshlack, A., Robinson, M. D., & Young, M. D. (2010) · Genome Biology · doi:10.1186/gb-2010-11-12-220 · Cited by 698
RNA-seq differential expression studies: more sequence or more replication?
Liu, Y., Zhou, J., & White, K. P. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btt688 · Cited by 497
Optimizing de novo transcriptome assembly from short-read RNA-Seq data: a comparative study
Zhao, Q.-Y., Wang, Y., Kong, Y.-M., Luo, D., Li, X., & Hao, P. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-s14-s2 · Cited by 479
Self-citationLi, J., & Tibshirani, R. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280211428386 · Cited by 437
Comparison of software packages for detecting differential expression in RNA-seq studies
Seyednasrollah, F., Laiho, A., & Elo, L. L. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbt086 · Cited by 421
Normalization, testing, and false discovery rate estimation for RNA-sequencing data
Li, J., Witten, D. M., Johnstone, I. M., & Tibshirani, R. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr031 · Cited by 369
Transcriptomics in the RNA-seq era
McGettigan, P. A. (2013) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2012.12.008 · Cited by 358
Morin, R. D., Bainbridge, M., Fejes, A., Hirst, M., Krzywinski, M., Pugh, T. J., McDonald, H., Varhol, R., Jones, S. J. M., & Marra, M. A. (2008) · BioTechniques · doi:10.2144/000112900 · Cited by 342
RNA-seq: technical variability and sampling
McIntyre, L. M., Lopiano, K. K., Morse, A. M., Amin, V., Oberg, A. L., Young, L. J., & Nuzhdin, S. V. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-293 · Cited by 285
A comparison of statistical methods for detecting differentially expressed genes from RNA‐seq data
Kvam, V. M., Liu, P., & Si, Y. (2012) · American Journal of Botany · doi:10.3732/ajb.1100340 · Cited by 281
Design and validation issues in RNA-seq experiments
Fang, Z., & Cui, X. (2011) · Briefings in Bioinformatics · doi:10.1093/bib/bbr004 · Cited by 230
Robles, J. A., Qureshi, S. E., Stephen, S. J., Wilson, S. R., Burden, C. J., & Taylor, J. M. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-484 · Cited by 198
The NBP Negative Binomial Model for Assessing Differential Gene Expression from RNA-Seq
Di, Y., Schafer, D. W., Cumbie, J. S., & Chang, J. H. (2011) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1637 · Cited by 191
Norepinephrine Directly Activates Adult Hippocampal Precursors via β3-Adrenergic Receptors
Jhaveri, D. J., Mackay, E. W., Hamlin, A. S., Marathe, S. V., Nandam, L. S., Vaidya, V. A., & Bartlett, P. F. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.3780-09.2010 · Cited by 174
Self-citationNacu, S., Yuan, W., Kan, Z., Bhatt, D., Rivers, C. S., Stinson, J., Peters, B. A., Modrusan, Z., Jung, K., Seshagiri, S., et al. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-11 · Cited by 167
Comparative study of RNA-seq- and Microarray-derived coexpression networks in Arabidopsis thaliana
Giorgi, F. M., Del Fabbro, C., & Licausi, F. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt053 · Cited by 103
Bayesian analysis of RNA sequencing data by estimating multiple shrinkage priors
Van De Wiel, M. A., Leday, G. G. R., Pardo, L., Rue, H., Van Der Vaart, A. W., & Van Wieringen, W. N. (2013) · Biostatistics · doi:10.1093/biostatistics/kxs031 · Cited by 101
Identification of RNA bound to the TDP-43 ribonucleoprotein complex in the adult mouse brain
Narayanan, R. K., Mangelsdorf, M., Panwar, A., Butler, T. J., Noakes, P. G., & Wallace, R. H. (2012) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.3109/21678421.2012.734520 · Cited by 89
Self-citationNext Generation Sequencing Analysis of Human Platelet PolyA+ mRNAs and rRNA-Depleted Total RNA
Kissopoulou, A., Jonasson, J., Lindahl, T. L., & Osman, A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0081809 · Cited by 69
RNA-Seq Profiling Reveals Novel Hepatic Gene Expression Pattern in Aflatoxin B1 Treated Rats
Merrick, B. A., Phadke, D. P., Auerbach, S. S., Mav, D., Stiegelmeyer, S. M., Shah, R., & Tice, R. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061768 · Cited by 67
Evolution of orthologous tandemly arrayed gene clusters
Tremblay-Savard, O., Bertrand, D., & El-Mabrouk, N. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-s9-s2 · Cited by 49
Dasgupta, N., Xu, Y.-H., Oh, S., Sun, Y., Li, J., Keddache, M. A., & Grabowski, G. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074912 · Cited by 22
Wan, L., & Sun, F. (2012) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2012.83 · Cited by 17
Cited by
Translating RNA sequencing into clinical diagnostics: opportunities and challenges
Byron, S. A., Van Keuren-Jensen, K. R., Engelthaler, D. M., Carpten, J. D., & Craig, D. W. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.10 · Cited by 809
RNA-Seq differential expression analysis: An extended review and a software tool
Costa-Silva, J., Domingues, D., & Lopes, F. M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0190152 · Cited by 626
Elhoseny, M., Abdelaziz, A., Salama, A. S., Riad, A. M., Muhammad, K., & Sangaiah, A. K. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.03.005 · Cited by 341
Li, Y., Ge, X., Peng, F., Li, W., & Li, J. J. (2022) · Genome Biology · doi:10.1186/s13059-022-02648-4 · Cited by 303
Baccarella, A., Williams, C. R., Parrish, J. Z., & Kim, C. C. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2445-2 · Cited by 72
Metadata
- Authors
- Zhang, Z. H., Jhaveri, D. J., Marshall, V. M., Bauer, D. C., Edson, J., Narayanan, R. K., Robinson, G. J., Lundberg, A. E., Bartlett, P. F., Wray, N. R., & Zhao, Q.-Y.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-08-13
- Volume
- 9
- Issue
- 8
- Pages
- e103207
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2116528446
- Cited by
- 360
- References
- 51
- FWCI
- 12.78
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.