RNA-Seq Gene Profiling - A Systematic Empirical Comparison
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Accurately quantifying gene expression levels is a key goal of experiments using RNA-sequencing to assay the transcriptome. This typically requires aligning the short reads generated to the genome or transcriptome before quantifying expression of pre-defined sets of genes. Differences in the alignment/quantification tools can have a major effect upon the expression levels found with important consequences for biological interpretation. Here we address two main issues: do different analysis pipelines affect the gene expression levels inferred from RNA-seq data? And, how close are the expression levels inferred to the "true" expression levels? We evaluate fifty gene profiling pipelines in experimental and simulated data sets with different characteristics (e.g, read length and sequencing depth). In the absence of knowledge of the 'ground truth' in real RNAseq data sets, we used simulated data to assess the differences between the "true" expression and those reconstructed by the analysis pipelines. Even though this approach does not take into account all known biases present in RNAseq data, it still allows to estimate the accuracy of the gene expression values inferred by different analysis pipelines. The results show that i) overall there is a high correlation between the expression levels inferred by the best pipelines and the true quantification values; ii) the error in the estimated gene expression values can vary considerably across genes; and iii) a small set of genes have expression estimates with consistently high error (across data sets and methods). Finally, although the mapping software is important, the quantification method makes a greater difference to the results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fast and SNP-tolerant detection of complex variants and splicing in short reads
Wu, T. D., & Nacu, S. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq057 · Cited by 1,894 · cited 2×
“We included the following aligners in the evaluation: TopHat1 [24], TopHat2 [25], Osa [18], Star [26], GSNAP [27], Bowtie2 [28], Bowtie1 [29], Smalt (http://www.”
MethodDifferential expression in RNA-seq: A matter of depth
Tarazona, S., García-Alcalde, F., Dopazo, J., Ferrer, A., & Conesa, A. (2011) · Genome Research · doi:10.1101/gr.124321.111 · Cited by 1,632 · cited 1×
“Previous studies [19] suggested that a rather stable detection of protein coding genes is reached at sequencing depths closer to 30x.”
BackgroundA comparison of methods for differential expression analysis of RNA-seq data
Soneson, C., & Delorenzi, M. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-91 · Cited by 887 · cited 1×
“Other studies have assessed how different methods for identifying differentially expressed genes [13–15] perform when applied to the same input data sets.”
BackgroundTranscriptome genetics using second generation sequencing in a Caucasian population
Montgomery, S. B., Sammeth, M., Gutierrez-Arcelus, M., Lach, R. P., Ingle, C., Nisbett, J., Guigo, R., & Dermitzakis, E. T. (2010) · Nature · doi:10.1038/nature08903 · Cited by 797
Assessment of transcript reconstruction methods for RNA-seq
The RGASP Consortium, Steijger, T., Abril, J. F., Engström, P. G., Kokocinski, F., Hubbard, T. J., Guigó, R., Harrow, J., & Bertone, P. (2013) · Nature Methods · doi:10.1038/nmeth.2714 · Cited by 699
Systematic evaluation of spliced alignment programs for RNA-seq data
The RGASP Consortium, Engström, P. G., Steijger, T., Sipos, B., Grant, G. R., Kahles, A., Rätsch, G., Goldman, N., Hubbard, T. J., Harrow, J., et al. (2013) · Nature Methods · doi:10.1038/nmeth.2722 · Cited by 513 · cited 2×
“More recently, the RGASP consortium presented two broad evaluations of RNA-seq data analysis methods: one on the performance of several spliced alignment programs by focusing on the quality of the alignments [16]; the second study evaluated computational methods for transcript reconstruction and quantification from RN…”
ResultNookaew, I., Papini, M., Pornputtapong, N., Scalcinati, G., Fagerberg, L., Uhlén, M., & Nielsen, J. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks804 · Cited by 309
A comparison of statistical methods for detecting differentially expressed genes from RNA‐seq data
Kvam, V. M., Liu, P., & Si, Y. (2012) · American Journal of Botany · doi:10.3732/ajb.1100340 · Cited by 281 · cited 1×
“Other studies have assessed how different methods for identifying differentially expressed genes [13–15] perform when applied to the same input data sets.”
BackgroundNURD: an implementation of a new method to estimate isoform expression from non-uniform RNA-seq data
Ma, X., & Zhang, X. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-220 · Cited by 14 · cited 1×
“Alternatively, tools for quantifying the expression of each transcript of a gene [7, 9–12] can be used and aggregated to obtain overall expression values.”
Method
Cited by
HTSeq—a Python framework to work with high-throughput sequencing data
Anders, S., Pyl, P. T., & Huber, W. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btu638 · Cited by 21,464
RNA sequencing: the teenage years
Stark, R., Grzelak, M., & Hadfield, J. (2019) · Nature Reviews Genetics · doi:10.1038/s41576-019-0150-2 · Cited by 1,915
Chen, Y., Lun, A. T. L., & Smyth, G. K. (2016) · F1000Research · doi:10.12688/f1000research.8987.1 · Cited by 1,287
Manzoni, C., Kia, D. A., Vandrovcova, J., Hardy, J., Wood, N. W., Lewis, P. A., & Ferrari, R. (2018) · Briefings in Bioinformatics · doi:10.1093/bib/bbw114 · Cited by 804
Classification of low quality cells from single-cell RNA-seq data
Ilicic, T., Kim, J. K., Kolodziejczyk, A. A., Bagger, F. O., McCarthy, D. J., Marioni, J. C., & Teichmann, S. A. (2016) · Genome Biology · doi:10.1186/s13059-016-0888-1 · Cited by 693
Self-citation
Metadata
- Authors
- Fonseca, N. A., Marioni, J., & Brazma, A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-09-30
- Volume
- 9
- Issue
- 9
- Pages
- e107026
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2951781413
- Cited by
- 99
- References
- 9
- FWCI
- 5.48
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RNA-Seq Gene Profiling - A Systematic Empirical Comparison. https://app.cochat.ai/papers/10.1371/journal.pone.0107026
- The paper
- Fonseca, N. A., Marioni, J., & Brazma, A. (2014). RNA-Seq Gene Profiling - A Systematic Empirical Comparison. PLoS ONE. https://doi.org/10.1371/journal.pone.0107026
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.