Characterization and improvement of RNA-Seq precision in quantitative transcript expression profiling
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Motivation: Measurement precision determines the power of any analysis to reliably identify significant signals, such as in screens for differential expression, independent of whether the experimental design incorporates replicates or not. With the compilation of large-scale RNA-Seq datasets with technical replicate samples, however, we can now, for the first time, perform a systematic analysis of the precision of expression level estimates from massively parallel sequencing technology. This then allows considerations for its improvement by computational or experimental means. Results: We report on a comprehensive study of target identification and measurement precision, including their dependence on transcript expression levels, read depth and other parameters. In particular, an impressive recall of 84% of the estimated true transcript population could be achieved with 331 million 50 bp reads, with diminishing returns from longer read lengths and even less gains from increased sequencing depths. Most of the measurement power (75%) is spent on only 7% of the known transcriptome, however, making less strongly expressed transcripts harder to measure. Consequently, <30% of all transcripts could be quantified reliably with a relative error <20%. Based on established tools, we then introduce a new approach for mapping and analysing sequencing reads that yields substantially improved performance in gene expression profiling, increasing the number of transcripts that can reliably be quantified to over 40%. Extrapolations to higher sequencing depths highlight the need for efficient complementary steps. In discussion we outline possible experimental and computational strategies for further improvements in quantification precision. Contact: rnaseq10@boku.ac.at Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Thus, simply calculating R2 values of genes' expression measures and showing that samples cluster together merely shows the tendency of expression values to track each other; these high correlation coefficients mask the 8–20% false positive rate described above33, 40.”
From Detecting and correcting systematic variation in large-scale RNA sequencing data (2014) · cites this paper as [40]
Experimental — accuracy not yet measuredIn the citing paper
“Similarly, longer reads improve mappability and transcript identification [5, 6].”
From A survey of best practices for RNA-seq data analysis (2016) · cites this paper as [6]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fast and accurate short read alignment with Burrows-Wheeler transform
Li, H., & Durbin, R. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp324 · Cited by 58,607
Ultrafast and memory-efficient alignment of short DNA sequences to the human genome.
Langmead, B., Trapnell, C., Pop, M., & Salzberg, S. L. (2009) · Genome Biology · doi:10.1186/gb-2009-10-3-r25 · Cited by 21,849
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
Trapnell, C., Williams, B. A., Pertea, G., Mortazavi, A., Kwan, G., van Baren, M. J., Salzberg, S. L., Wold, B. J., & Pachter, L. (2010) · Nature Biotechnology · doi:10.1038/nbt.1621 · Cited by 15,556
Mapping and quantifying mammalian transcriptomes by RNA-Seq
Mortazavi, A., Williams, B. A., McCue, K., Schaeffer, L., & Wold, B. (2008) · Nature Methods · doi:10.1038/nmeth.1226 · Cited by 13,696
TopHat: discovering splice junctions with RNA-Seq
Trapnell, C., Pachter, L., & Salzberg, S. L. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp120 · Cited by 11,617
mRNA-Seq whole-transcriptome analysis of a single cell
Tang, F., Barbacioru, C., Wang, Y., Nordman, E., Lee, C., Xu, N., Wang, X., Bodeau, J., Tuch, B. B., Siddiqui, A., et al. (2009) · Nature Methods · doi:10.1038/nmeth.1315 · Cited by 3,969
SOAP2: an improved ultrafast tool for short read alignment
Li, R., Yu, C., Li, Y., Lam, T.-W., Yiu, S.-M., Kristiansen, K., & Wang, J. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp336 · Cited by 3,760
Global analysis of protein expression in yeast
Ghaemmaghami, S., Huh, W.-K., Bower, K., Howson, R. W., Belle, A., Dephoure, N., O'Shea, E. K., & Weissman, J. S. (2003) · Nature · doi:10.1038/nature02046 · Cited by 3,750
Real-Time DNA Sequencing from Single Polymerase Molecules
Eid, J., Fehr, A., Gray, J., Luong, K., Lyle, J., Otto, G., Peluso, P., Rank, D., Baybayan, P., Bettman, B., et al. (2009) · Science · doi:10.1126/science.1162986 · Cited by 3,732
RNA-seq: An assessment of technical reproducibility and comparison with gene expression arrays
Marioni, J. C., Mason, C. E., Mane, S. M., Stephens, M., & Gilad, Y. (2008) · Genome Research · doi:10.1101/gr.079558.108 · Cited by 2,771
Mapping short DNA sequencing reads and calling variants using mapping quality scores
Li, H., Ruan, J., & Durbin, R. (2008) · Genome Research · doi:10.1101/gr.078212.108 · Cited by 2,638
Huber, W., von Heydebreck, A., Sültmann, H., Poustka, A., & Vingron, M. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.suppl_1.s96 · Cited by 2,440
Evolving gene/transcript definitions significantly alter the interpretation of GeneChip data
Dai, M. (2005) · Nucleic Acids Research · doi:10.1093/nar/gni179 · Cited by 1,797
A Model-Based Background Adjustment for Oligonucleotide Expression Arrays
Wu, Z., Irizarry, R. A., Gentleman, R., Martinez-Murillo, F., & Spencer, F. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000683 · Cited by 1,716
Bullard, J. H., Purdom, E., Hansen, K. D., & Dudoit, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-94 · Cited by 1,680
Sultan, M., Schulz, M. H., Richard, H., Magen, A., Klingenhoff, A., Scherf, M., Seifert, M., Borodina, T., Soldatov, A., Parkhomchuk, D., et al. (2008) · Science · doi:10.1126/science.1160342 · Cited by 1,293
Gene Expression Profiles in Normal and Cancer Cells
Zhang, L., Zhou, W., Velculescu, V. E., Kern, S. E., Hruban, R. H., Hamilton, S. R., Vogelstein, B., & Kinzler, K. W. (1997) · Science · doi:10.1126/science.276.5316.1268 · Cited by 1,184
Stem cell transcriptome profiling via massive-scale mRNA sequencing
Cloonan, N., Forrest, A. R. R., Kolle, G., Gardiner, B. B. A., Faulkner, G. J., Brown, M. K., Taylor, D. F., Steptoe, A. L., Wani, S., Bethel, G., et al. (2008) · Nature Methods · doi:10.1038/nmeth.1223 · Cited by 1,035
Dynamic repertoire of a eukaryotic transcriptome surveyed at single-nucleotide resolution
Wilhelm, B. T., Marguerat, S., Watt, S., Schubert, F., Wood, V., Goodhead, I., Penkett, C. J., Rogers, J., & Bähler, J. (2008) · Nature · doi:10.1038/nature07002 · Cited by 974
SSAHA: A Fast Search Method for Large DNA Databases
Ning, Z., Cox, A. J., & Mullikin, J. C. (2001) · Genome Research · doi:10.1101/gr.194201 · Cited by 965
Pruitt, K. D., Harrow, J., Harte, R. A., Wallin, C., Diekhans, M., Maglott, D. R., Searle, S., Farrell, C. M., Loveland, J. E., Ruef, B. J., et al. (2009) · Genome Research · doi:10.1101/gr.080531.108 · Cited by 557
BFAST: An Alignment Tool for Large Scale Genome Resequencing
Homer, N., Merriman, B., & Nelson, S. F. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007767 · Cited by 529
Transcript length bias in RNA-seq data confounds systems biology
Oshlack, A., & Wakefield, M. J. (2009) · Biology Direct · doi:10.1186/1745-6150-4-14 · Cited by 497 · cited 1×
“While systemic deviations due to length bias, lane effects, and processing artefacts are increasingly being investigated (Bullard et al., 2010; Marioni et al., 2008; Oshlack and Wakefield, 2009), reproducibility has in general received much less attention.”
Statistical inferences for isoform expression in RNA-Seq
Jiang, H., & Wong, W. H. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp113 · Cited by 460
The vertebrate genome annotation (Vega) database
Wilming, L. G., Gilbert, J. G. R., Howe, K., Trevanion, S., Hubbard, T., & Harrow, J. L. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm987 · Cited by 351
The beginning of the end for microarrays?
Shendure, J. (2008) · Nature Methods · doi:10.1038/nmeth0708-585 · Cited by 331
Alternative expression analysis by RNA sequencing
Griffith, M., Griffith, O. L., Mwenifumbo, J., Goya, R., Morrissy, A. S., Morin, R. D., Corbett, R., Tang, M. J., Hou, Y.-C., Pugh, T. J., et al. (2010) · Nature Methods · doi:10.1038/nmeth.1503 · Cited by 309
Flicek, P., Aken, B. L., Ballester, B., Beal, K., Bragin, E., Brent, S., Chen, Y., Clapham, P., Coates, G., Fairley, S., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp972 · Cited by 291
Stochastic Models Inspired by Hybridization Theory for Short Oligonucleotide Arrays
Wu, Z., & Irizarry, R. A. (2005) · Journal of Computational Biology · doi:10.1089/cmb.2005.12.882 · Cited by 265
Comparison of next generation sequencing technologies for transcriptome characterization
Wall, P. K., Leebens-Mack, J., Chanderbali, A. S., Barakat, A., Wolcott, E., Liang, H., Landherr, L., Tomsho, L. P., Hu, Y., Carlson, J. E., et al. (2009) · BMC Genomics · doi:10.1186/1471-2164-10-347 · Cited by 213
Levin, J. Z., Berger, M. F., Adiconis, X., Rogov, P., Melnikov, A., Fennell, T., Nusbaum, C., Garraway, L. A., & Gnirke, A. (2009) · Genome Biology · doi:10.1186/gb-2009-10-10-r115 · Cited by 195
Band, V, & Sager, R. (1989) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.86.4.1249 · Cited by 194
Targeting a Complex Transcriptome: The Construction of the Mouse Full-Length cDNA Encyclopedia
Carninci, P., Waki, K., Shiraki, T., Konno, H., Shibata, K., Itoh, M., Aizawa, K., Arakawa, T., Ishii, Y., Sasaki, D., et al. (2003) · Genome Research · doi:10.1101/gr.1119703 · Cited by 171
Accurate quantification of transcriptome from RNA-Seq data by effective length normalization
Lee, S., Seo, C. H., Lim, B., Yang, J. O., Oh, J., Kim, M., Lee, S., Lee, B., Kang, C., & Lee, S. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq1015 · Cited by 119
Tilstone, C. (2003) · Nature · doi:10.1038/424610a · Cited by 97
Blow, N. S. (2009) · Nature · doi:10.1038/458239a · Cited by 90
Mane, S. P., Evans, C., Cooper, K. L., Crasta, O. R., Folkerts, O., Hutchison, S. K., Harkins, T. T., Thierry-Mieg, D., Thierry-Mieg, J., & Jensen, R. V. (2009) · BMC Genomics · doi:10.1186/1471-2164-10-264 · Cited by 83
Statistical Analyses of Next Generation Sequence Data: A Partial Overview
Datta, S., Datta, S., Kim, S., Chakraborty, S., & Gill, R. S. (2010) · Journal of Proteomics & Bioinformatics · doi:10.4172/jpb.1000138 · Cited by 47
PANP - a New Method of Gene Detection on Oligonucleotide Expression Arrays
Warren, P., Taylor, D., Martini, P. G. V., Jackson, J., & Bienkowska, J. (2007) · 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering · doi:10.1109/bibe.2007.4375552 · Cited by 35
Model-based probe set optimization for high-performance microarrays
Leparc, G., Tüchler, T., Striedner, G., Bayer, K., Sykacek, P., Hofacker, I. L., & Kreil, D. P. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn1001 · Cited by 23
Self-citation(2008) · Nature Methods · doi:10.1038/nmeth0808-659 · Cited by 8
Research works printed but not linked: 2
- Bolstad, 2004, Low level analysis of high-density oligonucleotide array data: background, normalization and summarization, PhD Thesis
- Thas, 2010, Probabilistic allelic read calling: a quasi-Poisson mixed model for the analysis of allelic read counts
Cited by
A survey of best practices for RNA-seq data analysis
Conesa, A., Madrigal, P., Tarazona, S., Gomez-Cabrero, D., Cervera, A., McPherson, A., Szcześniak, M. W., Gaffney, D. J., Elo, L. L., Zhang, X., et al. (2016) · Genome Biology · doi:10.1186/s13059-016-0881-8 · Cited by 2,794
“Similarly, longer reads improve mappability and transcript identification [5, 6].”
BackgroundSEQC/MAQC-III Consortium (2014) · Nature Biotechnology · doi:10.1038/nbt.2957 · Cited by 983
Self-citationData quality aware analysis of differential expression in RNA-seq with NOISeq R/Bioc package
Tarazona, S., Furió-Tarí, P., Turrà, D., Pietro, A. D., Nueda, M. J., Ferrer, A., & Conesa, A. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv711 · Cited by 779
Wang, C., Gong, B., Bushel, P. R., Thierry-Mieg, J., Thierry-Mieg, D., Xu, J., Fang, H., Hong, H., Shen, J., Su, Z., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.3001 · Cited by 512
Self-citationKlambauer, G., Schwarzbauer, K., Mayr, A., Clevert, D.-A., Mitterecker, A., Bodenhofer, U., & Hochreiter, S. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks003 · Cited by 455
Metadata
- Authors
- Łabaj, P. P., Leparc, G. G., Linggi, B. E., Markillie, L. M., Wiley, H. S., & Kreil, D. P.
- Affiliations
- Pacific Northwest National Laboratory (US)
- Corresponding author
- Kreil, David P.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-06-14
- Volume
- 27
- Issue
- 13
- Pages
- i383-i391
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- PMC
- PMC3117338
- OpenAlex
- W2163871842
- Cited by
- 141
- References
- 42
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 7 · 2023: 2 · 2022: 5 · 2021: 7 · 2020: 3 · 2019: 9 · 2018: 7 · 2017: 8 · 2016: 14 · 2015: 15 · 2014: 17 · 2013: 23 · 2012: 17
- FWCI
- 7.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Bioinformatics (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- U.S. Department of Energy
- Vienna Science and Technology Fund
- Austrian Institute of Technology
- Biological and Environmental Research
- Laboratory Directed Research and Development
- Pacific Northwest National Laboratory
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Keywords
- RNA-seq, measurement precision, transcript quantification, sequencing depth, read length, technical replicates, transcriptome coverage, differential gene expression, read mapping, gene expression profiling
- MeSH terms
- Cell Line, Humans, RNA, Software, Sequence Analysis, RNA, Gene Expression Profiling, Microarray Analysis, High-Throughput Nucleotide Sequencing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.