Toward reliable biomarker signatures in the age of liquid biopsies - how to standardize the small RNA-Seq workflow
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Small RNA-Seq has emerged as a powerful tool in transcriptomics, gene expression profiling and biomarker discovery. Sequencing cell-free nucleic acids, particularly microRNA (miRNA), from liquid biopsies additionally provides exciting possibilities for molecular diagnostics, and might help establish disease-specific biomarker signatures. The complexity of the small RNA-Seq workflow, however, bears challenges and biases that researchers need to be aware of in order to generate high-quality data. Rigorous standardization and extensive validation are required to guarantee reliability, reproducibility and comparability of research findings. Hypotheses based on flawed experimental conditions can be inconsistent and even misleading. Comparable to the well-established MIQE guidelines for qPCR experiments, this work aims at establishing guidelines for experimental design and pre-analytical sample processing, standardization of library preparation and sequencing reactions, as well as facilitating data analysis. We highlight bottlenecks in small RNA-Seq experiments, point out the importance of stringent quality control and validation, and provide a primer for differential expression analysis and biomarker discovery. Following our recommendations will encourage better sequencing practice, increase experimental transparency and lead to more reproducible small RNA-Seq results. This will ultimately enhance the validity of biomarker signatures, and allow reliable and robust clinical predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments
Bustin, S. A., Benes, V., Garson, J. A., Hellemans, J., Huggett, J., Kubista, M., Mueller, R., Nolan, T., Pfaffl, M. W., Shipley, G. L., et al. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.112797 · Cited by 16,303
Self-citationvoom: precision weights unlock linear model analysis tools for RNA-seq read counts
Law, C. W., Chen, Y., Shi, W., & Smyth, G. K. (2014) · Genome Biology · doi:10.1186/gb-2014-15-2-r29 · Cited by 6,155
Biological properties of extracellular vesicles and their physiological functions
Yáñez‐Mó, M., Siljander, P. R. ‐., Andreu, Z., Bedina Zavec, A., Borràs, F. E., Buzas, E. I., Buzas, K., Casal, E., Cappello, F., Carvalho, J., et al. (2015) · Journal of Extracellular Vesicles · doi:10.3402/jev.v4.27066 · Cited by 5,926 · cited 1×
“The composition of circulating vesicles reflects the physiological and pathological status of a patient, and is therefore of considerable diagnostic interest (55).”
BackgroundBase-Calling of Automated Sequencer Traces Using Phred. II. Error Probabilities
Ewing, B., & Green, P. (1998) · Genome Research · doi:10.1101/gr.8.3.186 · Cited by 5,439
miRBase: annotating high confidence microRNAs using deep sequencing data
Kozomara, A., & Griffiths-Jones, S. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1181 · Cited by 5,073 · cited 1×
“Classic read alignment strategies include mapping to a reference genome or a specific small RNA database such as mirBase (178,179) or Rfam (180).”
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
MicroRNA targets in Drosophila
Enright, A. J., John, B., Gaul, U., Tuschl, T., Sander, C., & Marks, D. S. (2003) · Genome Biology · doi:10.1186/gb-2003-5-1-r1 · Cited by 3,597
Kowal, J., Arras, G., Colombo, M., Jouve, M., Morath, J. P., Primdal-Bengtson, B., Dingli, F., Loew, D., Tkach, M., & Théry, C. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521230113 · Cited by 3,426
Arroyo, J. D., Chevillet, J. R., Kroh, E. M., Ruf, I. K., Pritchard, C. C., Gibson, D. F., Mitchell, P. S., Bennett, C. F., Pogosova-Agadjanyan, E. L., Stirewalt, D. L., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1019055108 · Cited by 3,294
MicroRNAs are transported in plasma and delivered to recipient cells by high-density lipoproteins
Vickers, K. C., Palmisano, B. T., Shoucri, B. M., Shamburek, R. D., & Remaley, A. T. (2011) · Nature Cell Biology · doi:10.1038/ncb2210 · Cited by 2,741
The RIN: an RNA integrity number for assigning integrity values to RNA measurements
Schroeder, A., Mueller, O., Stocker, S., Salowsky, R., Leiber, M., Gassmann, M., Lightfoot, S., Menzel, W., Granzow, M., & Ragg, T. (2006) · BMC Molecular Biology · doi:10.1186/1471-2199-7-3 · Cited by 2,623
Tackling the widespread and critical impact of batch effects in high-throughput data
Leek, J. T., Scharpf, R. B., Bravo, H. C., Simcha, D., Langmead, B., Johnson, W. E., Geman, D., Baggerly, K., & Irizarry, R. A. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2825 · Cited by 2,196
Bullard, J. H., Purdom, E., Hansen, K. D., & Dudoit, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-94 · Cited by 1,680 · cited 3×
“Although early RNA-Seq reported a good fit to a Poisson distribution for single sample sequencings and technical replicates (30,196), studies with biological replicates are extremely likely to show variances greater than the mean for many genes (204).”
BackgroundDifferential expression in RNA-seq: A matter of depth
Tarazona, S., García-Alcalde, F., Dopazo, J., Ferrer, A., & Conesa, A. (2011) · Genome Research · doi:10.1101/gr.124321.111 · Cited by 1,632 · cited 2×
“For mRNA-Seq experiments, a stable detection of transcripts seems to be reached at coverage of about 30× with greater coverage only yielding marginal error reduction rates (23).”
BackgroundThe real-time polymerase chain reaction
Kubista, M., Andrade, J. M., Bengtsson, M., Forootan, A., Jonák, J., Lind, K., Sindelka, R., Sjöback, R., Sjögreen, B., Strömbom, L., et al. (2006) · Molecular Aspects of Medicine · doi:10.1016/j.mam.2005.12.007 · Cited by 1,515
SolexaQA: at-a-glance quality assessment of Illumina second-generation sequencing data
Cox, M. P., Peterson, D. A., & Biggs, P. J. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-485 · Cited by 1,357 · cited 1×
“Popular quality trimming algorithms implement either some variation of a running sum of the quality scores from 3′- to 5′-end looking for a minimal (Cutadapt), or a moving window that determines the longest continuous stretch of nucleotides above the threshold and trims the rest (Btrim, fastq quality trimmer from FAST…”
Quantitative single-cell RNA-seq with unique molecular identifiers
Islam, S., Zeisel, A., Joost, S., La Manno, G., Zajac, P., Kasper, M., Lönnerberg, P., & Linnarsson, S. (2014) · Nature Methods · doi:10.1038/nmeth.2772 · Cited by 1,183 · cited 1×
“Recently, more sophisticated library preparation strategies to avoid PCR bias altogether were developed for both bulk and single cell analyses (112,113).”
BackgroundDouble indexing overcomes inaccuracies in multiplex sequencing on the Illumina platform
Kircher, M., Sawyer, S., & Meyer, M. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr771 · Cited by 1,106 · cited 1×
“Growing mixed clusters from more than one template molecule results in a heterogeneous colony of PCR products, and thus an inconclusive fluorescence signal during imaging (135).”
BackgroundSubstantial biases in ultra-short read data sets from high-throughput DNA sequencing
Dohm, J. C., Lottaz, C., Borodina, T., & Himmelbauer, H. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn425 · Cited by 1,088 · cited 3×
“It is well-known that miscalls on the Illumina platform occur more frequently in GC-rich regions and increase in later cycles (141).”
BackgroundInfluentialCounting absolute numbers of molecules using unique molecular identifiers
Kivioja, T., Vähärautio, A., Karlsson, K., Bonke, M., Enge, M., Linnarsson, S., & Taipale, J. (2012) · Nature Methods · doi:10.1038/nmeth.1778 · Cited by 1,010 · cited 1×
“Recently, more sophisticated library preparation strategies to avoid PCR bias altogether were developed for both bulk and single cell analyses (112,113).”
BackgroundSchurch, N. J., Schofield, P., Gierliński, M., Cole, C., Sherstnev, A., Singh, V., Wrobel, N., Gharbi, K., Simpson, G. G., Owen-Hughes, T., et al. (2016) · RNA · doi:10.1261/rna.053959.115 · Cited by 966 · cited 2×
“A recent publication on RNA-Seq additionally reported that experiments entailing only three biological replicates severely lack power to detect the majority of differentially expressed genes, and are only suited to identify transcripts with major fold changes (28).”
BackgroundCharacterizing and measuring bias in sequence data
Ross, M. G., Russ, C., Costello, M., Hollinger, A., Lennon, N. J., Hegarty, R., Nusbaum, C., & Jaffe, D. B. (2013) · Genome Biology · doi:10.1186/gb-2013-14-5-r51 · Cited by 909
A comparison of methods for differential expression analysis of RNA-seq data
Soneson, C., & Delorenzi, M. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-91 · Cited by 887 · cited 2×
“Even though comparisons of software performances on small RNA-Seq data are scarce, a number of independent and extensive evaluations for mRNAs based on either synthetic data with clearly defined properties (216), or on biological datasets with validated gene expressions (217,218) have been made recently.”
BackgroundMethodA survey of sequence alignment algorithms for next-generation sequencing
Li, H., & Homer, N. (2010) · Briefings in Bioinformatics · doi:10.1093/bib/bbq015 · Cited by 875 · cited 1×
“), as well as software-specific algorithm variations such as spaced seeding, q-gram filters, and FM-indices can find short overviews of existing software tools in (173), (174) or (158).”
BackgroundGC-Content Normalization for RNA-Seq Data
Risso, D., Schwartz, K., Sherlock, G., & Dudoit, S. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-480 · Cited by 867 · cited 2×
“Unwanted differences between libraries commonly occur in size (sequencing depth) (193) as well as within libraries in GC-content (194) or as batch effects (128).”
BackgroundHuggett, J. F., Foy, C. A., Benes, V., Emslie, K., Garson, J. A., Haynes, R., Hellemans, J., Kubista, M., Mueller, R. D., Nolan, T., et al. (2013) · Clinical Chemistry · doi:10.1373/clinchem.2013.206375 · Cited by 859 · cited 2×
“This sustains the idea of the MIQE and dMIQE guidelines previously published by an international consortium (headed by SA Bustin and JF Huggett) in the field of qPCR and dPCR (21,22).”
BackgroundMethodSelf-citationCirculating nucleic acids (CNAs) and cancer—A survey
Fleischhacker, M., & Schmidt, B. (2007) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/j.bbcan.2006.10.001 · Cited by 851
Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data
Rapaport, F., Khanin, R., Liang, Y., Pirun, M., Krek, A., Zumbo, P., Mason, C. E., Socci, N. D., & Betel, D. (2013) · Genome Biology · doi:10.1186/gb-2013-14-9-r95 · Cited by 733 · cited 1×
“Even though comparisons of software performances on small RNA-Seq data are scarce, a number of independent and extensive evaluations for mRNAs based on either synthetic data with clearly defined properties (216), or on biological datasets with validated gene expressions (217,218) have been made recently.”
BackgroundSynthetic spike-in standards for RNA-seq experiments
Jiang, L., Schlesinger, F., Davis, C. A., Zhang, Y., Li, R., Salit, M., Gingeras, T. R., & Oliver, B. (2011) · Genome Research · doi:10.1101/gr.121095.111 · Cited by 653 · cited 2×
“Another publication using poly-A-tailed mRNA-mimetic standards reported a linear correlation spanning six orders of magnitude while suggesting that the detection of standards is robust to the endogenous complexity of RNA samples (125).”
BackgroundEvaluation of next generation sequencing platforms for population targeted sequencing studies
Harismendy, O., Ng, P. C., Strausberg, R. L., Wang, X., Stockwell, T. B., Beeson, K. Y., Schork, N. J., Murray, S. S., Topol, E. J., Levy, S., et al. (2009) · Genome Biology · doi:10.1186/gb-2009-10-3-r32 · Cited by 614
IsomiRs – the overlooked repertoire in the dynamic microRNAome
Neilsen, C. T., Goodall, G. J., & Bracken, C. P. (2012) · Trends in Genetics · doi:10.1016/j.tig.2012.07.005 · Cited by 499
Transcript length bias in RNA-seq data confounds systems biology
Oshlack, A., & Wakefield, M. J. (2009) · Biology Direct · doi:10.1186/1745-6150-4-14 · Cited by 497 · cited 1×
“Variation introduced by different gene lengths (195), as is frequently encountered in sequencings of longer RNAs, has a negligible effect.”
BackgroundCirculating MicroRNA biomarker studies: pitfalls and potential solutions
Witwer, K. W. (2015) · Clinical Chemistry · doi:10.1373/clinchem.2014.221341 · Cited by 447
Comparison of software packages for detecting differential expression in RNA-seq studies
Seyednasrollah, F., Laiho, A., & Elo, L. L. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbt086 · Cited by 421 · cited 1×
“Even though comparisons of software performances on small RNA-Seq data are scarce, a number of independent and extensive evaluations for mRNAs based on either synthetic data with clearly defined properties (216), or on biological datasets with validated gene expressions (217,218) have been made recently.”
BackgroundStatistical Design and Analysis of RNA Sequencing Data
Auer, P. L., & Doerge, R. W. (2010) · Genetics · doi:10.1534/genetics.110.114983 · Cited by 393
Illumina error profiles: resolving fine-scale variation in metagenomic sequencing data
Schirmer, M., D’Amore, R., Ijaz, U. Z., Hall, N., & Quince, C. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-0976-y · Cited by 376
MicroRNAs and their isomiRs function cooperatively to target common biological pathways
Cloonan, N., Wani, S., Xu, Q., Gu, J., Lea, K., Heater, S., Barbacioru, C., Steptoe, A. L., Martin, H. C., Nourbakhsh, E., et al. (2011) · Genome Biology · doi:10.1186/gb-2011-12-12-r126 · Cited by 345
Calculating Sample Size Estimates for RNA Sequencing Data
Hart, S. N., Therneau, T. M., Zhang, Y., Poland, G. A., & Kocher, J.-P. (2013) · Journal of Computational Biology · doi:10.1089/cmb.2012.0283 · Cited by 341
Dabney, J., & Meyer, M. (2012) · BioTechniques · doi:10.2144/000113809 · Cited by 316
RNA-seq: technical variability and sampling
McIntyre, L. M., Lopiano, K. K., Morse, A. M., Amin, V., Oberg, A. L., Young, L. J., & Nuzhdin, S. V. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-293 · Cited by 285
A comparison of statistical methods for detecting differentially expressed genes from RNA‐seq data
Kvam, V. M., Liu, P., & Si, Y. (2012) · American Journal of Botany · doi:10.3732/ajb.1100340 · Cited by 281 · cited 1×
“It has been shown that increasing the number of biological replicates in RNASeq experiments from two to five facilitates the detection of differential gene expression, but extensive biological replication to improve statistical power is still not utilized in most experiments (27).”
BackgroundReproducibility of high-throughput mRNA and small RNA sequencing across laboratories
The GEUVADIS Consortium, 't Hoen, P. A. C., Friedländer, M. R., Almlöf, J., Sammeth, M., Pulyakhina, I., Anvar, S. Y., Laros, J. F. J., Buermans, H. P. J., Karlberg, O., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2702 · Cited by 250 · cited 1×
“A recent article even reported that the composition of small RNA sequencing libraries is more heavily influenced by RNA extraction than by library preparation itself (129).”
BackgroundComparison of Reverse Transcriptases in Gene Expression Analysis
Ståhlberg, A., Kubista, M., & Pfaffl, M. (2004) · Clinical Chemistry · doi:10.1373/clinchem.2004.035469 · Cited by 240
Self-citationBaran-Gale, J., Kurtz, C. L., Erdos, M. R., Sison, C., Young, A., Fannin, E. E., Chines, P. S., & Sethupathy, P. (2015) · Frontiers in Genetics · doi:10.3389/fgene.2015.00352 · Cited by 120
RNA‐seq Data: Challenges in and Recommendations for Experimental Design and Analysis
Williams, A. G., Thomas, S., Wyman, S. K., & Holloway, A. K. (2014) · Current Protocols in Human Genetics · doi:10.1002/0471142905.hg1113s83 · Cited by 93
Comparison of Analysis Tools for miRNA High Throughput Sequencing Using Nerve Crush as a Model
Metpally, R. P. R., Nasser, S., Malenica, I., Courtright, A., Carlson, E., Ghaffari, L., Villa, S., Tembe, W., & Van Keuren-Jensen, K. (2013) · Frontiers in Genetics · doi:10.3389/fgene.2013.00020 · Cited by 63 · cited 2×
“5M mapped reads reliably represents the miRNA distribution in the sample (133).”
Background
Cited by
Buschmann, D., Kirchner, B., Hermann, S., Märte, M., Wurmser, C., Brandes, F., Kotschote, S., Bonin, M., Steinlein, O. K., Pfaffl, M. W., et al. (2018) · Journal of Extracellular Vesicles · doi:10.1080/20013078.2018.1481321 · Cited by 258
Self-citationCirculating microRNAs as Potential Biomarkers of Infectious Disease
Correia, C. N., Nalpas, N. C., McLoughlin, K. E., Browne, J. A., Gordon, S. V., MacHugh, D. E., & Shaughnessy, R. G. (2017) · Frontiers in Immunology · doi:10.3389/fimmu.2017.00118 · Cited by 237
“, Illumina®, ABI SOLiD®, and Ion TorrentTM) may generate reads that are not bona fide miRNAs (5, 127, 128).”
BackgroundBustin, S., & Nolan, T. (2017) · European Journal of Clinical Investigation · doi:10.1111/eci.12801 · Cited by 113
Kok, M. G. M., de Ronde, M. W. J., Moerland, P. D., Ruijter, J. M., Creemers, E. E., & Pinto-Sietsma, S. J. (2018) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2017.11.002 · Cited by 105
Wright, C., Rajpurohit, A., Burke, E. E., Williams, C., Collado-Torres, L., Kimos, M., Brandon, N. J., Cross, A. J., Jaffe, A. E., Weinberger, D. R., et al. (2019) · BMC Genomics · doi:10.1186/s12864-019-5870-3 · Cited by 99
Metadata
- Authors
- Buschmann, D., Haberberger, A., Kirchner, B., Spornraft, M., Riedmaier, I., Schelling, G., & Pfaffl, M. W.
- Venue
- Nucleic Acids Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-06-17
- Volume
- 44
- Issue
- 13
- Pages
- 5995-6018
- ISSN
- 0305-1048 (ISSN-L)
- 1362-4962
- OpenAlex
- W2424601086
- Cited by
- 103
- References
- 48
- FWCI
- 6.17
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.