Cited by 194Genomics and Phylogenetic StudiesGene expression and cancer classificationSingle-cell and spatial transcriptomics

Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

Open access
Love, Michael I, Hogenesch, John B, Irizarry, Rafael A·2016·Nature Biotechnology

Published version of a preprint

Abstract

We find that current computational methods for estimating transcript abundance from RNA-seq data can lead to hundreds of false-positive results. We show that these systematic errors stem largely from a failure to model fragment GC content bias. Sample-specific biases associated with fragment sequence features lead to misidentification of transcript isoforms. We introduce alpine, a method for estimating sample-specific bias-corrected transcript abundance. By incorporating fragment sequence features, alpine greatly increases the accuracy of transcript abundance estimates, enabling a fourfold reduction in the number of false positives for reported changes in expression compared with Cufflinks. Using simulated data, we also show that alpine retains the ability to discover true positives, similar to other approaches. The method is available as an R/Bioconductor package that includes data visualization tools useful for bias discovery.

Integrity signals

Registry

Crossref · 10.1038/nbt.3682

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 17 cited sources checked · 0 supported · 0 flagged

  • Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Lightweight quantification methods produced the same type of isoform-switching errors as Cufflinks, RSEM, and MISO.

    “The lightweight quantification methods generated the same kind of isoform-switching errors as Cufflinks and RSEM (Supplementary Figures 14-15), and as MISO 27, a statistical method for estimating isoform percentages within multi-isoform genes”
    Quote in the paperSubstantial claim
  • Findingreasoning
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    In USF2, lower coverage in center 1 samples shifts expression estimates from NM003367 to NM207291, which lacks the high-GC exon.

    “the drop in coverage for samples from center 1 results in a shift in expression estimates from NM003367 to NM207291, which does not include the high GC exon”
    Quote in the paperSubstantial claim
  • Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Overall mixing ratio recovery for all methods was higher for poly-A selected samples (65-75%) than for ribosomal RNA depleted samples (45-65%).

    “Overall, the mixing ratio recovery for all methods was higher for poly-A selected samples (65-75%) compared to ribosomal RNA depleted samples (45-65%).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The expected mixing ratios in the ABRF dataset are accurate ground truth for assessing measurement accuracy.
  • Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Correcting for fragment sequence bias with alpine reduced extreme predicted changes in isoform percent across centers among 2,838 two-isoform genes.

    “Correcting for fragment sequence bias using alpine reduced the number of extreme predicted changes in isoform percent when comparing across center”
    Quote in the paperSubstantial claim
  • Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    RSEM showed similar rates of across-center differentially expressed transcripts.

    “RSEM had similar rates of differentially expressed transcripts across center”
    Quote in the paperSubstantial claim
  • May combine two claims. 21
  • Classified as probably not a substantial claim. 5
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    In simulations where condition was confounded with sequencing center, alpine had the highest sensitivity for a given specificity; in the balanced design, methods performed similarly.

    “alpine had the highest sensitivity for a given specificity in the confounded design (Figure 3g-h), while methods performed similarly for the balanced design”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The Polyester-simulated RNA-seq data, with fragment GC dependence estimated from GEUVADIS samples, adequately represents real RNA-seq bias for sensitivity analysis.
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    MISO was more consistent than existing transcript abundance estimators at isoform identification, but alpine reported less than half of the large across-center isoform switches MISO reported.

    “While MISO performed better than the existing transcript abundance estimators in consistency of isoform identification, alpine reported less than half of the large isoform switches across center reported by MISO”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    The GC content effect is often nonlinear and highly sample-specific, so sample-specific bias estimation with smooth functions of fragment GC content is needed.

    “we confirmed other findings 21, that the GC content effect was often nonlinear and highly sample-specific, therefore requiring sample-specific bias estimation using smooth functions of fragment GC content.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [21] Benjamini, Y. & Speed, T.P. Summarizing and correcting the GC content bias in high-throughput sequencing. Nucleic Acids Res. 40, e72 (2012). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Fitting the fragment sequence model takes more computational effort than other models, though the implementation ran in comparable time to Cufflinks cuffquant.

    “Fitting the fragment sequence model does require more computational effort than other models, though our implementation ran in comparable time to the cuffquant step of the Cufflinks suite”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Adding GC stretch information to the fragment GC model improved predictive power, but only slightly.

    “The model that also included the information about GC stretches was more predictive than the model with just the fragment GC content, although only slightly so.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Alpine had the highest accuracy in estimating true expression values compared with other methods, with low median absolute error in isoform percent for two-isoform genes, comparable to RSEM.

    “alpine had the highest accuracy in estimating the true expression values compared to the other methods (Supplementary Figures 18-19), with low median absolute error in estimating the percent of isoform abundance for genes with two isoforms, comparable to RSEM”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    When counting transcripts whose C/D ratio was within 10% of expected, RSEM had the highest recovery for both protocols, while alpine was consistently high (within 5% of the top method).

    “When quantifying the number of transcripts whose C/D ratio was within 10% of the expected value, RSEM had the highest recovery for both protocols, though alpine also had consistently high recovery (within 5% of the top method).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: The expected mixing ratios in the ABRF dataset are accurate ground truth for assessing measurement accuracy.
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Models with fragment GC content doubled the predictive power of read-start bias models, including Cufflinks VLMM within alpine and mseq, which performed similarly.

    “The models that included fragment GC content doubled the predictive power of the read start bias models, both the Cufflinks VLMM read start bias model implemented within alpine and mseq, which performed similarly”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Alpine greatly reduced across-center significant differences while within-center coefficient of variation stayed the same as Cufflinks.

    “In general, alpine greatly reduced across-center significant differences while within-center coefficient of variation of abundance estimates remained the same as for Cufflinks”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Across ABRF protocols, the shape of fragment GC dependence changed little, but positional bias showed a strong effect, with poly-A selected samples having highest coverage at the 3' end.

    “We observed little change in the shape of fragment GC dependence across protocol, and a strong effect in the positional bias, with poly-A selected samples having highest coverage at the 3’ end of transcripts, as reported by the ABRF study authors29”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [29] Li, S. et al. Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study. Nat. Biotechnol. 32, 915–925 (2014). source

      Not checked in the free run.

    • Rests on an assumption: The ABRF samples prepared with different protocols are comparable except for the protocol.
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Alpine, by using fragment sequence features, substantially improves transcript abundance accuracy and cuts false positives for expression changes fourfold relative to Cufflinks.

    “By incorporating fragment sequence features, alpine greatly increases the accuracy of transcript abundance estimates, enabling a fourfold reduction in the number of false positives for reported changes in expression compared with Cufflinks.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    With Bonferroni correction at 1% FWER, Cufflinks reported 157 across-center DE transcripts and alpine reported 37.

    “Using a more conservative Bonferroni correction, Cufflinks reported 157 differentially expressed transcripts across center with FWER of 1%, while alpine reported only 37.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    RNA-seq experiments commonly involve total or partial confounding, unknown batches, and sample-specific within-batch deviations, none of which the balanced design simulation captures.

    “In contrast, scenarios with total or partial confounding, unknown batches, and sample-specific deviations within batches are typical in RNA-seq experiments and not represented by the balanced design simulation.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    To avoid unequal final library sizes from discarded read pairs, the simulation was repeated with a higher initial target library size so that the expected final size was 60 million paired-end reads.

    “As the process of discarding pairs of reads would result in unequal final library size, the simulation process was repeated, after first scaling the initial target library size higher such that the final library size for the experiment would be equal to 60 million paired-end reads in expectation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    In the specificity analysis, alpine was run with bias correction for fragment length, relative position, and fragment GC content, and the other methods were run with their bias correction options enabled, including a positional bias correction for RSEM.

    “The alpine software was run with bias correction terms for fragment length, relative position, and fragment GC content, and other methods were run with their bias correction arguments turned on, including a positional bias correction term for RSEM (Supplementary Note).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    For DNA-seq, GC bias is best corrected by modeling at the fragment scale.

    “For DNA-seq, this bias is best corrected by modeling at the scale of the fragment21.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] Benjamini, Y. & Speed, T.P. Summarizing and correcting the GC content bias in high-throughput sequencing. Nucleic Acids Res. 40, e72 (2012). source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductown data

    The GC content curves used in the simulation were estimated after read start bias had been removed with the Cufflinks VLMM, so the simulated fragment sequence effect does not stand in for read start bias.

    “Note that the GC content curves used in the simulation (Figure 2e) were estimated after removing the read start bias using the Cufflinks VLMM, and so the fragment sequence effect observed is not a proxy for read start bias.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Extreme technical, sample-specific variability in coverage along transcripts is common, is not explained by current bias models, and confounds transcript identification and quantification.

    “Even so, it is common to observe extreme variability in the coverage of RNA-seq fragments along transcripts that is purely technical and sample-specific17 and not explained by current bias models, which confounds current methods designed to identify and quantify transcripts18”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [17] Lahens, N.F. et al. IVT-seq reveals extreme bias in RNA sequencing. Genome Biol. 15, R86 (2014). source

      Not checked in the free run.

    • cites [18] Hayer, K.E., Pizarro, A., Lahens, N.F., Hogenesch, J.B. & Grant, G.R. Benchmark analysis of algorithms for determining and quantifying full-length mRNA splice forms from RNA-seq data. Bioinformatics 31, 3938–3945 (2015). source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    The identified problem applies to within-sample transcript abundance estimates for samples from a single center and for small-scale experiments.

    “The problem we identify holds for within-sample transcript abundance estimates for samples from a single center and for samples in small-scale experiments.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    The study demonstrated specificity using data from different sequencing centers and sensitivity using simulation.

    “Here we demonstrated specificity using data prepared by different sequencing centers, and sensitivity using simulation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The balanced design with sequencing center as a blocking factor is the best-case scenario for the competing methods, because the batches were known exactly and the residual degrees of freedom was high, allowing batch effects on transcript abundance estimates to be precisely estimated and removed by the linear model.

    “Note that the balanced design with blocking factor represents the best-case scenario for the competing methods, as the batches were known exactly and the residual degrees of freedom was high, such that the batch effects on transcript abundance estimates could be precisely estimated and removed by the linear model.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    GC content bias is often seen in high-throughput sequencing, with some GC fragments under-represented, and can be partly attributed to PCR amplification during library preparation.

    “A GC content bias is often observed in high-throughput sequencing data, with fragments of certain GC content under-represented, and can be partially attributed to PCR amplification during library preparation20.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] Aird, D. et al. Analyzing and minimizing PCR amplification bias in Illumina sequencing libraries. Genome Biol. 12, R18 (2011). source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data
    § Modeling of RNA-seq fragment sequence bias reduces systematic errors in transcript abundance estimation

    Across protocols, all methods including alpine reported 10,000-14,000 false-positive abundance differences at 1% FDR out of 28,000, suggesting none can remove the bulk of systematic bias across protocol.

    “The large number of transcripts with false positive differences in abundance reported across protocol, in the range of 10-14,000 at 1% FDR for all methods out of 28,000, suggests that none of the existing methods evaluated including alpine can remove the bulk of systematic bias seen across protocol.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The ABRF samples prepared with different protocols are comparable except for the protocol.
23 of 23
  • The paper relies on this without support.

    The 30 GEUVADIS samples from the two sequencing centers have no true biological differences across centers, so across-center differential expression is technical.

    “We downloaded 30 RNA-seq samples from the GEUVADIS Project of lymphoblastoid cell lines derived from the Toscani population, 15 of which were sequenced at one center and 15 at another19”
  • The paper relies on this without support.

    The Polyester-simulated RNA-seq data, with fragment GC dependence estimated from GEUVADIS samples, adequately represents real RNA-seq bias for sensitivity analysis.

    “we performed a sensitivity analysis using an RNA-seq fragment simulator, Polyester 28, to generate 30 samples with fragment GC content dependence estimated from the 30 GEUVADIS samples, after having removed read start sequence bias”
  • The paper relies on this without support.

    The expected mixing ratios in the ABRF dataset are accurate ground truth for assessing measurement accuracy.

    “The relationship of the samples in the ABRF dataset allowed an assessment of the measurement accuracy in terms of the methods’ recovery of expected mixing ratios”
  • The paper relies on this without support.

    The SEQC samples prepared at different sites are comparable except for library preparation location.

    “including libraries of the same samples that were prepared and sequenced at three different sites and libraries prepared at a separate site and only sequenced at the three sites”
  • The paper relies on this without support.

    The ABRF samples prepared with different protocols are comparable except for the protocol.

    “we downloaded a subset of samples from the ABRF Next-Generation Sequencing Study29 that were prepared using either ribosomal RNA depletion or poly-A selection”
  • The paper relies on this without support.

    The IVT transcripts with high unpredictable coverage are representative of transcripts affected by fragment sequence bias.

    “We focused our analysis on 64 of the IVT transcripts as exhibiting “high unpredictable coverage”17.”
  • The paper relies on this without support.

    The poly-A selection protocol does not capture all non-coding transcripts.

    “as the poly-A selection protocol is not designed to capture all the non-coding transcripts”
  • The paper relies on this without support.

    The C and D samples in the ABRF dataset were made by mixing the A and B samples in 3:1 and 1:3 ratios, respectively.

    “As the C and D samples in the ABRF dataset were created by mixing 3:1 and 1:3 ratios of the A and B samples respectively”
8 of 8

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • If not corrected, these biases can cause high false positive rates in differential expression studies.

    “When uncorrected, these biases can lead to, e.g., high false positive rates in differential expression studies [5].”
  • Existing transcriptome-wide abundance estimators, whether alignment-based or alignment-free, do not have sample-specific bias models detailed enough to capture major effects such as fragment GC content bias.

    “However, existing methods for transcriptome-wide abundance estimation, both alignment-based and alignment-free, lack sample-specific bias models rich enough to capture important effects, like fragment GC content bias.”
  • The GC content of an entire fragment can strongly affect its likelihood of being selected for sequencing.

    “it has also been observed that the GC-content of the entire fragment can play a substantial role in the likelihood that it will be selected for sequencing [5].”
  • The accuracy of isoform estimates is hindered by incomplete annotations, limitations of short-read sequencing, coverage, and genomic biases like GC content.

    “the accuracy of these estimates is hindered by incomplete annotations, as well as by limitations of short-read sequencing, coverage, and genomic biases like GC content (84, 85).”

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Patro, R., Duggal, G. & Kingsford, C. Accurate, fast, and model-aware transcript expression quantification with Salmon. bioRxiv (2015).

Cited by

Sorted by citations

Authors
Love, M. I., Hogenesch, J. B., & Irizarry, R. A.
Affiliations
  • Harvard University (US)
  • University of Pennsylvania (US)
Corresponding author
Irizarry, Rafael A
Venue
Nature Biotechnology
Published
2016-09-26
Volume
34
Issue
12
Pages
1287-1291
ISSN
  • 0733-222X (ISSN-L)
  • 1087-0156
  • 1546-1696
OpenAlex
W1897931464
Cited by
186
References
39
Citations by year
2026: 10 · 2025: 13 · 2024: 15 · 2023: 9 · 2022: 38 · 2021: 29 · 2020: 18 · 2019: 20 · 2018: 19 · 2017: 10 · 2016: 4 · 2015: 1
FWCI
9.18
Type
journal article
Language
en
Open access
Locations
  • Nature Biotechnology (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
  • Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
Funders
  • National Institutes of Health (NIH-R01, R01‐grant)
  • Defense Advanced Research Projects Agency (DARPA-D12AP00025, D12AP00025)
  • Advanced Research Projects Agency
  • National Human Genome Research Institute (R01HG005220)
  • National Cancer Institute (T32CA009337)
  • National Institute of General Medical Sciences (R01GM083084)
  • National Institute of Neurological Disorders and Stroke (R01NS054794)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
Keywords
RNA-seq, transcript abundance estimation, GC content bias, Alpine, false positives
MeSH terms
Algorithms, Base Composition, Computer Simulation, Models, Genetic, RNA, Sensitivity and Specificity, Software, Transcription Factors, Reproducibility of Results, Models, Statistical, Artifacts, Sequence Analysis, RNA

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-05.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-05.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review