Cited by 235RNA Research and SplicingGenomics and Rare DiseasesGenomics and Phylogenetic Studies

MMSplice: modular modeling improves the predictions of genetic variant effects on splicing

Open access
Cheng, Jun, Nguyen, Thi Yen Duong, Cygan, Kamil J., Çelik, Muhammed Hasan, Fairbrother, William G., Avsec, žiga, Gagneur, Julien·2019·Genome Biology

Published version of a preprint

Abstract

Predicting the effects of genetic variants on splicing is highly relevant for human genetics. We describe the framework MMSplice (modular modeling of splicing) with which we built the winning model of the CAGI5 exon skipping prediction challenge. The MMSplice modules are neural networks scoring exon, intron, and splice sites, trained on distinct large-scale genomics datasets. These modules are combined to predict effects of variants on exon skipping, splice site choice, splicing efficiency, and pathogenicity, with matched or higher performance than state-of-the-art. Our models, available in the repository Kipoi, apply to variants including indels directly from VCF files.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13059-019-1653-z

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Sequence-based models of post-transcriptional regulation rely on genome annotations and transformed measurements extracted from RNA-seq to isolate each regulatory mechanism.

    “Similarly, sequence-based models of post-transcriptional regulation rely on genome annotations and transformed measurements extracted from RNA-seq to isolate each regulatory mechanism (for example, percent spliced-in for splicing)14–23.”

    From Predicting RNA-seq coverage from DNA sequence as a unifying model of gene regulation (2025) · cites this paper as [14]

    The Background (page unavailable) describes percent spliced-in as an RNA-seq-derived measure used by sequence-based splicing models. The Results, “Modular modeling strategy” (page unavailable), says MMSplice trains separate splicing modules using genome annotations and measured splicing outcomes. These passages support the splicing example, but not the broader claim that models of post-transcriptional regulation generally use those inputs to isolate each regulatory mechanism. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 57

  1. [1]López-Bigas N, Audit B, Ouzounis C, Parra G, Guigó R. Are splicing mutations the most frequent cause of hereditary disease?FEBS Lett. 2005; 579(9):1900–3. 10.1016/j.febslet.2005.02.047. 15792793 · DOI · Paper page
  2. [2]Li YI, van de Geijn B, Raj A, Knowles DA, Petti AA, Golan D, Gilad Y, Pritchard JK. RNA splicing is a primary link between genetic variation and disease. Science. 2016; 352(6285):600–4. 10.1126/science.aad9417. PMC5182069 27126046 · DOI · Paper page
  3. [3]Wahl MC Will CL Lührmann R The spliceosome: design principles of a dynamic RNP machine Cell 2009 136 4 701 18 10.1016/j.cell.2009.02.009 19239890 · DOI · Paper page
  4. [4]Wang Z Burge CB Splicing regulation: from a parts list of regulatory elements to an integrated splicing code Rna 2008 14 5 802 13 10.1261/rna.876308 18369186 PMC2327353 · DOI
  5. [5]Scotti MM, Swanson MS. RNA mis-splicing in disease. Nat Rev Genet. 2015; 17(1):19–32. 10.1038/nrg.2015.3. PMC5993438 26593421 · DOI
  6. [6]Reese MG Eeckman FH Kulp D Haussler D Improved splice site detection in Genie J Comput Biol 1997 4 3 311 23 10.1089/cmb.1997.4.311 9278062 · DOI
  7. [7]Yeo G, Burge CB. Maximum entropy modeling of short sequence motifs with applications to RNA splicing signals. J Comput Biol J Comput Mol Cell Biol. 2004; 11(2-3):377–94. 10.1089/1066527041410418. 15285897 · DOI
  8. [8]Fairbrother WG Yeh RF Sharp PA Burge CB Predictive identification of exonic splicing enhancers in human genes Science 2002 297 5583 1007 13 10.1126/science.1073774 12114529 · DOI
  9. [9]Fairbrother WG, Yeo GW, Yeh R, Goldstein P, Mawson M, Sharp PA, Burge CB. RESCUE-ESE identifies candidate exonic splicing enhancers in vertebrate exons. Nucleic Acids Res. 2004; 32(Web Server issue):187–90. 10.1093/nar/gkh393. PMC441531 15215377 · DOI
  10. [10]Zhang XHF, Chasin LA. Computational definition of sequence motifs governing constitutive exon splicing. Genes Dev. 2004; 18(11):1241–50. 10.1101/gad.1195304. PMC420350 15145827 · DOI
  11. [11]Zhang XH-F Kangsamaksin T Chao MS Banerjee JK Chasin LA Exon inclusion is dependent on predictable exonic splicing enhancers Mol Cell Biol 2005 25 16 7323 32 10.1128/MCB.25.16.7323-7332.2005 16055740 PMC1190244 · DOI
  12. [12]Wang Z Xiao X Van Nostrand E Burge CB General and specific functions of exonic splicing silencers in splicing control Mol Cell 2006 23 1 61 70 10.1016/j.molcel.2006.05.018 16797197 PMC1839040 · DOI
  13. [13]Ke S, Shang S, Kalachikov SM, Morozova I, Yu L, Russo JJ, Ju J, Chasin LA. Quantitative evaluation of all hexamers as exonic splicing elements. Genome Res. 2011; 21(8):1360–74. 10.1101/gr.119628.110. PMC3149502 21659425 · DOI
  14. [14]Desmet FO, Hamroun D, Lalande M, Collod-Béroud G, Claustres M, Béroud C. Human Splicing Finder: an online bioinformatics tool to predict splicing signals. Nucleic Acids Res. 2009; 37(9):67. 10.1093/nar/gkp215. PMC2685110 19339519 · DOI
  15. [15]Mort M, Sterne-Weiler T, Li B, Ball EV, Cooper DN, Radivojac P, Sanford JR, Mooney SD. MutPred Splice: machine learning-based prediction of exonic variants that disrupt splicing. Genome Biol. 2014; 15(1):19. 10.1186/gb-2014-15-1-r19. PMC4054890 24451234 · DOI
  16. [16]Leman R Gaildrat P Gac GL Ka C Fichou Y Audrezet M-P Caux-Moncoutier V Caputo SM Boutry-Kryza N Léone M Novel diagnostic tool for prediction of variant spliceogenicity derived from a set of 395 combined in silico/in vitro studies: an international collaborative effort Nucleic Acids Res 2018 46 15 7913 23 10.1093/nar/gky372 29750258 PMC6125621 · DOI
  17. [17]Xiong HY, Alipanahi B, Lee LJ, Bretschneider H, Merico D, Yuen RKC, Hua Y, Gueroussov S, Najafabadi HS, Hughes TR, Morris Q, Barash Y, Krainer aR, Jojic N, Scherer SW, Blencowe BJ, Frey BJ. The human splicing code reveals new insights into the genetic determinants of disease. Science (80-). 2015; 347(6218):1254806. 10.1126/science.1254806. PMC4362528 25525159 · DOI
  18. [18]Rosenberg AB, Patwardhan RP, Shendure J, Seelig G. Learning the sequence determinants of alternative splicing from millions of random sequences. Cell. 2015; 163(3):698–711. 10.1016/j.cell.2015.09.054. 26496609 · DOI
  19. [19]Bretschneider H, Gandhi S, Deshwar AG, Zuberi K, Frey BJ. COSSMO: predicting competitive alternative splice site selection using deep learning. Bioinformatics (Oxford, England). 2018; 34(13):429–37. 10.1093/bioinformatics/bty244. PMC6022534 29949959 · DOI
  20. [20]Katz Y, Wang ET, Airoldi EM, Burge CB. Analysis and design of RNA sequencing experiments for identifying isoform regulation. Nat Methods. 2010; 7(12):1009–15. 10.1038/nmeth.1528. 9605103. PMC3037023 21057496 · DOI · Paper page
  21. [21]Barash Y, Calarco JA, Gao W, Pan Q, Wang X, Shai O, Blencowe BJ, Frey BJ. Deciphering the splicing code. Nature. 2010; 465(7294):53–9. 10.1038/nature09000. 20445623 · DOI
  22. [22]Xiong HY, Barash Y, Frey BJ. Bayesian prediction of tissue-regulated splicing using RNA sequence and cellular context. Bioinformatics. 2011; 27(18):2554–62. 10.1093/bioinformatics/btr444. 21803804 · DOI
  23. [23]Jha A, Gazzara MR, Barash Y. Integrative deep models for alternative splicing. Bioinformatics. 2017; 33(14):274–82. 10.1093/bioinformatics/btx268. PMC5870723 28882000 · DOI
  24. [24]Pervouchine DD Knowles DG Guigó R Intron-centric estimation of alternative splicing from rna-seq data Bioinformatics 2012 29 2 273 4 10.1093/bioinformatics/bts678 23172860 PMC3546801 · DOI
  25. [25]Park E, Pan Z, Zhang Z, Lin L, Xing Y. The expanding landscape of alternative splicing variation in human populations. Am J Hum Genet. 2018; 102(1):11–26. 10.1016/j.ajhg.2017.11.002. PMC5777382 29304370 · DOI
  26. [26]Vaquero-Garcia J, Barrera A, Gazzara MR, González-Vallinas J, Lahens NF, Hogenesch JB, Lynch KW, Barash Y. A new view of transcriptome complexity and regulation through the lens of local splicing variations. eLife. 2016; 5:11752. 10.7554/eLife.11752. arXiv:1011.1669v3. PMC4801060 26829591 · DOI · Paper page
  27. [27]Soemedi R, Cygan KJ, Rhine CL, Wang J, Bulacan C, Yang J, Bayrak-Toydemir P, McDonald J, Fairbrother WG. Pathogenic variants that alter protein code often disrupt splicing. Nat Genet. 2017; 49(6):848–55. 10.1038/ng.3837. PMC6679692 28416821 · DOI
  28. [28]Ke S Anquetil V Zamalloa JR Maity A Yang A Arias MA Kalachikov S Russo JJ Ju J Chasin LA Saturation mutagenesis reveals manifold determinants of exon definition Genome Res 2018 28 1 11 24 10.1101/gr.219683.116 29242188 PMC5749175 · DOI
  29. [29]Adamson SI Zhan L Graveley BR Vex-seq: high-throughput identification of the impact of genetic variation on pre-mRNA splicing efficiency Genome Biol 2018 19 1 71 10.1186/s13059-018-1437-x 29859120 PMC5984807 · DOI
  30. [30]Landrum MJ Lee JM Riley GR Jang W Rubinstein WS Church DM Maglott DR Clinvar: public archive of relationships among sequence variation and human phenotype Nucleic Acids Res 2013 42 D1 980 5 10.1093/nar/gkt1113 PMC3965032 24234437 · DOI · Paper page
  31. [31]Avsec Z, Kreuzhuber R, Israeli J, Xu N, Cheng J, Shrikumar A, Banerjee A, Kim DS, Urban L, Kundaje A, Stegle O, Gagneur J. Kipoi: accelerating the community exchange and reuse of predictive models for genomics. bioRxiv. 2018. 10.1101/375345. https://www.biorxiv.org/content/early/2018/07/24/375345.full.pdf. PMC6777348 31138913 · DOI
  32. [32]Lek M, Karczewski KJ, Minikel EV, Samocha KE, Banks E, Fennell T, O’Donnell-Luria AH, Ware JS, Hill AJ, Cummings BB, Tukiainen T, Birnbaum DP, Kosmicki JA, Duncan LE, Estrada K, Zhao F, Zou J, Pierce-Hoffman E, Berghout J, Cooper DN, Deflaux N, DePristo M, Do R, Flannick J, Fromer M, Gauthier L, Goldstein J, Gupta N, Howrigan D, Kiezun A, Kurki MI, Moonshine AL, Natarajan P, Orozco L, Peloso GM, Poplin R, Rivas MA, Ruano-Rubio V, Rose SA, Ruderfer DM, Shakir K, Stenson PD, Stevens C, Thomas BP, Tiao G, Tusie-Luna MT, Weisburd B, Won HH, Yu D, Altshuler DM, Ardissino D, Boehnke M, Danesh J, Donnelly S, Elosua R, Florez JC, Gabriel SB, Getz G, Glatt SJ, Hultman CM, Kathiresan S, Laakso M, McCarroll S, McCarthy MI, McGovern D, McPherson R, Neale BM, Palotie A, Purcell SM, Saleheen D, Scharf JM, Sklar P, Sullivan PF, Tuomilehto J, Tsuang MT, Watkins HC, Wilson JG, Daly MJ, MacArthur DG. Analysis of protein-coding genetic variation in 60,706 humans. Nature. 2016; 536(7616):285–91. 10.1038/nature19057. 030338. PMC5018207 27535533 · DOI · Paper page
  33. [33]Hoskins RA Repo S Barsky D Andreoletti G Moult J Brenner SE Reports from CAGI: the critical assessment of genome interpretation Hum Mutat 2017 38 9 1039 41 10.1002/humu.23290 28817245 PMC5606199 · DOI
  34. [34]Cheung R Insigne KD Yao D Burghard CP Wang J Hsiao Y-HE Jones EM Goodman DB Xiao X Kosuri S A multiplexed assay for exon recognition reveals that an unappreciated fraction of rare genetic variants cause large-effect splicing disruptions Mol Cell 2019 73 1 183 94 10.1016/j.molcel.2018.10.037 30503770 PMC6599603 · DOI · Paper page
  35. [35]Kircher M Witten DM Jain P O’roak BJ Cooper GM Shendure J A general framework for estimating the relative pathogenicity of human genetic variants Nat Genet 2014 46 3 310 10.1038/ng.2892 24487276 PMC3992975 · DOI · Paper page
  36. [37]Lonsdale J Thomas J Salvatore M Phillips R Lo E Shad S Hasz R Walters G Garcia F Young N The genotype-tissue expression (gtex) project Nat Genet 2013 45 6 580 10.1038/ng.2653 23715323 PMC4010069 · DOI · Paper page
  37. [38]Warf MB, Berglund JA. Role of RNA structure in regulating pre-mRNA splicing. Trends Biochem Sci. 2010; 35(3):169–78. 10.1016/j.tibs.2009.10.004. PMC2834840 19959365 · DOI
  38. [39]Danecek P, Auton A, Abecasis G, Albers CA, Banks E, DePristo MA, Handsaker RE, Lunter G, Marth GT, Sherry ST, McVean G, Durbin R. The variant call format and VCFtools. Bioinformatics. 2011; 27(15):2156–8. 10.1093/bioinformatics/btr330. NIHMS150003. PMC3137218 21653522 · DOI
  39. [40]McLaren W, Gil L, Hunt SE, Riat HS, Ritchie GRS, Thormann A, Flicek P, Cunningham F. The Ensembl variant effect predictor. Genome Biol. 2016; 17(1). 10.1186/s13059-016-0974-4. PMC4893825 27268795 · DOI · Paper page
  40. [41]Paggi JM, Bejerano G. A sequence-based, deep learning model accurately predicts RNA splicing branchpoints. RNA. 2018; 24(12):1647–58. 10.1261/rna.066290.118. PMC6239175 30224349 · DOI
  41. [44]Consortium G The Genotype-Tissue Expression (GTEx) pilot analysis: multitissue gene regulation in humans Science 2015 348 6235 648 0 10.1126/science.1262110 25954001 PMC4547484 · DOI · Paper page
  42. [45]Yeo G, Holste D, Kreiman G, Burge CB. Variation in alternative splicing across human tissues. Genome Biol. 2004; 5(10):74. 10.1186/gb-2004-5-10-r74. PMC545594 15461793 · DOI · Paper page
  43. [46]Cheng J, Maier KC, Avsec ž, Rus P, Gagneur J. Cis -regulatory elements explain most of the mRNA stability variation across genes in yeast. RNA. 2017; 23(11):1648–59. 10.1261/rna.062224.117. PMC5648033 28802259 · DOI · Paper page
  44. [47]Kolasinska-Zwierz P, Down T, Latorre I, Liu T, Liu XS, Ahringer J. Differential chromatin marking of introns and expressed exons by H3K36me3. Nat Genet. 2009; 41(3):376–81. 10.1038/ng.322. PMC2648722 19182803 · DOI
  45. [48]Han K, Yeo G, An P, Burge CB, Grabowski PJ. A combinatorial code for splicing silencing: UAGG and GGGG motifs. PLoS Biol. 2005; 3(5):0843–60. 10.1371/journal.pbio.0030158. PMC1079783 15828859 · DOI
  46. [49]Jagadeesh KA, Paggi JM, Ye JS, Stenson PD, Cooper DN, Bernstein JA, Bejerano G. S-CAP extends clinical-grade pathogenicity prediction to genetic variants that affect RNA splicing. bioRxiv. 2018:343749. 10.1101/343749. 30804562 · DOI
  47. [51]Ioffe S, Szegedy C. Batch Normalization: accelerating deep network training by reducing internal covariate shift. arXiv. 2015. http://arxiv.org/abs/1502.03167. · arXiv
  48. [53]Bergstra J Komer B Eliasmith C Yamins D Cox DD Hyperopt: a python library for model selection and hyperparameter optimization Comput Sci Discov 2015 8 1 014008 10.1088/1749-4699/8/1/014008 · DOI
  49. [54]Huber PJ. Robust estimation of a location parameter. Ann Math Stat. 1964; 35(1):73–101. 10.1214/aoms/1177703732. http://arxiv.org/abs/arXiv:1111.1308v3. · DOI · Paper page
  50. [55]Pollard KS, Hubisz MJ, Rosenbloom KR, Siepel A. Detection of nonneutral substitution rates on mammalian phylogenies. Genome Res. 2010; 20(1):110–21. 10.1101/gr.097857.109. PMC2798823 19858363 · DOI · Paper page
  51. [57]Cheng J, Çelik MH. MMSplice: modular modeling improves the predictions of genetic variant effects on splicing. GitHub. https://github.com/gagneurlab/MMSplice. PMC6396468 30823901
  52. [58]Cheng J, Çelik MH, Avsec Z. MMSplice: modular modeling improves the predictions of genetic variant effects on splicing. GitHub. https://github.com/kipoi/models/tree/master/MMSplice. PMC6396468 30823901
  53. [59]Cheng J. MMSplice: modular modeling improves the predictions of genetic variant effects on splicing. Zenodo. 10.5281/zenodo.2555955. PMC6396468 30823901 · DOI
  54. [60]Cheng J. MMSplice: modular modeling improves the predictions of genetic variant effects on splicing. GitHub. https://github.com/gagneurlab/MMSplice_paper. PMC6396468 30823901
  55. [61]Adamson SI. Vex-seq: high-throughput identification of the impact of genetic variation on pre-mRNA splicing efficiency. GitHub. https://github.com/scottiadamson/Vex-seq. Accessed 16 Feb 2018. PMC5984807 29859120
  56. [62]Insigne KD. A multiplexed assay for exon recognition reveals that an unappreciated fraction of rare genetic variants cause large-effect splicing disruptions. GitHub. https://github.com/KosuriLab/MFASS. Accessed 15 Mar 2018. PMC6599603 30503770
  57. [63]Landrum MJ, Lee JM, Riley GR, Jang W, Rubinstein WS, Church DM, Maglott DR. ClinVar: public archive of relationships among sequence variation and human phenotype. ClinVar. ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37/archive_2.0/2018/clinvar_20180429.vcf.gz. Accessed May 2018. PMC3965032 24234437

Cited by

Sorted by citations

Authors
Cheng, J., Nguyen, T. Y. D., Cygan, K. J., Çelik, M. H., Fairbrother, W. G., Avsec, Ž., & Gagneur, J.
Affiliations
  • Technical University of Munich (DE)
  • Brown University (US)
Corresponding author
Gagneur, Julien
Venue
Genome Biology
Published
2019-03-01
Volume
20
Issue
1
Pages
48-48
ISSN
  • 1465-6906 (ISSN-L)
  • 1474-760X
OpenAlex
W2918497364
Cited by
235
References
4
Citations by year
2026: 24 · 2025: 31 · 2024: 50 · 2023: 37 · 2022: 37 · 2021: 33 · 2020: 11 · 2019: 11 · 2013: 1
FWCI
7.61
Type
journal article
Language
en
Open access
Locations
  • Genome biology (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Nvidia
  • Deutsche Forschungsgemeinschaft
  • National Institute of General Medical Sciences (R01GM095612, R01GM105681, R01GM127472)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA Research and Splicing
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
Keywords
splicing efficiency, variant pathogenicity prediction, Kipoi, indels
MeSH terms
Models, Genetic, Genetic Variation, Neural Networks, Computer, Alternative Splicing, Genetic Diseases, Inborn

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review