CoChat

Secondary structure prediction of long noncoding RNA: review and experimental comparison of existing approaches

Open access
Bugnon, L A, Edera, A A, Prochetto, S, Gerard, M, Raad, J, Fenoy, E, Rubiolo, M, Chorostecki, U, Gabaldón, T, Ariel, F, Di Persia, L E, Milone, D H, Stegmayer, G · 2022 · Briefings in Bioinformatics
Cited by 53

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

Motivation: In contrast to messenger RNAs, the function of the wide range of existing long noncoding RNAs (lncRNAs) largely depends on their structure, which determines interactions with partner molecules. Thus, the determination or prediction of the secondary structure of lncRNAs is critical to uncover their function. Classical approaches for predicting RNA secondary structure have been based on dynamic programming and thermodynamic calculations. In the last 4 years, a growing number of machine learning (ML)-based models, including deep learning (DL), have achieved breakthrough performance in structure prediction of biomolecules such as proteins and have outperformed classical methods in short transcripts folding. Nevertheless, the accurate prediction for lncRNA still remains far from being effectively solved. Notably, the myriad of new proposals has not been systematically and experimentally evaluated. Results: In this work, we compare the performance of the classical methods as well as the most recently proposed approaches for secondary structure prediction of RNA sequences using a unified and consistent experimental setup. We use the publicly available structural profiles for 3023 yeast RNA sequences, and a novel benchmark of well-characterized lncRNA structures from different species. Moreover, we propose a novel metric to assess the predictive performance of methods, exclusively based on the chemical probing data commonly used for profiling RNA structures, avoiding any potential bias incorporated by computational predictions when using dot-bracket references. Our results provide a comprehensive comparative assessment of existing methodologies, and a novel and public benchmark resource to aid in the development and comparison of future approaches. Availability: Full source code and benchmark datasets are available at: https://github.com/sinc-lab/lncRNA-folding Contact: lbugnon@sinc.unl.edu.ar

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/bib/bbac205

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 85

  1. Lee, 2019, Long noncoding RNAs and repetitive elements: Junk or intimate evolutionary partners?, Trends Genet, 35, 892, 10.1016/j.tig.2019.09.006 · DOI · Paper page
  2. The ENCODE Project Consortium, 2012, An integrated encyclopedia of DNA elements in the human genome, Nature, 489, 57, 10.1038/nature11247 · DOI · Paper page
  3. Mortimer, 2014, Insights into RNA structure and function from genome-wide studies, Nat Rev Genet, 15, 469, 10.1038/nrg3681 · DOI · Paper page
  4. Kapranov, 2007, Rna maps reveal new rna classes and a possible function for pervasive transcription, Science, 316, 1484, 10.1126/science.1138341 · DOI · Paper page
  5. Ulitsky, 2013, lincRNAs: Genomics, evolution, and mechanisms, Cell, 154, 26, 10.1016/j.cell.2013.06.020 · DOI · Paper page
  6. Flynn, 2014, Long noncoding RNAs in cell-fate programming and reprogramming, Cell Stem Cell, 14, 752, 10.1016/j.stem.2014.05.014 · DOI · Paper page
  7. Lee, 2013, X-inactivation, imprinting, and long noncoding RNAs in health and disease, Cell, 152, 1308, 10.1016/j.cell.2013.02.016 · DOI · Paper page
  8. Ligang, 2008, Let me count the ways: Mechanisms of gene regulation by miRNAs and siRNAs, Mol Cell, 29, 1, 10.1016/j.molcel.2007.12.010 · DOI · Paper page
  9. Zou, 2015, Prediction of MicroRNA-disease associations based on social network analysis methods, Biomed Res Int, 2015, 1
  10. Rizki, 2015, Lncding epigenetic control of transcription to cardiovascular development and disease, Circ Res, 117, 192, 10.1161/CIRCRESAHA.117.304156 · DOI
  11. Anastasiadou, 2018, Non-coding rna networks in cancer, Nat Rev Cancer, 18, 5, 10.1038/nrc.2017.99 · DOI · Paper page
  12. Ariel, 2015, Battles and hijacks: noncoding transcription in plants, Trends Plant Sci, 20, 362, 10.1016/j.tplants.2015.03.003 · DOI · Paper page
  13. Lucero, 2020, Functional classification of plant long noncoding RNAs: a transcript is known by the company it keeps, New Phytol, 229, 1251, 10.1111/nph.16903 · DOI
  14. Rinn, 2020, Long noncoding RNAs: Molecular modalities to organismal functions, Annu Rev Biochem, 89, 283, 10.1146/annurev-biochem-062917-012708 · DOI · Paper page
  15. Romero-Barrios, 2018, Splicing regulation by long noncoding RNAs, Nucleic Acids Res, 46, 2169, 10.1093/nar/gky095 · DOI · Paper page
  16. Graf, 2020, From structure to function: Route to understanding lncrna mechanism, Bioessays, 42, 2000027, 10.1002/bies.202000027 · DOI
  17. Lee, 2004, Diversity of base-pair conformations and their occurrence in rRNA structure and RNA structural motifs, J Mol Biol, 344, 1225, 10.1016/j.jmb.2004.09.072 · DOI
  18. Morris, 2014, The rise of regulatory RNA, Nat Rev Genet, 15, 423, 10.1038/nrg3722 · DOI · Paper page
  19. Achar, 2015, RNA motif discovery: a computational overview, Biol Direct, 10, 1, 10.1186/s13062-015-0090-5 · DOI
  20. Spokoini-Stern, 2020, Visualizing the structure and motion of the long noncoding rna hotair, RNA, 26, 629, 10.1261/rna.074633.120 · DOI · Paper page
  21. Fürtig, 2003, NMR spectroscopy of RNA, Chembiochem, 4, 936, 10.1002/cbic.200300700 · DOI
  22. Keel, 2007, A general strategy to solve the phase problem in RNA crystallography, Structure, 15, 761, 10.1016/j.str.2007.06.003 · DOI
  23. Ross, WIREs RNA
  24. Zampetaki, 2018, Long non-coding RNA structure and function: Is there a link?, Front Physiol, 9, 1, 10.3389/fphys.2018.01201 · DOI · Paper page
  25. Kertesz, 2010, Genome-wide measurement of RNA secondary structure in yeast, Nature, 467, 103, 10.1038/nature09322 · DOI · Paper page
  26. Saus, 2018, nextPARS: parallel probing of RNA structures in illumina, RNA, 24, 609, 10.1261/rna.063073.117 · DOI
  27. Loughrey, 2014, Shape-seq 2.0: systematic optimization and extension of high-throughput chemical probing of rna secondary structure with next generation sequencing, Nucleic Acids Res, 42, e165, 10.1093/nar/gku909 · DOI · Paper page
  28. Calonaci, 2020, Machine learning a model for RNA structure prediction, NAR Genomics and Bioinformatics, 2, 1, 10.1093/nargab/lqaa090 · DOI
  29. Zafferani, 2021, Small molecule targeting of biologically relevant rna tertiary and quaternary structures, Cell Chemical Biology, 28, 594, 10.1016/j.chembiol.2021.03.003 · DOI
  30. Bonilla, 2021, High-throughput dissection of the thermodynamic and conformational properties of a ubiquitous class of rna tertiary contact motifs, Proc Natl Acad Sci, 118, 10.1073/pnas.2109085118 · DOI
  31. Liu, 2021, Prediction of the rna tertiary structure based on a random sampling strategy and parallel mechanism, Front Genet, 12, 813604, 10.3389/fgene.2021.813604 · DOI
  32. Mathews, 1999, Expanded sequence dependence of thermodynamic parameters improves prediction of RNA secondary structure, J Mol Biol, 288, 911, 10.1006/jmbi.1999.2700 · DOI · Paper page
  33. Schroeder, 2009, Methods in Enzymology, 371
  34. Anfinsen, 1973, Principles that govern the folding of protein chains, Science, 181, 223, 10.1126/science.181.4096.223 · DOI · Paper page
  35. Zhao, 2021, Review of machine learning methods for RNA secondary structure prediction, PLoS Comput Biol, 17, 10.1371/journal.pcbi.1009291 · DOI · Paper page
  36. Zhang, 2019, A new method of RNA secondary structure prediction based on convolutional neural network and dynamic programming, Front Genet, 10, 1
  37. Singh, 2019, RNA secondary structure prediction using an ensemble of two-dimensional deep neural networks and transfer learning, Nat Commun, 10, 1, 10.1038/s41467-019-13395-9 · DOI · Paper page
  38. Laiyi, 2022, UFold: Fast and accurate RNA secondary structure prediction with deep learning, Nucleic Acids Res, 50
  39. Ashish, 2017, Advances in Neural Information Processing Systems, 6000
  40. Sato, 2021, RNA secondary structure prediction using deep learning with thermodynamic integration, Nat Commun, 12, 1, 10.1038/s41467-021-21194-4 · DOI · Paper page
  41. Fallmann, 2017, Recent advances in RNA folding, J Biotechnol, 261, 97, 10.1016/j.jbiotec.2017.07.007 · DOI
  42. Seetin, Bacterial Regulatory RNA
  43. Batenburg, 2000, PseudoBase: a database with RNA pseudoknots, Nucleic Acids Res, 28, 201, 10.1093/nar/28.1.201 · DOI
  44. Andronescu, 2008, Holger H Hoos, and Anne Condon. RNA STRAND: The RNA secondary structure and statistical analysis database, BMC Bioinformatics, 9, 1, 10.1186/1471-2105-9-340 · DOI · Paper page
  45. Murthy, 2003, RNABase: an annotated database of RNA structures, Nucleic Acids Res, 31, 502, 10.1093/nar/gkg012 · doi:10.1093/nar/gkg012
  46. Danaee, 2018, bpRNA: large-scale automated annotation and analysis of RNA secondary structure, Nucleic Acids Res, 46, 5381, 10.1093/nar/gky285 · DOI · Paper page
  47. Do, 2006, CONTRAfold: RNA secondary structure prediction without physics-based models, Bioinformatics, 22, e90, 10.1093/bioinformatics/btl246 · DOI · Paper page
  48. Sato, 2009, CENTROIDFOLD: a web server for RNA secondary structure prediction, Nucleic Acids Res, 37, W277, 10.1093/nar/gkp367 · DOI · Paper page
  49. Deigan, 2008, Accurate SHAPE-directed RNA structure determination, Proc Natl Acad Sci, 106, 97, 10.1073/pnas.0806929106 · DOI · Paper page
  50. Bellaousov, 2010, ProbKnot: Fast prediction of RNA secondary structure including pseudoknots, RNA, 16, 1870, 10.1261/rna.2125310 · DOI · Paper page
  51. Reuter, 2010, RNAstructure: software for RNA secondary structure prediction and analysis, BMC Bioinformatics, 11, 1, 10.1186/1471-2105-11-129 · DOI · Paper page
  52. Sato, 2011, IPknot: fast and accurate prediction of RNA secondary structures with pseudoknots using integer programming, Bioinformatics, 27, i85, 10.1093/bioinformatics/btr215 · DOI · Paper page
  53. Sato, 10 2022, Prediction of RNA secondary structure including pseudoknots for long sequences, Brief Bioinform, 23, 10.1093/bib/bbab395 · DOI
  54. Zakov, 2011, Rich parameterization improves RNA structure prediction, J Comput Biol, 18, 1525, 10.1089/cmb.2011.0184 · DOI · Paper page
  55. Janssen, 2014, The RNA shapes studio, Bioinformatics, 31, 423, 10.1093/bioinformatics/btu649 · DOI
  56. Zhang, 2020, LinearPartition: linear-time approximation of RNA folding partition function and base-pairing probabilities, Bioinformatics, 36, i258, 10.1093/bioinformatics/btaa460 · DOI · Paper page
  57. Willmott, 2020, Improving RNA secondary structure prediction via state inference with deep recurrent neural networks, Computational and Mathematical Biophysics, 8, 36, 10.1515/cmb-2020-0002 · DOI
  58. Singh, 2021, Improved RNA secondary structure and tertiary base-pairing prediction using evolutionary profile, mutational coupling and two-dimensional transfer learning, Bioinformatics, 37, 2589, 10.1093/bioinformatics/btab165 · DOI · Paper page
  59. Mao, 2021, Learning the fastest RNA folding path based on reinforcement learning and monte carlo tree search, Molecules, 26, 4420, 10.3390/molecules26154420 · DOI
  60. Zuker, 1981, Optimal computer folding of large RNA sequences using thermodynamics and auxiliary information, Nucleic Acids Res, 9, 133, 10.1093/nar/9.1.133 · DOI · Paper page
  61. Quan, 2020, Developing parallel ant colonies filtered by deep learned constrains for predicting RNA secondary structure with pseudo-knots, Neurocomputing, 384, 104, 10.1016/j.neucom.2019.12.041 · DOI
  62. Wang, 2019, DMfold: A novel method to predict RNA secondary structure with pseudoknots based on deep learning and improved base pair maximization principle, Front Genet, 10, 1
  63. Weizhong, 2019, Predicting RNA secondary structure via adaptive deep recurrent neural networks with energy-based filter, BMC Bioinformatics, 20, 1
  64. Yonemoto, 2015, A semi-supervised learning approach for RNA secondary structure prediction, Comput Biol Chem, 57, 72, 10.1016/j.compbiolchem.2015.02.002 · DOI
  65. Qasim, 2010, Secondary structure prediction of RNA using machine learning method, International Journal of Computer Applications, 10, 15, 10.5120/1486-2003 · doi:10.5120/1486-2003
  66. Koessler, 2010, A predictive model for secondary RNA structure using graph theory and a neural network, BMC Bioinformatics, 11, 1, 10.1186/1471-2105-11-S6-S21 · DOI
  67. Weizhong, 2021, Research on RNA secondary structure predicting via bidirectional recurrent neural network, BMC Bioinformatics, 22, 1
  68. Lalwani, 2021, An efficient three-level parallel ABC algorithm for secondary structure prediction of complex RNA sequences, Appl Soft Comput, 99, 10.1016/j.asoc.2020.106848 · DOI
  69. Kang, 2017, Cpc2: a fast and accurate coding potential calculator based on sequence intrinsic features, Nucleic Acids Res, 45, W12, 10.1093/nar/gkx428 · DOI · Paper page
  70. Mathews, 2019, How to benchmark RNA secondary structure prediction accuracy, Methods, 162-163, 60, 10.1016/j.ymeth.2019.04.003 · DOI · Paper page
  71. Chorostecki, 2021, Structural characterization of NORAD reveals a stabilizing role of spacers and two new repeat units, Comput Struct Biotechnol J, 19, 3245, 10.1016/j.csbj.2021.05.045 · doi:10.1016/j.csbj.2021.05.045
  72. Jones, 2020, An evolutionarily conserved RNA structure in the functional core of the lincRNA cyrano, RNA, 26, 1234, 10.1261/rna.076117.120 · DOI
  73. Uroda, 2019, Conserved pseudoknots in lncRNA MEG3 are essential for stimulation of the p53 pathway, Mol Cell, 75, 982, 10.1016/j.molcel.2019.07.025 · DOI · Paper page
  74. Liu, 2017, Visualizing the secondary and tertiary architectural domains of lncRNA RepA, Nat Chem Biol, 13, 282, 10.1038/nchembio.2272 · DOI
  75. Sztuba-Solinska, 2017, Kaposi’s sarcoma-associated herpesvirus polyadenylated nuclear RNA: a structural scaffold for nuclear, cytoplasmic and viral proteins, Nucleic Acids Res, 45, 6805, 10.1093/nar/gkx241 · DOI
  76. Smola, 2016, Shape reveals transcript-wide interactions, complex structural domains, and protein interactions across the xist lncrna in living cells, PNAS, 113, 10322, 10.1073/pnas.1600008113 · DOI · Paper page
  77. Chillón, 2016, Inverted repeatAluelements in the human lincRNA-p21 adopt a conserved secondary structure that regulates RNA function, Nucleic Acids Res, 10.1093/nar/gkw599 · DOI
  78. Somarowthu, 2015, HOTAIR forms an intricate and modular secondary structure, Mol Cell, 58, 353, 10.1016/j.molcel.2015.03.006 · DOI · Paper page
  79. Brown, 2014, Structural insights into the stabilization of MALAT1 noncoding RNA by a bipartite triple helix, Nat Struct Mol Biol, 21, 633, 10.1038/nsmb.2844 · DOI · Paper page
  80. Ilik, 2013, Tandem stem-loops in roX RNAs act together to mediate x chromosome dosage compensation in drosophila, Mol Cell, 51, 156, 10.1016/j.molcel.2013.07.001 · DOI · Paper page
  81. Demsar, 2006, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research, 7, 1
  82. Chorostecki, 2021, Methods in Molecular Biology, 51
  83. Tichon, 2018, SAM68 is required for regulation of pumilio by the NORAD long noncoding RNA, Genes Dev, 32, 70, 10.1101/gad.309138.117 · DOI · Paper page
  84. Tichon, 2016, A conserved abundant cytoplasmic long noncoding RNA modulates repression by pumilio proteins in human cells, Nat Commun, 7, 1, 10.1038/ncomms12209 · DOI · Paper page
  85. Ziv, 2021, biorxiv - Cold Spring Harbor Laboratory, 1

Cited by

Metadata

Authors
Bugnon, L. A., Edera, A. A., Prochetto, S., Gerard, M., Raad, J., Fenoy, E., Rubiolo, M., Chorostecki, U., Gabaldón, T., Ariel, F., Di Persia, L. E., Milone, D. H., & Stegmayer, G.
Venue
Briefings in Bioinformatics
Published
2022-06-12
Volume
23
Issue
4
ISSN
  • 1467-5463 (ISSN-L)
  • 1477-4054
OpenAlex
W4282945580
Cited by
53
References
9
FWCI
2.90
Type
journal article
Language
en
Open access
hybrid
Funders
  • ANPCyT (PICT 2018 3384, PICT 2018 2905, PICT 2019 3420)
  • Santa Fe Science, Technology and Innovation Agency (AC-00010-18, 117/14)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.