Secondary structure prediction of long noncoding RNA: review and experimental comparison of existing approaches
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Motivation: In contrast to messenger RNAs, the function of the wide range of existing long noncoding RNAs (lncRNAs) largely depends on their structure, which determines interactions with partner molecules. Thus, the determination or prediction of the secondary structure of lncRNAs is critical to uncover their function. Classical approaches for predicting RNA secondary structure have been based on dynamic programming and thermodynamic calculations. In the last 4 years, a growing number of machine learning (ML)-based models, including deep learning (DL), have achieved breakthrough performance in structure prediction of biomolecules such as proteins and have outperformed classical methods in short transcripts folding. Nevertheless, the accurate prediction for lncRNA still remains far from being effectively solved. Notably, the myriad of new proposals has not been systematically and experimentally evaluated. Results: In this work, we compare the performance of the classical methods as well as the most recently proposed approaches for secondary structure prediction of RNA sequences using a unified and consistent experimental setup. We use the publicly available structural profiles for 3023 yeast RNA sequences, and a novel benchmark of well-characterized lncRNA structures from different species. Moreover, we propose a novel metric to assess the predictive performance of methods, exclusively based on the chemical probing data commonly used for profiling RNA structures, avoiding any potential bias incorporated by computational predictions when using dot-bracket references. Our results provide a comprehensive comparative assessment of existing methodologies, and a novel and public benchmark resource to aid in the development and comparison of future approaches. Availability: Full source code and benchmark datasets are available at: https://github.com/sinc-lab/lncRNA-folding Contact: lbugnon@sinc.unl.edu.ar
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Lorenz, R., Bernhart, S. H., Höner zu Siederdissen, C., Tafer, H., Flamm, C., Stadler, P. F., & Hofacker, I. L. (2011) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-6-26 · Cited by 5,098
Gene regulation by long non-coding RNAs and its biological functions
Statello, L., Guo, C.-J., Chen, L.-L., & Huarte, M. (2021) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-020-00315-9 · Cited by 4,991
Long non-coding RNAs: new players in cell differentiation and development
Fatica, A., & Bozzoni, I. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3606 · Cited by 2,980
Big Data: Astronomical or Genomical?
Stephens, Z. D., Lee, S. Y., Faghri, F., Campbell, R. H., Zhai, C., Efron, M. J., Iyer, R., Schatz, M. C., Sinha, S., & Robinson, G. E. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002195 · Cited by 1,340
In vivo genome-wide profiling of RNA secondary structure reveals novel regulatory features
Ding, Y., Tang, Y., Kwok, C. K., Zhang, Y., Bevilacqua, P. C., & Assmann, S. M. (2014) · Nature · doi:10.1038/nature12756 · Cited by 775
Turner, D. H., & Mathews, D. H. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp892 · Cited by 575
LinearFold: linear-time approximate RNA folding by 5'-to-3' dynamic programming and beam search
Huang, L., Zhang, H., Deng, D., Zhao, K., Liu, K., Hendrix, D. A., & Mathews, D. H. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz375 · Cited by 207
Research works printed but not linked: 85
- Lee, 2019, Long noncoding RNAs and repetitive elements: Junk or intimate evolutionary partners?, Trends Genet, 35, 892, 10.1016/j.tig.2019.09.006 · DOI · Paper page
- The ENCODE Project Consortium, 2012, An integrated encyclopedia of DNA elements in the human genome, Nature, 489, 57, 10.1038/nature11247 · DOI · Paper page
- Mortimer, 2014, Insights into RNA structure and function from genome-wide studies, Nat Rev Genet, 15, 469, 10.1038/nrg3681 · DOI · Paper page
- Kapranov, 2007, Rna maps reveal new rna classes and a possible function for pervasive transcription, Science, 316, 1484, 10.1126/science.1138341 · DOI · Paper page
- Ulitsky, 2013, lincRNAs: Genomics, evolution, and mechanisms, Cell, 154, 26, 10.1016/j.cell.2013.06.020 · DOI · Paper page
- Flynn, 2014, Long noncoding RNAs in cell-fate programming and reprogramming, Cell Stem Cell, 14, 752, 10.1016/j.stem.2014.05.014 · DOI · Paper page
- Lee, 2013, X-inactivation, imprinting, and long noncoding RNAs in health and disease, Cell, 152, 1308, 10.1016/j.cell.2013.02.016 · DOI · Paper page
- Ligang, 2008, Let me count the ways: Mechanisms of gene regulation by miRNAs and siRNAs, Mol Cell, 29, 1, 10.1016/j.molcel.2007.12.010 · DOI · Paper page
- Zou, 2015, Prediction of MicroRNA-disease associations based on social network analysis methods, Biomed Res Int, 2015, 1
- Rizki, 2015, Lncding epigenetic control of transcription to cardiovascular development and disease, Circ Res, 117, 192, 10.1161/CIRCRESAHA.117.304156 · DOI
- Anastasiadou, 2018, Non-coding rna networks in cancer, Nat Rev Cancer, 18, 5, 10.1038/nrc.2017.99 · DOI · Paper page
- Ariel, 2015, Battles and hijacks: noncoding transcription in plants, Trends Plant Sci, 20, 362, 10.1016/j.tplants.2015.03.003 · DOI · Paper page
- Lucero, 2020, Functional classification of plant long noncoding RNAs: a transcript is known by the company it keeps, New Phytol, 229, 1251, 10.1111/nph.16903 · DOI
- Rinn, 2020, Long noncoding RNAs: Molecular modalities to organismal functions, Annu Rev Biochem, 89, 283, 10.1146/annurev-biochem-062917-012708 · DOI · Paper page
- Romero-Barrios, 2018, Splicing regulation by long noncoding RNAs, Nucleic Acids Res, 46, 2169, 10.1093/nar/gky095 · DOI · Paper page
- Graf, 2020, From structure to function: Route to understanding lncrna mechanism, Bioessays, 42, 2000027, 10.1002/bies.202000027 · DOI
- Lee, 2004, Diversity of base-pair conformations and their occurrence in rRNA structure and RNA structural motifs, J Mol Biol, 344, 1225, 10.1016/j.jmb.2004.09.072 · DOI
- Morris, 2014, The rise of regulatory RNA, Nat Rev Genet, 15, 423, 10.1038/nrg3722 · DOI · Paper page
- Achar, 2015, RNA motif discovery: a computational overview, Biol Direct, 10, 1, 10.1186/s13062-015-0090-5 · DOI
- Spokoini-Stern, 2020, Visualizing the structure and motion of the long noncoding rna hotair, RNA, 26, 629, 10.1261/rna.074633.120 · DOI · Paper page
- Fürtig, 2003, NMR spectroscopy of RNA, Chembiochem, 4, 936, 10.1002/cbic.200300700 · DOI
- Keel, 2007, A general strategy to solve the phase problem in RNA crystallography, Structure, 15, 761, 10.1016/j.str.2007.06.003 · DOI
- Ross, WIREs RNA
- Zampetaki, 2018, Long non-coding RNA structure and function: Is there a link?, Front Physiol, 9, 1, 10.3389/fphys.2018.01201 · DOI · Paper page
- Kertesz, 2010, Genome-wide measurement of RNA secondary structure in yeast, Nature, 467, 103, 10.1038/nature09322 · DOI · Paper page
- Saus, 2018, nextPARS: parallel probing of RNA structures in illumina, RNA, 24, 609, 10.1261/rna.063073.117 · DOI
- Loughrey, 2014, Shape-seq 2.0: systematic optimization and extension of high-throughput chemical probing of rna secondary structure with next generation sequencing, Nucleic Acids Res, 42, e165, 10.1093/nar/gku909 · DOI · Paper page
- Calonaci, 2020, Machine learning a model for RNA structure prediction, NAR Genomics and Bioinformatics, 2, 1, 10.1093/nargab/lqaa090 · DOI
- Zafferani, 2021, Small molecule targeting of biologically relevant rna tertiary and quaternary structures, Cell Chemical Biology, 28, 594, 10.1016/j.chembiol.2021.03.003 · DOI
- Bonilla, 2021, High-throughput dissection of the thermodynamic and conformational properties of a ubiquitous class of rna tertiary contact motifs, Proc Natl Acad Sci, 118, 10.1073/pnas.2109085118 · DOI
- Liu, 2021, Prediction of the rna tertiary structure based on a random sampling strategy and parallel mechanism, Front Genet, 12, 813604, 10.3389/fgene.2021.813604 · DOI
- Mathews, 1999, Expanded sequence dependence of thermodynamic parameters improves prediction of RNA secondary structure, J Mol Biol, 288, 911, 10.1006/jmbi.1999.2700 · DOI · Paper page
- Schroeder, 2009, Methods in Enzymology, 371
- Anfinsen, 1973, Principles that govern the folding of protein chains, Science, 181, 223, 10.1126/science.181.4096.223 · DOI · Paper page
- Zhao, 2021, Review of machine learning methods for RNA secondary structure prediction, PLoS Comput Biol, 17, 10.1371/journal.pcbi.1009291 · DOI · Paper page
- Zhang, 2019, A new method of RNA secondary structure prediction based on convolutional neural network and dynamic programming, Front Genet, 10, 1
- Singh, 2019, RNA secondary structure prediction using an ensemble of two-dimensional deep neural networks and transfer learning, Nat Commun, 10, 1, 10.1038/s41467-019-13395-9 · DOI · Paper page
- Laiyi, 2022, UFold: Fast and accurate RNA secondary structure prediction with deep learning, Nucleic Acids Res, 50
- Ashish, 2017, Advances in Neural Information Processing Systems, 6000
- Sato, 2021, RNA secondary structure prediction using deep learning with thermodynamic integration, Nat Commun, 12, 1, 10.1038/s41467-021-21194-4 · DOI · Paper page
- Fallmann, 2017, Recent advances in RNA folding, J Biotechnol, 261, 97, 10.1016/j.jbiotec.2017.07.007 · DOI
- Seetin, Bacterial Regulatory RNA
- Batenburg, 2000, PseudoBase: a database with RNA pseudoknots, Nucleic Acids Res, 28, 201, 10.1093/nar/28.1.201 · DOI
- Andronescu, 2008, Holger H Hoos, and Anne Condon. RNA STRAND: The RNA secondary structure and statistical analysis database, BMC Bioinformatics, 9, 1, 10.1186/1471-2105-9-340 · DOI · Paper page
- Murthy, 2003, RNABase: an annotated database of RNA structures, Nucleic Acids Res, 31, 502, 10.1093/nar/gkg012 · doi:10.1093/nar/gkg012
- Danaee, 2018, bpRNA: large-scale automated annotation and analysis of RNA secondary structure, Nucleic Acids Res, 46, 5381, 10.1093/nar/gky285 · DOI · Paper page
- Do, 2006, CONTRAfold: RNA secondary structure prediction without physics-based models, Bioinformatics, 22, e90, 10.1093/bioinformatics/btl246 · DOI · Paper page
- Sato, 2009, CENTROIDFOLD: a web server for RNA secondary structure prediction, Nucleic Acids Res, 37, W277, 10.1093/nar/gkp367 · DOI · Paper page
- Deigan, 2008, Accurate SHAPE-directed RNA structure determination, Proc Natl Acad Sci, 106, 97, 10.1073/pnas.0806929106 · DOI · Paper page
- Bellaousov, 2010, ProbKnot: Fast prediction of RNA secondary structure including pseudoknots, RNA, 16, 1870, 10.1261/rna.2125310 · DOI · Paper page
- Reuter, 2010, RNAstructure: software for RNA secondary structure prediction and analysis, BMC Bioinformatics, 11, 1, 10.1186/1471-2105-11-129 · DOI · Paper page
- Sato, 2011, IPknot: fast and accurate prediction of RNA secondary structures with pseudoknots using integer programming, Bioinformatics, 27, i85, 10.1093/bioinformatics/btr215 · DOI · Paper page
- Sato, 10 2022, Prediction of RNA secondary structure including pseudoknots for long sequences, Brief Bioinform, 23, 10.1093/bib/bbab395 · DOI
- Zakov, 2011, Rich parameterization improves RNA structure prediction, J Comput Biol, 18, 1525, 10.1089/cmb.2011.0184 · DOI · Paper page
- Janssen, 2014, The RNA shapes studio, Bioinformatics, 31, 423, 10.1093/bioinformatics/btu649 · DOI
- Zhang, 2020, LinearPartition: linear-time approximation of RNA folding partition function and base-pairing probabilities, Bioinformatics, 36, i258, 10.1093/bioinformatics/btaa460 · DOI · Paper page
- Willmott, 2020, Improving RNA secondary structure prediction via state inference with deep recurrent neural networks, Computational and Mathematical Biophysics, 8, 36, 10.1515/cmb-2020-0002 · DOI
- Singh, 2021, Improved RNA secondary structure and tertiary base-pairing prediction using evolutionary profile, mutational coupling and two-dimensional transfer learning, Bioinformatics, 37, 2589, 10.1093/bioinformatics/btab165 · DOI · Paper page
- Mao, 2021, Learning the fastest RNA folding path based on reinforcement learning and monte carlo tree search, Molecules, 26, 4420, 10.3390/molecules26154420 · DOI
- Zuker, 1981, Optimal computer folding of large RNA sequences using thermodynamics and auxiliary information, Nucleic Acids Res, 9, 133, 10.1093/nar/9.1.133 · DOI · Paper page
- Quan, 2020, Developing parallel ant colonies filtered by deep learned constrains for predicting RNA secondary structure with pseudo-knots, Neurocomputing, 384, 104, 10.1016/j.neucom.2019.12.041 · DOI
- Wang, 2019, DMfold: A novel method to predict RNA secondary structure with pseudoknots based on deep learning and improved base pair maximization principle, Front Genet, 10, 1
- Weizhong, 2019, Predicting RNA secondary structure via adaptive deep recurrent neural networks with energy-based filter, BMC Bioinformatics, 20, 1
- Yonemoto, 2015, A semi-supervised learning approach for RNA secondary structure prediction, Comput Biol Chem, 57, 72, 10.1016/j.compbiolchem.2015.02.002 · DOI
- Qasim, 2010, Secondary structure prediction of RNA using machine learning method, International Journal of Computer Applications, 10, 15, 10.5120/1486-2003 · doi:10.5120/1486-2003
- Koessler, 2010, A predictive model for secondary RNA structure using graph theory and a neural network, BMC Bioinformatics, 11, 1, 10.1186/1471-2105-11-S6-S21 · DOI
- Weizhong, 2021, Research on RNA secondary structure predicting via bidirectional recurrent neural network, BMC Bioinformatics, 22, 1
- Lalwani, 2021, An efficient three-level parallel ABC algorithm for secondary structure prediction of complex RNA sequences, Appl Soft Comput, 99, 10.1016/j.asoc.2020.106848 · DOI
- Kang, 2017, Cpc2: a fast and accurate coding potential calculator based on sequence intrinsic features, Nucleic Acids Res, 45, W12, 10.1093/nar/gkx428 · DOI · Paper page
- Mathews, 2019, How to benchmark RNA secondary structure prediction accuracy, Methods, 162-163, 60, 10.1016/j.ymeth.2019.04.003 · DOI · Paper page
- Chorostecki, 2021, Structural characterization of NORAD reveals a stabilizing role of spacers and two new repeat units, Comput Struct Biotechnol J, 19, 3245, 10.1016/j.csbj.2021.05.045 · doi:10.1016/j.csbj.2021.05.045
- Jones, 2020, An evolutionarily conserved RNA structure in the functional core of the lincRNA cyrano, RNA, 26, 1234, 10.1261/rna.076117.120 · DOI
- Uroda, 2019, Conserved pseudoknots in lncRNA MEG3 are essential for stimulation of the p53 pathway, Mol Cell, 75, 982, 10.1016/j.molcel.2019.07.025 · DOI · Paper page
- Liu, 2017, Visualizing the secondary and tertiary architectural domains of lncRNA RepA, Nat Chem Biol, 13, 282, 10.1038/nchembio.2272 · DOI
- Sztuba-Solinska, 2017, Kaposi’s sarcoma-associated herpesvirus polyadenylated nuclear RNA: a structural scaffold for nuclear, cytoplasmic and viral proteins, Nucleic Acids Res, 45, 6805, 10.1093/nar/gkx241 · DOI
- Smola, 2016, Shape reveals transcript-wide interactions, complex structural domains, and protein interactions across the xist lncrna in living cells, PNAS, 113, 10322, 10.1073/pnas.1600008113 · DOI · Paper page
- Chillón, 2016, Inverted repeatAluelements in the human lincRNA-p21 adopt a conserved secondary structure that regulates RNA function, Nucleic Acids Res, 10.1093/nar/gkw599 · DOI
- Somarowthu, 2015, HOTAIR forms an intricate and modular secondary structure, Mol Cell, 58, 353, 10.1016/j.molcel.2015.03.006 · DOI · Paper page
- Brown, 2014, Structural insights into the stabilization of MALAT1 noncoding RNA by a bipartite triple helix, Nat Struct Mol Biol, 21, 633, 10.1038/nsmb.2844 · DOI · Paper page
- Ilik, 2013, Tandem stem-loops in roX RNAs act together to mediate x chromosome dosage compensation in drosophila, Mol Cell, 51, 156, 10.1016/j.molcel.2013.07.001 · DOI · Paper page
- Demsar, 2006, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research, 7, 1
- Chorostecki, 2021, Methods in Molecular Biology, 51
- Tichon, 2018, SAM68 is required for regulation of pumilio by the NORAD long noncoding RNA, Genes Dev, 32, 70, 10.1101/gad.309138.117 · DOI · Paper page
- Tichon, 2016, A conserved abundant cytoplasmic long noncoding RNA modulates repression by pumilio proteins in human cells, Nat Commun, 7, 1, 10.1038/ncomms12209 · DOI · Paper page
- Ziv, 2021, biorxiv - Cold Spring Harbor Laboratory, 1
Cited by
Xiong, W., Xu, K., Sun, J. K.-L., Liu, S., Zhao, B., Shi, J., Herrup, K., Chow, H.-M., Lu, L., & Li, J. (2024) · The EMBO Journal · doi:10.1038/s44318-024-00270-7 · Cited by 17
“Since the function of a wide range of existing lncRNAs is largely dependent on their secondary structures (Bugnon et al, 2022), based on the minimum free energy (MFE) model, lncMtDloop is predicted to form a complex double-stranded stem-loop (Fig.”
sincFold: end-to-end learning of short- and long-range interactions in RNA secondary structure
(2024) · doi:10.1093/bib/bbae271 · Cited by 14
Comprehensive datasets for RNA design, machine learning, and beyond
Badura, J., Rybarczyk, A., & Zok, T. (2025) · Scientific Reports · doi:10.1038/s41598-025-07041-2 · Cited by 3
sincFold: end-to-end learning of short- and long-range interactions in RNA secondary structure
Bugnon, L. A., Di Persia, L., Gerard, M., Raad, J., Prochetto, S., Fenoy, E., Chorostecki, U., Ariel, F., Stegmayer, G., & Milone, D. H. (2023) · doi:10.1101/2023.10.10.561771 · Cited by 2
Self-citation
Metadata
- Authors
- Bugnon, L. A., Edera, A. A., Prochetto, S., Gerard, M., Raad, J., Fenoy, E., Rubiolo, M., Chorostecki, U., Gabaldón, T., Ariel, F., Di Persia, L. E., Milone, D. H., & Stegmayer, G.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-06-12
- Volume
- 23
- Issue
- 4
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W4282945580
- Cited by
- 53
- References
- 9
- FWCI
- 2.90
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Funders
- ANPCyT (PICT 2018 3384, PICT 2018 2905, PICT 2019 3420)
- Santa Fe Science, Technology and Innovation Agency (AC-00010-18, 117/14)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.