Machine learning for RNA 2D structure prediction benchmarked on experimental data
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Since the 1980s, dozens of computational methods have addressed the problem of predicting RNA secondary structure. Among them are those that follow standard optimization approaches and, more recently, machine learning (ML) algorithms. The former were repeatedly benchmarked on various datasets. The latter, on the other hand, have not yet undergone extensive analysis that could suggest to the user which algorithm best fits the problem to be solved. In this review, we compare 15 methods that predict the secondary structure of RNA, of which 6 are based on deep learning (DL), 3 on shallow learning (SL) and 6 control methods on non-ML approaches. We discuss the ML strategies implemented and perform three experiments in which we evaluate the prediction of (I) representatives of the RNA equivalence classes, (II) selected Rfam sequences and (III) RNAs from new Rfam families. We show that DL-based algorithms (such as SPOT-RNA and UFold) can outperform SL and traditional methods if the data distribution is similar in the training and testing set. However, when predicting 2D structures for new RNA families, the advantage of DL is no longer clear, and its performance is inferior or equal to that of SL and non-ML methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 2×
“Let us mention the greed for data; all known successful CV and NLP models were developed using large training datasets.”
BackgroundLorenz, R., Bernhart, S. H., Höner zu Siederdissen, C., Tafer, H., Flamm, C., Stadler, P. F., & Hofacker, I. L. (2011) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-6-26 · Cited by 5,098
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224
Xia, T., SantaLucia, J., Burkard, M. E., Kierzek, R., Schroeder, S. J., Jiao, X., Cox, C., & Turner, D. H. (1998) · Biochemistry · doi:10.1021/bi9809425 · Cited by 1,140
Rivas, E., Lang, R., & Eddy, S. R. (2012) · RNA · doi:10.1261/rna.030049.111 · Cited by 145
Cited by
Predicting RNA structures and functions by artificial intelligence.
Zhang, J., Lang, M., Zhou, Y., & Zhang, Y. (2024) · Trends in Genetics · doi:10.1016/j.tig.2023.10.001 · Cited by 48
State-of-the-RNArt: benchmarking current methods for RNA 3D structure prediction
Bernard, C., Postic, G., Ghannay, S., & Tahi, F. (2024) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqae048 · Cited by 40
Szikszai, M., Magnus, M., Sanghi, S., Kadyan, S., Bouatta, N., & Rivas, E. (2024) · Journal of Molecular Biology · doi:10.1016/j.jmb.2024.168552 · Cited by 38
Assessment of Nucleic Acid Structure Prediction in CASP16
Kretsch, R. C., Hummer, A. M., He, S., Yuan, R., Zhang, J., Karagianes, T., Cong, Q., Kryshtafovych, A., & Das, R. (2026) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.70072 · Cited by 51
“After CASP15, retrospective analyses suggested that the difficulty in predicting secondary structure contributed to poor accuracy in RNA modeling, particularly by automated methods [30, 77].”
Deep generalizable prediction of RNA secondary structure via base pair motif energy
Zhu, H., Tang, F., Quan, Q., Chen, K., Xiong, P., & Zhou, S. K. (2025) · Nature Communications · doi:10.1038/s41467-025-60048-1 · Cited by 17
“For example, UFold 34 uses an alternative representation of the RNA sequence derived from CDPfold 41 to enhance the relationship between the input RNA sequence and thermodynamic prior of base pairs, SPOT-RNA 35 takes full advantage of evolutionary information, and MXfold2 38 regularizes the learning of the model with…”
InfluentialsincFold: end-to-end learning of short- and long-range interactions in RNA secondary structure
(2024) · doi:10.1093/bib/bbae271 · Cited by 14
Systematic benchmarking of deep-learning methods for tertiary RNA structure prediction
Bahai, A., Kwoh, C. K., Mu, Y., & Li, Y. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1012715 · Cited by 12
Szikszai, M., Wang, T.-Y., Krueger, R., Mathews, D. H., Ward, M., & Aviran, S. (2026) · RNA · doi:10.1261/rna.080846.125 · Cited by 5
Comprehensive datasets for RNA design, machine learning, and beyond
Badura, J., Rybarczyk, A., & Zok, T. (2025) · Scientific Reports · doi:10.1038/s41598-025-07041-2 · Cited by 3
sincFold: end-to-end learning of short- and long-range interactions in RNA secondary structure
Bugnon, L. A., Di Persia, L., Gerard, M., Raad, J., Prochetto, S., Fenoy, E., Chorostecki, U., Ariel, F., Stegmayer, G., & Milone, D. H. (2023) · doi:10.1101/2023.10.10.561771 · Cited by 2
Metadata
- Authors
- Justyna, M., Antczak, M., & Szachniuk, M.
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-04-24
- Volume
- 24
- Issue
- 3
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- OpenAlex
- W4366990642
- Cited by
- 53
- References
- 8
- FWCI
- 3.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.