Ribonanza: deep learning of RNA structure through dual crowdsourcing
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Prediction of RNA structure from sequence remains an unsolved problem, and progress has been slowed by a paucity of experimental data. Here, we present Ribonanza, a dataset of chemical mapping measurements on two million diverse RNA sequences collected through Eterna and other crowdsourced initiatives. Ribonanza measurements enabled solicitation, training, and prospective evaluation of diverse deep neural networks through a Kaggle challenge, followed by distillation into a single, self-contained model called RibonanzaNet. When fine tuned on auxiliary datasets, RibonanzaNet achieves state-of-the-art performance in modeling experimental sequence dropout, RNA hydrolytic degradation, and RNA secondary structure, with implications for modeling RNA tertiary structure.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“(f) Replicate measurements by different experimenters based on DNA template libraries synthesized by different vendors confirm replicability (left); independently measured profiles with estimated mean signal-to-noise ratios as low as 1.0 (right) agree with Pearson’s correlation coefficient r > 0.80.”
InfluentialHighly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
Accurate structure prediction of biomolecular interactions with AlphaFold 3
Abramson, J., Adler, J., Dunger, J., Evans, R., Green, T., Pritzel, A., Ronneberger, O., Willmore, L., Ballard, A. J., Bambrick, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07487-w · Cited by 15,861
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
Lorenz, R., Bernhart, S. H., Höner zu Siederdissen, C., Tafer, H., Flamm, C., Stadler, P. F., & Hofacker, I. L. (2011) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-6-26 · Cited by 5,098 · cited 5×
“The same fine-tuning process for RibonanzaNet-Drop was carried over to the RNA-FM foundation model, 40 and in addition two LSTM models were trained from scratch – one which had access only to the sequence, and another which was fed both the sequence and predicted secondary structure from ViennaRNA 57 in dot-bracket fo…”
MethodInfluentialNUPACK: Analysis and design of nucleic acid systems
Zadeh, J. N., Steenberg, C. D., Bois, J. S., Wolfe, B. R., Pierce, M. B., Khan, A. R., Dirks, R. M., & Pierce, N. A. (2011) · Journal of Computational Chemistry · doi:10.1002/jcc.21596 · Cited by 1,670
Protein Data Bank: the single global archive for 3D macromolecular structure data
wwPDB consortium, Burley, S. K., Berman, H. M., Bhikadiya, C., Bi, C., Chen, L., Costanzo, L. D., Christie, C., Duarte, J. M., Dutta, S., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky949 · Cited by 1,163 · cited 1×
“1a ) as well as databases curated by experts (e.g., RFAM, the RNA Families database 12 ; the PDB archive of 3D coordinates 17 ; and Pseudobase 22 ); see Supplemental Tables S2 and S3 .”
BackgroundGeneralized biomolecular modeling and design with RoseTTAFold All-Atom
Krishna, R., Wang, J., Ahern, W., Sturmfels, P., Venkatesh, P., Kalvet, I., Lee, G. R., Morey-Burrows, F. S., Anishchenko, I., Humphreys, I. R., et al. (2024) · Science · doi:10.1126/science.adl2528 · Cited by 978 · cited 1×
“Alternative 3D folding methods, like RoseTTaFold and AlphaFold3, 6,7 may better leverage information from RibonanzaNet but currently do not accept RNA secondary structure as input.”
MethodCritical assessment of methods of protein structure prediction (CASP)—Round XIV
Kryshtafovych, A., Schwede, T., Topf, M., Fidelis, K., & Moult, J. (2021) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26237 · Cited by 503 · cited 1×
“15 19 Motivated by these examples, we here present results from an experiment called Ribonanza ( Fig.”
ResultCombinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2021) · doi:10.1101/2021.03.29.437587 · Cited by 399 · cited 1×
“20,41 Third, we pursued prediction of RNA secondary structure, particularly the pseudoknot structures that are common in functional RNA.”
BackgroundSelf-citationCombinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28776-w · Cited by 399
Self-citationChen, J., Hu, Z., Sun, S., Tan, Q., Wang, Y., Yu, Q., Zong, L., Hong, L., Xiao, J., Shen, T., et al. (2022) · doi:10.1101/2022.08.06.503062 · Cited by 247 · cited 4×
“…based on heuristics involving hairpin lengths and sequence repeats as well as long-short term memory networks 39 and the foundation model RNA-FM 40 , trained on Illumina sequencer read counts for a library of 1 million 177-nt sequences available at the beginning of the competition ( Methods) .”
MethodInfluentialRNA tertiary structure modeling with BRiQ potential in CASP15
Chen, K., Zhou, Y., Wang, S., & Xiong, P. (2023) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.26574 · Cited by 37
Research works printed but not linked: 59
- 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
- 10.1038/s41467-023-42528-4 · DOI · Paper page
- 10.1038/s41592-023-02086-5 · DOI · Paper page
- 10.1126/sci-ence.adl2528 · doi:10.1126/sci-ence.adl2528
- 10.1038/s41576-018-0034-x · DOI · Paper page
- 2023, Assessment of three-dimensional RNA structure prediction in CASP15, Proteins, 91, 1747, 10.1002/prot.26602 · DOI · Paper page
- 2023, When will RNA get its AlphaFold moment?, Nucleic Acids Res, 51, 9522, 10.1093/nar/gkad726 · DOI · Paper page
- 10.1101/2023.12.13.571579 · DOI
- 10.1093/NAR/GKAA1047 · DOI · Paper page
- 10.1093/nar/gkx699 · DOI · Paper page
- 10.1038/s41565-019-0517-8 · DOI · Paper page
- 2021, RiboDraw: semiautomated two-dimensional drawing of RNA tertiary structure diagrams, NAR Genom Bioinform, 3, lqab091, 10.1093/nargab/lqab091 · DOI
- 9th Workshop on Statistical Machine Translation 2014: Baltimore, Maryland, USA, 26 - 27 June 2014; Held at ACL 2014, [the 52nd Annual Meeting of the Association for Computational Linguistics]. (2014).
- 2022, Deep learning models for predicting RNA degradation via dual crowdsourcing, Nat Mach Intell, 4, 1174, 10.1038/s42256-022-00571-8 · DOI
- 10.1073/pnas.1313039111 · DOI · Paper page
- 10.1093/nar/gkn806 · DOI
- 10.1038/s41592-022-01605-0 · DOI · Paper page
- 10.1016/0959-440X(92)90221-R · DOI
- Justyna, M. , Antczak, M. & Szachniuk, M. Machine learning for RNA 2D structure prediction benchmarked on experimental data. Brief. Bioinform. 24, (2023). · DOI · Paper page
- 10.1038/nmeth.4057 · DOI · Paper page
- 10.1093/nar/gkad522 · DOI
- 2021, A novel SHAPE reagent enables the analysis of RNA structure in living cells with unprecedented accuracy, Nucleic Acids Res, 49, e34, 10.1093/nar/gkaa1255 · DOI
- 10.1038/nmeth.3029 · DOI · Paper page
- 10.1371/journal.pbio.0030172 · DOI · Paper page
- 10.1261/rna.076141.120 · DOI · Paper page
- 10.1038/nchem.1176 · DOI · Paper page
- 10.1261/rna.060368.116 · DOI · Paper page
- 10.1261/rna.049502.114 · DOI · Paper page
- He, S. , Gao, B. , Sabnis, R. & Sun, Q. RNAdegformer: accurate prediction of mRNA degradation at nucleotide resolution with deep learning. Brief. Bioinform. 24, (2023). · DOI
- 10.48550/ARXIV.1706.03762 · DOI · Paper page
- 10.1073/pnas.2221324120 · DOI
- 2023, RNA target highlights in CASP15: Evaluation of predicted models by structure providers, Proteins, 91, 1600, 10.1002/prot.26550 · DOI · Paper page
- 10.48550/ARXIV.2204.00300 · arXiv · doi:10.48550/arxiv.2204.00300
- 2023, Advancing RNA 3D structure prediction: Exploring hierarchical and hybrid approaches in CASP15, Proteins, 91, 1779, 10.1002/prot.26583 · DOI
- 2023, RNA tertiary structure prediction using RNAComposer in CASP15, Proteins, 91, 1790, 10.1002/prot.26578 · DOI · Paper page
- 2023, RNA tertiary structure prediction in CASP15 by the GeneSilico group: Folding simulations based on statistical potentials and spatial restraints, Proteins, 91, 1800, 10.1002/prot.26575 · DOI
- 10.1038/s41467-019-13395-9 · DOI · Paper page
- 10.1002/bip.360290621 · DOI · Paper page
- 10.1002/jcc.10296 · DOI · Paper page
- 10.48550/ARXIV.1912.12796 · DOI
- 10.1093/bioinformatics/btl246 · DOI · Paper page
- 10.1261/rna.7284905 · DOI · Paper page
- 10.1093/bioinformatics/btr215 · DOI · Paper page
- 10.1186/1471-2105-15-147 · DOI
- 10.1093/bioinformatics/bty420 · DOI
- 10.1093/nar/gkm258 · DOI
- 10.1073/pnas.1219988110 · DOI · Paper page
- 10.1109/TAES.2016.140952 · DOI · Paper page
- 2020, Emulsion PCR made easy, Biotechniques, 69, 421
- 2021, Ultraplex: A rapid, flexible, all-in-one fastq demultiplexer, Wellcome Open Res, 6, 141, 10.12688/wellcomeopenres.16791.1 · DOI
- 10.1038/nmeth.1923 · DOI · Paper page
- 10.1093/nar/gky486 · DOI
- 10.1093/bioinformatics/btaa460 · DOI · Paper page
- 10.48550/ARXIV.2207.01586 · DOI
- 2018, Updates to the RNA mapping database (RMDB), version 2, Nucleic Acids Res, 46, D375, 10.1093/nar/gkx873 · DOI
- 10.48550/ARXIV.2106.13731 · DOI
- 10.1093/nar/gkt800 · DOI
- 10.1093/nar/gkac372 · DOI
- 10.1107/S0907444913007051 · DOI · Paper page
Cited by
RNA language models predict mutations that improve RNA function
Shulgina, Y., Trinidad, M. I., Langeberg, C. J., Nisonoff, H., Chithrananda, S., Skopintsev, P., Nissley, A. J., Patel, J., Boger, R. S., Shi, H., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-54812-y · Cited by 32
Assessment of Nucleic Acid Structure Prediction in CASP16
Kretsch, R. C., Hummer, A. M., He, S., Yuan, R., Zhang, J., Karagianes, T., Cong, Q., Kryshtafovych, A., & Das, R. (2026) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.70072 · Cited by 51
“0) [52], IPknot (last commit June 9, 2021) [53], SPOT-RNA (last commit April 1, 2021) [54], RNet [17] (three variants: (1) the RNet release model, trained on the experimental SHAPE and DMS data from the Ribonanza dataset and, as a form of distillation [55], average predictions of the 3 top models…”
Self-citationSzikszai, M., Wang, T.-Y., Krueger, R., Mathews, D. H., Ward, M., & Aviran, S. (2026) · RNA · doi:10.1261/rna.080846.125 · Cited by 5
Structure-alignment-driven cross-graph modeling for functional RNA design
Wang, S., Wang, J., Liu, X., Zhu, W., Huang, J., Xue, Y., Yan, J., Shen, H.-B., Song, J., & Pan, X. (2026) · Nature Computational Science · doi:10.1038/s43588-026-01029-2 · Cited by 2
Metadata
- Authors
- He, S., Huang, R., Townley, J., Kretsch, R. C., Karagianes, T. G., Cox, D. B. T., Blair, H., Penzar, D., Vyaltsev, V., Aristova, E., Zinkevich, A., Bakulin, A., Sohn, H., Krstevski, D., Fukui, T., Tatematsu, F., Uchida, Y., Jang, D., Lee, J. S., Shieh, R., Ma, T., Martynov, E., Shugaev, M. V., Bukhari, H. S. T., Fujikawa, K., Onodera, K., Henkel, C., Ron, S., Romano, J., Nicol, J. J., Nye, G. P., Wu, Y., Choe, C., Reade, W., participants, E., & Das, R.
- Venue
- bioRxiv (Cold Spring Harbor Laboratory)
- Publisher
- openRxiv
- Published
- 2024-02-27
- OpenAlex
- W4392236160
- Cited by
- 34
- References
- 14
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.