RNA secondary structure packages evaluated and improved by high-throughput experiments
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The computer-aided study and design of RNA molecules is increasingly prevalent across a range of disciplines, yet little is known about the accuracy of commonly used structure modeling packages in tasks sensitive to ensemble properties of RNA. Here, we demonstrate that the EternaBench dataset, a set of over 20,000 synthetic RNA constructs designed in iterative cycles on the RNA design platform Eterna, provides incisive discriminative power in evaluating current packages in ensemble-oriented structure prediction tasks. We find that CONTRAfold and RNAsoft, packages with parameters derived through statistical learning, achieve consistently higher accuracy than more widely used packages in their standard settings, which derive parameters primarily from thermodynamic experiments. Motivated by these results, we develop a multitask-learning-based model, EternaFold, which demonstrates improved performance that generalizes to diverse external datasets, including complete mRNAs and viral genomes probed in human cells and synthetic designs modeling mRNA vaccines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cd-hit: Accelerated for clustering the next-generation sequencing data
Fu, L., Niu, B., Zhu, Z., Wu, S., & Li, W. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts565 · Cited by 11,175
Lorenz, R., Bernhart, S. H., Höner zu Siederdissen, C., Tafer, H., Flamm, C., Stadler, P. F., & Hofacker, I. L. (2011) · Algorithms for Molecular Biology · doi:10.1186/1748-7188-6-26 · Cited by 5,098
cocor: A Comprehensive Solution for the Statistical Comparison of Correlations
Diedenhofen, B., & Musch, J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0121945 · Cited by 1,919
Xia, T., SantaLucia, J., Burkard, M. E., Kierzek, R., Schroeder, S. J., Jiao, X., Cox, C., & Turner, D. H. (1998) · Biochemistry · doi:10.1021/bi9809425 · Cited by 1,140
mRNA structure regulates protein expression through changes in functional half-life
Mauger, D. M., Cabral, B. J., Presnyak, V., Su, S. V., Reid, D. W., Goodman, B., Link, K., Khatwani, N., Reynders, J., Moore, M. J., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1908052116 · Cited by 555 · cited 3×
“…mapping data collected with methods different from those used in the Eterna Cloud Labs (SHAPE-CE, SHAPE-MaP, DMS-MaP-seq vs. MAP-seq) and for distinct molecules, including viral genomes 21, 35-40 ribosomal RNAs 40, 41 , and mRNAs designed to improve protein expression 19 (Table 2, Figure 4B).”
BackgroundMethodCombinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2021) · doi:10.1101/2021.03.29.437587 · Cited by 399
Self-citationCombinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28776-w · Cited by 399
Self-citationRivas, E., Lang, R., & Eddy, S. R. (2012) · RNA · doi:10.1261/rna.030049.111 · Cited by 145 · cited 1×
“42 Indeed, methods developed with a variety of more recent This observation might be rationalized by discrepancies in Mg 2+ -free solution conditions used to measure these packages’ thermodynamic parameters and the in vitro and in vivo conditions tested here.”
MethodMassively Parallel RNA Chemical Mapping with a Reduced Bias MAP-Seq Protocol
Seetin, M. G., Kladwang, W., Bida, J. P., & Das, R. (2014) · Methods in Molecular Biology · doi:10.1007/978-1-62703-667-2_6 · Cited by 63
Self-citation
Cited by
UFold: fast and accurate RNA secondary structure prediction with deep learning
Fu, L., Cao, Y., Wu, J., Peng, Q., Nie, Q., & Xie, X. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkab1074 · Cited by 266
Chen, J., Hu, Z., Sun, S., Tan, Q., Wang, Y., Yu, Q., Zong, L., Hong, L., Xiao, J., Shen, T., et al. (2022) · doi:10.1101/2022.08.06.503062 · Cited by 247
Theoretical basis for stabilizing messenger RNA through secondary structure design
Wayment-Steele, H. K., Kim, D. S., Choe, C. A., Nicol, J. J., Wellington-Oguri, R., Watkins, A. M., Sperberg, R. A. P., Huang, P.-S., Participants, E., & Das, R. (2020) · doi:10.1101/2020.08.22.262931 · Cited by 199
Self-citationTheoretical basis for stabilizing messenger RNA through secondary structure design
Wayment-Steele, H. K., Kim, D. S., Choe, C. A., Nicol, J. J., Wellington-Oguri, R., Watkins, A. M., Parra Sperberg, R. A., Huang, P.-S., Participants, E., & Das, R. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkab764 · Cited by 197
Self-citationAssessment of Nucleic Acid Structure Prediction in CASP16
Kretsch, R. C., Hummer, A. M., He, S., Yuan, R., Zhang, J., Karagianes, T., Cong, Q., Kryshtafovych, A., & Das, R. (2026) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.70072 · Cited by 51
Self-citation
Metadata
- Authors
- Wayment-Steele, H. K., Kladwang, W., Strom, A. I., Lee, J., Treuille, A., Becka, A., Participants, E., & Das, R.
- Venue
- Nature Methods
- Published
- 2022-10
- Volume
- 19
- Issue
- 10
- Pages
- 1234-1242
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- OpenAlex
- W4300861274
- Cited by
- 151
- References
- 9
- FWCI
- 7.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RNA secondary structure packages evaluated and improved by high-throughput experiments. https://app.cochat.ai/papers/10.1038/s41592-022-01605-0
- The paper
- Wayment-Steele, H. K., Kladwang, W., Strom, A. I., Lee, J., Treuille, A., Becka, A., Participants, E., & Das, R. (2022). RNA secondary structure packages evaluated and improved by high-throughput experiments. Nature Methods. https://doi.org/10.1038/s41592-022-01605-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.