RNAdvisor: a comprehensive benchmarking tool for the measure and prediction of RNA structural model quality
Open accessPublished version of a preprint
Abstract
RNA is a complex macromolecule that plays central roles in the cell. While it is well known that its structure is directly related to its functions, understanding and predicting RNA structures is challenging. Assessing the real or predictive quality of a structure is also at stake with the complex 3D possible conformations of RNAs. Metrics have been developed to measure model quality while scoring functions aim at assigning quality to guide the discrimination of structures without a known and solved reference. Throughout the years, many metrics and scoring functions have been developed, and no unique assessment is used nowadays. Each developed assessment method has its specificity and might be complementary to understanding structure quality. Therefore, to evaluate RNA 3D structure predictions, it would be important to calculate different metrics and/or scoring functions. For this purpose, we developed RNAdvisor, a comprehensive automated software that integrates and enhances the accessibility of existing metrics and scoring functions. In this paper, we present our RNAdvisor tool, as well as state-of-the-art existing metrics, scoring functions and a set of benchmarks we conducted for evaluating them. Source code is freely available on the EvryRNA platform: https://evryrna.ibisc.univ-evry.fr.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764 · see citing works
Comparative Protein Modelling by Satisfaction of Spatial Restraints
Šali, A., & Blundell, T. L. (1993) · Journal of Molecular Biology · doi:10.1006/jmbi.1993.1626 · Cited by 12,977 · see citing works
Evolutionary-scale prediction of atomic level protein structure with a language model
Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · doi:10.1101/2022.07.20.500902 · Cited by 5,523 · see citing works
MolProbity: all-atom contacts and structure validation for proteins and nucleic acids
Davis, I., Leaver‐Fay, A., Chen, V. B., Block, J. N., Kapral, G. J., Wang, X., Murray, L. W., Arendall, W. B., Snoeyink, J. S., Richardson, J. S., et al. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm216 · Cited by 3,915 · see citing works
Docker: lightweight Linux containers for consistent development and deployment
Merkel, D. (2014) · Linux journal · Cited by 3,277 · see citing works
Scoring function for automated assessment of protein structure template quality
Zhang, Y., & Skolnick, J. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20264 · Cited by 2,392 · see citing works
Statistical potential for assessment and prediction of protein structures
Shen, M., & Šali, A. (2006) · Protein Science · doi:10.1110/ps.062416606 · Cited by 2,294 · see citing works
Mariani, V., Biasini, M., Barbato, A., & Schwede, T. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt473 · Cited by 1,138 · see citing works
Zhou, H., & Zhou, Y. (2002) · Protein Science · doi:10.1110/ps.0217002 · Cited by 902 · see citing works
Automated 3D structure composition for large RNAs
Popenda, M., Szachniuk, M., Antczak, M., Purzycka, K. J., Łukasiak, P., Bartol, N., Błażewicz, J., & Adamiak, R. W. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks339 · Cited by 761 · see citing works
Samudrala, R., & Moult, J. (1998) · Journal of Molecular Biology · doi:10.1006/jmbi.1997.1479 · Cited by 446 · see citing works
Automated de novo prediction of native-like RNA tertiary structures
Das, R., & Baker, D. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0703836104 · Cited by 439 · see citing works
SimRNA: a coarse-grained method for RNA folding simulations and 3D structure prediction
Boniecki, M., Łach, G., Dawson, W., Tomala, K., Łukasz, P., Sołtysiński, T., Rother, K. M., & Bujnicki, J. M. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv1479 · Cited by 431 · see citing works
Geometric deep learning of RNA structure
Townshend, R. J. L., Eismann, S., Watkins, A. M., Rangan, R., Karelina, M., Das, R., & Dror, R. O. (2021) · Science · doi:10.1126/science.abe5650 · Cited by 416 · see citing works
Quantifying the Carbon Emissions of Machine Learning
Lacoste, A., Luccioni, A., Schmidt, V., & Dandres, T. (2019) · arXiv · doi:10.48550/arxiv.1910.09700 · Cited by 408 · cited 1× · see citing works
“We computed for each dataset the equivalent CO 2 measurements for an RNA (averaged over the different decoys), using CodeCarbon tool [41].”
Jonikas, M. A., Radmer, R. J., Laederach, A., Das, R., Pearlman, S. M., Herschlag, D., & Altman, R. B. (2009) · RNA · doi:10.1261/rna.1270809 · Cited by 317 · see citing works
A distance‐dependent atomic knowledge‐based potential for improved protein structure selection
Lu, H. J., & Skolnick, J. (2001) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.1087 · Cited by 290 · see citing works
FARFAR2: Improved De Novo Rosetta Prediction of Complex Global RNA Folds
Watkins, A. M., Rangan, R., & Das, R. (2020) · Structure · doi:10.1016/j.str.2020.05.011 · Cited by 278 · see citing works
Zhang, J., & Zhang, Y. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015386 · Cited by 237 · see citing works
New metrics for comparing and assessing discrepancies between RNA 3D structures and models.
Parisien, M., Cruz, J. A., Westhof, E., & Major, F. (2009) · RNA: A publication of the RNA Society · doi:10.1261/rna.1700409 · Cited by 204 · see citing works
The role of nucleobase interactions in RNA structure and dynamics
Bottaro, S., Palma, F. D., & Bussi, G. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku972 · Cited by 171 · see citing works
A nucleotide-level coarse-grained model of RNA
Šulc, P., Romano, F., Ouldridge, T. E., Doye, J. P. K., & Louis, A. A. (2014) · The Journal of Chemical Physics · doi:10.1063/1.4881424 · Cited by 162 · see citing works
3dRNA v2.0: An Updated Web Server for RNA 3D Structure Prediction
Wang, J., Wang, J., Huang, Y., & Xiao, Y. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20174116 · Cited by 160 · see citing works
RNA-Puzzles: a CASP-like evaluation of RNA three-dimensional structure prediction.
Cruz, J. A., Blanchet, M.-F., Boniecki, M. J., Bujnicki, J. M., Chen, S.-J., Cao, S., Das, R., Ding, F., Dokholyan, N., Flores, S., et al. (2012) · RNA: A publication of the RNA Society · doi:10.1261/rna.031054.111 · Cited by 157 · see citing works
CAD‐score: A new contact area difference‐based function for evaluation of protein structural models
Olechnovič, K., Kulberkytė, E., & Venclovas, Č. (2013) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.24172 · Cited by 153 · see citing works
3dRNAscore: a distance and torsion angle dependent evaluation function of 3D RNA structures
Wang, J., Zhao, Y., Zhu, C., & Xiao, Y. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv141 · Cited by 132 · see citing works
iFoldRNA v2: folding RNA with constraints
Krokhotin, A., Houlihan, K., & Dokholyan, N. V. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv221 · Cited by 123 · see citing works
On the significance of an RNA tertiary structure prediction
Hajdin, C. E., Ding, F., Dokholyan, N. V., & Weeks, K. M. (2010) · RNA · doi:10.1261/rna.1837410 · Cited by 106 · see citing works
Cragnolini, T., Laurin, Y., Derreumaux, P., & Pasquali, S. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00200 · Cited by 86 · see citing works
All-atom knowledge-based potential for RNA structure prediction and assessment
Capriotti, E., Norambuena, T., Martı́-Renom, M. A., & Melo, F. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr093 · Cited by 85 · see citing works
Li, J., Zhu, W., Wang, J., Li, W., Gong, S., Zhang, J., & Wang, W. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006514 · Cited by 81 · see citing works
IsRNA1: De Novo Prediction and Blind Screening of RNA 3D Structures
Zhang, D., Li, J., & Chen, S. (2021) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.0c01148 · Cited by 62 · see citing works
Rykunov, D., & Fiser, A. (2007) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.21279 · Cited by 61 · see citing works
MCQ4Structures to compute similarity of molecule structures
Żok, T., Popenda, M., & Szachniuk, M. (2013) · Central European Journal of Operations Research · doi:10.1007/s10100-013-0296-5 · Cited by 49 · see citing works
Li, J., & Chen, S. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad122 · Cited by 41 · see citing works
Modeling Noncanonical RNA Base Pairs by a Coarse-Grained IsRNA2 Model
Zhang, D., Chen, S., & Zhou, R. (2021) · The Journal of Physical Chemistry B · doi:10.1021/acs.jpcb.1c07288 · Cited by 38 · see citing works
&NA; (2009) · Journal for Nurses in Staff Development · doi:10.1097/01.nnd.0000320699.47006.a3 · Cited by 37 · see citing works
Deng, H., Jia, Y., Wei, Y., & Zhang, Y. (2012) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.24121 · Cited by 28 · see citing works
What is the best reference state for building statistical potentials in RNA 3D structure evaluation?
Tan, Y.-L., Feng, C., Jin, L., Shi, Y.-Z., Zhang, W., & Tan, Z.-J. (2019) · RNA · doi:10.1261/rna.069872.118 · Cited by 26 · see citing works
rna-tools.online: a Swiss army knife for RNA 3D structure modeling workflow
Magnus, M. (2022) · Nucleic Acids Res. · doi:10.1093/nar/gkac372 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The structure assessment web server: for proteins, complexes and more
Waterhouse, A. M., Studer, G., Robin, X., Bienert, S., Tauriello, G., & Schwede, T. F. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae270 · Cited by 140 · see citing works
Has <i>AlphaFold</i> 3 achieved success for RNA?
Bernard, C., Postic, G., Ghannay, S., & Tahi, F. (2025) · Acta Crystallographica Section D Structural Biology · doi:10.1107/s2059798325000592 · Cited by 61 · see citing works
Self-citationState-of-the-RNArt: benchmarking current methods for RNA 3D structure prediction
Bernard, C., Postic, G., Ghannay, S., & Tahi, F. (2024) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqae048 · Cited by 40 · see citing works
Self-citationMukherjee, S., Moafinejad, S. N., Badepally, N. G., Merdas, K., & Bujnicki, J. M. (2024) · Structure · doi:10.1016/j.str.2024.08.015 · Cited by 29 · see citing works
RNA-TorsionBERT: leveraging language models for RNA 3D torsion angles prediction
Bernard, C., Postic, G., Ghannay, S., & Tahi, F. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btaf004 · Cited by 15 · see citing works
Self-citationRNAtango: Analysing and comparing RNA 3D structures via torsional angles
Mackowiak, M., Adamczyk, B., Szachniuk, M., & Żok, T. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012500 · Cited by 9 · see citing works
Limits of deep-learning-based RNA prediction methods
Ludaic, M., & Elofsson, A. (2026) · Nucleic Acids Research · doi:10.1093/nar/gkag813 · Cited by 12 · see citing works
Aptamers Meet Structural Bioinformatics, Computational Chemistry, and Artificial Intelligence
da Rosa, G., de Castro, M., García-Velásquez, V. M., Pintos, S., Benedetto, J., Grille, L., Valla, S., Álvarez-Salas, L. M., Calzada, V., & Dans, P. D. (2025) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.70050 · Cited by 3 · see citing works
Bernard, C., Postic, G., Ghannay, S., & Tahi, F. (2025) · Scientific Reports · doi:10.1038/s41598-025-23326-y · Cited by 2 · see citing works
Self-citationHomRank: Homogeneous RNA Ranking for 3D Structure EvaluationPreprint
Liang, L., Yao, Y., Martinović, I., Kulkarni, M., Pan, Y., Huber, R. G., & Šikić, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.08.07.669087
Nithin, C., Pilla, S. P., & Kmiecik, S. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag689
RNADaemon: Reinforcement Learning-Guided Molecular Dynamics for RNA Tertiary Structure Prediction.
Xu, W.-T., Wu, Y., & Yu, X. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c02247
Meta-Scoring Approach to Curate Synthetic RNA 3D Structures
Bernard, C., Justyna, M., Postic, G., Antczak, M., Tahi, F., & Szachniuk, M. (2026) · Methods in molecular biology · doi:10.1007/978-1-0716-5583-2_12
Self-citation
- Authors
- Bernard, C., Postic, G., Ghannay, S., & Tahi, F.
- Affiliations
- Université Paris Saclay , Univ Evry, , 91020 Evry-Courcouronnes , France
- Université Paris-Saclay (FR)
- Centre National de la Recherche Scientifique (FR)
- Corresponding author
- Tahi, Fariza
- Venue
- Briefings in Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2024-01-22
- Volume
- 25
- Issue
- 2
- Pages
- bbae064
- ISSN
- 1467-5463 (ISSN-L)
- 1477-4054
- PMC
- PMC10939302
- OpenAlex
- W4392393183
- Cited by
- 12
- References
- 42
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 5
- FWCI
- 1.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Briefings in Bioinformatics (publishedVersion, cc-by-nc)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HAL (submittedVersion, other-oa)
- HAL (submittedVersion)
- Funders
- French National Research Agency (ANR-20-THIA-0013-01)
- DATAIA Convergence Institute (ANR-17-CONV-0003)
- GENCI/IDRIS (AD011014250)
- Labex DigiCosme (ANR11LABEX0045DIGICOSME)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA and protein synthesis mechanisms
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- RNA structure prediction, model quality assessment, scoring functions, benchmarking, RNA tertiary structure
- MeSH terms
- Models, Structural, RNA, Software, Benchmarking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review