A range of complex probabilistic models for RNA secondary structure prediction that includes the nearest-neighbor model and more
Open accessAbstract
The standard approach for single-sequence RNA secondary structure prediction uses a nearest-neighbor thermodynamic model with several thousand experimentally determined energy parameters. An attractive alternative is to use statistical approaches with parameters estimated from growing databases of structural RNAs. Good results have been reported for discriminative statistical methods using complex nearest-neighbor models, including CONTRAfold, Simfold, and ContextFold. Little work has been reported on generative probabilistic models (stochastic context-free grammars [SCFGs]) of comparable complexity, although probabilistic models are generally easier to train and to use. To explore a range of probabilistic models of increasing complexity, and to directly compare probabilistic, thermodynamic, and discriminative approaches, we created TORNADO, a computational tool that can parse a wide spectrum of RNA grammar architectures (including the standard nearest-neighbor model and more) using a generalized super-grammar that can be parameterized with probabilities, energies, or arbitrary scores. By using TORNADO, we find that probabilistic nearest-neighbor models perform comparably to (but not significantly better than) discriminative methods. We find that complex statistical models are prone to overfitting RNA structure and that evaluations should use structurally nonhomologous training and test data sets. Overfitting has affected at least one published method (ContextFold). The most important barrier to improving statistical approaches for RNA secondary structure prediction is the lack of diversity of well-curated single-sequence RNA secondary structures in current RNA databases.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The standard RNA secondary structure prediction problem can be cast as a parsing problem and solved by the CKY algorithm.
“Thus, the standard RNA secondary structure prediction problem can be cast as a parsing problem: given the above SCFG and an input RNA sequence, find the minimum-weight derivation in that can generate the sequence. This can be solved by the classical CKY algorithm from computational linguistics41–43.”
From Algorithm for optimized mRNA design improves stability and immunogenicity (2023) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Mfold web server for nucleic acid folding and hybridization prediction
Zuker, M. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg595 · Cited by 13,404 · see citing works
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,953 · see citing works
Introduction to automata theory, languages and computation
(1981) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(81)90068-9 · Cited by 10,781 · see citing works
Mathews, D. H., Sabina, J., Zuker, M., & Turner, D. H. (1999) · Journal of Molecular Biology · doi:10.1006/jmbi.1999.2700 · Cited by 3,795 · see citing works
Optimal computer folding of large RNA sequences using thermodynamics and auxiliary information
Zuker, M., & Stiegler, P. (1981) · Nucleic Acids Research · doi:10.1093/nar/9.1.133 · Cited by 3,604 · see citing works
Biological sequence analysis probabilistic models of proteins and nucleic acids
Durbin, R. M., Eddy, S. R., Krogh, A., & Mitchison, G. (1998) · Cited by 3,565 · see citing works
Self-citationThe Complete Atomic Structure of the Large Ribosomal Subunit at 2.4 Å Resolution
Ban, N., Nissen, P., Hansen, J., Moore, P. B., & Steitz, T. A. (2000) · Science · doi:10.1126/science.289.5481.905 · Cited by 3,327 · see citing works
Durbin, R. M., Eddy, S. R., Krogh, A., & Mitchison, G. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511790492 · Cited by 3,255 · see citing works
Self-citationVienna RNA secondary structure server
Hofacker, I. L. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg599 · Cited by 2,362 · see citing works
Fast folding and comparison of RNA secondary structures
Hofacker, I. L., Fontana, W., Stadler, P. F., Bonhoeffer, S., Tacker, M., & Schuster, P. M. (1994) · Monatshefte für Chemie - Chemical Monthly · doi:10.1007/bf00818163 · Cited by 2,314 · see citing works
Structure of the 30S ribosomal subunit
Wimberly, B. T., Brodersen, D. E., Clemons, W. M., Morgan-Warren, R. J., Carter, A. P., Vonrhein, C., Hartsch, T., & Ramakrishnan, V. (2000) · Nature · doi:10.1038/35030006 · Cited by 2,035 · see citing works
RNAstructure: software for RNA secondary structure prediction and analysis
Reuter, J. S., & Mathews, D. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-129 · Cited by 1,975 · see citing works
(2001) · Cited by 1,932 · see citing works
Compilation of tRNA sequences and sequences of tRNA genes
Sprinzl, M. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki012 · Cited by 1,916 · see citing works
Cannone, J. J., Subramanian, S., Schnare, M. N., Collett, J. R., D'Souza, L. M., Du, Y., Feng, B. Y., Lin, N., Madabusi, L. V., Müller, K. M., et al. (2002) · BMC Bioinformatics · doi:10.1186/1471-2105-3-2 · Cited by 1,614 · see citing works
Control of memory formation through regulated expression of a CaMKII transgene
Mayford, M., Bach, M. E., Huang, Y.-Y., Wang, L., Hawkins, R. D., & Kandel, E. R. (1996) · Science · doi:10.1126/science.274.5293.1678 · Cited by 1,550 · see citing works
Uncertainty in Artificial Intelligence
Kanal, L. N., & Lemmer, J. F. (1992) · Elsevier eBooks · doi:10.1016/c2013-0-12606-2 · Cited by 1,434 · see citing works
The equilibrium partition function and base pair binding probabilities for RNA secondary structure
McCaskill, J. S. (1990) · Biopolymers · doi:10.1002/bip.360290621 · Cited by 1,288 · see citing works
Crystal Structure of a Group I Ribozyme Domain: Principles of RNA Packing
Cate, J. H. D., Gooding, A. R., Podell, E. R., Zhou, K., Golden, B. L., Kundrot, C. E., Cech, T. R., & Doudna, J. A. (1996) · Science · doi:10.1126/science.273.5282.1678 · Cited by 1,249 · see citing works
Rubin, D. B. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345338 · Cited by 1,178 · see citing works
Xia, T., SantaLucia, J., Burkard, M. E., Kierzek, R., Schroeder, S. J., Jiao, X., Cox, C., & Turner, D. H. (1998) · Biochemistry · doi:10.1021/bi9809425 · Cited by 1,140 · see citing works
Geometric nomenclature and classification of RNA base pairs
Leontis, N. B., & Westhof, É. (2001) · RNA · doi:10.1017/s1355838201002515 · Cited by 1,074 · see citing works
Markham, N. R., & Zuker, M. (2008) · Methods in molecular biology · doi:10.1007/978-1-60327-429-6_1 · Cited by 1,026 · see citing works
Three-dimensional structure of a hammerhead ribozyme
Pley, H. W., Flaherty, K. M., & McKay, D. B. (1994) · Nature · doi:10.1038/372068a0 · Cited by 955 · see citing works
Genetic Control by a Metabolite Binding mRNA
Nahvi, A., Sudarsan, N., Ebert, M. S., Zou, X., Brown, K. L., & Breaker, R. R. (2002) · Chemistry & Biology · doi:10.1016/s1074-5521(02)00224-7 · Cited by 802 · see citing works
RNA sequence analysis using covariance models
Eddy, S. R., & Durbin, R. M. (1994) · Nucleic Acids Research · doi:10.1093/nar/22.11.2079 · Cited by 791 · see citing works
Self-citationCrystal structure of a hepatitis delta virus ribozyme
Ferré-D’Amaré, A. R., Zhou, K., & Doudna, J. A. (1998) · Nature · doi:10.1038/26912 · Cited by 787 · see citing works
Genome-wide measurement of RNA secondary structure in yeast
Kertesz, M., Wan, Y., Mazor, E., Rinn, J. L., Nutter, R. C., Chang, H. Y., & Segal, E. (2010) · Nature · doi:10.1038/nature09322 · Cited by 765 · see citing works
Fast and reliable prediction of noncoding RNAs
Stefan Washietl, A., Hofacker, I. L., & Stadler, P. F. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0409169102 · Cited by 658 · see citing works
Applications of stochastic context-free grammars using the Inside-Outside algorithm
Lari, K., & Young, S. J. (1991) · Computer Speech & Language · doi:10.1016/0885-2308(91)90009-f · Cited by 639 · see citing works
CONTRAfold: RNA secondary structure prediction without physics-based models
Do, C., Woods, D. A., & Batzoglou, S. (2006) · Intelligent Systems in Molecular Biology · doi:10.1093/bioinformatics/btl246 · Cited by 623 · see citing works
RNAalifold: improved consensus structure prediction for RNA alignments
Bernhart, S. H., Hofacker, I. L., Will, S., Gruber, A. R., & Stadler, P. F. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-474 · Cited by 595 · see citing works
Church: a language for generative models
Goodman, N., Mansinghka, V., Roy, D. M., Bonawitz, K., & Tenenbaum, J. B. (2012) · arXiv · doi:10.48550/arxiv.1206.3255 · Cited by 577 · see citing works
Structural Domains of Transfer RNA Molecules
Quigley, G. J., & Rich, A. S. (1976) · Science · doi:10.1126/science.790568 · Cited by 531 · see citing works
Identification and Classification of Conserved RNA Secondary Structures in the Human Genome
Pedersen, J. S., Bejerano, G., Siepel, A. C., Rosenbloom, K. R., Lindblad‐Toh, K., Lander, E. S., Kent, J., Miller, W., & Haussler, D. H. (2005) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0020033 · Cited by 515 · see citing works
Structure of a natural guanine-responsive riboswitch complexed with the metabolite hypoxanthine
Batey, R., Gilbert, S. D., & Montange, R. K. (2004) · Nature · doi:10.1038/nature03037 · Cited by 509 · see citing works
Noncoding RNA gene detection using comparative sequence analysis
Rivas, E., & Eddy, S. R. (2001) · BMC Bioinformatics · doi:10.1186/1471-2105-2-8 · Cited by 494 · see citing works
Self-citationBrown, J. (1998) · Nucleic Acids Research · doi:10.1093/nar/26.1.351 · Cited by 429 · see citing works
Structure of the S-adenosylmethionine riboswitch regulatory mRNA element
Montange, R. K., & Batey, R. (2006) · Nature · doi:10.1038/nature04819 · Cited by 405 · see citing works
Rfam: Wikipedia, clans and the “decimal” release
Gardner, P. P., Daub, J., Tate, J., Moore, B. L., Osuch, I. H., Griffiths-Jones, S., Finn, R. D., Nawrocki, E. P., Kolbe, D. L., Eddy, S. R., et al. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq1129 · Cited by 390 · see citing works
Self-citationCrystal Structure of the Ribonucleoprotein Core of the Signal Recognition Particle
Batey, R., Rambo, R. P., Lucast, L. J., Rha, B., & Doudna, J. A. (2000) · Science · doi:10.1126/science.287.5456.1232 · Cited by 384 · see citing works
The estimation of stochastic context-free grammars using the Inside-Outside algorithm
Lari, K., & Young, S. J. (1990) · Computer Speech & Language · doi:10.1016/0885-2308(90)90022-x · Cited by 380 · see citing works
Dynalign: an algorithm for finding the secondary structure common to two RNA sequences
Mathews, D. H., & Turner, D. H. (2002) · Journal of Molecular Biology · doi:10.1006/jmbi.2001.5351 · Cited by 374 · see citing works
RNA secondary structure prediction using stochastic context-free grammars and evolutionary history.
Knudsen, B. R., & Hein, J. (1999) · Bioinformatics · doi:10.1093/bioinformatics/15.6.446 · Cited by 349 · see citing works
RNA secondary structure prediction by centroids in a Boltzmann weighted ensemble
Ye, D., Chan, C. Y., & Lawrence, C. E. (2005) · RNA · doi:10.1261/rna.2500605 · Cited by 332 · see citing works
Inoue, T., & Cech, T. R. (1985) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.82.3.648 · Cited by 321 · see citing works
FragSeq: transcriptome-wide RNA structure probing using high-throughput sequencing
Underwood, J. G., Uzilov, A. V., Katzman, S. J., Onodera, C. S., Mainzer, J. E., Mathews, D. H., Lowe, T. M., Salama, S. R., & Haussler, D. H. (2010) · Nature Methods · doi:10.1038/nmeth.1529 · Cited by 315 · see citing works
Dowell, R. D., & Eddy, S. R. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-71 · Cited by 280 · see citing works
Self-citationRivas, E., & Eddy, S. R. (2000) · Bioinformatics · doi:10.1093/bioinformatics/16.7.583 · Cited by 279 · see citing works
Self-citationBrown, J. W. (1999) · Nucleic Acids Research · doi:10.1093/nar/27.1.314 · Cited by 279 · see citing works
Improved RNA secondary structure prediction by maximizing expected pair accuracy
Lü, Z., Gloor, J. W., & Mathews, D. H. (2009) · RNA · doi:10.1261/rna.1643609 · Cited by 237 · see citing works
Prediction of RNA secondary structure using generalized centroid estimators
Hamada, M., Kiryu, H., Sato, K., Mitsuyama, T., & Asai, K. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn601 · Cited by 233 · see citing works
Doshi, K. J., Cannone, J. J., Cobaugh, C. W., & Gutell, R. R. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-105 · Cited by 226 · see citing works
Crystal structure of a bacterial ribonuclease P RNA
Kazantsev, A. V., Krivenko, A. A., Harrington, D. J., Holbrook, S. R., Adams, P. D., & Pace, N. R. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506662102 · Cited by 222 · see citing works
Efficient parameter estimation for RNA secondary structure prediction
Andronescu, M., Condon, A., Hoos, H. H., Mathews, D. H., & Murphy, K. P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm223 · Cited by 220 · see citing works
Structural RNA Homology Search and Alignment Using Covariance Models
Nawrocki, E. P. (2009) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k78050mp · Cited by 207 · see citing works
Frequency and isostericity of RNA base pairs
Stombaugh, J., Zirbel, C. L., Westhof, É., & Leontis, N. B. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp011 · Cited by 205 · see citing works
SRPDB: Signal Recognition Particle Database
Rosenblad, M. A. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg107 · Cited by 192 · see citing works
Compilation of tRNA sequences and sequences of tRNA genes
Steinberg, S. V., Misch, A., & Sprinzl, M. (1993) · Nucleic Acids Research · doi:10.1093/nar/21.13.3011 · Cited by 163 · see citing works
Computational approaches for RNA energy parameter estimation
Andronescu, M., Condon, A., Hoos, H. H., Mathews, D. H., & Murphy, K. P. (2010) · RNA · doi:10.1261/rna.1950510 · Cited by 132 · see citing works
Efficient pairwise RNA structure prediction and alignment using sequence alignment constraints
Dowell, R. D., & Eddy, S. R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-400 · Cited by 125 · see citing works
Self-citationRich Parameterization Improves RNA Structure Prediction
Zakov, S., Goldberg, Y., Elhadad, M., & Ziv-Ukelson, M. (2011) · Journal of Computational Biology · doi:10.1089/cmb.2011.0184 · Cited by 125 · see citing works
An asymptotic analysis of generative, discriminative, and pseudolikelihood estimators
Liang, P., & Jordan, M. I. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390230 · Cited by 119 · see citing works
Puton, T., Kozlowski, L. P., Rother, K. M., & Bujnicki, J. M. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt101 · Cited by 118 · see citing works
Hudson, C. M., & Williams, K. P. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku1109 · Cited by 113 · see citing works
Database of non-canonical base pairs found in known RNA structures
Nagaswamy, U. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.375 · Cited by 103 · see citing works
A discipline of dynamic programming over sequence data
Giegerich, R., Meyer, C., & Steffen, P. (2004) · Science of Computer Programming · doi:10.1016/j.scico.2003.12.005 · Cited by 99 · see citing works
A reliable sequence alignment method based on probabilities of residue correspondences
Miyazawa, S. (1995) · Protein Engineering Design and Selection · doi:10.1093/protein/8.10.999 · Cited by 91 · see citing works
Stochastic context-free grammars for modeling RNA
Sakakibara, Brown, Underwood, Mian, & Haussler (1994) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.1994.323568 · Cited by 90 · see citing works
Efficient multiple hyperparameter learning for log-linear models
Foo, C.-S., Shulman, J., & Ng, A. Y. (2007) · neural information processing systems · Cited by 88 · see citing works
RNAcentral: A vision for an international database of RNA sequences
Bateman, A. G., Agrawal, S., Birney, E., Bruford, E. A., Bujnicki, J. M., Cochrane, G., Cole, J. R., Dinger, M. E., Enright, A. J., Gardner, P. P., et al. (2011) · RNA · doi:10.1261/rna.2750811 · Cited by 73 · see citing works
RNA Secondary Structure Prediction Based on Free Energy and Phylogenetic Analysis
Juan, V., & Wilson, C. (1999) · Journal of Molecular Biology · doi:10.1006/jmbi.1999.2801 · Cited by 70 · see citing works
Rich Parameterization Improves RNA Structure Prediction
Zakov, S., Goldberg, Y., Elhadad, M., & Ziv-Ukelson, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-20036-6_48 · Cited by 60 · see citing works
RNA Structure Determination Using SAXS Data
Yang, S., Parisien, M., Major, F., & Roux, B. (2010) · The Journal of Physical Chemistry B · doi:10.1021/jp1057308 · Cited by 60 · see citing works
Joint and conditional estimation of tagging and parsing models
Johnson, M. S. (2001) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1073012.1073054 · Cited by 51 · see citing works
SRPDB (Signal Recognition Particle Database)
Gorodkin, J. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.1.169 · Cited by 49 · see citing works
UNAFold : software for nucleic acid folding and hybriziation
Markham, N. (2008) · Medical Entomology and Zoology · Cited by 40 · see citing works
Mathews, D. H., André, T. C., Kim, J., Turner, D. H., & Zuker, M. (1997) · ACS symposium series · doi:10.1021/bk-1998-0682.ch015 · Cited by 39 · see citing works
STOCHASTIC CONTEXT-FREE GRAMMARS FOR MODELLING RNA
Sakakibara, Y., Brown, M. P., Underwood, R. C., et al. (1993) · Cited by 38 · see citing works
Explaining and Controlling Ambiguity in Dynamic Programming
Giegerich, R. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45123-4_6 · Cited by 34 · see citing works
Liu, B., Diamond, J. M., Mathews, D. H., & Turner, D. H. (2010) · Biochemistry · doi:10.1021/bi101470n · Cited by 28 · see citing works
Sparse RNA Folding: Time and Space Efficient Algorithms
Backofen, R., Tsur, D., Zakov, S., & Ziv-Ukelson, M. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02441-2_22 · Cited by 21 · see citing works
Studies in Probabilistic Sequence Alignment and Evolution
Holmes, I., Birney, E., Bruno, B., Durbin, R. M., Eddy, S. R., Haussler, D. H., Higgins, D. G., Hubbard, T., Krogh, A., Lawrence, C., et al. (1998) · Cited by 19 · see citing works
Self-citationChallenges in the compilation of a domain specific language for dynamic programming
Giegerich, R., & Steffen, P. (2006) · ACM Symposium on Applied Computing · doi:10.1145/1141277.1141653 · Cited by 17 · see citing works
Williams, K. P. (1999) · Nucleic Acids Research · doi:10.1093/nar/27.1.165 · Cited by 16 · see citing works
Williamson, J. R. (2000) · Nature · doi:10.1038/35030271 · Cited by 14 · see citing works
A home for RNA families atRNA Biology
Gardner, P. P., & Bateman, A. G. (2009) · RNA Biology · doi:10.4161/rna.6.1.7635 · Cited by 14 · see citing works
Compiling a domain specific language for dynamic programming
Peter, S. (2006) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 11 · see citing works
Extending Stochastic Context-Free Grammars for an Application in Bioinformatics
Weinberg, F., & Nebel, M. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13089-2_49 · Cited by 8 · see citing works
Analysis of the Free Energy in a Stochastic RNA Secondary Structure Model
Nebel, M. E., & Scheid, A. (2010) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2010.126 · Cited by 8 · see citing works
Fujita, Y., Furuta, H., & Ikawa, Y. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq018 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Algorithm for optimized mRNA design improves stability and immunogenicity
Zhang, H., Zhang, L., Lin, A., Xu, C., Li, Z., Liu, K., Liu, B., Ma, X., Zhao, F., Jiang, H., et al. (2023) · Nature · doi:10.1038/s41586-023-06127-z · Cited by 498 · see citing works
RNA secondary structure prediction using deep learning with thermodynamic integration
Sato, K., Akiyama, M., & Sakakibara, Y. (2021) · Nature Communications · doi:10.1038/s41467-021-21194-4 · Cited by 470 · see citing works
A statistical test for conserved RNA structure shows lack of evidence for structure in lncRNAs
Rivas, E., Clements, J., & Eddy, S. R. (2016) · Nature Methods · doi:10.1038/nmeth.4066 · Cited by 363 · see citing works
Self-citationLinearFold: linear-time approximate RNA folding by 5'-to-3' dynamic programming and beam search
Huang, L., Zhang, H., Deng, D., Zhao, K., Liu, K., Hendrix, D. A., & Mathews, D. H. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz375 · Cited by 207 · see citing works
RNA secondary structure packages evaluated and improved by high-throughput experiments
Wayment-Steele, H. K., Kladwang, W., Strom, A. I., Lee, J., Treuille, A., Becka, A. J., Participants, E., & Das, R. (2022) · Nature Methods · doi:10.1038/s41592-022-01605-0 · Cited by 154 · see citing works
Advances and opportunities in RNA structure experimental determination and computational modeling
Zhang, J., Fei, Y., Sun, L., & Zhang, Q. C. (2022) · Nature Methods · doi:10.1038/s41592-022-01623-y · Cited by 148 · see citing works
RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks
Penić, R. J., Vlašić, T., Huber, R. G., Wan, Y., & Šikić, M. (2025) · Nature Communications · doi:10.1038/s41467-025-60872-5 · Cited by 146 · see citing works
Rise of the RNA Machines: Exploring the Structure of Long Non-Coding RNAs
Novikova, I. V., Hennelly, S. P., Tung, C., & Sanbonmatsu, K. Y. (2013) · Journal of Molecular Biology · doi:10.1016/j.jmb.2013.02.030 · Cited by 144 · see citing works
Computational Analysis of Conserved RNA Secondary Structure in Transcriptomes and Genomes
Eddy, S. R. (2014) · Annual Review of Biophysics · doi:10.1146/annurev-biophys-051013-022950 · Cited by 127 · see citing works
Self-citationPredicting RNA secondary structures from sequence and probing data
Lorenz, R., Wolfinger, M. T., Andrea Tanzer, A., & Hofacker, I. L. (2016) · Methods · doi:10.1016/j.ymeth.2016.04.004 · Cited by 122 · see citing works
Review of machine learning methods for RNA secondary structure prediction
Zhao, Q., Zhao, Z., Fan, X., Yuan, Z., Mao, Q., & Yao, Y. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009291 · Cited by 106 · see citing works
Sato, K., & Hamada, M. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad186 · Cited by 101 · see citing works
RNA secondary structure modeling at consistent high accuracy using differential SHAPE
Rice, G. M., Leonard, C. W., & Weeks, K. M. (2014) · RNA · doi:10.1261/rna.043323.113 · Cited by 98 · see citing works
RNA structure prediction using positive and negative evolutionary information
Rivas, E. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008387 · Cited by 90 · see citing works
Self-citationRecent advances in RNA folding
Fallmann, J., Will, S., Engelhardt, J., Grüning, B. A., Backofen, R., & Stadler, P. F. (2017) · Journal of Biotechnology · doi:10.1016/j.jbiotec.2017.07.007 · Cited by 85 · see citing works
Szikszai, M., Wise, M. J., Datta, A., Ward, M., & Mathews, D. H. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac415 · Cited by 83 · see citing works
Proctor, J. R., & Meyer, I. M. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt174 · Cited by 82 · see citing works
How to benchmark RNA secondary structure prediction accuracy
Mathews, D. H. (2019) · Methods · doi:10.1016/j.ymeth.2019.04.003 · Cited by 69 · see citing works
Evolutionary conservation of RNA sequence and structure
Rivas, E. (2021) · Wiley Interdisciplinary Reviews - RNA · doi:10.1002/wrna.1649 · Cited by 68 · see citing works
Self-citationThe four ingredients of single-sequence RNA secondary structure prediction. A unifying perspective
Rivas, E. (2013) · RNA Biology · doi:10.4161/rna.24971 · Cited by 57 · see citing works
Self-citationImproving RNA Secondary Structure Prediction with Structure Mapping Data
Sloma, M. F., & Mathews, D. H. (2015) · Methods in enzymology on CD-ROM/Methods in enzymology · doi:10.1016/bs.mie.2014.10.053 · Cited by 57 · see citing works
3S: Shotgun secondary structure determination of long non-coding RNAs
Novikova, I. V., Dharap, A. A., Hennelly, S. P., & Sanbonmatsu, K. Y. (2013) · Methods · doi:10.1016/j.ymeth.2013.07.030 · Cited by 57 · see citing works
ERNIE-RNA: an RNA language model with structure-enhanced representations
Yin, W., Zhang, Z., Zhang, S., He, L., Zhang, R., Jiang, R., Liu, G., Wang, J., Zhang, X., Qin, T., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-64972-0 · Cited by 55 · see citing works
A max-margin training of RNA secondary structure prediction integrated with the thermodynamic model
Akiyama, M., Sato, K., & Sakakibara, Y. (2018) · Journal of Bioinformatics and Computational Biology · doi:10.1142/s0219720018400255 · Cited by 55 · see citing works
Machine learning for RNA 2D structure prediction benchmarked on experimental data
Marek, J. Ł., Antczak, M., & Szachniuk, M. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad153 · Cited by 50 · see citing works
DAFS: simultaneous aligning and folding of RNA sequences via dual decomposition
Sato, K., Kato, Y., Akutsu, T., Asai, K., & Sakakibara, Y. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts612 · Cited by 42 · see citing works
Szikszai, M., Magnus, M., Sanghi, S., Kadyan, S., Bouatta, N., & Rivas, E. (2024) · Journal of Molecular Biology · doi:10.1016/j.jmb.2024.168552 · Cited by 38 · see citing works
Self-citationZuber, J., Sun, H., Zhang, X., McFadyen, I. J., & Mathews, D. H. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkx170 · Cited by 37 · see citing works
Recent applications of artificial intelligence in RNA-targeted small molecule drug discovery
Morishita, E. C., & Nakamura, S. (2024) · Expert Opinion on Drug Discovery · doi:10.1080/17460441.2024.2313455 · Cited by 35 · see citing works
RNAformer: A Simple yet Effective Model for Homology-Aware RNA Secondary Structure PredictionPreprint
Franke, J. K. H., Runge, F., Koeksal, R., Matus, D., Backofen, R., & Hutter, F. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.02.12.579881 · Cited by 35 · see citing works
RNA Thermodynamic Structural Entropy
García-Martín, J. A., & Clote, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0137859 · Cited by 33 · see citing works
Zuber, J., Cabral, B. J., McFadyen, I. J., Mauger, D., & Mathews, D. H. (2018) · RNA · doi:10.1261/rna.065102.117 · Cited by 30 · see citing works
Mittal, A., Turner, D. H., & Mathews, D. H. (2024) · Journal of Molecular Biology · doi:10.1016/j.jmb.2024.168549 · Cited by 29 · see citing works
RNA Structural Alignments, Part I: Sankoff-Based Approaches for Structural Alignments
Havgaard, J. H., & Gorodkin, J. (2013) · Methods in molecular biology · doi:10.1007/978-1-62703-709-9_13 · Cited by 29 · see citing works
Dynamic conformation: Marching toward circular RNA function and application
Liu, C., Yang, L. C., & Chen, L. (2024) · Molecular Cell · doi:10.1016/j.molcel.2024.08.020 · Cited by 28 · see citing works
Computational biology of RNA interactions
Dieterich, C., & Stadler, P. F. (2012) · Wiley Interdisciplinary Reviews - RNA · doi:10.1002/wrna.1147 · Cited by 27 · see citing works
(2016) · Methods in molecular biology · doi:10.1007/978-1-4939-6433-8 · Cited by 26 · see citing works
A Hitchhiker's guide to RNA–RNA structure and interaction prediction tools
Tieng, F. Y. F., Abdullah‐Zawawi, M., Shahri, N. A. A. M., Mohamed‐Hussein, Z., Lee, L., & Mutalib, N. A. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad421 · Cited by 25 · see citing works
Bellman’s GAP—a language and compiler for dynamic programming in sequence analysis
Sauthoff, G., Möhl, M., Janssen, S., & Giegerich, R. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt022 · Cited by 22 · see citing works
Visualizing RNA base-pairing probabilities with RNAbow diagrams
Aalberts, D. P., & Jannen, W. K. (2013) · RNA · doi:10.1261/rna.033365.112 · Cited by 22 · see citing works
zu Siederdissen, C. H. (2012) · ACM SIGPLAN International Conference on Functional Programming (ICFP) · doi:10.1145/2364527.2364559 · Cited by 21 · see citing works
Computer Aided Development of Nucleic Acid Applications in Nanotechnologies
Paloncýová, M., Pykal, M., Kührová, P., Banáš, P., Šponer, J., & Otyepka, M. (2022) · Small · doi:10.1002/smll.202204408 · Cited by 21 · see citing works
Thirteen dubious ways to detect conserved structural RNAs
Gao, W. N. D., Yang, A., & Rivas, E. (2022) · IUBMB Life · doi:10.1002/iub.2694 · Cited by 21 · see citing works
Self-citationQiu, X. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011047 · Cited by 21 · see citing works
Designing molecular RNA switches with Restricted Boltzmann machines
Fernandez-de-Cossio-Diaz, J., Hardouin, P., Lyonnet du Moutier, F.-X., Di Gioacchino, A., Marchand, B., Ponty, Y., Sargueil, B., Monasson, R., & Cocco, S. (2025) · Nature Communications · doi:10.1038/s41467-025-66265-y · Cited by 20 · see citing works
A primer in macromolecular linguistics
Searls, D. B. (2012) · Biopolymers · doi:10.1002/bip.22101 · Cited by 20 · see citing works
Kim, M., Jo, H., Jung, G. Y., & Oh, S. S. (2022) · Advanced Materials · doi:10.1002/adma.202208309 · Cited by 19 · see citing works
RNA structure prediction using deep learning — A comprehensive review
Chaturvedi, M., Rashid, M. A., & Paliwal, K. K. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109845 · Cited by 18 · see citing works
Deep generalizable prediction of RNA secondary structure via base pair motif energy
Zhu, H., Tang, F., Quan, Q., Chen, K., Xiong, P., & Zhou, S. K. (2025) · Nature Communications · doi:10.1038/s41467-025-60048-1 · Cited by 17 · see citing works
Introduction to Stochastic Context Free Grammars
Giegerich, R. (2013) · Methods in molecular biology · doi:10.1007/978-1-62703-709-9_5 · Cited by 17 · see citing works
Long noncoding RNAs: from identification to functions and mechanisms
Huarte, M., & Marín-Béjar, O. (2015) · Advances in Genomics and Genetics · doi:10.2147/agg.s61842 · Cited by 17 · see citing works
RNA Secondary Structure Prediction from Multi-Aligned Sequences
Hamada, M. (2014) · Methods in molecular biology · doi:10.1007/978-1-4939-2291-8_2 · Cited by 17 · see citing works
Secondary structural entropy in RNA switch (Riboswitch) identification
Manzourolajdad, A., & Arnold, J. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0523-2 · Cited by 16 · see citing works
Evaluation of a sophisticated SCFG design for RNA secondary structure prediction
Nebel, M. E., & Scheid, A. (2011) · Theory in Biosciences · doi:10.1007/s12064-011-0139-7 · Cited by 16 · see citing works
Estimating uncertainty in predicted folding free energy changes of RNA secondary structures
Zuber, J., & Mathews, D. H. (2019) · RNA · doi:10.1261/rna.069203.118 · Cited by 16 · see citing works
A semi-supervised learning approach for RNA secondary structure prediction
Yonemoto, H., Asai, K., & Hamada, M. (2015) · Computational Biology and Chemistry · doi:10.1016/j.compbiolchem.2015.02.002 · Cited by 16 · see citing works
IRBIS: a systematic search for conserved complementarity
Pervouchine, D. D. (2014) · RNA · doi:10.1261/rna.045088.114 · Cited by 16 · see citing works
Winn, J. C., Maduna, S. N., & der Merwe, A. E. B. (2023) · Genomics · doi:10.1016/j.ygeno.2023.110771 · Cited by 15 · see citing works
Fighting against uncertainty: an essential issue in bioinformatics
Hamada, M. (2013) · Briefings in Bioinformatics · doi:10.1093/bib/bbt038 · Cited by 15 · see citing works
Oxfold: kinetic folding of RNA using stochastic context-free grammars and evolutionary information
Anderson, J. W. J., Haas, P. A., Mathieson, L.-A., Volynkin, V., Lyngsø, R. B., Tataru, P., & Hein, J. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt050 · Cited by 13 · see citing works
Algebraic dynamic programming for multiple context-free grammars
Riechert, M., zu Siederdissen, C. H., & Stadler, P. F. (2016) · Theoretical Computer Science · doi:10.1016/j.tcs.2016.05.032 · Cited by 12 · see citing works
Akiyama, M., Sakakibara, Y., & Sato, K. (2022) · Genes · doi:10.3390/genes13112155 · Cited by 10 · see citing works
In vivo-like nearest neighbor parameters improve prediction of fractional RNA base-pairing in cells
Sieg, J. P., Jolley, E. A., Huot, M. J., Babitzke, P., & Bevilacqua, P. C. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad807 · Cited by 10 · see citing works
Determining parameters for non-linear models of multi-loop free energy change
Ward, M., Sun, H., Datta, A., Wise, M. J., & Mathews, D. H. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz222 · Cited by 10 · see citing works
Research on folding diversity in statistical learning methods for RNA secondary structure prediction
Zhu, Y., Xie, Z., Li, Y., Zhu, M., & Chen, Y. P. (2018) · International Journal of Biological Sciences · doi:10.7150/ijbs.24595 · Cited by 10 · see citing works
Exact Learning of RNA Energy Parameters From Structure
Chitsaz, H., & Aminisharifabad, M. (2015) · Journal of Computational Biology · doi:10.1089/cmb.2014.0164 · Cited by 9 · see citing works
Sahoo, S., Świtnicki, M., & Pedersen, J. S. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw175 · Cited by 9 · see citing works
Szabat, M., Prochota, M., Kierzek, R., Kierzek, E., & Mathews, D. H. (2022) · Journal of Molecular Biology · doi:10.1016/j.jmb.2022.167632 · Cited by 9 · see citing works
Transformers in RNA structure prediction: A review
Chaturvedi, M., Rashid, M. A., & Paliwal, K. K. (2025) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2025.03.021 · Cited by 8 · see citing works
Direct Updating of an RNA Base-Pairing Probability Matrix with Marginal Probability Constraints
Hamada, M. (2012) · Journal of Computational Biology · doi:10.1089/cmb.2012.0215 · Cited by 8 · see citing works
Machine learning for RNA secondary structure prediction: a review of current methods and challenges
Sacco, G., Bussi, G., & Sanguinetti, G. (2026) · RNA · doi:10.1261/rna.080840.125 · Cited by 7 · see citing works
AliNA – a deep learning program for RNA secondary structure prediction
Nasaev, S. S., Mukanov, A. R., Kuznetsov, I. I., & Veselovsky, A. V. (2023) · Molecular Informatics · doi:10.1002/minf.202300113 · Cited by 7 · see citing works
KnotAli: informed energy minimization through the use of evolutionary information
Gray, M., Chester, S., & Jabbari, H. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04673-3 · Cited by 7 · see citing works
RnaBench: A Comprehensive Library for In Silico RNA ModellingPreprint
Runge, F., Farid, K., Franke, J. K. H., & Hutter, F. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.01.09.574794 · Cited by 7 · see citing works
All-at-once RNA folding with 3D motif prediction framed by evolutionary information
Karan, A., & Rivas, E. (2025) · Nature Methods · doi:10.1038/s41592-025-02833-w · Cited by 6 · see citing works
Self-citationLimits of experimental evidence in RNA secondary structure prediction
von Löhneysen, S., Mörl, M., & Stadler, P. F. (2024) · Frontiers in Bioinformatics · doi:10.3389/fbinf.2024.1346779 · Cited by 6 · see citing works
Improving RNA Branching Predictions: Advances and Limitations
Poznanović, S., Wood, C., Cloer, M., & Heitsch, C. (2021) · Genes · doi:10.3390/genes12040469 · Cited by 6 · see citing works
Szikszai, M., Wang, T.-Y., Krueger, R., Mathews, D. H., Ward, M., & Aviran, S. (2026) · RNA · doi:10.1261/rna.080846.125 · Cited by 5 · see citing works
Wfold: A new method for predicting RNA secondary structure with deep learning
Yuan, Y., Yang, E., & Zhang, R. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109207 · Cited by 5 · see citing works
StemP: A Fast and Deterministic Stem-Graph Approach for RNA Secondary Structure Prediction
Tang, M., Hwang, K., & Kang, S. H. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3253049 · Cited by 4 · see citing works
Stochastic k-Tree Grammar and Its Application in Biomolecular Structure Modeling
Ding, L., Samad, A., Xue, X., Huang, X., Malmberg, R. L., & Cai, L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-04921-2_25 · Cited by 4 · see citing works
RNAinformer: Generative RNA Design With Tertiary InteractionsPreprint
Patil, S., Runge, F., Franke, J. K. H., & Hutter, F. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.03.09.584209 · Cited by 4 · see citing works
Machine Learning Approaches for Predicting RNA–RNA/DNA Interactions
Fukunaga, T. (2025) · Methods in molecular biology · doi:10.1007/978-1-0716-4670-0_14 · Cited by 3 · see citing works
What does it take to learn the rules of RNA base pairing? A lot less than you may think
Pratap, J. S., Krueger, R., & Rivas, E. (2026) · Communications Biology · doi:10.1038/s42003-026-09921-3 · Cited by 3 · see citing works
Self-citationEstimating RNA Secondary Structure Folding Free Energy Changes with efn2
Zuber, J., & Mathews, D. H. (2024) · Methods in molecular biology · doi:10.1007/978-1-0716-3519-3_1 · Cited by 3 · see citing works
RNA secondary structures: from ab initio prediction to better compression, and back
Onokpasa, E., Wild, S., & Wong, P. W. H. (2023) · DCC · doi:10.1109/dcc55655.2023.00036 · Cited by 3 · see citing works
The RNA Newton polytope and learnability of energy parameters
Forouzmand, E., & Chitsaz, H. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt226 · Cited by 3 · see citing works
Zhou, T., Malik, A., TANG, W. Y., Mathews, D. H., & Huang, L. P. (2025) · Journal of Computational Biology · doi:10.1177/15578666251398551 · Cited by 2 · see citing works
Exploring Secondary Structure Predictions for RNA-Targeted Drug Discovery: Power and Challenges
Zhang, Z., Dolcetti, G., Tyrchan, C., Maria, L. D., Bussi, G., & Czechtizky, W. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c00108 · Cited by 2 · see citing works
RNA Secondary Structure Prediction Based on Energy Models
Akiyama, M., & Sato, K. (2023) · Methods in molecular biology · doi:10.1007/978-1-0716-2768-6_6 · Cited by 2 · see citing works
Lasher, B., & Hendrix, D. A. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf108 · Cited by 2 · see citing works
Zhou, T., Malik, A., Tang, W. Y., Mathews, D. H., & Huang, L. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-90252-9_10 · Cited by 2 · see citing works
RAFFT: Efficient prediction of RNA folding pathways using the fast Fourier transform
Opuu, V., Merleau, N. S. C., Messow, V., & Smerlak, M. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010448 · Cited by 2 · see citing works
Structural prediction of RNA switches using conditional base-pair probabilities
Manzourolajdad, A., & Spouge, J. L. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217625 · Cited by 2 · see citing works
Chasles, S., & Major, F. (2023) · Frontiers in Genetics · doi:10.3389/fgene.2023.1254226 · Cited by 2 · see citing works
Learning RNA secondary structure (only) from structure probing dataPreprint
Foo, C.-S., & Pop, C. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/152629 · Cited by 2 · see citing works
Graph Convolutional Network for predicting secondary structure of RNAPreprint
Korkin, D., Ammartayakun, A., Busaranuvong, P., & Khosravi‐Far, R. (2024) · Research Square · doi:10.21203/rs.3.rs-3798842/v1 · Cited by 2 · see citing works
Disentangling RNA evolution and thermodynamics in genomic language modelsPreprint
Xu, Y., Pai, N., & Wayment-Steele, H. K. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.28.728275 · Cited by 2 · see citing works
Structure–function relationship of long noncoding RNAs : Advances and challenges
Longkumer, I., & Mishra, S. (2022) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1609 · Cited by 1 · see citing works
Takahashi, S., Hamada, M., Tateishi‐Karimata, H., & Sugimoto, N. (2025) · RSC Chemical Biology · doi:10.1039/d5cb00105f · Cited by 1 · see citing works
- Authors
- Rivas, E., Lang, R., & Eddy, S. R.
- Affiliations
- Howard Hughes Medical Institute (US)
- Xavier University of Louisiana (US)
- Venue
- RNA
- Publisher
- Cold Spring Harbor Laboratory
- Published
- 2011-12-22
- Volume
- 18
- Issue
- 2
- Pages
- 193-212
- ISSN
- 1355-8382 (ISSN-L)
- 1469-9001
- PMC
- PMC3264907
- OpenAlex
- W2109638684
- Cited by
- 145
- References
- 91
- Citations by year
- 2026: 9 · 2025: 20 · 2024: 16 · 2023: 15 · 2022: 17 · 2021: 5 · 2020: 4 · 2019: 5 · 2018: 5 · 2017: 3 · 2016: 6 · 2015: 7 · 2014: 7 · 2013: 17 · 2012: 7
- FWCI
- 4.13
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- other-oa
- Locations
- RNA (publishedVersion, other-oa)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Howard Hughes Medical Institute
- National Institutes of Health
- National Institute of General Medical Sciences (R01GM070538)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › RNA and protein synthesis mechanisms
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Keywords
- RNA secondary structure prediction, probabilistic models, probabilistic context-free grammars, probabilistic generative models, overfitting, tornadoes, structural homology
- MeSH terms
- Algorithms, Models, Theoretical, Nucleic Acid Conformation, RNA, Software, Thermodynamics, Models, Statistical, Computational Biology, RNA Folding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review