RNA design rules from a massive open laboratory
Open accessThe DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Significance: Self-assembling RNA molecules play critical roles throughout biology and bioengineering. To accelerate progress in RNA design, we present EteRNA, the first internet-scale citizen science “game” scored by high-throughput experiments. A community of 37,000 nonexperts leveraged continuous remote laboratory feedback to learn new design rules that substantially improve the experimental accuracy of RNA structure designs. These rules, distilled by machine learning into a new automated algorithm EteRNABot, also significantly outperform prior algorithms in a gauntlet of independent tests. These results show that an online community can carry out large-scale experiments, hypothesis generation, and algorithm design to create practical advances in empirical science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Reprogramming bacteria to seek and destroy an herbicide
Sinha, J., Reyes, S. J., & Gallivan, J. P. (2010) · Nature Chemical Biology · doi:10.1038/nchembio.369 · Cited by 166
RetractedRegression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905 · cited 1×
“3B and SI Appendix, Table S4), its scoring function was optimized over the parameters using the downhill simplex algorithm (34) to minimize the average squared error between the predicted and actual structure mapping scores for the training set (results from phase I and the four follow-up puzzles before phase II).”
MethodEfron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Mathews, D. H., Sabina, J., Zuker, M., & Turner, D. H. (1999) · Journal of Molecular Biology · doi:10.1006/jmbi.1999.2700 · Cited by 3,795 · cited 1×
“In this sense, the EteRNA rules are analogous to energetic models, such as the nearest neighbor rules (25), which are also empirically derived but not yet derivable from first principles (26, 27) or other design heuristics (28).”
MethodNucleic acid junctions and lattices
Seeman, N. C. (1982) · Journal of Theoretical Biology · doi:10.1016/0022-5193(82)90002-9 · Cited by 2,497
RNAstructure: software for RNA secondary structure prediction and analysis
Reuter, J. S., & Mathews, D. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-129 · Cited by 2,012
NUPACK: Analysis and design of nucleic acid systems
Zadeh, J. N., Steenberg, C. D., Bois, J. S., Wolfe, B. R., Pierce, M. B., Khan, A. R., Dirks, R. M., & Pierce, N. A. (2011) · Journal of Computational Chemistry · doi:10.1002/jcc.21596 · Cited by 1,670
Mathews, D. H., Disney, M. D., Childs, J. L., Schroeder, S. J., Zuker, M., & Turner, D. H. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0401799101 · Cited by 1,622
The equilibrium partition function and base pair binding probabilities for RNA secondary structure
McCaskill, J. S. (1990) · Biopolymers · doi:10.1002/bip.360290621 · Cited by 1,310
Merino, E. J., Wilkinson, K. A., Coughlan, J. L., & Weeks, K. M. (2005) · Journal of the American Chemical Society · doi:10.1021/ja043822v · Cited by 796
RNA regulation: A new genetics?
Mattick, J. S. (2004) · Nature Reviews Genetics · doi:10.1038/nrg1321 · Cited by 765 · cited 1×
“Proc Natl Acad Sci USA 108(2):745–750.”
Accurate SHAPE-directed RNA structure determination
Deigan, K. E., Li, T. W., Mathews, D. H., & Weeks, K. M. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0806929106 · Cited by 696
Organization of Intracellular Reactions with Rationally Designed RNA Assemblies
Delebecque, C. J., Lindner, A. B., Silver, P. A., & Aldaye, F. A. (2011) · Science · doi:10.1126/science.1206938 · Cited by 633
Algorithm discovery by protein folding game players
Khatib, F., Cooper, S., Tyka, M. D., Xu, K., Makedon, I., Popović, Z., Baker, D., & Players, F. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1115898108 · Cited by 582
Higher-Order Cellular Information Processing with Synthetic RNA Devices
Win, M. N., & Smolke, C. D. (2008) · Science · doi:10.1126/science.1160311 · Cited by 545
Lucks, J. B., Mortimer, S. A., Trapnell, C., Luo, S., Aviran, S., Schroth, G. P., Pachter, L., Doudna, J. A., & Arkin, A. P. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1106501108 · Cited by 389
Atomic accuracy in predicting and designing noncanonical RNA structure
Das, R., Karanicolas, J., & Baker, D. (2010) · Nature Methods · doi:10.1038/nmeth.1433 · Cited by 368
Self-citationIncreased Diels-Alderase activity through backbone remodeling guided by Foldit players
Eiben, C. B., Siegel, J. B., Bale, J. B., Cooper, S., Khatib, F., Shen, B. W., Players, F., Stoddard, B. L., Popovic, Z., & Baker, D. (2012) · Nature Biotechnology · doi:10.1038/nbt.2109 · Cited by 315
DNA barcoding a useful tool for taxonomists
Schindel, D. E., & Miller, S. E. (2005) · Nature · doi:10.1038/435017b · Cited by 314
Cellular-resolution connectomics: challenges of dense neural circuit reconstruction
Helmstaedter, M. (2013) · Nature Methods · doi:10.1038/nmeth.2476 · Cited by 313
Discovery of selective bioactive small molecules by targeting an RNA dynamic ensemble
Stelzer, A. C., Frank, A. T., Kratz, J. D., Swanson, M. D., Gonzalez-Hernandez, M. J., Lee, J., Andricioaei, I., Markovitz, D. M., & Al-Hashimi, H. M. (2011) · Nature Chemical Biology · doi:10.1038/nchembio.596 · Cited by 291
Self-citationThe architectonics of programmable RNA and DNA nanostructures
Jaeger, L., & Chworos, A. (2006) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2006.07.001 · Cited by 269
DMS footprinting of structured RNAs and RNA–protein complexes
Tijerina, P., Mohr, S., & Russell, R. (2007) · Nature Protocols · doi:10.1038/nprot.2007.380 · Cited by 267
Isolation of RNA Aptamers for Biological Cofactors by In Vitro Selection
Burgstaller, P., & Famulok, M. (1994) · Angewandte Chemie International Edition in English · doi:10.1002/anie.199410841 · Cited by 221
Paradigms for computational nucleic acid design
Dirks, R. M. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh291 · Cited by 205
Nucleic acid sequence design via efficient ensemble defect optimization
Zadeh, J. N., Wolfe, B. R., & Pierce, N. A. (2011) · Journal of Computational Chemistry · doi:10.1002/jcc.21633 · Cited by 187
A New Algorithm for RNA Secondary Structure Design
Andronescu, M., Fejes, A. P., Hutter, F., Hoos, H. H., & Condon, A. (2004) · Journal of Molecular Biology · doi:10.1016/j.jmb.2003.12.041 · Cited by 179
Quantitative Dimethyl Sulfate Mapping for Automated RNA Secondary Structure Inference
Cordero, P., Kladwang, W., VanLang, C. C., & Das, R. (2012) · Biochemistry · doi:10.1021/bi3008802 · Cited by 153
Self-citationINFO-RNA—a fast approach to inverse RNA folding
Busch, A., & Backofen, R. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl194 · Cited by 151
R NA Secondary Structure Analysis Using the Vienna RNA Package
Hofacker, I. L. (2003) · Current Protocols in Bioinformatics · doi:10.1002/0471250953.bi1202s04 · Cited by 150
Galaxy Zoo: the large-scale spin statistics of spiral galaxies in the Sloan Digital Sky Survey★
Land, K., Slosar, A., Lintott, C., Andreescu, D., Bamford, S., Murray, P., Nichol, R., Raddick, M. J., Schawinski, K., Szalay, A., et al. (2008) · Monthly Notices of the Royal Astronomical Society · doi:10.1111/j.1365-2966.2008.13490.x · Cited by 131
Washietl, S., Hofacker, I. L., Stadler, P. F., & Kellis, M. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks009 · Cited by 124
A two-dimensional mutate-and-map strategy for non-coding RNA structure
Kladwang, W., VanLang, C. C., Cordero, P., & Das, R. (2011) · Nature Chemistry · doi:10.1038/nchem.1176 · Cited by 121
Self-citationGoldberg, M. S., Xing, D., Ren, Y., Oršulić, S., Bhatia, S. N., & Sharp, P. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1016538108 · Cited by 107
Understanding the Errors of SHAPE-Directed RNA Structure Modeling
Kladwang, W., VanLang, C. C., Cordero, P., & Das, R. (2011) · Biochemistry · doi:10.1021/bi200524n · Cited by 95
Self-citationCan Distributed Volunteers Accomplish Massive Data Analysis Tasks
Kanefsky, B., Barlow, N. G., & Gulick, V. C. (2001) · Lunar and Planetary Science Conference · Cited by 91
Cooperative binding of effectors by an allosteric ribozyme
Jose, A. M. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.7.1631 · Cited by 91
HiTRACE: high-throughput robust analysis for capillary electrophoresis
Yoon, S., Kim, J., Hum, J., Kim, H.-J., Park, S., Kladwang, W., & Das, R. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr277 · Cited by 88
Self-citationAn improved algorithm for nucleic acid secondary structure display
Bruccoleri, R. E., & Heinrich, G. (1988) · Computer applications in the biosciences · doi:10.1093/bioinformatics/4.1.167 · Cited by 88
Structural inference of native and partially folded RNA by high-throughput contact mapping
Das, R., Kudaravalli, M., Jonikas, M. A., Laederach, A., Fong, R., Schwans, J. P., Baker, D. A., Piccirilli, J. A., Altman, R. B., & Herschlag, D. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0709032105 · Cited by 83
Self-citationStructural Analysis by Energy Dot Plot of a Large mRNA
Jacobson, A. B., & Zuker, M. (1993) · Journal of Molecular Biology · doi:10.1006/jmbi.1993.1504 · Cited by 79
Massively Parallel RNA Chemical Mapping with a Reduced Bias MAP-Seq Protocol
Seetin, M. G., Kladwang, W., Bida, J. P., & Das, R. (2014) · Methods in Molecular Biology · doi:10.1007/978-1-62703-667-2_6 · Cited by 63 · cited 1×
“39 and 40.”
Self-citationQuarrier, S. O., Martin, J. S., Davis-Neulander, L., Beauregard, A., & Laederach, A. (2010) · RNA · doi:10.1261/rna.1988510 · Cited by 61
Tertiary Motifs Revealed in Analyses of Higher-Order RNA Junctions
Laing, C., Jung, S. C., Iqbal, A., & Tamar Schlick, A. (2009) · Journal of Molecular Biology · doi:10.1016/j.jmb.2009.07.089 · Cited by 54
RNA Challenges for Computational Chemists
Yildirim, I., & Turner, D. H. (2005) · Biochemistry · doi:10.1021/bi051236o · Cited by 50
The Mutate-and-Map Protocol for Inferring Base Pairs in Structured RNA
Cordero, P., Kladwang, W., VanLang, C. C., & Das, R. (2013) · Methods in molecular biology · doi:10.1007/978-1-62703-667-2_4 · Cited by 47
Self-citationMetal-ion rescue revisited: Biochemical detection of site-bound metal ions important for RNA folding
Frederiksen, J. K., Li, N., Das, R., Herschlag, D., & Piccirilli, J. A. (2012) · RNA · doi:10.1261/rna.028738.111 · Cited by 45
Self-citationSquaring theory with practice in RNA design
Bida, J., & Das, R. (2012) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2012.06.003 · Cited by 28
Self-citationGuidelines reduce the risk of brain-scan shock
Pickard, J. D., & Gillard, J. H. (2005) · Nature · doi:10.1038/435017a · Cited by 17
Cited by
Supramolecular Amphiphiles Based on Host–Guest Molecular Recognition Motifs
Yu, G., Jie, K., & Huang, F. (2015) · Chemical Reviews · doi:10.1021/cr5005315 · Cited by 1,025
Insights into RNA structure and function from genome-wide studies
Mortimer, S. A., Kidwell, M. A., & Doudna, J. A. (2014) · Nature Reviews Genetics · doi:10.1038/nrg3681 · Cited by 472
Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28776-w · Cited by 399
Self-citationCombinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2021) · doi:10.1101/2021.03.29.437587 · Cited by 399
Self-citationA single-stranded architecture for cotranscriptional folding of RNA nanostructures
Geary, C., Rothemund, P. W. K., & Andersen, E. S. (2014) · Science · doi:10.1126/science.1253920 · Cited by 361
Metadata
- Authors
- Lee, J., Kladwang, W., Lee, M., Cantu, D., Azizyan, M., Kim, H., Limpaecher, A., Gaikwad, S., Yoon, S., Treuille, A., Das, R., & Participants, E.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2014-01-27
- Volume
- 111
- Issue
- 6
- Pages
- 2122-2127
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W2155871507
- Cited by
- 301
- References
- 50
- FWCI
- 10.71
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.