The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Avoiding False Positive Conclusions in Molecular Simulation: The Importance of Replicas
Open accessAbstract
Molecular simulations are a computational technique used to investigate the dynamics of proteins and other molecules. The free energy landscape of these simulations is often rugged, and minor differences in the initial velocities, floating-point precision, or underlying hardware can cause identical simulations (replicas) to take different paths in the landscape. In this study we investigated the magnitude of these effects based on 310 000 ns of simulation time. We performed 100 identically parametrized replicas of 3000 ns each for a small 10 amino acid system as well as 100 identically parametrized replicas of 100 ns each for an 827 residue T-cell receptor/MHC system. Comparing randomly chosen subgroups within these replica sets, we estimated the reproducibility and reliability that can be achieved by a given number of replicas at a given simulation time. These results demonstrate that conclusions drawn from single simulations are often not reproducible and that conclusions drawn from multiple shorter replicas are more reliable than those from a single longer simulation. The actual number of replicas needed will always depend on the question asked and the level of reliability sought. On the basis of our data, it appears that a good rule of thumb is to perform a minimum of five to 10 replicas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
VMD: visual molecular dynamics
Humphrey, W., Dalke, A., & Schulten, K. (1996) · Journal of Molecular Graphics · doi:10.1016/0263-7855(96)00018-5 · Cited by 66,952
Berman, H. M. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.235 · Cited by 40,196
AutoDock4 and AutoDockTools4: Automated docking with selective receptor flexibility
Morris, G. M., Huey, R., Lindstrom, W., Sanner, M. F., Belew, R. K., Goodsell, D. S., & Olson, A. J. (2009) · Journal of Computational Chemistry · doi:10.1002/jcc.21256 · Cited by 25,486
Canonical sampling through velocity rescaling
Bussi, G., Donadio, D., & Parrinello, M. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2408420 · Cited by 18,089
GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation
Hess, B., Kutzner, C., van der Spoel, D., & Lindahl, E. (2008) · Journal of Chemical Theory and Computation · doi:10.1021/ct700301q · Cited by 15,908
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“32 The use of replicas to increase reproducibility and reliability is a standard method in many areas of research, including clinical trials, 33 gene expression analysis, 34 and experimental design.”
MethodOostenbrink, C., Villa, A., Mark, A. E., & Van Gunsteren, W. F. (2004) · Journal of Computational Chemistry · doi:10.1002/jcc.20090 · Cited by 3,719
Molecular dynamics simulations of biomolecules
Karplus, M., & McCammon, J. A. (2002) · Nature Structural Biology · doi:10.1038/nsb0902-646 · Cited by 3,386
THEORY OF PROTEIN FOLDING: The Energy Landscape Perspective
Onuchic, J. N., Luthey-Schulten, Z., & Wolynes, P. G. (1997) · Annual Review of Physical Chemistry · doi:10.1146/annurev.physchem.48.1.545 · Cited by 2,210
How fast-folding proteins fold
Lindorff-Larsen, K., Piana, S., Dror, R. O., & Shaw, D. E. (2011) · Science · doi:10.1126/science.1208351 · Cited by 1,980
Improved prediction of protein side‐chain conformations with SCWRL4
Krivov, G. G., Shapovalov, M. V., & Dunbrack, R. L. (2009) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.22488 · Cited by 1,301
Mature HIV-1 capsid structure by cryo-electron microscopy and all-atom molecular dynamics
Zhao, G., Perilla, J. R., Yufenyuy, E. L., Meng, X., Chen, B., Ning, J., Ahn, J., Gronenborn, A. M., Schulten, K., Aiken, C., et al. (2013) · Nature · doi:10.1038/nature12162 · Cited by 801
Mechanisms for T cell receptor triggering
van der Merwe, P. A., & Dushek, O. (2011) · Nature Reviews Immunology · doi:10.1038/nri2887 · Cited by 482
A Structural Basis for the Selection of Dominant αβ T Cell Receptors in Antiviral Immunity
Kjer-Nielsen, L., Clements, C. S., Purcell, A. W., Brooks, A. G., Whisstock, J. C., Burrows, S. R., McCluskey, J., & Rossjohn, J. (2003) · Immunity · doi:10.1016/s1074-7613(02)00513-7 · Cited by 323
Chapter 2 Quantifying Uncertainty and Sampling Quality in Biomolecular Simulations
Grossfield, A., & Zuckerman, D. M. (2009) · Annual Reports in Computational Chemistry · doi:10.1016/s1574-1400(09)00502-7 · Cited by 312
Frontiers in Molecular Dynamics Simulations of DNA
Pérez, A., Luque, F. J., & Orozco, M. (2012) · Accounts of Chemical Research · doi:10.1021/ar2001217 · Cited by 214
Crystal Structure of a Ten-Amino Acid Protein
Honda, S., Akiba, T., Kato, Y. S., Sawada, Y., Sekijima, M., Ishimura, M., Ooishi, A., Watanabe, H., Odahara, T., & Harata, K. (2008) · Journal of the American Chemical Society · doi:10.1021/ja8030533 · Cited by 188
Characterization of Variability in Large-Scale Gene Expression Data: Implications for Study Design
Novak, J. P., Sladek, R., & Hudson, T. J. (2002) · Genomics · doi:10.1006/geno.2001.6675 · Cited by 184
Galindo-Murillo, R., Roe, D. R., & Cheatham, T. E. (2015) · Biochimica et Biophysica Acta (BBA) - General Subjects · doi:10.1016/j.bbagen.2014.09.007 · Cited by 169
Tuning Cytokine Receptor Signaling by Re-orienting Dimer Geometry with Surrogate Ligands
Moraga, I., Wernig, G., Wilmes, S., Gryshkova, V., Richter, C. P., Hong, W.-J., Sinha, R., Guo, F., Fabionar, H., Wehrman, T. S., et al. (2015) · Cell · doi:10.1016/j.cell.2015.02.011 · Cited by 167
Computing Clinically Relevant Binding Free Energies of HIV-1 Protease Inhibitors
Wright, D. W., Hall, B. A., Kenway, O. A., Jha, S., & Coveney, P. V. (2014) · Journal of Chemical Theory and Computation · doi:10.1021/ct4007037 · Cited by 143
Wan, S., Knapp, B., Wright, D. W., Deane, C. M., & Coveney, P. V. (2015) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5b00179 · Cited by 140
Self-citationBergonzo, C., Henriksen, N. M., Roe, D. R., Swails, J., Roitberg, A. E., & Cheatham, T. E. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct400862k · Cited by 127
Mirza, M. U., Rafique, S., Ali, A., Munir, M., Ikram, N., Manan, A., Salo‐Ahen, O. M. H., & Idrees, M. (2016) · Scientific Reports · doi:10.1038/srep37313 · Cited by 124
Sample Size Calculation in Clinical Trials
Röhrig, B., du Prel, J., Wachtlin, D., Kwiecien, R., & Blettner, M. (2010) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2010.0552 · Cited by 115
Marsili, S., Signorini, G. F., Chelli, R., Marchi, M., & Procacci, P. (2009) · Journal of Computational Chemistry · doi:10.1002/jcc.21388 · Cited by 91
vmdICE: A plug‐in for rapid evaluation of molecular dynamics simulations using VMD
Knapp, B., Lederer, N., Omasits, U., & Schreiner, W. (2010) · Journal of Computational Chemistry · doi:10.1002/jcc.21581 · Cited by 63
Self-citationCurrent status and future challenges in T-cell receptor/peptide/MHC molecular dynamics simulations
Knapp, B., Demharter, S., Esmaielbeiki, R., & Deane, C. M. (2015) · Briefings in Bioinformatics · doi:10.1093/bib/bbv005 · Cited by 52
Self-citationWan, S., Flower, D. R., & Coveney, P. V. (2007) · Molecular Immunology · doi:10.1016/j.molimm.2007.09.022 · Cited by 52
Modeling and design by hierarchical natural moves
Sim, A. Y. L., Levitt, M., & Mináry, P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1119918109 · Cited by 43
Probing Protein Fold Space with a Simplified Model
Mináry, P., & Levitt, M. (2007) · Journal of Molecular Biology · doi:10.1016/j.jmb.2007.10.087 · Cited by 39
A critical cross-validation of high throughput structural binding prediction methods for pMHC
Knapp, B., Omasits, U., Frantal, S., & Schreiner, W. (2009) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-009-9259-2 · Cited by 38
Self-citationYokoyama, M., Fujisaki, S., Shirakura, M., Watanabe, S., Odagiri, T., Ito, K., & Sato, H. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.00584 · Cited by 37
Zhang, J., Mináry, P., & Levitt, M. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1205945109 · Cited by 35
Knapp, B., Dunbar, J., & Deane, C. M. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003748 · Cited by 33
Self-citationTraining-free atomistic prediction of nucleosome occupancy
Mináry, P., & Levitt, M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404475111 · Cited by 29
Zhang, H., Lim, H.-S., Knapp, B., Deane, C. M., Aleksic, M., Dushek, O., & van der Merwe, P. A. (2016) · Scientific Reports · doi:10.1038/srep35326 · Cited by 29
Self-citationT-Cell Receptor Binding Affects the Dynamics of the Peptide/MHC-I Complex
Knapp, B., & Deane, C. M. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00511 · Cited by 28
Self-citationKnapp, B., Dunbar, J., Alcala, M., & Deane, C. M. (2017) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.7b00080 · Cited by 25
Self-citationGro2mat: A package to efficiently read gromacs output in MATLAB
Dien, H., Deane, C. M., & Knapp, B. (2014) · Journal of Computational Chemistry · doi:10.1002/jcc.23650 · Cited by 23
Self-citationExploring peptide/MHC detachment processes using hierarchical natural move Monte Carlo
Knapp, B., Demharter, S., Deane, C. M., & Mináry, P. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv502 · Cited by 21
Self-citationTransmembrane helical interactions in the CFTR channel pore
Das, J., Aleksandrov, A. A., Cui, L., He, L., Riordan, J. R., & Dokholyan, N. V. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005594 · Cited by 10
Modeling Functional Motions of Biological Systems by Customized Natural Moves
Demharter, S., Knapp, B., Deane, C. M., & Mináry, P. (2016) · Biophysical Journal · doi:10.1016/j.bpj.2016.06.028 · Cited by 7
Self-citationIn silico structural modeling of multiple epigenetic marks on DNA
Krawczyk, K., Demharter, S., Knapp, B., Deane, C. M., & Mináry, P. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx516 · Cited by 7
Self-citation
Cited by
In Silico Modeling and Scoring of PROTAC-Mediated Ternary Complex Poses
Liao, J., Nie, X., Unarta, I. C., Ericksen, S. S., & Tang, W. (2022) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.1c02155 · Cited by 62
EnzyHTP: A High-Throughput Computational Platform for Enzyme Modeling
Shao, Q., Jiang, Y., & Yang, Z. J. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c01424 · Cited by 43
Crean, R. M., Slusky, J. S. G., Kasson, P. M., & Kamerlin, S. C. L. (2023) · The Journal of Chemical Physics · doi:10.1063/5.0140882 · Cited by 30
Metadata
- Authors
- Knapp, B., Ospina, L., & Deane, C. M.
- Venue
- Journal of Chemical Theory and Computation
- Publisher
- American Chemical Society (ACS)
- Published
- 2018-10-24
- Volume
- 14
- Issue
- 12
- Pages
- 6127-6138
- ISSN
- 1549-9618 (ISSN-L)
- 1549-9626
- OpenAlex
- W2898119186
- Cited by
- 344
- References
- 45
- FWCI
- 6.83
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.