The DOI matches its Crossref record.
Journals unite for reproducibility
Abstract
Reproducibility, rigor, transparency, and independent verification are cornerstones of the scientific method. Of course, just because a result is reproducible does not necessarily make it right, and just because it is not reproducible does not necessarily make it wrong. A transparent and rigorous approach, however, can almost always shine a light on issues of reproducibility. This light ensures that science moves forward, through independent verifications as well as the course corrections that come from refutations and the objective examination of the resulting data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Radiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Experimental design and analysis and their reporting: new guidance for publication in BJP
Curtis, M. J., Bond, R. A., Spina, D., Ahluwalia, A., Alexander, S. P. A., Giembycz, M. A., Gilchrist, A., Hoyer, D., Insel, P. A., Izzo, A. A., et al. (2015) · British Journal of Pharmacology · doi:10.1111/bph.12856 · Cited by 1,033
The fickle P value generates irreproducible results
Halsey, L. G., Curran-Everett, D., Vowler, S. L., & Drummond, G. B. (2015) · Nature Methods · doi:10.1038/nmeth.3288 · Cited by 765
Best practices in data analysis and sharing in neuroimaging using MRI
Nichols, T. E., Das, S., Eickhoff, S. B., Evans, A. C., Glatard, T., Hanke, M., Kriegeskorte, N., Milham, M. P., Poldrack, R. A., Poline, J.-B., et al. (2017) · Nature Neuroscience · doi:10.1038/nn.4500 · Cited by 714
FRET as a biomolecular research tool — understanding its potential while avoiding pitfalls
Algar, W. R., Hildebrandt, N., Vogel, S. S., & Medintz, I. L. (2019) · Nature Methods · doi:10.1038/s41592-019-0530-8 · Cited by 609
Unique in the shopping mall: On the reidentifiability of credit card metadata
de Montjoye, Y.-A., Radaelli, L., Singh, V. K., & Pentland, A. “. (2015) · Science · doi:10.1126/science.1256297 · Cited by 570
Power Analysis for Parameter Estimation in Structural Equation Modeling: A Discussion and Tutorial
Wang, Y. A., & Rhemtulla, M. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920918253 · Cited by 544
Reproducibility of animal research in light of biological variation
Voelkl, B., Altman, N. S., Forsman, A., Forstmeier, W., Gurevitch, J., Jaric, I., Karp, N. A., Kas, M. J., Schielzeth, H., Van de Casteele, T., et al. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0313-3 · Cited by 390
Sala, E., Mema, E., Himoto, Y., Veeraraghavan, H., Brenton, J. D., Snyder, A., Weigelt, B., & Vargas, H. A. (2017) · Clinical Radiology · doi:10.1016/j.crad.2016.09.013 · Cited by 369
Risk of bias in reports of in vivo research: a focus for improvement
Macleod, M. R., Lawson McLean, A., Kyriakopoulou, A., Serghiou, S., de Wilde, A., Sherratt, N., Hirst, T., Hemblade, R., Bahor, Z., Nunes-Fonseca, C., et al. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002273 · Cited by 358
The importance of open data and software: Is energy research lagging behind?
Pfenninger, S., DeCarolis, J., Hirth, L., Quoilin, S., & Staffell, I. (2017) · Energy Policy · doi:10.1016/j.enpol.2016.11.046 · Cited by 335
Raso, J., Frey, W., Ferrari, G., Pataro, G., Knorr, D., Teissie, J., & Miklavčič, D. (2016) · Innovative Food Science & Emerging Technologies · doi:10.1016/j.ifset.2016.08.003 · Cited by 318
Trust, but Verify II: A Practical Guide to Chemogenomics Data Curation
Fourches, D., Muratov, E., & Tropsha, A. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00129 · Cited by 294
Nakayasu, E. S., Gritsenko, M., Piehowski, P. D., Gao, Y., Orton, D. J., Schepmoes, A. A., Fillmore, T. L., Frohnert, B. I., Rewers, M., Krischer, J. P., et al. (2021) · Nature Protocols · doi:10.1038/s41596-021-00566-6 · Cited by 275
pcaExplorer: an R/Bioconductor package for interacting with RNA-seq principal components
Marini, F., & Binder, H. (2019) · BMC Bioinformatics · doi:10.1186/s12859-019-2879-1 · Cited by 271
Considering aspects of the 3Rs principles within experimental animal biology
Sneddon, L. U., Halsey, L. G., & Bury, N. R. (2017) · Journal of Experimental Biology · doi:10.1242/jeb.147058 · Cited by 254
Llovera, G., Hofmann, K., Roth, S., Salas-Pérdomo, A., Ferrer-Ferrer, M., Perego, C., Zanier, E. R., Mamrak, U., Rex, A., Party, H., et al. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aaa9853 · Cited by 253
Pineau, J., Vincent-Lamarre, P., Sinha, K., Larivière, V., Beygelzimer, A., d'Alché-Buc, F., Fox, E., & Larochelle, H. (2020) · arXiv · doi:10.48550/arxiv.2003.12206 · Cited by 232
The case for formal methodology in scientific reform
Devezer, B., Navarro, D. J., Vandekerckhove, J., & Buzbas, E. O. (2020) · doi:10.1101/2020.04.26.048306 · Cited by 195
Fixing problems with cell lines
Lorsch, J. R., Collins, F. S., & Lippincott-Schwartz, J. (2014) · Science · doi:10.1126/science.1259110 · Cited by 179
Assessment of transparency indicators across the biomedical literature: How open is open?
Serghiou, S., Contopoulos-Ioannidis, D. G., Boyack, K. W., Riedel, N., Wallach, J. D., & Ioannidis, J. P. A. (2021) · PLOS Biology · doi:10.1371/journal.pbio.3001107 · Cited by 139
Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps
Jarvis, M. F., & Williams, M. (2016) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2015.12.001 · Cited by 129
Never waste a good crisis: confronting reproducibility in translational research
Drucker, D. J. (2016) · Cell Metabolism · doi:10.1016/j.cmet.2016.08.006 · Cited by 117
Nakagawa, S., & Parker, T. H. (2015) · BMC Biology · doi:10.1186/s12915-015-0196-3 · Cited by 110
Reproducibility and replicability: opportunities and challenges for geospatial research
Kedron, P., Li, W., Fotheringham, S., & Goodchild, M. (2021) · International Journal of Geographical Information Science · doi:10.1080/13658816.2020.1802032 · Cited by 108
Macleod, M., Collings, A. M., Graf, C., Kiermer, V., Mellor, D., Swaminathan, S., Sweet, D., & Vinson, V. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2103238118 · Cited by 77
The Stroke Preclinical Assessment Network: Rationale, Design, Feasibility, and Stage 1 Results
Lyden, P. D., Bosetti, F., Diniz, M. A., Rogatko, A., Koenig, J. I., Lamb, J., Nagarkatti, K. A., Cabeen, R. P., Hess, D. C., Kamat, P. K., et al. (2022) · Stroke · doi:10.1161/strokeaha.121.038047 · Cited by 73
The researchers’ view of scientific rigor—survey on the conduct and reporting of in vivo research
Reichlin, T. S., Vogt, L., & Würbel, H. (2016) · PLOS ONE · doi:10.1371/journal.pone.0165999 · Cited by 72
Aligning physiology with psychology: Translational neuroscience in neuropsychiatric drug discovery
McArthur, R. A. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.004 · Cited by 42
Reporting standards for preclinical studies of stroke therapy
Vahidy, F., Schäbitz, W.-R., Fisher, M., & Aronowski, J. (2016) · Stroke · doi:10.1161/strokeaha.116.013643 · Cited by 39
Evidence appraisal: a scoping review, conceptual framework, and research agenda
Goldstein, A., Venker, E., & Weng, C. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx050 · Cited by 30
Framework for advancing rigorous research
Koroshetz, W. J., Behrman, S., Brame, C. J., Branchaw, J. L., Brown, E. N., Clark, E. A., Dockterman, D., Elm, J. J., Gay, P. L., Green, K. M., et al. (2020) · eLife · doi:10.7554/elife.55915 · Cited by 28
From methods to monographs: fostering a culture of research quality
Crawford, D. C., Hoye, M. L., & Silberberg, S. D. (2023) · eneuro · doi:10.1523/eneuro.0247-23.2023 · Cited by 25
Improving the reliability of peer-reviewed publications: We are all in it together
Bustin, S. A., & Nolan, T. (2016) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.11.002 · Cited by 22
Better reporting for better research: a checklist for reproducibility
Kenall, A., Edmunds, S., Goodman, L., Bal, L., Flintoft, L., Shanahan, D. R., & Shipley, T. (2015) · GigaScience · doi:10.1186/s13742-015-0071-8 · Cited by 15
Zarezadeh, M. (2020) · European Journal of Clinical Nutrition · doi:10.1038/s41430-020-0586-7 · Cited by 3
Metadata
- Authors
- McNutt, M.
- Venue
- Science
- Published
- 2014-11-07
- Volume
- 346
- Issue
- 6210
- Pages
- 679-679
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2041179993
- Cited by
- 300
- References
- 0
- FWCI
- 85.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.