The Economics of Reproducibility in Preclinical Research
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Low reproducibility rates within life science research undermine cumulative knowledge production and contribute to both delays and costs of therapeutic drug development. An analysis of past studies indicates that the cumulative (total) prevalence of irreproducible preclinical research exceeds 50%, resulting in approximately US$28,000,000,000 (US$28B)/year spent on preclinical research that is not reproducible-in the United States alone. We outline a framework for solutions and a plan for long-term improvements in reproducibility rates that will help to accelerate the discovery of life-saving therapies and cures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Studies reporting the prevalence of irreproducibility. Source: Begley and Ellis [6], Prinz et al. [7], Vasilevsky [8], Hartshorne and Schachner [5], and Glasziou et al. [9].](https://figures.cochat.ai/paper-figures/a30bd9bd65dc4bedb5db19b413eb814f/the-economics-of-reproducibility-in-preclinical-research-figure-1.jpg)
![Fig 2 Estimated US preclinical research spend and categories of errors that contribute to irreproducibility. Note that the percentage value of error for each category is the midpoint of the high and low prevalence estimates for that category divided (weighted) by the sum of all midpoint error rates (see S1 Dataset). Source: Chakma et al. [18] and the American Association for the Advancement of Science (AAAS) [19].](https://figures.cochat.ai/paper-figures/207a0a58df5c4620a819d7aa1f4aa960/the-economics-of-reproducibility-in-preclinical-research-figure-2.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Besides, reliably determining actual translational success rates is unmanageable as long as the current status of reporting of preclinical research leaves room for improvement [89], and non-reproducibility is such a critical issue in both animal [1] and human [90] studies.”
From Animal to human translation: a systematic scoping review of reported concordance rates (2019) · cites this paper as [1]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the field of biomedical research, the majority of incorrect results are estimated to derive from the incorrect use of material standards and experimental reagents [2, 3].”
From Semi-automated fact-checking of nucleotide sequence reagents in biomedical research publications: The Seek & Blastn tool (2019) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The S&B tool therefore directly addresses the larger problem of material reagents and standards representing the major source of incorrect published results from pre-clinical research [3, 4].”
From Semi-automated fact-checking of nucleotide sequence reagents in biomedical research publications: The Seek & Blastn tool (2019) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current drug development is handicapped by high attrition rates; many molecules that were promising during preclinical development fail during subsequent clinical testing [1].”
From Animal to human translation: a systematic scoping review of reported concordance rates (2019) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This observation has been followed by a number of additional reports, the summary of which is, in essence, that 77-90% of biomedical experiments are not reproducible [14-17].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [16]
Experimental — accuracy not yet measured
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Governing the Commons: The Evolution of Institutions for Collective Action
Field, B. C., & Ostrom, E. (1992) · Land Economics · doi:10.2307/3146384 · Cited by 18,859
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 2×
“Source: Begley and Ellis [6], Prinz et al.”
BackgroundBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“[7], Vasilevsky [8], Hartshorne and Schachner [5], and Glasziou et al.”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597 · cited 1×
“However, it is reasonable to state that cumulative errors in the following broad categories—as well as underlying biases that could contribute to each problem area [14] or even result in entire studies never being published or reported [15]—are the primary causes of irreproducibility [16]: (1) study design, (2) biolog…”
BackgroundPolicy: NIH plans to enhance reproducibility
Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035 · cited 1×
“Much has been written about the alarming number of preclinical studies that were later found to be irreproducible [1,2].”
BackgroundBiomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Partial Identification of Probability Distributions
(2003) · Springer Series in Statistics · doi:10.1007/b97478 · Cited by 698
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Research works printed but not linked: 1
- CF Manski, 2003, Springer Series in Statistics, 178
Cited by
Items 801–900 of 1,003
Harald Atmanspacher, A. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118865064.part4 · Cited by 1
Sharing mutations: are biobanks still required in the post-CRISPR/Cas9 era?
Kenyon, J., & Fray, M. (2017) · Mammalian Genome · doi:10.1007/s00335-017-9710-y · Cited by 1
Kolmar, J. F., Thum, O., & Baganz, F. (2017) · Microbial Cell Factories · doi:10.1186/s12934-017-0788-4 · Cited by 1
“Further, despite the significant negative economic impact associated with low reproducibility [14], there are only few studies that report the practicability and reproducibility of standardized scale-down microwell systems for complex applications in industrial biotechnology research.”
BackgroundScholarly triage: Advances in manuscript submission using text analytics techniques
Kasenchak, R. T. (2017) · Information Services & Use · doi:10.3233/isu-170847 · Cited by 1
Araujo, M. A., Graf, R., Maco, M., van Dam, E., Schenker, E., Drinkenburg, P., Koopmans, B., de Boer, S. F., Cullum‐Doyle, M., Noldus, L. P. J. J., et al. (2019) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2019.01.044 · Cited by 1
Harnessing Nature’s Clues for Regeneration, Disease Reversion, and Rejuvenation
Pastor, I. S. (2019) · Springer eBooks · doi:10.1007/978-3-030-16920-6_22 · Cited by 1
Automating the pre-review of research
McIntosh, L. D., & Juehne, A. (2019) · Information Services & Use · doi:10.3233/isu-190048 · Cited by 1
Impact de la phase pré-analytique sur la qualité des échantillons collectés dans les biobanques
Amalfitano, M., Dong, Q., & Keita, A. (2020) · médecine/sciences · doi:10.1051/medsci/2020041 · Cited by 1
Schleif, W. S., Goldenberg, N. A., & Catchpoole, D. R. (2020) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2020.02.068 · Cited by 1
Will improvements in health journalism improve health literacy?
Oransky, I. (2020) · Information Services & Use · doi:10.3233/isu-200081 · Cited by 2
“many studies are not replicable in preclinical medicine, psychology, and other fields [19,20].”
BackgroundIrreproducibility –The deadly sin of preclinical research in drug development
Pillai, S., Kobayashi, K., Michael, M., & Meena, A. (2020) · Journal of Pre-Clinical and Clinical Research · doi:10.26444/jpccr/131017 · Cited by 1
“In the United States, approximately US$28 billion per year is spent on irreproducible preclinical research [5].”
BackgroundBegley, C. G., & Snapinn, S. M. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1782259 · Cited by 1
Open Science and Clinical Psychology
Linthicum, K. P., Southward, M. W., & Schleider, J. L. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00165-5 · Cited by 2
Ehlers, L., Kirchner, M., Mertins, P., Strehl, C., Buttgereit, F., & Gaber, T. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23095049 · Cited by 2
“These failures to validate previous findings cause yearly global costs of about USD 28 billion [3].”
BackgroundBiobanking IT Systems, Database Structure and Web Applications
Mitchell, C., Gramatiuk, S., Sarkisian, T., Kozlakidis, Z., & Sargsyan, K. (2022) · Springer eBooks · doi:10.1007/978-3-030-87637-1_12 · Cited by 1
Lanati, A. (2018) · Springer eBooks · doi:10.1007/978-3-319-76750-5_1 · Cited by 1
Comparative Tasks for Comparative Neurophysiology
Mattfeld, A. T. (2022) · Neuromethods · doi:10.1007/978-1-0716-2631-3_9 · Cited by 1
КРИЗА РЕПЛІКАЦІЇ. СУЧАСНИЙ СТАН РОЗВИТКУ КРИМІНОЛОГІЧНИХ ДОСЛІДЖЕНЬ
KOROSTELOVA, L. A. (2022) · Вісник Луганського державного університету внутрішніх справ імені Е О Дідоренка · doi:10.33766/2524-0323.97.50-58 · Cited by 1
Should we rethink neurodegeneration?
Sipilä, J. (2022) · Exploration of neuroscience · doi:10.37349/en.2022.00006 · Cited by 1
Cannabidiol (CBD) and Its Biological Toxicity: Modelling Preclinical Studies
Dziwenka, M. M., & Coppock, R. W. (2022) · Springer eBooks · doi:10.1007/978-3-030-92392-1_69 · Cited by 1
Promoting Open Science Principles and Primenjena psihologija (Applied Psychology)
Mellor, D. T., & Pajić, D. (2023) · Primenjena psihologija · doi:10.19090/pp.v16i4.2512 · Cited by 1
A survey of open science attitudes and behaviors among US pharmacy faculty
Harpe, S. E. (2025) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2025.10.012 · Cited by 2
Editorial: Reproducibility in Research: A Cautionary Tale and Lessons Not Learned
Schönbrunn, A. (2015) · Molecular Endocrinology · doi:10.1210/me.2015-1209 · Cited by 1
Tuncay, O. C. (2015) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2015.07.016 · Cited by 1
The regulator-executor-phenotype architecture shaped by natural selectionPreprint
Chen, H., Wu, C.-I., & He, X. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/026443 · Cited by 1
False positive results in preclinical research
Angoulvant, D., & Bejan‐Angoulvant, T. (2016) · Therapies · doi:10.1016/j.therap.2016.06.001 · Cited by 1
The Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2835131 · Cited by 2
“[3] Freedman LP, Cockburn IM, Simcoe TS.”
Reliability and Uncertainty in Diffusion MRI Modelling
Charles, C. N. (2016) · The Sydney eScholarship Repository (The University of Sydney) · Cited by 3
TraIT, Translational research IT bridging the valley of death in translational medicinePreprint
Boiten, J., Azevedo, R., van Bochove, K., Cavelaars, M., Dekker, A. L. A. J., Fijneman, R. J. A., Lansberg, P. J., van der Linden, W., Mons, B., Stathonikos, N., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.05.18.052563 · Cited by 1
Increasing the availability of quality human tissue for research
McCarthy, J. (2020) · ALTEX · doi:10.14573/altex.2007141 · Cited by 1
Tools to enable animal to human translation: Assessing the value of disease models
Ferreira, G. S. (2020) · Utrecht University Repository (Utrecht University) · doi:10.33540/157 · Cited by 2
Machine Learning Can Solve the Reproducibility Crisis by Supplanting Reductionist StatisticsPreprint
Sadri, A. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/yxba5 · Cited by 1
Lehmkuhl, M., & Promies, N. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/jszt7 · Cited by 1
Auer, S., Haelterman, N. A. T., Weissgerber, T. L., Erlich, J. C., Susilaradeya, D., Julkowska, M., Gazda, M. A., Abitua, A., Niraulu, A., Shah, A. P., et al. (2020) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/dxw67 · Cited by 2
Being positive about negatives: why publishing negative results is good for veterinary science
Boxer, E. (2024) · Veterinary Record · doi:10.1002/vetr.4362 · Cited by 1
The Replication Crisis: A Persistent Challenge in Biomedical Research
Dagli, N., Haque, M., & Kumar, S. (2024) · Bangladesh Journal of Medical Science · doi:10.3329/bjms.v23i4.76503 · Cited by 2
Oops: A Language for Formalizing Fallible Biological ProtocolsPreprint
Shang, M., Klavins, E., & Bernstein, G. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.17.660245 · Cited by 1
“Irreproducible biomedical research has been estimated to cost $28 billion a year [10].”
Schlögl, M., Waltersdorfer, L., Regner, P., Siposova, A., & Brenning, A. (2025) · doi:10.5194/egusphere-2025-5210 · Cited by 1
Knowledge and attitudes among life scientists towards reproducibility within journal articles.Preprint
Samota, E. K. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.6084/m9.figshare.c.4436912 · Cited by 2
Contaminating the evidence: the reproducibility crisis and fraud in infectious disease research
Watkins, R. R. (2026) · Infection · doi:10.1007/s15010-026-02730-0 · Cited by 1
“It is estimated that approximately 50% of all published research papers cannot be reproduced [1].”
Collaborate and listen to reproduce research
Woolston, C. (2015) · Nature · doi:10.1038/523385f
Algunos aspectos del artículo científico en la Revista Peruana de Biología
Romero, L. (2015) · Revista Peruana de Biología · doi:10.15381/rpb.v22i3.11431
Principles of studying a cell - a non-boastful paper for all molecular biologistsPreprint
Chen, H., & He, X. (2015) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/027680
A failure to reproduce: How bad biomedical science is holding us back
Jaafar, H., & Maweni, R. M. (2016) · F1000Research · doi:10.12688/f1000research.8370.1
“The price we pay A recent study estimated the cost of irreproducible pre-clinical research at 28 billion dollars in the US alone (Freedman et al., 2015).”
BackgroundScience in Congress: Deceptive statistics
Evans, G. K. (2015) · Science · doi:10.1126/science.349.6247.486-c
Engel, F., Walsh, P., Görzig, H., Brocks, H., Heutelbeck, D., Kelly, B., Fuchs, M., & Hemmje, M. (2016) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-319-32703-7_152
Dark Side of Molecular Techniques: How to Fix It ?Preprint
Bhardwaj, V. (2016) · Preprints.org · doi:10.20944/preprints201608.0016.v1
Miller, S. M., Moos, W. H., Munk, B. H., & Munk, S. A. (2016) · Elsevier eBooks · doi:10.1016/b978-0-08-100625-2.00012-x
Lehmkuhl, M. (2016) · Krankenhaushygiene up2date · doi:10.1055/s-0042-119223
Miller, S. M., Moos, W. H., Munk, B. H., & Munk, S. A. (2016) · Elsevier eBooks · doi:10.1016/b978-0-08-100625-2.00001-5
Morrison, J. S., & Hageman, M. J. (2017) · AAPS advances in the pharmaceutical sciences series · doi:10.1007/978-3-319-50042-3_14
Leeder, S. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyx100
“Reports of few new interventions in clinical fields are, rarely, tested by repetition.(3,4) When they are, the null hypothesis is often resurrected.”
BackgroundEnhancing research with Plenary Labs
Sinha, P., Bex, P. J., Kjelgaard, M., & Phillips, F. (2016) · Science and Public Policy · doi:10.1093/scipol/scw051
Cvek, B. (2017) · Health Affairs · doi:10.1377/hlthaff.2017.0803
Lushington, G. H., & Chaguturu, R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-801814-9.00016-7
Statistische Modelle in der Gefäßchirurgie
Mansmann, U. (2017) · Gefässchirurgie · doi:10.1007/s00772-017-0306-3
Development of a multiplexed RNAi-coupled sensor assay to study neuronal function on the large-scale
Herholt, A. (2017) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-6199
Raising the Bar for Cell Line Authentication
Ferreira, M. M. (2017) · Genetic Engineering & Biotechnology News · doi:10.1089/gen.37.20.03
La investigación biomédica en la encrucijada y vías de salida
Pons, J. M. V., & Adam, P. (2018) · Medicina Clínica · doi:10.1016/j.medcli.2017.12.013 · Cited by 2
How Quality Can Improve Reproducibility
Lanati, A. (2018) · Springer eBooks · doi:10.1007/978-3-319-76750-5_2
Hofman, P. M. (2018) · Springer eBooks · doi:10.1007/978-3-319-90563-1_4
Data Reanalysis: Much More Important Than Analysis
Berman, J. J. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-815609-4.00016-9
Occurrence of non-western magic in the European brainPreprint
Koten, J. W., Schüppen, A., Kumar, V., & Wood, G. M. D. O. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/395285
Hollmann, S., Regierer, B., D’Elia, D., Gruden, K., Baebler, Š., Frohme, M., Pfeil, J., Sezerman, O. U., Evelo, C. T., Ehrhart, F., et al. (2018) · EasyChair preprint · doi:10.29007/4xkd
“drawer or on an individual’s hard-drive [3].”
Printing of platinum for use in neural implants
Sullivan, R. P. (2018) · Research Online (University of Wollongong)
Williams, M. J., Mullane, K., & Curtis, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00004-5
Forrester, S. (2019) · Preprints.org · doi:10.20944/preprints201903.0079.v1
“(1) Prioritize funding for team grants and incentivize diversity in team-member career status (early through established investigators).”
BackgroundInfluentialFlügge, F., Figge, L., Duhm-Harbeck, P., Kammler, R., & Habermann, J. K. (2019) · Expert Review of Precision Medicine and Drug Development · doi:10.1080/23808993.2019.1690395 · Cited by 1
“According to the literature, the rates of irreproducible preclinical studies range from ~50% to 90% [45,46].”
BackgroundBiorepositories and their foundation
Simione, F. P., Vines, R. R., & Mullins, T. D. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-815379-6.00029-5
Does the blue bird get the flu? using Twitter for flu surveillance
Grüninger, S. (2017) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-152442
Nuclear Quality Assurance in University Research with Control System Design as a Case Study
Kendrick, J. (2019) · eScholarship (California Digital Library)
Die Reproduzierbarkeitskrise: Bedrohung oder Chance für die Wissenschaft?
Michel, M. C., & Dahm, R. (2020) · Biologie in unserer Zeit · doi:10.1002/biuz.202070202
Incremental science: papers and grants - yes, discoveries - no
Свердлов, Е. Д. (2018) · Molecular Genetics Microbiology and Virology (Russian) · doi:10.17116/molgen201836041168
Indizien für schlechte Forschung und ein Plädoyer
Dubben, H.-H. (2020) · Vandenhoeck & Ruprecht eBooks · doi:10.13109/9783666403965.169
Workshop on reproducibility in research
KALICHMAN, M. W., & Mills, P. J. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.496
“The goal was to produce a program with the following features: (1) highly interactive; (2) pre- and post-testings to monitor impact; (3) independent of the particular area of research for the participants; (4) emphasis on the many different ways in which diverse stakeholders could easily improve the reproducibility of…”
BackgroundScherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.003
Bussooa, A. (2020) · Nanotechnology Science and Applications · doi:10.2147/nsa.s266663
RetractedPerdue, W. L., Reus, V. I., & Yeamans, R. (2020) · medRxiv · doi:10.1101/2020.10.25.20212282
Scheuer, K. S., Hanlon, B. M., Dresel, J. W., Nolan, E. D., Davis, J. C., & Loewe, L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/099192
“…AND FRIESIKE 2014), 1 improve reproducibility (IOANNIDIS 2005b; DONOHO 2009; HUANG AND GOTTARDO 2013; 2 LOEWE AND KEEL 2014; STODDEN et al. 2014; FREEDMAN et al. 2015a; JAMES et al. 2015; 3 STODDEN 2015; BARBA 2016; LOEWE et al. 2016a; LOEWE et al. 2016b), share data 4 (WILKINSON et al. 2016),…”
BackgroundInfluentialIndependent replication of classic trials in neurosurgery: A missing validation practice
Kerr, N., Kerr, J., Sheridan, M. M. P., & Holcombe, A. O. (2020) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2020.10.028
Manifiestos sobre Evaluación Académica
Redes, R. (2020) · Redes Revista de Estudios Sociales de la Ciencia y la Tecnología · doi:10.48160/18517072re49.77
Addison, T. (2020) · Physiology News · doi:10.36866/pn.118.20
Obituary: David Arthur Jones 1943 – 2020
Degens, H., Sargeant, T., Newham, D. J., McPhee, J. S., & Jackson, M. J. (2020) · Physiology News · doi:10.36866/pn.118.51
An interview with John Cripps, our new external trustee
Turan, J. (2020) · Physiology News · doi:10.36866/pn.118.19
Transformative Agreements and the immediate future of Open Access
Stewart, A. (2020) · Physiology News · doi:10.36866/pn.118.12
The bustling world of hormone dynamics: Endocrinology Theme Lead update
Tissier, P. L., & Wells, T. (2020) · Physiology News · doi:10.36866/pn.118.44
Obituary: Michael Berridge 1938 – 2020
Bootman, M. D., Galione, A., & Taylor, C. W. (2020) · Physiology News · doi:10.36866/pn.118.50
Blandinières, F. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3370092
Obituary: Peter Bryan Conrad Matthews 1928 – 2020
Banks, B. (2020) · Physiology News · doi:10.36866/pn.118.49
Ecophysiology and climate change: Shaping our understanding of animal form and function
Trondrud, L. M., & Evans, A. L. (2020) · Physiology News · doi:10.36866/pn.118.26
Editorial: Physiology in the time of coronavirus
Siew, K., & Turan, J. (2020) · Physiology News · doi:10.36866/pn.118.5
The science and art of detecting data manipulation and fraud: An interview with Elisabeth Bik
Turan, J. (2020) · Physiology News · doi:10.36866/pn.118.10
The Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1609.03223 · Cited by 1
“[3] Freedman LP, Cockburn IM, Simcoe TS.”
Multiple-Study Replication Initiatives
Bausell, R. B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197536537.003.0008
On the Value of Biomedical Research and Medical Care
Catillon, M. (2020) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 1
Mesnage, R. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823674-1.00011-0
Metadata
- Authors
- Freedman, L. P., Cockburn, I. M., & Simcoe, T. S.
- Affiliations
- Global Biological Standards Institute (US)
- Boston University (US)
- Corresponding author
- Freedman, Leonard P.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-06-09
- Volume
- 13
- Issue
- 6
- Pages
- e1002165
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC4461318
- OpenAlex
- W585341442
- Cited by
- 1,055
- References
- 35
- Citations by year
- 2026: 48 · 2025: 45 · 2024: 69 · 2023: 92 · 2022: 93 · 2021: 96 · 2020: 142 · 2019: 116 · 2018: 109 · 2017: 93 · 2016: 103 · 2015: 49
- FWCI
- 188.58
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-04-10)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- OpenBU (Boston University) (submittedVersion, cc-by)
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Keywords
- reproducibility, preclinical research, research costs, research waste, reproducibility framework
- MeSH terms
- Reproducibility of Results, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.