The Economics of Reproducibility in Preclinical Research
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Low reproducibility rates within life science research undermine cumulative knowledge production and contribute to both delays and costs of therapeutic drug development. An analysis of past studies indicates that the cumulative (total) prevalence of irreproducible preclinical research exceeds 50%, resulting in approximately US$28,000,000,000 (US$28B)/year spent on preclinical research that is not reproducible-in the United States alone. We outline a framework for solutions and a plan for long-term improvements in reproducibility rates that will help to accelerate the discovery of life-saving therapies and cures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Studies reporting the prevalence of irreproducibility. Source: Begley and Ellis [6], Prinz et al. [7], Vasilevsky [8], Hartshorne and Schachner [5], and Glasziou et al. [9].](https://figures.cochat.ai/paper-figures/a30bd9bd65dc4bedb5db19b413eb814f/the-economics-of-reproducibility-in-preclinical-research-figure-1.jpg)
![Fig 2 Estimated US preclinical research spend and categories of errors that contribute to irreproducibility. Note that the percentage value of error for each category is the midpoint of the high and low prevalence estimates for that category divided (weighted) by the sum of all midpoint error rates (see S1 Dataset). Source: Chakma et al. [18] and the American Association for the Advancement of Science (AAAS) [19].](https://figures.cochat.ai/paper-figures/207a0a58df5c4620a819d7aa1f4aa960/the-economics-of-reproducibility-in-preclinical-research-figure-2.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“Besides, reliably determining actual translational success rates is unmanageable as long as the current status of reporting of preclinical research leaves room for improvement [89], and non-reproducibility is such a critical issue in both animal [1] and human [90] studies.”
From Animal to human translation: a systematic scoping review of reported concordance rates (2019) · cites this paper as [1]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In the field of biomedical research, the majority of incorrect results are estimated to derive from the incorrect use of material standards and experimental reagents [2, 3].”
From Semi-automated fact-checking of nucleotide sequence reagents in biomedical research publications: The Seek & Blastn tool (2019) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The S&B tool therefore directly addresses the larger problem of material reagents and standards representing the major source of incorrect published results from pre-clinical research [3, 4].”
From Semi-automated fact-checking of nucleotide sequence reagents in biomedical research publications: The Seek & Blastn tool (2019) · cites this paper as [3]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current drug development is handicapped by high attrition rates; many molecules that were promising during preclinical development fail during subsequent clinical testing [1].”
From Animal to human translation: a systematic scoping review of reported concordance rates (2019) · cites this paper as [1]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This observation has been followed by a number of additional reports, the summary of which is, in essence, that 77-90% of biomedical experiments are not reproducible [14-17].”
From Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition) (2021) · cites this paper as [16]
Experimental — accuracy not yet measured
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Governing the Commons: The Evolution of Institutions for Collective Action
Field, B. C., & Ostrom, E. (1992) · Land Economics · doi:10.2307/3146384 · Cited by 18,859
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 2×
“Source: Begley and Ellis [6], Prinz et al.”
BackgroundBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“[7], Vasilevsky [8], Hartshorne and Schachner [5], and Glasziou et al.”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597 · cited 1×
“However, it is reasonable to state that cumulative errors in the following broad categories—as well as underlying biases that could contribute to each problem area [14] or even result in entire studies never being published or reported [15]—are the primary causes of irreproducibility [16]: (1) study design, (2) biolog…”
BackgroundPolicy: NIH plans to enhance reproducibility
Collins, F. S., & Tabak, L. A. (2014) · Nature · doi:10.1038/505612a · Cited by 1,247
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035 · cited 1×
“Much has been written about the alarming number of preclinical studies that were later found to be irreproducible [1,2].”
BackgroundBiomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Partial Identification of Probability Distributions
(2003) · Springer Series in Statistics · doi:10.1007/b97478 · Cited by 698
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Research works printed but not linked: 1
- CF Manski, 2003, Springer Series in Statistics, 178
Cited by
Items 901–1,000 of 1,003
Public–Private Partnership in Biobanking: The Model of the BBMRI-ERIC Expert Centre
Abuja, P. M., & Zatloukal, K. (2021) · Springer eBooks · doi:10.1007/978-3-030-55901-4_10
Why Do We Need a Statistical Experiment Design?
Parkinson, M., & Sorzano, C. Ó. S. (2020) · Laboratory animal science and medicine · doi:10.1007/978-3-030-66147-2_6 · Cited by 1
Dealing with Failure and Stress in Academic Research
Schmidt, B. Z. (2021) · Springer eBooks · doi:10.1007/978-3-030-85571-0_6
Bettin, R. (2021) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/y94gu
Comment restaurer la compétitivité de la recherche française en biologie-santé ?
Catillon, M. (2021) · Revue d économie financière · doi:10.3917/ecofi.143.0123
Sáez-Rodríguez, J. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.733769287.793563721
Subjectivity, Truth, and Theological Anthropology
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.009
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.001
The Practices Shaping the Entrepreneurial Subject
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.006
Acquiring the Virtue of Truth-Speaking in Science
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.008
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.011
Teleology and the Craft of Science
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.005
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.004
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.010
Reshaping the Entrepreneurial Subject of Science
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.007
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.002
Hermans, K. C. M. (2016) · Research Publications (Maastricht University) · doi:10.26481/dis.20160511kh
The Role of the Engineer and Technology in Healthcare
Vienken, J. (2022) · Research for development · doi:10.1007/978-3-030-85653-3_2
Bhandari, V. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.736952686.793576202
Cannabidiol (CBD) and Its Biological Toxicity: Modelling Preclinical Studies
Dziwenka, M. M., & Coppock, R. W. (2022) · Springer eBooks · doi:10.1007/978-3-030-67928-6_69-1
Stukalin, Y., Lan, A., & Einat, H. (2019) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2019.09.420
de Winter, J., & Dodou, D. (2017) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-319-56964-2_3
Morita, M., & Toyooka, S. (2016) · Okayama Igakkai Zasshi (Journal of Okayama Medical Association) · doi:10.4044/joma.128.237
BJOHNS, E.-I.-C. (2019) · Bengal Journal of Otolaryngology and Head Neck Surgery · doi:10.47210/bjohns.2019.v27i2.274
Veening-Griffioen, D. H. (2020) · ALTEX · doi:10.14573/altex.2003301s2
(2015) · BioTechniques · doi:10.2144/000114335
Baldwin, A., Schroeder, K., Singh, L., & Billeci, K. L. (2017) · Wiley eBooks · doi:10.1002/9781119384434.ch9
Williams, M., Curtis, M. J., & Mullane, K. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00010-0
Almgren, H., Parsons, N., Bossche, S. V. D., & Marinazzo, D. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/9hg3j
Quelle est la qualité de la recherche médicale?
(2015) · Bulletin des Médecins Suisses · doi:10.4414/bms.2015.04171
BJOHNS, E.-I.-C. (2019) · Bengal Journal of Otolaryngology and Head Neck Surgery · doi:10.47210/bjohns.2019.v27i1.273
Veening-Griffioen, D. H. (2020) · ALTEX · doi:10.14573/altex.2003301s1
(2017) · Elsevier eBooks · doi:10.1016/b978-0-12-805070-5.16001-1
Lash, G. E. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.730111372.793558458
Scherz, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108593694.012
Interfacing the Pig Cortex - Towards a Translational Large Animal Model of LTP-Like Pain
Janjua, T. A. M. (2021) · VBN Forskningsportal (Aalborg Universitet) · doi:10.54337/aau468595795
“Clinical trials highlight a failure to translate drug effects with human subjects during drug development, possibly due to the difference in complexity between rodents and humans (Freedman et al., 2015).”
BackgroundThe Reproducibility Crisis and Autism Spectrum Research
Bennett, M., & Goodall, E. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80382-463-520221011
Plataformes avançades en el Núvol per a la reproductibilitat d'experiments computacionals
Giménez-Alventosa, V. (2022) · RiuNet (Universitat Politècnica de València) · doi:10.4995/thesis/10251/184010
Naranjo, A. R. C. (2021) · Repositorio Institucional (Pontificia Universidad Javeriana) · doi:10.11144/javeriana.10554.56968
Quality and Performance Improvement
Balas, E. A. (2018) · Wiley eBooks · doi:10.1002/9781119225898.ch20
Perdue, W. L., Reus, V. I., van Breemen, R. B., Muchiri, R. N., & Yeamans, R. (2022) · medRxiv · doi:10.1101/2022.08.09.22278588
Interpreting and Implementing Evidence for Quality Research
Cahan, E. M., & Shea, K. G. (2022) · Springer eBooks · doi:10.1007/978-3-031-07105-8_13
Reducing Networks of Ethnographic Codes Co-occurrence in Anthropology
Cottica, A., Davidov, V. M., Góralska, M., Kubík, J., Mélançon, G., Mole, R. C. M., Pinaud, B., & Szymański, W. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-31726-2_4
How to Mitigate Unintentional Misconduct with Samples and Data in Biorepositories
Simeon‐Dubach, D., & Kozlakidis, Z. (2022) · Springer eBooks · doi:10.1007/978-3-030-99680-2_46
Seveljevic-Jaran, D., Antolić, M., Ognjenović, A., Kalliokoski, O., Abelson, K., & Hau, J. (2023) · In Vivo · doi:10.21873/invivo.13060
Choice of Research Topic – A Question of Taking Societal Responsibility
Slotfeldt‐Ellingsen, D. (2023) · Springer eBooks · doi:10.1007/978-3-031-25484-0_6
Bennett, M. (2023) · Springer eBooks · doi:10.1007/978-981-19-9240-7_1
Miller, S. M., Moos, W. H., Munk, B. H., Munk, S. A., Hart, C. P., & Spellmeyer, D. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-824304-6.00003-1
Research and discovery: Essential partners but just a start
Miller, S. M., Moos, W. H., Munk, B. H., Munk, S. A., Hart, C. P., & Spellmeyer, D. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-824304-6.00011-0
Doctoral and professional programs
Miller, S. M., Moos, W. H., Munk, B. H., Munk, S. A., Hart, C. P., & Spellmeyer, D. C. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-824304-6.00013-4 · Cited by 1
TOOLS FOR A SEARCHABLE AND TRACEABLE CURATED DATABASE
Brochu, F. M., Chrubasik, M., & Thomas, S. A. (2022) · IMEKO TC6 Conference on Digitalization (M4DConf) · doi:10.21014/tc6-2022.002
Cottica, A., Davidov, V. M., Góralska, M., Kubík, J., Mélançon, G., Mole, R. C. M., Pinaud, B., & Szymański, W. (2023) · Applied Network Science · doi:10.1007/s41109-023-00547-6 · Cited by 2
“But there are others: for example, it is claimed that half of the total expenditure on pre-clinical research in the US goes towards non-replicable studies (Freedman et al. 2015).”
BackgroundHow naïve is your naïve subject? The behavior of rodents under a social lensPreprint
de la Fuente, V. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3mjnt
Cobey, K. D., Fehlmann, C. A., Franco, M. C., Ayala, A. P., Sikora, L., Rice, D. B., Xu, C., Ioannidis, J. P. A., Lalu, M. M., Ménard, A., et al. (2022) · eLife · doi:10.7554/elife.78518.sa2
Reproduzierbare und replizierbare Forschung
Hoffmann, S., Scheipl, F., & Boulesteix, A. (2023) · Springer eBooks · doi:10.1007/978-3-662-63496-7_25-1 · Cited by 1
REFLEXÕES EDUCATIVAS SOBRE A CRISE DE REPRODUTIBILIDADE DAS PESQUISAS BIOMÉDICAS
Ferrari, C. K. B. (2023) · LEOPOLDIANUM · doi:10.58422/releo2023.e1399
Empirical and Translational Pilots
Reynolds, P. S. (2023) · Wiley eBooks · doi:10.1002/9781119800002.ch6
The Design and Statistical Analysis of Randomized Pre-clinical Experiments
Festing, M. F. W. (2023) · Springer eBooks · doi:10.1007/978-981-99-1284-1_28
Cryopreservation and utility of cancer organoids and cartilage microtissues
Shajib, M. S. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.244762
Differences in enteric neuronal density in the NSE-Noggin mouse model across institutes
Schonkeren, S. L., Thijssen, M. S., Idris, M., Wouters, K., de Vaan, J., Teubner, A., Gijbels, M. J., Boesmans, W., & Melotte, V. (2024) · Scientific Reports · doi:10.1038/s41598-024-54337-w · Cited by 1
“It has been estimated that over 50% of preclinical studies, i.e. animals studies, are irreproducible 19 due to weaknesses in study design, such as lack of blinding and randomization, or because of equipment or procedural differences between laboratories 20 .”
Implementation of the EQIPD Quality System
Gerlach, B., Meinhardt, M. W., & Kas, M. J. (2024) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2024.110084
“Preclinical and basic research has been criticized for some years for producing unreproducible data (Bishop, 2019; Freedman et al., 2015; Voelkl et al., 2020).”
BackgroundClosed-chest occlusion of the left anterior descending artery in swine infarction model
Kőrösi, D., Vorobcsuk, A., Fajtai, D., Tátrai, O., Bodor, E., & Garamvölgyi, R. (2023) · Acta Agraria Kaposváriensis · doi:10.31914/aak.3423
Chavarria, C. G. D. A., & Dela-Sávia, S. (2023) · INSTANTE · doi:10.18391/ri.v5i2.2736
Sikorski, M., & Hominis, O. (2024) · Philosophical Psychology · doi:10.1080/09515089.2024.2330477
“…problematic (see e.g., National Academies of Sciences, & Medicine, 2019), but also potentially responsible for both a significant waste of resources (Freedman et al., 2015) and a decline in the confidence that society at large places in scientific findings (see e.g., Anvari & Lakens, 2018).”
Osteopathie und evidenzbasierte Medizin, Teil 2: Kritik an der EBM
Luthin, D. (2024) · DO - Deutsche Zeitschrift für Osteopathie · doi:10.1055/a-2220-8344
“Reproduzierbarkeit wird unterschiedlich definiert [25–27] und bedeutet im Kontext dieser Veröffentlichung die Mög - lichkeit, anhand der publizierten Daten die Studie repli-zieren oder reanalysieren zu können [28], wobei eine vollständige Reproduzierbarkeit nur schwer erreichbar ist [29].”
Bayesian Methods: A Means of Improving Statistical Power in Preclinical Neurotrauma?
Mueller, P. M., Espin, A. T., & Haar, C. V. (2024) · Neurotrauma Reports · doi:10.1089/neur.2024.0028 · Cited by 2
Stepwise Imperatives for Improving the Protection of Animals in Research and Education in Canada
Lavelle, K., Fouad, K., & Illes, J. (2024) · Animals · doi:10.3390/ani14192755
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-5519-4
Arrighi, N., & Hofman, P. M. (2024) · Wiley eBooks · doi:10.1002/9781394332731.refs
Strategic policy options to improve quality and productivity of biomedical research
Balas, E. A., Leo, G. D., & Shaw, K. B. (2024) · Politics and the Life Sciences · doi:10.1017/pls.2024.10
“It is estimated that unreliable preclinical research generates direct costs nearly $28 billion annually in the United States alone (Freedman et al., 2015).”
Poth, T., & Schirmacher, P. (2024) · Die Pathologie · doi:10.1007/s00292-024-01383-w
Ragouet, P. (2023) · Sociologie et sociétés · doi:10.7202/1115297ar
Moving forward: challenges and directions for psychopathological network theory and methodologyPreprint
Fried, E. I., & Cramer, A. O. J. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mh3cf_v1
Incorporating Quantitative Literacy into a T32 Retreat: Lessons and Considerations from Experience
Hall, A. A., & McGrath, J. R. (2025) · eNeuro · doi:10.1523/eneuro.0027-25.2025
“Emblematic of these ongoing issues, many studies have shown that >50% of biomedical science papers fail to replicate (Begley and Ellis, 2012; Baker, 2016a; Korbmacher et al., 2023), with the expected cost to taxpayers being as high as 28-billion dollars per year (Freedman et al., 2015).”
Villarreal, J. C., Ljungberg, E., Jehanathan, N., Owens, M., Li, A., & Borges, C. R. (2025) · Reaction Chemistry & Engineering · doi:10.1039/d5re00192g
Analisis Bibliometrik tentang Perilaku Menabung dan Resolusi Finansial
Judijanto, L. (2025) · Jurnal Multidisiplin West Science · doi:10.58812/jmws.v4i06.2387
Electronic Laboratory Notebooks
Teutenberg, T. (2025) · Wiley eBooks · doi:10.1002/9783527843763.ch02
Laboratory mice are usually distressed and overweight, calling into question research findings
Mason, G. J., & Cait, J. (2022) · The Conversation · doi:10.64628/aam.6fdhvs36j
The folklore of the “Swift” effect – lessons for medical research and clinical practice
Smoliga, J. M., & Sawyer, K. (2025) · PLoS ONE · doi:10.1371/journal.pone.0315560
“Likewise, low reproducibility rates in preclinical research is estimated to lead to>US$28 billion per year in research waste [33].”
Formal Statistical Replication Analysis in Lung Cancer Genome-Wide Association StudiesPreprint
Chang, Y.-H., Byun, J., Gorman, B. R., Hung, R. J., McKay, J., Amos, C. I., Pyarajan, S., Bhattacharya, A., & Sun, R. (2025) · medRxiv · doi:10.1101/2025.10.02.25337130
“The large amount of false positives can substantially hinder clinical efforts such as PRS construction or development of new therapies [35, 36, 37, 38, 39, 40].”
Schlögl, M., Waltersdorfer, L., Regner, P., Siposova, A., & Brenning, A. (2025) · doi:10.5194/egusphere-2025-5210-v1 · Cited by 1
Jacobsen, P. C., & Lautarescu, A. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009028967.002
Yarmush, M. L. (2025) · Innovation and Emerging Technologies · doi:10.1142/s2737599425300107
Wilson, E. T., Heimbach, N. S., Eidelman, D. H., & Baglole, C. J. (2025) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2025.100564 · Cited by 1
Rafi, Z., & Greenland, S. (2020) · Figshare · doi:10.6084/m9.figshare.13031539
Rafi, Z., & Greenland, S. (2020) · Figshare · doi:10.6084/m9.figshare.13031533
Rafi, Z., & Greenland, S. (2020) · Figshare · doi:10.6084/m9.figshare.13031536
Miao, X., Hu, J., Chai, C., Tang, H., Zhao, Z., Luo, W., Zhou, W., & Xu, H. (2023) · Figshare · doi:10.6084/m9.figshare.22609132
Is the replication crisis a problem for biologists? A geometric morphometric approachPreprint
Vrdoljak, J., Sánchez, K. I., Arreola-Ramos, R., Huesa, E. G. D., Villagra, A., Ávila, L. J., & Morando, M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/862052
Rafi, Z., & Greenland, S. (2020) · Figshare · doi:10.6084/m9.figshare.13031530
Metadata
- Authors
- Freedman, L. P., Cockburn, I. M., & Simcoe, T. S.
- Affiliations
- Global Biological Standards Institute (US)
- Boston University (US)
- Corresponding author
- Freedman, Leonard P.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-06-09
- Volume
- 13
- Issue
- 6
- Pages
- e1002165
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC4461318
- OpenAlex
- W585341442
- Cited by
- 1,055
- References
- 35
- Citations by year
- 2026: 48 · 2025: 45 · 2024: 69 · 2023: 92 · 2022: 93 · 2021: 96 · 2020: 142 · 2019: 116 · 2018: 109 · 2017: 93 · 2016: 103 · 2015: 49
- FWCI
- 188.58
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-04-10)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- OpenBU (Boston University) (submittedVersion, cc-by)
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Keywords
- reproducibility, preclinical research, research costs, research waste, reproducibility framework
- MeSH terms
- Reproducibility of Results, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.