Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data
Open accessThe DOI matches its Crossref record; 162 of the 162 references it cites were found in a registry or an index.
Abstract
Objectives: To synthesise research investigating data and code sharing in medicine and health to establish an accurate representation of the prevalence of sharing, how this frequency has changed over time, and what factors influence availability. Design: Systematic review with meta-analysis of individual participant data. Data sources: Ovid Medline, Ovid Embase, and the preprint servers medRxiv, bioRxiv, and MetaArXiv were searched from inception to 1 July 2021. Forward citation searches were also performed on 30 August 2022. Review methods: Meta-research studies that investigated data or code sharing across a sample of scientific articles presenting original medical and health research were identified. Two authors screened records, assessed the risk of bias, and extracted summary data from study reports when individual participant data could not be retrieved. Key outcomes of interest were the prevalence of statements that declared that data or code were publicly or privately available (declared availability) and the success rates of retrieving these products (actual availability). The associations between data and code availability and several factors (eg, journal policy, type of data, trial design, and human participants) were also examined. A two stage approach to meta-analysis of individual participant data was performed, with proportions and risk ratios pooled with the Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis. Results: The review included 105 meta-research studies examining 2 121 580 articles across 31 specialties. Eligible studies examined a median of 195 primary articles (interquartile range 113-475), with a median publication year of 2015 (interquartile range 2012-2018). Only eight studies (8%) were classified as having a low risk of bias. Meta-analyses showed a prevalence of declared and actual public data availability of 8% (95% confidence interval 5% to 11%) and 2% (1% to 3%), respectively, between 2016 and 2021. For public code sharing, both the prevalence of declared and actual availability were estimated to be <0.5% since 2016. Meta-regressions indicated that only declared public data sharing prevalence estimates have increased over time. Compliance with mandatory data sharing policies ranged from 0% to 100% across journals and varied by type of data. In contrast, success in privately obtaining data and code from authors historically ranged between 0% and 37% and 0% and 23%, respectively. Conclusions: The review found that public code sharing was persistently low across medical research. Declarations of data sharing were also low, increasing over time, but did not always correspond to actual sharing of data. The effectiveness of mandatory data sharing policies varied substantially by journal and type of data, a finding that might be informative for policy makers when designing policies and allocating resources to audit compliance. Systematic review registration: Open Science Framework doi: 10.17605/OSF.IO/7SX8U .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures











Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“None of the included modelling studies provided access to the associated model code, in line with recent estimates that, to date, only 0⋅5% of medical studies provide public access codes.127”
From Severe acute respiratory syndrome (SARS) mathematical models and disease parameters: a systematic review (2025) · cites this paper as [127]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Poor distribution of labor and lack of task specialization may be part of the reason data and code sharing remain rare [48,54]”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [48]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, a recent meta-analysis of over 2 million publications revealed that while 5% to 11% (95% confidence interval) of publications declared to have publicly available data, only 1% to 3% actually had publicly available data [48].”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [48]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon.”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [48]
The cited source says what the claim attributes to it.
In the citing paper
“For code sharing, the estimate was <0.5%.”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [48]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01626-4 · Cited by 13,874
Self-citationIntHout, J., Ioannidis, J. P., & Borm, G. F. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-25 · Cited by 2,419
The arcsine is asinine: the analysis of proportions in ecology
Warton, D. I., & Hui, F. K. C. (2011) · Ecology · doi:10.1890/10-0340.1 · Cited by 2,280
Stewart, L. A., Clarke, M., Rovers, M., Riley, R. D., Simmonds, M., Stewart, G., & Tierney, J. F. (2015) · JAMA · doi:10.1001/jama.2015.3656 · Cited by 2,134
What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse data
J. Sweeting, M., J. Sutton, A., & C. Lambert, P. (2004) · Statistics in Medicine · doi:10.1002/sim.1761 · Cited by 1,734
Sharing Detailed Research Data Is Associated with Increased Citation Rate
Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000308 · Cited by 881
Stijnen, T., Hamza, T. H., & Özdemir, P. (2010) · Statistics in Medicine · doi:10.1002/sim.4040 · Cited by 757
Haddaway, N. R., Grainger, M. J., & Gray, C. T. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1563 · Cited by 604
Meta‐analysis of prevalence: I 2 statistic and how to deal with heterogeneity
Migliavaca, C. B., Stein, C., Colpani, V., Barker, T. H., Ziegelmann, P. K., Munn, Z., Falavigna, M., & Prevalence Estimates Reviews—Systematic Review Methodology Group (PERSyst) (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1547 · Cited by 577
Cited by
Slideflow: deep learning for digital histopathology with real-time whole-slide visualization
Dolezal, J. M., Kochanny, S. E., Dyer, E., Ramesh, S., Srisuwananukorn, A., Sacco, M., Howard, F. M., Li, A., Mohan, P., & Pearson, A. T. (2024) · BMC Bioinformatics · doi:10.1186/s12859-024-05758-x · Cited by 98
“At present, most computational pathology research papers either share code that is custom written for the specific research application and not immediately generalizable to other datasets or research questions, or do not share code at all [14].”
BackgroundOpen Science 2.0: Towards a truly collaborative research ecosystem
Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I. (2023) · PLOS Biology · doi:10.1371/journal.pbio.3002362 · Cited by 72
General-purpose foundation models for increased autonomy in robot-assisted surgery
Schmidgall, S., Kim, J. W., Kuntz, A., Ghazi, A., & Krieger, A. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00917-4 · Cited by 59
“61), which is in contrast to the field of artificial intelligence, which has rates from 35% to 51% (ref.”
OpenSAFELY: A platform for analysing electronic health records designed for reproducible research
Nab, L., Schaffer, A. L., Hulme, W., DeVito, N. J., Dillingham, I., Wiedemann, M., Andrews, C. D., Curtis, H., Fisher, L., Green, A., et al. (2024) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5815 · Cited by 34
Enhancing the trustworthiness of pain research: A call to action.
O'Connell, N. E., Belton, J. L., Crombez, G., Eccleston, C., Fisher, E., Ferraro, M. C., Hood, A., Keefe, F. J., Knaggs, R., Norris, E., et al. (2024) · Journal of Pain · doi:10.1016/j.jpain.2024.104736 · Cited by 36
Metadata
- Authors
- Hamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J.
- Affiliations
- The University of Melbourne (AU)
- University of Maryland, Baltimore (US)
- Monash University (AU)
- Corresponding author
- Hamilton, Daniel G
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2023-07-11
- Volume
- 382
- Pages
- e075767
- ISSN
- 1756-1833 (ISSN-L)
- PMC
- PMC10334349
- OpenAlex
- W4383878837
- Semantic Scholar
- bde1eaeccd37e477d92e55d1c1df53dff5a91be9
- Cited by
- 86
- References
- 156
- Citations by year
- 2026: 20 · 2025: 26 · 2024: 30 · 2023: 10
- FWCI
- 3.55
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- BMJ (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Funders
- U.S. Food and Drug Administration
- Laura and John Arnold Foundation
- Australian Research Council
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- data sharing, code sharing, research data availability, open science, data sharing policy, research reproducibility, meta-research, medical research, health research, research transparency, research ethics
- MeSH terms
- Administrative Personnel, Humans, Medicine, Prevalence, Information Dissemination, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. https://app.cochat.ai/papers/10.1136/bmj-2023-075767
- The paper
- Hamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J. (2023). Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. BMJ. https://doi.org/10.1136/bmj-2023-075767
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.