Has open data arrived at the British Medical Journal (BMJ) ? An observational study
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Objective: To quantify data sharing trends and data sharing policy compliance at the British Medical Journal (BMJ) by analysing the rate of data sharing practices, and investigate attitudes and examine barriers towards data sharing. Design: Observational study. Setting: The BMJ research archive. Participants: 160 randomly sampled BMJ research articles from 2009 to 2015, excluding meta-analysis and systematic reviews. Main outcome measures: Percentages of research articles that indicated the availability of their raw data sets in their data sharing statements, and those that easily made their data sets available on request. Results: 3 articles contained the data in the article. 50 out of 157 (32%) remaining articles indicated the availability of their data sets. 12 used publicly available data and the remaining 38 were sent email requests to access their data sets. Only 1 publicly available data set could be accessed and only 6 out of 38 shared their data via email. So only 7/157 research articles shared their data sets, 4.5% (95% CI 1.8% to 9%). For 21 clinical trials bound by the BMJ data sharing policy, the per cent shared was 24% (8% to 47%). Conclusions: Despite the BMJ 's strong data sharing policy, sharing rates are low. Possible explanations for low data sharing rates could be: the wording of the BMJ data sharing policy, which leaves room for individual interpretation and possible loopholes; that our email requests ended up in researchers spam folders; and that researchers are not rewarded for sharing their data. It might be time for a more effective data sharing policy and better incentives for health and medical researchers to share their data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, assessment of analytic reproducibility is typically precluded by poor access to research data [7–14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [11]
The cited source says what the claim attributes to it.
In the citing paper
“Post-publication efforts to obtain data directly from authors frequently go unanswered, or are refused [11–13]”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700
Empirical Study of Data Sharing by Authors Publishing in PLoS Journals
Savage, C. J., & Vickers, A. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007078 · Cited by 411
Approaches for estimating prevalence ratios
Deddens, J. A., & Petersen, M. R. (2008) · Occupational and Environmental Medicine · doi:10.1136/oem.2007.034777 · Cited by 386
Public Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363 · cited 1×
“The success of these policies remain largely untested.(15) Although the BMJ’s data sharing policy focuses on”
BackgroundReproducible Research Practices and Transparency across the Biomedical Literature
Iqbal, S. A., Wallach, J. D., Khoury, M. J., Schully, S. D., & Ioannidis, J. P. A. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002333 · Cited by 310
Sharing research data to improve public health
Walport, M., & Brest, P. (2011) · The Lancet · doi:10.1016/s0140-6736(10)62234-9 · Cited by 254
Sharing Clinical Trial Data — A Proposal from the International Committee of Medical Journal Editors
Taichman, D. B., Backus, J., Baethge, C., Bauchner, H., de Leeuw, P. W., Drazen, J. M., Fletcher, J., Frizelle, F. A., Groves, T., Haileamlak, A., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejme1515172 · Cited by 190
Sample size calculations: should the emperor's clothes be off the peg or made to measure?
Norman, G., Monteiro, S., & Salama, S. (2012) · BMJ · doi:10.1136/bmj.e5278 · Cited by 187
Bartling, S. H., & Friesike, S. (2014) · Directory of Open access Books (OAPEN Foundation) · doi:10.34734/fzj-2023-02860 · Cited by 170
(2014) · Springer eBooks · doi:10.1007/978-3-319-00026-8 · Cited by 156
Research works printed but not linked: 1
- BMJ. 2016. http://www.bmj.com/about-bmj/resources-authors/article-types/research
Cited by
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335
Naudet, F., Sakarovitch, C., Janiaud, P., Cristea, I., Fanelli, D., Moher, D., & Ioannidis, J. P. A. (2018) · BMJ · doi:10.1136/bmj.k400 · Cited by 227
Data sharing in PLOS ONE: An analysis of Data Availability Statements
Federer, L. M., Belter, C. W., Joubert, D. J., Livinski, A., Lu, Y.-L., Snyders, L. N., & Thompson, H. (2018) · PLOS ONE · doi:10.1371/journal.pone.0194768 · Cited by 208
Hardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620979806 · Cited by 187
Metadata
- Authors
- Rowhani-Farid, A., & Barnett, A. G.
- Affiliations
- Queensland University of Technology (AU)
- Corresponding author
- Rowhani-Farid, Anisa
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2016-10
- Volume
- 6
- Issue
- 10
- Pages
- e011784
- ISSN
- 2044-6055 (ISSN-L)
- PMC
- PMC5073489
- OpenAlex
- W2531377616
- Cited by
- 84
- References
- 28
- Citations by year
- 2026: 1 · 2025: 8 · 2024: 5 · 2023: 10 · 2022: 5 · 2021: 12 · 2020: 22 · 2019: 7 · 2018: 13 · 2017: 1
- FWCI
- 15.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMJ Open (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- QUT ePrints (Queensland University of Technology) (submittedVersion, cc-by)
- HighWire Press Open Archive (submittedVersion)
- Faculty of Health; Institute of Health and Biomedical Innovation
- Funders
- Queensland University of Technology
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Keywords
- data sharing, open data, British Medical Journal, clinical trials, research data availability, barriers to data sharing, researcher attitudes, data sharing incentives, policy loopholes
- MeSH terms
- Authorship, Clinical Trials as Topic, Cooperative Behavior, United Kingdom, Humans, Periodicals as Topic, Public Policy, Research Design, Research Personnel, Organizational Policy, Information Storage and Retrieval, Access to Information, Information Dissemination, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Has open data arrived at the British Medical Journal (BMJ) ? An observational study. https://app.cochat.ai/papers/10.1136/bmjopen-2016-011784
- The paper
- Rowhani-Farid, A., & Barnett, A. G. (2016). Has open data arrived at the British Medical Journal (BMJ) ? An observational study. BMJ Open. https://doi.org/10.1136/bmjopen-2016-011784
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.