CoChat

A descriptive analysis of the data availability statements accompanying medRxiv preprints and a comparison with their published counterparts

Open access

The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.

Abstract

Objective: To determine whether medRxiv data availability statements describe open or closed data—that is, whether the data used in the study is openly available without restriction—and to examine if this changes on publication based on journal data-sharing policy. Additionally, to examine whether data availability statements are sufficient to capture code availability declarations. Design: Observational study, following a pre-registered protocol, of preprints posted on the medRxiv repository between 25th June 2019 and 1st May 2020 and their published counterparts. Main outcome measures: Distribution of preprinted data availability statements across nine categories, determined by a prespecified classification system. Change in the percentage of data availability statements describing open data between the preprinted and published versions of the same record, stratified by journal sharing policy. Number of code availability declarations reported in the full-text preprint which were not captured in the corresponding data availability statement. Results: 3938 medRxiv preprints with an applicable data availability statement were included in our sample, of which 911 (23.1%) were categorized as describing open data. 379 (9.6%) preprints were subsequently published, and of these published articles, only 155 contained an applicable data availability statement. Similar to the preprint stage, a minority (59 (38.1%)) of these published data availability statements described open data. Of the 151 records eligible for the comparison between preprinted and published stages, 57 (37.7%) were published in journals which mandated open data sharing. Data availability statements more frequently described open data on publication when the journal mandated data sharing (open at preprint: 33.3%, open at publication: 61.4%) compared to when the journal did not mandate data sharing (open at preprint: 20.2%, open at publication: 22.3%). Conclusion: Requiring that authors submit a data availability statement is a good first step, but is insufficient to ensure data availability. Strict editorial policies that mandate data sharing (where appropriate) as a condition of publication appear to be effective in making research data available. We would strongly encourage all journal editors to examine whether their data availability policies are sufficiently stringent and consistently enforced.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0250887

Cites

74 of 74 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Distribution of the data availability statements of preprinted (Panel A) and published (Panel B) records by category from Table 1.
Fig 1 Distribution of the data availability statements of preprinted (Panel A) and published (Panel B) records by category from Table 1.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 74 references

Research works printed but not linked: 2

  1. LA McGuinness, 2020, Protocol for a descriptive analysis of the data availability statements accompanying medRxiv preprints
  2. C Chan, 2018, Rio: A swiss-army knife for data file i/o

Cited by

See all 35

Metadata

Authors
McGuinness, L. A., & Sheppard, A. L.
Affiliations
  • University of Bristol (GB)
  • University of Leicester (GB)
Corresponding author
McGuinness, Luke A.
Venue
PLOS ONE
Published
2021-05-13
Volume
16
Issue
5
Pages
e0250887
ISSN
1932-6203 (ISSN-L)
OpenAlex
W3161322225
Cited by
33
References
65
Citations by year
2026: 4 · 2025: 4 · 2024: 2 · 2023: 12 · 2022: 9 · 2021: 2
FWCI
5.34
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • MetArXiv (OSF Preprints) (publishedVersion)
  • Explore Bristol Research (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Bristol Research (University of Bristol) (submittedVersion, cc-by)
  • MetArXiv (OSF Preprints) (submittedVersion, cc-by)
Funders
National Institute for Health Research (NIHR; https://www.nihr.ac.uk/) Doctoral Research Fellowship (DRF-2018-11-ST2-048)
Topics
  • Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
Keywords
data availability statements, medRxiv, preprints, open data, data sharing policy, research data availability, journal editorial policy, health research data
MeSH terms
Data Accuracy, Preprints as Topic, Humans, Peer Review, Research, Information Dissemination, Editorial Policies, Policy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A descriptive analysis of the data availability statements accompanying medRxiv preprints and a comparison with their published counterparts. https://app.cochat.ai/papers/10.1371/journal.pone.0250887
The paper
McGuinness, L. A., & Sheppard, A. L. (2021). A descriptive analysis of the data availability statements accompanying medRxiv preprints and a comparison with their published counterparts. PLOS ONE. https://doi.org/10.1371/journal.pone.0250887

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.