The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
OpenSAFELY: A platform for analysing electronic health records designed for reproducible research
Abstract
Electronic health records (EHRs) and other administrative health data are increasingly used in research to generate evidence on the effectiveness, safety, and utilisation of medical products and services, and to inform public health guidance and policy. Reproducibility is a fundamental step for research credibility and promotes trust in evidence generated from EHRs. At present, ensuring research using EHRs is reproducible can be challenging for researchers. Research software platforms can provide technical solutions to enhance the reproducibility of research conducted using EHRs. In response to the COVID‐19 pandemic, we developed the secure, transparent, analytic open‐source software platform OpenSAFELY designed with reproducible research in mind. OpenSAFELY mitigates common barriers to reproducible research by: standardising key workflows around data preparation; removing barriers to code‐sharing in secure analysis environments; enforcing public sharing of programming code and codelists; ensuring the same computational environment is used everywhere; integrating new and existing tools that encourage and enable the use of reproducible working practices; and providing an audit trail for all code that is run against the real data to increase transparency. This paper describes OpenSAFELY's reproducibility‐by‐design approach in detail.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Platforms such as OpenSAFELY 8 are designed as tightly integrated research environments that provide a complete end-to-end analytic ecosystem, including curated datasets, predefined tooling, and governance processes within a largely uniform infrastructure.”
In the citing paper
“This approach enables highly reproducible analyses at scale, but it relies on a relatively consistent operating model across participating data providers.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293 · cited 2×
“11 Closely related to the Turing Way definition, Goodman et al. 7 defined methods reproducibility as: ‘ the ability to implement, as exactly as possible, the experimental and computational procedures, with the same data and tools , to obtain the same results ’ (definition 3).”
Reproducibility and Replicability in Science
Committee on Reproducibility and Replicability in Science, Board on Behavioral, C., Committee on National Statistics, Education, D. O. B. A. S. S. A., Nuclear and Radiation Studies Board, Studies, D. O. E. A. L., Board on Mathematical Sciences and Analytics, Committee on Applied and Theoretical Statistics, Sciences, D. O. E. A. P., Board on Research Data and Information, et al. (2019) · doi:10.17226/25303 · Cited by 924
Ten Simple Rules for Reproducible Computational Research
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003285 · Cited by 880
Harnessing the power of synthetic data in healthcare: innovation, application, and privacy
Giuffrè, M., & Shung, D. L. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00927-3 · Cited by 392
Hamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J. (2023) · BMJ · doi:10.1136/bmj-2023-075767 · Cited by 86
Why researchers should share their analytic code
Goldacre, B., Morton, C. E., & DeVito, N. J. (2019) · BMJ · doi:10.1136/bmj.l6365 · Cited by 61 · cited 1×
“To protect privacy, laws are put in place such as the EU's General Data Protection Regulation and the US Health Insurance Portability and Accountability Act, prohibiting sharing data obtained from EHRs and therefore hindering checks on reproducibility.”
Self-citation
Research works printed but not linked: 18
- 10.1002/pds.4295 · DOI · Paper page
- 10.1016/j.jval.2020.04.002 · DOI
- Goldacre B, 2022, Better, Broader, Safer: Using Health Data for Research and Analysis. A Review Commissioned by the Secretary of State for Health and Social Care
- 10.1038/s41467‐022‐32310‐3 · DOI
- 10.1371/journal.pone.0251194 · DOI
- 10.1038/s41586‐020‐2521‐4 · DOI · Paper page
- BarbaLA.Terminologies for reproducible research; 2018; arXiv:1802.03311.http://arxiv.org/abs/1802.03311 · arXiv
- 10.1190/1.1822162 · DOI · Paper page
- 10.1002/gepi.21867 · DOI
- 10.2196/33720 · DOI
- 10.1016/S1470‐2045(21)00207‐2 · DOI
- 10.1371/journal.pone.0099825 · DOI · Paper page
- 10.1038/s41567‐018‐0342‐2 · DOI
- 10.1038/s41597‐022‐01143‐6 · DOI
- 10.1136/bmj.p1609 · DOI
- Sharing Your Data Materials and Software; 2023. Accessed November 23 2023.https://www.biomedcentral.com/getpublished/writing-resources/structuring-your-data-materials-and-software
- 10.1093/aje/kwx066 · DOI
- 10.1136/bmjhci‐2021‐100488 · DOI
Cited by
Suchak, T., Aliu, A. E., Harrison, C., Zwiggelaar, R., Geifman, N., & Spick, M. (2025) · PLOS Biology · doi:10.1371/journal.pbio.3003152 · Cited by 95
Beck, T., Lockhart-Jones, H., Panagi, V., Biddle, J., Chan, M., Couldridge, J., Eva, J., Figueredo, G., Gaungoo, A., Hong, J., et al. (2026) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocag160
Metadata
- Authors
- Nab, L., Schaffer, A. L., Hulme, W., DeVito, N. J., Dillingham, I., Wiedemann, M., Andrews, C. D., Curtis, H., Fisher, L., Green, A., Massey, J., Walters, C. E., Higgins, R., Cunningham, C., Morley, J., Mehrkar, A., Hart, L., Davy, S., Evans, D., Hickman, G., Inglesby, P., Morton, C. E., Smith, R. M., Ward, T., O'Dwyer, T., Maude, S., Bridges, L., Butler‐Cole, B. F. C., Stables, C. L., Stokes, P., Bates, C., Cockburn, J., Hester, F., Parry, J., Bhaskaran, K., Schultze, A., Rentsch, C. T., Mathur, R., Tomlinson, L. A., Williamson, E. J., Smeeth, L., Walker, A., Bacon, S., MacKenna, B., & Goldacre, B.
- Affiliations
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences University of Oxford Oxford UK
- TPP TPP House Leeds UK
- London School of Hygiene and Tropical Medicine London UK
- Venue
- Pharmacoepidemiology and Drug Safety
- Publisher
- Wiley
- Published
- 2024-05-23
- Volume
- 33
- Issue
- 6
- ISSN
- 1053-8569
- 1099-1557
- PMC
- PMC7616137
- Cited by
- 34
- References
- 6
- Language
- en
- Funders
- Wellcome Trust (222097/Z/20/Z, 220283/Z/20/Z, 224485/Z/21/Z)
- Medical Research Council (MR/V015737/1, MC_PC_20059, MR/W016729/1, MC_PC_20030)
- UK Research and Innovation (MC_PC_20058)
- National Institute for Health and Care Research (COV‐LT‐0009, NIHR135559, COV‐LT2‐0073)
- Health Data Research UK (HDRUK2021.000)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.