Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 34

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

OpenSAFELY: A platform for analysing electronic health records designed for reproducible research

Nab, Linda, Schaffer, Andrea L., Hulme, William, DeVito, Nicholas J., Dillingham, Iain, Wiedemann, Milan, Andrews, Colm D., Curtis, Helen, Fisher, Louis, Green, Amelia, Massey, Jon, Walters, Caroline E., Higgins, Rose, Cunningham, Christine, Morley, Jessica, Mehrkar, Amir, Hart, Liam, Davy, Simon, Evans, David, Hickman, George, Inglesby, Peter, Morton, Caroline E., Smith, Rebecca M., Ward, Tom, O'Dwyer, Thomas, Maude, Steven, Bridges, Lucy, Butler‐Cole, Ben F. C., Stables, Catherine L., Stokes, Pete, Bates, Chris, Cockburn, Jonny, Hester, Frank, Parry, John, Bhaskaran, Krishnan, Schultze, Anna, Rentsch, Christopher T., Mathur, Rohini, Tomlinson, Laurie A., Williamson, Elizabeth J., Smeeth, Liam, Walker, Alex, Bacon, Sebastian, MacKenna, Brian, Goldacre, Ben · 2024 · Pharmacoepidemiology and Drug Safety

Abstract

Electronic health records (EHRs) and other administrative health data are increasingly used in research to generate evidence on the effectiveness, safety, and utilisation of medical products and services, and to inform public health guidance and policy. Reproducibility is a fundamental step for research credibility and promotes trust in evidence generated from EHRs. At present, ensuring research using EHRs is reproducible can be challenging for researchers. Research software platforms can provide technical solutions to enhance the reproducibility of research conducted using EHRs. In response to the COVID‐19 pandemic, we developed the secure, transparent, analytic open‐source software platform OpenSAFELY designed with reproducible research in mind. OpenSAFELY mitigates common barriers to reproducible research by: standardising key workflows around data preparation; removing barriers to code‐sharing in secure analysis environments; enforcing public sharing of programming code and codelists; ensuring the same computational environment is used everywhere; integrating new and existing tools that encourage and enable the use of reproducible working practices; and providing an audit trail for all code that is run against the real data to increase transparency. This paper describes OpenSAFELY's reproducibility‐by‐design approach in detail.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/pds.5815

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Overview of transformations from health care delivery to analysis results in research using linked electronic health records. Transformations in a general research setting (panel A, figure adapted from “Reporting to Improve Reproducibility and Facilitate Validity Assessment for Healthcare Database Studies V1.0” by Wang et al.1, licensed under CC BY 4.0), and transformations in OpenSAFELY* (panel B). Abbreviations: GPSS: general practice system supplier; ehrQL: Electronic Health Records Query Language. * This diagram represents a simplified overview of conceptual levels of data identifiability and data preparation in the OpenSAFELY platform from the perspective of a platform user. A detailed description of the tiered structure of data in OpenSAFELY, including data controllership and accessibility, is found in the Supplemental Material.
Figure 1 Overview of transformations from health care delivery to analysis results in research using linked electronic health records. Transformations in a general research setting (panel A, figure adapted from “Reporting to Improve Reproducibility and Facilitate Validity Assessment for Healthcare Database Studies V1.0” by Wang et al.1, licensed under CC BY 4.0), and transformations in OpenSAFELY* (panel B). Abbreviations: GPSS: general practice system supplier; ehrQL: Electronic Health Records Query Language. * This diagram represents a simplified overview of conceptual levels of data identifiability and data preparation in the OpenSAFELY platform from the perspective of a platform user. A detailed description of the tiered structure of data in OpenSAFELY, including data controllership and accessibility, is found in the Supplemental Material.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 18

  1. 10.1002/pds.4295 · DOI · Paper page
  2. 10.1016/j.jval.2020.04.002 · DOI
  3. Goldacre B, 2022, Better, Broader, Safer: Using Health Data for Research and Analysis. A Review Commissioned by the Secretary of State for Health and Social Care
  4. 10.1038/s41467‐022‐32310‐3 · DOI
  5. 10.1371/journal.pone.0251194 · DOI
  6. 10.1038/s41586‐020‐2521‐4 · DOI · Paper page
  7. BarbaLA.Terminologies for reproducible research; 2018; arXiv:1802.03311.http://arxiv.org/abs/1802.03311 · arXiv
  8. 10.1190/1.1822162 · DOI · Paper page
  9. 10.1002/gepi.21867 · DOI
  10. 10.2196/33720 · DOI
  11. 10.1016/S1470‐2045(21)00207‐2 · DOI
  12. 10.1371/journal.pone.0099825 · DOI · Paper page
  13. 10.1038/s41567‐018‐0342‐2 · DOI
  14. 10.1038/s41597‐022‐01143‐6 · DOI
  15. 10.1136/bmj.p1609 · DOI
  16. Sharing Your Data Materials and Software; 2023. Accessed November 23 2023.https://www.biomedcentral.com/getpublished/writing-resources/structuring-your-data-materials-and-software
  17. 10.1093/aje/kwx066 · DOI
  18. 10.1136/bmjhci‐2021‐100488 · DOI

Cited by

See all 34

Metadata

Authors
Nab, L., Schaffer, A. L., Hulme, W., DeVito, N. J., Dillingham, I., Wiedemann, M., Andrews, C. D., Curtis, H., Fisher, L., Green, A., Massey, J., Walters, C. E., Higgins, R., Cunningham, C., Morley, J., Mehrkar, A., Hart, L., Davy, S., Evans, D., Hickman, G., Inglesby, P., Morton, C. E., Smith, R. M., Ward, T., O'Dwyer, T., Maude, S., Bridges, L., Butler‐Cole, B. F. C., Stables, C. L., Stokes, P., Bates, C., Cockburn, J., Hester, F., Parry, J., Bhaskaran, K., Schultze, A., Rentsch, C. T., Mathur, R., Tomlinson, L. A., Williamson, E. J., Smeeth, L., Walker, A., Bacon, S., MacKenna, B., & Goldacre, B.
Affiliations
  • Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences University of Oxford Oxford UK
  • TPP TPP House Leeds UK
  • London School of Hygiene and Tropical Medicine London UK
Venue
Pharmacoepidemiology and Drug Safety
Publisher
Wiley
Published
2024-05-23
Volume
33
Issue
6
ISSN
  • 1053-8569
  • 1099-1557
Cited by
34
References
6
Language
en
Funders
  • Wellcome Trust (222097/Z/20/Z, 220283/Z/20/Z, 224485/Z/21/Z)
  • Medical Research Council (MR/V015737/1, MC_PC_20059, MR/W016729/1, MC_PC_20030)
  • UK Research and Innovation (MC_PC_20058)
  • National Institute for Health and Care Research (COV‐LT‐0009, NIHR135559, COV‐LT2‐0073)
  • Health Data Research UK (HDRUK2021.000)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.