CoChat

The opportunities and challenges of pragmatic point-of-care randomised trials using routinely collected electronic records: evaluations of two exemplar trials

Open access
van Staa, Tjeerd-Pieter, Dyson, Lisa, McCann, Gerard, Padmanabhan, Shivani, Belatri, Rabah, Goldacre, Ben, Cassell, Jackie, Pirmohamed, Munir, Torgerson, David, Ronaldson, Sarah, Adamson, Joy, Taweel, Adel, Delaney, Brendan, Mahmood, Samhar, Baracaia, Simona, Round, Thomas, Fox, Robin, Hunter, Tommy, Gulliford, Martin, Smeeth, Liam · 2014 · Health Technology Assessment
Cited by 155

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Pragmatic trials compare the effects of different decisions in usual clinical practice. OBJECTIVES: To develop and evaluate methods to implement simple pragmatic trials using routinely collected electronic health records (EHRs) and recruiting patients at the point of care; to identify the barriers and facilitators for general practitioners (GPs) and patients and the experiences of trial participants. DESIGN: Two exemplar randomised trials (Retropro and eLung) with qualitative evaluations. SETTING: Four hundred and fifty-nine English and Scottish general practices contributing EHRs to a research database, of which 17 participated in the trials. PARTICIPANTS: Retropro aimed to recruit 300 patients with hypercholesterolaemia and high cardiovascular risk and eLung aimed to recruit 150 patients with a chronic obstructive pulmonary disease exacerbation. INTERVENTIONS: Retropro randomised between simvastatin and atorvastatin and eLung between immediate antibiotics and deferred or non-use. eLung recruited during an unscheduled consultation using EHR flagging. MAIN OUTCOME MEASURE: Successful trial completion with implementation of information technology (IT) system for flagging and data processing and documentation of operational and scientific experiences. DATA SOURCES: EHR research database. RESULTS: The governance approval process took over 3 years. A total of 58.8% of the practices (n = 270) expressed interest in participating. The number of interested practices dropped substantially with each stage of the governance process. In Retropro, 6.5% of the practices (n = 30) were eventually approved and 3.7% (n = 17) recruited patients; in eLung, these numbers were 6.8% (n = 31) and 1.3% (n = 6) respectively. Retropro successfully completed recruitment (301 patients) whereas eLung recruited 31 patients. Retropro recruited 20.6% of all statin starters in recruiting practices and 1.1% in the EHR database; the comparable numbers for eLung were 32.3% and 0.9% respectively. The IT system allowed for complex eligibility criteria with central on and off control of recruitment and flagging at a practice. Good Clinical Practice guidelines, governance and consent procedures were found to have substantially affected the intended simple nature of the trials. One qualitative study of 13 clinicians found that clinicians were generally positive about the principle of computerised trial recruitment (flagging during consultation). However, trials which did not include patients with acute illness were favoured. The second qualitative process evaluation interviewed 27 GPs about their actual experiences, including declining, recruiting and non-recruiting GPs. Opportunistic patient recruitment during a routine GP consultation was found to be the most controversial element. The actual experiences of recruiting patients during unscheduled consultation were generally more positive than the hypothetical views of GPs. Several of the recruiting GPs reported the process took 5 minutes and was straightforward and feasible on most occasions. Almost all GPs expressed their strong support for the use of EHRs for trials. Ten eLung participants were interviewed, all of whom considered it acceptable to be recruited during a consultation and to use EHRs for trials. CONCLUSIONS: EHR point-of-care trials are feasible, although the recruitment of clinicians is a major challenge owing to the complexity of trial approvals. These trials will provide substantial evidence on clinical effectiveness only if trial interventions and participating clinicians and patients are typical of usual clinical care and trials are simple to initiate and conduct. Recommendations for research include the development of evidence and implementation of risk proportionality in trial governance and conduct. TRIAL REGISTRATION: Current Controlled Trials ISRCTN33113202 and ISRCTN72035428. FUNDING: This project was funded by the NIHR Health Technology Assessment programme and the Wellcome Trust and will be published in full in Health Technology Assessment; Vol. 18, No. 43. See the NIHR Journals Library website for further project information.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3310/hta18430

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 155

Metadata

Authors
van Staa, T.-P., Dyson, L., McCann, G., Padmanabhan, S., Belatri, R., Goldacre, B., Cassell, J., Pirmohamed, M., Torgerson, D., Ronaldson, S., Adamson, J., Taweel, A., Delaney, B., Mahmood, S., Baracaia, S., Round, T., Fox, R., Hunter, T., Gulliford, M., & Smeeth, L.
Venue
Health Technology Assessment
Published
2014-07
Volume
18
Issue
43
Pages
1-146
ISSN
  • 1366-5278 (ISSN-L)
  • 2046-4924
OpenAlex
W2018612904
Cited by
155
References
37
FWCI
42.38
Type
journal article
Language
en
Open access
diamond

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.