CoChat

Implementing online consultations in primary care: a mixed-method evaluation extending normalisation process theory through service co-production

Open access

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Abstract

Objectives: To examine patient and staff views, experiences and acceptability of a UK primary care online consultation system and ask how the system and its implementation may be improved. Design: Mixed-method evaluation of a primary care e-consultation system. Setting: Primary care practices in South West England. Methods: Qualitative interviews with 23 practice staff in six practices. Patient survey data for 756 e-consultations from 36 practices, with free-text survey comments from 512 patients, were analysed thematically. Anonymised patients’ records were abstracted for 485 e-consultations from eight practices, including consultation types and outcomes. Descriptive statistics were used to analyse quantitative data. Analysis of implementation and the usage of the e-consultation system were informed by: (1) normalisation process theory, (2) a framework that illustrates how e-consultations were co-produced and (3) patients’ and staff touchpoints. Results: We found different expectations between patients and staff on how to use e-consultations ‘appropriately’. While some patients used the system to try and save time for themselves and their general practitioners (GPs), some used e-consultations when they could not get a timely face-to-face appointment. Most e-consultations resulted in either follow-on phone (32%) or face-to-face appointments (38%) and GPs felt that this duplicated their workload. Patient satisfaction of the system was high, but a minority were dissatisfied with practice communication about their e-consultation. Conclusions: Where both patients and staff interact with technology, it is in effect ‘co-implemented’. How patients used e-consultations impacted on practice staff’s experiences and appraisal of the system. Overall, the e-consultation system studied could improve access for some patients, but in its current form, it was not perceived by practices as creating sufficient efficiencies to warrant financial investment. We illustrate how this e-consultation system and its implementation can be improved, through mapping the co-production of e-consultations through touchpoints.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2017-019966

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Normalisation process theory (NPT) constructs in association with the implementation of e-consultations.
Figure 1 Normalisation process theory (NPT) constructs in association with the implementation of e-consultations.CC BY · PubMed Central
Figure 2 Combining normalisation process theory (NPT) framework with service co-production processes.
Figure 2 Combining normalisation process theory (NPT) framework with service co-production processes.CC BY · PubMed Central
Figure 3 e-Consultation process map highlighting key touchpoints. GP, general practitioner.
Figure 3 e-Consultation process map highlighting key touchpoints. GP, general practitioner.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 42 references

Cited by

See all 117

Metadata

Authors
Farr, M., Banks, J., Edwards, H. B., Northstone, K., Bernard, E., Salisbury, C., & Horwood, J.
Affiliations
University Hospitals Bristol NHS Foundation Trust (GB)
Corresponding author
Farr, Michelle
Venue
BMJ Open
Publisher
BMJ
Published
2018-03
Volume
8
Issue
3
Pages
e019966
ISSN
2044-6055 (ISSN-L)
OpenAlex
W2792425939
Cited by
106
References
42
Citations by year
2026: 4 · 2025: 13 · 2024: 12 · 2023: 23 · 2022: 13 · 2021: 18 · 2020: 15 · 2019: 7 · 2018: 1
FWCI
9.76
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • BMJ Open (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Bristol Research (University of Bristol) (submittedVersion, cc-by)
Funders
  • National Institute for Health Research
  • One Care Consortium Ltd
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
Keywords
teleconsultation, e-consultation, primary care, Normalisation Process Theory, service co-production, patient and staff experiences, acceptability, general practitioner workload, patient satisfaction, health care access, implementation evaluation, touchpoints
MeSH terms
Adult, Appointments and Schedules, Communication, England, Female, Humans, Interviews as Topic, Male, Online Systems, Primary Health Care, Surveys and Questionnaires, Referral and Consultation, Workload, Patient Satisfaction, Process Assessment, Health Care, Telemedicine, Qualitative Research, General Practitioners

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Implementing online consultations in primary care: a mixed-method evaluation extending normalisation process theory through service co-production. https://app.cochat.ai/papers/10.1136/bmjopen-2017-019966
The paper
Farr, M., Banks, J., Edwards, H. B., Northstone, K., Bernard, E., Salisbury, C., & Horwood, J. (2018). Implementing online consultations in primary care: a mixed-method evaluation extending normalisation process theory through service co-production. BMJ Open. https://doi.org/10.1136/bmjopen-2017-019966

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.