Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 96 of the 97 references it cites were found in a registry or an index.

Understanding How the Design and Implementation of Online Consultations Affect Primary Care Quality: Systematic Review of Evidence With Recommendations for Designers, Providers, and Researchers

Open access
Darley, Sarah, Coulson, Tessa, Peek, Niels, Moschogianis, Susan, van der Veer, Sabine N, Wong, David C, Brown, Benjamin C · 2022 · Journal of Medical Internet Research

Published version of a preprint

Abstract

Background: Online consultations (OCs) allow patients to contact their care providers on the web. Worldwide, OCs have been rolled out in primary care rapidly owing to policy initiatives and COVID-19. There is a lack of evidence regarding how OC design and implementation influence care quality. Objective: We aimed to synthesize research on the impacts of OCs on primary care quality, and how these are influenced by system design and implementation. Methods: We searched databases from January 2010 to February 2022. We included quantitative and qualitative studies of real-world OC use in primary care. Quantitative data were transformed into qualitative themes. We used thematic synthesis informed by the Institute of Medicine domains of health care quality, and framework analysis informed by the nonadoption, abandonment, scale-up, spread, and sustainability framework. Strength of evidence was judged using the GRADE-CERQual approach. Results: We synthesized 63 studies from 9 countries covering 31 OC systems, 14 (22%) of which used artificial intelligence; 41% (26/63) of studies were published from 2020 onward, and 17% (11/63) were published after the COVID-19 pandemic. There was no quantitative evidence for negative impacts of OCs on patient safety, and qualitative studies suggested varied perceptions of their safety. Some participants believed OCs improved safety, particularly when patients could describe their queries using free text. Staff workload decreased when sufficient resources were allocated to implement OCs and patients used them for simple problems or could describe their queries using free text. Staff workload increased when OCs were not integrated with other software or organizational workflows and patients used them for complex queries. OC systems that required patients to describe their queries using multiple-choice questionnaires increased workload for patients and staff. Health costs decreased when patients used OCs for simple queries and increased when patients used them for complex queries. Patients using OCs were more likely to be female, younger, and native speakers, with higher socioeconomic status. OCs increased primary care access for patients with mental health conditions, verbal communication difficulties, and barriers to attending in-person appointments. Access also increased by providing a timely response to patients’ queries. Patient satisfaction increased when using OCs owing to better primary care access, although it decreased when using multiple-choice questionnaire formats. Conclusions: This is the first theoretically informed synthesis of research on OCs in primary care and includes studies conducted during the COVID-19 pandemic. It contributes new knowledge that, in addition to having positive impacts on care quality such as increased access, OCs also have negative impacts such as increased workload. Negative impacts can be mitigated through appropriate OC system design (eg, free text format), incorporation of advanced technologies (eg, artificial intelligence), and integration into technical infrastructure (eg, software) and organizational workflows (eg, timely responses). Trial Registration: PROSPERO CRD42020191802; https://tinyurl.com/2p84ezjy

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/37436

Cites

96 of 96 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Flowchart of the study selection process. HMIC: Health Management Information Consortium; NTIS: National Technical Information Service.
Figure 1 Flowchart of the study selection process. HMIC: Health Management Information Consortium; NTIS: National Technical Information Service.CC BY · PubMed Central
Figure 2 Artificial intelligence opportunities.
Figure 2 Artificial intelligence opportunities.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 97 references

Research works printed but not linked: 6

  1. GM Digital First Primary Care: Patient and public insights: Workshop resultsHealth Innovation Manchester20202021-09-01https://healthinnovationmanchester.com/our-work/gm-digital-first-primary-care/
  2. Wilson, G, 2021, N Z Med J, 134, 89
  3. Pawson, R, 1997, Realistic Evaluation
  4. 2001, Crossing the Quality Chasm: A New Health System for the 21st Century
  5. Padman, R, 2010, Stud Health Technol Inform, 160, 262
  6. Jung, C, 2011, AMIA Annu Symp Proc, 2011, 1070

Cited by

See all 53

Metadata

Authors
Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C.
Affiliations
  • University of Manchester (GB)
  • National Health Service (GB)
  • Manchester Academic Health Science Centre (GB)
Corresponding author
Brown, Benjamin C
Venue
Journal of Medical Internet Research
Published
2022-10-24
Volume
24
Issue
10
Pages
e37436
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4281898180
Cited by
53
References
97
Citations by year
2026: 8 · 2025: 21 · 2024: 11 · 2023: 12 · 2022: 1
FWCI
2.23
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • medRxiv (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Research Explorer (The University of Manchester) (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • Wellcome Trust (Z/17/Z, 209593/Z/17/Z)
  • National Institute for Health and Care Research
  • Department of Health and Social Care
  • Patient Safety Translational Research Centre
  • Innovate UK
Topics
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
teleconsultation, primary care quality, telemedicine, patient safety, staff workload, health care costs, patient satisfaction, primary care access, COVID-19 pandemic, multiple-choice questionnaires, health equity, system design and implementation, mental illness, communication difficulties, socioeconomic status
MeSH terms
COVID-19, Artificial Intelligence, Female, Humans, Male, Quality of Health Care, Referral and Consultation, United States, Pandemics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Understanding How the Design and Implementation of Online Consultations Affect Primary Care Quality: Systematic Review of Evidence With Recommendations for Designers, Providers, and Researchers. https://app.cochat.ai/papers/10.2196/37436
The paper
Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C. (2022). Understanding How the Design and Implementation of Online Consultations Affect Primary Care Quality: Systematic Review of Evidence With Recommendations for Designers, Providers, and Researchers. Journal of Medical Internet Research. https://doi.org/10.2196/37436

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.