Understanding How the Design and Implementation of Online Consultations Affect Primary Care Quality: Systematic Review of Evidence With Recommendations for Designers, Providers, and Researchers
Open accessPublished version of a preprint
The DOI matches its Crossref record; 96 of the 97 references it cites were found in a registry or an index.
Abstract
Background: Online consultations (OCs) allow patients to contact their care providers on the web. Worldwide, OCs have been rolled out in primary care rapidly owing to policy initiatives and COVID-19. There is a lack of evidence regarding how OC design and implementation influence care quality. Objective: We aimed to synthesize research on the impacts of OCs on primary care quality, and how these are influenced by system design and implementation. Methods: We searched databases from January 2010 to February 2022. We included quantitative and qualitative studies of real-world OC use in primary care. Quantitative data were transformed into qualitative themes. We used thematic synthesis informed by the Institute of Medicine domains of health care quality, and framework analysis informed by the nonadoption, abandonment, scale-up, spread, and sustainability framework. Strength of evidence was judged using the GRADE-CERQual approach. Results: We synthesized 63 studies from 9 countries covering 31 OC systems, 14 (22%) of which used artificial intelligence; 41% (26/63) of studies were published from 2020 onward, and 17% (11/63) were published after the COVID-19 pandemic. There was no quantitative evidence for negative impacts of OCs on patient safety, and qualitative studies suggested varied perceptions of their safety. Some participants believed OCs improved safety, particularly when patients could describe their queries using free text. Staff workload decreased when sufficient resources were allocated to implement OCs and patients used them for simple problems or could describe their queries using free text. Staff workload increased when OCs were not integrated with other software or organizational workflows and patients used them for complex queries. OC systems that required patients to describe their queries using multiple-choice questionnaires increased workload for patients and staff. Health costs decreased when patients used OCs for simple queries and increased when patients used them for complex queries. Patients using OCs were more likely to be female, younger, and native speakers, with higher socioeconomic status. OCs increased primary care access for patients with mental health conditions, verbal communication difficulties, and barriers to attending in-person appointments. Access also increased by providing a timely response to patients’ queries. Patient satisfaction increased when using OCs owing to better primary care access, although it decreased when using multiple-choice questionnaire formats. Conclusions: This is the first theoretically informed synthesis of research on OCs in primary care and includes studies conducted during the COVID-19 pandemic. It contributes new knowledge that, in addition to having positive impacts on care quality such as increased access, OCs also have negative impacts such as increased workload. Negative impacts can be mitigated through appropriate OC system design (eg, free text format), incorporation of advanced technologies (eg, artificial intelligence), and integration into technical infrastructure (eg, software) and organizational workflows (eg, timely responses). Trial Registration: PROSPERO CRD42020191802; https://tinyurl.com/2p84ezjy
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In this scoping review, we identified the risk of information being lost during virtual consultations, compromising understanding of the clinical picture and potentially leading to incorrect diagnoses [14].”
From Patient safety risk associated with synchronous telehealth: A scoping review (2025) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Stanton, B. F., & Rogers, E. M. (1963) · Journal of Farm Economics · doi:10.2307/1235767 · Cited by 6,675
Qualitative data analysis for applied policy research
Ritchie, J., & Spencer, L. (2010) · Analyzing qualitative data · doi:10.4324/9780203413081_chapter_9 · Cited by 4,800
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · cited 1×
“The methodological quality of the studies was assessed using the Mixed Methods Appraisal Tool (MMAT), which is designed for qualitative, quantitative, and mixed methods studies [76].”
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 4×
“For objective 2, we considered OC “design” as material properties of an OC, such as features and functionality [74], and “implementation” as the way an OC was introduced and used in a particular context [65].”
InfluentialLewin, S., Glenton, C., Munthe-Kaas, H., Carlsen, B., Colvin, C. J., Gülmezoglu, M., Noyes, J., Booth, A., Garside, R., & Rashidian, A. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001895 · Cited by 866
Patient Portals and Patient Engagement: A State of the Science Review
Irizarry, T., DeVito Dabbs, A., & Curran, C. R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4255 · Cited by 732 · cited 1×
“Although symptom checkers [29,42] and patient portals [30,43,44] have been well studied, only a small number of evidence syntheses directly relevant to OCs have been published: a systematic review of 57 articles on delivering “e-consultation” in primary care largely focused on generic stand-alone…”
Research works printed but not linked: 6
- GM Digital First Primary Care: Patient and public insights: Workshop resultsHealth Innovation Manchester20202021-09-01https://healthinnovationmanchester.com/our-work/gm-digital-first-primary-care/
- Wilson, G, 2021, N Z Med J, 134, 89
- Pawson, R, 1997, Realistic Evaluation
- 2001, Crossing the Quality Chasm: A New Health System for the 21st Century
- Padman, R, 2010, Stud Health Technol Inform, 160, 262
- Jung, C, 2011, AMIA Annu Symp Proc, 2011, 1070
Cited by
The Role of AI in Hospitals and Clinics: Transforming Healthcare in the 21st Century
Maleki Varnosfaderani, S., & Forouzanfar, M. (2024) · Bioengineering · doi:10.3390/bioengineering11040337 · Cited by 931
Abell, B., Naicker, S., Rodwell, D., Donovan, T., Tariq, A., Baysari, M., Blythe, R., Parsons, R., & McPhail, S. M. (2023) · Implementation Science · doi:10.1186/s13012-023-01287-y · Cited by 131
Telemedicine and Digital Tools in Dentistry: Enhancing Diagnosis and Remote Patient Care
Surdu, A. E., Foia, C. I., Luchian, I. A., Trifan, D., Budală, D. G., Scutariu, M. M., Ciupilan, C., Puha, B., & Tatarciuc, D. (2025) · Medicina · doi:10.3390/medicina61050826 · Cited by 68
Challenges to quality in contemporary, hybrid general practice a multi-site longitudinal case study
Payne, R., Dakin, F., MacIver, E., Swann, N., Pring, T., Clarke, A., Kalin, A., Moore, L., Ladds, E. C., Wherton, J. P., et al. (2024) · British Journal of General Practice · doi:10.3399/bjgp.2024.0184 · Cited by 45
Vestesson, E., Corte, K. D., Crellin, E., Ledger, J., Bakhai, M., & Clarke, G. M. (2023) · JMIR Public Health and Surveillance · doi:10.2196/44944 · Cited by 41
Systematic Review on Requirements Engineering in Quantum Computing: Insights and Future Directions
Sepúlveda, S., Cravero, A., Fonseca, G. M., & Antonelli, L. (2024) · Electronics · doi:10.3390/electronics13152989 · Cited by 36
Chappell, P., Dias, A. R., Bakhai, M., Ledger, J., & Clarke, G. M. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-072944 · Cited by 25
Digital health and care: emerging from pandemic times
Peek, N. B., Sujan, M. A., & Scott, P. (2023) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100861 · Cited by 36
Self-citationPatel, S. B., Iqbal, F. M., Lam, K., Acharya, A., Ashrafian, H., & Darzi, A. W. (2025) · Journal of Medical Internet Research · doi:10.2196/56711 · Cited by 31
Moschogianis, S. F., Darley, S., Coulson, T., Peek, N. B., Cheraghi‐Sohi, S., & Brown, B. C. (2023) · British Journal of General Practice · doi:10.3399/bjgp.2023.0076 · Cited by 27
Self-citationDakin, F., Hemmings, N., Kalin, A., Moore, L., Ladds, E. C., Payne, R. E., Rosen, R., Byng, R., Wherton, J. P., Wieringa, S., et al. (2025) · British Journal of General Practice · doi:10.3399/bjgp.2024.0322 · Cited by 23
The impact of eHealth use on general practice workload in the pre-COVID-19 era: a systematic review
Keuper, J., van Tuyl, L. H. D., de Geit, E., Rijpkema, C., Vis, E., Batenburg, R. S., & Verheij, R. A. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11524-9 · Cited by 14
Ge, X., Chappell, P., Ledger, J., Bakhai, M., & Clarke, G. M. (2024) · Journal of Medical Internet Research · doi:10.2196/51272 · Cited by 12
Ban, K., Greenfield, S., Burrows, M., Gale, N. K., & Litchfield, I. J. (2024) · British Journal of General Practice · doi:10.3399/bjgp.2024.0228 · Cited by 8
Patient safety risk associated with synchronous telehealth: A scoping review
Oliveira, J. S. R. D., Fernandez, R. S., Molina, M. R., Pinto, A. C. P. N., Rocha-Filho, C. R., Ferreira, T. M., & Peres, S. V. (2025) · PLoS One · doi:10.1371/journal.pone.0336992 · Cited by 7
Health Care Professionals’ Experiences in Telerehabilitation: Qualitative Content Analysis
Qvarfordt, M., Nilsson, E., & Nilsson, L. (2023) · JMIR Human Factors · doi:10.2196/40690 · Cited by 11
Norberg, B. L., Austad, B., Kristiansen, E., Zanaboni, P., & Getz, L. (2024) · JMIR Formative Research · doi:10.2196/63068 · Cited by 8
Ohannessian, R., Yaghobian, S., Simon, R., Poinsot, G., Hiridjee, S., Gleize, J.-C., Piermé, J.-P., Amar, N., Merlaud, C., Maudoux, C., et al. (2023) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2023.0274 · Cited by 6
Litchfield, I. J., Gale, N. K., Greenfield, S., Shukla, D., & Burrows, M. (2025) · Frontiers in Health Services · doi:10.3389/frhs.2024.1499847 · Cited by 10
AI Triage in Primary Care: Building Safer and More Equitable Real-World Evidence
Alamoudi, A. K., Kontopantelis, E., Zghebi, S. S., & Brown, B. C. (2026) · Journal of Medical Internet Research · doi:10.2196/88396 · Cited by 8
Self-citationSmall, N., Masood, Y., Stevenson, F. A., Brown, B. C., Sanders, C., McMillan, B., Atherton, H., Mazumdar, T., Ara, N., Haqqani, H., et al. (2024) · Health Expectations · doi:10.1111/hex.13982 · Cited by 6
Self-citationWillemsen, R. F., Aardoom, J. J., van der Galiën, O. P., van de Vijver, S. J. M., Chavannes, N. H., & Versluis, A. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105296 · Cited by 7
Newbould, J., Hocking, L., Sidhu, M. S., & Daniel, K. (2023) · Health and Social Care Delivery Research · doi:10.3310/awbt4827 · Cited by 10
Kristiansen, E., Atherton, H., Austad, B., Bergmo, T. S., Norberg, B. L., Salisbury, C., & Zanaboni, P. (2025) · Journal of Medical Internet Research · doi:10.2196/55158 · Cited by 5
Vestesson, E., Corte, K. L. A. D., Crellin, E., Ledger, J., Bakhai, M., & Clarke, G. M. (2022) · medRxiv · doi:10.1101/2022.12.06.22283150 · Cited by 4
Aminu, A. Q., Sinclair, D. R., Davies, K., Hall, A., Wiedemann, M., O’Neill, T. W., Clegg, A. P., & Todd, C. J. (2025) · BMC Medicine · doi:10.1186/s12916-025-04469-1 · Cited by 4
Boekhorst, K. E. T., Kuipers, S. J., Ribbers, G. M., & Cramm, J. M. (2025) · BMC Health Services Research · doi:10.1186/s12913-024-12044-2 · Cited by 6
Patient-facing online triage tools and clinician decision-making: a systematic review
Paule, A., Abel, G., Parsons, J., & Atherton, H. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-094068 · Cited by 6
Digitalization of Access to Primary Care: Is There an Equity‐Efficiency Trade‐Off?
Rodrigues, D., Kreif, N., Darzi, A. W., Barahona, M., & Mayer, E. K. (2025) · Health Economics · doi:10.1002/hec.70014 · Cited by 4
Kristiansen, E., Atherton, H., Bergmo, T. S., & Zanaboni, P. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1459684 · Cited by 2
Implementation of digital HIV services in Guangzhou’s primary health-care system, China
Wang, J., Gu, Y., Lu, Y., Li, J., Luo, Y., Cai, Y., Han, Z., & Hao, C. (2025) · Bulletin of the World Health Organization · doi:10.2471/blt.24.291921 · Cited by 3
The Role of Human and Organizational Factors in the Pursuit of One Digital Health
Kuziemsky, C. E. (2023) · Yearbook of Medical Informatics · doi:10.1055/s-0043-1768724 · Cited by 5
Tolegenova, A., Kanderzhanova, A., Foster, F., Colet, P. C., Stolyarova, V., & Sarría‐Santamera, A. (2024) · medRxiv · doi:10.1101/2024.11.18.24317472 · Cited by 2
Marks, T., Ge, X., Opie-Martin, S., Clarke, J., Xu, Y., Brine, R. J., Bakhai, M., & Clarke, G. M. (2026) · BMJ Open Quality · doi:10.1136/bmjoq-2025-003616 · Cited by 1
Luchowska, K., Chmielewska, M., Byszek, K., Olearczyk, A., Gawrońska, A., & Więckowska, B. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-088169 · Cited by 1
Willemsen, R. F., Aardoom, J. J., Goedegebuure, D., Tanwir, A., Chavannes, N. H., & Versluis, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5163863
Schelling, E. J., & van Linschoten, R. C. A. (2025) · medRxiv · doi:10.1101/2025.03.27.25322992
Raudne, R., & Tillmann, T. (2025) · JMIR Formative Research · doi:10.2196/59620
Hidalgo-Padilla, L., Dabbous, M., Halvorsrud, K., Beaney, T. E., Gideon, G., Gogarty, E., Greenfield, G., Hayhoe, B. W. J., Kerr, G. K., Raine, R., et al. (2025) · Online Journal of Public Health Informatics · doi:10.2196/66672 · Cited by 1
MediLoc: Navigating Healthcare with GIS Precision
Manishankar, S., Sunny, A. M., Benny, A., Indhu, C., & Mathew, S. (2025) · International Conference on Trends in Engineering Systems and Technologies (ICTEST) · doi:10.1109/ictest64710.2025.11042611
Leveraging Patient Views for Optimal Remote Care
Pinho-Costa, L., Pereira, A. L., Amorim, L., & Coelho, L. (2025) · TELe-Health · doi:10.1007/978-3-031-89661-3_12
Leung, K. (2025) · BMJ Open Quality · doi:10.1136/bmjoq-2024-002741 · Cited by 1
Rodrigues, D., Kreif, N., Darzi, A. W., Barahona, M., & Mayer, E. K. (2025) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-025-00361-w
Dahlberg, A., Kaartinen, T., Jukarainen, S., & Orre, P. (2025) · medRxiv · doi:10.1101/2025.11.06.25339651
Abell, B., Naicker, S., Rodwell, D., Donovan, T., Tariq, A., Baysari, M., Blythe, R. D., Parsons, R., & McPhail, S. (2023) · Figshare · doi:10.6084/m9.figshare.23788345
Abell, B., Naicker, S., Rodwell, D., Donovan, T., Tariq, A., Baysari, M., Blythe, R. D., Parsons, R., & McPhail, S. (2023) · Figshare · doi:10.6084/m9.figshare.23788348
44324 Digital Health Citizenship – a Spectrum from Invited to Uninvited Participation
Langstrup, H. (2025) · De Gruyter eBooks · doi:10.1515/9783111247854-024 · Cited by 1
Barros, G. D. M., Amaral, C. E. M., Macieira, C., de Freitas, M. A. C., de Paula, F. P., & dos Santos, A. D. F. (2026) · Telemedicine Journal and e-Health · doi:10.1177/15305627261471706
Eriksson, P., Thulesius, H. O., Bergman, P., & Hammar, T. (2026) · Research Square · doi:10.21203/rs.3.rs-10849007/v1
Lezcano, M., Pasini, M., Romá, V. G., Palma, M., & Landuzzi, M. G. (2026) · Safety Science · doi:10.1016/j.ssci.2026.107453
Telemedicine as a substitute for in-person primary care: Scenarios and boundaries
Zhao, Y., & Zhao, D. (2026) · Health Affairs Review · doi:10.3934/har.2026005
Zhang, W., Sousi, S., Greenfield, G., Lunova, T., Li, E., Hayhoe, B. W. J., Majeed, A., & Neves, A. L. (2026) · JMIR Formative Research · doi:10.2196/94743
Liu, J., Gong, X., Yang, T., Xu, R., Tan, L., & Ye, H. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001779
Metadata
- Authors
- Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C.
- Affiliations
- University of Manchester (GB)
- National Health Service (GB)
- Manchester Academic Health Science Centre (GB)
- Corresponding author
- Brown, Benjamin C
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-10-24
- Volume
- 24
- Issue
- 10
- Pages
- e37436
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9621309
- OpenAlex
- W4281898180
- Cited by
- 53
- References
- 97
- Citations by year
- 2026: 8 · 2025: 21 · 2024: 11 · 2023: 12 · 2022: 1
- FWCI
- 2.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Wellcome Trust (Z/17/Z, 209593/Z/17/Z)
- National Institute for Health and Care Research
- Department of Health and Social Care
- Patient Safety Translational Research Centre
- Innovate UK
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- teleconsultation, primary care quality, telemedicine, patient safety, staff workload, health care costs, patient satisfaction, primary care access, COVID-19 pandemic, multiple-choice questionnaires, health equity, system design and implementation, mental illness, communication difficulties, socioeconomic status
- MeSH terms
- COVID-19, Artificial Intelligence, Female, Humans, Male, Quality of Health Care, Referral and Consultation, United States, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

