Understanding How the Design and Implementation of Online Consultations Affect Primary Care Quality: Systematic Review of Evidence With Recommendations for Designers, Providers, and Researchers
Open accessPublished version of a preprint
The DOI matches its Crossref record; 96 of the 97 references it cites were found in a registry or an index.
Abstract
Background: Online consultations (OCs) allow patients to contact their care providers on the web. Worldwide, OCs have been rolled out in primary care rapidly owing to policy initiatives and COVID-19. There is a lack of evidence regarding how OC design and implementation influence care quality. Objective: We aimed to synthesize research on the impacts of OCs on primary care quality, and how these are influenced by system design and implementation. Methods: We searched databases from January 2010 to February 2022. We included quantitative and qualitative studies of real-world OC use in primary care. Quantitative data were transformed into qualitative themes. We used thematic synthesis informed by the Institute of Medicine domains of health care quality, and framework analysis informed by the nonadoption, abandonment, scale-up, spread, and sustainability framework. Strength of evidence was judged using the GRADE-CERQual approach. Results: We synthesized 63 studies from 9 countries covering 31 OC systems, 14 (22%) of which used artificial intelligence; 41% (26/63) of studies were published from 2020 onward, and 17% (11/63) were published after the COVID-19 pandemic. There was no quantitative evidence for negative impacts of OCs on patient safety, and qualitative studies suggested varied perceptions of their safety. Some participants believed OCs improved safety, particularly when patients could describe their queries using free text. Staff workload decreased when sufficient resources were allocated to implement OCs and patients used them for simple problems or could describe their queries using free text. Staff workload increased when OCs were not integrated with other software or organizational workflows and patients used them for complex queries. OC systems that required patients to describe their queries using multiple-choice questionnaires increased workload for patients and staff. Health costs decreased when patients used OCs for simple queries and increased when patients used them for complex queries. Patients using OCs were more likely to be female, younger, and native speakers, with higher socioeconomic status. OCs increased primary care access for patients with mental health conditions, verbal communication difficulties, and barriers to attending in-person appointments. Access also increased by providing a timely response to patients’ queries. Patient satisfaction increased when using OCs owing to better primary care access, although it decreased when using multiple-choice questionnaire formats. Conclusions: This is the first theoretically informed synthesis of research on OCs in primary care and includes studies conducted during the COVID-19 pandemic. It contributes new knowledge that, in addition to having positive impacts on care quality such as increased access, OCs also have negative impacts such as increased workload. Negative impacts can be mitigated through appropriate OC system design (eg, free text format), incorporation of advanced technologies (eg, artificial intelligence), and integration into technical infrastructure (eg, software) and organizational workflows (eg, timely responses). Trial Registration: PROSPERO CRD42020191802; https://tinyurl.com/2p84ezjy
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In this scoping review, we identified the risk of information being lost during virtual consultations, compromising understanding of the clinical picture and potentially leading to incorrect diagnoses [14].”
From Patient safety risk associated with synchronous telehealth: A scoping review (2025) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Stanton, B. F., & Rogers, E. M. (1963) · Journal of Farm Economics · doi:10.2307/1235767 · Cited by 6,675
Qualitative data analysis for applied policy research
Ritchie, J., & Spencer, L. (2010) · Analyzing qualitative data · doi:10.4324/9780203413081_chapter_9 · Cited by 4,800
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · cited 1×
“The methodological quality of the studies was assessed using the Mixed Methods Appraisal Tool (MMAT), which is designed for qualitative, quantitative, and mixed methods studies [76].”
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,245
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · cited 4×
“For objective 2, we considered OC “design” as material properties of an OC, such as features and functionality [74], and “implementation” as the way an OC was introduced and used in a particular context [65].”
InfluentialLewin, S., Glenton, C., Munthe-Kaas, H., Carlsen, B., Colvin, C. J., Gülmezoglu, M., Noyes, J., Booth, A., Garside, R., & Rashidian, A. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001895 · Cited by 866
Patient Portals and Patient Engagement: A State of the Science Review
Irizarry, T., DeVito Dabbs, A., & Curran, C. R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4255 · Cited by 732 · cited 1×
“Although symptom checkers [29,42] and patient portals [30,43,44] have been well studied, only a small number of evidence syntheses directly relevant to OCs have been published: a systematic review of 57 articles on delivering “e-consultation” in primary care largely focused on generic stand-alone…”
Methodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L., Carrier, J., Godfrey, C., Rieger, K., Salmond, S., Apóstolo, J., Kirkpatrick, P., & Loveday, H. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00169 · Cited by 700
Cresswell, K., & Sheikh, A. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.10.007 · Cited by 690 · cited 1×
“Furthermore, there are widely recognized challenges in initiating and sustaining the adoption of new technologies in primary care [41].”
Hobbs, F. D. R., Bankhead, C., Mukhtar, T., Stevens, S., Perera-Salazar, R., Holt, T., & Salisbury, C. (2016) · The Lancet · doi:10.1016/s0140-6736(16)00620-6 · Cited by 601
Abd-Alrazaq, A. A., Rababeh, A., Alajlani, M., Bewick, B. M., & Househ, M. (2020) · Journal of Medical Internet Research · doi:10.2196/16021 · Cited by 503 · cited 1×
“Although symptom checkers [29,42] and patient portals [30,43,44] have been well studied, only a small number of evidence syntheses directly relevant to OCs have been published: a systematic review of 57 articles on delivering “e-consultation” in primary care largely focused on generic stand-alone…”
Noyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Fisk, M., Livingstone, A., & Pit, S. W. (2020) · Journal of Medical Internet Research · doi:10.2196/19264 · Cited by 486
Murphy, M., Scott, L. J., Salisbury, C., Turner, A., Scott, A., Denholm, R., Lewis, R., Iyer, G., Macleod, J., & Horwood, J. (2021) · British Journal of General Practice · doi:10.3399/bjgp.2020.0948 · Cited by 486
Kruse, C. S., Bolton, K., & Freriks, G. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3171 · Cited by 379
The Impact of E-Visits on Visit Frequencies and Patient Health: Evidence from Primary Care
Bavafa, H., Hitt, L. M., & Terwiesch, C. (2018) · Management Science · doi:10.1287/mnsc.2017.2900 · Cited by 242
Addressing the crisis of GP recruitment and retention: a systematic review
Marchand, C., & Peckham, S. (2017) · British Journal of General Practice · doi:10.3399/bjgp17x689929 · Cited by 238
Chambers, D., Cantrell, A. J., Johnson, M., Preston, L., Baxter, S. K., Booth, A., & Turner, J. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-027743 · Cited by 218 · cited 1×
“Although symptom checkers [29,42] and patient portals [30,43,44] have been well studied, only a small number of evidence syntheses directly relevant to OCs have been published: a systematic review of 57 articles on delivering “e-consultation” in primary care largely focused on generic stand-alone…”
Daniel, H., Sulmasy, L. S., & for the Health and Public Policy Committee of the American College of Physicians* (2015) · Annals of Internal Medicine · doi:10.7326/m15-0498 · Cited by 202
Judson, T. J., Odisho, A. Y., Neinstein, A. B., Chao, J., Williams, A., Miller, C., Moriarty, T., Gleason, N., Intinarelli, G., & Gonzales, R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa051 · Cited by 195
Electronic Consultation in Primary Care Between Providers and Patients: Systematic Review
Mold, F., Hendy, J., Lai, Y.-L., & de Lusignan, S. (2019) · JMIR Medical Informatics · doi:10.2196/13042 · Cited by 181 · cited 8×
“Consistent with previous reviews relevant to OCs, we found a limited demographic of patients using OCs, leading to potential inequitable care [45,46].”
InfluentialSafety of patient-facing digital symptom checkers
Fraser, H., Coiera, E., & Wong, D. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32819-8 · Cited by 180
Self-citationJoy, M., McGagh, D., Jones, N., Liyanage, H., Sherlock, J., Parimalanathan, V., Akinyemi, O., van Vlymen, J., Howsam, G., Marshall, M., et al. (2020) · British Journal of General Practice · doi:10.3399/bjgp20x710933 · Cited by 178
Virtual Visits and Patient-Centered Care: Results of a Patient Survey and Observational Study
McGrail, K. M., Ahuja, M. A., & Leaver, C. A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7374 · Cited by 176
Mehrotra, A., Paone, S., Martich, G. D., Albert, S. M., & Shevchik, G. J. (2013) · JAMA Internal Medicine · doi:10.1001/2013.jamainternmed.305 · Cited by 150
The State of Evidence in Patient Portals: Umbrella Review
Antonio, M. G., Petrovskaya, O., & Lau, F. (2020) · Journal of Medical Internet Research · doi:10.2196/23851 · Cited by 146
Electronic Communication Improves Access, But Barriers To Its Widespread Adoption Remain
Bishop, T. F., Press, M. J., Mendelsohn, J. L., & Casalino, L. P. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.1151 · Cited by 117
Inequalities in general practice remote consultations: a systematic review
Parker, R. F., Figures, E. L., Paddison, C. A., Matheson, J. I., Blane, D. N., & Ford, J. A. (2021) · BJGP Open · doi:10.3399/bjgpo.2021.0040 · Cited by 115
Royal New Zealand College of General Practitioners.
West, S. R. (1980) · PubMed · Cited by 111
Edwards, H. B., Marques, E., Hollingworth, W., Horwood, J., Farr, M., Bernard, E., Salisbury, C., & Northstone, K. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016901 · Cited by 110
Use of an electronic consultation system in primary care: a qualitative interview study
Banks, J., Farr, M., Salisbury, C., Bernard, E., Northstone, K., Edwards, H., & Horwood, J. (2018) · British Journal of General Practice · doi:10.3399/bjgp17x693509 · Cited by 108
Alternatives to the face-to-face consultation in general practice: focused ethnographic case study
Atherton, H., Brant, H., Ziebland, S., Bikker, A., Campbell, J., Gibson, A., McKinstry, B., Porqueddu, T., & Salisbury, C. (2018) · British Journal of General Practice · doi:10.3399/bjgp18x694853 · Cited by 107 · cited 3×
“Multimedia Appendix 7 [13,59,99] and Multimedia Appendix 8 [3, 5, 8-11, 13-17, 19-21, 25, 27, 54, 57, 59, 60, 63, 64, 71, 85, 90, 91, 95, 97, 100, 101] detail the low-confidence findings.”
Farr, M., Banks, J., Edwards, H. B., Northstone, K., Bernard, E., Salisbury, C., & Horwood, J. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019966 · Cited by 106
Abimbola, S., Patel, B., Peiris, D., Patel, A., Harris, M., Usherwood, T., & Greenhalgh, T. (2019) · BMC Medicine · doi:10.1186/s12916-019-1463-x · Cited by 102 · cited 1×
“We used the NASSS to capture “a rich, contextualised narrative of technology-supported change efforts and the numerous interacting influences that help explain its successes, failures, and unexpected events” [75].”
Impact of Patient Portal Secure Messages and Electronic Visits on Adult Primary Care Office Visits
North, F., Crane, S. J., Chaudhry, R., Ebbert, J. O., Ytterberg, K., Tulledge-Scheitel, S. M., & Stroebel, R. J. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0097 · Cited by 100
Characteristics of Patients Who Seek Care via eVisits Instead of Office Visits
Mehrotra, A., Paone, S., Martich, G. D., Albert, S. M., & Shevchik, G. J. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2012.0221 · Cited by 98
Pilot Study of Providing Online Care in a Primary Care Setting
Adamson, S. C., & Bachman, J. W. (2010) · Mayo Clinic Proceedings · doi:10.4065/mcp.2010.0145 · Cited by 95
Unintended consequences of online consultations: a qualitative study in UK primary care
Turner, A., Morris, R., Rakhra, D., Stevenson, F., McDonagh, L., Hamilton, F., Atherton, H., Farr, M., Blake, S., Banks, J., et al. (2022) · British Journal of General Practice · doi:10.3399/bjgp.2021.0426 · Cited by 92 · cited 2×
“Multimedia Appendix 7 [13,59,99] and Multimedia Appendix 8 [3, 5, 8-11, 13-17, 19-21, 25, 27, 54, 57, 59, 60, 63, 64, 71, 85, 90, 91, 95, 97, 100, 101] detail the low-confidence findings.”
Cowie, J., Calveley, E., Bowers, G., & Bowers, J. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15050896 · Cited by 89 · cited 3×
“Reasons included the amount of work required to complete them [14], their inflexibility in obtaining the answers patients wanted from their primary care provider [9], and that they could be confusing to navigate [25].”
Atherton, H., Brant, H., Ziebland, S., Bikker, A., Campbell, J., Gibson, A., McKinstry, B., Porqueddu, T., & Salisbury, C. (2018) · Health Services and Delivery Research · doi:10.3310/hsdr06200 · Cited by 82
Gottliebsen, K., & Petersson, G. (2020) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2019-100114 · Cited by 80
Impact of Remote Consultations on Antibiotic Prescribing in Primary Health Care: Systematic Review
Han, S. M., Greenfield, G., Majeed, A., & Hayhoe, B. (2020) · Journal of Medical Internet Research · doi:10.2196/23482 · Cited by 80 · cited 1×
“However, they have the potential to exacerbate health inequities [38,39] and increase inappropriate antibiotic prescriptions [40].”
Ekman, B., Thulesius, H., Wilkens, J., Lindgren, A., Cronberg, O., & Arvidsson, E. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.04.016 · Cited by 70
Stamenova, V., Agarwal, P., Kelley, L., Fujioka, J., Nguyen, M., Phung, M., Wong, I., Onabajo, N., Bhatia, R. S., & Bhattacharyya, O. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037064 · Cited by 70
Eldh, A. C., Sverker, A., Bendtsen, P., & Nilsson, E. (2020) · JMIR Human Factors · doi:10.2196/21698 · Cited by 70
Zanaboni, P., & Fagerlund, A. J. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034773 · Cited by 68 · cited 1×
“…significantly to become more specialized and technologically advanced [51], with several more empirical research studies published on their use [2-11 Given this rapid scale-up and increase in the diversity and complexity of OCs, further insight is needed into their impact on health care…”
Patient-generated secure messages and eVisits on a patient portal: are patients at risk?
North, F., Crane, S. J., Stroebel, R. J., Cha, S. S., Edell, E. S., & Tulledge-Scheitel, S. M. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001208 · Cited by 66 · cited 1×
“However, quantitative evidence from 17% (11/63) of the studies did not support these concerns in terms of emergency department attendance rates [92], hospitalizations [70], deaths [88], and other measures [59].”
Neves, A. L., Li, E., Gupta, P. P., Fontana, G., & Darzi, A. W. (2021) · European Journal of General Practice · doi:10.1080/13814788.2021.1965120 · Cited by 62
Fagerlund, A. J., Holm, I. M., & Zanaboni, P. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028251 · Cited by 61
Albert, S. M., Shevchik, G. J., Paone, S., & Martich, G. D. (2011) · Telemedicine and e-Health · doi:10.1089/tmj.2010.0156 · Cited by 58
Marshall, M., Shah, R., & Stokes-Lampard, H. (2018) · BMJ · doi:10.1136/bmj.k1195 · Cited by 58
Jung, C., & Padman, R. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.08.004 · Cited by 57
Exploring how virtual primary care visits affect patient burden of treatment
Kelley, L. T., Phung, M., Stamenova, V., Fujioka, J., Agarwal, P., Onabajo, N., Wong, I., Nguyen, M., Bhatia, R. S., & Bhattacharyya, O. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104228 · Cited by 56
Eccles, A., Hopper, M., Turk, A., & Atherton, H. (2019) · British Journal of General Practice · doi:10.3399/bjgp19x702197 · Cited by 55
Carter, M., Fletcher, E., Sansom, A., Warren, F. C., & Campbell, J. L. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018688 · Cited by 54 · cited 3×
“Filling out long lists of questions shifted work from the clinician to the patient [20], and staff found them burdensome to read [86].”
Barriers and Enablers in Implementing Electronic Consultations in Primary Care: Scoping Review
Baines, R., Tredinnick‐Rowe, J., Jones, R. B., & Chatterjee, A. (2020) · Journal of Medical Internet Research · doi:10.2196/19375 · Cited by 52
Nilsson, E., Sverker, A., Bendtsen, P., & Eldh, A. C. (2021) · Journal of Medical Internet Research · doi:10.2196/29868 · Cited by 48
Leng, S., MacDougall, M., & McKinstry, B. (2016) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v23i2.141 · Cited by 45
Non-use of Digital Health Consultations Among Swedish Elderly Living in the Countryside
Landgren, S., & Cajander, Å. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.588583 · Cited by 45
Cajander, Å., Larusdottir, M. K., & Hedström, G. (2020) · Quality and User Experience · doi:10.1007/s41233-020-00038-x · Cited by 44
López Seguí, F., Vidal-Alaball, J., Sagarra Castro, M., García-Altés, A., & García Cuyàs, F. (2020) · Journal of Medical Internet Research · doi:10.2196/14478 · Cited by 42
Experiences with online consultation systems in primary care: case study of one early adopter site
Casey, M., Shaw, S., & Swinglehurst, D. (2017) · British Journal of General Practice · doi:10.3399/bjgp17x693137 · Cited by 41
Impact of Online Primary Care Visits on Standard Costs: A Pilot Study
Rohrer, J. E., Angstman, K. B., Adamson, S. C., Bernard, M. E., Bachman, J. W., & Morgan, M. E. (2010) · Population Health Management · doi:10.1089/pop.2009.0018 · Cited by 40 · cited 1×
“Multimedia Appendix 7 [13,59,99] and Multimedia Appendix 8 [3, 5, 8-11, 13-17, 19-21, 25, 27, 54, 57, 59, 60, 63, 64, 71, 85, 90, 91, 95, 97, 100, 101] detail the low-confidence findings.”
Who are portal users vs. early e-Visit adopters? A preliminary analysis.
Jung, C., Padman, R., Shevchik, G. J., & Paone, S. (2011) · PubMed Central · Cited by 39
Comparison of eVisit Management of Urinary Symptoms and Urinary Tract Infections with Standard Care
Murray, M. A., Penza, K. S., Myers, J. F., Furst, J. W., & Pecina, J. L. (2020) · Telemedicine and e-Health · doi:10.1089/tmj.2019.0044 · Cited by 39 · cited 2×
“Multimedia Appendix 7 [13,59,99] and Multimedia Appendix 8 [3, 5, 8-11, 13-17, 19-21, 25, 27, 54, 57, 59, 60, 63, 64, 71, 85, 90, 91, 95, 97, 100, 101] detail the low-confidence findings.”
Johnson, K. M., Dumkow, L. E., Burns, K. W., Yee, M. A., & Egwuatu, N. E. (2019) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofz393 · Cited by 39 · cited 1×
“Multimedia Appendix 7 [13,59,99] and Multimedia Appendix 8 [3, 5, 8-11, 13-17, 19-21, 25, 27, 54, 57, 59, 60, 63, 64, 71, 85, 90, 91, 95, 97, 100, 101] detail the low-confidence findings.”
Johansson, A., Larsson, M., & Ivarsson, B. (2020) · Journal of Primary Care & Community Health · doi:10.1177/2150132720909656 · Cited by 39
López Seguí, F., Walsh, S., Solans, O., Adroher Mas, C., Ferraro, G., García-Altés, A., García Cuyàs, F., Salvador Carulla, L., Sagarra Castro, M., & Vidal-Alaball, J. (2020) · Journal of Medical Internet Research · doi:10.2196/19149 · Cited by 36
Entezarjou, A., Bolmsjö, B. B., Calling, S., Midlöv, P., & Milos Nymberg, V. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036585 · Cited by 35
Five cards: a simple guide to beginning the consultation
Larsen, J.-H., & Neighbour, R. (2014) · British Journal of General Practice · doi:10.3399/bjgp14x677662 · Cited by 33
Use, cost, and digital divide in online public health care: lessons from Denmark
Andersen, K. N., Nielsen, J. A., & Kim, S. (2019) · Transforming Government People Process and Policy · doi:10.1108/tg-06-2018-0041 · Cited by 33
Hertzog, R., Johnson, J. D., Smith, J., McStay, F. W., da Graca, B., Haneke, T. W., Heavener, T. E., & Couchman, G. R. (2019) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2019.02.011 · Cited by 32
Penza, K. S., Murray, M. A., Pecina, J. L., Myers, J. F., & Furst, J. W. (2018) · Telemedicine and e-Health · doi:10.1089/tmj.2017.0091 · Cited by 31 · cited 2×
“[70], younger (27/63, 43”
How to conduct written online consultations with patients in primary care
Bakhai, M., & Atherton, H. (2021) · BMJ · doi:10.1136/bmj.n264 · Cited by 30
Management of Acute Sinusitis via e-Visit
Penza, K. S., Murray, M. A., Myers, J. F., Furst, J. W., & Pecina, J. L. (2020) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2020.0047 · Cited by 29
Wilson, G., Currie, O., Bidwell, S., Saeed, B., Dowell, A. C., Halim, A. A., Toop, L. J., Richardson, A. K., Savage, R. L., & Hudson, B. (2021) · PubMed · Cited by 27
eVisit: A Pilot Study of a New Kind of Healthcare Delivery
Rema, P., Grant, S., Suzanne, P., Carl, D., & Jody, C. (2010) · Studies in Health Technology and Informatics · doi:10.3233/978-1-60750-588-4-262 · Cited by 24
Electronic Visits For Common Acute Conditions: Evaluation Of A Recently Established Program
Player, M. S., O'Bryan, E. C., Sederstrom, E., Pinckney, J., & Díaz, V. A. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.05122 · Cited by 24
Entezarjou, A., Bonamy, A. E., Benjaminsson, S., Herman, P. A., & Midlöv, P. (2020) · JMIR Medical Informatics · doi:10.2196/18930 · Cited by 21
Examining GP online consultation in a primary care setting in east midlands, UK
Nijhof, D., Ingram, A., Ochieng, R., Roberts, E.-J., Poulton, B. C., & Ochieng, B. M. N. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-07039-2 · Cited by 21
Danish Citizens and General Practitioners' Use of ICT for their Mutual Communication
Pernille, B., & Lone, S. P. (2015) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-564-7-376 · Cited by 19
Johansson, A., Larsson, M., & Ivarsson, B. (2020) · Journal of Primary Care & Community Health · doi:10.1177/2150132720910564 · Cited by 18
Ruas, S. S. M., & Assunção, A. Á. (2013) · Telemedicine and e-Health · doi:10.1089/tmj.2012.0095 · Cited by 17
Chen, L., & Wong, G. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809633-8.20204-5 · Cited by 15
Prevalence and Factors Associated with Family Physicians Providing E-Visits
Peabody, M. R., Dai, M., Turner, K. L., Peterson, L. E., & Mainous, A. G. (2019) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2019.06.190081 · Cited by 14
Using Virtual Visits to Care for Primary Care Patients With COVID-19 Symptoms
Tarn, D. M., Hintz, C. N., Mendez-Hernandez, E., Sawlani, S. P., & Bholat, M. A. (2021) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2021.s1.200241 · Cited by 14
Integrating telehealth in to ‘business as usual’: Is it really possible?
Jury, S. C., & Kornberg, A. J. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16675802 · Cited by 12
Fernández, O. S., Seguí, F. L., Vidal-Alaball, J., Bonet Simo, J. M., Vian, O. H., Cabo, P. R., Hernandez, M. C., Dominguez, C. O., Reig, X. A., Rodríguez, Y. D., et al. (2020) · JMIR Medical Informatics · doi:10.2196/16484 · Cited by 12
Leung, K., & Qureshi, S. (2021) · BMJ Open Quality · doi:10.1136/bmjoq-2020-001310 · Cited by 8
Nijland, N., van Gemert‐Pijnen, J. E. W. C., Kelders, S. M., Brandenburg, B. J., & Seydel, E. R. (2010) · PubMed · Cited by 7
GP Online: turning expectations into reality with the new NHS app
Beaney, P., Odulaja, A., Hadley, A., Prince, C., & Ruth Chambers, O. B. E. (2019) · British Journal of General Practice · doi:10.3399/bjgp19x701333 · Cited by 7
Nijland, N., van Gemert‐Pijnen, J. E. W. C., Kelders, S. M., Brandenburg, B. J., & Seydel, E. R. (2010) · International Conference on eHealth, Telemedicine, and Social Medicine · doi:10.1109/etelemed.2010.33 · Cited by 6
LAWLESS, M., Wright, E., & Davidson, J. (2016) · London Journal of Primary Care · doi:10.1080/17571472.2016.1173946 · Cited by 6
Research works printed but not linked: 6
- GM Digital First Primary Care: Patient and public insights: Workshop resultsHealth Innovation Manchester20202021-09-01https://healthinnovationmanchester.com/our-work/gm-digital-first-primary-care/
- Wilson, G, 2021, N Z Med J, 134, 89
- Pawson, R, 1997, Realistic Evaluation
- 2001, Crossing the Quality Chasm: A New Health System for the 21st Century
- Padman, R, 2010, Stud Health Technol Inform, 160, 262
- Jung, C, 2011, AMIA Annu Symp Proc, 2011, 1070
Cited by
The Role of AI in Hospitals and Clinics: Transforming Healthcare in the 21st Century
Maleki Varnosfaderani, S., & Forouzanfar, M. (2024) · Bioengineering · doi:10.3390/bioengineering11040337 · Cited by 931
Abell, B., Naicker, S., Rodwell, D., Donovan, T., Tariq, A., Baysari, M., Blythe, R., Parsons, R., & McPhail, S. M. (2023) · Implementation Science · doi:10.1186/s13012-023-01287-y · Cited by 131
Telemedicine and Digital Tools in Dentistry: Enhancing Diagnosis and Remote Patient Care
Surdu, A. E., Foia, C. I., Luchian, I. A., Trifan, D., Budală, D. G., Scutariu, M. M., Ciupilan, C., Puha, B., & Tatarciuc, D. (2025) · Medicina · doi:10.3390/medicina61050826 · Cited by 68
Challenges to quality in contemporary, hybrid general practice a multi-site longitudinal case study
Payne, R., Dakin, F., MacIver, E., Swann, N., Pring, T., Clarke, A., Kalin, A., Moore, L., Ladds, E. C., Wherton, J. P., et al. (2024) · British Journal of General Practice · doi:10.3399/bjgp.2024.0184 · Cited by 45
Vestesson, E., Corte, K. D., Crellin, E., Ledger, J., Bakhai, M., & Clarke, G. M. (2023) · JMIR Public Health and Surveillance · doi:10.2196/44944 · Cited by 41
Metadata
- Authors
- Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C.
- Affiliations
- University of Manchester (GB)
- National Health Service (GB)
- Manchester Academic Health Science Centre (GB)
- Corresponding author
- Brown, Benjamin C
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-10-24
- Volume
- 24
- Issue
- 10
- Pages
- e37436
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC9621309
- OpenAlex
- W4281898180
- Cited by
- 53
- References
- 97
- Citations by year
- 2026: 8 · 2025: 21 · 2024: 11 · 2023: 12 · 2022: 1
- FWCI
- 2.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Wellcome Trust (Z/17/Z, 209593/Z/17/Z)
- National Institute for Health and Care Research
- Department of Health and Social Care
- Patient Safety Translational Research Centre
- Innovate UK
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Systems and Technology
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- teleconsultation, primary care quality, telemedicine, patient safety, staff workload, health care costs, patient satisfaction, primary care access, COVID-19 pandemic, multiple-choice questionnaires, health equity, system design and implementation, mental illness, communication difficulties, socioeconomic status
- MeSH terms
- COVID-19, Artificial Intelligence, Female, Humans, Male, Quality of Health Care, Referral and Consultation, United States, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

