Evaluation of a Digital Consultation and Self-Care Advice Tool in Primary Care: A Multi-Methods Study
Open accessAbstract
Digital services are often regarded as a solution to the growing demands on primary care services. Provision of a tool offering advice to support self-management as well as the ability to digitally consult with a General Practitioner (GP) has the potential to alleviate some of the pressure on primary care. This paper reports on a Phase II, 6-month evaluation of eConsult, a web-based triage and consultation system that was piloted across 11 GP practices across Scotland. Through a multi-method approach the evaluation explored eConsult use across practices, exposing both barriers and facilitators to its adoption. Findings suggest that expectations that eConsult would offer an additional and alternative method of accessing GP services were largely met. However, there is less certainty that it has fulfilled expectations of promoting self-help. In addition, low uptake meant that evaluation of current effectiveness was difficult for practices to quantify. The presence of an eConsult champion(s) within the practice was seen to be a significant factor in ensuring successful integration of the tool. A lack of patient and staff engagement, insufficient support and lack of protocols around processes were seen as barriers to its success.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An economic evaluation of eConsult found no added costs, but could not tell if savings were made owing to low usage.
“An economic evaluation of eConsult found no added costs, but they were unable to tell if savings were made owing to low usage. 40”
From Effectiveness and safety of asynchronous telemedicine consultations in general practice: a systematic review (2024) · cites this paper as [40]
Three studies reported patient use of asynchronous telemedicine increased gradually before the pandemic, and in 2016 20% of UK general practices planned to introduce it.
“Three studies reported patient use of asynchronous telemedicine increased gradually before the pandemic 26,31–33,40 and in 2016 20% of UK general practices planned to introduce it. 49”
From Effectiveness and safety of asynchronous telemedicine consultations in general practice: a systematic review (2024) · cites this paper as [40]
Citation 49 is attached to the assertion that, in 2016, 20% of UK general practices planned to introduce asynchronous telemedicine. The Introduction discusses slow uptake of online consultations, and Results §3.1 reports use in a 2017 Scottish pilot, but neither gives the claimed 2016 UK-wide figure. Searches for “20%,” “one in five,” and plans to introduce online consultations found no passage addressing it; the earlier claim about gradual patient use has separate citations. (LLM, conf=0.76)
Experimental — accuracy not yet measuredThese barriers and challenges are consistent with other qualitative studies.
“These barriers and challenges are consistent with other qualitative studies [87,92].”
From Effectiveness and Acceptability of Asynchronous Digital Health in Asthma Care: Mixed Methods Systematic Review (2024) · cites this paper as [92]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Gale, N. K., Heath, G., Cameron, E., Rashid, S., & Redwood, S. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-117 · Cited by 10,865 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Murray, E., Treweek, S., Pope, C., MacFarlane, A., Ballini, L., Dowrick, C., Finch, T., Kennedy, A., Mair, F., O'Donnell, C., et al. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-63 · Cited by 1,478 · see citing works
Kitson, A. L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K., & Titchen, A. (2008) · Implementation Science · doi:10.1186/1748-5908-3-1 · Cited by 1,314 · see citing works
Qualitative research methods in health technology assessment: a review of the literature.
Murphy, Dingwall, Greatbatch, Parker, & Watson (1998) · Health Technology Assessment · doi:10.3310/hta2160 · Cited by 1,107 · see citing works
Vimalananda, V. G., Gupte, G., Seraj, S. M., Orlander, J., Berlowitz, D., Fincke, B. G., & Simon, S. R. (2015) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15582108 · Cited by 437 · see citing works
Kontopantelis, E., Roland, M. O., & Reeves, D. (2010) · BMC Family Practice · doi:10.1186/1471-2296-11-61 · Cited by 192 · see citing works
Liddy, C., Afkham, A., Drosinis, P., Joschko, J., & Keely, E. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.03.140255 · Cited by 140 · see citing works
Brant, H., Atherton, H., Ziebland, S., McKinstry, B., Campbell, J. L., & Salisbury, C. (2016) · British Journal of General Practice · doi:10.3399/bjgp16x685597 · Cited by 120 · see citing works
Edwards, H. B., Marques, E., Hollingworth, W., Horwood, J., Farr, M., Bernard, E., Salisbury, C., & Northstone, K. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-016901 · Cited by 110 · see citing works
Use of an electronic consultation system in primary care: a qualitative interview study
Banks, J., Farr, M., Salisbury, C., Bernard, E., Northstone, K., Edwards, H., & Horwood, J. (2018) · British Journal of General Practice · doi:10.3399/bjgp17x693509 · Cited by 108 · see citing works
Nijland, N., van Gemert-Pijnen, J. E. W. C., Boer, H., Steehouder, M. F., & Seydel, E. R. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2009.06.002 · Cited by 84 · see citing works
Hanna, L., May, C. R., & Fairhurst, K. (2011) · Family Practice · doi:10.1093/fampra/cmr087 · Cited by 63 · see citing works
Lenzen, S. A., Daniëls, R., van Bokhoven, M. A., van der Weijden, T., & Beurskens, A. J. H. M. (2014) · European Journal of General Practice · doi:10.3109/13814788.2014.973844 · Cited by 48 · see citing works
eHealth for inflammatory bowel disease self-management – the patient perspective
Con, D., Jackson, B., Gray, K., & De Cruz, P. (2017) · Scandinavian Journal of Gastroenterology · doi:10.1080/00365521.2017.1333625 · Cited by 38 · see citing works
Gagnon, M., Légaré, F., Fortin, J., Lamothe, L., Labrecque, M., & Duplantie, J. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-17 · Cited by 23 · see citing works
Chang, F., Paramsothy, T., Roche, M., & Gupta, N. S. (2016) · Primary Health Care Research & Development · doi:10.1017/s1463423616000414 · Cited by 23 · see citing works
Witry, M. J., Comellas, A. P., Simmering, J. E., & Polgreen, P. M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9382 · Cited by 22 · see citing works
Can E-Health Support Programme Improve Self-Management for Diabetes Patients in the Community?
Wong, E. M. L., & Lam, G. Y. (2016) · Journal of Community & Public Health Nursing · doi:10.4172/2471-9846.1000e111 · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [17]Andreassen H. Trondsen M. How to Use Qualitative Interviews in E-health Research Proceedings of the 17th International Conference on eHealth, Telemedicine, and Social Medicine: eTELEMED Lisbon, Portugal 22–27 February 2015
- [18]Ritchie J. Spencer L. Qualitative data analysis for applied policy research Analyzing Qualitative Data Bryman A. Burgess R.G. Taylor & Francis Group London, UK 1994 173 194
Cited by
Sorted by citations
The ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105 · see citing works
Legal and Ethical Consideration in Artificial Intelligence in Healthcare: Who Takes Responsibility?
Naik, N., Hameed, B. M. Z., Shetty, D. K., Swain, D., Shah, M., Paul, R., Aggarwal, K., Ibrahim, S., Patil, V., Smriti, K., et al. (2022) · Frontiers in Surgery · doi:10.3389/fsurg.2022.862322 · Cited by 931 · see citing works
Chambers, D., Cantrell, A. J., Johnson, M., Preston, L., Baxter, S. K., Booth, A., & Turner, J. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-027743 · Cited by 218 · see citing works
Unintended consequences of online consultations: a qualitative study in UK primary care
Turner, A., Morris, R., Rakhra, D., Stevenson, F., McDonagh, L., Hamilton, F., Atherton, H., Farr, M., Blake, S., Banks, J., et al. (2022) · British Journal of General Practice · doi:10.3399/bjgp.2021.0426 · Cited by 92 · see citing works
Gottliebsen, K., & Petersson, G. (2020) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2019-100114 · Cited by 80 · see citing works
The Debate on the Ethics of AI in Health Care: a Reconstruction and Critical Review
Morley, J., Machado, C., Burr, C., Cowls, J., Taddeo, M., & Floridi, L. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3486518 · Cited by 66 · see citing works
Darley, S., Coulson, T., Peek, N., Moschogianis, S., van der Veer, S. N., Wong, D. C., & Brown, B. C. (2022) · Journal of Medical Internet Research · doi:10.2196/37436 · Cited by 53 · see citing works
López Seguí, F., Vidal-Alaball, J., Sagarra Castro, M., García-Altés, A., & García Cuyàs, F. (2020) · Journal of Medical Internet Research · doi:10.2196/14478 · Cited by 42 · see citing works
Leighton, C., Cooper, A., Porter, A., Edwards, A., & Joseph-Williams, N. (2024) · BJGP Open · doi:10.3399/bjgpo.2023.0177 · Cited by 34 · see citing works
“Two studies found socioeconomic factors had no effect on uptake, 31–33,40”
BackgroundRemote Consultations in General Practice—A Systematic Review
Vodička, S., & Zelko, E. (2022) · Slovenian Journal of Public Health · doi:10.2478/sjph-2022-0030 · Cited by 19 · see citing works
Uzzaman, N., Hammersley, V., McClatchey, K., Sheringham, J., Singh, D., Habib, G. M., & Pinnock, H. (2024) · Journal of Medical Internet Research · doi:10.2196/57708 · Cited by 13 · see citing works
- Authors
- Cowie, J., Calveley, E., Bowers, G., & Bowers, J.
- Affiliations
- University of Stirling (GB)
- University of Glasgow (GB)
- Corresponding author
- Cowie, Julie
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2018-05-02
- Volume
- 15
- Issue
- 5
- Pages
- 896
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC5981935
- OpenAlex
- W2800943224
- Cited by
- 89
- References
- 19
- Citations by year
- 2026: 2 · 2025: 13 · 2024: 11 · 2023: 11 · 2022: 17 · 2021: 16 · 2020: 12 · 2019: 6
- FWCI
- 8.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
- ResearchOnline (Glasgow Caledonian University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Stirling Online Research Repository (University of Stirling) (submittedVersion, cc-by)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Healthcare Systems and Technology
- Keywords
- e-consultation, digital health services, primary care, self-care advice, self-management, triage, general practitioners, technology adoption barriers and facilitators, patient engagement, employee engagement, workload reduction
- MeSH terms
- Adolescent, Adult, Aged, Female, Humans, Male, Middle Aged, Primary Health Care, Scotland, Self Care, Triage, Remote Consultation, Internet, Young Adult, General Practitioners
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review