Advantages and limitations of virtual online consultations in a NHS acute trust: the VOCAL mixed-methods study
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Background: There is much enthusiasm from clinicians, industry and the government to utilise digital technologies and introduce alternatives to face-to-face consultations. Objective(s): To define good practice and inform digital technology implementation in relation to remote consultations via Skype™ (Microsoft Corporation, Redmond, WA, USA) and similar technologies. Design: Multilevel mixed-methods study of remote video consultations (micro level) embedded in an organisational case study (meso level), taking account of the national context and wider influences (macro level). Setting: Three contrasting clinical settings (Diabetes, Antenatal Diabetes and Cancer Surgery) in a NHS acute trust. Data collection and analysis: Macro level – interviews with 12 national-level stakeholders combined with document analysis. Meso level – longitudinal organisational ethnography comprising over 300 hours of observations, 24 staff interviews and analysis of 16 documents. Micro level – 30 video-recorded remote consultations; 17 matched audio-recorded face-to-face consultations. Interview and ethnographic data were analysed thematically and theorised using strong structuration theory. Consultations were transcribed verbatim and analysed using the Roter interaction analysis system (RIAS), producing descriptive statistics on different kinds of talk and interaction. Results: Policy-makers viewed remote video consultations as a way of delivering health care efficiently in the context of rising rates of chronic illness and growing demand for services. However, the reality of establishing such services in a busy and financially stretched NHS acute trust proved to be far more complex and expensive than anticipated. Embedding new models of care took much time and many resources, and required multiple workarounds. Considerable ongoing effort was needed to adapt and align structures, processes and people within clinics and across the organisation. For practical and safety reasons, virtual consultations were not appropriate for every patient or every consultation. By the end of this study, between 2% and 20% of all consultations were being undertaken remotely in participating clinics. Technical challenges in setting up such consultations were typically minor, but potentially prohibitive. When clinical, technical and practical preconditions were met, virtual consultations appeared to be safe and were popular with both patients and staff. Compared with face-to-face consultations, virtual consultations were very slightly shorter, patients did slightly more talking and both parties sometimes needed to make explicit things that typically remained implicit in a traditional encounter. Virtual consultations appeared to work better when the clinician and the patient knew and trusted each other. Some clinicians used Skype adaptively to support ad hoc clinician-initiated and spontaneous patient-initiated encounters. Other clinicians chose not to use the new service model at all. Conclusions: Virtual consultations appear to be safe, effective and convenient for patients who are preselected by their clinicians as ‘suitable’, but such patients represent a small fraction of clinic workloads. There are complex challenges to embedding virtual consultation services within routine practice in the NHS. Roll-out (across the organisation) and scale-up (to other organisations) are likely to require considerable support. Limitations: The focus on a single NHS organisation raises questions about the transferability of findings, especially quantitative data on likely uptake rates. Future research: Further studies on the micro-analysis of virtual consultations and on the spread and scale-up of virtual consulting services are planned. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Five misunderstandings about case-study research
Flyvbjerg, B. (2006) · Qualitative Inquiry · doi:10.1177/1077800405284363 · Cited by 14,266
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Self-citationReconceptualizing Organizational Routines as a Source of Flexibility and Change
Feldman, M. S., & Pentland, B. T. (2003) · Administrative Science Quarterly · doi:10.2307/3556620 · Cited by 4,020
Development and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520 · cited 1×
“A study of family based behavioural support for adolescents with poorly controlled type 1 diabetes focused on the ‘working alliance’ (the strength of the relationships between patients, caregivers and health-care professionals).(129) Findings showed that 10 sessions via Skype were as effective at preserving the workin…”
BackgroundEmerson, R. M. (1976) · Annual Review of Sociology · doi:10.1146/annurev.so.02.080176.002003 · Cited by 3,457
Barley, S. R. (1986) · Administrative Science Quarterly · doi:10.2307/2392767 · Cited by 2,315
Text messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190
Mobile Text Messaging for Health: A Systematic Review of Reviews
Hall, A. K., Cole-Lewis, H., & Bernhardt, J. M. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122855 · Cited by 815
Rodgers, A., Corbett, T., Bramley, D., Riddell, T., Wills, M., Lin, R.-B., & Jones, M. (2005) · Tobacco Control · doi:10.1136/tc.2005.011577 · Cited by 732
Steventon, A., Bardsley, M., Billings, J., Dixon, J., Doll, H., Hirani, S., Cartwright, M., Rixon, L., Knapp, M., Henderson, C., et al. (2012) · BMJ · doi:10.1136/bmj.e3874 · Cited by 583 · cited 4×
“At the macro level, we found that remote video consultation was viewed by policy-makers with much enthusiasm as a way of delivering health care efficiently to a population with rising rates of chronic illness at a time of progressively worsening funding pressures on the NHS.”
BackgroundInfluentialPrinciples of Sociotechnical Design Revisted
Cherns, A. (1987) · Human Relations · doi:10.1177/001872678704000303 · Cited by 545
GREENHALGH, T., POTTS, H. W. W., WONG, G., BARK, P., & SWINGLEHURST, D. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00578.x · Cited by 541
Self-citationVimalananda, V. G., Gupte, G., Seraj, S. M., Orlander, J., Berlowitz, D., Fincke, B. G., & Simon, S. R. (2015) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x15582108 · Cited by 437
Stones, R. (2005) · doi:10.1007/978-0-230-21364-7 · Cited by 400
Theorising big IT programmes in healthcare: Strong structuration theory meets actor-network theory
Greenhalgh, T., & Stones, R. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.12.034 · Cited by 371
Self-citationA systematic review of economic analyses of telehealth services using real time video communication
Wade, V. A., Karnon, J., Elshaug, A. G., & Hiller, J. E. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-233 · Cited by 351
Greenhalgh, T., Hinder, S., Stramer, K., Bratan, T., & Russell, J. (2010) · BMJ · doi:10.1136/bmj.c5814 · Cited by 343 · cited 1×
“In reality, the literature on national roll-outs of ‘transformational’ IT projects in health care suggests that this assumption may be overoptimistic.(69) Indeed, just because a DOI: 10.”
BackgroundSelf-citationSMS STI: A Review of the Uses of Mobile Phone Text Messaging in Sexual Health
Lim, M. S. C., Hocking, J. S., Hellard, M. E., & Aitken, C. K. (2008) · International Journal of STD & AIDS · doi:10.1258/ijsa.2007.007264 · Cited by 293
Why Do Evaluations of eHealth Programs Fail? An Alternative Set of Guiding Principles
Greenhalgh, T., & Russell, J. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000360 · Cited by 273
Self-citationViers, B. R., Lightner, D. J., Rivera, M. E., Tollefson, M. K., Boorjian, S. A., Karnes, R. J., Thompson, R. H., O’Neil, D. A., Hamilton, R. L., Gardner, M. R., et al. (2015) · European Urology · doi:10.1016/j.eururo.2015.04.002 · Cited by 252
Preventive Health Behavior Change Text Message Interventions: A Meta-analysis
Armanasco, A. A., Miller, Y. D., Fjeldsoe, B. S., & Marshall, A. L. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.10.042 · Cited by 210
The organising vision for telehealth and telecare: discourse analysis
Greenhalgh, T., Procter, R., Wherton, J., Sugarhood, P., & Shaw, S. (2012) · BMJ Open · doi:10.1136/bmjopen-2012-001574 · Cited by 199 · cited 2×
“Rather, the use of Skype for virtual consulting was assumed to be a straightforward matter of downloading the software onto the relevant computers – an illustration, perhaps, of the ‘plug and play’ mindset we have described previously in telehealth discourses.(81)”
MethodResultSelf-citationLiddy, C., Drosinis, P., & Keely, E. (2016) · Family Practice · doi:10.1093/fampra/cmw024 · Cited by 195 · cited 1×
“Similarly, systematic reviews of a large number of primary studies (mostly of weak methodological quality) have confirmed that it is technically possible to consult via e-mail, and that some patient groups value such contact.(60,61) Other studies have raised the possibility of increased inequality of access and profes…”
BackgroundFranklin, V. L., Greene, A., Waller, A., Greene, S. A., & Pagliari, C. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.962 · Cited by 188
Methodologies for assessing telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.10.009 · Cited by 187
Telephone consultations for general practice: a systematic review
Downes, M. J., Mervin, M. C., Byrnes, J. M., & Scuffham, P. A. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0529-0 · Cited by 183
Greenhalgh, T., Procter, R., Wherton, J., Sugarhood, P., Hinder, S., & Rouncefield, M. (2015) · BMC Medicine · doi:10.1186/s12916-015-0279-6 · Cited by 181 · cited 1×
“Shared understanding is important, but is not sufficient; technological advances need to be underpinned by a user-centred approach to design and delivery.(214)”
BackgroundSelf-citationEffectiveness of Telemedical Applications in Postoperative Follow-Up After Total Joint Arthroplasty
Sharareh, B., & Schwarzkopf, R. (2014) · The Journal of Arthroplasty · doi:10.1016/j.arth.2013.09.019 · Cited by 180
Understanding the Normalization of Telemedicine Services through Qualitative Evaluation: Table 1
May, C., Harrison, R., Finch, T., MacFarlane, A., Mair, F., & Wallace, P. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1145 · Cited by 155 · cited 1×
“However, the adoption, spread and sustainability of telemedicine tends to be disappointing, because of issues of cost, patient preferences and subtle but vital impacts on professional roles, interactions and work routines.(73,79,80)”
BackgroundHealth technology assessment in its local contexts: studies of telehealthcare
May, C., Mort, M., Williams, T., Mair, F., & Gask, L. (2003) · Social Science & Medicine · doi:10.1016/s0277-9536(02)00419-7 · Cited by 147
Patients’ attitudes to the summary care record and HealthSpace: qualitative study
Greenhalgh, T., Wood, G. W., Bratan, T., Stramer, K., & Hinder, S. (2008) · BMJ · doi:10.1136/bmj.a114 · Cited by 141 · cited 1×
“This finding resonated strongly with our previous work on patient concerns about the summary care record, which showed that patients considered the trade-off between potential security breaches (a theoretical possibility, but in practice unlikely) and accessibility and quality of clinical care (potentially enhanced th…”
ResultArmfield, N. R., Bradford, M., & Bradford, N. K. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.06.006 · Cited by 137
A randomized controlled study about the use of eHealth in the home health care of premature infants
Gund, A., Sjöqvist, B. A., Wigert, H., Hentz, E., Lindecrantz, K., & Bry, K. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-22 · Cited by 105 · cited 1×
“All found the technology easy to use, noting that virtual consultations were better than telephone calls.(131) Tellingly, the authors commented that ‘The families readily embraced the use of ICT [information, communication and technology], whereas motivating some of the nurses to accept and use ICT was a major challen…”
BackgroundSeeing is believing: using skype to improve diabetes outcomes in youth
Harris, M. A., Freeman, K. A., & Duke, D. C. (2015) · Diabetes Care · doi:10.2337/dc14-2469 · Cited by 101 · cited 1×
“Adherence to treatment and glycaemic control were also similar.(91) However, losses to follow-up were high: of the 47 (out of 92) participants randomised to Skype sessions, follow-up data were available for only 32.”
BackgroundThe role of the champion in telehealth service development: a qualitative analysis
Wade, V., & Eliott, J. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.gth115 · Cited by 97
Clinical use of Skype: a review of the evidence base
Armfield, N. R., Gray, L. C., & Smith, A. C. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.sft101 · Cited by 91
iPeer2Peer program: A pilot feasibility study in adolescents with chronic pain
Ahola Kohut, S., Stinson, J. N., Ruskin, D., Forgeron, P., Harris, L., van Wyk, M., Luca, S., & Campbell, F. (2016) · Pain · doi:10.1097/j.pain.0000000000000496 · Cited by 89
Dixon, A., Robertson, R., & Bal, R. (2010) · Health Economics Policy and Law · doi:10.1017/s1744133110000058 · Cited by 86
Lehoux, P., Miller, F. A., Daudelin, G., & Denis, J.-L. (2017) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.11 · Cited by 74
Greenhalgh, T., Swinglehurst, D., & Stones, R. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02390 · Cited by 71
Self-citationHansen, C. R., Perrild, H., Koefoed, B. G., & Zander, M. (2017) · European Journal of Endocrinology · doi:10.1530/eje-16-0811 · Cited by 53
Greenhalgh, T., Fahy, N., & Shaw, S. (2017) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2017.65 · Cited by 44
Self-citationOrlandoni, P., Jukic Peladic, N., Spazzafumo, L., Venturini, C., Cola, C., Sparvoli, D., Giorgini, N., Basile, R., & Fagnani, D. (2016) · Geriatrics & Gerontology International · doi:10.1111/ggi.12551 · Cited by 36
‘Never heard of it’– understanding the public’s lack of awareness of a new electronic patient record
Bratan, T., Stramer, K., & Greenhalgh, T. (2010) · Health Expectations · doi:10.1111/j.1369-7625.2010.00608.x · Cited by 34
Self-citation
Cited by
Video consultations for covid-19
Greenhalgh, T., Wherton, J., Shaw, S., & Morrison, C. (2020) · BMJ · doi:10.1136/bmj.m998 · Cited by 866
Self-citationCovid-19: a remote assessment in primary care
Greenhalgh, T., Koh, G. C. H., & Car, J. (2020) · BMJ · doi:10.1136/bmj.m1182 · Cited by 705
Self-citationMurphy, M., Scott, L. J., Salisbury, C., Turner, A., Scott, A., Denholm, R., Lewis, R., Iyer, G., Macleod, J., & Horwood, J. (2021) · British Journal of General Practice · doi:10.3399/bjgp.2020.0948 · Cited by 486
Imlach, F., McKinlay, E., Middleton, L., Kennedy, J., Pledger, M., Russell, L., Churchward, M., Cumming, J., & McBride-Henry, K. (2020) · BMC Family Practice · doi:10.1186/s12875-020-01336-1 · Cited by 275
James, H. M., Papoutsi, C., Wherton, J., Greenhalgh, T., & Shaw, S. E. (2021) · Journal of Medical Internet Research · doi:10.2196/23775 · Cited by 164
“Studies described 3 types of video consultation services: (1) video-to-home services [2,34,38,39,42] that connected providers directly to a patient who received a video consultation on their own device; (2) hub-and-spoke models [32,33,35,37,40,41] that connected a provider at a central hub to a patient at a rural spok…”
BackgroundMethodInfluentialSelf-citation
Metadata
- Authors
- Shaw, S., Wherton, J., Vijayaraghavan, S., Morris, J., Bhattacharya, S., Hanson, P., Campbell-Richards, D., Ramoutar, S., Collard, A., Hodkinson, I., & Greenhalgh, T.
- Venue
- Health Services and Delivery Research
- Published
- 2018-06
- Volume
- 6
- Issue
- 21
- Pages
- 1-136
- ISSN
- 2050-4349 (ISSN-L)
- 2050-4357
- OpenAlex
- W2809257310
- Cited by
- 146
- References
- 45
- FWCI
- 17.18
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.