Explaining the mixed findings of a randomised controlled trial of telehealth with centralised remote support for heart failure: multi-site qualitative study using the NASSS framework
Open accessAbstract
Background: The SUPPORT-HF2 randomised controlled trial compared telehealth technology alone with the same technology combined with centralised remote support, in which a clinician responds promptly to biomarker changes. The intervention was implemented differently in different sites; no overall impact was found on the primary endpoint (proportion of patients on optimum treatment). We sought to explain the trial’s findings in a qualitative evaluation. Methods: Fifty-one people (25 patients, 3 carers, 18 clinicians, 4 additional researchers) were interviewed and observed in 7 UK trial sites in 2016–2018. We collected 110 pages of documents. The analysis was informed by the NASSS framework, a multi-level theoretical lens which considers non-adoption and abandonment of technologies by individuals and challenges to scale-up, spread and sustainability. In particular, we used NASSS to tease out why a ‘standardised’ socio-technical intervention played out differently in different sites. Results: Patients’ experiences of the technology were largely positive, though influenced by the nature and severity of their illness. In each trial site, existing services, staffing levels, technical capacity and previous telehealth experiences influenced how the complex intervention of ‘telehealth technology plus centralised specialist remote support’ was interpreted and the extent to which it was adopted and used to its full potential. In some sites, the intervention was quickly mobilised to fill significant gaps in service provision. In others, it was seen as usefully extending the existing care model for selected patients. Elsewhere, the new model was actively resisted and the technology little used. In one site, centralised provision of specialist advice aligned awkwardly with an existing community-based heart failure support service. Conclusions: Complex socio-technical interventions, even when implemented in a so-called standardised way with uniform inclusion and exclusion criteria, are inevitably implemented differently in different local settings because of how individual staff members interpret the technology and the trial protocol and because of the practical realities and path dependencies of local organisations. Site-specific iteration and embedding of a new technology-supported complex intervention may be required (in addition to co-design of the user interface) before such interventions are ready for testing in clinical trials. Trial registration: BMC ISRCTN Registry 86212709. Retrospectively registered on 5 September 2014
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The NASSS has been utilized prospectively and retrospectively to assess patient-oriented technologies and tools for decision-making.
“The surge in interest reflects the widespread adoption of the NASSS, which has been utilized prospectively and retrospectively to assess patient-oriented technologies and tools for decision-making purposes [12,13].”
From The NASSS (Non-Adoption, Abandonment, Scale-Up, Spread and Sustainability) framework use over time: A scoping review (2025) · cites this paper as [13]
The Methods (Theoretical framework; page unavailable) and Results (page unavailable) describe using NASSS to analyse a patient-facing heart-failure telehealth intervention across trial sites. The paper does not establish that NASSS was used both prospectively and retrospectively, or as a decision-making tool; it describes its use as an analytical framework for this study. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
McDonagh, T. A., Metra, M., Adamo, M., Gardner, R. S., Baumbach, A., Böhm, M., Burri, H., Butler, J., Čelutkienė, J., Chioncel, O. D., et al. (2021) · PubMed · doi:10.1093/eurheartj/ehab670 · Cited by 19,618 · see citing works
2016 ESC Guidelines for the Diagnosis and Treatment of Acute and Chronic Heart Failure
Ponikowski, P., Voors, A. A., Anker, S. D., Bueno, H., Cleland, J. G. F., Coats, A. J. S., Falk, V., González-Juanatey, J. R., Harjola, V.-P., Jankowska, E. A., et al. (2016) · European Journal of Heart Failure · doi:10.1002/ejhf.592 · Cited by 5,866 · see citing works
The Constant Comparative Method of Qualitative Analysis
Glaser, B. G. (1965) · Social Problems · doi:10.2307/798843 · Cited by 4,937 · see citing works
Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A'Court, C., Hinder, S., Fahy, N., Procter, R., & Shaw, S. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8775 · Cited by 2,887 · see citing works
Self-citationPredicting survival in heart failure: a risk score based on 39 372 patients from 30 studies
Pocock, S., Ariti, C. A., McMurray, J. J. V., Maggioni, A. P., Køber, L., Squire, I. B., Swedberg, K. B., Dobson, J., Poppe, K., WHALLEY, G. A., et al. (2012) · European Heart Journal · doi:10.1093/eurheartj/ehs337 · Cited by 1,343 · see citing works
Patient care information systems and health care work: a sociotechnical approach
Berg, M. (1999) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(99)00011-8 · Cited by 786 · see citing works
Principles of Sociotechnical Design Revisted
Cherns, A. (1987) · Human Relations · doi:10.1177/001872678704000303 · Cited by 545 · see citing works
Clinician Acceptance is the Key Factor for Sustainable Telehealth Services
Wade, V. A., Eliott, J. A., & Hiller, J. E. (2014) · Qualitative Health Research · doi:10.1177/1049732314528809 · Cited by 410 · see citing works
Telemedicine and remote management of patients with heart failure
Anker, S. D., Koehler, F., & Abraham, W. T. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61229-4 · Cited by 343 · see citing works
Greenhalgh, T., Wherton, J. P., Sugarhood, P., Hinder, S., Procter, R., & Stones, R. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.05.036 · Cited by 319 · see citing works
Self-citationHeart Failure Care in Low- and Middle-Income Countries: A Systematic Review and Meta-Analysis
Callender, T., Woodward, M., Roth, G. A., Farzadfar, F., Lemarié, J.-C., Gicquel, S., Atherton, J. J., Rahimzadeh, S., Ghaziani, M., Shaikh, M., et al. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001699 · Cited by 291 · see citing works
Advancing complexity science in healthcare research: the logic of logic models
Mills, T., Lawton, R., & Sheard, L. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0701-4 · Cited by 190 · see citing works
Taylor, J., Coates, E., Brewster, L., Mountain, G., Wessels, B., & Hawley, M. S. (2015) · Journal of Advanced Nursing · doi:10.1111/jan.12480 · Cited by 164 · see citing works
Care at a Distance : On the Closeness of Technology
Pols, J. (2012) · doi:10.26530/oapen_413032 · Cited by 151 · see citing works
Understanding heart failure; explaining telehealth—a hermeneutic systematic review
Greenhalgh, T., A’Court, C., & Shaw, S. (2017) · BMC Cardiovascular Disorders · doi:10.1186/s12872-017-0594-2 · Cited by 141 · see citing works
Self-citationThe role of the champion in telehealth service development: a qualitative analysis
Wade, V., & Eliott, J. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.gth115 · Cited by 97 · see citing works
Dickinson, M. G., Allen, L. A., Albert, N. M., DiSalvo, T. G., Ewald, G. A., Vest, A. R., Whellan, D. J., Zile, M. R., & Givertz, M. M. (2018) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2018.08.011 · Cited by 85 · see citing works
Greenhalgh, T., Shaw, S., Wherton, J., Hughes, G., Lynch, J., A'Court, C., Hinder, S., Fahy, N., Byrne, E., Finlayson, A., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010208 · Cited by 85 · see citing works
Self-citationMazurek, J. A., & Jessup, M. L. (2015) · Cardiac Electrophysiology Clinics · doi:10.1016/j.ccep.2015.08.001 · Cited by 77 · see citing works
A personalised mobile-based home monitoring system for heart failure: The SUPPORT-HF Study
Triantafyllidis, A. K., Velardo, C., Chantler, T., Shah, S. A., Paton, C., Khorshidi, R., Tarassenko, L., & Rahimi, K. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.05.003 · Cited by 77 · see citing works
eHealth in cardiovascular medicine: A clinical update
Saner, H. E., & van der Velde, E. T. (2016) · European Journal of Preventive Cardiology · doi:10.1177/2047487316670256 · Cited by 73 · see citing works
Nurses’ and community support workers’ experience of telehealth: a longitudinal case study
Sharma, U., & Clarke, M. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-164 · Cited by 73 · see citing works
How can telehealth help in the provision of integrated care?
Stroetmann, K. A., Kubitschke, L., Robinson, S., Stroetmann, V., Cullen, K., & McDaid, D. (2010) · doi:10.13140/2.1.5083.1361 · Cited by 68 · see citing works
Home monitoring with technology-supported management in chronic heart failure: a randomised trial
Rahimi, K., Nazarzadeh, M., Pinho‐Gomes, A., Woodward, M., Salimi‐Khorshidi, G., Ohkuma, T., Fitzpatrick, R. M., Tarassenko, L., Denis, M., & Cleland, J. G. F. (2020) · Heart · doi:10.1136/heartjnl-2020-316773 · Cited by 60 · see citing works
Conrad, N., Judge, A., Canoy, D., Tran, J., O’Donnell, J., Nazarzadeh, M., Salimi‐Khorshidi, G., Hobbs, R. F., Cleland, J. G. F., McMurray, J. J. V., et al. (2019) · PLoS Medicine · doi:10.1371/journal.pmed.1002805 · Cited by 57 · see citing works
Remote monitoring of chronic diseases: a landscape assessment of policies in four European countries
Rojahn, K., Laplante, S., Sloand, J., Main, C., Ibrahim, A., Wild, J., Sturt, N., Areteou, T., & Johnson, K. I. (2016) · PLoS ONE · doi:10.1371/journal.pone.0155738 · Cited by 54 · see citing works
Telemonitoring in heart failure: Big Brother watching over you
Dierckx, R., Pellicori, P., Cleland, J. G. F., & Clark, A. L. (2014) · Heart Failure Reviews · doi:10.1007/s10741-014-9449-4 · Cited by 40 · see citing works
Pols, J. J. (2012) · Amsterdam University Press eBooks · doi:10.1017/9789048513017 · Cited by 37 · see citing works
A critical review on telemonitoring in heart failure
Gurné, O., Conraads, V. M., Missault, L. H., Müllens, W., Vachiéry, J., Mieghem, W. V., Droogné, W., Pouleur, A., Troisfontaines, P., Huez, S., et al. (2012) · Acta cardiologica. Supplementum · doi:10.1080/ac.67.4.2170685 · Cited by 25 · see citing works
Rahimi, K., Velardo, C., Triantafyllidis, A. K., Conrad, N., Shah, S. A., Chantler, T., Mohseni, H., Stoppani, E., Moore, F., Paton, C., et al. (2015) · European Heart Journal - Quality of Care and Clinical Outcomes · doi:10.1093/ehjqcco/qcv013 · Cited by 23 · see citing works
Chantler, T., Paton, C., Velardo, C., Triantafyllidis, A. K., Shah, S. A., Stoppani, E., Conrad, N., Fitzpatrick, R. M., Tarassenko, L., & Rahimi, K. (2016) · Digital Health · doi:10.1177/2055207616671461 · Cited by 19 · see citing works
SUPPORT-HF 2 Investigators and Committees (2018) · American Heart Journal · doi:10.1016/j.ahj.2018.09.007 · Cited by 16 · see citing works
Merrell, R. C., & Doarn, C. R. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2012.9997 · Cited by 10 · see citing works
Government pins hopes on £250m AI centre for faster diagnosis and treatment
O’Dowd, A. (2019) · BMJ · doi:10.1136/bmj.l5106 · Cited by 9 · see citing works
Documento di consenso ANMCO/SIC/SIT: Il futuro della telemedicina nello scompenso cardiaco
Lenarda, A. D., Casolo, G., Gulizia, M. M., Aspromonte, N., Scalvini, S., Mortara, A., Alunni, G., Ricci, R. P., Mantovan, R., Russo, G., et al. (2016) · Giornale italiano di cardiologia · doi:10.1714/2262.24354 · Cited by 9 · see citing works
Technology-supported home monitoring in heart failure patients
Rahimi, K., Nazarzadeh, M., Pinho‐Gomes, A., Woodward, M., Salimi‐Khorshidi, G., Ohkuma, T., Fitzpatrick, R. M., Tarassenko, L., Denis, M., & Cleland, J. G. F. (2020) · European Heart Journal · doi:10.1093/ehjci/ehaa946.1034 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [23]Di Lenarda A Casolo G Gulizia MM Aspromonte N Scalvini S Mortara A Alunni G Ricci RP Mantovan R Russo G ANMCO/SIC/SIT Consensus document: the future of telemedicine in heart failure G Ital Cardiol 2016 17 6 491 507 27311090
Cited by
Sorted by citations
Jacob, C., Sezgın, E., Sánchez-Vázquez, A., & Ivory, C. J. (2022) · JMIR mhealth and uhealth · doi:10.2196/36284 · Cited by 172 · see citing works
Alami, H., Lehoux, P., Papoutsi, C., Shaw, S. E., Fleet, R. P., & Fortin, J. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11112-x · Cited by 92 · see citing works
Self-citationDyb, K., Berntsen, G. R., & Kvam, L. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06262-1 · Cited by 67 · see citing works
Winter, P., & Chico, T. (2023) · Sensors · doi:10.3390/s23146333 · Cited by 60 · see citing works
Approaches to Spread, Scale-Up, and Sustainability
Papoutsi, C., Greenhalgh, T., & Marjanovic, S. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009326049 · Cited by 37 · see citing works
Self-citationShin, H. D., Hamovitch, E., Gatov, E., MacKinnon, M., Samawi, L., Boateng, R., Thorpe, K. E., & Barwick, M. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000418 · Cited by 40 · see citing works
“The surge in interest reflects the widespread adoption of the NASSS, which has been utilized prospectively and retrospectively to assess patient-oriented technologies and tools for decision-making purposes [12,13].”
Chahla, R. E., Ruiz, L. M., Ortega, E. S., Morales, M. F., Barreiro, F., George, A., Mancilla, C., AMATO, S., Barrenechea, G. G., Goroso, D. G., et al. (2021) · American Journal of Therapeutics · doi:10.1097/mjt.0000000000001433 · Cited by 33 · see citing works
Alami, H., Rivard, L., Lehoux, P., Ahmed, M. A. A., Fortin, J., & Fleet, R. P. (2023) · Digital Health · doi:10.1177/20552076231219113 · Cited by 34 · see citing works
Lynch, J. K., Hughes, G., Papoutsi, C., Wherton, J. P., & A’Court, C. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.114553 · Cited by 17 · see citing works
Self-citationArtanian, V., Ware, P., Rac, V. E., Ross, H. J., & Seto, E. (2021) · JMIR Cardio · doi:10.2196/28259 · Cited by 15 · see citing works
A’Court, C., Jenkins, W., Reidy, C., & Papoutsi, C. (2022) · BMC Cardiovascular Disorders · doi:10.1186/s12872-022-02860-x · Cited by 16 · see citing works
Self-citationCastor, C., Lindkvist, R., Hallström, I., & Holmberg, R. G. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/47663 · Cited by 10 · see citing works
A Survey of Technology Abandonment in US Nursing Homes
Powell, K., Farmer, M., Liu, J., & Alexander, G. L. (2023) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2023.09.002 · Cited by 8 · see citing works
Robertson, S. T., Rosbergen, I. C. M., Brauer, S., Grimley, R., & Burton‐Jones, A. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-10314-z · Cited by 7 · see citing works
Reidy, C., A'Court, C., Jenkins, W., Jani, A., Ramos, A., Morys-Carter, M., & Papoutsi, C. (2023) · Digital Health · doi:10.1177/20552076221147114 · Cited by 6 · see citing works
Self-citationAuener, S. L., van Dulmen, S. A., van Kimmenade, R. R. J., Westert, G. P., & Jeurissen, P. (2023) · Digital Health · doi:10.1177/20552076231196998 · Cited by 5 · see citing works
Nordmann, K., Sauter, S., Redlich, M.-C., Möbius-Lerch, P., Schaller, M., & Fischer, F. (2024) · Digital Health · doi:10.1177/20552076241259855 · Cited by 5 · see citing works
Alami, H., Lehoux, P., Papoutsi, C., Shaw, S. E., Fleet, R. P., & Fortin, J. (2023) · Research Square · doi:10.21203/rs.3.rs-2546681/v1 · Cited by 3 · see citing works
Self-citationShaw, S. E., Marjanovic, S., Papoutsi, C., Wu, F. M., Newhouse, N., Wherton, J. P., Nishio, A. A., Darbyshire, J. L., Fahy, N., Ford, G. A., et al. (2025) · NIHR Open Research · doi:10.3310/nihropenres.13842.1 · Cited by 2 · see citing works
Self-citationElferink, N., Roest, M. J., Weggelaar‐Jansen, A. M., & de Mul, M. (2025) · JMIR Medical Informatics · doi:10.2196/69349 · Cited by 1 · see citing works
Hehakaya, C., & Moors, E. H. M. (2023) · Innovation · doi:10.1080/14479338.2023.2213212 · Cited by 1 · see citing works
Navigating the Complexities of Scaling Remote Patient Management: A Scoping Review (Preprint)Preprint
Houwen, J., Pannunzio, V., van Os, H. J. A., Janssen, V. R., Raijmakers, J., Rietjens, J. A. C., Atsma, D. E., & Kleinsmann, M. S. (2024) · doi:10.2196/preprints.59534
Jarvie, R., Frost, J., Pratt-Boyden, K., Lang, I., Pope, C., & James, M. A. (2024) · doi:10.31219/osf.io/v9mgn
Robertson, S. T., Rosbergen, I. C. M., Brauer, S., Grimley, R., & Burton‐Jones, A. (2024) · Figshare · doi:10.6084/m9.figshare.26645029
Robertson, S. T., Rosbergen, I. C. M., Brauer, S., Grimley, R., & Burton‐Jones, A. (2024) · Figshare · doi:10.6084/m9.figshare.26645026
40240322 Understanding Emerging Digital Health Disparities
Greenhalgh, T., Veinot, T. C., & Husain, L. (2025) · De Gruyter eBooks · doi:10.1515/9783111247854-022
Self-citationWienands, L., Valenta, S., Leppla, L., Geest, S. D., Kovács, L., Teynor, A., & Krumme, J. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1905222
- Authors
- Papoutsi, C., A’Court, C., Wherton, J., Shaw, S., & Greenhalgh, T.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Greenhalgh, Trisha
- Venue
- Trials
- Published
- 2020-10-27
- Volume
- 21
- Issue
- 1
- Pages
- 891-891
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC7590600
- OpenAlex
- W3096303332
- Cited by
- 26
- References
- 36
- Citations by year
- 2025: 4 · 2024: 7 · 2023: 9 · 2022: 2 · 2021: 4
- FWCI
- 2.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Trials (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Wellcome Trust (WT104830MA)
- NIHR (BRC-1215-20008)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Failure Treatment and Management
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- heart failure, telemedicine, socio-technical interventions, NASSS framework, service gaps, patient and caregiver experiences
- MeSH terms
- Heart Failure, Humans, Telemedicine, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
