Evaluating the Implementation of a Mobile Phone–Based Telemonitoring Program: Longitudinal Study Guided by the Consolidated Framework for Implementation Research
Open accessPublished version of a preprint
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Telemonitoring has shown promise for alleviating the burden of heart failure on individuals and health systems. However, real-world implementation of sustained programs is rare. OBJECTIVE: The objective of this study was to evaluate the implementation of a mobile phone-based telemonitoring program, which has been implemented as part of standard care in a specialty heart function clinic by answering two research questions: (1) To what extent was the telemonitoring program successfully implemented? (2) What were the barriers and facilitators to implementing the telemonitoring program? METHODS: We conducted a longitudinal single case study. The implementation success was evaluated using the following four implementation outcomes: adoption, penetration, feasibility, and fidelity. Semistructured interviews based on the Consolidated Framework for Implementation Research (CFIR) were conducted at 0, 4, and 12 months with 12 program staff members to identify the barriers and facilitators of the implementation. RESULTS: One year after the implementation, 98 patients and 8 clinicians were enrolled in the program. Despite minor technical issues, the intervention was used as intended. We obtained qualitative data from clinicians (n=8) and implementation staff members (n=4) for 24 CFIR constructs. A total of 12 constructs were facilitators clustered in the CFIR domains of inner setting (culture, tension for change, compatibility, relative priority, learning climate, leadership engagement, and available resources), characteristics of individuals (knowledge and beliefs about the intervention and self-efficacy), and process (engaging and reflecting and evaluating). In addition, we identified other notable facilitators from the characteristics of the intervention domain (relative advantage and adaptability) and the outer setting (patient needs and resources). Four constructs were perceived as minor barriers- the complexity of the intervention, cost, inadequate communication among high-level stakeholders, and the absence of a formal implementation plan. The remaining CFIR constructs had a neutral impact on the overall implementation. CONCLUSIONS: This is the first comprehensive evaluation of the implementation of a mobile phone-based telemonitoring program. Although the acceptability of the telemonitoring system was high, the strongest facilitators to the implementation success were related to the implementation context. By identifying what works and what does not in a real-world clinical context using a framework-guided approach, this work will inform the design of telemonitoring services and implementation strategies of similar telemonitoring interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Construct names and definitions were updated in response to recommendations to make the framework more applicable across a range of innovations and settings [30–35].”
From The updated consolidated framework for implementation research based on user feedback (2022) · cites this paper as [31]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 4×
“The Quality Implementation Framework [26] offers a prescriptive approach that can help formulate an implementation strategy that incorporates an assessment of many of the constructs outlined in the CFIR [19].”
MethodInfluentialGale, N. K., Heath, G., Cameron, E., Rashid, S., & Redwood, S. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-117 · Cited by 10,865
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · cited 3×
“7 | e10768 | p. 3http://mhealth.jmir.org/2018/7/e10768/ (page number not for citation purposes) XSL•FO RenderX 12 months4 monthsImplementation outcomea and indicator Adoption 83Number of clinicians having decided to use Medly to monitor patients Penetration 8938Percentage of clinicians using Medly over the total numbe…”
BackgroundMethodInfluentialA systematic review of the use of the Consolidated Framework for Implementation Research
Kirk, M. A., Kelley, C., Yankey, N., Birken, S. A., Abadie, B., & Damschroder, L. (2015) · Implementation Science · doi:10.1186/s13012-016-0437-z · Cited by 1,496
The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9522-x · Cited by 1,102
Damschroder, L. J., & Lowery, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-51 · Cited by 734
m-Health adoption by healthcare professionals: a systematic review
Gagnon, M.-P., Ngangue, P., Payne-Gagnon, J., & Desmartis, M. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv052 · Cited by 622
Granja, C., Janssen, W., & Johansen, M. A. (2018) · Journal of Medical Internet Research · doi:10.2196/10235 · Cited by 578 · cited 3×
“In fact, a recent review found that the challenge presented by new and often ill-defined clinician roles within changing workflows was a key factor in leading to the failure of eHealth interventions [16].”
BackgroundInfluentialStructured telephone support or non-invasive telemonitoring for patients with heart failure
Inglis, S. C., Clark, R. A., Dierckx, R., Prieto-Merino, D., & Cleland, J. G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007228.pub3 · Cited by 453 · cited 1×
“Meta-analyses tend to support claims of the positive impact on heart failure outcomes [1,6-9]; however, important inconsistencies in the evidence persist [10].”
ResultMobile Phone-Based Telemonitoring for Heart Failure Management: A Randomized Controlled Trial
Seto, E., Leonard, K. J., Cafazzo, J. A., Barnsley, J., Masino, C., & Ross, H. J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1909 · Cited by 339
Self-citation
Cited by
The updated consolidated framework for implementation research based on user feedback
Damschroder, L. J., Reardon, C. M., Widerquist, M. A. O., & Lowery, J. (2022) · Implementation Science · doi:10.1186/s13012-022-01245-0 · Cited by 4,452
Odendaal, W. A., Anstey Watkins, J., Leon, N., Goudge, J., Griffiths, F., Tomlinson, M., & Daniels, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011942.pub2 · Cited by 289
“Ware 2018a Notes This study explored health workers' perceptions and experiences when using mHealth to provide appropriate medical treatment to reduce maternal mortality in Papua New Guinea.”
BackgroundInfluentialTheories Informing eHealth Implementation: Systematic Review and Typology Classification
Heinsch, M., Wyllie, J., Carlson, J., Wells, H., Tickner, C., & Kay-Lambkin, F. (2021) · Journal of Medical Internet Research · doi:10.2196/18500 · Cited by 114
Londral, A., Azevedo, S., Dias, P., Ramos, C., Santos, J., Martins, F., Silva, R., Semedo, H., Vital, C., Gualdino, A., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08073-4 · Cited by 15
“Accordingly, the co-design of a new digital service, along with its iterative integration in the clinical workflows, as we used, is an essential part of our contribution to optimize the feasibility and adoption of the technology [46].”
Method
Metadata
- Authors
- Ware, P., Ross, H. J., Cafazzo, J. A., Laporte, A., Gordon, K., & Seto, E.
- Affiliations
- University Health Network (CA)
- University of Toronto (CA)
- Corresponding author
- Ware, Patrick
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2018-07-31
- Volume
- 6
- Issue
- 7
- Pages
- e10768
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC6092591
- OpenAlex
- W2808108821
- Cited by
- 85
- References
- 27
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 14 · 2023: 6 · 2022: 14 · 2021: 20 · 2020: 9 · 2019: 7 · 2018: 1
- FWCI
- 14.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- remote patient monitoring, heart failure, implementation barriers and facilitators, Consolidated Framework for Implementation Research, implementation fidelity, clinician self-efficacy, implementation context
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.