A Framework to Guide Implementation of AI in Health Care: Protocol for a Cocreation Research Project
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Background: Artificial intelligence (AI) has the potential in health care to transform patient care and administrative processes, yet health care has been slow to adopt AI due to many types of barriers. Implementation science has shown the importance of structured implementation processes to overcome implementation barriers. However, there is a lack of knowledge and tools to guide such processes when implementing AI-based applications in health care. Objective: The aim of this protocol is to describe the development, testing, and evaluation of a framework, “Artificial Intelligence-Quality Implementation Framework” (AI-QIF), intended to guide decisions and activities related to the implementation of various AI-based applications in health care. Methods: The paper outlines the development of an AI implementation framework for broad use in health care based on the Quality Implementation Framework (QIF). QIF is a process model developed in implementation science. The model guides the user to consider implementation-related issues in a step-by-step design and plan and perform activities that support implementation. This framework was chosen for its adaptability, usability, broad scope, and detailed guidance concerning important activities and considerations for successful implementation. The development will proceed in 5 phases with primarily qualitative methods being used. The process starts with phase I, in which an AI-adapted version of QIF is created (AI-QIF). Phase II will produce a digital mockup of the AI-QIF. Phase III will involve the development of a prototype of the AI-QIF with an intuitive user interface. Phase IV is dedicated to usability testing of the prototype in health care environments. Phase V will focus on evaluating the usability and effectiveness of the AI-QIF. Cocreation is a guiding principle for the project and is an important aspect in 4 of the 5 development phases. The cocreation process will enable the use of both on research-based and practice-based knowledge. Results: The project is being conducted within the frame of a larger research program, with the overall objective of developing theoretically and empirically informed frameworks to support AI implementation in routine health care. The program was launched in 2021 and has carried out numerous research activities. The development of AI-QIF as a tool to guide the implementation of AI-based applications in health care will draw on knowledge and experience acquired from these activities. The framework is being developed over 2 years, from January 2023 to December 2024. It is under continuous development and refinement. Conclusions: The development of the AI implementation framework, AI-QIF, described in this study protocol aims to facilitate the implementation of AI-based applications in health care based on the premise that implementation processes benefit from being well-prepared and structured. The framework will be coproduced to enhance its relevance, validity, usefulness, and potential value for application in practice. International Registered Report Identifier (IRRID): DERR1-10.2196/50216
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sample Size in Qualitative Interview Studies: Guided by Information Power
Malterud, K., Siersma, V. D., & Guassora, A. D. (2016) · Qualitative Health Research · doi:10.1177/1049732315617444 · Cited by 12,703 · cited 2×
“Approximately 20 interviews are tentatively planned, but the actual number of interviews will be guided by the information power principle [36], meaning that the larger information the sample holds relevant for the study, the lower amount of interviews is needed, and vice versa.”
Lost in knowledge translation: Time for a map?
Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.47 · Cited by 4,705 · cited 1×
“Implementation tends to be a complex and challenging process because it requires changes in existing behaviors, practices, and routines, many of which are well established or ingrained [19].”
Making sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · cited 1×
“Strategies in implementation science are defined as “methods or techniques used to enhance the adoption, implementation and sustainability of a clinical program or practice” [43].”
The practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
The Quality Implementation Framework: A Synthesis of Critical Steps in the Implementation Process
Meyers, D. C., Durlak, J. A., & Wandersman, A. (2012) · American Journal of Community Psychology · doi:10.1007/s10464-012-9522-x · Cited by 1,102
D’Alfonso, S. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.04.005 · Cited by 408
Artificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389
Knowledge Translation in Health Care: Moving from Evidence to Practice
(2009) · doi:10.1002/9781444311747 · Cited by 285
Gama, F., Tyskbo, D., Nygren, J., Barlow, J., Reed, J., & Svedberg, P. (2022) · Journal of Medical Internet Research · doi:10.2196/32215 · Cited by 216 · cited 1×
“Several studies have concluded that the implementation of AI-based applications tends to be unstructured [16,17].”
Self-citationArtificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198 · cited 5×
“Numerous barriers to the implementation of AI in health care have been identified [9-14 , 17 The starting point for the AI-QIF is the QIF, a widely used process model in implementation science.”
InfluentialSelf-citationBickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184 · cited 1×
“AI can also be used to predict disease progression and recommend treatment options based on a patient’s individual characteristics and medical history [7].”
The Last Mile: Where Artificial Intelligence Meets Reality
Coiera, E. (2019) · Journal of Medical Internet Research · doi:10.2196/16323 · Cited by 102
Barriers to the Implementation of AI in Organizations: Findings from a Delphi Study
Bérubé, M., Giannelia, T., & Vial, G. (2021) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2021.805 · Cited by 67 · cited 1×
“Numerous barriers to the implementation of AI in health care have been identified [9-14 , 17 The starting point for the AI-QIF is the QIF, a widely used process model in implementation science.”
Palumbo, R. (2017) · SpringerBriefs in Public Health · doi:10.1007/978-3-319-58344-0 · Cited by 54 · cited 3×
“Cocreation has been found to improve the quality, usability, and social acceptance of new solutions [23].”
Tachkov, K., Zemplenyi, A., Kamusheva, M., Dimitrova, M., Siirtola, P., Pontén, J., Nemeth, B., Kalo, Z., & Petrova, G. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.921226 · Cited by 49 · cited 1×
“These barriers have been classified in different ways, for example, data related, methodological, technological, regulatory or policy related, human factor related, environmental, and organizational [13-15].”
Cited by
Nair, M., Svedberg, P., Larsson, I., & Nygren, J. M. (2024) · PLOS ONE · doi:10.1371/journal.pone.0305949 · Cited by 179
Self-citationPreti, L. M., Ardito, V., Compagni, A., Petracca, F., & Cappellaro, G. (2024) · Journal of Medical Internet Research · doi:10.2196/55897 · Cited by 62
“Several implementation frameworks for health care technologies are on hand, but no widely recognized model addresses all the specific issues that are relevant to ML applications [15-17].”
Hack, S., Karni, R. J., Maniaci, A., Fundakowski, C. E., Castellani, L., Incandela, F., Accorona, R., Mayo-Yanez, M., Violati, M., Giannini, L., et al. (2026) · Oral Oncology · doi:10.1016/j.oraloncology.2026.107877 · Cited by 10
Metadata
- Authors
- Nilsen, P., Svedberg, P., Neher, M., Nair, M., Larsson, I., Petersson, L., & Nygren, J.
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2023-11-08
- Volume
- 12
- Pages
- e50216
- ISSN
- 1929-0748 (ISSN-L)
- OpenAlex
- W4386544822
- Cited by
- 37
- References
- 16
- FWCI
- 1.28
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.