Artificial Intelligence and the Implementation Challenge
Open accessPublished version of a preprint
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Applications of artificial intelligence (AI) in health care have garnered much attention in recent years, but the implementation issues posed by AI have not been substantially addressed. OBJECTIVE: In this paper, we have focused on machine learning (ML) as a form of AI and have provided a framework for thinking about use cases of ML in health care. We have structured our discussion of challenges in the implementation of ML in comparison with other technologies using the framework of Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies (NASSS). METHODS: After providing an overview of AI technology, we describe use cases of ML as falling into the categories of decision support and automation. We suggest these use cases apply to clinical, operational, and epidemiological tasks and that the primary function of ML in health care in the near term will be decision support. We then outline unique implementation issues posed by ML initiatives in the categories addressed by the NASSS framework, specifically including meaningful decision support, explainability, privacy, consent, algorithmic bias, security, scalability, the role of corporations, and the changing nature of health care work. RESULTS: Ultimately, we suggest that the future of ML in health care remains positive but uncertain, as support from patients, the public, and a wide range of health care stakeholders is necessary to enable its meaningful implementation. CONCLUSIONS: If the implementation science community is to facilitate the adoption of ML in ways that stand to generate widespread benefits, the issues raised in this paper will require substantial attention in the coming years.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, health care has seen slow success in the implementation of AI use cases.”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Clinicians expressed the need to understand both the scientific and clinical bases of the recommendations provided by the AI to confidently validate and apply the decision [19,20,36-38].”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [20]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“However, successful utility requires successful adoption, and a number of studies have reported on the challenges encountered with implementing AI in health care [19-21].”
From Barriers to and facilitators of artificial intelligence adoption in health care: scoping review (2024) · cites this paper as [20]
In the citing paper
“Shaw et al. (2019) contend that decision support in health care can be useful only if its outputs are able to integrate with the human decision-making processes at the heart of health service delivery.”
From SHIFTing artificial intelligence to be responsible in healthcare: a systematic review (2022) · cites this paper as Shaw et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 2×
“The value proposition of digital technology might be different for different stakeholder groups, and implementation frameworks direct attention to the implications of newly introduced technologies for patients, health care providers, managers, health policymakers, and others [8,25,26].”
BackgroundMethodDermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362 · cited 1×
“Often, ML involves supervised methods that categorize data points, for example, as images of skin cancer or otherwise given datasets in which all data points (or at least a substantial subset) are associated with a label, ordinal, or category that is meant to be predicted or inferred [15].”
BackgroundNorth, D. C. (1991) · Journal of Economic Perspectives · doi:10.1257/jep.5.1.97 · Cited by 5,232
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837 · cited 1×
“We agree with a growing chorus of health care providers and researchers who suggest that ML will primarily serve to augment as opposed to replace the work of humans in the provision of health care in the near term [31], despite applications of automation in health care.”
BackgroundThe ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“In cases where training data are partial or incomplete or only reflect a subset of a given population, the resulting model will only be relevant to the population of people represented in the dataset [47].”
BackgroundMaking sense of implementation theories, models and frameworks
Nilsen, P. (2015) · Implementation Science · doi:10.1186/s13012-015-0242-0 · Cited by 4,447 · cited 2×
“We have described use cases (and attendant value propositions) of ML in health care as more likely relating to decision support and less likely to automation, which begins to illustrate the implementation object of focus in ML initiatives [6,7].”
BackgroundMethodEvidence-Based Medicine: A New Approach to Teaching the Practice of Medicine
Guyatt, G. (1992) · JAMA · doi:10.1001/jama.1992.03490170092032 · Cited by 4,202
Machine Learning Applications in Cancer Prognosis and Prediction
Kourou, K., Exarchos, T. P., Exarchos, K. P., Karamouzis, M. V., & Fotiadis, D. I. (2015) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2014.11.005 · Cited by 3,338 · cited 1×
“Given these labels and the statistical models they help to train, ML can be very effective at determining the category in which any newly available individual data point belongs, thereby being useful in the effort to, for example, identify malignant cancers based on particular images [16].”
BackgroundBig other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 1×
“As the innovations enabled by ML have taken on a more powerful role in driving global economies, corporations have strategically sought to acquire larger amounts of more diverse data to boost their capacity to develop ML algorithms [61].”
BackgroundInstitutions and Organizations: Ideas, Interests, and Identities
Scott, W. R. (2007) · Cited by 2,943
Research works printed but not linked: 8
- Ajay, A, 2019, The Economics of Artificial Intelligence: An Agenda
- 10.1016/j.socscimed.2012.11.021published · doi:10.1016/j.socscimed.2012.11.021published
- Agrawal, A, 2018, Prediction Machines: The Simple Economics of Artificial Intelligence
- RajpurkarPPolamreddiVBalakrishnanAResearchGate2017Cornell University LibraryMalaria likelihood prediction by effectively surveying households using deep reinforcement learning https://www.researchgate.net/publication/321324506_Malaria_Likelihood_Prediction_By_Effectively_Surveying_Households_Using_Deep_Reinforcement_Learning
- CaseyDBeyanOMurphyKFelzmannHRobot-Assisted Care for Elderly With Dementia: Is There a Potential for Genuine End-User Empowerment?Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts2015HRI'15 Extended AbstractsMarch 2-5, 2015Portland, OR2478
- RossiRAAhmedNKThe Network Data Repository with Interactive Graph Analytics and VisualizationProceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence2015AAAI'15January 25-30, 2015Austin Texas42923
- CulnaneCRubinsteinBTeagueVarXiv2017Health data in an open world https://arxiv.org/ftp/arxiv/papers/1712/1712.05627.pdf
- TsymbalAResearchGate2004Computer Science Department, Trinity College DublinThe problem of concept drift: definitions and related work https://www.researchgate.net/publication/228723141_The_Problem_of_Concept_Drift_Definitions_and_Related_Work
Cited by
Items 101–200 of 443
Goel, P., Jain, P., Pasman, H. J., Pistikopoulos, E. N., & Datta, A. A. (2020) · Journal of Loss Prevention in the Process Industries · doi:10.1016/j.jlp.2020.104316 · Cited by 35
Korinek, A., & Stiglitz, J. E. (2021) · BMJ · doi:10.1136/bmj.n367 · Cited by 45
Hussain, W., Mabrok, M. A., Gao, H., Rabhi, F., & Rashed, E. A. (2024) · Digital Health · doi:10.1177/20552076241258757 · Cited by 35
“Additionally, ethical considerations, including safety, accountability, security, and the scarcity of computational resources, 23 – 25 further compound the challenges.”
BackgroundChallenges of developing artificial intelligence‐assisted tools for clinical medicine
Shung, D. L., & Sung, J. J. �. (2021) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.15378 · Cited by 33
Tricco, A. C., Hezam, A., Parker, A., Nincic, V., Harris, C., Fennelly, O., Thomas, S. M., Ghassemi, M., McGowan, J., Paprica, P. A., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-065845 · Cited by 32
Climent, R. C., Haftor, D., & Staniewski, M. W. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102637 · Cited by 48
“…expectancy by automating tasks, enhancing professional capabilities, personalising recommendations, facilitating decision-making, managing data, and offering other advantages (Brynjolfsson, Jin, & McElheran, 2021; Shaw, Rudzicz, Jamieson, & Goldfarb, 2019; Arel, Rose, & Karnowski, 2010).”
Project Management in the Era of Artificial Intelligence
Sahadevan, S. (2023) · European Journal of Theoretical and Applied Sciences · doi:10.59324/ejtas.2023.1(3).35 · Cited by 32
“The research shows that AI is not a replacement for human judgment in PM, but rather a tool that may support and improve decision-making (Shaw et al., 2019; Roberts, 2016).”
BackgroundMethodAdithyan, N., Chowdhury, R. R., Padmavathy, L., Peter, R. M., & Anantharaman, V. V. (2024) · Cureus · doi:10.7759/cureus.69910 · Cited by 36
Barriers to Implementing an Artificial Intelligence Model for Unplanned Readmissions
Baxter, S. L., Bass, J. S., & Sitapati, A. M. (2020) · ACI Open · doi:10.1055/s-0040-1716748 · Cited by 30
“This highlights the importance of explainability in implementing ML in health care, identi fi ed as a key issue in the Shaw framework 15 and in the technology domain of the NASSS framework.”
BackgroundMethodInfluentialGillner, S. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2023.116442 · Cited by 30
Singh, Y. R., Shah, D. B., Maheshwari, D., Shah, J. S., & Shah, S. (2023) · Critical Reviews in Analytical Chemistry · doi:10.1080/10408347.2023.2254379 · Cited by 30
“[33] Artificial neural networks (ANNs) are mathematical algorithms projected to simulate the human brain ’ s performance (Figure 2).”
A Justifiable Investment in AI for Healthcare: Aligning Ambition with Reality
Karpathakis, K., Morley, J., & Floridi, L. (2024) · Minds and Machines · doi:10.1007/s11023-024-09692-y · Cited by 31
Siira, E., Tyskbo, D., & Nygren, J. (2024) · BMC Primary Care · doi:10.1186/s12875-024-02516-z · Cited by 29
“The quest to understand how to effectively sur-mount implementation barriers remains an underex-plored aspect within the realm of AI implementation in healthcare [24–26].”
BackgroundPark, Y., Park, S., & Lee, M. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.06.035 · Cited by 37
Pul, U., Tichý, A., Pitchika, V., & Schwendicke, P. D. F. (2025) · Journal of Dentistry · doi:10.1016/j.jdent.2025.105868 · Cited by 32
Begley, K., Begley, C., & Smith, V. A. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13515 · Cited by 29
“They believe that the current generation of ML capabilities work at the task level , and not at the level of conducting a complete job , 34 which would encompass addressing ethical, moral, legal and stakeholder standpoints.”
BackgroundArtificial Intelligence and the Future of Gastroenterology and Hepatology
Penrice, D. D., Rattan, P., & Simonetto, D. A. (2022) · Gastro Hep Advances · doi:10.1016/j.gastha.2022.02.025 · Cited by 29
Space situational awareness systems: Bridging traditional methods and artificial intelligence
Jia, Q., Xiao, J., Bai, L., Zhang, Y., Zhang, R., & Feroskhan, M. (2024) · Acta Astronautica · doi:10.1016/j.actaastro.2024.11.025 · Cited by 30
Ndembi, N., Rammer, B., Fokam, J., Dinodia, U., Tessema, S. K., Nsengimana, J. P., Mwangi, S., Adzogenu, E., Dongmo, L. T., Rees, B., et al. (2025) · Journal of Public Health in Africa · doi:10.4102/jphia.v16i1.876 · Cited by 29
Chou, M. M., Illa-Bochaca, I., Minxi, B., Darvishian, F., Johannet, P. M., Moran, U., Shapiro, R. L., Berman, R. S., Osman, I., Jour, G., et al. (2020) · Modern Pathology · doi:10.1038/s41379-020-00686-6 · Cited by 29
Lyndyuk, A., Гаврилюк, І., Томашевський, Ю. М., Khirivskyi, R., & Kohut, M. (2024) · Economics of Development · doi:10.57111/econ/4.2024.60 · Cited by 26
Stakeholder perspectives on ethical and trustworthy voice AI in health care
Bélisle‐Pipon, J., Powell, M., English, R., Malo, M.-F. A., Ravitsky, V., & Bensoussan, Y. E. (2024) · Digital Health · doi:10.1177/20552076241260407 · Cited by 28
Gaps in standards for integrating artificial intelligence technologies into ophthalmic practice
Baxter, S. L., & Lee, A. (2021) · Current Opinion in Ophthalmology · doi:10.1097/icu.0000000000000781 · Cited by 25
Mensah, G., Mijwil, M. M., & Adamopoulos, I. (2024) · Babylonian Journal of Artificial Intelligence · doi:10.58496/bjai/2024/003 · Cited by 25
Tyskbo, D., & Nygren, J. (2024) · Social Science & Medicine · doi:10.1016/j.socscimed.2024.117298 · Cited by 24
Delpino, F. M., Costa, Â. K., do Nascimento, M. C., Moura, H. S. D., dos Santos, H. G., Wichmann, R. M., Filho, A. D. P. C., Arcêncio, R. A., & Nunes, B. P. (2024) · Nutrition Metabolism and Cardiovascular Diseases · doi:10.1016/j.numecd.2024.05.020 · Cited by 23
Nilsén, P., Reed, J. E., Nair, M., Savage, C., Macrae, C., Barlow, J., Svedberg, P., Larsson, I., Lundgren, L. E., & Nygren, J. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.961475 · Cited by 25
“AI is not one single type of technology but rather encompasses many technologies covering a range of practical applications (10, 60).”
BackgroundChen, J., Baxter, S. L., van den Brandt, A., Lieu, A. C., Camp, A. S., Jiun, L., Welsbie, D. S., Moghimi, S., Christopher, M. A., Weinreb, R. N., et al. (2022) · Journal of Glaucoma · doi:10.1097/ijg.0000000000002163 · Cited by 23
“17,19 In a framework for implementing machine learning into health care published by Shaw et al, 17 the authors stated that algorithms need to have a “ meaningful entryway ” into decision-making.”
BackgroundMethodAbbas, A. F., & Al-Lawati, E. H. (2025) · Journal of the International Council for Small Business · doi:10.1080/26437015.2025.2549059 · Cited by 26
Bin, K. J., Melo, A. A. R., da Rocha, J. G. M. F., de Almeida, R. P., Cobello-Júnior, V., Maia, F. L., de Faria, E., Pereira, A. J. R., Battistella, L. R., & Ono, S. K. (2021) · JMIR Formative Research · doi:10.2196/29012 · Cited by 28
“However, pressures of cost, high expectations, uncertain benefits, a large variety of stakeholders involved, data sharing, and patient safety remain challenging obstacles in the implementation of AI in health care [3-5].”
Dixit, A. S., & Jatav, S. (2024) · Journal of Management Development · doi:10.1108/jmd-01-2024-0009 · Cited by 22
The present and future role of artificial intelligence and machine learning in anesthesiology
Alexander, J. C., Romito, B. T., & Çobanoğlu, M. C. (2020) · International Anesthesiology Clinics · doi:10.1097/aia.0000000000000294 · Cited by 25
“117 One fi nal limitation is regulation.”
Five things every clinician should know about AI ethics in intensive care
Shaw, J., Sethi, N., & Block, B. L. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06277-y · Cited by 22
Self-citationKing, H., Wright, J. M., Treanor, D. E., Williams, B. J., & Randell, R. (2022) · Journal of Medical Internet Research · doi:10.2196/38039 · Cited by 21
Garcia-Lopez, A. E., Girón-Luque, F., & Rosselli, D. (2023) · Universitas Médica · doi:10.11144/javeriana.umed64-3.inte · Cited by 35
Sideris, K., Weir, C. R., Schmalfuss, C. M., Hanson, H., Pipke, M., Tseng, P.-H., Lewis, N. P., Sallam, K., Bozkurt, B., Hanff, T. C., et al. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae017 · Cited by 21
Human-centred AI for emergency cardiac care: Evaluating RAPIDx AI with PROLIFERATE_AI
de Plaza, M. A. P., Lambrakis, K., Marmolejo‐Ramos, F., Beleigoli, A. M. R., Archibald, M. M., Yadav, L., McMillan, P., Clark, R. A., Lawless, M., Morton, E. B., et al. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105810 · Cited by 22
Ma, F., Fan, Z., Nikolaeva, A., & Bao, H. (2025) · Fishes · doi:10.3390/fishes10030088 · Cited by 33
“In this context, the rapid development of artificial intelligence (AI) technologies presents innovative solutions to address these critical challenges [8,9].”
Designing for Control in Nurse-AI Collaboration During Emergency Medical Calls
Berge, A., Guribye, F., Fotland, S.-L. S., Fonnes, G., Johansen, I. H., & Trattner, C. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596110 · Cited by 20
Bolocan, V.-O., Mitoi, A., Nicu-Canareica, O., Băean, M.-L., Medar, C., & Popa, G.-A. (2025) · Journal of Imaging · doi:10.3390/jimaging11100335 · Cited by 22
“Journals could require algorithm registration similar to clinical trial registration, with pre-specified performance metrics and analysis plans [119].”
Machine Learning in Emergency Medicine: Keys to Future Success
Taylor, R. A., & Haimovich, A. D. (2020) · Academic Emergency Medicine · doi:10.1111/acem.14189 · Cited by 20
“18 D&I sciences provide a framework for the engagement of provider, patient, organizational, and policy stakeholders.”
BackgroundBhatt, S. A., Cohon, A., Rose, J., Majerczyk, N., Cozzi, B., Crenshaw, D., & Myers, G. (2021) · NEJM Catalyst · doi:10.1056/cat.21.0008 · Cited by 20
Levy, J., Chan, N., Marotti, J. D., Kerr, D. A., Gutmann, E. J., Glass, R. E., Dodge, C. P., Suriawinata, A. A., Christensen, B. C., Liu, X., et al. (2023) · Cancer Cytopathology · doi:10.1002/cncy.22732 · Cited by 21
“106,107 This framework assesses factors beyond effectiveness (e.g., performance at new sites, education/training, regulatory oversight, proficiency testing, etc.), which are critical for successful implementation.”
BackgroundDey, A. K. (2023) · International Journal of Diabetes and Technology · doi:10.4103/ijdt.ijdt_31_23 · Cited by 24
Hehakaya, C., Sharma, A. M., van Zyp, J. R. N. V. D. V., Grobbee, D. E., Verkooijen, H. M., Izaguirre, E. W., & Moors, E. H. M. (2022) · Advances in Radiation Oncology · doi:10.1016/j.adro.2022.100953 · Cited by 21
Xie, J., Chen, S., Zhao, L., & Dong, X. W. (2024) · Journal of Pharmaceutical Analysis · doi:10.1016/j.jpha.2024.101155 · Cited by 20
Jaigirdar, F. T., Rudolph, C., Oliver, G., Watts, D., & Bain, C. (2020) · 2020 IEEE 6th International Conference on Collaboration and Internet Computing (CIC) · doi:10.1109/cic50333.2020.00030 · Cited by 18
“Even if the overall system works perfectly, it is essential to know the very root of performing the decision, especially when the decision or prediction is crucial [6] [7].”
BackgroundAbdulhussain, R., Muhamad, H., Fiza, T., Dereiah, S., Mawla, N., Patel, K., Adebisi, A. O., & Asare‐Addo, K. (2026) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2026.126682 · Cited by 18
An overview of technologies available to monitor behaviours of mosquitoes
Javed, N., Paradkar, P. N., & Bhatti, A. (2024) · Acta Tropica · doi:10.1016/j.actatropica.2024.107347 · Cited by 18
Sumarlin, T., & Kusumajaya, R. A. (2024) · Journal of Management and Informatics · doi:10.51903/jmi.v3i2.25 · Cited by 17
“However, the implementation of AI also presents challenges, particularly regarding ethics and privacy (Shaw et al., 2019; Zhang et al., 2021).”
BackgroundConsumer Health in the Digital Age
Liu, P. J., Inman, J. J., Li, B., Wong, C. A., & Yang, N. (2021) · Journal of the Association for Consumer Research · doi:10.1086/718457 · Cited by 17
“Given healthcare provider time constraints, healthcare systems and healthcare providers may increasingly consider using digital technologies that provide decision support and automation (Shaw et al. 2019).”
BackgroundInsirat, M. N., Syahfir, H. A., Usman, A., & Mediaty, M. (2025) · Owner · doi:10.33395/owner.v9i1.2525 · Cited by 16
“Selain itu, di sektor ritel, AI dapat menganalisis perilaku konsumen dan memprediksi permintaan (Shaw et al., 2019; Taufik et al., 2023), sehingga membantu manajer dalam pengelolaan inventaris.”
Kyung, N., & Kwon, H. E. (2025) · Production and Operations Management · doi:10.1177/10591478231225891 · Cited by 16
Climent, R. C., Navarrete, S. R., Haftor, D., & Staniewski, M. W. (2023) · International Entrepreneurship and Management Journal · doi:10.1007/s11365-023-00922-w · Cited by 20
“ML algorithms are valuable for optimizing tasks that maximize and automate processes (Arel et al., 2010; Shaw et al., 2019).”
Morgan, P., & Cogan, N. A. (2024) · Journal of Public Mental Health · doi:10.1108/jpmh-07-2024-0095 · Cited by 16
Virk, A., Alasmari, S., Patel, D., & Allison, K. (2025) · Cureus · doi:10.7759/cureus.80676 · Cited by 15
“As machine learning and AI algorithms collect and analyze personal data, there is an increased risk of security breaches [46].”
Zhang, X., Gu, Y., Yin, J., Zhang, Y., Jin, C., Wang, W., Li, A. M., Wang, Y., Su, L., Xu, H., et al. (2023) · JMIR Formative Research · doi:10.2196/42202 · Cited by 14
“Unsatisfactory performance of knowledge and practice in the implementation of ethics [55,56] may be due to the unclear ethics framework and the lack of a series of support such as ethical training [23].”
BackgroundQutishat, M., & Shakman, L. (2025) · International Nursing Review · doi:10.1111/inr.70077 · Cited by 15
"Challenges implementing and running an AI-Lab: Experience and Literature Review"
Hergan, K. (2022) · Biomedical Journal of Scientific & Technical Research · doi:10.26717/bjstr.2022.45.007222 · Cited by 14
Swart, R., Boersma, L. J., Fijten, R., van Elmpt, W., Cremers, H., & Jacobs, M. (2024) · JCO Clinical Cancer Informatics · doi:10.1200/cci.24.00101 · Cited by 14
Artificial intelligence is going to transform the field of endocrinology: an overview
Belkhouribchia, J. (2025) · Frontiers in Endocrinology · doi:10.3389/fendo.2025.1513929 · Cited by 14
Harish, V., Samson, T. G., Diemert, L. M., Tuite, A. R., Mamdani, M., Khan, K., McGahan, A. M., Shaw, J., Das, S., & Rosella, L. C. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000164 · Cited by 15
“(2019), these tasks are ancillary to, but essential for delivering clinical services [44].”
BackgroundSelf-citationHow Artificial Intelligence for Healthcare Look Like in the Future?
Denecke, K., & Gabarrón, E. (2021) · Studies in health technology and informatics · doi:10.3233/shti210301 · Cited by 16
“There are clearly more challenges than those, such as: the burden of missing training data, reproducibility of AI-decisions [27], privacy considerations [28], implementation challenges [29] or the possible overuse of healthcare due to overdiagnosis done by AI [30], etc.”
BackgroundBarriers to Artificial Intelligence Adoption in Healthcare Management: A Systematic Review
Assadullah, M. M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3530598 · Cited by 13
Sinha, C. (2025) · Oxford Open Digital Health · doi:10.1093/oodh/oqaf016 · Cited by 13
“Moreover,the need for more implementation research to bridge the gap between the promise of AI-enabled solutions for global health and the real-world effects on health systems is gaining traction [10, 11].”
Zhang, L., Yang, J., & Fang, G. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1637270 · Cited by 15
“Conversely, Shaw et al. point out the limitations of AI in healthcare, including potential issues with data quality and privacy, which could lead to incorrect guidance or privacy breaches (18).”
Ispas, L., Mironeasa, C., Severin, T.-L., CERLINCĂ, D.-A., & Mironeasa, S. (2025) · Systems · doi:10.3390/systems13110967 · Cited by 17
“There are concerns about fairness, privacy, and transparency, which can complicate the implementation of AI [38,42,43].”
Innovation tactics for implementing an ML application in healthcare: A long and winding road
Gyldenkærne, C. H., Hansen, J. U., Hertzum, M., & Mønsted, T. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103162 · Cited by 13
“A supplementary reason for using algorithms for decision support, rather than automated decision making, is that their scope tends to be restricted to subtasks, thereby requiring a clinician to perform the remaining sub-tasks and ‘connect the dots ’ , that is, complete the task (Shaw et al., 2019).”
BackgroundAnalysing the Suitability of Artificial Intelligence in Healthcare and the Role of AI Governance
You, Z., Wang, Y., & Xiao, Y. (2025) · Health Care Analysis · doi:10.1007/s10728-025-00514-5 · Cited by 13
Revolutionizing food safety in the airline industry: AI-powered smart solutions
Kanwal, N., Zhang, M., Zeb, M., Hussain, M., & Wang, D. (2025) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2025.104970 · Cited by 15
F-CBR: An Architecture for Federated Case-Based Reasoning
Jaiswal, A. D., Yigzaw, K. Y., & Öztürk, P. (2022) · IEEE Access · doi:10.1109/access.2022.3188808 · Cited by 12
Etchebehere, E., Andrade, R., Camacho, M., Lima, M., Brink, A., Cerci, J. J., Nadel, H. R., Bal, C. S., Rangarajan, V., Pfluger, T., et al. (2022) · Journal of Nuclear Medicine Technology · doi:10.2967/jnmt.121.262900 · Cited by 12
Leveraging Artificial Intelligence for Expediting Implementation Efforts
Younas, A., & Reynolds, S. S. (2024) · Creative Nursing · doi:10.1177/10784535241239059 · Cited by 15
“Predictive analytics can enable implementation scientists and practitioners to generate more accurate and reliable predictions about to the outcomes of particular interventions and implementation strategies under particular contexts, settings, or conditions (Shaw et al., 2019).”
Bin-Salem, A. A., Zubaydi, H. D., Alzubaidi, M. S., Tariq, Z. U. A., & Naeem, H. (2022) · Traitement du signal · doi:10.18280/ts.390121 · Cited by 11
“For decades, academics have focused on AI owing to its potential to revolutionize healthcare [9].”
Tian, J., Zhao, Z., Tang, L., Song, Y., Li, Y., & Jiang, N. (2026) · Journal of Medical Internet Research · doi:10.2196/92680 · Cited by 12
“…often lack clearly defined organizational carriers through which governance becomes actionable [17], while implementation-oriented approaches tend to emphasize evaluation and oversight without addressing upstream conditions of ownership, financing, and sustained operational responsibility [6,18].”
Saini, F., Sharma, T., & Madan, S. (2021) · Advanced Journal of Graduate Research · doi:10.21467/ajgr.11.1.10-22 · Cited by 13
“J. Shaw, et al, [11] proposed use cases of machine learning- a field of AI by presenting a framework to help enable its use in the healthcare industry such as by giving decision support and automation.”
MethodCommentary on Biological Assets Cataloging and AI in the Global South
Samori, I. A., Palmer, X., Potter, L. N., & Karahan, S. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-16075-2_54 · Cited by 12
Data Science Implementation Trends in Nursing Practice: A Review of the 2021 Literature
Wieben, A. M., Walden, R. L., Alreshidi, B. G., Brown, S., Cato, K., Coviak, C. P., Cruz, C., D’Agostino, F., Douthit, B. J., Forbes, T. H., et al. (2023) · Applied Clinical Informatics · doi:10.1055/a-2088-2893 · Cited by 13
The poor performance of apps assessing skin cancer risk
Morley, J., Floridi, L., & Goldacre, B. M. (2020) · BMJ · doi:10.1136/bmj.m428 · Cited by 11
Shu, S., Luo, Q., & Chen, Z. (2025) · BMC Medical Ethics · doi:10.1186/s12910-025-01236-y · Cited by 10
“Although healthcare service providers are encouraged to go beyond legal compliance and take proactive roles in addressing AI ethics [45], they still face challenges in determining appropriate resource allocation for algorithmic ethics practices [9, 19, 57].”
AI MEETS HR – SYSTEMATIC REVIEW OF IMPLEMENTATION AND OPERATIONAL BARRIERS
Wójcik, M. (2025) · Scientific Papers of Silesian University of Technology Organization and Management Series · doi:10.29119/1641-3466.2025.224.35 · Cited by 10
Schaffernak, I., Cecil, J., Kleine, A., & Lermer, E. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13620-w · Cited by 12
“However, unique characteristics of AI, such as the opacity of machine learning algorithms, have prompted calls for research that specifically investigates how AI applications can be effectively embedded into clinical practice [19–21].”
AI Technologies for Delivering Government Services to Citizens: Benefits and Challenges
Mohamad, I., Hughes, L., Dwivedi, Y. K., & Alalwan, A. A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-15342-6_4 · Cited by 11
Kossowsky, H., & Nisky, I. (2022) · IEEE Transactions on Medical Robotics and Bionics · doi:10.1109/tmrb.2022.3156635 · Cited by 10
“There is also the question of rare cases; while the surgeon may be able to use their knowledge and experience to adapt to a rare or unexpected case, an AI system may not know how to respond to an unfamiliar case [51], [52].”
BackgroundDigital twin of patient in clinical workflow
Wickramasinghe, N. S., Ulapane, N. N. B., Andargoli, A., Shuakat, M. N., Nguyen, T. A., Zelcer, J., & Vaughan, S. (2023) · Proceedings of the Royal Society of Victoria · doi:10.1071/rs23013 · Cited by 9
Developing and evaluating a design method for positive artificial intelligence
van der Maden, W., Lomas, D., & Hekkert, P. (2024) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060424000155 · Cited by 11
“A useful checklist with the activities and outcomes of the method can be found in Appendix.”
Wood, K. V., Frings, D., Flood, C., & Thomas, N. (2025) · Digital Health · doi:10.1177/20552076251321016 · Cited by 9
“13 This study aimed to explore the experiences of patients and staff with an AI machine learning-driven appointment management system currently implemented in parts of the NHS. Speci fi cally, it sought to address gaps in the literature by examining the acceptability of this system and its…”
Ethical AI and Automation in the Workplace
Kayyali, M. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-5127-8.ch004 · Cited by 9
Turning the Tide—Artificial Intelligence in the Evolving Landscape of Liver Cancer
Grapa, C. M., Mocan, T., Mocan, L. P., Motofelea, A., Stănciulescu, R., Crăciun, R., Vârciu, A., Sparchez, Z. A., & Mocan, T. (2025) · Cancers · doi:10.3390/cancers17183003 · Cited by 10
“Most research so far focuses on the development and evaluation of advanced technical AI-based processes, but the gap between their potential and their clinical deployment persists [110].”
Mersal, F. A., Mersal, N. A., Ibrahim, N. M., Elgazzar, S. E., Alanazi, A. M., Alzughaibi, S., Alanazi, E. M., & Elsayed, E. A. H. (2026) · Digital Health · doi:10.1177/20552076261429671 · Cited by 9
“Signi fi cant interactions ( p < 0.05) were probed using simple slopes analysis, 25 calculating the association between perceived risks and trust at different levels of the moderator (e.g. with vs. without prior AI education; second-year vs. third-year vs. fourth-year students).”
InfluentialLu, S.-C., Knafl, M., Turin, A., Offodile, A. C., Ravi, V., & Sidey-Gibbons, C. J. (2023) · JCO Clinical Cancer Informatics · doi:10.1200/cci.22.00123 · Cited by 9
Development of Artificial Intelligence in the Dispute Resolution of Religious Courts
Sidqi, I., Nisa, S. M., & Daini, H. S. (2023) · JURNAL HUKUM ISLAM · doi:10.28918/jhi_v21i1_04 · Cited by 9
Newlands, R. S. N., Bruhn, H., Rzewuska, M., Lip, G., Anderson, L. A., & Ramsay, C. R. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-10926-z · Cited by 9
“Numerous concerns have been raised around the possible implications of AI for patient safety, data security, public acceptance and trust, accountability for decisions and impact in the broader healthcare system [12, 16].”
BackgroundDontchos, B. N., Dodelzon, K., Bhole, S., Edmonds, C. E., Mullen, L. A., Parikh, J. R., Daly, C., Epling, J. A., Christensen, S., & Grimm, L. J. (2025) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2025.05.001 · Cited by 9
Davoodi, L., & Mezei, J. (2022) · Bled eConference · doi:10.18690/um.fov.4.2022.13 · Cited by 12
Lakkimsetti, M., Devella, S. G., Patel, K. B., Dhandibhotla, S., Kaur, J., Mathew, M., Kataria, J., Nallani, M., Farwa, U. E., Patel, T. D., et al. (2024) · Cureus · doi:10.7759/cureus.58400 · Cited by 10
“Despite the advantages, abundant literature raises concerns about using AI in healthcare [4,5].”
BackgroundBélisle‐Pipon, J., & David, P. (2023) · Pharmaceutical Medicine · doi:10.1007/s40290-022-00459-3 · Cited by 9
Weinert, L., Klass, M., Schneider, G., & Heinze, O. (2023) · JMIR Formative Research · doi:10.2196/43958 · Cited by 8
“In addition, legal uncertainty surrounding the (partly) automized testing of routine medical data against defined gold standards persists [14].”
BackgroundKloka, J., Holtmann, S. C., Nürenberg-Goloub, E., Piekarski, F., Zacharowski, K., & Friedrichson, B. (2022) · JMIR Formative Research · doi:10.2196/43896 · Cited by 6
“In line with challenges highlighted in previous research [4,5,14,15,26,27], our survey shows that intensivists and anesthesiologists anticipate a high potential for technical problems and legal issues related to defining liability and ensuring data protection.”
BackgroundResultArdito, V., Cappellaro, G., Compagni, A., Petracca, F., & Preti, L. M. (2023) · JMIR Research Protocols · doi:10.2196/47971 · Cited by 10
Metadata
- Authors
- Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A.
- Affiliations
- University of Toronto (CA)
- St. Michael's Hospital (CA)
- Corresponding author
- Shaw, James
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-07-10
- Volume
- 21
- Issue
- 7
- Pages
- e13659
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6652121
- OpenAlex
- W2947151330
- Cited by
- 389
- References
- 58
- Citations by year
- 2026: 62 · 2025: 70 · 2024: 68 · 2023: 77 · 2022: 49 · 2021: 36 · 2020: 22 · 2019: 5
- FWCI
- 8.91
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- artificial intelligence in healthcare, machine learning implementation, NASSS framework, clinical decision support, explainability, algorithmic bias, privacy and consent, healthcare workforce, scalability, technology adoption, implementation science
- MeSH terms
- Machine Learning, Artificial Intelligence, Humans, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.