From Bit to Bedside: A Practical Framework for Artificial Intelligence Product Development in Healthcare
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) in healthcare holds great potential to expand access to high‐quality medical care, while reducing systemic costs. Despite hitting headlines regularly and many publications of proofs‐of‐concept, certified products are failing to break through to the clinic. AI in healthcare is a multiparty process with deep knowledge required in multiple individual domains. A lack of understanding of the specific challenges in the domain is the major contributor to the failure to deliver on the big promises. Herein, a “decision perspective” framework for the development of AI‐driven biomedical products from conception to market launch is presented. The framework highlights the risks, objectives, and key results which are typically required to navigate a three‐phase process to market‐launch of a validated medical AI product. Clinical validation, regulatory affairs, data strategy, and algorithmic development are addressed. The development process proposed for AI in healthcare software strongly diverges from modern consumer software development processes. Key time points to guide founders, investors, and key stakeholders throughout the process are highlighted. This framework should be seen as a template for innovation frameworks, which can be used to coordinate team communications and responsibilities toward a viable product development roadmap, thus unlocking the potential of AI in medicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The framework for AI health care product development highlighted that RCTs are often recommended to provide strong evidence to validate the clinical efficacy and safety of an AI-assisted tool in real-world settings [61].”
From Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review (2022) · cites this paper as [61]
The cited source says what the claim attributes to it.
In the citing paper
“A major goal of AI in healthcare product development is to approximate this ideal state via thorough clinical validation and development on heterogeneous data sources [1].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [1]
In the citing paper
“Medical AI systems and especially CDSSs, whether AI-powered or not, have to undergo a rigorous validation process to meet regulatory standards and achieve medical certification [1].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,445 · cited 1×
“matical function of data [5]). Other non-ANN machine learning methods successfully applied in healthcare include decision tree algorithms [6–8], generalised linear models [9], support vector machines [10,11] and gaussian processes (GPs) [12,13]. Modern ML methods constitute the new state-ofthe-art in computer vision […”
Method(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“And indeed, commercial products in healthcare have already been shown to contain considerable racial bias [55].”
BackgroundGaussian Processes in Machine Learning
Rasmussen, C. E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_4 · Cited by 5,397
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 1×
“determined in the training process and also determine the predictive capability of the model [4].”
Background
Research works printed but not linked: 8
- Patel P., 2020, Int. J. Electr. Comput. Eng., 10, 538
- M. E.Peters M.Neumann M.Iyyer M.Gardner C.Clark K.Lee L.Zettlemoyer Proc. of the 2018 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long Papers) Association for Computational Linguistics New Orleans LA2018 pp.2227–2237.
- S.Rendle F.Machines inProc. IEEE Int. Conf. on Data Minning IEEE Sydney2010.
- R.Ying R.He K.Chen P.Eksombatchai W. L.Hamilton J.Leskovec inProc. 24th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining Association for Computing Machinery New York NY2018.
- Livne M., 2019, XPOMET©: 360° Next Generation Healthcare
- Englich B., 2016, Pers. Soc. Psychol. Bull., 2, 188
- Hacker P., 2020, Artif. Intell. Law
- Schneider S., 2001, The B-Method
Cited by
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
Self-citationVasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01772-9 · Cited by 1,039
Self-citationVasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070904 · Cited by 665
Borys, K., Schmitt, Y. A., Nauta, M., Seifert, C., Krämer, N., Friedrich, C. M., & Nensa, F. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.110786 · Cited by 233
A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?
Bharati, S., Mondal, M. R. H., & Podder, P. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3266418 · Cited by 203
“As part of the AI framework, healthcare decisions are made in part by healthcare practitioners with malpractice insurance [31], [55], [56].”
BackgroundArtificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198
“Research on AI implementation in health care is predominantly conceptual in nature, dominated by commentaries, perspectives, opinion articles, and conceptual frameworks that raise important questions and issues but without much-needed empirical evidence [93-96].”
Roy, S., Meena, T., & Lim, S.-J. (2022) · Diagnostics · doi:10.3390/diagnostics12102549 · Cited by 164
Fraser, A. G., Biasin, E., Bijnens, B., Bruining, N., Caiani, E. G., Cobbaert, K., Davies, R. H., Gilbert, S. H., Hovestadt, L., Kamenjasevic, E., et al. (2023) · Expert Review of Medical Devices · doi:10.1080/17434440.2023.2184685 · Cited by 88
“Methodological guidelines Park 2020 JAMIA Open [65] Cross-specialty Recommendations for a phased approach to medical AI evaluation Sendak 2020 EMJ Innovation [66] European Medical Journal Cross-specialty Recommendations for translation of ML products into healthcare delivery McCradden 2020 Nature Medicine [67] Cross-s…”
MethodAlgorithm Change Protocols in the Regulation of Adaptive Machine Learning–Based Medical Devices
Gilbert, S., Fenech, M., Hirsch, M., Upadhyay, S., Biasiucci, A., & Starlinger, J. (2021) · Journal of Medical Internet Research · doi:10.2196/30545 · Cited by 100
“…class devices discussed by [8,9], and also for adaptive ML-based SaMD and autonomous applications, there is a requirement for smarter regulation in the EU, United States, and worldwide, both to ensure patient safety and to remove a hurdle to adoption and advancement of the technologies [10-13].”
Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review
Lam, T. Y. T., Cheung, M. F. K., Munro, Y. L., Lim, K. M., Shung, D., & Sung, J. J. Y. (2022) · Journal of Medical Internet Research · doi:10.2196/37188 · Cited by 120
Hilbert, A., Madai, V. I., Akay, E. M. Z., Aydin, O. U., Behland, J., Sobesky, J., Galinović, I., Khalil, A. A., Taha, A. A., Wuerfel, J. T., et al. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.552258 · Cited by 119
“In recent years, the medical AI research field showed a tendency to develop an overwhelming focus for performance in homogeneous samples in contrast to the requirements for a medical imaging product (Higgins and Madai, 2020).”
BackgroundSelf-citationAmann, J., Vayena, E., Ormond, K. E., Frey, D., Madai, V. I., & Blasimme, A. (2023) · PLOS ONE · doi:10.1371/journal.pone.0279088 · Cited by 106
“Indeed, evidence suggests that despite their attested performance and technical sophistication [4,5], AI-powered CDSS, particularly those based on the latest deep neural networks, often fail to realize their potential beyond the proof-of-concept stage [6–8].”
Self-citationSubaşı, D. Ö., Sümengen, A. A., Semerci, R., Şimşek, E., Çakır, G. N., & Temizsoy, E. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16335 · Cited by 97
Explainable Artificial Intelligence: A Perspective on Drug Discovery
Qadri, Y. A., Shaikh, S., Ahmad, K., Choi, I., Kim, S. W., & Vasilakos, A. V. (2025) · Pharmaceutics · doi:10.3390/pharmaceutics17091119 · Cited by 97
“AI has the potential to help address these issues by improving care quality and cost effectiveness [68].”
Co-Design of a Trustworthy AI System in Healthcare: Deep Learning Based Skin Lesion Classifier
Zicari, R. V., Ahmed, S., Amann, J., Braun, S. A., Brodersen, J., Bruneault, F., Brusseau, J., Campano, E., Coffee, M., Dengel, A., et al. (2021) · Frontiers in Human Dynamics · doi:10.3389/fhumd.2021.688152 · Cited by 71
“Best practice guidelines for AI in healthcare development stress the continuous alignment of technical development with a clinical use case (Higgins and Madai, 2020).”
BackgroundSelf-citationLämmermann, L., Hofmann, P., & Urbach, N. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102728 · Cited by 93
“…favorable value attributes enable value creation (e.g., interaction requirements, explainability, safety expectations), adverse value refers to attributes whose existence hinders value creation (e.g., errors and workflow disruption by an AI application) (Higgins & Madai, 2020; Reimer et al., 2020).”
BackgroundInfluentialCall for the responsible artificial intelligence in the healthcare
Upadhyay, U., Gradišek, A., Iqbal, U., Dhar, E., Li, Y., & Syed-Abdul, S. (2023) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100920 · Cited by 92
A machine-learning–based algorithm improves prediction of preeclampsia-associated adverse outcomes
Schmidt, L. J., Rieger, O., Neznansky, M., Hackelöer, M., Dröge, L. A., Henrich, W., Higgins, D., & Verlohren, S. (2022) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2022.01.026 · Cited by 91
Self-citationThe Impact and Issues of Artificial Intelligence in Nursing Science and Healthcare Settings
Pailaha, A. D. (2023) · SAGE Open Nursing · doi:10.1177/23779608231196847 · Cited by 85
“AI technology in healthcare has the greatest potential to improve and expand access to high-quality medical care, providing personalized intervention and monitoring with reduced error rates and lower costs (D. Higgins & Madai, 2020).”
BackgroundLauritsen, S. M., Thiesson, B., Jørgensen, M. J., Riis, A. H., Espelund, U. S., Weile, J. B., & Lange, J. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00529-x · Cited by 61
Artificial Intelligence for Clinical Decision Support in Acute Ischemic Stroke: A Systematic Review
Akay, E. M. Z., Hilbert, A., Carlisle, B. G., Madai, V. I., Mutke, M. A., & Frey, D. (2023) · Stroke · doi:10.1161/strokeaha.122.041442 · Cited by 77
Self-citationVasey, B., Novak, A., Ather, S., Ibrahim, M., & McCulloch, P. G. (2023) · Clinical Radiology · doi:10.1016/j.crad.2022.09.131 · Cited by 74
Kossen, T., Subramaniam, P., Madai, V. I., Hennemuth, A., Hildebrand, K., Hilbert, A., Sobesky, J., Livne, M., Galinović, I., Khalil, A. A., et al. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104254 · Cited by 72
Self-citationMachine-learned, waterproof MXene fiber-based glove platform for underwater interactivities
Duan, S., Lin, Y., Zhang, C., Li, Y., Zhu, D., Wu, J. L., & Lei, W. (2021) · Nano Energy · doi:10.1016/j.nanoen.2021.106650 · Cited by 63
Dengler, N. F., Madai, V. I., Unteroberdörster, M., Zihni, E., Brune, S. C., Hilbert, A., Livne, M., Wolf, S., Vajkoczy, P., & Frey, D. (2021) · Neurosurgical Review · doi:10.1007/s10143-020-01453-6 · Cited by 63
“However, the substantial heterogeneity of clinical questions, input and output variables, and applied algorithms may reduce traceability and reproducibility [24, 32].”
BackgroundSelf-citationYou, J. G., Hernandez-Boussard, T., Pfeffer, M. A., Landman, A., & Mishuris, R. G. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01506-4 · Cited by 59
Leveraging explainable AI for sustainable agriculture: a comprehensive review of recent advances
Rajbongshi, A., Johora, F. T., Hossain, A., Sarker, M. S., Rahman, M. H., Rahman, M. W., Alotaibi, F. T., & Moni, M. A. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-025-11459-5 · Cited by 60
“To fulfill regulatory norms and get medical accreditation, medical AI frameworks, particularly Clinical Decision Support Systems (CDSSs), must undergo rigor - ous validation procedures (Higgins and Madai 2020 ).”
External validation of AI-based scoring systems in the ICU: a systematic review and meta-analysis
Rockenschaub, P., Akay, E. M., Carlisle, B. G., Hilbert, A., Wendland, J., Meyer-Eschenbach, F., Näher, A.-F., Frey, D., & Madai, V. I. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02830-7 · Cited by 58
“There is a continued lack of verification and clinical validation, blocking the translation of these proof-of-concepts to actual products [18].”
InfluentialSelf-citationThe unmet promise of trustworthy AI in healthcare: why we fail at clinical translation
Bürger, V. K., Amann, J., Bui, C. K. T., Fehr, J., & Madai, V. I. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1279629 · Cited by 56
Self-citationCornelissen, L., Egher, C., van Beek, V., Williamson, L., & Hommes, D. W. (2022) · JMIR Formative Research · doi:10.2196/33368 · Cited by 53
“Even though AI has already been proven beneficial in several health areas, such as clinical decision support, patient monitoring, health interventions, and health care administration [4-6], its impact on health care delivery has thus far remained limited [7].”
BackgroundZhang, J., Morley, J., Gallifant, J., Oddy, C., Teo, J., Ashrafian, H., Delaney, B. C., & Darzi, A. W. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(23)00157-7 · Cited by 54
Walger, L., Adler, S., Wagstyl, K., Henschel, L., David, B., Borger, V., Hattingen, E., Vatter, H., Elger, C. E., Baldeweg, T., et al. (2023) · Epilepsia · doi:10.1111/epi.17522 · Cited by 52
“Given the clinical relevance of FCD detection, we think this is one of the first fields where AI algorithms may translate successfully from “bit to bedside” 19 into a measurable advance for health care.”
BackgroundStypińska, J., & Franke, A. (2023) · Frontiers in Sociology · doi:10.3389/fsoc.2022.1038854 · Cited by 51
“Diagnostic tools, although very promising and receiving heightened attention in the last few years, are not yet deemed as safe and accurate enough to be used in everyday practise and their general uptake among clinicians is still low (Higgins and Madai, 2020).”
BackgroundBucher, A., Blazek, E. S., & Symons, C. T. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.05.007 · Cited by 48
“…evidence for the use of AI to change real-world behaviors d especially as randomized controlled trials showing causal impact will be necessary for widespread clinical adoption 106 and with innovative approaches such as just-in-time adaptive interventions and N-of-1 experimentation available to use.”
Validation of Artificial Intelligence Containing Products Across the Regulated Healthcare Industries
Higgins, D., & Johner, C. (2023) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-023-00530-4 · Cited by 44
“A previous article in a similar vein [44], by one of the authors, has seen considerable success within one of the top-3 pharma companies (personal communications).”
BackgroundSelf-citationRadiologists in the loop: the roles of radiologists in the development of AI applications
Scheek, D., Mehrizi, M. H. R., & Ranschaert, E. R. (2021) · European Radiology · doi:10.1007/s00330-021-07879-w · Cited by 39
Mukhopadhyay, A., Sumner, J., Ling, L. H., Quek, R. H. C., Tan, A. T. H., Teng, G. G., Seetharaman, S. K., Gollamudi, S. P. K., Ho, D., & Motani, M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19158979 · Cited by 38
Kwiatek, J., Leśna, M., Piskórz, W., & Kaczewiak, J. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14051566 · Cited by 37
“The growing interest in AI technology in medicine and dentistry stems from its potential to enhance diagnostic precision, improve treatment efficiency, and reduce healthcare costs [20].”
Machine Learning in Stroke Medicine: Opportunities and Challenges for Risk Prediction and Prevention
Amann, J. (2021) · Advances in neuroethics · doi:10.1007/978-3-030-74188-4_5 · Cited by 37
Explainable Artificial Intelligence (XAI) with IoHT for Smart Healthcare: A Review
Bharati, S., Mondal, M. R. H., Podder, P., & Köse, U. (2023) · Internet of things · doi:10.1007/978-3-031-08637-3_1 · Cited by 36
Domesticating AI in medical diagnosis
Williams, R., Anderson, S., Cresswell, K. M., Kannelønning, M. S., Mozaffar, H., & Yang, X. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102469 · Cited by 36
“These costs may be prohibitively high in relation to available income streams – particularly for SMEs, accentuating concerns about reimbursement: how soon can new ventures secure sales/licensing income to recover their investments [44].”
BackgroundMulti-Criteria Decision Analysis for Benefit-Risk Analysis by National Regulatory Authorities
Chisholm, O., Sharry, P., & Phillips, L. D. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.820335 · Cited by 33
Bhimani, M., Miller, A., Agnew, J. D., Ausin, M. S., Raglow-Defranco, M., Mangat, H. S., Voisard, M., Taylor, M., Bierman-Lytle, S., Parikh, V., et al. (2025) · medRxiv · doi:10.1101/2025.03.17.25324157 · Cited by 32
Zinchenko, V. V., Arzamasov, K. M., Четвериков, С. Ф., Maltsev, A. V., Novik, V. P., Akhmad, E. S., Е., Ш. Д., Андрейченко, А. Е., Vladzymyrskyy, A. V., & Morozov, S. P. (2022) · Современные технологии в медицине · doi:10.17691/stm2022.14.5.02 · Cited by 31
“The recommendations of the International Medical Device Regulators Forum (IMDRF) developed for software as an MD [14, 17], FDA documents [11, 18], as well as additional literature [2, 13, 15, 19, 20] were also considered.”
MethodAESRSA: A New Cryptography Key for Electronic Health Record Security
Ajagbe, S. A., Flórez, H., & Awotunde, J. B. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-19647-8_17 · Cited by 31
Weimar, S. N., Martjan, R. S., & Terzidis, O. (2024) · Management Review Quarterly · doi:10.1007/s11301-024-00417-0 · Cited by 31
“However, there are numerous challenges to adopting AI in healthcare (Singh et al. 2020), which is why practical frameworks have been developed to provide guidance on best practices for founders (Arora 2020; Higgins and Madai 2020).”
Artificial Intelligence in Healthcare: Lost In Translation?Preprint
Madai, V. I., & Higgins, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.13454 · Cited by 28
“In order to successfully deploy AI in healthcare solutions, honest and repeated testing of the internal and external validity of the models is necessary at all stages in the development process [8].”
InfluentialSelf-citationLee, K. H., Lee, R. W., Yun, J.-S., Kim, M. S., & Choi, H. S. (2024) · Diagnostics · doi:10.3390/diagnostics14212451 · Cited by 27
Artificial Intelligence in Traditional Chinese Medicine: Unraveling Herbal Medicine’s Mechanisms
He, Y., Wu, S. Q., Li, J., Chen, S., Chen, S., Zhang, Z., He, B., Hong, Y., Sun, C., & Kai, G. (2026) · Research · doi:10.34133/research.1224 · Cited by 24
“Traditional TCM efficacy assessment relies heavily on subjective symptom evaluations, but AI can analyze high-dimensional data (imaging, laboratory indices, and wearable device data) to identify latent, quantifiable biomarkers that correlate with TCM treatment responses [ 97 ].”
Yao, S., Shen, P., Dai, T., Dai, F., Wang, Y., Zhang, W., & Lu, H. J. (2023) · iScience · doi:10.1016/j.isci.2023.106530 · Cited by 23
“However, this task would be difficult to perform without interpreting AI results, especially when AI predictions contradict clinicians’ own assessment.(14) Third, current AI models are mostly trained and validated in cleaned and selective data.”
Kim, J., Kim, S. Y., Kim, E.-A., Sim, J.-A., Lee, Y., & Kim, H. (2024) · Asian Bioethics Review · doi:10.1007/s41649-024-00281-w · Cited by 22
“Conversely, healthcare AI research entails an iterative process of development, refinement, and validation of algorithms or applications, inherently characterized by their modifiability (Higgins and Madai 2020).”
BackgroundBolton, W. J., Wilson, R. C., Gilchrist, M. J., Georgiou, P., Holmes, A. H., & Rawson, T. M. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100912 · Cited by 21
OnRAMP for Regulating Artificial Intelligence in Medical Products
Higgins, D. C. (2021) · Advanced Intelligent Systems · doi:10.1002/aisy.202100042 · Cited by 21
Self-citationNúñez‐Merino, M., Marín, J. M. M., Moyano‐Fuentes, J., & Castaño-Moraga, C. A. (2024) · Production Planning & Control · doi:10.1080/09537287.2024.2349224 · Cited by 20
“In healthcare NPD, specifically, project management plays a crucial role in coordinating interdisciplinary teams, navigating regulatory requirements, and ensuring the timely and cost-effective delivery of new healthcare products and services to the market (Higgins and Madai 2020).”
Uihlein, A., Beissel, L., Ajlani, A. H., Orzechowski, M., Leinert, C., Kocar, T. D., Pankratz, C., Schuetze, K., Gebhard, F. T., Steger, F., et al. (2024) · JMIR Aging · doi:10.2196/57899 · Cited by 19
“Albeit only mentioned by a few participants, data protection and scientific evaluation of a new AI-CDSS are essential regarding the medico-ethical concept of nonmalefi-cence [53,54].”
Impact of AI in Healthcare Services: Analysis Using Medical Synthetic Data
Gani, R., Isty, M. N., Rimi, R. A., Parsub, W. R., Islam, M. S., Priyanka, M. M., Rashid, M. R. A., Hasan, M., Mansoor, N., & Adnan, M. N. (2024) · International Conference on Advances in Computing, Communication, Electrical, and Smart Systems (iCACCESS) · doi:10.1109/icaccess61735.2024.10499613 · Cited by 14
“AI in the development of clinical product development Higgins et al. [8] bring up the importance of those products that are convenient and secure for a patient in their methodical review.”
BackgroundComprehensive Evaluation of AI-Driven Systems in Modern Hospital Environments
Ravikumar, R. N., Aarthi, S., Atamuratova, Z., Ashirova, A. I., Atamuratovich, J. K., & Hayitova, M. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2787-7.ch003 · Cited by 14
Altobelli, E., Angeletti, P. M., Ciancaglini, M., & Petrocelli, R. (2025) · Healthcare · doi:10.3390/healthcare13040378 · Cited by 13
“As reported by Higgins et al., the application of AI may be able to change the approach of doctors and patients to the pathology [51].”
ISO 13485:2016 – The Gateway of Global or Regional Harmonization for Medical Device Regulations
Jadhav, N. M., & Shendge, R. S. (2024) · International Journal of Pharmaceutical Quality Assurance · doi:10.25258/ijpqa.15.1.76 · Cited by 12
Data-Driven Quality of Care in the ICU: A Concise Review
Moralez, G. M., Amado, F., Liu, V. X., Tan, S. C., Meyfroidt, G., Stevens, R. D., Pilcher, D., & Salluh, J. I. (2025) · Critical Care Medicine · doi:10.1097/ccm.0000000000006862 · Cited by 12
Naik, S., Vellappally, S., Alateek, M., Alrayyes, Y. F., Kheraif, A. A. A., Alnassar, T. M., Alsultan, Z. M., Thomas, N. G., & Chopra, A. (2025) · International Dental Journal · doi:10.1016/j.identj.2025.103893 · Cited by 11
The Need for the Human-Centred Explanation for ML-based Clinical Decision Support Systems
Jia, Y., McDermid, J. A., Hughes, N. G. J., Sujan, M. A., Lawton, T., & Habli, I. (2023) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi57859.2023.00064 · Cited by 10
“However, comparatively few systems are in widespread use in healthcare and one of the reasons for this is the challenge of demonstrating safety [2], especially of the ML components.”
BackgroundEl‐Gazar, H. E., AbdElhay, E. S., Abdelhay, I. S., & Zoromba, M. A. (2025) · BMC Nursing · doi:10.1186/s12912-025-03624-6 · Cited by 9
“AI provides personalized interventions and monitoring with reduced error rates and costs [3].”
It's the data, stupid: Inflection point for Artificial Intelligence in Indian healthcare
Ramaswamy, A., Gowda, N. R., Vikas, H., Prabhu, M., Sharma, D. K., Gowda, P. R., Mohan, D., & Kumar, A. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2022.102300 · Cited by 9
Morley, J. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-jxprn9ry5 · Cited by 9
Steffny, L., Dahlem, N., Reichl, L., Gisa, K., Greff, T., & Werth, D. (2023) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia230090 · Cited by 8
Surveying the Academic Literature on the Use of OKR (Objectives and Key Results) – An Update
Silva, R. V., & Santos, G. (2024) · iSys - Brazilian Journal of Information Systems · doi:10.5753/isys.2024.3885 · Cited by 8
Artificial Intelligence in Predictive Healthcare Analytics
Irene, N. J. (2025) · IAA Journal of Biological Sciences · doi:10.59298/iaajb/2025/1316774 · Cited by 7
Translational health technology and system schemes: enhancing the dynamics of health informatics
Rissanen, M. (2020) · Health Information Science and Systems · doi:10.1007/s13755-020-00133-5 · Cited by 7
“However, it is remarked that promising technologies are not reaching the patients and healthcare systems because beneficial products are not deployed at the rates required [55].”
BackgroundBellina, F., & Jungmann, S. (2023) · Springer eBooks · doi:10.1007/978-3-031-32614-1_13 · Cited by 7
Why Companies Fail With Objectives And Key Results: An Analysis Of Implementation Frameworks
Herkenrath, C., Hoeborn, G., & Stich, V. (2023) · Publication Server of FIR e. V. an der RWTH Aachen · doi:10.15488/13449 · Cited by 7
Pavanya, M., Chadaga, K., Jaganathan, V., Vasudeva, A., Rao, B. K., & Bhat, S. K. (2025) · Healthcare Technology Letters · doi:10.1049/htl2.70014 · Cited by 6
“Explainability makes settling disputes between human specialists and AI systems possible regardless of who renders an error in judgement [21, 22].”
Pallamala, G., Jenkins, J., Sherin, P. K., Nyathi, A., & George, J. (2026) · Oxford Open Digital Health · doi:10.1093/oodh/oqag004 · Cited by 6
“AI offers a promising, cost-effective means to improve healthcare delivery (Higgins et al. 2020).”
Bashir, M., El–Sappagh, S., Woo, S. S., Kim, D. I., & Abuhmed, T. (2026) · Information Fusion · doi:10.1016/j.inffus.2026.104507 · Cited by 6
Explainable AI and Its Applications in Healthcare
Sarkar, A. (2022) · Intelligent systems reference library · doi:10.1007/978-3-031-12807-3_6 · Cited by 6
Wenderott, K., Krups, J., & Weigl, M. (2026) · BMJ Open Quality · doi:10.1136/bmjoq-2025-003639 · Cited by 6
EasyDiagnos: An Accurate Feature Selection Framework for Automated Diagnosis in Smart Healthcare
Maji, P., Mondal, H. K., Mondal, H. K., & Mohanty, S. P. (2025) · SN Computer Science · doi:10.1007/s42979-025-04260-2 · Cited by 5
“Today’s world has made medical illness analysis more and more critical [20], leading to increased research and development efforts in this area.”
Pandey, J. K., Verma, S. K., Kumar, J., Perwej, Y., Jha, S. K., Panchal, B. Y., Ferdouse, R., Sindhu, V., Banerjee, S., Tiwari, M., et al. (2026) · Seminars in Ultrasound CT and MRI · doi:10.1053/j.sult.2026.06.010 · Cited by 5
Thavanesan, N., Naiseh, M., Terol, M., Rahman, S., Hill, S. L., Parfitt, C., Walters, Z. S., Ramchurn, S. D., Markar, S. R., Owen, R. P., et al. (2025) · EClinicalMedicine · doi:10.1016/j.eclinm.2025.103527 · Cited by 4
“32 This is multifactorial in nature but partly attributable to a sense of clinician superiority especially when handling nuance and uncertainty, or a lack of clinical validation.”
Ensuring Halal Compliance in AI-Driven Healthcare Solutions: Balancing Innovation and Faith
Rahman, M. M. (2023) · Advances in healthcare information systems and administration book series · doi:10.4018/979-8-3693-1082-3.ch015 · Cited by 4
Sestino, A., Nasta, L., Rossi, M. V., & Barth, H. (2024) · Technology Analysis and Strategic Management · doi:10.1080/09537325.2024.2405137 · Cited by 3
Doğan, N., & Aksoy, M. (2025) · Karya Journal of Health Science · doi:10.52831/kjhs.1686433 · Cited by 3
Explanation Beyond Individual Features: Instance-wise Feature Grouping for EHR Predictive Analytics
Cheong, C. W., Yin, K., Cheung, W. K., & Tsang, I. W.-H. (2025) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-025-00222-8 · Cited by 3
Artificial intelligence-driven patient monitoring for adverse event detection in clinical trials
Vampana, S. B., Jayanthi, E. S. S., Mary, D. A., & Sriniketh, C. (2024) · International Journal of Basic & Clinical Pharmacology · doi:10.18203/2319-2003.ijbcp20241657 · Cited by 3
The fundamentals of AI ethics in medical imaging
Amann, J., Bürger, V. K., Livne, M., Bui, C. K. T., & Madai, V. I. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-323761-4.00010-9 · Cited by 3
Self-citationBenjamin, M., Engelhard, G., Aisen, A. M., Aradi, Y., & Benjamin, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.13781 · Cited by 3
“The difficulty of gathering data for feedback and monitoring has been emphasized [37].”
BackgroundHilbert, A., Akay, E. M. Z., Carlisle, B. G., Madai, V. I., Mutke, M. A., & Frey, D. (2022) · Research Square · doi:10.21203/rs.3.rs-1706474/v3 · Cited by 3
Self-citationHardware Accelerated Foundations for Multimodal Medical AI Systems: A Comprehensive SurveyPreprint
Liu, Z., Bi, Z., Liang, C. X., Song, J., Wang, T., Zhang, Y., Liu, M., & Song, X. (2025) · doi:10.36227/techrxiv.174613320.07642490/v2 · Cited by 3
Médecine générale et intelligence artificielle : revue de la littérature
Molcard, A. (2023) · HAL · Cited by 3
Public Library Service Transformation Impact on Adult Learning: Evidence from Ningbo Libraries
Al-Safarini, M. Y., & Baashirah, R. (2025) · El Profesional de la Informacion · doi:10.3145/epi.2024.ene.0612 · Cited by 2
Mahmood, T., Wang, Y., Khan, A. R., & Ayesha, N. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-23979-3.00013-0 · Cited by 2
Ethical considerations in artificial intelligence-powered patient counseling
Patne, A. Y., & Suryawanshic, M. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-43823-3.00011-x · Cited by 2
Cura, Ş. Ü., Atay, S., Çimen, M., & Işık, E. (2026) · BMC Nursing · doi:10.1186/s12912-026-04763-0 · Cited by 2
“The fact that AI-supported systems reduce routine workload, thereby providing nurses with the opportunity to allocate more time to direct patient care [4, 32, 33], may contribute to the strengthening of the caring value.”
Omisade, O., Gegov, A., Zhou, S., Good, A., Tryfona, C., Sengar, S. S., Prior, A.-L., Liu, B., Adedeji, T., & Toptan, C. M. (2023) · Smart innovation, systems and technologies · doi:10.1007/978-981-99-6706-3_3 · Cited by 2
AI in Indian Healthcare Startups
Kumar, S., & Nandini, S. (2024) · Advances in medical technologies and clinical practice book series · doi:10.4018/979-8-3693-8990-4.ch001 · Cited by 2
Algorithmic Approaches, Practical Implementations and Future Research Directions in Machine Learning
Sharma, V., Sharma, D., & Punia, S. K. (2024) · International Conference on Advances in Computing, Communication and Networking (ICAC2N) · doi:10.1109/icac2n63387.2024.10895837 · Cited by 2
Efforts to a Belief and Decolonize Global Health
Omambia, S. M. (2023) · Journal of Advances in Medicine and Medical Research · doi:10.9734/jammr/2023/v35i125032 · Cited by 2
Using Artificial Intelligence in the OKRs Methodology: A Theoretical Framework
Gonçalves, V. B., Palmeira, E. G. Q., Martin, V. B. S., Moraes, Í. A., de Siqueira, A. G., & Cardoso, A. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-54235-0_34 · Cited by 2
Ganesan, S., & Arulkumaran, G. (2025) · International Journal of Multidisciplinary and Current Research · doi:10.14741/ijmcr/v.9.2.9 · Cited by 2
Opportunities and Challenges of Explainable AI (XAI) in Health Care: A Review
Begum, M., & Ferdush, J. (2026) · Journal of Computer and Communications · doi:10.4236/jcc.2026.146006 · Cited by 1
Metadata
- Authors
- Higgins, D., & Madai, V. I.
- Affiliations
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin (DE)
- Charité – Universitätsmedizin Berlin (DE)
- Corresponding author
- Higgins, David
- Venue
- Advanced Intelligent Systems
- Publisher
- Wiley
- Published
- 2020-07-02
- Volume
- 2
- Issue
- 10
- ISSN
- 2640-4567 (ISSN-L)
- OpenAlex
- W3012810655
- Cited by
- 118
- References
- 58
- Citations by year
- 2026: 19 · 2025: 25 · 2024: 20 · 2023: 23 · 2022: 17 · 2021: 9 · 2020: 5
- FWCI
- 3.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Advanced Intelligent Systems (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- artificial intelligence in healthcare, clinical validation, regulatory affairs, data strategy, algorithm development, innovation framework, clinical translation, medical software development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.