From Bit to Bedside: A Practical Framework for Artificial Intelligence Product Development in Healthcare
Open accessThe DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) in healthcare holds great potential to expand access to high‐quality medical care, while reducing systemic costs. Despite hitting headlines regularly and many publications of proofs‐of‐concept, certified products are failing to break through to the clinic. AI in healthcare is a multiparty process with deep knowledge required in multiple individual domains. A lack of understanding of the specific challenges in the domain is the major contributor to the failure to deliver on the big promises. Herein, a “decision perspective” framework for the development of AI‐driven biomedical products from conception to market launch is presented. The framework highlights the risks, objectives, and key results which are typically required to navigate a three‐phase process to market‐launch of a validated medical AI product. Clinical validation, regulatory affairs, data strategy, and algorithmic development are addressed. The development process proposed for AI in healthcare software strongly diverges from modern consumer software development processes. Key time points to guide founders, investors, and key stakeholders throughout the process are highlighted. This framework should be seen as a template for innovation frameworks, which can be used to coordinate team communications and responsibilities toward a viable product development roadmap, thus unlocking the potential of AI in medicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The framework for AI health care product development highlighted that RCTs are often recommended to provide strong evidence to validate the clinical efficacy and safety of an AI-assisted tool in real-world settings [61].”
From Randomized Controlled Trials of Artificial Intelligence in Clinical Practice: Systematic Review (2022) · cites this paper as [61]
The cited source says what the claim attributes to it.
In the citing paper
“A major goal of AI in healthcare product development is to approximate this ideal state via thorough clinical validation and development on heterogeneous data sources [1].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [1]
In the citing paper
“Medical AI systems and especially CDSSs, whether AI-powered or not, have to undergo a rigorous validation process to meet regulatory standards and achieve medical certification [1].”
From Explainability for artificial intelligence in healthcare: a multidisciplinary perspective (2020) · cites this paper as [1]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,445
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“And indeed, commercial products in healthcare have already been shown to contain considerable racial bias [55].”
BackgroundGaussian Processes in Machine Learning
Rasmussen, C. E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_4 · Cited by 5,397
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · cited 1×
“determined in the training process and also determine the predictive capability of the model [4].”
BackgroundSarasvathy, S. D. (2001) · Academy of Management Review · doi:10.5465/amr.2001.4378020 · Cited by 4,275
Artificial intelligence in radiology
Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L. H., & Aerts, H. J. W. L. (2018) · Nature Reviews Cancer · doi:10.1038/s41568-018-0016-5 · Cited by 3,803
The potential for artificial intelligence in healthcare
Davenport, T., & Kalakota, R. (2019) · Future Healthcare Journal · doi:10.7861/futurehosp.6-2-94 · Cited by 3,800
Graph Convolutional Neural Networks for Web-Scale Recommender Systems
Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W. L., & Leskovec, J. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219890 · Cited by 3,733
(2011) · Cited by 3,330
Rendle, S. (2010) · 2010 IEEE International Conference on Data Mining · doi:10.1109/icdm.2010.127 · Cited by 3,189
Sarasvathy, S. D. (2001) · The Academy of Management Review · doi:10.2307/259121 · Cited by 2,543
Basch, E., Deal, A. M., Dueck, A. C., Scher, H. I., Kris, M. G., Hudis, C., & Schrag, D. (2017) · JAMA · doi:10.1001/jama.2017.7156 · Cited by 2,302
Leshno, M., Lin, V. Y., Pinkus, A., & Schocken, S. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80131-5 · Cited by 2,121
Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719 · cited 1×
“In that case, the model might learn to identify that hardware-tag instead of the pathology [38].”
BackgroundProduct Development Decisions: A Review of the Literature
Krishnan, V., & Ulrich, K. T. (2001) · Management Science · doi:10.1287/mnsc.47.1.1.10668 · Cited by 1,701
Global, regional, and country-specific lifetime risks of stroke, 1990 and 2016
Collaborators, T. G. 2. L. R. O. S. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1804492 · Cited by 1,503
GAUSSIAN PROCESSES FOR MACHINE LEARNING
SEEGER, M. (2004) · International Journal of Neural Systems · doi:10.1142/s0129065704001899 · Cited by 1,488
Clinical decision support in the era of artificial intelligence
Shortliffe, E. H., & Sepúlveda, M. J. (2018) · JAMA · doi:10.1001/jama.2018.17163 · Cited by 920 · cited 1×
“is also the phase where the necessity of explainable AI (xAI) deserves to be considered. Applications, such as clinical decision support, might require explanations as the users (doctors) demand them [36] or are required to use them[37]. A more comprehensive product vision might even leverage xAI to provide different…”
BackgroundArtificial intelligence in medical practice: the question to the answer?
Miller, D. D., & Brown, E. W. (2018) · The American Journal of Medicine · doi:10.1016/j.amjmed.2017.10.035 · Cited by 774 · cited 1×
“AI is a great fit for precision medicine due to its inherent ability to utilize high-dimensional data to identify subpopulations and make individualized predictions [53].”
BackgroundDecision trees: An overview and their use in medicine
Podgorelec, V., Kokol, P., Stiglic, B., & Rozman, I. (2002) · Journal of Medical Systems · doi:10.1023/a:1016409317640 · Cited by 736
Mammone, A., Turchi, M., & Cristianini, N. (2009) · WIREs Computational Statistics · doi:10.1002/wics.49 · Cited by 699
Artificial intelligence-enabled healthcare delivery
Reddy, S., Fox, J., & Purohit, M. P. (2019) · Journal of the Royal Society of Medicine · doi:10.1177/0141076818815510 · Cited by 635
Englich, B., Mussweiler, T., & Strack, F. (2006) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205282152 · Cited by 554
A design thinking framework for healthcare management and innovation
Roberts, J. P., Fisher, T. R., Trowbridge, M. J., & Bent, C. (2016) · Healthcare · doi:10.1016/j.hjdsi.2015.12.002 · Cited by 518
Gao, X., Ritter, J. R., & Zhu, Z. (2013) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109014000015 · Cited by 506
Kim, D. W., Jang, H. Y., Kim, K. W., Shin, Y., & Park, S. H. (2019) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0025 · Cited by 459 · cited 1×
“However, the overwhelming majority of reported positive studies to date are retrospective in nature and the presented solutions, more often than not, provide mere proofs-of-concept as evidenced by systematic reviews [28,29].”
BackgroundKosorok, M. R., & Laber, E. B. (2019) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-030718-105251 · Cited by 370
Beyond validation: getting health apps into clinical practice
Gordon, W. J., Landman, A., Zhang, H., & Bates, D. W. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0212-z · Cited by 326
When and how can real world data analyses substitute for randomized controlled trials?
Franklin, J. M., & Schneeweiss, S. (2017) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.857 · Cited by 316 · cited 1×
“bias, lack of controls, confounding and others [54].”
BackgroundPredictive analytics with gradient boosting in clinical medicine
written on behalf of AME Big-Data Clinical Trial Collaborative Group, Zhang, Z., Zhao, Y., Canes, A., Steinberg, D., & Lyashevska, O. (2019) · Annals of Translational Medicine · doi:10.21037/atm.2019.03.29 · Cited by 312
The impact of machine learning on patient care: A systematic review
Ben-Israel, D., Jacobs, W. B., Casha, S., Lang, S., Ryu, W. H. A., de Lotbiniere-Bassett, M., & Cadotte, D. W. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101785 · Cited by 207
Explainable AI under contract and tort law: legal incentives and technical challenges
Hacker, P., Krestel, R., Grundmann, S., & Naumann, F. (2020) · Artificial Intelligence and Law · doi:10.1007/s10506-020-09260-6 · Cited by 186
The Potential for Artificial Intelligence in Healthcare
Puaschunder, J. M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3525037 · Cited by 177
Anchoring and cognitive ability
Bergman, O., Ellingsen, T., Johannesson, M., & Svensson, C. (2010) · Economics Letters · doi:10.1016/j.econlet.2009.12.028 · Cited by 173
Zero to One Notes on Start-Ups, or How to Build the Future
Thiel, P. A., & Masters, B. G. (2001) · Cited by 148
Allen, B., Seltzer, S. E., Langlotz, C. P., Dreyer, K. P., Summers, R. M., Petrick, N., Marinac-Dabic, D., Cruz, M., Alkasab, T. K., Hanisch, R. J., et al. (2019) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2019.04.014 · Cited by 128
Wilson, M. D. (2008) · Elsevier eBooks · doi:10.1016/b978-008045405-4.00168-3 · Cited by 126
Artificial intelligence in radiology
Filipović-Grčić, L., & Đerke, F. (2019) · Rad Hrvatske akademije znanosti i umjetnosti Medicinske znanosti · doi:10.21857/y26kec3o79 · Cited by 118
Healthcare uses of artificial intelligence: Challenges and opportunities for growth
Racine, E., Boehlen, W., & Sample, M. (2019) · Healthcare Management Forum · doi:10.1177/0840470419843831 · Cited by 102 · cited 1×
“[19,20,25–27].”
Where Have All the IPOs Gone?Preprint
Ritter, J. R., Bakshi, X. G., & Zhu, Z. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.1954788 · Cited by 97
Advancing a Framework for Regulatory Use of Real-World Evidence: When Real Is Reliable
Dreyer, N. A. (2018) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479018763591 · Cited by 95
The fourth industrial revolution - Industry 4.0 and IoT [Trends in Future I&M]
Griffiths, F., & Ooi, M. (2018) · IEEE Instrumentation & Measurement Magazine · doi:10.1109/mim.2018.8573590 · Cited by 85
The upsurge of deep learning for computer vision applications
Patel, P., & Thakkar, A. R. (2019) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i1.pp538-548 · Cited by 84
Fast and accurate medication identification
Delgado, N. L., Usuyama, N., Hall, A. K., Hazen, R. J., Ma, M., Sahu, S., & Lundin, J. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0086-0 · Cited by 71
Schrag, D., Kris, M. G., Deal, A. M., et al. (2022) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/ceaq-hc11 · Cited by 69
Zero to One: Notes on Startups, or How to Build the Future
Radziwill, N. (2016) · Quality Management Journal · doi:10.1080/10686967.2016.11918474 · Cited by 61
Designing a Model of a Digital Ecosystem for Healthcare and Wellness Using the Business Model Canvas
Cosío-León, M. D. L. Á., Hipólito, J. I. N., Garibaldi-Beltrán, J., Parra, G. A., Luque, P. A., Magaña-Espinoza, P., & Aguilar-Velazco, J. C. (2016) · Journal of Medical Systems · doi:10.1007/s10916-016-0488-3 · Cited by 53
Review of Machine Learning and Deep Learning Based Recommender Systems for Health Informatics
Saha, J., Chowdhury, C., & Biswas, S. (2019) · Studies in big data · doi:10.1007/978-3-030-33966-1_6 · Cited by 39
Don’t abandon RCTs in IVF. We don’t even understand them
Wilkinson, J., Brison, D. R., Duffy, J. M., Farquhar, C. M., Lensen, S. F., Mastenbroek, S., van Wely, M., & Vail, A. (2019) · Human Reproduction · doi:10.1093/humrep/dez199 · Cited by 35
BURRIDGE, J., McCullagh, P., & Nelder, J. A. (1991) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2983054 · Cited by 35
Manjunath, K. N., Jagadeesh, J., & Yogeesh, M. (2013) · International Mutli-Conference on Automation, Computing, Communication, Control and Compressed Sensing · doi:10.1109/imac4s.2013.6526379 · Cited by 24
Panesar, A. (2019) · Apress eBooks · doi:10.1007/978-1-4842-3799-1_7 · Cited by 11
The Hospital of the Future: Evidence-Based, Data-Driven
Savino, J. A., & Latifi, R. (2019) · Springer eBooks · doi:10.1007/978-3-030-01394-3_35 · Cited by 7
Research works printed but not linked: 8
- Patel P., 2020, Int. J. Electr. Comput. Eng., 10, 538
- M. E.Peters M.Neumann M.Iyyer M.Gardner C.Clark K.Lee L.Zettlemoyer Proc. of the 2018 Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long Papers) Association for Computational Linguistics New Orleans LA2018 pp.2227–2237.
- S.Rendle F.Machines inProc. IEEE Int. Conf. on Data Minning IEEE Sydney2010.
- R.Ying R.He K.Chen P.Eksombatchai W. L.Hamilton J.Leskovec inProc. 24th ACM SIGKDD Int. Conf. on Knowledge Discovery and Data Mining Association for Computing Machinery New York NY2018.
- Livne M., 2019, XPOMET©: 360° Next Generation Healthcare
- Englich B., 2016, Pers. Soc. Psychol. Bull., 2, 188
- Hacker P., 2020, Artif. Intell. Law
- Schneider S., 2001, The B-Method
Cited by
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
Self-citationVasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01772-9 · Cited by 1,039
Self-citationVasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070904 · Cited by 665
Borys, K., Schmitt, Y. A., Nauta, M., Seifert, C., Krämer, N., Friedrich, C. M., & Nensa, F. (2023) · European Journal of Radiology · doi:10.1016/j.ejrad.2023.110786 · Cited by 233
A Review on Explainable Artificial Intelligence for Healthcare: Why, How, and When?
Bharati, S., Mondal, M. R. H., & Podder, P. (2024) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2023.3266418 · Cited by 203
Metadata
- Authors
- Higgins, D., & Madai, V. I.
- Affiliations
- Berlin Institute of Health at Charité - Universitätsmedizin Berlin (DE)
- Charité – Universitätsmedizin Berlin (DE)
- Corresponding author
- Higgins, David
- Venue
- Advanced Intelligent Systems
- Publisher
- Wiley
- Published
- 2020-07-02
- Volume
- 2
- Issue
- 10
- ISSN
- 2640-4567 (ISSN-L)
- OpenAlex
- W3012810655
- Cited by
- 118
- References
- 58
- Citations by year
- 2026: 19 · 2025: 25 · 2024: 20 · 2023: 23 · 2022: 17 · 2021: 9 · 2020: 5
- FWCI
- 3.97
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Advanced Intelligent Systems (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- artificial intelligence in healthcare, clinical validation, regulatory affairs, data strategy, algorithm development, innovation framework, clinical translation, medical software development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.