Artificial intelligence-based clinical decision support in modern medical physics: Selection, acceptance, commissioning, and quality assurance
Open accessAbstract
BACKGROUND: Recent advances in machine and deep learning based on an increased availability of clinical data have fueled renewed interest in computerized clinical decision support systems (CDSSs). CDSSs have shown great potential to improve healthcare, increase patient safety and reduce costs. However, the use of CDSSs is not without pitfalls, as an inadequate or faulty CDSS can potentially deteriorate the quality of healthcare and put patients at risk. In addition, the adoption of a CDSS might fail because its intended users ignore the output of the CDSS due to lack of trust, relevancy or actionability. AIM: In this article, we provide guidance based on literature for the different aspects involved in the adoption of a CDSS with a special focus on machine and deep learning based systems: selection, acceptance testing, commissioning, implementation and quality assurance. RESULTS: A rigorous selection process will help identify the CDSS that best fits the preferences and requirements of the local site. Acceptance testing will make sure that the selected CDSS fulfills the defined specifications and satisfies the safety requirements. The commissioning process will prepare the CDSS for safe clinical use at the local site. An effective implementation phase should result in an orderly roll out of the CDSS to the well-trained end-users whose expectations have been managed. And finally, quality assurance will make sure that the performance of the CDSS is maintained and that any issues are promptly identified and solved. CONCLUSION: We conclude that a systematic approach to the adoption of a CDSS will help avoid pitfalls, improve patient safety and increase the chances of success.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Explainability of the support system can improve the acceptability of CDSS by clinicians, increase the chances of the complex AI systems' adoption and clinical feasibility of a novel CDSS.
“Therefore, explainability of the support system can improve the acceptability of CDSS by clinicians [48] increase the chances of the complex AI systems' adoption and clinical feasibility of a novel CDSS [105,121].”
From Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review (2021) · cites this paper as [105]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · see citing works
A guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312 · see citing works
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · BMJ · doi:10.1136/bmj.g7594 · Cited by 4,388 · see citing works
Collins, P. G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Cancer · doi:10.1038/bjc.2014.639 · Cited by 3,312 · see citing works
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936 · see citing works
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931 · see citing works
Artificial intelligence in healthcare
Yu, K.-H., Beam, A. L., & Kohane, I. S. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0305-z · Cited by 2,817 · see citing works
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703 · see citing works
Hunt, D. L., Haynes, R. B., Hanna, S., & Smith, K. (1998) · JAMA · doi:10.1001/jama.280.15.1339 · Cited by 1,684 · see citing works
Effect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200 · see citing works
Computer-aided Diagnosis of Acute Abdominal Pain
de Dombal, F. T., Leaper, D. J., Staniland, J. R., McCann, A. P., & Horrocks, J. C. (1972) · BMJ · doi:10.1136/bmj.2.5804.9 · Cited by 675 · see citing works
Grand challenges in clinical decision support
Sittig, D. F., Wright, A., Osheroff, J. A., Middleton, B., Teich, J. M., Ash, J. S., Campbell, E., & Bates, D. W. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2007.09.003 · Cited by 582 · see citing works
Clinical Decision-Support Systems
Musen, M. A., Blackford Middleton, A., & Greenes, R. A. (2013) · Springer eBooks · doi:10.1007/978-1-4471-4474-8_22 · Cited by 577 · see citing works
Roshanov, P. S., Fernandes, N., Wilczynski, J. M., Hemens, B. J., You, J. J., Handler, S. M., Nieuwlaat, R., Souza, N. M., Beyene, J., Spall, H. G. C. V., et al. (2013) · BMJ · doi:10.1136/bmj.f657 · Cited by 458 · see citing works
Predicting outcomes in radiation oncology—multifactorial decision support systems
Lambin, P., van Stiphout, R. G. P. M., Starmans, M. H. W., Velazquez, E. R., Nalbantov, G. I., Aerts, H. J. W. L., Roelofs, E., van Elmpt, W., Boutros, P. C., Granone, P. M., et al. (2012) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2012.196 · Cited by 396 · see citing works
Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer
Lustberg, T., van Soest, J., Gooding, M. J., Peressutti, D., Aljabar, P., van der Stoep, J., van Elmpt, W., & Dekker, A. L. A. J. (2017) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2017.11.012 · Cited by 368 · see citing works
Eccles, M. (2002) · BMJ · doi:10.1136/bmj.325.7370.941 · Cited by 354 · cited 1× · see citing works
“Some forms of CDSSs have been in use for decades, but their use is not yet widespread due to a number of issues related to design and implementation, such as clinicians not using them due to lack of time or lack of confidence in the CDSS’s output.(29,30)”
BackgroundLiberati, E. G., Ruggiero, F., Galuppo, L., Gorli, M., González-Lorenzo, M., Maraldi, M., Ruggieri, P., Polo Friz, H., Scaratti, G., Kwag, K. H., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0644-2 · Cited by 301 · see citing works
Some unintended consequences of clinical decision support systems.
Ash, J. S., Sittig, D. F., Campbell, E. M., Guappone, K. P., & Dykstra, R. H. (2007) · PubMed Central · Cited by 298 · see citing works
Improving Outcomes with Clinical Decision Support : An Implementer's Guide
Osheroff, J. A., Teich, J. M., Levick, D., Saldana, L., Velasco, F. T., Sittig, D. F., Rogers, K. M., & Jenders, R. A. (2012) · Cited by 297 · see citing works
Clinical Decision Support Systems
Helmons, P. J. (2009) · CRC Press eBooks · doi:10.1201/9781420071764-c15 · Cited by 295 · see citing works
Clinical Decision Support Systems
Berner, E. S. (2007) · Computers in health care · doi:10.1007/978-0-387-38319-4 · Cited by 276 · see citing works
Exploring Barriers and Facilitators to the Use of Computerized Clinical Reminders
Saleem, J. J., Patterson, E. S., Militello, L. G., Render, M. L., Orshansky, G., & Asch, S. M. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1777 · Cited by 250 · see citing works
Roshanov, P. S., Misra, S., Gerstein, H. C., Garg, A. X., Sebaldt, R. J., Mackay, J. A., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., et al. (2011) · Implementation Science · doi:10.1186/1748-5908-6-92 · Cited by 236 · see citing works
Informing sequential clinical decision-making through reinforcement learning: an empirical study
Shortreed, S. M., Laber, E. B., Lizotte, D. J., Stroup, T. S., Pineau, J., & Murphy, S. A. (2010) · Machine Learning · doi:10.1007/s10994-010-5229-0 · Cited by 196 · see citing works
Souza, N. M., Sebaldt, R. J., Mackay, J. A., Prorok, J. C., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-87 · Cited by 178 · see citing works
HELP: A Dynamic Hospital Information System
Kuperman, G. J., Gardner, R. M., & Pryor, T. A. (1991) · Computers and medicine · doi:10.1007/978-1-4612-3070-0 · Cited by 168 · see citing works
Guide to Health Informatics, 2Ed
Coiera, E. W. (2003) · CRC Press eBooks · doi:10.1201/b13618 · Cited by 168 · see citing works
Data driven: profiting from your most important business asset
Redman, T. C. (2009) · Choice Reviews Online · doi:10.5860/choice.46-3345 · Cited by 152 · see citing works
A four-phase model of the evolution of clinical decision support architectures
Wright, A. T., & Sittig, D. F. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.01.004 · Cited by 148 · see citing works
Wright, A. T., Sittig, D. F., Ash, J. S., Feblowitz, J. C., Meltzer, S. N., McMullen, C. K., Guappone, K. P., Carpenter, J., Richardson, J. E., Simonaitis, L., et al. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000113 · Cited by 147 · see citing works
A framework for evaluating the appropriateness of clinical decision support alerts and responses
McCoy, A. B., Waitman, L. R., Lewis, J. B., Wright, J. A., Choma, D. P., Miller, R. A., & Peterson, J. F. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000185 · Cited by 138 · see citing works
Hemens, B. J., Holbrook, A. M., Tonkin, M., Mackay, J. A., Weise-Kelly, L., Navarro, T., Wilczynski, N. L., Haynes, R. B., & the CCDSS Systematic Review Team (2011) · Implementation Science · doi:10.1186/1748-5908-6-89 · Cited by 132 · see citing works
Sirajuddin, A. M., Osheroff, J. A., Sittig, D. F., Chuo, J., Velasco, F. T., & Collins, D. A. (2009) · PubMed · Cited by 131 · see citing works
Valdés, G., Simone, C. B., Chen, J., Lin, A., Yom, S. S., Pattison, A. J., Carpenter, C. M., & Solberg, T. D. (2017) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2017.10.014 · Cited by 111 · see citing works
Nieuwlaat, R., Connolly, S., Mackay, J., Weise-Kelly, L., Navarro, T., Wilczynski, N., & Haynes, R. (2011) · Implementation science : IS · doi:10.1186/1748-5908-6-90 · Cited by 103 · see citing works
Ash, J. S., Sittig, D. F., Guappone, K. P., Dykstra, R. H., Richardson, J., Wright, A., Carpenter, J., McMullen, C., Shapiro, M., Bunce, A., et al. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-6 · Cited by 103 · see citing works
Computerised decision support systems for healthcare professionals: an interpretative review
Cresswell, K. M., Majeed, A., Bates, D. W., & Sheikh, A. (2013) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v20i2.32 · Cited by 101 · see citing works
The five "rights" of clinical decision support.
Campbell, R. J. (2013) · PubMed · Cited by 100 · see citing works
The arden syntax for medical logic modules
Pryor, T. A., & Hripcsak, G. M. (1993) · International journal of clinical monitoring and computing · doi:10.1007/bf01133012 · Cited by 89 · see citing works
Gooding, M. J., Smith, A. J., Tariq, M., Aljabar, P., Peressutti, D., van der Stoep, J., Reymen, B., Emans, D., Hattu, D., van Loon, J., et al. (2018) · Medical Physics · doi:10.1002/mp.13200 · Cited by 89 · see citing works
Self-citationClinical decision support alert malfunctions: analysis and empirically derived taxonomy
Wright, A. T., Ai, A., Ash, J. S., Wiesen, J. F., Hickman, T.-T. T., Aaron, S., McEvoy, D. S., Borkowsky, S., Dissanayake, P. I., Embí, P. J., et al. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx106 · Cited by 79 · see citing works
Jacob, V., Thota, A. B., Chattopadhyay, S. K., Njie, G. J., Proia, K. K., Hopkins, D. P., Ross, M. N., Pronk, N. P., & Clymer, J. M. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw160 · Cited by 66 · see citing works
The Five Rights of Clinical Decision Support: CDS Tools Helpful for Meeting Meaningful Use
Campbell, R. J. (2013) · Journal of AHIMA · Cited by 55 · see citing works
Detailed clinical models for sharable, executable guidelines.
Parker, C. G., Rocha, R. A., Campbell, J. R., Tu, S. W., & Huff, S. M. (2004) · PubMed · Cited by 53 · see citing works
Khorasani, R., Hentel, K., Darer, J. D., Langlotz, C. P., Ip, I. K., Manaker, S., Cardella, J. F., Min, R. J., & Seltzer, S. E. (2014) · American Journal of Roentgenology · doi:10.2214/ajr.14.13134 · Cited by 50 · see citing works
Kortesniemi, M., Tsapaki, V., Trianni, A., Russo, P., Maas, A. J. J., Källman, H., Brambilla, M., & Damilakis, J. E. (2018) · Physica Medica · doi:10.1016/j.ejmp.2018.11.005 · Cited by 47 · see citing works
Using statistical anomaly detection models to find clinical decision support malfunctions
Ray, S., McEvoy, D. S., Aaron, S., Hickman, T.-T., & Wright, A. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy041 · Cited by 44 · see citing works
Wagholikar, K. B., MacLaughlin, K. L., Kastner, T. M., Casey, P. M., Henry, M. R., Greenes, R. A., Liu, H., & Chaudhry, R. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001613 · Cited by 42 · see citing works
Evaluating Medical Expert Systems: What To Test, And How ?
Wyatt, J. C., & Spiegelhalter, D. J. (1991) · Lecture notes in medical informatics · doi:10.1007/978-3-662-08131-0_22 · Cited by 41 · see citing works
Clinical decision support systems: a discussion of quality, safety and legal liability issues.
Fox, J., & Thomson, R. (2002) · PubMed · Cited by 38 · see citing works
Provider Response to Computer-Based Care Suggestions for Chronic Heart Failure
Keeffe, B. G., Subramanian, U., Tierney, W. M., Udris, E. M., Willems, J., McDonell, M. B., & Fihn, S. D. (2005) · Medical Care · doi:10.1097/01.mlr.0000160378.53326.f3 · Cited by 37 · see citing works
Clinical decisions support malfunctions in a commercial electronic health record
Yackel, T. R., Gorman, P., Dorr, D. A., & Kassakian, S. Z. (2017) · Applied Clinical Informatics · doi:10.4338/aci-2017-01-ra-0006 · Cited by 37 · see citing works
Schuh, C. J., de Bruin, J. S., & Seeling, W. (2015) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2015.11.002 · Cited by 36 · see citing works
Advances in Clinical Decision Support: Highlights of Practice and the Literature 2015-2016
Jenders, R. A. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-012 · Cited by 35 · see citing works
Connolly, F., Byrne, D., Lydon, S., Walsh, C., & O'Connor, P. E. (2017) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzx148 · Cited by 33 · see citing works
Nakatsugawa, M., Cheng, Z., Kiess, A. P., Choflet, A., Bowers, M., Utsunomiya, K., Sugiyama, S., Wong, J. W., Quon, H., & McNutt, T. (2018) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2018.09.038 · Cited by 32 · see citing works
FMEA of manual and automated methods for commissioning a radiotherapy treatment planning system
Wexler, A., Gu, B., Goddu, S. M., Mutic, M., Yaddanapudi, S., Olsen, L. A., Harry, T., Noel, C. E., Pawlicki, T. A., Mutic, S., et al. (2017) · Medical Physics · doi:10.1002/mp.12278 · Cited by 27 · see citing works
Shortliffe, E. H. (1976) · Elsevier eBooks · doi:10.1016/b978-0-444-00179-5.50007-x · Cited by 8 · see citing works
Test Case Selection in Pre-Deployment Testing of Complex Clinical Decision Support Systems.
Tso, G. J., Yuen, K., Martins, S. B., Tu, S. W., Ashcraft, M., Heidenreich, P. A., Hoffman, B. B., & Goldstein, M. K. (2016) · PubMed Central · Cited by 6 · see citing works
Liu, S., Wright, A. T., Sittig, D. F., & Hauskrecht, M. (2017) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2017.8217712 · Cited by 5 · see citing works
Acceptance testing of medical electrical equipment
Whelpton, D. (1984) · Journal of Medical Engineering & Technology · doi:10.3109/03091908409032068 · Cited by 3 · see citing works
Flagged first, then by citations
1 of the 63 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- [4]Shortliffe E. Computer‐Based Medical Consultations: MYCIN ‐ 1st Edition; 1976 [cited 2018 Dec 4]. Available from https://www.elsevier.com/books/computer-based-medical-consultations-mycin/shortliffe/978-0-444-00179-5
- [34]National Academy of Medicine. Optimizing Strategies for Clinical Decision Support; 2017 [cited 2019 Jan 9]. Available from https://nam.edu/optimizing-strategies-clinical-decision-support/ 37733888
Cited by
Sorted by citations
Antoniadi, A. M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B. A., & Mooney, C. (2021) · Applied Sciences · doi:10.3390/app11115088 · Cited by 629 · see citing works
Man Tang, P., Koopman, J., McClean, S. T., Zhang, J. H., Li, C. H., De Cremer, D., Lu, Y., & Ng, C. T. S. (2022) · Academy of Management Journal · doi:10.5465/amj.2020.1516 · Cited by 370 · see citing works
Artificial Intelligence in Medical Sensors for Clinical Decisions
Haick, H., & Tang, N. (2021) · ACS Nano · doi:10.1021/acsnano.1c00085 · Cited by 231 · see citing works
Kresevic, S., Giuffrè, M., Ajcevic, M., Accardo, A., Crocè, L. S., & Shung, D. L. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01091-y · Cited by 207 · see citing works
Artificial intelligence in the embryology laboratory: a review
Dimitriadis, I., Zaninović, N., Chávez-Badiola, A., & Bormann, C. L. (2021) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2021.11.003 · Cited by 149 · see citing works
Beckers, R., Kwade, Z., & Zanca, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.02.011 · Cited by 141 · see citing works
Acceptance of artificial intelligence: key factors, challenges, and implementation strategies
Rane, N., Choudhary, S. P., & Rane, J. (2024) · Journal of Applied Artificial Intelligence · doi:10.48185/jaai.v5i2.1017 · Cited by 152 · see citing works
Jacob, C., Brasier, N., Laurenzi, E., Heuss, S., Mougiakakou, S. G., Çöltekin, A., & Peter, M. K. (2024) · Journal of Medical Internet Research · doi:10.2196/67485 · Cited by 113 · see citing works
From clinical decision support to clinical reasoning support systems
van Baalen, S., Boon, M., & Verhoef, P. (2021) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13541 · Cited by 84 · see citing works
AI and machine learning ethics, law, diversity, and global impact
Drabiak, K., Kyzer, S., Nemov, V., & El Naqa, I. (2023) · The British Journal of Radiology · doi:10.1259/bjr.20220934 · Cited by 84 · see citing works
Olier, I., Ortega‐Martorell, S., Pieroni, M., & Lip, G. Y. H. (2021) · Cardiovascular Research · doi:10.1093/cvr/cvab169 · Cited by 81 · see citing works
Artificial Intelligence and the Medical Physicist: Welcome to the Machine
Avanzo, M., Trianni, A., Botta, F., Talamonti, C., Stasi, M., & Iori, M. (2021) · Applied Sciences · doi:10.3390/app11041691 · Cited by 78 · see citing works
Monitoring performance of clinical artificial intelligence in health care: a scoping review
Andersen, E. S., Birk-Korch, J. B., Hansen, R. S., Fly, L. H., Röttger, R., Arcani, D. M. C., Brasen, C. L., Brandslund, I., & Madsen, J. S. (2024) · JBI Evidence Synthesis · doi:10.11124/jbies-24-00042 · Cited by 73 · see citing works
Avanzo, M., Stancanello, J., Pirrone, G., Drigo, A., & Retico, A. (2024) · Cancers · doi:10.3390/cancers16213702 · Cited by 80 · see citing works
Regulatory Aspects of the Use of Artificial Intelligence Medical Software
Zanca, F., Brusasco, C., Pesapane, F., Kwade, Z., Beckers, R., & Avanzo, M. (2022) · Seminars in Radiation Oncology · doi:10.1016/j.semradonc.2022.06.012 · Cited by 59 · see citing works
Bajgain, B. B., Lorenzetti, D., Lee, J., & Sauro, K. M. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-068373 · Cited by 62 · see citing works
Niemiec, E. (2022) · Digital Health · doi:10.1177/20552076221089079 · Cited by 58 · see citing works
The use of AI in mental health services to support decision-making: scoping review
Auf, H., Svedberg, P., Nygren, J., Nair, M., & Lundgren, L. E. (2025) · Journal of Medical Internet Research · doi:10.2196/63548 · Cited by 56 · see citing works
Machine Learning and Artificial Intelligence in Neurosurgery: Status, Prospects, and Challenges
Dagi, T. F., Barker, F. G., & Glass, J. L. (2021) · Neurosurgery · doi:10.1093/neuros/nyab170 · Cited by 53 · see citing works
New frontiers in embryo selection
Glatstein, I. Z., Chávez-Badiola, A., & Curchoe, C. L. (2023) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-022-02708-5 · Cited by 49 · see citing works
Kazmierski, M., Welch, M. L., Kim, S., McIntosh, C., Rey‐McIntyre, K., Huang, S. H., Patel, T., Tadic, T., Milosevic, M., Liu, F., et al. (2023) · Cancer Research Communications · doi:10.1158/2767-9764.crc-22-0152 · Cited by 47 · see citing works
Evaluating predictive models in reproductive medicine
Curchoe, C. L., Farias, A. F.-S., Mendizabal‐Ruiz, G., & Chávez-Badiola, A. (2020) · Fertility and Sterility · doi:10.1016/j.fertnstert.2020.09.159 · Cited by 47 · see citing works
Artificial intelligence in the medical physics community: An international survey
Díaz, O., Guidi, G., Ivashchenko, O., Colgan, N. C., & Zanca, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2020.11.037 · Cited by 47 · see citing works
Giebel, G. D., Raszke, P., Nowak, H., Palmowski, L., Adamzik, M., Heinz, P., Tokic, M. C., Timmesfeld, N., Brunkhorst, F., Wasem, J., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/63377 · Cited by 47 · see citing works
Enhancing trust in clinical decision support systems: a framework for developers
Jones, C. H. D., Thornton, J., & Wyatt, J. C. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2020-100247 · Cited by 46 · see citing works
Perumal, M. K. K., Renuka, R. R., Kumar, S. S., & Natarajan, P. M. (2025) · Frontiers in Oral Health · doi:10.3389/froh.2025.1592428 · Cited by 46 · see citing works
Exploration of Interpretability Techniques for Deep COVID-19 Classification Using Chest X-ray Images
Chatterjee, S., Saad, F., Sarasaen, C., Ghosh, S., Krug, V., Khatun, R., Mishra, R., Desai, N., Radeva, P. I., Rose, G., et al. (2024) · Journal of Imaging · doi:10.3390/jimaging10020045 · Cited by 40 · see citing works
The diagnostic, therapeutic, and ethical impact of artificial intelligence in modern medicine
Katwaroo, A. R., Adesh, V. S., Lowtan, A., & Umakanthan, S. (2023) · Postgraduate Medical Journal · doi:10.1093/postmj/qgad135 · Cited by 40 · see citing works
Ankolekar, A., van der Heijden, B., Dekker, A. L. A. J., Roumen, C., Ruysscher, D. D., Reymen, B. J. T., Berlanga, A., Oberije, C., & Fijten, R. (2022) · Health Expectations · doi:10.1111/hex.13457 · Cited by 37 · see citing works
Vijayakumar, S., Lee, V. V., Leong, Q. Y., Hong, S. J., Blasiak, A., & Ho, D. (2023) · JMIR Human Factors · doi:10.2196/48476 · Cited by 34 · see citing works
Antoun, I., Abdelrazik, A., Eldesouky, M., Li, X., Layton, G. R., Zakkar, M., Somani, R., & Ng, G. A. (2025) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2025.1596574 · Cited by 33 · see citing works
Building Resilient Health Systems: Patient Safety during COVID-19 and Lessons for the Future
Narwal, S., & Jain, S. (2021) · Journal of Health Management · doi:10.1177/0972063421994935 · Cited by 32 · see citing works
Chitoran, E., Rotaru, V., Gelal, A., Ionescu, S. O., Gullo, G., Stefan, D. C., & Simion, L. (2025) · Diagnostics · doi:10.3390/diagnostics15182391 · Cited by 30 · see citing works
Bosmans, H., Zanca, F., & Gelaude, F. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.006 · Cited by 29 · see citing works
The Holistic Perspective of the INCISIVE Project—Artificial Intelligence in Screening Mammography
Lazić, I., López, F., Aussó, S., Alves, B., Barelle, C., Berral, J. L., Bizopoulos, P. A., Bunduc, O., Chouvarda, I., Domínguez-Herrera, D., et al. (2022) · Applied Sciences · doi:10.3390/app12178755 · Cited by 26 · see citing works
Quality-in-use characteristics for clinical decision support system assessment
Souza-Pereira, L., Ouhbi, S., & Pombo, N. G. C. C. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106169 · Cited by 25 · see citing works
Mapping the Landscape of Care Providers’ Quality Assurance Approaches for AI in Diagnostic Imaging
Lundström, C. F., & Lindvall, M. (2022) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-022-00731-7 · Cited by 26 · see citing works
The role of machine and deep learning in modern medical physics
Naqa, I. E., & Das, S. K. (2020) · Medical Physics · doi:10.1002/mp.14088 · Cited by 24 · see citing works
The Application of Preventive Medicine in the Future Digital Health Era
la Torre, K. D., Min, S., Lee, H., & Kang, D. (2024) · Journal of Medical Internet Research · doi:10.2196/59165 · Cited by 23 · see citing works
Leveraging law and ethics to promote safe and reliable AI/ML in healthcare
Drabiak, K. (2022) · Frontiers in Nuclear Medicine · doi:10.3389/fnume.2022.983340 · Cited by 22 · see citing works
Blanes-Selva, V., Cuesta, S. A., Doñate-Martínez, A., Mesquita, F. P., & Garcia-Gomez, J. M. (2023) · Digital Health · doi:10.1177/20552076221150735 · Cited by 22 · see citing works
Chun, J., & Kim, H. (2023) · Journal of Korean Medical Science · doi:10.3346/jkms.2023.38.e253 · Cited by 21 · see citing works
Machine learning in medicine: It has arrived, let's embrace it
Pappada, S. M. (2021) · Journal of Cardiac Surgery · doi:10.1111/jocs.15918 · Cited by 19 · see citing works
Retico, A., Avanzo, M., Boccali, T., Bonacorsi, D., Botta, F., Cuttone, G., Martelli, B., Salomoni, D., Spiga, D., Trianni, A., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.10.005 · Cited by 19 · see citing works
Jiao, S., Wang, M. L., Chen, L. X., & Liu, X. (2021) · Scientific Reports · doi:10.1038/s41598-021-82749-5 · Cited by 17 · see citing works
Yang, L., Li, Z., Ma, S., & Yang, X. (2021) · Alexandria Engineering Journal · doi:10.1016/j.aej.2021.07.007 · Cited by 17 · see citing works
Bias, fairness, and assurance in AI: overview and synthesis
Al-Khulaidy, A., & Kavak, H. (2023) · Elsevier eBooks · doi:10.1016/b978-0-32-391919-7.00016-0 · Cited by 14 · see citing works
The Reasons for Physicians and Pharmacists’ Acceptance of Clinical Support Systems in Saudi Arabia
Albahly, M. S., & Albahly, M. S. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043132 · Cited by 15 · see citing works
Review on enhancing clinical decision support system using machine learning
Masood, A., Naseem, U., Rashid, J., Kim, J., & Razzak, I. (2024) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12286 · Cited by 14 · see citing works
Emerging role of artificial intelligence in nuclear medicine
Jha, A. K., Mithun, S., Rangarajan, V., Wee, L., & Dekker, A. L. A. J. (2021) · Nuclear Medicine Communications · doi:10.1097/mnm.0000000000001381 · Cited by 13 · see citing works
Vendrame, A., Cappelletto, C., Chiovati, P., Vinante, L., Parvej, M., Caroli, A., Pirrone, G., Barresi, L., Drigo, A., & Avanzo, M. (2023) · Applied Sciences · doi:10.3390/app13084962 · Cited by 12 · see citing works
Shaping the future of cancer treatment: The commitment of medical physicists
Al‐Raeei, M. (2024) · AIP Advances · doi:10.1063/5.0219314 · Cited by 11 · see citing works
Blanes-Selva, V., Doñate-Martínez, A., Linklater, G. T., Ferrer, J. G., & Garcia-Gomez, J. M. (2021) · Sustainability · doi:10.3390/su13179844 · Cited by 10 · see citing works
Technology readiness assessment: Case of clinical decision support systems in healthcare
Laraichi, O., Daim, T. U., Alzahrani, S., Hogaboam, L., Bolatan, G. İ. S., & Moughari, M. M. (2024) · Technology in Society · doi:10.1016/j.techsoc.2024.102736 · Cited by 9 · see citing works
Steffny, L., Dahlem, N., Reichl, L., Gisa, K., Greff, T., & Werth, D. (2023) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia230090 · Cited by 8 · see citing works
AIMS5.0 AI Toolbox: Enabling Efficient Knowledge Sharing for Industrial AI
Hollósi, G., Ficzere, D., Frankó, A., Bancsics, M., Almahasneh, R., Lukovszki, C., & Varga, P. (2024) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms59830.2024.10575076 · Cited by 8 · see citing works
Narindrarangkura, P., Kim, M. S., & Boren, S. A. (2021) · ACI Open · doi:10.1055/s-0041-1735470 · Cited by 8 · see citing works
Rahman, J. S., Brankovic, A., Tracy, M. B., & Khanna, S. (2024) · Interactive Journal of Medical Research · doi:10.2196/46946 · Cited by 7 · see citing works
Hoebers, F. J. P., Wee, L., Likitlersuang, J., Mak, R. H., Bitterman, D. S., Huang, Y., Dekker, A. L. A. J., Aerts, H. J. W. L., & Kann, B. H. (2023) · BJR|Open · doi:10.1093/bjro/tzae039 · Cited by 9 · see citing works
Gao, Q., Zhen, K., Xia, L., Wang, W., Xu, Y., Si, C., Zhang, Z., Dong, F., Lei, J., Yang, P. B., et al. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11174997 · Cited by 7 · see citing works
Brioschi, G. C., Brioschi, M. L., Neto, C. D., & O'Young, B. J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44511-8_1 · Cited by 7 · see citing works
External Validation of a Bayesian Network for Error Detection in Radiotherapy Plans
Kalendralis, P., Eyssen, D., Canters, R. A. M., Luk, S. M. H., Kalet, A. M., van Elmpt, W., Fijten, R., Dekker, A. L. A. J., Zegers, C. M. L., & Bermejo, I. (2021) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2021.3070656 · Cited by 8 · see citing works
Dang, A., Dang, D., & Vallish, B. N. (2023) · Indian Journal of Medical Research · doi:10.4103/ijmr.ijmr_555_20 · Cited by 7 · see citing works
Yapay Zekanın Eğitime Yansımaları: Yönetici ve Öğretmenlerin Bakış Açıları
Uğurlu, C. T., & Usta, G. (2025) · Batı anadolu eğitim bilimleri dergisi · doi:10.51460/baebd.1578952 · Cited by 7 · see citing works
Curiello, S., Iannuzzi, E., Meissner, D., & Nigro, C. (2025) · European Journal of Innovation Management · doi:10.1108/ejim-01-2024-0078 · Cited by 7 · see citing works
The utilization of artificial intelligence in life science research and healthcare delivery
Shah, H., Jayabalan, B., & Mery, A. (2023) · Salud Ciencia y Tecnología · doi:10.56294/saludcyt2023450 · Cited by 6 · see citing works
Artificial intelligence in medical physics
Amoroso, N., Errico, R., Pantaleo, E., Monaco, A., & Bellotti, R. (2025) · Rivista Del Nuovo Cimento · doi:10.1007/s40766-025-00073-4 · Cited by 5 · see citing works
Machine Learning-Enabled Biosensors in Clinical Decision Making
Verma, S., Shukla, R. P., & Dutta, G. (2022) · Springer eBooks · doi:10.1007/978-981-19-7130-3_7 · Cited by 6 · see citing works
AI Toolbox Concept for the Arrowhead Framework
Ficzere, D., Hollósi, G., Frankó, A., & Varga, P. (2023) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm59352.2023.10327821 · Cited by 5 · see citing works
Su, Y. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023745 · Cited by 4 · see citing works
Lee, E., Lee, D., Baek, J. H., Kim, S. Y., & Park, W.-Y. (2024) · Scientific Reports · doi:10.1038/s41598-023-49490-7 · Cited by 4 · see citing works
Marques, J. A. L., Gois, F. N. B., Silveira, J., Li, T., & Fong, S. J. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-85751-2.00001-3 · Cited by 4 · see citing works
Anugerah, G. B., & Hidayanto, A. N. (2023) · International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA) · doi:10.1109/icicyta60173.2023.10428744 · Cited by 4 · see citing works
A mixed methods evaluation of an antimicrobial prescribing clinical decision support system app
Waldock, W. J., Gilchrist, M. J., Ashrafian, H., Darzi, A. W., & Franklin, B. D. (2025) · npj Antimicrobials and Resistance · doi:10.1038/s44259-025-00146-8 · Cited by 3 · see citing works
Chang, H., Yu, J. Y., Park, H., Song, Y. J., Heo, S., Park, J. E., Lee, G. T., Lee, S. U., Kim, T., Yoon, H. J., et al. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-025-03234-x · Cited by 3 · see citing works
Impacts of artificial intelligence on healthcare business models and outcomes
Kakale, M. M., & Pinelli, N. (2026) · Journal of Health Organization and Management · doi:10.1108/jhom-06-2025-0356 · Cited by 4 · see citing works
Clinical Reasoning and Artificial Intelligence
Ghasemi, A., & aali, M. N. (2023) · Annals of Military and Health Sciences Research · doi:10.5812/amh-134440 · Cited by 3 · see citing works
Clinical Application of Artificial Intelligence in Cancer Treatment: A Systematic Literature Review
Shahraki-Mohammadi, A., Aliabadi, A., & Karimi, A. (2025) · Health Scope · doi:10.5812/healthscope-158492 · Cited by 3 · see citing works
Unger, M. (2021) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/wain52551.2021.00022 · Cited by 3 · see citing works
Lu, C., Tan, T., Yu, L., MohammadiNasab, P., Zhang, T., Zhang, H., Soryani, M., Mann, R. M., Kozegar, E., & Bao, L. (2025) · Medical Physics · doi:10.1002/mp.70018 · Cited by 2 · see citing works
Salahi‐Niri, A., Safavi‐Naini, S. A. A., Devi, J., Naderi, N., Sebastian, S., Adamina, M., Nadkarni, G. N., Soroush, A., & El‐Hussuna, A. (2026) · Colorectal Disease · doi:10.1111/codi.70436 · Cited by 2 · see citing works
Ontology of knowledge representation about the prescribed personalized treatment
Kovalev, R., Gribova, V. V., & Okun, D. B. (2023) · Ontology of Designing · doi:10.18287/2223-9537-2023-13-2-192-203 · Cited by 2 · see citing works
Significance of repertory in homoeopathic curriculum
Munir, A. R. (2024) · Journal of Integrated Standardized Homoeopathy · doi:10.25259/jish_53_2024 · Cited by 2 · see citing works
Design for AI-Enhanced Operator Information Ergonomics in a Time-Critical Environment
Okkonen, J., Hakulinen, J., Jalava, M., Mansikka, H., Keskinen, T., & Turunen, M. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-80285-1_26 · Cited by 2 · see citing works
A systematic review of artificial intelligence-based methods in healthcare
Apio, A. L., Kissi, J., & Achampong, E. K. (2023) · International Journal of Public Health Science (IJPHS) · doi:10.11591/ijphs.v12i3.22298 · Cited by 2 · see citing works
Aduamoah, M., Anomah, S., & Ayeboafo, B. (2022) · International Journal of Innovation and Technology Management · doi:10.1142/s0219877022400053 · Cited by 1 · see citing works
The Evolution of Artificial Intelligence in Healthcare
Santoshi, S., Bansal, H., Bondhopadhyay, B., & Maurya, P. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-6180-1.ch014 · Cited by 1 · see citing works
Artificial intelligence and healthcare: a critical review of the current state and future directions
Swain, K. P., Nayak, S. R., & Swain, S. K. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-26747-5.00008-2 · Cited by 1 · see citing works
Clinical Implementation of Artificial Intelligence Systems in Medical Imaging and Radiotherapy
Vienna International Centre, 100, P. B., Vienna, A.-1., Austria, 2600-0, T. +. (., & 2600-7, F. +. (. (2026) · IAEA human health series · doi:10.61092/iaea.9olq-aqa9 · Cited by 2 · see citing works
Volatile Biomarkers in Clinical Decision Support Systems
Haick, H. (2022) · Royal Society of Chemistry eBooks · doi:10.1039/9781839166990-00472 · Cited by 1 · see citing works
Role of artificial intelligence for the curative field: A review
Sabeer, S., Siddiqua, A., Anjum, A., Kondapalli, S., Kaur, C., & Begum, A. U. (2023) · AIP conference proceedings · doi:10.1063/5.0176664 · Cited by 1 · see citing works
The current status, challenges, and future prospects of medical physics in China
Pan, Y., Yang, B. S., Qiu, J., & Qiu, J. (2025) · Chinese Science Bulletin (Chinese Version) · doi:10.1360/tb-2024-1142 · Cited by 1 · see citing works
Lu, P., Chen, M., Chen, L., Lin, F. Y., Yang, H., Wang, Y., & Ding, X. (2025) · Journal of Alzheimer s Disease · doi:10.1177/13872877251343241 · Cited by 1 · see citing works
Artificial Intelligence in Biomedical Education
Fayaz, S., Jagota, V., & Kamaal, S. (2022) · Springer eBooks · doi:10.1007/978-3-030-96569-3_13 · Cited by 1 · see citing works
Machine learning & semantic web technologies for cancer care
Geetha, M. (2020) · doi:10.26481/dis.20200409gm · Cited by 1 · see citing works
Benjamin, M., Engelhard, G., Aisen, A. M., Aradi, Y., & Benjamin, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.13781 · Cited by 1 · see citing works
Jacob, C., Brasier, N., Laurenzi, E., Heuss, S., Mougiakakou, S. G., Çöltekin, A., & Peter, M. K. (2024) · doi:10.2196/preprints.67485 · Cited by 1 · see citing works
Shared decision-making in oncology
Ankolekar, A. (2021) · doi:10.26481/dis.20211125aa
Artificial intelligence applications in radiotherapy
Kalendralis, P. (2022) · doi:10.26481/dis.20221010pk · Cited by 1 · see citing works
- Authors
- Mahadevaiah, G., RV, P., Bermejo, I., Jaffray, D., Dekker, A., & Wee, L.
- Affiliations
- Philips Research India Bangalore 560045 India
- Department of Radiation Oncology (MAASTRO), GROW School for Oncology and Developmental Biology Maastricht University Medical Centre Maastricht 6229 ET Netherlands
- University Health Network (CA)
- Maastricht University Medical Centre (NL)
- Venue
- Medical Physics
- Publisher
- Wiley
- Published
- 2020-05
- Volume
- 47
- Issue
- 5
- Pages
- e228-e235
- ISSN
- 0094-2405 (ISSN-L)
- 2473-4209
- PMC
- PMC7318221
- OpenAlex
- W3024513077
- Cited by
- 114
- References
- 63
- Citations by year
- 2026: 8 · 2025: 17 · 2024: 20 · 2023: 26 · 2022: 14 · 2021: 25 · 2020: 4
- FWCI
- 1.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Medical Physics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (submittedVersion, cc-by)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- clinical decision support systems, artificial intelligence, deep learning, machine learning, acceptance testing, commissioning, implementation, quality assurance, patient safety, trust in AI
- MeSH terms
- Artificial Intelligence, Humans, Physics, Quality Assurance, Health Care, Decision Support Systems, Clinical
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review