Machine learning in medicine: Addressing ethical challenges
Open accessThe DOI matches its Crossref record; 10 of the 11 references it cites were found in a registry or an index.
Abstract
A recent United Kingdom survey reports that 63% of the adult population is uncomfortable with allowing personal data to be used to improve healthcare and is unfavorable to artificial intelligence (AI) systems replacing doctors and nurses in tasks they usually perform [1].Another study, conducted in Germany, found that medical students-the doctors of tomorrow-overwhelmingly buy into the promise of AI to improve medicine (83%) but are more skeptical that it will establish conclusive diagnoses in, for instance, imaging exams (56% disagree) [2].When asked about the prospects of AI, United States decision-makers at healthcare organizations are confident that it will improve medicine, but roughly half of them think it will produce fatal errors, will not work properly, and will not meet currently hyped expectations [3].These survey data resonate to the ethical and regulatory challenges that surround AI in healthcare, particularly privacy, data fairness, accountability, transparency, and liability.Successfully addressing these will foster the future of machine learning in medicine (MLm) and its positive impact on healthcare.Ethical and regulatory concerns about MLm can be grouped into three broad categories according to how and where they emerge, namely, around the sources of data needed for MLm and the approaches used in the development and deployment of MLm in clinical practice (for a hypothetical case study, see Fig 1). Data sourcing for MLm must adhere to data protection and privacy requirementsMLm algorithms use data that are subject to privacy protections, requiring that developers pay close attention to ethical and regulatory restrictions at each stage of data processing.Data provenance and consent for use and reuse are of particular importance [4,5], especially for MLm that requires considerable amounts and large varieties of data.It is very likely that such disparate data will have different conditions of use and/or be bound by different legal protections.A prominent example is the newly enacted European General Data Protection Regulation (GDPR), which sets out specific informed consent requirements for data uses and grants data subjects several rights that must be respected by those processing their data [6].Moreover, this law applies to data from residents of the European Union (EU) irrespective of where the data are processed.Data that are used to train algorithms must have the necessary use authorizations, but determining which data uses are permitted for a given purpose is not an easy feat.This will also depend on data type, jurisdiction, purpose of use, and oversight models.Ethical and regulatory concerns around health data have been debated for some time, and regulation such as GDPR is emblematic of legislative motivation to address novel digital challenges.However, different jurisdictions have reached and can be expected to reach different conclusions.Compare, for example, the GDPR with the Health Insurance Portability and
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Risks related to security (cyber intrusion and privacy), economic aspects (e.g., job displacement) and performance (e.g., errors and bias, black box and explainability issues) can be minimized by valuing human intelligence and skills (Vayena et al., 2018).”
From Setting the future of digital and social media marketing research: Perspectives and research propositions (2021) · cites this paper as Vayena et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, an AI solution trained with data biased towards an over-diagnosis of schizophrenia in African Americans can have detrimental consequences if used in some sub-Saharan African populations”
From SHIFTing artificial intelligence to be responsible in healthcare: a systematic review (2022) · cites this paper as Vayena et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For example, an AI solution trained with data biased towards an over-diagnosis of schizophrenia in African Americans can have detrimental consequences if used in some sub-Saharan African populations (Vayena et al., 2018).”
From SHIFTing artificial intelligence to be responsible in healthcare: a systematic review (2022) · cites this paper as Vayena et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Method of data collection for AI may increase risks as AI systems need huge datasets, and patients are concerned that their personal information will be collected without their knowledge [30].”
From Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives (2020) · cites this paper as [30]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Introduction of bias is a pressing issue that has become a focal point of MI fairness21,22.”
From Machine intelligence in healthcare—perspectives on trustworthiness, explainability, usability, and transparency (2020) · cites this paper as [22]
8 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Health disparities and health equity: Concepts and measurement
Braveman, P. (2006) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.27.021405.102103 · Cited by 1,570
Medical students' attitude towards artificial intelligence: a multicentre survey
Pinto dos Santos, D., Giese, D., Brodehl, S., Chon, S. H., Staab, W., Kleinert, R., Maintz, D., & Baeßler, B. (2019) · European Radiology · doi:10.1007/s00330-018-5601-1 · Cited by 754
HIPAA and protecting health information in the 21st century
Cohen, I. G., & Mello, M. M. (2018) · JAMA · doi:10.1001/jama.2018.5630 · Cited by 273
Self-citationThe influence of racial factors on psychiatric diagnosis: A review and suggestions for research
Neighbors, H. W., Jackson, J. S., Campbell, L., & Williams, D. (1989) · Community Mental Health Journal · doi:10.1007/bf00755677 · Cited by 244
Health Research with Big Data: Time for Systemic Oversight
Vayena, E., & Blasimme, A. (2018) · Journal of Law, Medicine & Ethics · doi:10.1177/1073110518766026 · Cited by 162
Self-citationBiomedical Big Data: New Models of Control Over Access, Use and Governance
Vayena, E., & Blasimme, A. (2017) · Journal of Bioethical Inquiry · doi:10.1007/s11673-017-9809-6 · Cited by 145
Self-citationMedical Malpractice and Black-Box Medicine
Price, W. N. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108147972.027 · Cited by 78
Price, W. (2017) · Michigan Law Review · doi:10.36644/mlr.116.3.regulating · Cited by 64
Big Data, Health Law, and Bioethics
Cohen, I. G., Lynch, H. V., Vayena, E., & Gasser, U. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108147972 · Cited by 62
Self-citationWhat does the GDPR mean for the medical community?
McCall, B. (2018) · The Lancet · doi:10.1016/s0140-6736(18)30739-6 · Cited by 55
Research works printed but not linked: 1
- The American Medical Association. AMA passes first policy recommendations on augmented intelligence. 2018 Jun 14 [Cited 19 Sept 2018]. https://www.ama-assn.org/ama-passes-first-policy-recommendations-augmented-intelligence.
Cited by
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Self-citationDwivedi, Y. K., Ismagilova, E., Hughes, D. L., Carlson, J., Filieri, R., Jacobson, J., Jain, V., Karjaluoto, H., Kefi, H., Krishen, A. S., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102168 · Cited by 4,608
“Risks related to security (cyber intrusion and privacy), economic aspects (e.g., job displacement) and performance (e.g., errors and bias, black box and explainability issues) can be minimized by valuing human intelligence and skills (Vayena et al., 2018).”
BackgroundThe ethics of AI in health care: A mapping review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113172 · Cited by 1,105
“…(2019) stress, uptake of algorithmic-decision-making tools by the clinical community is highly unlikely until this liability question is resolved (Vayena et al., 2018a, 2018b), which could result in the overarching ethical concern raised in the introduction—that of a significant missed…”
BackgroundInfluentialA governance model for the application of AI in health care
Reddy, S., Allan, S., Coghlan, S., & Cooper, P. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz192 · Cited by 979
“8 Unrepresentative data can occur due to, for example, societal discrimination (eg, poor access to health care) and relatively small samples (eg, minority groups).”
BackgroundInfluentialInitial validation of the general attitudes towards Artificial Intelligence Scale
Schepman, A., & Rodway, P. (2020) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2020.100014 · Cited by 785
“Vayena, Blasimme, and Cohen (2018) explored what could be done in response to a majority of the UK public feeling uncomfortable with the use of AI andmachine learning in medical settings.”
BackgroundSignificance of machine learning in healthcare: Features, pillars and applications
Javaid, M., Haleem, A., Pratap Singh, R., Suman, R., & Rab, S. (2022) · International Journal of Intelligent Networks · doi:10.1016/j.ijin.2022.05.002 · Cited by 641
Ethical Machine Learning in Healthcare
Chen, I. Y., Pierson, E., Rose, S., Joshi, S., Ferryman, K., & Ghassemi, M. (2021) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-092820-114757 · Cited by 645
Fairness of artificial intelligence in healthcare: review and recommendations
Ueda, D., Kakinuma, T., Fujita, S., Kamagata, K., Fushimi, Y., Ito, R., Matsui, Y., Nozaki, T., Nakaura, T., Fujima, N., et al. (2024) · Japanese Journal of Radiology · doi:10.1007/s11604-023-01474-3 · Cited by 607
“Respecting patient autonomy and protect‑ ing confidential medical information is the foundation of ethical AI implementation, which can only be achieved by addressing important issues related to data privacy [94, 95].”
BackgroundCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
“For example, users may resist adopting a tool if they do not understand its capabilities, its intended use, or its utility over existing practices [48, 72, 74].”
BackgroundExplainable AI for Healthcare 5.0: Opportunities and Challenges
Saraswat, D., Bhattacharya, P., Verma, A., Prasad, V. K., Tanwar, S., Sharma, G., Bokoro, P. N., & Sharma, R. (2022) · IEEE Access · doi:10.1109/access.2022.3197671 · Cited by 523
Deep learning in ophthalmology: The technical and clinical considerations
Ting, D. S. W., Peng, L., Varadarajan, A. V., Keane, P. A., Burlina, P. M., Chiang, M. F., Schmetterer, L., Pasquale, L. R., Bressler, N. M., Webster, D. R., et al. (2019) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2019.04.003 · Cited by 534
Ethics and governance of trustworthy medical artificial intelligence
Zhang, J., & Zhang, Z.-M. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02103-9 · Cited by 507
Use of AI-based tools for healthcare purposes: a survey study from consumers’ perspectives
Esmaeilzadeh, P. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01191-1 · Cited by 507
“Method of data collection for AI may increase risks as AI systems need huge datasets, and patients are concerned that their personal information will be collected without their knowledge [30].”
BackgroundInfluentialMachine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 454
“…m /t e r m s - a nd - c ond iti on s ) on W il e y O n li n e L i b r a r y f o r r u l e s o f u s e ; OA a r ti c l e s a r e gov e r n e d by t h e a pp li ca b l e C r ea ti v e C o mm on s L i ce n s e will emerge, as they have in other fields (e.g. Hardt et al., 2016 ; Vayena et al., 2018 ).”
Legal and human rights issues of AI: Gaps, challenges and vulnerabilities
Rodrigues, R. (2020) · Journal of Responsible Technology · doi:10.1016/j.jrt.2020.100005 · Cited by 494
Artificial intelligence in clinical and genomic diagnostics
Dias, R., & Torkamani, A. (2019) · Genome Medicine · doi:10.1186/s13073-019-0689-8 · Cited by 456
“…by the development of: (i) best practices for the interpretability of predictions to protect patient autonomy and shared decision-making; (ii) fairness standards to minimize disparities induced by machine bias; and (iii) ad hoc guidance to allow for continuous improvement of the algorithms [83].”
BackgroundMethodDurán, J. M., & Jongsma, K. R. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106820 · Cited by 446
“23 52 It is for example argued that AI may reintroduce a paternalistic model of decision making, by ranking treatments according to effectiveness to increase the lifespan of patients.”
BackgroundMannuru, N. R., Shahriar, S., Teel, Z. A., Wang, T., Lund, B. D., Tijani, S., Pohboon, C. O., Agbaji, D., Alhassan, J., Galley, J., et al. (2025) · Information Development · doi:10.1177/02666669231200628 · Cited by 314
“Protecting patient privacy is crucial as the deep learning model employed by AI may inadvertently collect and transmit data without the patient ’ s knowledge, leading to privacy breaches (Vayena et al., 2018).”
Artificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389
“This point raises the overarching issue of the extent of automation that is possible through applications of ML, linked to speculation about whether ML will mostly augment or actually replace health care providers’ work [1,30].”
BackgroundRashidi, H. H., Tran, N. K., Betts, E. V., Howell, L. P., & Green, R. (2019) · Academic Pathology · doi:10.1177/2374289519873088 · Cited by 371
SHIFTing artificial intelligence to be responsible in healthcare: a systematic review
Siala, H., & Wang, Y. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114782 · Cited by 358
Artificial intelligence in nursing and midwifery: A systematic review
O'Connor, S., Yan, Y., Thilo, F. J. S., Felzmann, H., Dowding, D., & Lee, J. J. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16478 · Cited by 351
Blease, C., Kaptchuk, T. J., Bernstein, M. H., Mandl, K. D., Halamka, J. D., & DesRoches, C. M. (2019) · Journal of Medical Internet Research · doi:10.2196/12802 · Cited by 346
“Our findings carry implications about the capacity of physicians to contribute in meaningful and objective ways to the many cutting-edge ethical and policy issues in relation to the advancement of AI in medicine [8,51,52].”
Cutillo, C. M., Sharma, K. R., Foschini, L., Kundu, S., Mackintosh, M., Mandl, K. D., MI in Healthcare Workshop Working Group, Beck, T., Collier, E., Colvis, C., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0254-2 · Cited by 337
Ethical and legal considerations in healthcare AI: innovation and policy for safe and fair use
Pham, T. (2025) · Royal Society Open Science · doi:10.1098/rsos.241873 · Cited by 261
“The public often worries about whether AI will make decisions that align with their values, especially in healthcare, where personal well-being is at stake [115,116].”
Grassini, S. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1191628 · Cited by 330
Artificial intelligence and machine learning in cancer imaging
Koh, D.-M., Papanikolaou, N., Bick, U., Illing, R., Kahn, C. E., Kalpathi-Cramer, J., Matos, C., Martí-Bonmatí, L., Miles, A., Mun, S. K., et al. (2022) · Communications Medicine · doi:10.1038/s43856-022-00199-0 · Cited by 311
“For an ML algorithm to be clinically useful it must be trained on data that appropriately represent the variance in the human population, the presentation of disease and data collection systems 119,120 .”
What Clinicians Want: Contextualizing Explainable Machine Learning for Clinical End Use
Tonekaboni, S., Joshi, S., McCradden, M. D., & Goldenberg, A. (2019) · arXiv · doi:10.48550/arxiv.1905.05134 · Cited by 318
“, 2018b), and high stakes (Vayena et al., 2018) are some of the technical barriers to practical adoption.”
BackgroundTrust and medical AI: the challenges we face and the expertise needed to overcome them
Quinn, T. P., Senadeera, M., Jacobs, S., Coghlan, S., & Le, V. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa268 · Cited by 287
Alami, H., Rivard, L., Lehoux, P., Hoffman, S. J., Cadeddu, S. B. M., Savoldelli, M., Samri, M. A., Ag Ahmed, M. A., Fleet, R., & Fortin, J.-P. (2020) · Globalization and Health · doi:10.1186/s12992-020-00584-1 · Cited by 283
“For example, an AI solution trained with data biased towards over-diagnosis of schizophrenia in African-Americans can have detrimental consequences if used in some sub-Saharan African populations as these technologies could make incomplete or erroneous diagnoses [27].”
BackgroundThe need to separate the wheat from the chaff in medical informatics
Cabitza, F., & Campagner, A. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104510 · Cited by 276
“Is there any discussion regarding model fairness, ethical concerns or risks of bias [25, 86] (for a list of clinically relevant biases, refer to [87] )? If possible, the authors should report the model performance stratified for particularly relevant population strata [88] (e.”
Background(2021) · doi:10.2196/25856 · Cited by 268
“Generally, algorithms that change continuously with features that are not limited to the original accepted clinical trials may need a new range of policies and guidelines [47].”
BackgroundMethodInfluentialČartolovni, A., Tomičić, A., & Lazić Mosler, E. (2022) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2022.104738 · Cited by 267
Mousavi Baigi, S. F., Sarbaz, M., Ghaddaripouri, K., Ghaddaripouri, M., Mousavi, A. S., & Kimiafar, K. (2023) · Health Science Reports · doi:10.1002/hsr2.1138 · Cited by 255
“Vayena et al. 67 investigated whether, in response to feeling uncomfortable, the majority of the UK public can make use of AI and ML in medical settings in tasks such as answering medical questions and offering treatment (17% agree, 63% disagree, and 20% do not know).”
BackgroundRole of machine learning in medical research: A survey
Garg, A., & Mago, V. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100370 · Cited by 243
Primer on an ethics of AI-based decision support systems in the clinic
Braun, M., Hummel, P., Beck, S., & Dabrock, P. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105860 · Cited by 238
“As with other data-intensive applications, adherence to data protection and privacy requirements 26 27 such as the general data protection regulation (GDPR) will be essential.”
BackgroundA Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis
Xu, X., Li, J., Zhu, Z., Zhao, L., Wang, H., Song, C., Chen, Y., Zhao, Q., Yang, J., & Pei, Y. (2024) · Bioengineering · doi:10.3390/bioengineering11030219 · Cited by 242
AI-driven healthcare: A review on ensuring fairness and mitigating bias
Chinta, S. V., Wang, Z., Palikhe, A., Zhang, X., Kashif, A., Smith, M. A., Liu, J., & Zhang, W. (2025) · PLOS Digital Health · doi:10.1371/journal.pdig.0000864 · Cited by 171
“For instance, if an AI sys-tem were to consistently provide inferior diagnostic support for certain racial groups, this could be viewed as a form of systemic negligence or malpractice [73].”
Predictive analytics in health care: how can we know it works?
Van Calster, B., Wynants, L., Timmerman, D., Steyerberg, E. W., & Collins, G. S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz130 · Cited by 223
“This is the commonly addressed problem when discussing transparency of predictive analytics based on machine learning.(26) We argue that algorithm availability is at least as important.”
BackgroundThe three ghosts of medical AI: Can the black-box present deliver?
Quinn, T. P., Jacobs, S., Senadeera, M., Le, V., & Coghlan, S. (2022) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102158 · Cited by 215
Benefits and Risks of AI in Health Care: Narrative Review
Chustecki, M. (2024) · Interactive Journal of Medical Research · doi:10.2196/53616 · Cited by 208
“Increased reliance on AI may lead to automated decision-making, limiting the contact and communication between health care workers and patients [46].”
Artificial Intelligence and Biosensors in Healthcare and Its Clinical Relevance: A Review
(2023) · doi:10.1109/access.2023.3285596 · Cited by 205
“AI embedded in smart devices democratizes healthcare by putting AI-enabled health services (for example, AI-based clinical decision support) into patients’ homes or remote healthcare [35].”
BackgroundLatent bias and the implementation of artificial intelligence in medicine
DeCamp, M., & Lindvall, C. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa094 · Cited by 198
“Among the many concerns about AI that have garnered widespread public attention, the most controversial and pressing may be the challenge of identifying biases in AI algorithms.(9,10) These biases include those related to missing data and patients not identified by algorithms, misclassification, observational error, a…”
BackgroundPeyroteo, M., Ferreira, I. A., Elvas, L. B., Ferreira, J. C., & Lapão, L. V. (2021) · JMIR mHealth and uHealth · doi:10.2196/28285 · Cited by 190
“The Food and Drug Association in the United States has established a wearables certification [6].”
BackgroundZihni, E., Madai, V. I., Livne, M., Galinovic, I., Khalil, A. A., Fiebach, J. B., & Frey, D. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231166 · Cited by 187
“3) Domain knowledge supported interpretation leading to increased trust by the physicians, other healthcare professionals, and patients [12]: Some argue that black box approaches are unacceptable for clinical decision support from the physician ́s point-of-view [13] and from the patient’s point-of-view [14].”
BackgroundArtificial Intelligence and Health Technology Assessment: Anticipating a New Level of Complexity
Alami, H., Lehoux, P., Auclair, Y., de Guise, M., Gagnon, M.-P., Shaw, J., Roy, D., Fleet, R., Ag Ahmed, M. A., & Fortin, J.-P. (2020) · Journal of Medical Internet Research · doi:10.2196/17707 · Cited by 164
“As the data may come from different sources and contexts, different conditions and precautions will need to be considered [73].”
BackgroundKumar, P., Dwivedi, Y. K., & Anand, A. (2023) · Information Systems Frontiers · doi:10.1007/s10796-021-10136-6 · Cited by 163
“However, these rapid advancements of AI technologies create numerous challenges and raise legitimate concerns (Sivarajah et al., 2017; Vayena et al., 2018).”
BackgroundRasool, R. U., Ahmad, H. F., Rafique, W., Qayyum, A., & Qadir, J. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103332 · Cited by 177
Zahlan, A., Ranjan, R. P., & Hayes, D. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102321 · Cited by 195
Using Machine Learning to Predict Complications in Pregnancy: A Systematic Review
Bertini, A., Salas, R., Chabert, S., Sobrevía, L., & Pardo, F. (2022) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2021.780389 · Cited by 197
“This may be risky since the sample size may not be representative for a given geographic group, representing one of the limitations of ML in health (Vayena et al., 2018).”
BackgroundLooking beyond the hype: applied AI and machine learning in translational medicine
Toh, T. S., Dondelinger, F., & Wang, D. (2019) · EBioMedicine · doi:10.1016/j.ebiom.2019.08.027 · Cited by 159
“Ethical frameworks should be developed by scientific committees and regulatory bodies to recognise and minimise the effect of biased models while guiding design choices to introduce systems that build trust, understanding, and maintaining individual privacy [57,59].”
BackgroundData Integration Challenges for Machine Learning in Precision Medicine
Martínez-García, M., & Hernández-Lemus, E. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.784455 · Cited by 185
“In this regard, it is worth discussing the role that data portabilitywill play in individual and collective decisions (324, 325).”
BackgroundMachine Learning in Action: Stroke Diagnosis and Outcome Prediction
Mainali, S., Darsie, M. E., & Smetana, K. S. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.734345 · Cited by 183
“Furthermore, the “black-box” nature of ML precludes the clinicians from identifying and addressing biases within the algorithms (95, 96).”
BackgroundPutting the data before the algorithm in big data addressing personalized healthcare
Cahan, E. M., Hernandez-Boussard, T., Thadaney-Israni, S., & Rubin, D. L. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0157-2 · Cited by 149
“49 For example, deliberate outreach efforts can be made by investigators to populations with poorer healthcare access.”
BackgroundA translucent box: interpretable machine learning in ecology
Lucas, T. C. D. (2020) · Ecological Monographs · doi:10.1002/ecm.1422 · Cited by 171
Toward an Understanding of Responsible Artificial Intelligence Practices
Wang, Y., Xiong, M., & Olya, H. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.610 · Cited by 181
“On the other hand, with appropriate data policy, it will improve consumers’ confidence in sharing the data with firms for AI use [56].”
BackgroundRodway, P., & Schepman, A. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100150 · Cited by 144
Wubineh, B. Z., Deriba, F. G., & Woldeyohannis, M. M. (2024) · Urologic Oncology: Seminars and Original Investigations · doi:10.1016/j.urolonc.2023.11.019 · Cited by 141
The Ethics of AI in Health Care: A Mapping Review
Morley, J., Machado, C. C. V., Burr, C., Cowls, J., Joshi, I., Taddeo, M., & Floridi, L. (2020) · Philosophical studies series · doi:10.1007/978-3-030-81907-1_18 · Cited by 157
Albahra, S., Gorbett, T., Robertson, S., D'Aleo, G., Kumar, S. V. S., Ockunzzi, S., Lallo, D., Hu, B., & Rashidi, H. H. (2023) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2023.02.002 · Cited by 139
Artificial Intelligence for Health Professions Educators
Lomis, K., Jeffries, P., Palatta, A., Sage, M., Sheikh, J., Sheperis, C., & Whelan, A. (2021) · NAM Perspectives · doi:10.31478/202109a · Cited by 136
“In the United States, when decision makers at health care organizations were asked how con fi dent they were that AI would improve medicine, roughly 50 percent feared that it will produce fatal errors, have operational fl aws, and produce unmet expectations [29].”
BackgroundDawoodbhoy, F. M., Delaney, J., Cecula, P., Yu, J., Peacock, I., Tan, J. S., & Cox, B. M. (2021) · Heliyon · doi:10.1016/j.heliyon.2021.e06993 · Cited by 174
“The future challenge is to ensure transparency and comprehensiveness of models and datasets whilst still protecting con fi dential data and patients' privacy [131].”
Backgroundvan de Sande, D., Van Genderen, M. E., Smit, J. M., Huiskens, J., Visser, J. J., Veen, R. E. R., van Unen, E., BA, O. H., Gommers, D., & Bommel, J. V. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100495 · Cited by 135
Wamba, S. F., & de Queiroz, M. M. (2021) · Information Systems Frontiers · doi:10.1007/s10796-021-10142-8 · Cited by 156
“For instance, there are issues of patient ’ s trustworthiness on the technologies (Vayena et al., 2018), ethics and data-related privacy (Vayena et al., 2018).”
BackgroundInfluentialYou Can’t Have AI Both Ways: Balancing Health Data Privacy and Access Fairly
Bak, M., Madai, V. I., Fritzsche, M.-C., Mayrhofer, M. T., & McLennan, S. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.929453 · Cited by 145
“Requiring (re-)consent may also lead to major selection biases that undermine data representativeness, which can lead to biased AI models that in turn harm patients and exacerbate existing health inequalities (Vayena et al., 2018).”
BackgroundBlease, C., Locher, C., Leon-Carlyle, M., & Doraiswamy, M. (2020) · DIGITAL HEALTH · doi:10.1177/2055207620968355 · Cited by 121
“In light of high levels of patient interest in mental health apps, the effectiveness, reliability, and safety of machine learning technologies present serious ethical, legal, and regulatory considerations that require the sustained engagement of the psychiatric community.(72,73,76,77) So far, the efficacy and safety o…”
BackgroundSuresh, H., Gomez, S. R., Nam, K. K., & Satyanarayan, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445088 · Cited by 117
“…their mental model" [30], mental models of the system to generalize the AI behavior [83, 130], patient/client/decision subject [21, 101, 105, 113, 117, 121], “hold preconception of what constitutes useful explanations for decisions" [76], “prognosticating their patient’s condition in their…”
BackgroundInfluentialMachine Learning in Oncology: Methods, Applications, and Challenges
Bertsimas, D., & Wiberg, H. (2020) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00072 · Cited by 137
Trust me, i'm a chatbot: how artificial intelligence in health care fails the Turing Test
Powell, J. (2019) · Journal of Medical Internet Research · doi:10.2196/16222 · Cited by 115
“For those of us studying the social science of digital technology in health and health care, one area of research is likely to dominate the next decade: the extent to which the promise of artificial intelligence (AI) in health care will be realized, and the social and ethical issues which accompany it [11-13].”
BackgroundMohamed, E. S., Naqishbandi, T. A., Bukhari, S. A. C., Rauf, I., Sawrikar, V., & Hussain, A. (2023) · Healthcare Analytics · doi:10.1016/j.health.2023.100185 · Cited by 146
Applications of Artificial Intelligence in Cardiology. The Future is Already Here
Dorado-Díaz, P. I., Sampedro-Gómez, J., Vicente-Palacios, V., & Sánchez, P. L. (2019) · Revista Española de Cardiología (English Edition) · doi:10.1016/j.rec.2019.05.014 · Cited by 111
The Role of Machine Learning in Spine Surgery: The Future Is Now
Chang, M., Canseco, J. A., Nicholson, K. J., Patel, N., & Vaccaro, A. R. (2020) · Frontiers in Surgery · doi:10.3389/fsurg.2020.00054 · Cited by 121
“Finally, as foreshadowed in the Overview of Machine Learning section, a major component of artificial intelligence research involves the ethical challenges of implementing machine learning for clinical practice (2, 4, 77–79).”
BackgroundResponsibility beyond design: Physicians’ requirements for ethical medical AI
Sand, M., Durán, J. M., & Jongsma, K. R. (2021) · Bioethics · doi:10.1111/bioe.12887 · Cited by 133
Amann, J., Vayena, E., Ormond, K. E., Frey, D., Madai, V. I., & Blasimme, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0279088 · Cited by 119
“This paper complements existing normative guidelines and ethical frameworks [22–26] by empirically probing stakeholders’ views on ethically relevant issues relating to the use of medical AI in a concrete clinical context, namely, stroke medicine.”
Self-citationChauhan, C., & Gullapalli, R. R. (2021) · American Journal Of Pathology · doi:10.1016/j.ajpath.2021.06.011 · Cited by 125
“An intensely studied aspect of AI ethics is risk assessment and evaluation of the dangers associated with implementation of AI.”
BackgroundMethodInfluentialAntes, A. L., Burrous, S., Sisk, B. A., Schuelke, M. J., Keune, J. D., & DuBois, J. M. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01586-8 · Cited by 120
“…Concern about the comprehensibility of AI results or recommendations and uncertainty about being made aware when AI is used in healthcare [12, 14, 38, 42] Human element of care Concern about AI decreasing the clinician’s role in healthcare and these technologies impacting the interactions…”
BackgroundGonzález-Gonzalo, C., Thee, E. F., Klaver, C. C. W., Lee, A. Y., Schlingemann, R. O., Tufail, A., Verbraak, F., & Sánchez, C. I. (2022) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2021.101034 · Cited by 103
“It could happen that certain payers start to consider the recommendations provided by AI systems as a precondition for reimbursement and refuse to cover procedures or treatments when the AI recommended against them (Vayena et al., 2018).”
Geiger, R. S., Cope, D., Ip, J., Lotosh, M., Shah, A., Weng, J., & Tang, R. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00144 · Cited by 140
“Medical privacy risks arise for patients whose health care records may be used in formulating a training dataset ( Vayena et al., 2018 ).”
BackgroundMachine learning for sperm selection
You, J. B., McCallum, C., Wang, Y., Riordon, J., Nosrati, R., & Sinton, D. A. (2021) · Nature Reviews Urology · doi:10.1038/s41585-021-00465-1 · Cited by 111
“Thus, continuous effort is needed — by both the scientific and the regulatory sectors — to investigate the effect of biased training data sets and to develop models and practices for determining the appropriate sample size 140 .”
BackgroundDavies, R. H., Augusto, J. B., Bhuva, A., Xue, H., Treibel, T. A., Ye, Y., Hughes, R. K., Bai, W., Lau, C. W. Z., Shiwani, H., et al. (2022) · Journal of Cardiovascular Magnetic Resonance · doi:10.1186/s12968-022-00846-4 · Cited by 112
“EDV end diastolic volume, ESV end systolic volume, EF ejection fraction, LVM LV mass science and clinical domains, as well as validation, trans-parency, ethical and regulatory concerns [32].”
BackgroundAdvancements in AI based healthcare techniques with FOCUS ON diagnostic techniques
Kalra, N., Verma, P., & Verma, S. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108917 · Cited by 95
A systematic review of intermediate fusion in multimodal deep learning for biomedical applications
Guarrasi, V., Aksu, F., Caruso, C. M., Di Feola, F., Rofena, A., Ruffini, F., & Soda, P. (2025) · Image and Vision Computing · doi:10.1016/j.imavis.2025.105509 · Cited by 95
Tackling COVID-19 Through Responsible AI Innovation: Five Steps in the Right Direction
Leslie, D. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.4bb9d7a7 · Cited by 123
AI in healthcare: navigating opportunities and challenges in digital communication
Sun, G., & Zhou, Y. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1291132 · Cited by 129
Application of Bayesian networks to generate synthetic health data
Kaur, D., Sobiesk, M., Patil, S. S., Liu, J., Bhagat, P., Gupta, A. D., & Markuzon, N. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa303 · Cited by 102
Lahat, A., Shachar, E., Avidan, B., Glicksberg, B. S., & Klang, E. (2023) · Diagnostics · doi:10.3390/diagnostics13111950 · Cited by 108
“The ability to understand and accurately respond to complex medical questions requires a deep understanding of the subject matter, as well as the ability to process and integrate information from a variety of sources [10].”
BackgroundConway, M., Hu, M., & Chapman, W. W. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677918 · Cited by 91
“…ethics (i.e. the empirical investigation of ethical beliefs and practices) [101, 102], and those that are focussed on ethical guideline development (i.e. the generation of theoretical frameworks and practical guidelines for conducting health-related NLP research with social media) [9, 103, 104].”
BackgroundAstromskė, K., Peičius, E., & Astromskis, P. (2020) · AI & Society · doi:10.1007/s00146-020-01008-9 · Cited by 116
“Therefore, the “black box” problem of artificial intelligence remains some of the greatest challenges for medical ethicists and regulators (Vayena et al. 2018).”
BackgroundInfluentialTransforming Healthcare with AI: Promises, Pitfalls, and Pathways Forward
Shuaib, A. S. (2024) · International Journal of General Medicine · doi:10.2147/ijgm.s449598 · Cited by 103
“31 ● Accountability: Creating mechanisms to address errors or biases in AI systems, with clearly defined responsibilities.”
BackgroundExplainable AI: A review of applications to neuroimaging data
Farahani, F. V., Fiok, K., Lahijanian, B., Karwowski, W., & Douglas, P. K. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.906290 · Cited by 98
“Transparency builds trust, subtends the evaluation of fairness, and helps identify points of model failure (Kindermans et al., 2017; Rajkomar et al., 2018; Vayena et al., 2018; Wilson et al., 2019).”
BackgroundArtificial Intelligence in Clinical Neuroscience: Methodological and Ethical Challenges
Ienca, M., & Ignatiadis, K. (2020) · AJOB Neuroscience · doi:10.1080/21507740.2020.1740352 · Cited by 106
“Although many of these challenges are inherent in any biomedical application of AI (Char et al. 2018; Obermeyer and Emanuel 2016; Topol 2019; Vayena et al. 2018), at least five of them acquire particular ethical salience when applied to the human brain and clinical neuroscience more generally.”
BackgroundA scoping review of school-based efforts to support students who have experienced trauma.
Stratford, B., Cook, E., Hanneke, R., Katz, E., Seok, D., Steed, H., Fulks, E., Lessans, A., & Temkin, D. (2020) · School Mental Health · doi:10.1007/s12310-020-09368-9 · Cited by 83
Petersen, E., Potdevin, Y., Mohammadi, E., Zidowitz, S., Breyer, S., Nowotka, D., Henn, S., Pechmann, L., Leucker, M., Rostalski, P., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3178382 · Cited by 112
“Much of what is often called ‘‘responsible machine learning’’ [21], [61], [399] is thus — at least to some degree — already required by existing regulations.”
BackgroundAlhur, A. (2024) · Cureus · doi:10.7759/cureus.57795 · Cited by 82
Ethical considerations for artificial intelligence: an overview of the current radiology landscape.
Department of Radiology and Nuclear Medicine, U. H. B., & Akinci D'Antonoli, T. (2020) · Diagnostic and Interventional Radiology · doi:10.5152/dir.2020.19279 · Cited by 80
“While the identification and minimaliza-tion of the bias are consistently promoted, novel findings also need to be incorporated to allow continuous optimization towards higher quality standards (32, 33).”
BackgroundFuture-proofing biobanks’ governance
Gille, F., Vayena, E., & Blasimme, A. (2020) · European Journal of Human Genetics · doi:10.1038/s41431-020-0646-4 · Cited by 89
Self-citationChikwetu, L., Yu, M., Woldetensae, M. K., Bell, D., Goldenholz, D. M., & Dunn, J. (2023) · The Lancet Digital Health · doi:10.1016/s2589-7500(22)00234-5 · Cited by 91
“Just” accuracy? Procedural fairness demands explainability in AI-based medical resource allocations
Rueda, J., Delgado, J., Jounou, I. P., Hortal-Carmona, J., Ausín, T., & Rodríguez‐Arias, D. (2022) · AI & Society · doi:10.1007/s00146-022-01614-9 · Cited by 97
“For instance, the black box problem arises when it is not possible to know, not even for the developers of the algorithm, the inner logic that has led from the processing of the data to the corresponding result (Vayena et al. 2018).”
BackgroundArtificial Intelligence in radiotherapy: state of the art and future directions
Francolini, G., Desideri, I., Stocchi, G., Salvestrini, V., Ciccone, L. P., Garlatti, P., Loi, M., & Livi, L. (2020) · Medical Oncology · doi:10.1007/s12032-020-01374-w · Cited by 82
What Makes Artificial Intelligence Exceptional in Health Technology Assessment?
Bélisle‐Pipon, J., Couture, V., Roy, M., Ganache, I., Goetghebeur, M. M., & Cohen, I. G. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.736697 · Cited by 93
“That being said, in a study reported by Vayena et al. (2018), half of the surveyed American healthcare decision-makers expect that AIHTs will both improve medicine and fail meeting hyped expectations.”
BackgroundResultInfluentialSelf-citation
Metadata
- Authors
- Vayena, E., Blasimme, A., & Cohen, I. G.
- Affiliations
- ETH Zurich (CH)
- Harvard University (US)
- Corresponding author
- Vayena, Effy
- Venue
- PLOS Medicine
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-11-06
- Volume
- 15
- Issue
- 11
- Pages
- e1002689
- ISSN
- 1549-1277 (ISSN-L)
- 1549-1676
- PMC
- PMC6219763
- OpenAlex
- W2899768131
- Cited by
- 912
- References
- 11
- Citations by year
- 2026: 228 · 2025: 165 · 2024: 126 · 2023: 104 · 2022: 81 · 2021: 103 · 2020: 61 · 2019: 42 · 2018: 2
- FWCI
- 14.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
- ETH Zürich Research Collection (cc-by)
- Funders
- Celgene
- Novo Nordisk
- Novo Nordisk Fonden (NNF17SA0027784)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- machine learning in medicine, artificial intelligence in healthcare, AI ethics, regulatory challenges, health data privacy, data protection, General Data Protection Regulation, informed consent, data provenance, data fairness, algorithmic accountability, transparency, liability, data sourcing, medical students' attitudes, public trust in AI
- MeSH terms
- Machine Learning, Attitude of Health Personnel, Attitude to Computers, Confidentiality, Delivery of Health Care, Humans, Medical Records, Public Opinion, Self Care, Computer Security, Trust, Data Mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.