Responsible AI for Digital Health: a Synthesis and a Research Agenda
Open accessThe DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index; 6 of the 71 sources its claims cite were checked for support.
Abstract
Responsible AI is concerned with the design, implementation and use of ethical, transparent, and accountable AI technology in order to reduce biases, promote fairness, equality, and to help facilitate interpretability and explainability of outcomes, which are particularly pertinent in a healthcare context. However, the extant literature on health AI reveals significant issues regarding each of the areas of responsible AI, posing moral and ethical consequences. This is particularly concerning in a health context where lives are at stake and where there are significant sensitivities that are not as pertinent in other domains outside of health. This calls for a comprehensive analysis of health AI using responsible AI concepts as a structural lens. A systematic literature review supported our data collection and sampling procedure, the corresponding analysis, and extraction of research themes helped us provide an evidence-based foundation. We contribute with a systematic description and explanation of the intellectual structure of Responsible AI in digital health and develop an agenda for future research.
Overview
CoChat Summary
TL;DR
This systematic review synthesizes 34 papers (2009–2020) on responsible AI in digital health using Mittelstadt et al.’s six ethical concerns, mapping research themes via co-word and network analysis. It finds big data/predictive modelling as the mainstream theme, ethics/healthcare as a basic transversal theme, and proposes a research agenda around inconclusive, inscrutable, misguided evidence, unfair outcomes, transformative effects, and traceability.
Key findings
- From 83 initially retrieved papers, 34 were selected; 30 papers had author-assigned keywords (133 unique keywords, M = 4.43 per paper), and machine extraction produced 158 unique key-phrases (M = 4.65 per paper), with 47 keywords and 57 key-phrases retained for analysis.
- Co-word analysis identified seven clusters in both author-assigned and machine-extracted datasets; the mainstream Q1 theme covered big data, big data analytics, and predictive modelling, while ethics/healthcare appeared as a basic and transversal Q4 theme.
- Peripheral Q2 themes included ethical AI, primary ethical risks, ethical design, and IoT/medical devices; author-keyword Q3 emerging/declining themes included information ethics, trust, security, privacy, and health information exchange.
- Core-periphery analysis found ethics, artificial intelligence, privacy, big data, and healthcare among the most popular/core/backbone topics; big data analytics was frequent but not core or backbone.
Methods
- Qualitative systematic literature review with a protocol covering research questions, sources, search terms, search strategy, and inclusion/exclusion criteria; searches covered AIS basket-of-eight journals, leading management journals, EBSCOhost, Web of Science, Scopus, ACM Digital Library, and INFORMS, for articles published until October 2020.
- Meta-data analysis used correspondence analysis, co-word analysis, network analysis, and core-periphery analysis on author-assigned keywords and machine-extracted key-phrases; TextRank was used for abstract key-phrase extraction with a sliding window of 3, nouns/adjectives/proper nouns, and top-10 phrases.
- Synthesis was structured using Mittelstadt et al.’s (2016) six types of ethical concerns: inconclusive evidence, inscrutable evidence, misguided evidence, unfair outcomes, transformative effects, and traceability.
Limitations
- Stated by the paper: the focus is limited to healthcare, the analysis is limited by using Mittelstadt et al.’s framework, and other technologies such as Electronic Healthcare Records were not included.
- Evident from the text: the search ended in October 2020, included only English-language peer-reviewed journals and complete conference papers, and excluded research in progress, abstracts, workshop proposals, book chapters, demos, and blogs.
- Evident from the text: the final corpus is small (34 papers), and the co-word analysis retained only terms co-appearing more than 2 times, which may narrow the themes captured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 4 Not valid · 58 Not checked · 67 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The application of AI in healthcare therefore raises significant concerns of fairness, responsibility, human rights (Floridi & Taddeo, 2016)”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 1 Introduction
What the sources say
- Partly supportedcites Floridi & Taddeo, 2016 matched to “What Is Data Ethics?” (2016) sourceExperimental — accuracy not yet measured
The Introduction (page not specified) says that growing reliance on algorithms, including AI, raises issues of fairness, responsibility and respect for human rights. It discusses biomedical data and an NHS programme separately, but does not specifically make this three-part claim about AI applications in healthcare. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Recent empirical articles highlight how deploying AI is coupled with significant ethical challenges (Floridi & Taddeo, 2016)”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 1 Introduction
What the sources say
- Supportedcites Floridi & Taddeo, 2016 matched to “What Is Data Ethics?” (2016) source
The Introduction (p. 1) states verbatim that the opportunities of data science 'are also coupled to significant ethical challenges', explicitly listing 'the growing reliance on algorithms ... (including machine learning, artificial intelligence and robotics)' and reduced human oversight as posing 'pressing issues of fairness, responsibility and respect of human rights'. The same section's passage on the ethics of algorithms ties AI and artificial agents to 'crucial challenges' of moral responsibility, accountability and unforeseen/undesired consequences, and the Abstract reinforces 'the complexity of the ethical challenges posed by data science'. Only caveat: the source is a conceptual framing paper rather than an empirical study, and it treats AI within the wider scope of data science, but the attributed content itself is stated. (LLM, conf=0.85)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
None of the sources cited for this claim have been checked yet.
In the paper
“On other occasions a false negative occurred when AI incorrectly fails to indicate the presence of a disease when in reality it is present.”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 4.2 Inconclusive Evidence
What the sources say
- Could not verifycites Burr et al., 2020 matched to “The Ethics of Digital Well-Being: A Thematic Review” (2020) sourceExperimental — accuracy not yet measured
The Health and Healthcare section discusses possible false positives in ML detection of at-risk patients, but does not discuss false negatives or AI failing to identify a disease that is present. Searches for false negatives and missed diagnoses found no passage addressing that claim. (LLM, conf=0.72)
- Not checked yetcites Maher et al., 2019 matched to “Passive data collection and use in healthcare: A systematic review of ethical issues” (2019) source
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“In these cases, AI is subject to significant uncertainty, which called for precautionary and safety principles in the data collection and analysis for decision making (Floridi et al., 2020).”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 4.2 Inconclusive Evidence
What the sources say
- Supportedcites Floridi et al., 2020 matched to “How to Design AI for Social Good: Seven Essential Factors” (2020) source
In “Falsifiability and Incremental Deployment” (page unavailable), the paper says complete certainty about an AI-for-social-good application’s safety is out of reach in an uncertain world. This supports the attributed statement that AI in such cases is subject to significant uncertainty. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although AI can augment or surpass human abilities by identifying, interpreting, making inferences, and learning from data to achieve predetermined organizational and societal goals (Mikalef & Gupta, 2021), it provides suggestions that are by nature uncertain as it identifies correlation relationships (Floridi et al., 2020).”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 5.1 Inconclusive Evidence
What the sources say
- Partly supportedcites Floridi et al., 2020 matched to “How to Design AI for Social Good: Seven Essential Factors” (2020) sourceExperimental — accuracy not yet measured
In “Safeguards Against the Manipulation of Predictors” (page unavailable), the paper says AI prediction can rely on indicators correlated with, but not causal of, an outcome. It describes this as a risk for AI4SG interventions; it does not say AI suggestions are inherently uncertain because they identify correlations. (LLM, conf=0.85)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
46 more claims
Create a free account to see all 134 claims and to verify the 65 references still open.
- Probably not a substantial claim. 52
- It may state two separate claims as one. 46
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, irresponsible AI may lead to a loss of medical staff and patients [18].”
From Survey of Explainable AI Techniques in Healthcare (2023) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 4.1.3 Thematic Analysis along the Four Quadrants of Strategic Diagram
“According to author assigned keywords, big data, responsible development, ethical impact resulted to be motor theme about ethical issues stemming from AI (custer C4).”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > Network and Core-Periphery Analysis
“C4 Q1 2 8 55 0,622 2000 bigdata, biomedicine”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 4.1.1 Insights from the Correspondence Analysis Factor Map
“Density: how cohesive is the cluster of terms, i.e., the number of direct ties observed for the cluster divided by the maximum number of possible ones (M.Callon et al., 1991).”
§ Responsible AI for Digital Health: a Synthesis and a Research Agenda > 4.1.1 Insights from the Correspondence Analysis Factor Map
“The value range can be any positive number, and can be greater than 1, as density is not "interpreted" as a proportion, but rather as the average number of observed lines (Knoke & Yang, 2019, p. 107).”
Citations
Cites
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Structural Holes and Good Ideas
Burt, R. S. (2004) · American Journal of Sociology · doi:10.1086/421787 · Cited by 5,642
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
TextRank: Bringing Order into Text
Mihalcea, R. F., & Tarau, P. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 3,631
Science mapping software tools: Review, analysis, and cooperative study among tools
Cobo, M. J., López-Herrera, A. G., Herrera-Viedma, E., & Herrera, F. (2011) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21525 · Cited by 3,242
Callon, M., Courtial, J. P., & Laville, F. (1991) · Scientometrics · doi:10.1007/bf02019280 · Cited by 2,090
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987 · cited 1×
“In the first step, we specified the objective of our review and the road map towards achieving this objective (Templier & Paré, 2015).”
MethodFrom translations to problematic networks: An introduction to co-word analysis
Callon, M., Courtial, J.-P., Turner, W. A., & Bauin, S. (1983) · Social Science Information · doi:10.1177/053901883022002003 · Cited by 1,951
Principles alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886 · cited 2×
“Most of the highlevel interventions into the ethics of AI discussion are principle-based (Floridi & Cowls, 2019) but principles alone cannot guarantee ethical AI (Mittelstadt, 2019).”
Background
Research works printed but not linked: 1
- Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data & Society, 3 ( 2 ) , 2 0 5 3 9 5 1 7 1 6 6 7 9 6 7 9
Cited by
Ooi, K.-B., Tan, G. W.-H., Al-Emran, M., Al-Sharafi, M. A., Capatina, A., Chakraborty, A., Dwivedi, Y. K., Huang, T.-L., Kar, A. K., Lee, V.-H., et al. (2025) · Journal of Computer Information Systems · doi:10.1080/08874417.2023.2261010 · Cited by 746
“130 This can be achieved by analyzing the patients’ medical results and identifying potential health issues that may be inadvertently missed by clinicians.”
Self-citationSurvey of Explainable AI Techniques in Healthcare
Chaddad, A., Peng, J., Xu, J., & Bouridane, A. (2023) · Sensors · doi:10.3390/s23020634 · Cited by 591
“For example, irresponsible AI may lead to a loss of medical staff and patients [18].”
BackgroundWhat influences algorithmic decision-making? A systematic literature review on algorithm aversion
Mahmud, H., Islam, A. K. M. N., Ahmed, S. I., & Smolander, K. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121390 · Cited by 601
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565
Self-citationThinking responsibly about responsible AI and ‘the dark side’ of AI
Mikalef, P., Conboy, K., Lundström, J. E., & Popovič, A. (2022) · European Journal of Information Systems · doi:10.1080/0960085x.2022.2026621 · Cited by 435
“Time also plays an immediate key role at the very point that AI or analytics are used, and it is this timing that may determine whether said analytics or AI is, in fact, dark (Conboy et al., 2020; Trocin et al., 2021).”
BackgroundSelf-citationSHIFTing artificial intelligence to be responsible in healthcare: a systematic review
Siala, H., & Wang, Y. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2022.114782 · Cited by 358
Trocin, C., Hovland, I. V., Mikalef, P., & Dremel, C. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121081 · Cited by 216
“Fourth, AI enables internal actors to develop and use unbiased approaches during the decision-making process to provide similar opportunities to multiple users, which can subsequently contribute to organisational performance (Trocin et al., 2021).”
Self-citationMikalef, P., Conboy, K., & Krogstie, J. (2021) · Industrial Marketing Management · doi:10.1016/j.indmarman.2021.08.003 · Cited by 210
Self-citationArtificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198
“Earlier reviews have tended to focus only on some aspects of the implementation process of AI in healthcare, for example, regulation and legal issues (24,25), trust and ethics (24–29), clinical and patient outcomes (30–32) and economic impact (33).”
BackgroundToward AI Governance: Identifying Best Practices and Potential Barriers and Outcomes
Papagiannidis, E., Enholm, I. M., Dremel, C., Mikalef, P., & Krogstie, J. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10251-y · Cited by 191
“Information analysis refers to the opportunity of developing unbiased approaches for evidence-based data analysis (Trocin et al., 2021a), where AI can foster digital process and service innovation as companies did in this study.”
BackgroundSelf-citationShaping the future of AI in healthcare through ethics and governance
Bouderhem, R. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-02894-w · Cited by 162
Almaraz-López, C., Almaraz-Menéndez, F., & López-Esteban, C. (2023) · Education Sciences · doi:10.3390/educsci13060609 · Cited by 137
“In healthcare as well, new AI-driven initiatives are emerging, particularly those that apply machine learning algorithms to identify disease patterns without a priori hypotheses [8,9].”
BackgroundXAIR: A Systematic Metareview of Explainable AI (XAI) Aligned to the Software Development Process
Clement, T., Kemmerzell, N., Abdelaal, M., & Amberg, M. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5010006 · Cited by 131
Gupta, S., Kamboj, S., & Bag, S. (2021) · Information Systems Frontiers · doi:10.1007/s10796-021-10174-0 · Cited by 147
“Moral and ethical consequences are a concern that makes the adoption of responsible AI in healthcare a complex process (Trocin et al., 2021).”
BackgroundImplementing AI in healthcare—the relevance of trust: a scoping review
Steerling, E., Siira, E., Nilsén, P., Svedberg, P., & Nygren, J. (2023) · Frontiers in Health Services · doi:10.3389/frhs.2023.1211150 · Cited by 159
What about investors? ESG analyses as tools for ethics-based AI auditing
Minkkinen, M., Niukkanen, A., & Mäntymäki, M. (2024) · AI & SOCIETY · doi:10.1007/s00146-022-01415-0 · Cited by 109
“Because regulation cannot cover everything, effective AI governance is not only about legal compliance; organizations should also strive to go beyond legal requirements in the development of fair, transparent, and accountable AI systems (Dignum 2019; Trocin et al. 2021).”
The Application of the Principles of Responsible AI on Social Media Marketing for Digital Health
Liu, R., Gupta, S., & Patel, P. (2023) · Information Systems Frontiers · doi:10.1007/s10796-021-10191-z · Cited by 102
“The concept of responsible AI has been stated which seeks to support the design, implementation, and use of ethical, transparent, and accountable AI solutions, aiming at reducing biases, facilitating fairness, equality, interpretability, and explainability (Trocin et al., 2021).”
BackgroundRegulation of Digital Healthcare in India: Ethical and Legal Challenges
Jain, D. (2023) · Healthcare · doi:10.3390/healthcare11060911 · Cited by 120
“It could also include robot-assisted surgery and has, amongst other changes, led to an amplified focus on the use of artificial intelligence (AI) in various aspects of healthcare service delivery, including predicting, diagnosing, and treating diseases and conditions [10].”
BackgroundAI in medical diagnosis: AI prediction & human judgment
Göndöcs, D., & Dörfler, V. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102769 · Cited by 90
Minkkinen, M., Laine, J., & Mäntymäki, M. (2022) · Digital Society · doi:10.1007/s44206-022-00022-2 · Cited by 88
“Artificial intelligence (AI), which refers to both a research field and a set of technologies, is rapidly growing and has already spread to application areas ranging from policing to healthcare and transport (e.g. Rezende, 2020; Stilgoe, 2018; Trocin et al., 2021).”
BackgroundGeorgieva, I., Lazo, C., Timan, T., & van Veenstra, A. F. (2022) · AI and Ethics · doi:10.1007/s43681-021-00127-3 · Cited by 89
“1 The third wave of scholarship on ethical AI, which builds on the first two by exploring how to turn AI principles into actionable data science practice and governance (see for instance [10, 12, 24, 29, 62]), examines as such the spectrum of applicability of AI ethics in real-world cases [45], highlights issues of st…”
BackgroundSarker, I. H. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00129-0 · Cited by 140
“Researchers also need to give priority to creating frameworks for responsible model governance, which requires establishing explicit procedures for addressing ethical concerns, ensuring compliance with regulatory standards, and promoting responsible data management practices [13, 14].”
Bao, Y., Gong, W., & Yang, K. (2023) · Systems · doi:10.3390/systems11090442 · Cited by 80
“By eliminating human biases, AI-driven decisions tend to be more objective and impartial, leading to fairer outcomes [90].”
Behera, R. K., Bala, P. K., Rana, N. P., & Kizgin, H. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.11.070 · Cited by 113
“To eliminate biases, there is a need to improve fairness and equality, and to further assist in the interpretation of findings (Trocin et al., 2021).”
BackgroundMinkkinen, M., Zimmer, M. P., & Mäntymäki, M. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10269-2 · Cited by 93
“At an organizational level, the socially responsible use of AI requires the appropriate design, implementation, and use of AI systems (Kumar et al., 2021; Rakova et al., 2021; Trocin et al., 2021) in addition to ethical guidelines and governance approaches (Dig-num, 2020; Jobin et al., 2019).”
BackgroundMethodInfluentialLämmermann, L., Hofmann, P., & Urbach, N. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102728 · Cited by 93
“Particularly, the current discourse around responsible AI in healthcare underpins the relevance of ethical and robust AI management (Kumar et al., 2021; Trocin et al., 2021).”
BackgroundResultMajeed, A., & Hwang, S. O. (2021) · Symmetry · doi:10.3390/sym14010016 · Cited by 103
“With the help of precise forecasting, extra care can be provided to the vulnerable people having underlying diseases, and treatment can be done on the regular basis [22,23].”
BackgroundSarno, L. D., Caroselli, A., Tonin, G., Graglia, B., Pansini, V., Causio, F. A., Gatto, A., & Chiaretti, A. (2024) · Biomedicines · doi:10.3390/biomedicines12061220 · Cited by 67
“It involves the moral accountability of state-of-the-art technologies [116].”
An Assessment of the Barriers Impacting Responsible Artificial Intelligence
Merhi, M. I. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10276-3 · Cited by 69
“The quality of the data can also cause injustice and bias especially if the data are fabricated or modified (Trocin et al., 2021).”
BackgroundMethodInfluentialPal, A., Wangmo, T., Bharadia, T., Ahmed-Richards, M., Bhanderi, M., Kachhadiya, R., Allemann, S. S., & Elger, B. S. (2025) · Patient Preference and Adherence · doi:10.2147/ppa.s527922 · Cited by 63
“4 75 Developers could consider designing a second layer of a “bias detective gAI/LLM”, which will verify the output generated by the first gAI/LLM against a valid information source.”
Mutuality in AI-enabled new public service solutions
Koskimies, E., & Kinder, T. (2022) · Public Management Review · doi:10.1080/14719037.2022.2078501 · Cited by 63
“Trocin et al. (2021) draws attention to misinterpretations and fuzzy meanings while allowing the emergence of new factors and causal relationships.”
BackgroundMethodInfluentialKushwaha, A. K., Pharswan, R., Kumar, P., & Kar, A. K. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10293-2 · Cited by 58
“Unlike conventional technologies, AI model algorithms used for decision-making are highly complicated and opaque in most cases (Mikalef & Gupta, 2021; Trocin et al., 2021).”
MethodResponsible Artificial Intelligence (AI) for digital health and medical analytics.
Sivarajah, U., Wang, Y., Olya, H., & Mathew, S. (2023) · Information Systems Frontiers · doi:10.1007/s10796-023-10412-7 · Cited by 36
“In addition, the research by Wang et al. (2023) has revealed that “techno-overload” can impact healthcare practitioners’ attitudes and usage intentions.”
BackgroundSync fast and solve things-best practices for responsible digital health
Landers, C., Blasimme, A., & Vayena, E. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01105-9 · Cited by 35
“However, the adoption of responsible digital health principles in practice lags far behind their almost universal acceptance 2,3,7 .”
BackgroundRAISE: leveraging responsible AI for service excellence
Alkire, L., Bilgihan, A., Bui, M., Buoye, A. J., Doğan, S., & Kim, S. (2024) · Journal of service management · doi:10.1108/josm-11-2023-0448 · Cited by 42
Stuck in translation: Stakeholder perspectives on impediments to responsible digital health
Landers, C., Vayena, E., Amann, J., & Blasimme, A. (2023) · Frontiers in Digital Health · doi:10.3389/fdgth.2023.1069410 · Cited by 45
“As digital technologies permeate and disrupt healthcare, they fuel concerns around privacy, justice, security, trust, and accountability (9, 11, 14).”
BackgroundA Systematic Review of Responsible Artificial Intelligence Principles and Practice
Gunasekara, L., El-Haber, N., Nagpal, S., Moraliyage, H., Issadeen, Z., Manic, M., & Silva, D. D. (2025) · Applied System Innovation · doi:10.3390/asi8040097 · Cited by 70
Digital Transformation in Norwegian Enterprises
Mikalef, P., & Parmiggiani, E. (2022) · Springer eBooks · doi:10.1007/978-3-031-05276-7 · Cited by 60
Self-citationVirmani, N., Singh, R. K., Agarwal, V., & Aktaş, E. (2024) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2024.3370377 · Cited by 37
“Furthermore, Trocin et al. [73] discussed that responsible AI ensures transparent, unbiased, and indiscriminate results.”
Hani, I. B., Alawadi, S., & Mrayyan, N. E. (2024) · Journal of Decision System · doi:10.1080/12460125.2024.2349425 · Cited by 49
“To this end, the literature is offering a notion of ‘responsible AI’ calling for the design, implementation, and use of ethical, transparent, and accountable AI technology (Trocin et al., 2023).”
Ferdowsi, M., Hasan, M., & Habib, W. (2024) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2024.108289 · Cited by 42
Stieglitz, S., Mirbabaie, M., Möllmann, N. R. J., & Rzyski, J. (2021) · Information Systems Frontiers · doi:10.1007/s10796-021-10201-0 · Cited by 50
“Employees no longer identifying themselves with a decision made by a VA, not questioning or taking responsibility for it, which possibly means making poor or even wrong choices (Trocin et al., 2021).”
BackgroundBehl, A., Sampat, B. H., Pereira, V. E., & Jabbour, C. J. C. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05624-8 · Cited by 50
“Accountable models help reduce biases, promoting fairness to ensure that the outcomes obtained are explainable and accountable (Trocin et al., 2021); this can help improve SC coordination.”
Usmani, U. A., Happonen, A., & Watada, J. (2022) · Lecture notes in networks and systems · doi:10.1007/978-3-031-18461-1_19 · Cited by 44
State-of-the-Art in Responsible, Explainable, and Fair AI for Medical Image Analysis
Amirian, S., Gao, F., Littlefield, N. G., Hill, J. H., Yates, A. J., Plate, J. F., Pantanowitz, L., Rashidi, H. H., & Tafti, A. P. (2025) · IEEE Access · doi:10.1109/access.2025.3555543 · Cited by 37
“This includes maintaining detailed records of data sources, core functionalities of the system, training procedures, AI model parameters, and validation strategies [5], [97], [98].”
Recommendations for Successful Development and Implementation of Digital Health Technology Tools
Loo, R. T. J., Nasta, F., Macchi, M., Baudot, A., Burstein, F. V., Bove, R. M., Greve, M., Fröhlich, H., Khalid, S., Küderle, A., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/56747 · Cited by 45
“Finally, developers need to adopt responsible AI practices such as bias detection, algorithmic impact assessments, and transparency to evaluate risks and mitigate biases [66], and there should be human oversight of any automated decisions [67].”
A systematic review of early evidence on generative AI for drafting responses to patient messages
Hu, D., Guo, Y., Zhou, Y., Flores, L., & Zheng, K. (2025) · npj Health Systems · doi:10.1038/s44401-025-00032-5 · Cited by 40
“Atthesametime, researchers, healthsystem leaders, and policymakers should work to establish clear governance frameworks for AI-assisted messaging in response to ongoing calls for responsible AI in healthcare 63,64 .”
A Responsible AI Framework for Mitigating the Ramifications of the Organ Donation Crisis
Tutun, S., Harfouche, A., Albizri, A., Johnson, M., & He, H. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10340-y · Cited by 35
“Therefore, there is an urgent need to reframe AI design to include the ethical implications that affect the choice of data, algorithm type, and evaluation of the output to be more explicitly value-laden (Liu et al., 2021; Martin, 2018; Trocin et al., 2021).”
BackgroundLeverage zones in Responsible AI: towards a systems thinking conceptualization
Nabavi, E., & Browne, C. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01579-0 · Cited by 40
“Research into implications of AI can be seen in fi elds as diverse as health (Gupta et al., 2021; Trocin et al., 2021), fi nance (Maree et al., 2020), urban studies (Yigitcanlar et al., 2021), conservation science (Wearn et al., 2019), marketing (Liu et al., 2021), and military affairs…”
BackgroundOperationalising fairness in medical AI adoption: detection of early Alzheimer’s disease with 2D CNN
Heising, L. M., & Angelopoulos, S. P. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100485 · Cited by 35
“Finally, our work is in line with the broader Information Systems research agenda, 22 on the adoption of responsible medical AI algorithms, 23 and the stewardship of sensitive personal data.”
ResultNavigating Bias and Fairness in Digital AI Systems
Tariq, M. U. (2024) · Advances in human and social aspects of technology book series · doi:10.4018/979-8-3693-4147-6.ch006 · Cited by 31
Are we justified attributing a mistake in diagnosis to an AI diagnostic system?
Babushkina, D. (2022) · AI and Ethics · doi:10.1007/s43681-022-00189-x · Cited by 30
Kanungo, R. P., Liu, R., & Gupta, S. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2024.114788 · Cited by 29
Jawad, K. M. T., Verma, A., Amsaad, F., & Ashraf, L. (2025) · IEEE Access · doi:10.1109/access.2025.3535692 · Cited by 55
“It is highly critical to develop responsible practices of AI applications as patient health, hospital staff trust everything becomes at a stake based on the applications [17].”
Being Responsible in Cybersecurity: A Multi-Layered Perspective
Panteli, N., Nthubu, B. R., & Mersinas, K. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10588-0 · Cited by 39
“Literature on responsible digital technologies has discussed ethical challenges such as bias reinforcement, lack of transparency and the need for regulation (Trocin et al., 2023).”
User Privacy, Surveillance and Public Health during COVID-19 – An Examination of Twitterverse
Bhatt, P., Vemprala, N., Valecha, R., Hariharan, G., & Rao, H. R. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10247-8 · Cited by 27
Predictive Artificial Intelligence Model for Detecting Dental Age Using Panoramic Radiograph Images
Aljameel, S. S., Althumairy, L., Albassam, B., Alsheikh, G., Albluwi, L., Althukair, R., Alhareky, M. S., Alamri, A. A., Alabdan, A., & Shahin, S. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010008 · Cited by 23
Wójcik, Z., Dimitrova, V. G., Warrington, L., Velikova, G., & Absolom, K. L. (2025) · Health and Quality of Life Outcomes · doi:10.1186/s12955-025-02365-z · Cited by 28
“Furthermore, studies often lack reproducibility, external validity [12], and generalisability of the results to the clinical context [10].”
Agbese, M., Alanen, H.-K., Antikainen, J., Halme, E., Isomaki, H., Jantunen, M., Kemell, K., Rousi, R. A., Vainio-Pekka, H., & Vakkur, V. (2023) · e-Informatica Software Engineering Journal · doi:10.37190/e-inf230101 · Cited by 30
Utilizing artificial intelligence for environmental sustainability
Mumtaz, N., Izhar, T., Pandey, G., & Labhasetwar, P. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-90396-7.00010-9 · Cited by 24
A scoping review of explainable artificial intelligence in sports science
Kranzinger, S., Halmich, C., Hofer, D., & Kranzinger, C. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00709-8 · Cited by 26
“Insights from fields like healthcare underline the necessity for strict regulatory oversight and responsible frameworks to ensure AI-driven solutions are sustainably developed and ethically sound [7].”
An Integrative Theoretical Framework for Responsible Artificial Intelligence
Haidar, A. (2023) · International Journal of Digital Strategy Governance and Business Transformation · doi:10.4018/ijdsgbt.334844 · Cited by 38
Leveraging responsible artificial intelligence to enhance salespeople well-being and performance
Weng, C., Yuan, R., Ye, D., Huang, B., & Xun, J. (2024) · Service Industries Journal · doi:10.1080/02642069.2024.2361291 · Cited by 23
“Given the accountability and explainability a ff orded by responsible data and AI algorithms (Trocin et al., 2021), nuanced and responsive moral reasoning needs to occur to ensure organizations are more inclined to foster ethics of care.”
Leveraging AI-Enabled Information Systems for Healthcare Management
Amiri, Z. (2024) · Journal of Computer Information Systems · doi:10.1080/08874417.2024.2414216 · Cited by 37
Passlack, N., Hammerschmidt, T., & Posegga, O. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2431050 · Cited by 19
Ye, D., Yuan, R., Luo, J., Liu, M. J., & Yannopoulou, N. (2025) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2025.124349 · Cited by 27
Capitalization of digital healthcare: The cornerstone of emerging medical practices
Hazra, S., & Bora, K. S. (2025) · Intelligent Pharmacy · doi:10.1016/j.ipha.2024.12.002 · Cited by 31
Exploring the impact of responsible AI usage on users’ behavioral intentions
Chedrawi, C., Haddad, G., Tarhini, A. A., Osta, S., & Kazoun, N. (2025) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2025.100813 · Cited by 23
Artificial Intelligence in Healthcare: ChatGPT and Beyond
Hulsen, T. (2024) · AI · doi:10.3390/ai5020028 · Cited by 22
Cano, A. M. C. (2023) · LatIA · doi:10.62486/latia20233 · Cited by 22
Application of artificial intelligence in medical education: A meta-ethnographic synthesis
Li, W., Shi, H.-Y., Chen, X.-L., Lan, J., Rehman, A.-U., Ge, M., Shen, L.-T., Hu, F., Jia, Y., Li, X., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2418936 · Cited by 21
“Researchers contend that healthcare providers must be accountable for harm caused by misinterpreting AI-generated information or advice, as they are obliged to independently evaluate AI outputs [68].”
Governance of High-Risk AI Systems in Healthcare and Credit Scoring
Bartsch, S. C., Behn, O., Benlian, A., Brownsword, R., Bücker, S., Düwell, M., Formánek, N., Jungtäubl, M., Leyer, M., Richter, A., et al. (2025) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00944-4 · Cited by 29
Health Technology Assessment for In Silico Medicine: Social, Ethical and Legal Aspects
Leo, C. G., Tumolo, M. R., Sabina, S., Colella, R., Recchia, V., Ponzini, G., Fotiadis, D. I., Bodini, A., & Mincarone, P. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19031510 · Cited by 18
“In silico models could adopt algorithms for data analysis that may not meet the transparency standards of evidence-based medicine (a phenomenon referred to as black-box medicine) [44], and information could hardly be conveyed in a consistent manner with the patient’s language of preference and culture [45].”
Responsibility, Recourse, and Redress: A Focus on the Three R’s of AI Ethics
Gardner, A. (2022) · IEEE Technology and Society Magazine · doi:10.1109/mts.2022.3173342 · Cited by 16
Talking Ethics Early in Health Data Public Private Partnerships
Landers, C., Ormond, K. E., Blasimme, A., Brall, C., & Vayena, E. (2023) · Journal of Business Ethics · doi:10.1007/s10551-023-05425-w · Cited by 22
“In the context of digital health or AI in medicine, for instance, ethical principles have been articulated, but practitioners have not crossed the translational chasm of implementing these in practice (Landers et al., 2023; Trocin et al., 2021; Vayena et al., 2018).”
BackgroundAre we Nearly There Yet? A Desires & Realities Framework for Europe’s AI Strategy
Polyviou, A., & Zamani, E. D. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10285-2 · Cited by 17
“AI’s black-boxed algorithms need to be scrutinised carefully and regulated so that we can shift beyond the risks of uncontrolled algorithms and towards a trustworthy AI (Trocin et al., 2021).”
BackgroundBaker, S., & Xiang, W. (2023) · arXiv · doi:10.48550/arxiv.2312.01555 · Cited by 12
“RAI is fundamentally the field of applying ethics to the development and utilization of AI, to ensure that AI systems and used for the good of humanity [10, 137].”
BackgroundPasslack, N., Hammerschmidt, T., & Posegga, O. (2026) · Information Systems Frontiers · doi:10.1007/s10796-025-10648-5 · Cited by 12
Elwahsh, S., Stern, N., Singh, A., & Ayobi, A. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736615 · Cited by 24
Responsible artificial intelligence for measuring efficiency: a neural production specification
Konstantakis, K. Ν., Michaelides, P. G., Xidonas, P., Prelorentzos, A. N., & Samitas, A. (2024) · Annals of Operations Research · doi:10.1007/s10479-024-05929-2 · Cited by 13
“Forinstance, Trocinetal.”
Artificial Intelligence in Medical Metaverse: Applications, Challenges, and Future Prospects
Yang, J., Chen, B., Li, R., Huang, B.-Q., Zhao, M.-H., Liu, P., Zhang, J., & Ye, Z. (2024) · Current Medical Science · doi:10.1007/s11596-024-2960-5 · Cited by 15
“In the current situation where population aging is increasingly evident and healthcare systems are under immense pressure, the existence of the medical metaverse becomes even more crucial [95] .”
Nadeem, W., Ashraf, A. R., Khan, H., & Kumar, V. (2025) · Technovation · doi:10.1016/j.technovation.2025.103390 · Cited by 15
Singh, A. K., Sharma, K. K., Bajpai, M. K., & Cabezuelo, A. S. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112374 · Cited by 12
Fairness Concerns in App Reviews: A Study on AI-Based Mobile Apps
Nasab, A. R., Dashti, M., Shahin, M., Zahedi, M., Khalajzadeh, H., Arora, C., & Liang, P. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3690633 · Cited by 29
“Additionally, a fairness review can reflect users’ perceptions that the outcomes of AI-based apps, or the decisions and policies of the app owners, are inconsistent, non-transparent, and unreasonable.”
BackgroundUrban, I., & Plattfaut, R. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10610-5 · Cited by 20
A socio-technical framework for AI trust in public administration
Tsarouhas, P., & Grigoriadis, K. (2025) · Transforming Government People Process and Policy · doi:10.1108/tg-06-2025-0157 · Cited by 23
Esteban, C. L. (2023) · Ediciones Universidad de Salamanca eBooks · doi:10.14201/0aq0347 · Cited by 17
Bakker, L. J., Aarts, J. E. C. M., Groot, C. A. U., & Redekop, K. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01682-9 · Cited by 14
“In recent years, there has been an increased interest in the ethical challenges that we face relating to the adoption of artificial intelligence [70].”
BackgroundEthics Concerns in the Use of Computer-Generated Images for Human Communication
Simões, J. M., & Caldeira, W. G. (2024) · Journal of Ethics in Higher Education · doi:10.26034/fr.jehe.2024.5962 · Cited by 8
Bakidou, A., Caragounis, E.-C., Hagiwara, M. A., Jönsson, A., Sjöqvist, B. A., & Candefjord, S. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02290-5 · Cited by 12
“The long-term ambition is to provide a responsible and explainable [27] data-driven prehospital injury severity classification model for real-time assessment of patients to support prehospital decision making.”
BackgroundBartenschlager, C. C., Gassner, U. M., Römmele, C., Brunner, J. O., Schlögl-Flierl, K., & Ziethmann, P. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102873 · Cited by 12
Ethical and Regulatory Considerations
Seeram, E., & Kanade, V. A. (2024) · Springer eBooks · doi:10.1007/978-3-031-64049-0_9 · Cited by 11
Ferraz, V., Houf, L., Pitz, T., Schwieren, C., & Sickmann, J. (2024) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2024.100578 · Cited by 15
Valli, A. D., Tingle, S. J., Kazerouni, S., Kalpana, T. S. R., Karki, B. B., Knight, S. R., Wilson, C. H., & Kourounis, G. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.103836 · Cited by 10
Explainable AI in Disease Diagnosis
Bedi, P., Thukral, A., & Dhiman, S. (2024) · Computational intelligence methods and applications · doi:10.1007/978-981-97-3705-5_5 · Cited by 8
Responsible Digital: Co-Creating Safe, Wise and Secure Digital Interventions with Vulnerable Groups
Lorini, M. R., Harindranath, G., & Unwin, T. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10611-4 · Cited by 7
Artificial intelligence driven dynamic capabilities: unpacking micro-foundational mechanisms
Shahzad, F., & Ferreira, J. J. M. (2026) · Management Decision · doi:10.1108/md-07-2025-2141 · Cited by 18
Germanov, N. S. (2023) · Digital Diagnostics · doi:10.17816/dd430334 · Cited by 9
Tomczyk, P., Brüggemann, P., & Doligalski, T. (2024) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213024500234 · Cited by 8
Factoring ethics in management algorithms for municipal information-analytical systems
Sergei, K., Kriebitz, A., Polina, E., & Aleksandrov, N. (2021) · AI and Ethics · doi:10.1007/s43681-021-00098-5 · Cited by 8
“…the benefits AI provides in terms of data processing and decision-making support, the matter of responsibility still remains, since the mass introduction of AI has already begun in key areas, such as healthcare, where defects are unacceptable and human control of AI is so far inevitable [27].”
Background
Metadata
- Authors
- Trocin, C., Mikalef, P., Papamitsiou, Z., & Conboy, K.
- Affiliations
- Norwegian University of Science and Technology (NO)
- Ollscoil na Gaillimhe – University of Galway (IE)
- Corresponding author
- Trocin, Cristina
- Venue
- Information Systems Frontiers
- Published
- 2021-06-26
- Volume
- 25
- Issue
- 6
- Pages
- 2139-2157
- ISSN
- 1387-3326 (ISSN-L)
- 1572-9419
- OpenAlex
- W3173496715
- Cited by
- 205
- References
- 86
- Citations by year
- 2026: 36 · 2025: 56 · 2024: 48 · 2023: 30 · 2022: 24 · 2021: 11
- FWCI
- 35.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Information Systems Frontiers (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- Newcastle University ePrints (Newcastle Univesity) (cc-by)
- Funders
- European Research Consortium for Informatics and Mathematics
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- responsible AI, digital health, health AI, algorithmic bias, fairness, transparency, accountability, explainability, interpretability, AI ethics, research agenda
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.