A Review of Trustworthy and Explainable Artificial Intelligence (XAI)
Open accessThe DOI matches its Crossref record; 113 of the 122 references it cites were found in a registry or an index; 52 of the 152 sources its claims cite were checked for support.
Abstract
The advancement of Artificial Intelligence (AI) technology has accelerated the development of several systems that are elicited from it. This boom has made the systems vulnerable to security attacks and allows considerable bias in order to handle errors in the system. This puts humans at risk and leaves machines, robots, and data defenseless. Trustworthy AI (TAI) guarantees human value and the environment. In this paper, we present a comprehensive review of the state-of-the-art on how to build a Trustworthy and eXplainable AI, taking into account that AI is a black box with little insight into its underlying structure. The paper also discusses various TAI components, their corresponding bias, and inclinations that make the system unreliable. The study also discusses the necessity for TAI in many verticals, including banking, healthcare, autonomous system, and IoT. We unite the ways of building trust in all fragmented areas of data protection, pricing, expense, reliability, assurance, and decision-making processes utilizing TAI in several diverse industries and to differing degrees. It also emphasizes the importance of transparent and post hoc explanation models in the construction of an eXplainable AI and lists the potential drawbacks and pitfalls of building eXplainable AI. Finally, the policies for developing TAI in the autonomous vehicle construction sectors are thoroughly examined and eclectic ways of building a reliable, interpretable, eXplainable, and Trustworthy AI sys…
Overview
CoChat Summary
TL;DR
This review surveys trustworthy AI (TAI) and explainable AI (XAI), covering the European Commission’s seven TAI criteria, XAI methods, and applications in healthcare, banking/commerce, IoT, and autonomous systems. It argues that trustworthiness and explainability are increasingly necessary as AI systems become more autonomous and opaque, while identifying unresolved technical and governance challenges.
Key findings
- The paper reports that more than 70% of individuals in a cited University of Queensland study had neutral or no confidence in AI systems, leaving the total proportion of trustworthiness in AI systems at just a quarter; the public was more trusting and supportive of AI use in healthcare.
- It cites AI investment growth from $37.5 billion in 2019 to $97.9 billion in 2023, and a worldwide AI software market value of over $126 billion by 2025; in healthcare, AI is estimated to potentially address 20% of all clinical needs.
- For autonomous vehicles, the paper cites an automotive intelligent hardware/technology/operations market expanding from $1.25 billion in 2017 to $28.5 billion by 2025, and Intel’s analysis that automated cars could save 250 million hours of commuters’ annual travel time and more than 500,000 lives in the USA between 2035–2045.
- The review organizes TAI around seven EC criteria—human agency and oversight, robustness and safety, privacy and data governance, transparency, diversity and fairness, societal and environmental well-being, and accountability—and divides XAI work into transparency design and post-hoc explanation, with global and local methods.
Methods
- Design: a comprehensive narrative review/survey of TAI and XAI, not an empirical study; it synthesizes prior literature, regulations, taxonomies, and sector-specific examples.
- Data/sample: no primary dataset or experimental sample is reported; the paper draws on cited studies, EC/GDPR materials, and application examples in healthcare, banking/commerce, IoT, and autonomous systems.
- Main analysis: conceptual and taxonomic synthesis, including the seven TAI criteria, XAI categories such as transparent design versus post-hoc explanation, global versus local methods, and tables summarizing XAI research for autonomous systems.
Limitations
- The paper states that significant constraints remain: replicability of post-hoc explainability methodologies, absence of a unified understanding/criteria/metrics for interpretability, friction between efficiency and predictability, and limitations in explaining deep neural networks.
- Evident from the text: as a review, it does not report a systematic search strategy, inclusion/exclusion criteria, or quantitative meta-analysis, and it presents no primary empirical validation of the reviewed TAI/XAI approaches.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
29 Valid · 13 Not valid · 59 Not checked · 38 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Any errors by AI or the human involved in the creation of the AI, could lead to loss of lives [30], [33], [34].”
What the sources say
- Could not verifycites [30] [30] D. Paul, G. Sanap, S. Shenoy, D. Kalyane, K. Kalia, and R. K. Tekade, ''Artificial intelligence in drug discovery and development,'' Drug Discovery Today , vol. 26, no. 1, pp. 80-93, Jan. 2021. - sourceExperimental — accuracy not yet measured
The ‘Ongoing challenges in adopting AI’ section discusses data quality, inaccurate predictions, and the need for human intervention, but does not say that AI or human errors could cause loss of life. A further search for fatal errors, patient deaths, and related harms found no passage addressing that consequence. No page numbers were available in our copy. (LLM, conf=0.75)
- Not checked — no full text of the sourcecites [33] [33] T. Grote, ''Trustworthy medical AI systems need to know when they don't know,'' J. Med. Ethics , vol. 47, no. 5, pp. 337-338, 2021. [Online]. Available: https://jme.bmj.com/content/47/5/337 - source
- Not checked — no full text of the sourcecites [34] [34] E. J. Topol, ''High-performance medicine: The convergence of human and artificial intelligence,'' Nature Med. , vol. 25, no. 1, pp. 44-56, Jan. 2019, doi: 10.1038/s41591-018-0300-7. - source
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Based in the existing research summarized in Table 2, it can be concluded that XAI for autonomous systems is a catalogue of AI-driven methodologies that (1) guarantee a plausible degree of safety for a vehicle's major decisions, (2) offer rationales and accountability on the intervention choices in crucial traffic situations, and (3) follow all traffic regulations set forth by the law enforcement”
What the sources say
- Supportedcites [79] [79] S. Atakishiyev, M. Salameh, H. Yao, and R. Goebel, ''Explainable artificial intelligence for autonomous driving: A comprehensive overview and field guide for future research directions,'' 2021, arXiv:2112.11561 . - source
The proposed framework’s explanation component must justify an autonomous car’s actions and communicate that reasoning to users (framework discussion, p. 12). The survey also describes scenario-based explanations serving accountability goals (Section 4.5, p. 9), while the framework discusses timely explanations around hazardous situations and human intervention (p. 12). (LLM, conf=0.87)
- Partly supportedcites [103] [103] U. Ehsan and M. O. Riedl, ''Human-centered explainable AI: Towards a reflective sociotechnical approach,'' 2020, arXiv:2002.01092 . <!-- image --> VINAY CHAMOLA (Senior Member, IEEE) received the B.E. degree in electrical and electronics engineering and the master's degree in communication engineering from the Birla Institute of Technology and Science (BITS), Pilani, India, in 2010 and 2013, respectively, and the Ph.D. degree in electrical and computer engineering from the National University of Singapore, Singapore, in 2016. In 2015, he was a Visiting Researcher with the Autonomous Netw sourceExperimental — accuracy not yet measured
The Introduction (p. 1) defines XAI as providing human-understandable justifications, and the case study (pp. 3, 7) generates rationales for an AI agent avoiding traffic in the game Frogger. The paper mentions self-driving cars as an example of differing explanation needs (Introduction, p. 2), but does not establish that XAI provides accountability for autonomous vehicles’ intervention choices in crucial real-world traffic situations. (LLM, conf=0.86)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Local models expressed as a sequential function of input variables can be more efficient than model simulations because limited segments of the system are more inclined to be continuous [52], [55].”
What the sources say
- Could not verifycites [52] [52] M. Nassar, K. Salah, M. H. U. Rehman, and D. Svetinovic, ''Blockchain for explainable and trustworthy artificial intelligence,'' WIREs Data Mining Knowl. Discovery , vol. 10, no. 1, pp. 1-12, Oct. 2019, doi: 10.1002/widm.1340. - sourceExperimental — accuracy not yet measured
Across the prompt passages and four further searches (local/sequential function models vs simulations; continuity of limited segments; simulation and interpolation; efficiency comparisons), our copy of Marcus (2020) never addresses local models expressed as a sequential function of input variables being cheaper than running model simulations, nor any rationale based on limited segments of a system being more continuous. The nearest material is the footnote to 2.1.5 Summary (p. 23), which speculates only that 'some low-level neural network-like computations might conceivably be more efficiently computed at a purely symbolic level', and 2.1.1 (p. 14) on operations over variables versus learned function approximation — both about symbolic vs neural implementation, not about surrogate/local models vs simulations. Since our copy does not treat the claim's point at all (and does not contradict it), attribution here cannot be checked. (LLM, conf=0.70)
- Partly supportedcites [55] [55] N. Burkart and M. F. Huber, ''A survey on the explainability of supervised machine learning,'' J. Artif. Intell. Res. , vol. 70, pp. 245-317, Jan. 2021, doi: 10.1613/jair.1.12228. - sourceExperimental — accuracy not yet measured
Section 3.2.3 (p. 11) distinguishes local surrogates, which are valid near one prediction, from global surrogates, which simulate all predictions of a black-box model. It does not say that local models are more efficient, describe them as sequential functions of input variables, or attribute an advantage to local continuity. (LLM, conf=0.80)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Based in the existing research summarized in Table 2, it can be concluded that XAI for autonomous systems is a catalogue of AI-driven methodologies that (1) guarantee a plausible degree of safety for a vehicle's major decisions, (2) offer rationales and accountability on the intervention choices in crucial traffic situations, and (3) follow all traffic regulations set forth by the law enforcement”
What the sources say
- Partly supportedcites [79] [79] S. Atakishiyev, M. Salameh, H. Yao, and R. Goebel, ''Explainable artificial intelligence for autonomous driving: A comprehensive overview and field guide for future research directions,'' 2021, arXiv:2112.11561 . - sourceExperimental — accuracy not yet measured
Our copy supports only the general idea that regulatory compliance belongs to XAI for AVs: Section 5 (p. 11) states 'These steps are aligned with our observation regarding the role of XAI in confirming regulatory compliance', and the Conclusion (p. 15) says AVs 'need to achieve regulatory-compliant operational safety and explainability in real-time decisions'. It does not, however, define XAI as a catalogue of methodologies that 'follow all traffic regulations': Section 2.3 (p. 3) attributes law-enforcement compliance to the vehicles, noting that organizations 'proposed guidelines on the regulation of AVs to monitor their compliance with law enforcement' (NACTO, NHTSA, Transport Canada, etc.), alongside ISO 26262/21448 standards and GDPR rather than traffic regulations as such. The three-part definitional framing is the citing authors' own synthesis of their Table 2; the source supplies the compliance requirement, not the guarantee that XAI methods obey all traffic regulations. (LLM, conf=0.68)
- Could not verifycites [103] [103] U. Ehsan and M. O. Riedl, ''Human-centered explainable AI: Towards a reflective sociotechnical approach,'' 2020, arXiv:2002.01092 . <!-- image --> VINAY CHAMOLA (Senior Member, IEEE) received the B.E. degree in electrical and electronics engineering and the master's degree in communication engineering from the Birla Institute of Technology and Science (BITS), Pilani, India, in 2010 and 2013, respectively, and the Ph.D. degree in electrical and computer engineering from the National University of Singapore, Singapore, in 2016. In 2015, he was a Visiting Researcher with the Autonomous Netw sourceExperimental — accuracy not yet measured
The Introduction (pp. 1–2) defines XAI and mentions self-driving cars only as an example of differing explanation needs. The case study (p. 3) concerns an agent playing Frogger. A search for traffic regulations, law enforcement, and autonomous-vehicle compliance found no passage saying that XAI systems follow traffic laws. (LLM, conf=0.76)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The entire calculation process is transformed into a ''black box,'' which is incredibly challenging to understand [28].”
What the sources say
- Supportedcites [28] [28] R. Guidotti, A. Monreale, S. Ruggieri, F. Turini, F. Giannotti, and D. Pedreschi, ''A survey of methods for explaining black box models,'' ACM Comput. Surv. , vol. 51, no. 5, pp. 1-42, Sep. 2019, doi: 10.1145/3236009. - source
The Reverse Engineering section (p. 19) describes a black-box predictor whose inputs and outputs can be observed but whose internal workings cannot be directly seen. The Needs for Interpretable Models section (p. 3) likewise treats decisions made by black boxes as difficult to interpret. These passages support the citing sentence’s broad characterization, though “transformed” is its own metaphor. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
28 more claims · 12 with their cited sources checked
Create a free account to see all 139 claims and to verify the 22 references still open.
- Probably not a substantial claim. 101
- It may state two separate claims as one. 36
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Although the black box problem presents a challenge to trusting AI by limiting our ability to understand how AI works, most AI ethicists argue that this problem can be adequately dealt with by making AI more explainable, which involves disclosing details about how an AI system operates, such as its training data, algorithms, architecture and so on31 [5, 147].”
From Autonomous artificial intelligence, scientific research, and human values (2026) · cites this paper as [147]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ D. EXPLAINABLE AI FOR AUTONOMOUS SYSTEMS · p. 18
“A semantic segmentation paradigm that is executed like a pixel-by-pixel categorization has been suggested by Hofmarcher et al. to explicate the fundamental legitimate sense of the surroundings [84].”
§ REFERENCES · p. 21
“- [84] H. He, J. Gray, A. Cangelosi, Q. Meng, T. M. McGinnity, and J. Mehnen, ''The challenges and opportunities of artificial intelligence for trustworthy robots and autonomous systems,'' in Proc. 3rd Int. Conf. Intell. Robotic Control Eng. (IRCE) , Aug. 2020, pp. 68-74.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ I. INTRODUCTION · p. 4
“Section V sums up the challenges in current streams and highlights a perspective on achieving TAI for various organizations.”
§ V. ADVANCEMENTS AND PROGRESS OF TAI IN VARIOUS FIELDS · p. 13
“## V. ADVANCEMENTS AND PROGRESS OF TAI IN VARIOUS FIELDS”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ I. INTRODUCTION · p. 4
“future goals and needs, and how trust and explainability is the pressing priority for upcoming AI systems have been covered in Section VI, followed by the concluding remarks in Section VII.”
§ VI. CONCLUSION · p. 19
“## VI. CONCLUSION”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ D. EXPLAINABLE AI FOR AUTONOMOUS SYSTEMS · p. 18
“| [101] | 2021 | Creating causal inferences both in and out of tree-based interpretations”
§ REFERENCES · p. 21
“- [101] H. Krasowski, X. Wang, and M. Althoff, ''Safe reinforcement learning for autonomous lane changing using set-based prediction,'' in Proc. IEEE 23rd Int. Conf. Intell. Transp. Syst. (ITSC) , Sep. 2020, pp. 1-7.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ D. EXPLAINABLE AI FOR AUTONOMOUS SYSTEMS · p. 17
“A methodology for examining how a sequence of pixel intensities influences the CNN's forecasting, called Visual-Back Propagation is presented in [94].”
§ REFERENCES · p. 21
“- [94] M. Hofmarcher, T. Unterthiner, J. Arjona-Medina, G. Klambauer, S. Hochreiter, and B. Nessler, ''Visual scene understanding for autonomous driving using semantic segmentation,'' in Explainable AI: Interpreting, Explaining and Visualizing Deep Learning . Springer, 2019, pp. 285-296.”
2 more findings
Create a free account to see every finding of this check.
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“categorization further and farther [68], [70], [71].”
Cited work 10.1155/2022/4189781 · retracted 2023-10-18 · notice 10.1155/2023/9890389 · this paper published 2023
Citations
Cites
1 retracted
U-Net-Based Medical Image Segmentation
Yin, X.-X., Sun, L., Fu, Y., Lu, R., & Zhang, Y. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/4189781 · Cited by 318 · cited 1×
“categorization further and farther [68], [70], [71].”
RetractedMastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612 · cited 3×
“In that tournament, Lee beat AlphaGo only once in the five matches [2].”
BackgroundLearning Deep Features for Discriminative Localization
Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.319 · Cited by 11,428 · cited 1×
“In reality, it’s worth emphasizing that such a form of rationalization is applicable to a wide range of autonomous system scenarios [79], [91].”
BackgroundArrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 2×
“Any errors by AI or the human involved in the creation of the AI, could lead to loss of lives [30], [33], [34].”
BackgroundBarredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · cited 2×
“The transparency structure divulges how a model functions [48], [49].”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · cited 5×
“…that categorise instances based on certain measure of similarity (such as K-nearest neighbours, K-means, and SVM), as the methodology is intuitive: locate the datum that would be the most parallel to the one presumed, and allocate the aforementioned to the very same category as the latter [48].”
BackgroundMethodInfluentialMachine learning: Algorithms, real-world applications and research directions
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00592-x · Cited by 5,583 · cited 1×
“now is highly unjust and excessive [8].”
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427 · cited 1×
“Furthermore, the controllers facilitate widespread adoption sans jeopardizing the terminal interface, which will boost efficiency and productivity [62], [63].”
BackgroundImage segmentation using deep learning: A survey
Minaee, S., Boykov, Y. Y., Porikli, F., Plaza, A. J., Kehtarnavaz, N., & Terzopoulos, D. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059968 · Cited by 3,796 · cited 2×
“Zhou et al. presented U-Net ++ , a new, broader neural net topology for image processing, to take categorization further and farther [68], [70], [71].”
BackgroundWhat Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088 · cited 1×
“The system is dubious about its identification of sections of the sidewalk, as seen in the figure on the bottom right, and might warn the human operator to take over the guiding wheel [20].”
BackgroundA Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524 · cited 2×
“This is also a major issue in the case of medical data wherein the information in a patient’s files can be leaked [3], [23].”
BackgroundBernard, O., Lalande, A., Zotti, C., Cervenansky, F., Yang, X., Heng, P.-A., Cetin, I., Lekadir, K., Camara, O., Gonzalez Ballester, M. A., et al. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2837502 · Cited by 2,431
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“platforms are opening up a plethora of opportunities [60].”
BackgroundA survey of deep learning techniques for autonomous driving
Grigorescu, S., Trasnea, B., Cocias, T., & Macesanu, G. (2020) · Journal of Field Robotics · doi:10.1002/rob.21918 · Cited by 1,809 · cited 1×
“• Users’ Perspective Layout: The populace’s adoption of the aforementioned technology would expand if the intended consumers’ involvement, ideas, and expectations are sought out during the conception and creation of autonomous vehicles [27], [89].”
BackgroundAdversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P., Zhu, Q., & Li, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886017 · Cited by 1,733 · cited 5×
“To determine a subset of parameters that are most significant to the categorization job, a novel hybrid algorithm is used in [50].”
BackgroundMethodInfluentialArtificial intelligence in drug discovery and development
Paul, D., Sanap, G., Shenoy, S., Kalyane, D., Kalia, K., & Tekade, R. K. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2020.10.010 · Cited by 1,695
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503 · cited 1×
“Federated AI has been created for a distributed environment where every device can host an AI [41].”
Background6G Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., Niyato, D., Dobre, O., & Poor, H. V. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3103320 · Cited by 1,452
Predictive learning via rule ensembles
Friedman, J. H., & Popescu, B. E. (2008) · The Annals of Applied Statistics · doi:10.1214/07-aoas148 · Cited by 1,315 · cited 1×
“DT are the replica of if-then rules and a number of works like RuleFit [43] which employs DT have proved capable of understanding the sparse relation between the variables which is quite difficult to understand by regression models.”
BackgroundTechniques for interpretable machine learning
Du, M., Liu, N., & Hu, X. (2019) · Communications of the ACM · doi:10.1145/3359786 · Cited by 1,268 · cited 2×
“Nevertheless, such extraction puts emphasis on compressing the dimensionality of the problem, which under-mines the veracity of the initial formulation [1], [57].”
BackgroundTechniques for Interpretable Machine Learning
Du, M., Liu, N., & Hu, X. (2018) · arXiv · doi:10.48550/arxiv.1808.00033 · Cited by 1,261
Explainable artificial intelligence: A survey
Dosilovic, F. K., Brcic, M., & Hlupic, N. (2018) · 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.23919/mipro.2018.8400040 · Cited by 1,147 · cited 4×
“To assess the significance of an input characteristic, there are two different work pathways which include feature importance and activation maximization [46], [53].”
BackgroundMethodInfluentialA Survey on the Explainability of Supervised Machine Learning
Burkart, N., & Huber, M. F. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12228 · Cited by 1,008
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Poor, H. (2021) · Deakin Research Online (Deakin University) · Cited by 889
Interpretable Convolutional Neural Networks
Zhang, Q., Wu, Y. N., & Zhu, S.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00920 · Cited by 833
Markus, A. F., Kors, J. A., & Rijnbeek, P. R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103655 · Cited by 811 · cited 5×
“AI breakthroughs in a variety of sectors [3], [4], [5], [6].”
BackgroundInfluentialShneiderman, B. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3419764 · Cited by 768
Explainable AI: A Brief Survey on History, Research Areas, Approaches and Challenges
Xu, F., Uszkoreit, H., Du, Y., Fan, W., Zhao, D., & Zhu, J. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32236-6_51 · Cited by 758 · cited 8×
“(ITSC), Sep. 2020, pp. 1–7.”
BackgroundInfluentialAI in Medical Imaging Informatics: Current Challenges and Future Directions
Panayides, A. S., Amini, A., Filipovic, N. D., Sharma, A., Tsaftaris, S. A., Young, A., Foran, D., Do, N., Golemati, S., Kurc, T., et al. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2991043 · Cited by 713 · cited 1×
“A major application of AI in medicine is image analysis in radiology, and AI being increasingly adept at gathering information from images and finding underlying patterns that even humans can’t identify has become a very powerful tool in this field [31].”
BackgroundPerception, Planning, Control, and Coordination for Autonomous Vehicles
Pendleton, S., Andersen, H., Du, X., Shen, X., Meghjani, M., Eng, Y., Rus, D., & Ang, M. (2017) · Machines · doi:10.3390/machines5010006 · Cited by 657 · cited 1×
“However, from a social and technological aspect, the basic notion seems to be that human-sentient design, implementation, and distribution of automated systems is indispensable [87], [88].”
BackgroundArtificial intelligence: a survey on evolution, models, applications and future trends
Lu, Y. (2019) · Journal of Management Analytics · doi:10.1080/23270012.2019.1570365 · Cited by 641 · cited 2×
“A new AI with partiality in its coding can start off by being partial towards different types of human beings which is terrible in itself, but with consequent evolution might be discriminating its services against humans as a whole [7], [12].”
BackgroundA Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · cited 9×
“Simulatability is the capability for user simulation: ‘‘A paradigm where a person can take in incoming data along with the model’s attributes and proceed through each computation required to construct a prognosis in an acceptable timeframe’’ [28], [50].”
BackgroundMethodInfluentialTrustworthy artificial intelligence
Thiebes, S., Lins, S., & Sunyaev, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00441-4 · Cited by 595
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00765-8 · Cited by 570
Generating Visual Explanations
Hendricks, L. A., Akata, Z., Rohrbach, M., Donahue, J., Schiele, B., & Darrell, T. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_1 · Cited by 534 · cited 1×
“Local interpretations can only represent a certain portion of any and all potential actions, i.e., they can only describe one forecast in a particular circumstance [92].”
BackgroundSecurity and Privacy for 6G: A Survey on Prospective Technologies and Challenges
Nguyen, V.-L., Lin, P.-C., Cheng, B.-C., Hwang, R.-H., & Lin, Y.-D. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3108618 · Cited by 515 · cited 1×
“…The associate editor coordinating the review of this manuscript and approving it for publication was Zijian Zhang . smart assistants, recommendation engines, disease detection, or automated robots, people’s lives are greatly influenced by AI breakthroughs in a variety of sectors [3], [4], [5], [6].”
BackgroundEnd-to-end privacy preserving deep learning on multi-institutional medical imaging
Kaissis, G., Ziller, A., Passerat-Palmbach, J., Ryffel, T., Usynin, D., Trask, A., Lima, I., Mancuso, J., Jungmann, F., Steinborn, M.-M., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00337-8 · Cited by 513 · cited 1×
“This is also a major issue in the case of medical data wherein the information in a patient’s files can be leaked [3], [23].”
BackgroundThe cell biology of the retinal pigment epithelium
Lakkaraju, A., Umapathy, A., Tan, L. X., Daniele, L., Philp, N. J., Boesze-Battaglia, K., & Williams, D. S. (2020) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2020.100846 · Cited by 422
Distilling a neural network into a soft decision tree
Frosst, N., & Hinton, G. (2017) · arXiv · doi:10.48550/arxiv.1711.09784 · Cited by 407 · cited 2×
“Local methods make a concerted effort to validate the model’s actions for a specific circumstance or cluster of occurrences [54], [59].”
BackgroundEnd-to-end Interpretable Neural Motion Planner
Zeng, W., Luo, W., Suo, S., Sadat, A., Yang, B., Casas, S., & Urtasun, R. (2021) · arXiv · doi:10.48550/arxiv.2101.06679 · Cited by 406 · cited 1×
“In accordance with the proposal put forth by Zeng et al., autonomous vehicles can be trained to operate securely by adhering to traffic regulations such as relinquishing, interacting with the other pedestrians, and obeying road signs [95].”
MethodEnd-To-End Interpretable Neural Motion Planner
Zeng, W., Luo, W., Suo, S., Sadat, A., Yang, B., Casas, S., & Urtasun, R. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00886 · Cited by 398
Establishing the rules for building trustworthy AI
Floridi, L. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0055-y · Cited by 394 · cited 1×
“The EC has provided seven different criteria on the basis of which trustworthiness can be proven [13], [14] and these rules were formulated on the basis of three main criteria which are to ensure the transparency, reliability and for the protection of data in models [14].”
BackgroundStepin, I., Alonso, J. M., Catala, A., & Pereira-Farina, M. (2021) · IEEE Access · doi:10.1109/access.2021.3051315 · Cited by 376 · cited 2×
“Various client advocacy organizations, competitors, and internal stakeholders within banking firms all exhibit this upsurge [1], [51].”
BackgroundMethodExplanations in Autonomous Driving: A Survey
Omeiza, D., Webb, H., Jirotka, M., & Kunze, L. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3122865 · Cited by 355
Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342 · cited 3×
“Organisations in the current world use this discipline to analyse, predict, and accurately work in the direction which enhances their productivity [35], [36].”
BackgroundMethodAtakishiyev, S., Salameh, M., Yao, H., & Goebel, R. (2021) · arXiv · doi:10.48550/arxiv.2112.11561 · Cited by 336
An improved particle swarm optimization for feature selection
Liu, Y., Wang, G., Chen, H., Dong, H., Zhu, X., & Wang, S. (2011) · Journal of Bionic Engineering · doi:10.1016/s1672-6529(11)60020-6 · Cited by 324
Atakishiyev, S., Salameh, M., Yao, H., & Goebel, R. (2024) · IEEE Access · doi:10.1109/access.2024.3431437 · Cited by 323
Nazar, M., Alam, M. M., Yafi, E., & Su'ud, M. M. (2021) · IEEE Access · doi:10.1109/access.2021.3127881 · Cited by 312 · cited 1×
“To oversee researchers, we may establish a regulatory system, as proposed by Nazar et al. [74].”
MethodThe Next Decade in AI: Four Steps Towards Robust Artificial Intelligence
Marcus, G. (2020) · arXiv · doi:10.48550/arxiv.2002.06177 · Cited by 297 · cited 3×
“A human operator can be notified whenever the predictive model expresses skepticism about the veracity of its prognosis [15], [19], [18].”
BackgroundHuman-Centered Explainable AI: Towards a Reflective Sociotechnical Approach
Ehsan, U., & Riedl, M. O. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60117-1_33 · Cited by 274 · cited 1×
“The system can grasp the operating conditions based on the comprehensive data provided by 3-dimensional recognition occurrences [102].”
BackgroundArtificial Intelligence and the Future of Humans
Ovidius University of Constanta, D. O. T., & Ciocan, T.-C. (2023) · DIALOGO · doi:10.51917/dialogo.2023.10.1.15 · Cited by 243 · cited 2×
“HIC refers to the ability to supervise the AI system’s entire activities and also the authority to decide when and how to employ it in any particular circumstance [16], [17], [18].”
BackgroundA Trustworthy Privacy Preserving Framework for Machine Learning in Industrial IoT Systems
Arachchige, P. C. M., Bertok, P., Khalil, I., Liu, D., Camtepe, S., & Atiquzzaman, M. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2974555 · Cited by 236 · cited 1×
“…The associate editor coordinating the review of this manuscript and approving it for publication was Zijian Zhang . smart assistants, recommendation engines, disease detection, or automated robots, people’s lives are greatly influenced by AI breakthroughs in a variety of sectors [3], [4], [5], [6].”
BackgroundExplainability of Deep Vision-Based Autonomous Driving Systems: Review and Challenges
Zablocki, É., Ben-Younes, H., Pérez, P., & Cord, M. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01657-x · Cited by 227 · cited 2×
“Mankind preferred to endure unreliable commodities and offerings even during early stages of robotics and autonomous systems implementation, but they’ve progressively recognized that reliable and trustworthy autonomous systems are critical [81].”
BackgroundExplainability of deep vision-based autonomous driving systems: Review and challenges
Zablocki, É., Ben-Younes, H., Pérez, P., & Cord, M. (2021) · arXiv · doi:10.48550/arxiv.2101.05307 · Cited by 227
A Survey of Data-driven and Knowledge-aware eXplainable AI
Li, X.-H., Cao, C. C., Shi, Y., Bai, W., Gao, H., Qiu, L., Wang, C., Gao, Y., Zhang, S., Xue, X., et al. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2983930 · Cited by 224 · cited 8×
“become a need for most humans in their everyday lives [1].”
BackgroundMethodInfluentialApplication of artificial intelligence in surgery
Zhou, X.-Y., Guo, Y., Shen, M., & Yang, G.-Z. (2020) · Frontiers of Medicine · doi:10.1007/s11684-020-0770-0 · Cited by 181 · cited 1×
“AI can now perform invasive surgeries with extreme precision that humans could never do before with their hands [32].”
BackgroundDemystification of AI-driven medical image interpretation: past, present and future
Savadjiev, P., Chong, J., Dohan, A., Vakalopoulou, M., Reinhold, C., Paragios, N., & Gallix, B. (2019) · European Radiology · doi:10.1007/s00330-018-5674-x · Cited by 161 · cited 2×
“The US Food and Drug Administration is presently contem-plating new guidelines for digitization, one of which involves a switch inside the locus of control from finalized outcome to enterprises [65].”
BackgroundRobustness and Explainability of Artificial Intelligence
(2020) · Joint Research Centre (European Commission) · doi:10.2760/57493 · Cited by 155 · cited 9×
“The global agency would also be responsible for monitoring the larger creators on certain occasions so that no human malpractice is done by them [14], [16], [17].”
BackgroundInfluentialBlockchain for explainable and trustworthy artificial intelligence
Nassar, M., Salah, K., ur Rehman, M. H., & Svetinovic, D. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1340 · Cited by 149 · cited 2×
“Local models expressed as a sequential function of input variables can be more efficient than model simulations because limited segments of the system are more inclined to be continuous [52], [55].”
BackgroundSteps Toward Robust Artificial Intelligence
Dietterich, T. G. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2756 · Cited by 139 · cited 4×
“A human operator can be notified whenever the predictive model expresses skepticism about the veracity of its prognosis [15], [19], [18].”
BackgroundInfluentialExplainable Object-Induced Action Decision for Autonomous Vehicles
Xu, Y., Yang, X., Gong, L., Lin, H.-C., Wu, T.-Y., Li, Y., & Vasconcelos, N. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00954 · Cited by 129
Explainable Artificial Intelligence: An Introduction to Interpretable Machine Learning
Kamath, U., & Liu, J. (2021) · doi:10.1007/978-3-030-83356-5 · Cited by 126 · cited 1×
“interpretable learning algorithms [42].”
Vale, D., El-Sharif, A., & Ali, M. (2022) · AI and Ethics · doi:10.1007/s43681-022-00142-y · Cited by 124 · cited 3×
“Global interpretability illustrates a model’s overarching rationale and the justification for all probable consequences [54].”
BackgroundMorales, A., Kinnamon, D. D., Jordan, E., Platt, J., Vatta, M., Dorschner, M. O., Starkey, C. A., Mead, J. O., Ai, T., Burke, W., et al. (2020) · Circulation: Genomic and Precision Medicine · doi:10.1161/circgen.119.002480 · Cited by 114
Enhancing Explainability of Neural Networks Through Architecture Constraints
Yang, Z., Zhang, A., & Sudjianto, A. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007259 · Cited by 106 · cited 3×
“For instance, the European Union’s GDPR framework, which was been passed in 2016 and went into effect in May 2018, established criteria to support the ‘‘entitlement of an explanation’’ premise for users [47].”
BackgroundMethodTrust in artificial Intelligence: a five country study
Gillespie, N., Lockey, S., & Curtis, C. (2021) · doi:10.14264/e34bfa3 · Cited by 104 · cited 1×
“A study by the University of Queensland, Australia in 2021 [10] provides details about the level of trustworthiness of people over overall AI systems, AI in medical and human resource systems.”
BackgroundGonzález-Gonzalo, C., Thee, E. F., Klaver, C. C. W., Lee, A. Y., Schlingemann, R. O., Tufail, A., Verbraak, F., & Sánchez, C. I. (2022) · Progress in Retinal and Eye Research · doi:10.1016/j.preteyeres.2021.101034 · Cited by 103 · cited 1×
“potential to address 20%of all clinical needs [29].”
BackgroundAI and Big Data in Healthcare: Towards a More Comprehensive Research Framework for Multimorbidity
Majnarić, L. T., Babič, F., O’Sullivan, S., & Holzinger, A. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10040766 · Cited by 97 · cited 1×
“To guarantee that development is for the betterment of everybody, technology in the medical industry should indeed adhere to the law, standards, and federal regulations [29], [64].”
BackgroundTrusted AI in Multiagent Systems: An Overview of Privacy and Security for Distributed Learning
Ma, C., Li, J., Wei, K., Liu, B., Ding, M., Yuan, L., Han, Z., & Vincent Poor, H. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3306773 · Cited by 96 · cited 1×
“The entire basis of tailor made advertisements for every person is one use of such distributed AI [21].”
BackgroundBelenkaya, R., Gurley, M. J., Golozar, A., Dymshyts, D., Miller, R. T., Williams, A. E., Ratwani, S., Siapos, A., Korsik, V., Warner, J., et al. (2021) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00079 · Cited by 95 · cited 1×
“The Observational Health Data Sciences and Informatics consortium has designed tools that facilitate the establishment and performance evaluation of diagnosis estimation techniques at mass, in a transparent manner, and in compliance with acknowledged guiding principles [72], [73].”
MethodZerka, F., Urovi, V., Vaidyanathan, A., Barakat, S., Leijenaar, R. T. H., Walsh, S., Gabrani-Juma, H., Miraglio, B., Woodruff, H. C., Dumontier, M., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3029445 · Cited by 89 · cited 2×
“The main standard facilitating the systematic use of autonomous vehicle technology in this context is ISO/TC 204, which delivers an extensive manual on the entire system and infrastructure elements of ITS [45], [79], [80].”
BackgroundExplainable Artificial Intelligence Approaches: A Survey
Islam, S. R., Eberle, W., Ghafoor, S., & Ahmed, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.09429 · Cited by 88 · cited 1×
“Another way to achieve XAI is to build a model using agnostic methods [44].”
MethodExplainability of Machine Learning Models for Bankruptcy Prediction
Park, M. S., Son, H., Hyun, C., & Hwang, H. J. (2021) · IEEE Access · doi:10.1109/access.2021.3110270 · Cited by 83
Transparency as design publicity: explaining and justifying inscrutable algorithms
Loi, M., Ferrario, A., & Viganò, E. (2021) · Ethics and Information Technology · doi:10.1007/s10676-020-09564-w · Cited by 79 · cited 2×
“Hence, this calls for better explanations and highlighting any aspects that might hamper humans [14], [24].”
BackgroundMehdiyev, N., & Fettke, P. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-64949-4_1 · Cited by 78 · cited 2×
“approaches for users to interact with financial organisations [75].”
BackgroundSafe Reinforcement Learning for Autonomous Lane Changing Using Set-Based Prediction
Krasowski, H., Wang, X., & Althoff, M. (2020) · 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294259 · Cited by 76 · cited 1×
“With almost more than half a percent per-class average intersection over union (IoU) and more than 80 per-category average IoU, the methodology surpasses several well-known segmentation models including ENet and SegNet [71], [101].”
MethodSachan, S., Almaghrabi, F., Yang, J.-B., & Xu, D.-L. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115597 · Cited by 66 · cited 3×
“An organisation possessing this would hence have the power to stump their entire competition, becoming a monopoly by just controlling their and other’s assets [25].”
BackgroundEnhancing human agency through redress in Artificial Intelligence Systems
Fanni, R., Steinkogler, V. E., Zampedri, G., & Pierson, J. (2023) · AI & SOCIETY · doi:10.1007/s00146-022-01454-7 · Cited by 66 · cited 3×
“HIC refers to the ability to supervise the AI system’s entire activities and also the authority to decide when and how to employ it in any particular circumstance [16], [17], [18].”
BackgroundGenerating Visual Explanations
Hendricks, L. A., Akata, Z., Rohrbach, M., Donahue, J., Schiele, B., & Darrell, T. (2016) · arXiv · doi:10.48550/arxiv.1603.08507 · Cited by 64 · cited 1×
“Local interpretations can only represent a certain portion of any and all potential actions, i.e., they can only describe one forecast in a particular circumstance [92].”
BackgroundVashisht, R., Jung, K., Schuler, A., Banda, J. M., Park, R. W., Jin, S., Li, L., Dudley, J. T., Johnson, K. W., Shervey, M. M., et al. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.1755 · Cited by 61
Visual Scene Understanding for Autonomous Driving Using Semantic Segmentation
Hofmarcher, M., Unterthiner, T., Arjona-Medina, J., Klambauer, G., Hochreiter, S., & Nessler, B. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-28954-6_15 · Cited by 51 · cited 1×
“A methodology for examining how a sequence of pixel intensities influences the CNN’s forecasting, called Visual-Back Propagation is presented in [94].”
MethodVisualBackProp: efficient visualization of CNNs
Bojarski, M., Choromanska, A., Choromański, K., Firner, B., Jackel, L., Müller, U., & Zieba, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05418 · Cited by 46
Advisable Learning for Self-Driving Vehicles by Internalizing Observation-to-Action Rules
Kim, J., Moon, S., Rohrbach, A., Darrell, T., & Canny, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00968 · Cited by 45
Marcillo, P., Caraguay, Á. L. V., & Hernández-Álvarez, M. (2022) · Applied Sciences · doi:10.3390/app12094529 · Cited by 44
He, H., Gray, J., Cangelosi, A., Meng, Q., McGinnity, T. M., & Mehnen, J. (2020) · 2020 3rd International Conference on Intelligent Robotic and Control Engineering (IRCE) · doi:10.1109/irce50905.2020.9199244 · Cited by 43 · cited 1×
“sociological, and regulatory concerns [84].”
Addressing EU climate targets: Reducing CO2 emissions using cooperative and automated vehicles
Pribyl, O., Blokpoel, R., & Matowicki, M. (2020) · Transportation Research Part D: Transport and Environment · doi:10.1016/j.trd.2020.102437 · Cited by 41
AutoAI-TS: AutoAI for Time Series Forecasting
Shah, S. Y., Patel, D., Vu, L., Dang, X.-H., Chen, B., Kirchner, P., Samulowitz, H., Wood, D., Bramble, G., Gifford, W. M., et al. (2021) · Proceedings of the 2021 International Conference on Management of Data · doi:10.1145/3448016.3457557 · Cited by 39 · cited 2×
“These AutoAI models are sandbox type systems which can be modified and suited to individual requirements [36], [37], [38].”
MethodEvaluating Explanation Without Ground Truth in Interpretable Machine Learning
Yang, F., Du, M., & Hu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06831 · Cited by 34 · cited 4×
“To assess the significance of an input characteristic, there are two different work pathways which include feature importance and activation maximization [46], [53].”
BackgroundMethodInfluentialInterpretable Convolutional Neural NetworksPreprint
Zhang, Q., Wu, Y. N., & Zhu, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.00935 · Cited by 23
Developing and Operating Artificial Intelligence Models in Trustworthy Autonomous Systems
Martínez-Fernández, S., Franch, X., Jedlitschka, A., Oriol, M., & Trendowicz, A. (2021) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-030-75018-3_14 · Cited by 22 · cited 1×
“However, from a social and technological aspect, the basic notion seems to be that human-sentient design, implementation, and distribution of automated systems is indispensable [87], [88].”
BackgroundDeveloping and Operating Artificial Intelligence Models in Trustworthy Autonomous Systems
Martínez-Fernández, S., Franch, X., Jedlitschka, A., Oriol, M., & Trendowicz, A. (2020) · arXiv · doi:10.48550/arxiv.2003.05434 · Cited by 22
Unsupervised Learning for Trustworthy IoT
Banerjee, N., Giannetsos, T., Panaousis, E., & Took, C. (2018) · IEEE International Conference on Fuzzy Systems · doi:10.48550/arxiv.1805.10401 · Cited by 22
Interpretable Goal Recognition in the Presence of Occluded Factors for Autonomous Vehicles
Hanna, J. P., Rahman, A., Fosong, E., Eiras, F., Dobre, M., Redford, J., Ramamoorthy, S., & Albrecht, S. V. (2021) · 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9635903 · Cited by 21
Concept Tree: High-Level Representation of Variables for More Interpretable Surrogate Decision TreesPreprint
Renard, X., Woloszko, N., Aigrain, J., & Detyniecki, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.01297 · Cited by 20
Trustworthy medical AI systems need to know when they don’t know
Grote, T. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2021-107463 · Cited by 20
Software Black Box: an alternative mechanism for failure analysis
Elbaum, S., & Munson, J. C. (2002) · Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000 · doi:10.1109/issre.2000.885887 · Cited by 15 · cited 1×
“digital assistants are additional possibilities [53], [61].”
Interpretable Goal-based Prediction and Planning for Autonomous Driving
Albrecht, S. V., Brewitt, C., Wilhelm, J., Gyevnar, B., Eiras, F., Dobre, M., & Ramamoorthy, S. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9560849 · Cited by 12
Toward Accountable and Explainable Artificial Intelligence Part Two: The Framework Implementation
Vice, J., & Khan, M. M. (2022) · IEEE Access · doi:10.1109/access.2022.3163523 · Cited by 11 · cited 5×
“However, in tightly controlled domains like IoT systems, avionics, finance, banking, autonomous systems, and medical services, integrating AI and its interoperability with legacy applications is much more onerous [27], [47].”
BackgroundInfluentialAn approach for predicting heart failure rate using IBM Auto AI Service
Krishna Priya, G., Suganthi, S. T., VijiPriya, G., & Madian, N. (2021) · International Conference on Computational Intelligence and Knowledge Economy (ICCIKE) · doi:10.1109/iccike51210.2021.9410783 · Cited by 10 · cited 1×
“This system was made by IBM, and used by Sunganthi et al. and many others to predict different medical diseases which are nearly impossible to predict by humans alone [36], [37], [39], [40].”
MethodIBM Auto AI Bot: Diabetes Mellitus Prediction Using Machine Learning Algorithms
Kumar, J. N. V. R. S., Kumar, K. H., Haleem, A., Sivaranjani, B., Kiran, B. N. T., & Prameela, S. (2022) · 2022 International Conference on Applied Artificial Intelligence and Computing (ICAAIC) · doi:10.1109/icaaic53929.2022.9792690 · Cited by 8 · cited 1×
“This system was made by IBM, and used by Sunganthi et al. and many others to predict different medical diseases which are nearly impossible to predict by humans alone [36], [37], [39], [40].”
MethodNot All Samples are Trustworthy: Towards Deep Robust SVP Prediction
Xu, Q., Yang, Z., Jiang, Y., Cao, X., Yao, Y., & Huang, Q. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3047817 · Cited by 6 · cited 1×
“…been carried out to illustrate how automated vehicles might be commandeered, and the malfunction of the Maneuvering Characteristics Augmentation System (MCAS) on Boeing air-crafts led to the crash of two aircrafts which resulted in the fatalities of 157 and 189 passengers, respectively [82], [83].”
BackgroundThe Quandary in Data Protection and Rights to Privacy of AI Technology Adoption in Malaysia
Kamaruddin, S., Wan Rosli, W. R., Mohd Saufi, N. N., Mohammad, A. M., & Hamin, Z. (2021) · 2021 Innovations in Power and Advanced Computing Technologies (i-PACT) · doi:10.1109/i-pact52855.2021.9696803 · Cited by 6 · cited 1×
“GDPR has already stated this issue and countries like Malaysia have also employed some regulations [14], [22].”
BackgroundCardiac MRI Image Segmentation for Left Ventricle and Right Ventricle using Deep LearningPreprint
Seo, B., Mariano, D., Beckfield, J., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.08028 · Cited by 5 · cited 1×
“Furthermore, several domain-especial techniques and unique modifications have been developed [68], [69], [70].”
BackgroundTrusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed LearningPreprint
Ma, C., Li, J., Kang, W., et al. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2202.09027 · Cited by 4
Unsupervised Learning for Trustworthy IoT
Banerjee, N., Giannetsos, T., Panaousis, E., & Took, C. C. (2018) · 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2018.8491672 · Cited by 3
Towards Explainable and Trustworthy Autonomous Physical Systems
Omeiza, D., Anjomshoae, S., Kollnig, K., Camburu, O.-M., Främling, K., & Kunze, L. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3441338 · Cited by 2 · cited 1×
“Omeiza et al. have suggested various explanations and interpretabilities in relation to autonomous systems [90].”
BackgroundSustainability of CEO and Employee Compensation Divide: Evidence from USA
Aggarwal, V., & Doifode, A. (2023) · Lecture Notes on Data Engineering and Communications Technologies · doi:10.1007/978-981-19-1844-5_35 · Cited by 2
A Survey of Deep Learning Techniques for Autonomous Driving
Grigorescu, S., Trasnea, B., Cocias, T., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.07738
Explanations in Autonomous Driving: A Survey
Omeiza, D., Webb, H., Jirotka, M., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.05154
Human-centered Explainable AI: Towards a Reflective Sociotechnical Approach
Ehsan, U., & Riedl, M. O. (2020) · arXiv · doi:10.48550/arxiv.2002.01092
Markus, A. F., Kors, J. A., & Rijnbeek, P. R. (2020) · arXiv · doi:10.48550/arxiv.2007.15911
Research works printed but not linked: 5
- hoos, 2018, Automated artificial intelligence (AutoAI)
- 2019, What is GDPR the EU’s new data protection law?
- 2023, GDPR Articles and Recitals
- dastani, 2021, Responsibility Research for Trustworthy Autonomous Systems (Blue Sky Ideas Track)
- stierle, 2021, Bringing light into the darkness—A systematic literature review on explainable predictive business process monitoring techniques
Cited by
Mersha, M., Lam, K., Wood, J., AlShami, A. K., & Kalita, J. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128111 · Cited by 237
“…in reinforcement learning is crucial, particularly for safety-critical domains, due to the need for trust, safety assurance, regulatory compliance, ethical decision-making, model debugging, collaborative human-AI interaction, accountability, and AI model adoption and acceptance [73, 81, 82].”
BackgroundMathew, D. E., Ebem, D. U., Ikegwu, A. C., Ukeoma, P. E., & Dibiaezue, N. F. (2025) · Neural Processing Letters · doi:10.1007/s11063-025-11732-2 · Cited by 168
“Furthermore, Chamola, et al. [25] reviewed that ensuring that XAI methods effectively handle real-world scenarios, including unforeseen situations and adversarial attacks, is essential for their practical applicability, and overcoming these challenges is imperative for the widespread adoption of…”
Wani, N. A., Kumar, R., Mamta, Bedi, J., & Rida, I. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102472 · Cited by 191
Douaioui, K., Oucheikh, R., Benmoussa, O., & Mabrouki, C. (2024) · Applied System Innovation · doi:10.3390/asi7050093 · Cited by 252
“Explainable AI (XAI) is becoming increasingly important to address the challenge of interpretability by emphasizing transparency in decision-making processes alongside model accuracy [41,42].”
Shadi, M. R., Mirshekali, H., & Shaker, H. R. (2025) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2025.115668 · Cited by 161
Metadata
- Authors
- Chamola, V., Hassija, V., Sulthana, A. R., Ghosh, D., Dhingra, D., & Sikdar, B.
- Affiliations
- Birla Institute of Technology and Science, Pilani (IN)
- National University of Singapore (SG)
- University of Greenwich (GB)
- Jaypee Institute of Information Technology (IN)
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 78994-79015
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4385059984
- Cited by
- 352
- References
- 122
- Citations by year
- 2026: 127 · 2025: 143 · 2024: 76 · 2023: 6
- FWCI
- 33.09
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- IEEE Access (publishedVersion, cc-by-nc-nd)
- Greenwich Academic Literature Archive (University of Greenwich) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Education, Singapore (A-0009040-00-00, A-0009040-01-00)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- trustworthy AI, explainable AI, algorithmic bias, black-box models, post-hoc explanation, interpretability, autonomous vehicles, AI security, artificial intelligence in banking, artificial intelligence in healthcare, Internet of Things, AI policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.