CoChat

It is Not “Accuracy vs. Explainability”—We Need Both for Trustworthy AI Systems

Petkovic, Dragutin · 2023 · IEEE Transactions on Technology and Society

The DOI matches its Crossref record; 26 of the 27 references it cites were found in a registry or an index.

Abstract

We are witnessing the emergence of an “AI economy and society” where AI technologies and applications are increasingly impacting health care, business, transportation, defense and many aspects of everyday life. Many successes have been reported where AI systems even surpassed the accuracy of human experts. However, AI systems may produce errors, can exhibit bias, may be sensitive to noise in the data, and often lack technical and judicial transparency resulting in reduction in trust and challenges to their adoption. These recent shortcomings and concerns have been documented in both the scientific and general press such as accidents with self-driving cars, biases in healthcare or hiring and face recognition systems for people of color, and seemingly correct decisions later found to be made due to wrong reasons etc. This has resulted in the emergence of many government and regulatory initiatives requiring trustworthy and ethical AI to provide accuracy and robustness, some form of explainability, human control and oversight, elimination of bias, judicial transparency and safety. The challenges in delivery of trustworthy AI systems have motivated intense research on explainable AI systems (XAI). The original aim of XAI is to provide human understandable information of how AI systems make their decisions in order to increase user trust. In this paper we first very briefly summarize current XAI work and then challenge the recent arguments that present “accuracy vs. explainability” as being mutually exclusive and for focusing mainly on deep learning with its limited XAI capabilities. We then present our recommendations for the broad use of XAI in all stages of delivery of high stakes trustworthy AI systems, e.g., development; validation/certification; and trustworthy production and maintenance.

Overview

Integrity signals

Registry

Crossref · 10.1109/tts.2023.3239921

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 26 references

Research works printed but not linked: 20

  1. Szabo, 2019, Artificial intelligence is rushing into patient care—And could raise risks
  2. Kaushal, 2020, Toward fairness in health care training data
  3. 2017, Can A.I. be taught to explain itself
  4. Goodman, 2018, Why Amazon’s automated hiring tool discriminated against women
  5. Harwell, 2019, Federal study confirms bias in facial recognition systems
  6. 2021, Proposal for a regulation of the european parliament and of the council laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts, COM/2021/206 final
  7. 2017, Asilomar ethical AI principles
  8. 2022, The EU general data protection regulation 2016/679 (GDPR), recital 71
  9. 2021, How does FDA regulate AI/ML in medical devices and products
  10. Ford, 2021, Rule of the Robots: How Artificial Intelligence Will Transform Everything
  11. McCausland, 2019, Self-driving Uber car that hit and killed woman did not recognize that pedestrians jaywalk
  12. Turek, 2018, Explainable artificial intelligence (XAI)
  13. Petkovic, 2023, Explainable Deep Learning AI: Methods and Challenges
  14. 2022, Occam’s razor, Britannica
  15. Dong, Towards interpretable deep neural networks by leveraging adversarial examples, 975
  16. Mitsa, 2022, How do you know you have enough training data?
  17. 10.1007/978-1-4899-7687-1_192 · DOI · Paper page
  18. Guszcza, 2018, AI needs human-centered design
  19. Lundberg, 2018, Interpretable machine learning with XGBoost
  20. Bhattacharya, 2021, Top 10 massive failures of artifficial inteliogence till date

Cited by

See all 92

Metadata

Authors
Petkovic, D.
Affiliations
Computer Science Department, San Francisco State University, San Francisco, CA, USA
Venue
IEEE Transactions on Technology and Society
Published
2023-03
Volume
4
Issue
1
Pages
46-53
ISSN
2637-6415 (ISSN-L)
OpenAlex
W4319863522
Cited by
63
References
27
Citations by year
2026: 13 · 2025: 26 · 2024: 20 · 2023: 4
FWCI
5.58
Type
journal article
Language
en
Open access
closed
Locations
IEEE Transactions on Technology and Society (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
Keywords
explainable AI, trustworthy AI, trust in AI, algorithmic bias, deep learning limitations, AI regulation, AI ethics, human oversight of AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: It is Not “Accuracy vs. Explainability”—We Need Both for Trustworthy AI Systems. https://app.cochat.ai/papers/10.1109/tts.2023.3239921
The paper
Petkovic, D. (2023). It is Not “Accuracy vs. Explainability”—We Need Both for Trustworthy AI Systems. IEEE Transactions on Technology and Society. https://doi.org/10.1109/tts.2023.3239921

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.