Challenges and efforts in managing AI trustworthiness risks: a state of knowledge
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
This paper addresses the critical gaps in existing AI risk management frameworks, emphasizing the neglect of human factors and the absence of metrics for socially related or human threats. Drawing from insights provided by NIST AI RFM and ENISA, the research underscores the need for understanding the limitations of human-AI interaction and the development of ethical and social measurements. The paper explores various dimensions of trustworthiness, covering legislation, AI cyber threat intelligence, and characteristics of AI adversaries. It delves into technical threats and vulnerabilities, including data access, poisoning, and backdoors, highlighting the importance of collaboration between cybersecurity engineers, AI experts, and social-psychology-behavior-ethics professionals. Furthermore, the socio-psychological threats associated with AI integration into society are examined, addressing issues such as bias, misinformation, and privacy erosion. The manuscript proposes a comprehensive approach to AI trustworthiness, combining technical and social mitigation measures, standards, and ongoing research initiatives. Additionally, it introduces innovative defense strategies, such as cyber-social exercises, digital clones, and conversational agents, to enhance understanding of adversary profiles and fortify AI security. The paper concludes with a call for interdisciplinary collaboration, awareness campaigns, and continuous research efforts to create a robust and resilient AI ecosystem aligned with ethical standards and societal expectations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Polemi et al. similarly show that AI trustworthiness risks include human, behavioral and organizational factors, not only technical robustness and security (Polemi et al., 2024).”
From Human-centric AI governance in the European Union. Accountability, fundamental rights, and institutional resilience in public administration (2026) · cites this paper as Polemi et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
The Mythos of Model Interpretability
Lipton, Z. C. (2016) · arXiv · doi:10.48550/arxiv.1606.03490 · Cited by 5,422 · cited 1×
“Achieving predictability requires transparency in AI algorithms and decision-making processes, enabling users to comprehend and trust the system’s operations (Lipton, 2016).”
BackgroundFloridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“In the context of AI ethics and design, concepts such as fairness, accountability, and transparency become crucial to achieving a system that is truly fit for its intended purpose (Floridi et al., 2018).”
BackgroundMembership Inference Attacks Against Machine Learning Models
Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.41 · Cited by 4,754
Internet of things: Vision, applications and research challenges
Miorandi, D., Sicari, S., De Pellegrini, F., & Chlamtac, I. (2012) · Ad Hoc Networks · doi:10.1016/j.adhoc.2012.02.016 · Cited by 3,578
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Can machine learning be secure?
Barreno, M., Nelson, B., Sears, R., Joseph, A. D., & Tygar, J. D. (2006) · Proceedings of the 2006 ACM Symposium on Information, computer and communications security · doi:10.1145/1128817.1128824 · Cited by 836
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11839 · Cited by 783
Research works printed but not linked: 14
- Aufrant, 2020, Guide de recommandations pour la spécification et la qualification de systèmes intégrant de l'intelligence artificielle
- 2018, Supervisory Guidance on Model Risk Management
- Cavoukian, 2017, Privacy by Design in the Age of Big Data
- 2019, Ethics Guidelines for Trustworthy AI. High-Level Expert Group on AI (HLEG)
- Hoffman, 2018, “Evaluating human-robot interaction with the interactive causal attribution model,”
- Huang, 2020, Towards dependable artificial intelligence: a survey, J. Comput. Sci. Technol., 35, 487
- IEEE P2976 Standards2021
- IEEE P3119 Standards.2021
- Kioskli, 2020, “Measuring psychosocial and behavioral factors improves attack potential estimates,”, 216
- Newman, 2023, A Taxonomy of Trustworthiness for Artificial Intelligence Connecting Properties of Trustworthiness With Risk Management and the AI Lifecycle. UC Berkeley Center for Long-Term Cybersecurity Series, CLTC White Papers Series, January 2023
- 2024, Adversarial Machine Learning—A Taxonomy and Terminology of Attacks and Mitigations
- Pennycook, 2018, The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Stories Increases Perceived Accuracy of Stories Without Warnings. Management.
- Raj, 2020, Priming for performance: the impact of learning management systems on firm performance, Manag. Sci., 66, 1489
- Smith, 2021, The S.A.F.E. approach to AI safety, Artif. Intell. J., 59, 58
Cited by
Evaluating Trustworthiness in AI: Risks, Metrics, and Applications Across Industries
Nastoska, A., Jancheska, B., Rizinski, M., & Trajanov, D. (2025) · Electronics · doi:10.3390/electronics14132717 · Cited by 167
Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models
Ferdaus, M. M., Abdelguerfi, M., Ioup, E., Niles, K. N., Pathak, K., & Sloan, S. D. (2025) · ACM Computing Surveys · doi:10.1145/3777382 · Cited by 137
Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models
Ferdaus, M. M., Abdelguerfi, M., Ioup, E., Niles, K. N., Pathak, K., & Sloan, S. (2024) · arXiv · doi:10.48550/arxiv.2407.13934 · Cited by 80
Maheshwari, R. U., & Paulchamy, B. (2024) · Automatika · doi:10.1080/00051144.2024.2400640 · Cited by 56
Rethinking responsible AI from ethical pillars to sociotechnical practice
Ibitoye, A., Nkwo, M. S., & Orji, R. (2025) · AI and Ethics · doi:10.1007/s43681-025-00809-2 · Cited by 56
Ali, I., Nguyen, K., Ali, A. M., & Cui, T. (2025) · Journal of Knowledge Management · doi:10.1108/jkm-03-2025-0431 · Cited by 56
Wang, S., Fatima, N., Shahbaz, M., & Asif, M. (2026) · Scientific Reports · doi:10.1038/s41598-026-38179-2 · Cited by 24
ADABARA, I., Olaniyi Sadiq, B., Nuhu Shuaibu, A., Ibarahim Danjuma, Y., & Venkateswarlu, M. (2025) · F1000Research · doi:10.12688/f1000research.169337.1 · Cited by 34
Negative impacts of artificial intelligence technologies on the tourism industry
Zvaigzne, A., Litavniece, L., Kodors, S., & Jurkāne, K. (2025) · Worldwide Hospitality and Tourism Themes · doi:10.1108/whatt-12-2024-0299 · Cited by 27
Ilić, N., & Sarajlija, A. (2025) · Journal of Personalized Medicine · doi:10.3390/jpm15090407 · Cited by 19
A comprehensive introspection on AI risks: taxonomy, challenges, and future directions
Ray, P. P. (2026) · Iran Journal of Computer Science · doi:10.1007/s42044-025-00370-5 · Cited by 16
AI_TAF: A Human-Centric Trustworthiness Risk Assessment Framework for AI Systems
Seralidou, E., Kioskli, K., Fotis, T. G., & Polemi, N. (2025) · Computers · doi:10.3390/computers14070243 · Cited by 12
Self-citationNyberg, A. J., Abdulsalam, D. “., Cragun, O. R., & Arumugam, V. (2025) · Human Resource Management Review · doi:10.1016/j.hrmr.2025.101119 · Cited by 12
Khapre, S., Mersha, M. A., Shakil, H., Baruah, J., & Kalita, J. K. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.129832 · Cited by 15
Gewida, M., & Qu, Y. (2025) · European Journal of Electrical Engineering and Computer Science · doi:10.24018/ejece.2025.9.1.666 · Cited by 8
Generative Artificial Intelligence and education: Research, policy and practice
Passey, D., Taggart, S., Leow, S., & Lee, C. E. (2024) · doi:10.21428/8c225f6e.001efa82 · Cited by 8
The Pitfalls of “Security by Obscurity” and What They Mean for Transparent AI
Hall, P., Mundahl, O., & Park, S. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i27.35022 · Cited by 12
Artificial intelligence (AI) safety system for safe & trustworthy autonomy
Thakur, R., Sajid, Z., & Khan, F. I. (2026) · Digital Chemical Engineering · doi:10.1016/j.dche.2026.100308 · Cited by 10
Trust in AI: Evidence of Trust-Supporting Mechanisms from 17 Countries
Lockey, S., & Gillespie, N. A. (2025) · Springer eBooks · doi:10.1007/978-3-032-01940-0_10 · Cited by 5
Agathangelos-Ioannou, G., & Tsohou, A. (2026) · International Journal of Information Security · doi:10.1007/s10207-026-01271-9 · Cited by 3
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets60972 · Cited by 4
Artificial Intelligence Risk Identification: Challenges, Impacts, and Mitigation Strategies
Syukrina, U., & Nugraha, I. G. D. (2025) · International Journal of Electrical, Computer, and Biomedical Engineering · doi:10.62146/ijecbe.v3i2.109 · Cited by 2
RISK-BASED TEST FRAMEWORK FOR LLM FEATURES IN REGULATED SOFTWARE
Zhou, Z. (2026) · doi:10.5121/csit.2026.160209 · Cited by 3
Almarwani, R., Almarwani, M., & Almarwani, F. (2026) · IEEE Access · doi:10.1109/access.2026.3673980 · Cited by 4
The Role of Explainable AI in Enhancing Threat Intelligence Analysis in Cybersecurity Operations
(2024) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets60971 · Cited by 3
Dragomir, A. N., Bulea, I., & Tarnu, L. I. (2026) · Frontiers in Political Science · doi:10.3389/fpos.2026.1928481 · Cited by 1
Kumar, R., Malhotra, M., & Reddy, C. K. K. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3551-3.ch004 · Cited by 1
Venkateswaran, P. S., Manimaran, S., & Suba, S. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-9195-3.ch001 · Cited by 1
Public awareness, trust, and readiness to adopt AI-driven WASH policies
Pawar, D., & Biswas, R. (2026) · Water Policy · doi:10.2166/wp.2026.207 · Cited by 1
Artificial Intelligence in Social Work: Bridging Technology and Humanity
An, R., & Lindsey, M. A. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6 · Cited by 1
Tan, C. N.-L., Dou, J., Liu, Y. D., & Chung, H. F. L. (2026) · Journal of Enterprise Information Management · doi:10.1108/jeim-04-2026-0628 · Cited by 1
Issue 4.1 Generative AI and education
(2024) · doi:10.21428/8c225f6e.0390b853 · Cited by 1
Cyber Threat Intelligence Sharing: Challenges and OpportunitiesPreprint
Viana, C. R., de Lima, M. S. F., de Melo, B. L. L., Silva, G. N., & Araujo, D. R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5143870
Mitra, U., & Rehman, S. U. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-2200-1.ch001
Security Challenges in Cloud-Based Watermarking
Agrawal, A., Verma, S., Sharma, A., Kumar, A., Mann, M., & Baniya, P. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3785-2.ch002
Ethical Implications and Challenges of AI in Workflow Automation and Optimization
-, R. P. (2025) · International Journal of Business and Management · doi:10.5539/ijbm.v20n6p47 · Cited by 1
Yilmaz, C., & Balcıoğlu, Y. S. (2025) · International Journal of Basic and Applied Sciences · doi:10.14419/xh7kv106
Deepfake in Digital Business: Systematic Review of Strategies
Atencio, G. S. (2025) · Artificial Intelligence and Applications · doi:10.47852/bonviewaia52025448
A Multidisciplinary Approach to Trustworthy AI in the Digital Society
Mitan, E., NEACȘU, D. M., OVREIU, S., & Daniel, S. A. V. U. (2025) · Romanian Cyber Security Journal · doi:10.54851/v7i2y202504
352 AI in enterprise security risk management: Threats, benefits, and governance
Loyear, R. (2025) · De Gruyter eBooks · doi:10.1515/9783111595306-002
A Framework-Driven Mapping of ADS-B Vulnerabilities to NIST RMF and AI RMF
Searcy, A., & Kacem, T. (2025) · International Symposium on Networks, Computers and Communications (ISNCC) · doi:10.1109/isncc66965.2025.11250387
Machine Learning Driven Trust and Reliability In Human-AI Collaboration For Cybersecurity
Wairagade, A., & Ranjan, S. (2025) · International Conference on Business Analytics for Technology and Security (ICBATS) · doi:10.1109/icbats66542.2025.11258290
Secure AI-Enabled Communication in Smart Cities and Industry 4.0
Thamrin, M., Anwar, N., Nurdiansyah, N., Asrowardi, I., Faisal, M., Sahabuddin, Ronaldi, T., Kumar, A., & Bajpai, S. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3576-6.ch009 · Cited by 1
The role of AI integration in fostering innovation within software houses
Siddiqui, N. (2024) · Theseus (Ammattikorkeakoulujen) · Cited by 2
Ishaq, F., Kalaydjian, A., Machnik, J. V., Malveaux, J. A., Pletcher, S., & Nguyen, N.-A. (2026) · doi:10.2196/preprints.94243
Zieliński, T. (2026) · De Securitate et Defensione O Bezpieczeństwie i Obronności · doi:10.34739/dsd.2025.02.09
Gamarra, N. A. G. (2026) · International Journal of Emerging Research in Engineering and Technology · doi:10.63282/3050-922x.ijeret-v7i1p139
Shivadekar, S. S. (2025) · International Conference on Smart Electronics and Communication (ICOSEC) · doi:10.1109/icosec67334.2025.11459645
Sharbaf, M. S. (2026) · IEEE International Systems Conference (SysCon) · doi:10.1109/syscon66367.2026.11503517
Declarable Integration of NIST AI Risk Management into AI-driven ISMS through Policy-as-Code
Kharchevnikov, D., & Robinett, S. (2026) · Journal of Information and Knowledge Management · doi:10.24191/1pd5sq41
Jarosz, S. F. (2025) · Data Engineering and Applications · doi:10.64972/dea.2025.v4i2.1994d:43-56
Ethical Challenges and AI Governance in Social Work
Huang, J., Yang, F., & Lee, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-18443-6_22
Khalifa, M., & Taha, A. (2026) · World Research of Business Administration Journal · doi:10.56830/wrba03202604
Searcy, A., & Kacem, T. (2026) · Integrated Communications, Navigation and Surveillance Conference (ICNS) · doi:10.1109/icns69853.2026.11570567
Diffusion of Innovation Factors Influencing User Trust and Adoption of AI-Based Cybersecurity Tools
Muhudin, A., Hussein, O. D., Osoble, A. M., Mondal, J., Mohamud, A. A., Omar, A. A., & Ali, I. M. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2702157
ElSayary, A. (2026) · Routledge eBooks · doi:10.4324/9781003657590
Responsible AI Assistants in High School Cyber Education: Strategic and Root-Cause Analysis
Rishat, M. A. S. A., Akter, R., Ahmad, M. M., Hossain, G., & Ovi, P. R. (2026) · International Conference on Artificial Intelligence, Robotics and Control (AIRC) · doi:10.1109/airc69745.2026.11631440
Managing Security Risks in AI Deployment
Mudassir, N., Waris, A., & Shehzad, A. (2026) · Springer eBooks · doi:10.1007/978-981-92-0875-3_13
Nair, A. J., Manohar, S., & Rao, S. R. (2026) · Journal of Service Theory and Practice · doi:10.1108/jstp-10-2025-0420
AI governance under threat managing data poisoning, drift, and integrity challenges
Shanmugam, U., Rajendran, M. K., Natarajan, J., & Karri, V. V. S. R. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01959-w
Nair, A. J., Manohar, S., Rao, S. R., & Shyna, P. K. (2026) · The Bottom Line Managing Library Finances · doi:10.1108/bl-12-2025-0265
AI-Powered Claims Intelligence for Identifying Billing Anomalies and Fraud in Medicare and Medicaid
-, R. P. (2025) · Journal of Computer Science and Technology Studies · doi:10.32996/jcsts.2025.7.10.32 · Cited by 1
Agentic AI Trustworthiness Is a Full-Stack Problem: A Framework from Hardware to Governance
Farahani, B., Rouintan, M., Vahidinia, P., & Firouzi, F. (2026) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins69995.2026.11715577
LLM-Based IAS: Facilitating Trustworthiness Through Transparency
Black, A., Smith, G., Francia, G., & El-Sheikh, E. (2026) · Studies in big data · doi:10.1007/978-3-032-23522-0_27
Zhou, S. (2026) · International journal of law, crime and justice · doi:10.1016/j.ijlcj.2026.100913
Metadata
- Authors
- Polemi, N., Praça, I., Kioskli, K., & Bécue, A.
- Affiliations
- University of Piraeus (GR)
- Grupo de Investigação em Engenharia e Computação Inteligente para a Inovação e o Desenvolvimento (PT)
- University of Essex (GB)
- Thales (France) (FR)
- Corresponding author
- Polemi, Nineta
- Venue
- Frontiers in Big Data
- Publisher
- Frontiers Media SA
- Published
- 2024-05-09
- Volume
- 7
- Pages
- 1381163-1381163
- ISSN
- 2624-909X (ISSN-L)
- PMC
- PMC11119750
- OpenAlex
- W4396775672
- Cited by
- 46
- References
- 24
- Citations by year
- 2026: 22 · 2025: 21 · 2024: 3
- FWCI
- 19.07
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Big Data (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- European Commission (101121042, 101135932)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
- Keywords
- trustworthy AI, AI risk management, human-AI interaction, data poisoning, backdoors, algorithmic bias, misinformation, privacy erosion, AI security, ENISA, AI legislation, chatbots, AI ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.