Metrics, Explainability and the European AI Act Proposal
Open accessAbstract
On 21 April 2021, the European Commission proposed the first legal framework on Artificial Intelligence (AI) to address the risks posed by this emerging method of computation. The Commission proposed a Regulation known as the AI Act. The proposed AI Act considers not only machine learning, but expert systems and statistical models long in place. Under the proposed AI Act, new obligations are set to ensure transparency, lawfulness, and fairness. Their goal is to establish mechanisms to ensure quality at launch and throughout the whole life cycle of AI-based systems, thus ensuring legal certainty that encourages innovation and investments on AI systems while preserving fundamental rights and values. A standardisation process is ongoing: several entities (e.g., ISO) and scholars are discussing how to design systems that are compliant with the forthcoming Act, and explainability metrics play a significant role. Specifically, the AI Act sets some new minimum requirements of explicability (transparency and explainability) for a list of AI systems labelled as “high-risk” listed in Annex III. These requirements include a plethora of technical explanations capable of covering the right amount of information, in a meaningful way. This paper aims to investigate how such technical explanations can be deemed to meet the minimum requirements set by the law and expected by society. To answer this question, with this paper we propose an analysis of the AI Act, aiming to understand (1) what specific explicability obligations are set and who shall comply with them and (2) whether any metric for measuring the degree of compliance of such explanatory documentation could be designed. Moreover, by envisaging the legal (or ethical) requirements that such a metric should possess, we discuss how to implement them in a practical way. More precisely, drawing inspiration from recent advancements in the theory of explanations, our analysis proposes that metrics to measure the kind of explainability endorsed by the proposed AI Act shall be risk-focused, model-agnostic, goal-aware, intelligible, and accessible. Therefore, we discuss the extent to which these requirements are met by the metrics currently under discussion.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Through measures such as ethical evaluation of AI applications used in learning, regulating access to generative models, establishing protocols for the use of AI in research, or promoting decision-making transparency in automated systems, institutions create a concrete framework that facilitates legal and ethical literacy.
“Through measures such as ethical evaluation of AI applications used in learning, regulating access to generative models, establishing protocols for the use of AI in research, or promoting decision-making transparency in automated systems, institutions create a concrete framework that facilitates legal and ethical literacy [51-53].”
Cites
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · see citing works
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294 · see citing works
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302 · see citing works
Fraassen, B. C. V. (1980) · doi:10.1093/0198244274.001.0001 · Cited by 4,682 · see citing works
Scientific Explanation and the Causal Structure of the World
Salmon, W. C. (1985) · Princeton University Press eBooks · doi:10.1515/9780691221489 · Cited by 2,484 · see citing works
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx005 · Cited by 1,308 · see citing works
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925 · see citing works
Veale, M., & Zuiderveen Borgesius, F. (2021) · Computer Law Review International · doi:10.9785/cri-2021-220402 · Cited by 805 · see citing works
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · see citing works
Evaluating the quality of machine learning explanations: a survey on methods and metrics
Zhou, J., Gandomi, A. H., Chen, F., & Holzinger, A. (2021) · Electronics · doi:10.3390/electronics10050593 · Cited by 606 · see citing works
Philosophy and the Scientific Image of Man
Sellars, W. (1963) · University of Pittsburgh Press eBooks · doi:10.2307/jj.5973228.6 · Cited by 511 · see citing works
Holzinger, A., Carrington, A., & Müller, H. (2020) · KI - Künstliche Intelligenz · doi:10.1007/s13218-020-00636-z · Cited by 406 · see citing works
Explication as a Method of Conceptual Re-engineering
Brun, G. (2015) · Erkenntnis · doi:10.1007/s10670-015-9791-5 · Cited by 188 · see citing works
Keane, M. T., Kenny, E. M., Delaney, E. D., & Smyth, B. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/609 · Cited by 169 · see citing works
Carnapian explication, formalisms as cognitive tools, and the paradox of adequate formalization
Novaes, C. D., & Reck, E. H. (2015) · Synthese · doi:10.1007/s11229-015-0816-z · Cited by 123 · see citing works
Mental Models and Causal Explanation: Judgements of Probable Cause and Explanatory Relevance
Hilton, D. (1996) · Thinking & Reasoning · doi:10.1080/135467896394447 · Cited by 117 · see citing works
Varieties of AI Explanations Under the Law. From the GDPR to the AIA, and Beyond
Hacker, P., & Passoth, J.-H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-031-04083-2_17 · Cited by 83 · see citing works
A comparative analysis of rule-based, model-agnostic methods for explainable artificial intelligence
Vilone, G., Rizzo, L., & Longo, L. (2021) · Arrow - TU Dublin (Technological University Dublin) · doi:10.21427/z4x3-3f86 · Cited by 14 · see citing works
Scientific Realism, Metaphysical Antirealism and the No Miracle Arguments
Alai, M. (2020) · Foundations of Science · doi:10.1007/s10699-020-09691-z · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
The role of explainable AI in the context of the AI Act
Panigutti, C., Hamon, R., Hupont, I., Llorca, D. F., Yela, D. F., Junklewitz, H., Scalzo, S., Mazzini, G., Sánchez, I., Garrido, J. S., et al. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594069 · Cited by 171 · see citing works
Co-design of human-centered, explainable AI for clinical decision support
Panigutti, C., Beretta, A., Fadda, D., Giannotti, F., Pedreschi, D., Perotti, A., & Rinzivillo, S. (2023) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3587271 · Cited by 127 · see citing works
Explainable AI for earth observation: A review including societal and regulatory perspectives
Gevaert, C. M. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102869 · Cited by 116 · see citing works
Artificial intelligence in government: Concepts, standards, and a unified framework
Straub, V. J., Morgan, D., Bright, J., & Margetts, H. Z. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2023.101881 · Cited by 120 · see citing works
Cabitza, F., Campagner, A., Malgieri, G., Natali, C., Schneeberger, D., Stoeger, K., & Holzinger, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118888 · Cited by 89 · see citing works
Nannini, L., Balayn, A., & Smith, A. L. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594074 · Cited by 87 · see citing works
Oncioiu, I., & Bularca, A. R. (2025) · Societies · doi:10.3390/soc15060144 · Cited by 64 · see citing works
Bridging the Transparency Gap: What Can Explainable AI Learn from the AI Act?
Gyevnár, B., Ferguson, N., & Schäfer, B. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230367 · Cited by 43 · see citing works
Kharchenko, V. S., Fesenko, H. V., & Illiashenko, O. A. (2022) · Sensors · doi:10.3390/s22134865 · Cited by 49 · see citing works
ISO/IEC quality standards for AI engineering
Oviedo, J., Rodríguez, M., Trenta, A., Cannas, D., Natale, D., & Piattini, M. G. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100681 · Cited by 42 · see citing works
Normative Challenges of Risk Regulation of Artificial Intelligence
Orwat, C., Bareis, J., Folberth, A., Jahnel, J., & Wadephul, C. (2024) · NanoEthics · doi:10.1007/s11569-024-00454-9 · Cited by 52 · see citing works
Sovrano, F., & Vitali, F. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00872-x · Cited by 33 · see citing works
Self-citationNavigating the EU AI Act: A Methodological Approach to Compliance for Safety-critical Products
Kelly, J., Zafar, S. A., Heidemann, L., Zacchi, J.-V., Espinoza, D., & Mata, N. (2024) · 2024 IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00179 · Cited by 30 · see citing works
Amaliah, N. R., Tjahjono, B., & Palade, V. (2025) · Electronics · doi:10.3390/electronics14173384 · Cited by 34 · see citing works
Operationalizing Explainable Artificial Intelligence in the European Union Regulatory Ecosystem
Nannini, L., Alonso, J. M., Catalá, A., Lama, M., & Barro, S. (2024) · IEEE Intelligent Systems · doi:10.1109/mis.2024.3383155 · Cited by 30 · see citing works
Chun, J., & Elkins, K. (2023) · International Journal of Digital Humanities · doi:10.1007/s42803-023-00069-8 · Cited by 19 · see citing works
Simplifying software compliance: AI technologies in drafting technical documentation for the AI Act
Sovrano, F., Hine, E., Anzolut, S., & Bacchelli, A. (2025) · Empirical Software Engineering · doi:10.1007/s10664-025-10645-x · Cited by 18 · see citing works
Self-citationLane, L. (2023) · Internet Policy Review · doi:10.14763/2023.1.1697 · Cited by 11 · see citing works
Explainable AI: Can the AI Act and the GDPR go out for a date?
Nišević, M., Cuypers, A., & Bruyne, J. D. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10649994 · Cited by 13 · see citing works
Zehlike, M., Loosley, A., Jonsson, H., Wiedemann, E., & Hacker, P. (2025) · Artificial Intelligence · doi:10.1016/j.artint.2024.104280 · Cited by 16 · see citing works
Pagallo, U., & Durante, M. (2022) · J — Multidisciplinary Scientific Journal · doi:10.3390/j5010011 · Cited by 13 · see citing works
Sposini, L. (2024) · Journal of Digital Technologies and Law · doi:10.21202/jdtl.2024.5 · Cited by 11 · see citing works
Spoladore, D., Stella, F., Tosi, M., Lorenzini, E. C., & Bettini, C. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.109001 · Cited by 10 · see citing works
Combining shallow and deep learning approaches against data scarcity in legal domains
Sovrano, F., Palmirani, M., & Vitali, F. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2022.101715 · Cited by 10 · see citing works
Self-citationHacia una gobernanza algorítmica transparente: auditoría de sesgo. Estudio de caso.
Gracia, J. L. B. (2025) · Cuadernos de Gobierno y Administración Pública · doi:10.5209/cgap.97604 · Cited by 8 · see citing works
Adamu, S., Iorliam, A., & Asilkan, Ö. (2025) · Journal of Future Artificial Intelligence and Technologies · doi:10.62411/faith.3048-3719-58 · Cited by 7 · see citing works
Morandini, S., Fraboni, F., Balatti, E., Hackmann, A., Brendel, H., Puzzo, G., Volpi, L., Giusino, D., Angelis, M. D., & Pietrantoni, L. (2023) · AHFE international · doi:10.54941/ahfe1004068 · Cited by 7 · see citing works
Transformative Impact of the EU AI Act on Maritime Autonomous Surface Ships
Lee, Y.-G., Lee, C.-H., Jeon, Y.-H., & Bae, J.-H. (2024) · Laws · doi:10.3390/laws13050061 · Cited by 7 · see citing works
MAG-BERT-ARL for Fair Automated Video Interview Assessment
Putra, B., Azizah, K., Mawalim, C. O., Hanif, I. A., Sakti, S., Leong, C. W., & Okada, S. (2024) · IEEE Access · doi:10.1109/access.2024.3473314 · Cited by 6 · see citing works
On the Explainability of Financial Robo-Advice Systems
Vilone, G., Sovrano, F., & Lognoul, M. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-63803-9_12 · Cited by 6 · see citing works
Self-citationWalke, F., Bennek, L., & Winkler, T. J. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-80122-8_8 · Cited by 6 · see citing works
Approach to global regulations around AI
Cardozo, G. T. (2023) · LatIA · doi:10.62486/latia20237 · Cited by 2 · see citing works
AI Act High-Risk Requirements Readiness: Industrial Perspectives and Case Company Insights
Wagner, M., Gupta, R., Borg, M., Engström, E., & Lysek, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-78392-0_5 · Cited by 5 · see citing works
Predicting handball matches with machine learning and statistically estimated team strengths
Felice, F., & Ley, C. (2025) · Journal of Sports Analytics · doi:10.1177/22150218251313937 · Cited by 5 · see citing works
A Critical Look at the EU AI Act’s Requirements and Affected Systems – Who Must Explain What?
Wagner, M., Wittmann, M.-T., & Borg, M. (2025) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew66121.2025.00074 · Cited by 4 · see citing works
XAI: regulatory and ethical aspects
Nannini, L. (2025) · Elsevier eBooks · doi:10.1016/b978-0-44-329135-7.00020-5 · Cited by 4 · see citing works
The Impact of AI and Data Analytics on Project Management Information Systems (PMIS)
Jariwala, M. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0700-8.ch004 · Cited by 4 · see citing works
Domain-Aware Feature Learning with Grammar-Guided Genetic Programming
Ingelse, L., & Fonseca, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-29573-7_15 · Cited by 4 · see citing works
Colmenarejo, A. B., State, L., & Comandé, G. (2025) · International Review of Law Computers & Technology · doi:10.1080/13600869.2025.2497633 · Cited by 3 · see citing works
Tomczyk, P., Brüggemann, P., Mergner, N., & Petrescu, M. (2024) · Springer proceedings in business and economics · doi:10.1007/978-3-031-62135-2_15 · Cited by 3 · see citing works
Towards Transparent AI: How will the AI Act Shape the Future?
Moreira, N. A., Freitas, P. M., & Nováis, P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73497-7_24 · Cited by 3 · see citing works
Algorithmic Knowability: A Unified Approach to Explanations in the AI Act
Sapienza, S., & Palmirani, M. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08317-3_9 · Cited by 2 · see citing works
Self-citationSurvey on Explainable AI for Traditional Machine Learning and Domains
Hanif, A., Shawi, R. E., Beheshti, A., & Benatallah, B. (2026) · ACM Computing Surveys · doi:10.1145/3806829 · Cited by 3 · see citing works
Sovrano, F., & Vitali, F. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-44064-9_2 · Cited by 2 · see citing works
Self-citationGood Administration in AI-Enhanced Banking Supervision: A Risk-Based ApproachPreprint
Azzutti, A., Batista, P. M., & Ringe, W.-G. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4430642 · Cited by 2 · see citing works
The Impact of the Artificial Intelligence Act on ChatGPT
Wang, Y. (2024) · Lecture Notes in Education Psychology and Public Media · doi:10.54254/2753-7048/44/20230134 · Cited by 1 · see citing works
Leveraging Existing Road-Vehicle Standards to Address EU AI Act Compliance
Zafar, S. A., Kelly, J., Heidemann, L., & Mata, N. (2025) · doi:10.1109/raie66699.2025.00017 · Cited by 1 · see citing works
Rizzo, A., & Hassan, G. (2026) · World Tax Journal · doi:10.59403/560kfb · Cited by 1 · see citing works
A question bank to assess inclusive AI
Shams, R. A., Zowghi, D., & Bano, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01068-5 · Cited by 1 · see citing works
van Beem, E. H. (2026) · International Review of Law Computers & Technology · doi:10.1080/13600869.2026.2668320 · Cited by 1 · see citing works
A Review of Taxonomies of Explainable AI (XAI) Evaluation
Speith, T. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806537 · Cited by 1 · see citing works
AI Transparency: Governance Compliance or Stakeholder Requirements?
Bano, M., & Zowghi, D. (2026) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re68928.2026.00021 · Cited by 1 · see citing works
“Giurisprudenza predittiva” Risultati operativi e prospettive future
Musella, G. (2023) · doi:10.30687/978-88-6969-765-4/013 · Cited by 1 · see citing works
Mental State Classification Using EEG Signals: Ethics, Law and Challenges
Nahon, R., Bagheri, N., Varni, G., Tartaglione, E., & Nguyen, V.-T. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-74630-7_28 · Cited by 1 · see citing works
Fairness of AI Systems in the Legal Context
Paternolli, V., Preda, M. D., & Giacobazzi, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-92648-8_4 · Cited by 1 · see citing works
Ethical Considerations in Artificial Intelligence and Machine Learning
Rodrigues, M., Lino, R., Alves, F., & Nováis, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02728-3_3 · Cited by 1 · see citing works
Li, Z., Lei, F., Ermakov, D. N., Symaniuk, N., Poletaev, I. V., Aziz, N. M. H., Obaid, A., & Ivanov, P. I. (2024) · RUDN Journal of Engineering Researches · doi:10.22363/2312-8143-2024-25-2-173-185 · Cited by 1 · see citing works
Normative Challenges of Risk Regulation of Artificial Intelligence and Automated Decision-MakingPreprint
Orwat, C., Bareis, J., Folberth, A., Jahnel, J., & Wadephul, C. (2022) · doi:10.31235/osf.io/qkx8b · Cited by 1 · see citing works
A África Contemporânea: do colonialismo aos dias atuais, de Pio Penna Filho
Chagas-Bastos, F. H. (2012) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.20889/6863
Identifying influential individuals and predicting future demand of chronic kidney disease patients
Nenova, Z. D., & Bartelt, V. L. (2024) · Decision Sciences · doi:10.1111/deci.12650
Falvo, D. J., Weidener, L., & Karlsson, M. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.01.08.631843
FLAIRS: Federated Learning AI Regulatory Sandbox
Roszel, M., Pontiveros, B. B. F., & State, R. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-74630-7_31
Diega, G. N. L. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009279079.015
The Implications of Emerging Product Design and Business Models
Elvy, S.-A., & Kim, N. S. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009279079.010
Walke, F., Bennek, L., & Winkler, T. J. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-80125-9_23
Seed-Induced Uniqueness in Transformer Models: Subspace Alignment Governs Subliminal Transfer
Okatan, A. S., Akbaş, M. İ., Kandel, L. N., & Peköz, B. (2025) · Cyber Awareness and Research Symposium (CARS) · doi:10.1109/cars67163.2025.11337559
Dossier sobre l’impacte del Reglament europeu d’intel·ligència artificial al sector públic
Rodríguez, A. C. (2025) · Revista Catalana de Dret Públic · doi:10.58992/rcdp.i71.2025.4544
Applications and Challenges of Generative AI in the Medical Field
Tao, Z., & Li, L. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/407369
Challenges and ethical considerations in implementing Machine Learning
Galal, M. K., & Said, Z. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-33943-1.00003-4
Ravichandran, A. (2025) · International Journal of Computational and Experimental Science and Engineering · doi:10.22399/ijcesen.5372
Explainability, Standardisation, and the AI Act
Sapienza, S., & Palmirani, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-34304-8_1
Self-citation
- Authors
- Sovrano, F., Sapienza, S., Palmirani, M., & Vitali, F.
- Affiliations
- University of Bologna (IT)
- Corresponding author
- Palmirani, Monica
- Venue
- J
- Publisher
- MDPI AG
- Published
- 2022-02-18
- Volume
- 5
- Issue
- 1
- Pages
- 126-138
- ISSN
- 2571-8800 (ISSN-L)
- OpenAlex
- W4283384010
- Cited by
- 71
- References
- 19
- Citations by year
- 2026: 9 · 2025: 25 · 2024: 16 · 2023: 13 · 2022: 7 · 2012: 1
- FWCI
- 5.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- J — Multidisciplinary Scientific Journal (publishedVersion, cc-by)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion, cc-by)
- Zurich Open Repository and Archive (University of Zurich)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Law › Digitalization, Law, and Regulation
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Keywords
- EU AI Act, explainability metrics, high-risk AI systems, transparency, regulatory compliance, explainable AI, AI regulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
