CoChat
Cited by 160

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

Bridging the Gap Between AI and Explainability in the GDPR: Towards Trustworthiness-by-Design in Automated Decision-Making

Hamon, Ronan, Junklewitz, Henrik, Sanchez, Ignacio, Malgieri, Gianclaudio, De Hert, Paul · 2022 · IEEE Computational Intelligence Magazine

Abstract

Can satisfactory explanations for complex machine learning models be achieved in high-risk automated decision-making? How can such explanations be integrated into a data protection framework safeguarding a right to explanation? This article explores from an interdisciplinary point of view the connection between existing legal requirements for the explainability of AI systems set out in the General Data Protection Regulation (GDPR) and the current state of the art in the field of explainable AI. It studies the challenges of providing human legible explanations for current and future AI-based decision-making systems in practice, based on two scenarios of automated decision-making in credit scoring risks and medical diagnosis of COVID-19. These scenarios exemplify the trend towards increasingly complex machine learning algorithms in automated decision-making, both in terms of data and models. Current machine learning techniques, in particular those based on deep learning, are unable to make clear causal links between input data and final decisions. This represents a limitation for providing exact, human-legible reasons behind specific decisions, and presents a serious challenge to the provision of satisfactory, fair and transparent explanations. Therefore, the conclusion is that the quality of explanations might not be considered as an adequate safeguard for automated decision-making processes under the GDPR. Accordingly, additional tools should be considered to complement explanations. These could include algorithmic impact assessments, other forms of algorithmic justifications based on broader AI principles, and new technical developments in trustworthy AI. This suggests that eventually all of these approaches would need to be considered as a whole.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/mci.2021.3129960

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 26 references

Research works printed but not linked: 56

  1. 10.1016/j.clsr.2017.12.003 · DOI
  2. 10.1016/j.clsr.2019.105342 · DOI
  3. 10.21552/EDPL/2016/4/6 · doi:10.21552/edpl/2016/4/6
  4. 10.1093/idpl/ipz028 · DOI
  5. 10.1017/err.2017.40 · DOI
  6. 10.31228/osf.io/es8bm · DOI
  7. 2020, Artificial intelligence cybersecurity challenges – Threat landscape for artificial intelligence
  8. 10.3233/FAIA200380 · DOI
  9. 10.1145/2939672.2939778 · DOI · Paper page
  10. chen, 2018, An interpretable model with globally consistent explanations for credit risk
  11. 10.1145/3233231 · doi:10.1145/3233231 · Paper page
  12. molnar, 2021, ., Interpretable Machine Learning
  13. 10.1007/978-3-319-10590-1_53 · DOI · Paper page
  14. 10.1214/10-STS330 · DOI · Paper page
  15. 10.1145/3236009 · DOI · Paper page
  16. schölkopf, 2019, Causality for machine learning
  17. 10.1145/3442188.3445941 · DOI · Paper page
  18. comandè, 2020, Causality and explanation in ML A lead from the GDPR and an application to personal injury damages
  19. rouvroy, 2013, The end(s) of critique: Data behaviourism versus due process, Privacy Due Process and the Computational Turn, 157
  20. 10.1016/j.clsr.2020.105415 · DOI
  21. 2017, Guidelines on Data Protection Impact Assessment (DPIA)
  22. 2018, Guidelines on automated individual decision-making and profiling for the purposes of regulation 2016/679
  23. 2019, A Definition of AI Main Capabilities and Scientific Disciplines
  24. 2019, Ethics guidelines for trustworthy ai
  25. gebru, 2020, Datasheets for Datasets
  26. murdoch, 2019, Interpretable machine learning definitions methods and applications
  27. 10.1080/01605682.2021.1922098 · DOI · Paper page
  28. 10.1016/S2589-7500(20)30162-X · DOI
  29. 10.1038/s41598-020-76550-z · DOI · Paper page
  30. 10.1016/S2589-7500(20)30199-0 · DOI
  31. 10.2196/23811 · DOI · Paper page
  32. 10.1016/S2589-7500(20)30054-6 · DOI · Paper page
  33. hao, 2020, AI is helping triage coronavirus patients The tools may be here to stay
  34. 10.1016/j.clsr.2018.05.017 · DOI · Paper page
  35. 10.1093/oso/9780198826491.001.0001 · DOI · Paper page
  36. 10.1007/s10506-020-09260-6 · DOI · Paper page
  37. roig, 2017, Safeguards for the right not to be subject to a decision based solely on automated processing (Article 22 GDPR), European Journal of Law and Technology, 8
  38. 10.1093/idpl/ipx019 · DOI · Paper page
  39. 10.1145/3351095.3372875 · DOI
  40. begley, 2020, Explainability for fair machine learning
  41. 10.1093/idpl/ipx022 · DOI · Paper page
  42. 10.1080/17579961.2018.1452176 · DOI · Paper page
  43. 10.1007/978-3-030-50423-6_46 · DOI
  44. 2016, Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data and repealing Directive 95/46/EC (General Data Protection Regulation)
  45. 2019, Atlas of automation Automated decision making and participation in Germany
  46. 10.1145/3442188.3445917 · DOI
  47. demajo, 2020, Explainable AI for interpretable credit scoring
  48. 2021, Proposal for a Regulation laying down harmonised rules on Artificial Intelligence
  49. 10.1016/j.asoc.2020.106263 · DOI · Paper page
  50. 10.3390/risks7010029 · DOI · Paper page
  51. k?osok, 2020, Towards better understanding of complex machine learning models using Explainable Artificial Intelligence (XAI) – Case of Credit Scoring modelling
  52. 0, FICO – Explainable Machine Learning Challenge
  53. 10.1007/978-3-030-22871-2_67 · DOI
  54. henin, 2020, A multi-layered approach for interactive black-box explanations
  55. 10.1007/978-3-030-58342-2_11 · DOI
  56. rathi, 2019, Generating counterfactual and contrastive explanations using shap

Cited by

See all 160

Metadata

Authors
Hamon, R., Junklewitz, H., Sanchez, I., Malgieri, G., & De Hert, P.
Venue
IEEE Computational Intelligence Magazine
Published
2022-02
Volume
17
Issue
1
Pages
72-85
ISSN
  • 1556-603X (ISSN-L)
  • 1556-6048
OpenAlex
W4206025728
Cited by
160
References
26
FWCI
10.99
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Bridging the Gap Between AI and Explainability in the GDPR: Towards Trustworthiness-by-Design in Automated Decision-Making. https://app.cochat.ai/papers/10.1109/mci.2021.3129960
The paper
Hamon, R., Junklewitz, H., Sanchez, I., Malgieri, G., & De Hert, P. (2022). Bridging the Gap Between AI and Explainability in the GDPR: Towards Trustworthiness-by-Design in Automated Decision-Making. IEEE Computational Intelligence Magazine. https://doi.org/10.1109/mci.2021.3129960

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.