The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Explainable AI under contract and tort law: legal incentives and technical challenges
Open accessAbstract
This paper shows that the law, in subtle ways, may set hitherto unrecognized incentives for the adoption of explainable machine learning applications. In doing so, we make two novel contributions. First, on the legal side, we show that to avoid liability, professional actors, such as doctors and managers, may soon be legally compelled to use explainable ML models. We argue that the importance of explainability reaches far beyond data protection law, and crucially influences questions of contractual and tort liability for the use of ML models. To this effect, we conduct two legal case studies, in medical and corporate merger applications of ML. As a second contribution, we discuss the (legally required) trade-off between accuracy and explainability and demonstrate the effect in a technical case study in the context of spam classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013) · arXiv · doi:10.48550/arxiv.1312.6034 · Cited by 5,370
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., & Samek, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130140 · Cited by 4,524
Machine Learning Applications in Cancer Prognosis and Prediction
Kourou, K., Exarchos, T. P., Exarchos, K. P., Karamouzis, M. V., & Fotiadis, D. I. (2015) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2014.11.005 · Cited by 3,338
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
Research works printed but not linked: 38
- Almeida T, Hidalgo JMG, Silva TP (2013) Towards sms spam filtering: results under a new dataset. Int J Inf Secur Sci 2(1):1–18
- Arras L, Horn F, Montavon G, Müller KR, Samek W (2017) What is relevant in a text document?: An interpretable machine learning approach. PloS one 12(8):e0181142 · DOI · Paper page
- Biran O, Cotton C (2017) Explanation and justification in machine learning: a survey. In: IJCAI-17 workshop on explainable AI (XAI), pp 1–6
- Chen C, Lin K, Rudin C, Shaposhnik Y, Wang S, Wang T (2018) An interpretable model with globally consistent explanations for credit risk. arXiv preprint arXiv:181112615
- Cowgill B (2017) Automating judgement and decision-making: theory and evidence from résumé screening. In: Columbia University, 2015 Empirical Management Conference
- De Fauw J (2018) Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat Med 24(9):1342 · DOI · Paper page
- Droste W (2018) Intelligente Medizinprodukte. Zeitschrift fr das gesamte Medizinprodukterecht 18(4):109–114
- Froomkin M (2018) When AIs outperform doctors: confronting the challenges of a tort-induced over-reliance on machine learning. Arizona Law Review, Forthcoming; University of Miami Legal Studies 18(3) · DOI
- Goodman B, Flaxman S (2016) Eu regulations on algorithmic decision-making and a right to explanation. In: ICML workshop on human interpretability in machine learning (WHI 2016), New York, NY. arxiv:1606.08813 v1 · arXiv
- Greenberg MD (2009) Medical malpractice and new devices: defining an elusive standard of care. Health Matrix 19:423
- Grundmann S (2012) European company law—organization finance and capital markets. Intersentia, Cambridge
- Hart D (2000) Evidenz-basierte Medizin und Gesundheitsrecht. MedR-Medizinrecht 18(1):1–5 · doi:10.1007/s003500050001
- Hume D (2016) An enquiry concerning human understanding. In: Seven masterpieces of philosophy, Routledge, pp 191–284
- Jaklevic C (2017) MD Anderson cancer centers IBM Watson project fails, and so did the journalism related to it. Health News Review
- Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA (2018) The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med 24(11):1716 · DOI · Paper page
- Kraakman R (2017) The anatomy of corporate law—a comparative and functional approach. Oxford University Press, Oxford · doi:10.1093/acprof:oso/9780198739630.001.0001
- Lapuschkin S, Wäldchen S, Binder A, Montavon G, Samek W, Müller KR (2019) Unmasking clever hans predictors and assessing what machines really learn. Nat Commun 10(1):1096 · DOI · Paper page
- Laufs A (1990) Die Entwicklung des Arztrechts. NJur Wochenschr 24:1507–1513
- Malgieri G, Comandé G (2017) Why a right to legibility of automated decision-making exists in the general data protection regulation. Int Data Priv Law 7(6):243–265 · DOI · Paper page
- Monroe D (2018) AI, explain yourself. Commun ACM 61(11):11–13 · DOI
- Mori T, Uchihira N (2018) Balancing the trade-off between accuracy and interpretability in software defect prediction. Empirical Softw Eng 24:1–47
- Press X (2018) China focus: AI beats human doctors in neuroimaging recognition contest. http://www.xinhuanet.com/english/2018-06/30/c_137292451.htm. Accessed 10 Nov 2019
- Ribeiro MT, Singh S, Guestrin C (2016) Why should I trust you?: explaining the predictions of any classifier. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135–1144 · DOI · Paper page
- Rosoff AJ (2001) Evidence-based medicine and the law: the courts confront clinical practice guidelines. J Health Politics Policy Law 26(2):327–368 · doi:10.1215/03616878-26-2-327
- Rudin C, Ustun B (2018) Optimized scoring systems: toward trust in machine learning for healthcare and criminal justice. Interfaces 48(5):449–466 · DOI
- Samek W, Wiegand T, Müller KR (2017) Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:170808296
- Selbst AD (2019) Negligence and AI’s human users. Boston University Law Review, Forthcoming
- Selbst AD, Barocas S (2018) The intuitive appeal of explainable machines. Fordham L Rev 87:1085
- Selbst AD, Powles J (2017) Meaningful information and the right to explanation. Int Data Priv Law 7(4):233–242 · DOI · Paper page
- Shao B, Asatani K, Sataka I (2018) Analyzing mergers and acquisitions (M&A) in Japan using AI methods. In: Proceedings of the annual conference of JSAI. The Japanese Society for Artificial Intelligence, pp 2J1–214
- Shibayama S (2008) Effect of mergers and acquisitions on drug discovery: perspective from a case study of a Japanese pharmaceutical company. Drug Discov Today 13:86–93 · doi:10.1016/j.drudis.2007.10.015
- Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 58:267–288 · DOI · Paper page
- Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24(1):18–28 · DOI · Paper page
- Twigg-Flessner C (2013) The Europeanisation of European contract law. Routledge, Abingdon · doi:10.4324/9780203549377
- Varzaly J (2012) Protecting the authority of directors: an empirical analysis of the statutory business judgment rule. J Corp Law Stud 12:429–463 · doi:10.5235/jcls.12.2.429
- Wischmeyer T (2018) Regulierung intelligenter systeme. Archiv des öffentlichen Rechts 143(1):1–66 · DOI
- Witten IH, Frank E, Hall MA, Pal CJ (2016) Data mining: practical machine learning tools and techniques. Morgan Kaufmann, Burlington
- Zuo Z, Loster M, Krestel R, Naumann F (2017) Uncovering business relationships: context-sensitive relationship extraction for difficult relationship types. In: Proceedings of the conference Lernen, Wissen, Daten, Analysen (LWDA), vol 1917, pp 271–283
Cited by
Explainability for artificial intelligence in healthcare: a multidisciplinary perspective
the Precise4Q consortium, Amann, J., Blasimme, A., Vayena, E., Frey, D., & Madai, V. I. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01332-6 · Cited by 2,203
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
Zhang, Z., Hamadi, H. A., Damiani, E., Yeun, C. Y., & Taher, F. (2022) · IEEE Access · doi:10.1109/access.2022.3204051 · Cited by 450
Kiseleva, A., Kotzinos, D., & De Hert, P. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.879603 · Cited by 278
A literature review on applications of explainable artificial intelligence (XAI)
Kalasampath, K., Spoorthi, K. N., Sajeev, S., Kuppa, S. S., Ajay, K., & Maruthamuthu, A. (2025) · IEEE Access · doi:10.1109/access.2025.3546681 · Cited by 180
Higgins, D., & Madai, V. I. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000052 · Cited by 118
Metadata
- Authors
- Hacker, P., Krestel, R., Grundmann, S., & Naumann, F.
- Venue
- Artificial Intelligence and Law
- Published
- 2020-01-19
- Volume
- 28
- Issue
- 4
- Pages
- 415-439
- ISSN
- 0924-8463 (ISSN-L)
- 1572-8382
- OpenAlex
- W3000576676
- Cited by
- 186
- References
- 21
- FWCI
- 11.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- AXA Research Fund
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Explainable AI under contract and tort law: legal incentives and technical challenges. https://app.cochat.ai/papers/10.1007/s10506-020-09260-6
- The paper
- Hacker, P., Krestel, R., Grundmann, S., & Naumann, F. (2020). Explainable AI under contract and tort law: legal incentives and technical challenges. Artificial Intelligence and Law. https://doi.org/10.1007/s10506-020-09260-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.