Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 186

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Explainable AI under contract and tort law: legal incentives and technical challenges

Open access
Hacker, Philipp, Krestel, Ralf, Grundmann, Stefan, Naumann, Felix·2020·Artificial Intelligence and Law

Abstract

This paper shows that the law, in subtle ways, may set hitherto unrecognized incentives for the adoption of explainable machine learning applications. In doing so, we make two novel contributions. First, on the legal side, we show that to avoid liability, professional actors, such as doctors and managers, may soon be legally compelled to use explainable ML models. We argue that the importance of explainability reaches far beyond data protection law, and crucially influences questions of contractual and tort liability for the use of ML models. To this effect, we conduct two legal case studies, in medical and corporate merger applications of ML. As a second contribution, we discuss the (legally required) trade-off between accuracy and explainability and demonstrate the effect in a technical case study in the context of spam classification.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10506-020-09260-6

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Research works printed but not linked: 38

  1. Almeida T, Hidalgo JMG, Silva TP (2013) Towards sms spam filtering: results under a new dataset. Int J Inf Secur Sci 2(1):1–18
  2. Arras L, Horn F, Montavon G, Müller KR, Samek W (2017) What is relevant in a text document?: An interpretable machine learning approach. PloS one 12(8):e0181142 · DOI · Paper page
  3. Biran O, Cotton C (2017) Explanation and justification in machine learning: a survey. In: IJCAI-17 workshop on explainable AI (XAI), pp 1–6
  4. Chen C, Lin K, Rudin C, Shaposhnik Y, Wang S, Wang T (2018) An interpretable model with globally consistent explanations for credit risk. arXiv preprint arXiv:181112615
  5. Cowgill B (2017) Automating judgement and decision-making: theory and evidence from résumé screening. In: Columbia University, 2015 Empirical Management Conference
  6. De Fauw J (2018) Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat Med 24(9):1342 · DOI · Paper page
  7. Droste W (2018) Intelligente Medizinprodukte. Zeitschrift fr das gesamte Medizinprodukterecht 18(4):109–114
  8. Froomkin M (2018) When AIs outperform doctors: confronting the challenges of a tort-induced over-reliance on machine learning. Arizona Law Review, Forthcoming; University of Miami Legal Studies 18(3) · DOI
  9. Goodman B, Flaxman S (2016) Eu regulations on algorithmic decision-making and a right to explanation. In: ICML workshop on human interpretability in machine learning (WHI 2016), New York, NY. arxiv:1606.08813 v1 · arXiv
  10. Greenberg MD (2009) Medical malpractice and new devices: defining an elusive standard of care. Health Matrix 19:423
  11. Grundmann S (2012) European company law—organization finance and capital markets. Intersentia, Cambridge
  12. Hart D (2000) Evidenz-basierte Medizin und Gesundheitsrecht. MedR-Medizinrecht 18(1):1–5 · doi:10.1007/s003500050001
  13. Hume D (2016) An enquiry concerning human understanding. In: Seven masterpieces of philosophy, Routledge, pp 191–284
  14. Jaklevic C (2017) MD Anderson cancer centers IBM Watson project fails, and so did the journalism related to it. Health News Review
  15. Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA (2018) The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nat Med 24(11):1716 · DOI · Paper page
  16. Kraakman R (2017) The anatomy of corporate law—a comparative and functional approach. Oxford University Press, Oxford · doi:10.1093/acprof:oso/9780198739630.001.0001
  17. Lapuschkin S, Wäldchen S, Binder A, Montavon G, Samek W, Müller KR (2019) Unmasking clever hans predictors and assessing what machines really learn. Nat Commun 10(1):1096 · DOI · Paper page
  18. Laufs A (1990) Die Entwicklung des Arztrechts. NJur Wochenschr 24:1507–1513
  19. Malgieri G, Comandé G (2017) Why a right to legibility of automated decision-making exists in the general data protection regulation. Int Data Priv Law 7(6):243–265 · DOI · Paper page
  20. Monroe D (2018) AI, explain yourself. Commun ACM 61(11):11–13 · DOI
  21. Mori T, Uchihira N (2018) Balancing the trade-off between accuracy and interpretability in software defect prediction. Empirical Softw Eng 24:1–47
  22. Press X (2018) China focus: AI beats human doctors in neuroimaging recognition contest. http://www.xinhuanet.com/english/2018-06/30/c_137292451.htm. Accessed 10 Nov 2019
  23. Ribeiro MT, Singh S, Guestrin C (2016) Why should I trust you?: explaining the predictions of any classifier. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135–1144 · DOI · Paper page
  24. Rosoff AJ (2001) Evidence-based medicine and the law: the courts confront clinical practice guidelines. J Health Politics Policy Law 26(2):327–368 · doi:10.1215/03616878-26-2-327
  25. Rudin C, Ustun B (2018) Optimized scoring systems: toward trust in machine learning for healthcare and criminal justice. Interfaces 48(5):449–466 · DOI
  26. Samek W, Wiegand T, Müller KR (2017) Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:170808296
  27. Selbst AD (2019) Negligence and AI’s human users. Boston University Law Review, Forthcoming
  28. Selbst AD, Barocas S (2018) The intuitive appeal of explainable machines. Fordham L Rev 87:1085
  29. Selbst AD, Powles J (2017) Meaningful information and the right to explanation. Int Data Priv Law 7(4):233–242 · DOI · Paper page
  30. Shao B, Asatani K, Sataka I (2018) Analyzing mergers and acquisitions (M&A) in Japan using AI methods. In: Proceedings of the annual conference of JSAI. The Japanese Society for Artificial Intelligence, pp 2J1–214
  31. Shibayama S (2008) Effect of mergers and acquisitions on drug discovery: perspective from a case study of a Japanese pharmaceutical company. Drug Discov Today 13:86–93 · doi:10.1016/j.drudis.2007.10.015
  32. Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Methodol) 58:267–288 · DOI · Paper page
  33. Timmermans S, Mauck A (2005) The promises and pitfalls of evidence-based medicine. Health Aff 24(1):18–28 · DOI · Paper page
  34. Twigg-Flessner C (2013) The Europeanisation of European contract law. Routledge, Abingdon · doi:10.4324/9780203549377
  35. Varzaly J (2012) Protecting the authority of directors: an empirical analysis of the statutory business judgment rule. J Corp Law Stud 12:429–463 · doi:10.5235/jcls.12.2.429
  36. Wischmeyer T (2018) Regulierung intelligenter systeme. Archiv des öffentlichen Rechts 143(1):1–66 · DOI
  37. Witten IH, Frank E, Hall MA, Pal CJ (2016) Data mining: practical machine learning tools and techniques. Morgan Kaufmann, Burlington
  38. Zuo Z, Loster M, Krestel R, Naumann F (2017) Uncovering business relationships: context-sensitive relationship extraction for difficult relationship types. In: Proceedings of the conference Lernen, Wissen, Daten, Analysen (LWDA), vol 1917, pp 271–283

Cited by

See all 186

Metadata

Authors
Hacker, P., Krestel, R., Grundmann, S., & Naumann, F.
Venue
Artificial Intelligence and Law
Published
2020-01-19
Volume
28
Issue
4
Pages
415-439
ISSN
  • 0924-8463 (ISSN-L)
  • 1572-8382
OpenAlex
W3000576676
Cited by
186
References
21
FWCI
11.08
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
AXA Research Fund

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Explainable AI under contract and tort law: legal incentives and technical challenges. https://app.cochat.ai/papers/10.1007/s10506-020-09260-6
The paper
Hacker, P., Krestel, R., Grundmann, S., & Naumann, F. (2020). Explainable AI under contract and tort law: legal incentives and technical challenges. Artificial Intelligence and Law. https://doi.org/10.1007/s10506-020-09260-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.