CoChat

Conformity Assessments and Post-market Monitoring: A Guide to the Role of Auditing in the Proposed European AI Regulation

Open access
Mökander, Jakob, Axente, Maria, Casolari, Federico, Floridi, Luciano · 2022 · Minds and Machines

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.

Abstract

The proposed European Artificial Intelligence Act (AIA) is the first attempt to elaborate a general legal framework for AI carried out by any major global economy. As such, the AIA is likely to become a point of reference in the larger discourse on how AI systems can (and should) be regulated. In this article, we describe and discuss the two primary enforcement mechanisms proposed in the AIA: the conformity assessments that providers of high-risk AI systems are expected to conduct, and the post-market monitoring plans that providers must establish to document the performance of high-risk AI systems throughout their lifetimes. We argue that the AIA can be interpreted as a proposal to establish a Europe-wide ecosystem for conducting AI auditing, albeit in other words. Our analysis offers two main contributions. First, by describing the enforcement mechanisms included in the AIA in terminology borrowed from existing literature on AI auditing, we help providers of AI systems understand how they can prove adherence to the requirements set out in the AIA in practice. Second, by examining the AIA from an auditing perspective, we seek to provide transferable lessons from previous research about how to refine further the regulatory approach outlined in the AIA. We conclude by highlighting seven aspects of the AIA where amendments (or simply clarifications) would be helpful. These include, above all, the need to translate vague concepts into verifiable criteria and to strengthen the institutional safeguards concerning conformity assessments based on internal checks.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11023-021-09577-4

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 The risk-based approach to AI governance proposed in the AIA
Fig. 1 The risk-based approach to AI governance proposed in the AIACC BY · PubMed Central
Fig. 2 Ways to conduct conformity assessments for high-risk AI systems
Fig. 2 Ways to conduct conformity assessments for high-risk AI systemsCC BY · PubMed Central
Fig. 3 Roles and responsibilities during conformity assessments with the involvement of third-party auditors
Fig. 3 Roles and responsibilities during conformity assessments with the involvement of third-party auditorsCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 59 references

Research works printed but not linked: 21

  1. Barrett C Are the EU GDPR and the California CCPA becoming the de facto global standards for data privacy and protection? The SciTech Lawyer 2019 15 3 24 29
  2. Bradford A The Brussels effect Law Review 2012 107 1 1 68
  3. CDEI The European Commission’s artificial intelligence act highlights the need for an effective AI assurance ecosystem 2021 CDEI
  4. CDEI The need for effective AI assurance 2021 CDEI
  5. ECP Artificial intelligence impact assessment 2018 ECP
  6. European Commission Policy and investment recommendations for trustworthy Artificial Intelligence 2019 European Commission
  7. European Commission EU regulation on European data governance 0340 2020 European Commission
  8. European Commission Recommendation (EU) 2020/518 of 8 April 2020 on a common union toolbox for the use of technology and data to combat and exit from the COVID-19 crisis, in particular concerning mobile applications and the use of anonymes data, OJ [2020] L 114/7 2020 European Commission
  9. European Commission White paper on artificial intelligence—A European approach to excellence and trust 2020 European Commission 27
  10. European Commission ANNEXES to the proposal for a regulation of the European Parliament and of the council 2021 European Commission
  11. European Commission Commission staff working document: Impact assessment accompanying the proposal for a regulation of the European Parliament and of the Council (Artificial Intelligence ACT) 2021 European Commission
  12. European Commission Proposal for regulation of the European parliament and of the council—Laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain Union legislative acts 2021 European Commission
  13. European Parliament Resolution on the Commission evaluation report on the implementation of the general data protection regulation two years after its application 2021 European Commission
  14. European Parliament/Council Directive 2001/95/EC of the European Parliament and of the Council on general product safety Official Journal of the European Communities 2001 4 7 4 17
  15. Fontanelli F Pollicino O Romeo G The Court of Justice of the European Union and the illusion of balancing in internet related disputes The internet and constitutional law. The protection of fundamental rights and constitutional adjudication in Europe 2016 Routledge 94 117
  16. ICO Guidance on the AI auditing framework: Draft guidance for consultation 2020 Information Commissioner’s Office
  17. McCarthy J What is artificial intelligence? 2007 Stanford University
  18. Mitchell TM Machine learning 1997 McGraw-Hill
  19. O’Donoghue C Splittgerber A O’Brien S The proposed European regulation on artificial intelligence—A summary of the obligations, scope and effect 2021 Reed Smith Client Alerts
  20. Russell SJ Norvig P Artificial intelligence: A modern approach 2015 3 Prentice Hall
  21. The European Parliament. (2016). EU general data protection regulation. Official Journal of the European Union, 27 April.

Cited by

Items 101–154 of 154

Metadata

Authors
Mökander, J., Axente, M., Casolari, F., & Floridi, L.
Affiliations
  • University of Oxford (GB)
  • University of Bologna (IT)
Corresponding author
Mökander, Jakob
Venue
Minds and Machines
Published
2021-11-05
Volume
32
Issue
2
Pages
241-268
ISSN
  • 0924-6495 (ISSN-L)
  • 1572-8641
OpenAlex
W3211982349
Cited by
153
References
50
Citations by year
2026: 39 · 2025: 43 · 2024: 23 · 2023: 34 · 2022: 13 · 2021: 1
FWCI
115.46
Type
journal article
Language
en
Open access
Licence
Locations
  • Minds and Machines (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
astrazeneca schweiz
Topics
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Law, AI, and Intellectual Property
Keywords
EU AI Act, AI regulation, artificial intelligence in auditing, conformity assessment, post-market monitoring, high-risk AI systems, internal audit, institutional safeguards, regulatory compliance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.