The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
AI Regulation Is (not) All You Need
Open accessAbstract
The development of processes and tools for ethical, trustworthy, and legal AI is only beginning. At the same time, legal requirements are emerging in various jurisdictions, following a deluge of ethical guidelines. It is therefore key to explore the necessary practices that must be adopted to ensure the quality of AI systems, mitigate their potential risks and enable legal compliance. Ensuring that the potential negative impacts of AI on individuals, society, and the environment are mitigated will depend on many factors, including the capacity to properly regulate its deployment and to mandate necessary internal best practices along lifecycles. Regulatory frameworks must evolve from abstract requirements to providing concrete operational mandates that enable better oversight mechanisms in the way AI systems operate, how they are developed, and how they are deployed. In view of the above, this paper explores the necessary practices that can be adopted throughout a comprehensive lifecycle audit as a key practice to ensure the quality of AI systems and enable the development of compliance mechanisms. It also discusses novel governance tools that enable bridging the current operational gaps. Such gaps were identified by interviewing experts, analysing adaptable tools and methodologies from the software engineering domain, and by exploring the state of the art of auditing. The results present recommendations for novel tools and oversight mechanisms for governing AI systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In addition, in cases where substantive differences of opinion exist between expertssuch as in the discourse on computational definitions of fairness [6,8,37]-designers of audit standards must navigate these nuances while also balancing to achieve a set of criteria that provides compliance and is operationalizable at scale.”
From A Framework for Assurance Audits of Algorithmic Systems (2024) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“A significant amount of research has been devoted to crafting ethical guidelines for practitioners, to guide their development of AI systems [27, 35, 38].”
Doyle, T. (2017) · The Information Society · doi:10.1080/01972243.2017.1354593 · Cited by 3,071 · cited 5×
“Certification emerged throughout four interviews as fundamental in improving the ecosystem (Candi-dates 1, 3, 4, 5).”
InfluentialModel Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 4×
“Emerging guidelines have addressed documentation practices for certain features and particular steps along the pipeline of an ML model such as model cards and datasheets [30, 51].”
InfluentialHierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · cited 1×
“AI systems are rapidly transforming many areas of life with disruptive applications, such as the impressive advancement of generative AI models like ChatGPT, a text-generating chatbot, or the text-to-image generation provided by cascaded diffusion models such as DALL·E [64].”
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474 · cited 5×
“Datasheets are inspired by the standardised forms of information sharing and rigorous testing, established in the electronic hardware industry, to enable the overview of the components performances under different test conditions [30].”
InfluentialGebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 5×
“Datasheets are inspired by the standardised forms of information sharing and rigorous testing, established in the electronic hardware industry, to enable the overview of the components performances under different test conditions [30].”
InfluentialRaji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 9×
“This process allows the developers to detect the potential unintended consequences before the deployment [63].”
InfluentialThe Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911
The Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581
Research works printed but not linked: 23
- Sarah Bird, Miro Dudík, Richard Edgar, Brandon Horn, Roman Lutz, Vanessa Milan, Mehrnoosh Sameki, Hanna Wallach, and Kathleen Walker. 2020. Fairlearn: A toolkit for assessing and improving fairness in AI. Microsoft, Tech. Rep. MSR-TR-2020-32 (2020).
- Alan Bryman, Robert G Burgess, 1994. Analyzing qualitative data. Vol. 11. Routledge London.
- Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77–91.
- Danton S Char, Nigam H Shah, and David Magnus. 2018. Implementing machine learning in health care—addressing ethical challenges. The New England journal of medicine 378, 11 (2018), 981.
- João Figueiredo Nobre Brito Cortese, Fabio Gagliardi Cozman, Marcos Paulo Lucca-Silveira, and Adriano Figueiredo Bechara. 2022. Should explainability be a fifth ethical principle in AI ethics?AI and Ethics (2022), 1–12.
- Financial Reporting Council. 2021. Auditors I Audit and Assurance I Standards and Guidance for Auditors I Financial Reporting Council (2020).
- Kate Crawford. 2021. The atlas of AI: Power, politics, and the planetary costs of artificial intelligence. Yale University Press.
- Finale Doshi-Velez, Mason Kortz, Ryan Budish, Chris Bavitz, Sam Gershman, David O’Brien, Kate Scott, Stuart Schieber, James Waldo, David Weinberger, 2017. Accountability of AI under the law: The role of explanation. arXiv preprint arXiv:1711.01134 (2017). · arXiv
- Nicola K Gale, Gemma Heath, Elaine Cameron, Sabina Rashid, and Sabi Redwood. 2013. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC medical research methodology 13, 1 (2013), 1–8.
- 10.5555/3297863.3297908 · doi:10.5555/3297863.3297908
- Ellen P Goodman and Julia Trehu. 2022. AI Audit Washing and Accountability. Available at SSRN 4227350 (2022).
- Jaber F Gubrium and James A Holstein. 2002. From the individual interview to the interview society. Handbook of interview research: Context and method (2002), 3–32.
- Shin-Shin Hua and Haydn Belfield. 2020. AI & Antitrust: Reconciling Tensions between Competition Law and Cooperative AI Development. Yale JL & Tech. 23 (2020), 415.
- Johann Laux, Sandra Wachter, and Brent Mittelstadt. 2023. Three Pathways for Standardisation and Ethical Disclosure by Default under the European Union Artificial Intelligence Act. Available at SSRN (2023).
- Heidi Ledford. 2019. Millions of black people affected by racial bias in health-care algorithms. Nature 574, 7780 (2019), 608–610.
- Carina Lewandowski. 2021. Machine (Un) learning: An Investigation of Racial Bias in Predictive Recidivism Algorithms as a Product of Real-World, Structural Discrimination. (2021).
- Ziad Obermeyer, Brian Powers, Christine Vogeli, and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 6464 (2019), 447–453.
- House of Commons of Canada. 2022. Bill C-27: An Act to enact the Consumer Privacy Protection Act, the Personal Information and Data Protection Tribunal Act and the Artificial Intelligence and Data Act and to make consequential and related amendments to other Acts. 1st Session, 44th Parliament, 70-71 Elizabeth II, 2021-2022 (2022).
- Cathy O’neil. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books.
- Junaid Qadir, Mohammad Qamar Islam, and Ala Al-Fuqaha. 2022. Toward accountable human-centered AI: rationale and promising directions. Journal of Information, Communication and Ethics in Society (2022).
- Jane Ritchie, Jane Lewis, Carol McNaughton Nicholls, Rachel Ormston, 2013. Qualitative research practice: A guide for social science students and researchers. sage.
- Carol AB Warren. 2002. Qualitative interviewing. Handbook of interview research: Context and method 839101 (2002), 103–116.
- Jenna Wiens, W Nicholson Price, and Michael W Sjoding. 2020. Diagnosing bias in data-driven algorithms for healthcare. Nature medicine 26, 1 (2020), 25–26.
Cited by
Black-Box Access is Insufficient for Rigorous AI Audits
Casper, S., Ezell, C., Siegmann, C., Kolt, N., Curtis, T. L., Bucknall, B., Haupt, A., Wei, K., Scheurer, J., Hobbhahn, M., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3659037 · Cited by 86
Neuromarketing algorithms’ consumer privacy and ethical considerations: challenges and opportunities
Goncalves, M. V., Hu, Y., Aliagas, I., & Suárez, L. M. C. (2024) · Cogent Business & Management · doi:10.1080/23311975.2024.2333063 · Cited by 103
“One practical approach to promoting ethical and standardized ai/Ml algorithms is through certification, which can help reduce information asymmetries (cihon et al., 2021; lucaj et al., 2023).”
Benk, M., Kerstan, S., von Wangenheim, F., & Ferrario, A. (2024) · AI & Society · doi:10.1007/s00146-024-02059-y · Cited by 120
“…humans trust AI systems is fueled by increasingly capable AI-based technologies that are transforming the way humans work and collaborate in a multitude of society-impacting applications (Jacobs et al. 2021; Chiou and Lee 2021; Lucaj et al. 2023; Shin 2021; Wamba et al. 2021; Feher et al. 2024).”
Rethinking open source generative AI: open washing and the EU AI Act
Liesenfeld, A., & Dingemanse, M. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3659005 · Cited by 123
A Framework for Assurance Audits of Algorithmic Systems
Lam, K., Lange, B., Blili-Hamelin, B., Davidovic, J., Brown, S., & Hasan, A. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658957 · Cited by 75
Metadata
- Authors
- Lucaj, L., van der Smagt, P., & Benbouzid, D.
- Affiliations
- Volkswagen Group (Germany) (DE)
- Machine Learning Research Lab, Volkswagen Group, Germany
- Venue
- 2023 ACM Conference on Fairness Accountability and Transparency
- Publisher
- ACM
- Published
- 2023-06-12
- Pages
- 1267-1279
- OpenAlex
- W4380320348
- Cited by
- 40
- References
- 45
- Citations by year
- 2026: 8 · 2025: 14 · 2024: 18
- FWCI
- 10.02
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- AI regulation, AI governance, legal compliance, trustworthy AI, ethical AI, AI risk mitigation, oversight mechanisms, regulatory framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI Regulation Is (not) All You Need. https://app.cochat.ai/papers/10.1145/3593013.3594079
- The paper
- Lucaj, L., van der Smagt, P., & Benbouzid, D. (2023). AI Regulation Is (not) All You Need. 2023 ACM Conference on Fairness Accountability and Transparency. https://doi.org/10.1145/3593013.3594079
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.