Operationalising AI governance through ethics-based auditing: an industry case study
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
Ethics-based auditing (EBA) is a structured process whereby an entity’s past or present behaviour is assessed for consistency with moral principles or norms. Recently, EBA has attracted much attention as a governance mechanism that may help to bridge the gap between principles and practice in AI ethics. However, important aspects of EBA—such as the feasibility and effectiveness of different auditing procedures—have yet to be substantiated by empirical research. In this article, we address this knowledge gap by providing insights from a longitudinal industry case study. Over 12 months, we observed and analysed the internal activities of AstraZeneca, a biopharmaceutical company, as it prepared for and underwent an ethics-based AI audit. While previous literature concerning EBA has focussed on proposing or analysing evaluation metrics or visualisation techniques, our findings suggest that the main difficulties large multinational organisations face when conducting EBA mirror classical governance challenges. These include ensuring harmonised standards across decentralised organisations, demarcating the scope of the audit, driving internal communication and change management, and measuring actual outcomes. The case study presented in this article contributes to the existing literature by providing a detailed description of the organisational context in which EBA procedures must be integrated to be feasible and effective.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“However, the use of AI systems in the healthcare sector is coupled with ethical challenges [35, 36].”
BackgroundThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Making Social Science Matter: Why Social Inquiry Fails and How it Can Succeed Again
Flyvbjerg, B. (2001) · doi:10.1017/cbo9780511810503 · Cited by 4,681
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196 · cited 1×
“Since proprietary protection is one of the main drivers of AI systems’ opacity [121, 122], that facilitates the process of conducting AI audits.”
BackgroundArtificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469
Encyclopedia of Research Design
Salkind, N. (2010) · doi:10.4135/9781412961288 · Cited by 2,347
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245 · cited 2×
“Rather, organisations should undertake a gap finding and filling exercise, adding ethics-based evaluation criteria to existing procurement processes.”
Background
Research works printed but not linked: 91
- Brundage, M., et al.: Toward trustworthy AI development: mechanisms for supporting verifiable claims. arXiv:2004.07213[cs.CY] (2020) · arXiv
- Koshiyama, A., et al.: Towards algorithm auditing: a survey on managing legal, ethical and technological risks of AI, ML and associated algorithms. SSRN Electron. J. 1–31 (2021) · DOI
- LaBrie, R.C and Steinke, G. H.: Towards a framework for ethical audits of AI algorithms. In: 25th Am. Conf. Inf. Syst. AMCIS 2019, pp. 1–5 (2019)
- Sandvig, C., Hamilton, K., Karahalios, K. and Langbort, C.: Auditing algorithms. In ICA 2014 Data Discrim. Preconference, pp. 1–23 (2014)
- Diakopoulos, N.: Algorithmic accountability: journalistic investigation of computational power structures. Digit. Journal. 3(3), 398–415 (2015) · DOI · Paper page
- Keyes, O., Hutson, J. and Durbin, M.: A mulching proposal. no. May 2019, pp. 1–11 (2019) · DOI · Paper page
- Deloitte: Deloitte introduces trustworthy AI framework to guide organizations in ethical application of technology. Press release (2020). https://www2.deloitte.com/us/en/pages/about-deloitte/articles/press-releases/deloitte-introduces-trustworthy-ai-framework.html. (Accessed: 19-Sep-2020)
- KPMG: KPMG offers ethical AI Assurance using CIO Strategy Council standards. Press release (2020) https://home.kpmg/ca/en/home/media/press-releases/2020/11/kpmg-offers-ethical-ai-assurance-using-ciosc-standards.html. (Accessed: 11-Nov-2021)
- Buolamwini, J., Gebru, T.: Gender shades: intersectional accuracy disparities in commercial gender classification. Conf. Fairness Accountabil. Transparency 1, 1–15 (2018)
- Mahajan, V., Venugopal, V.K., Murugavel, M., Mahajan, H.: The algorithmic audit: working with vendors to validate radiology-AI algorithms—how we do it. Acad. Radiol. 27(1), 132–135 (2020) · DOI · Paper page
- Dignum, V.: Responsibility and artificial intelligence. Oxford Handb. Ethics AI, no. November, pp. 213–231 (2020) · DOI · Paper page
- Balas, V.E., Kumar, R., Srivastava, R.: Recent Trends and Advances in Artificial Intelligence and Internet of Things. Springer, Cham (2020) · DOI
- Kaushik, S., et al.: AI in healthcare: time-series forecasting using statistical, neural, and ensemble architectures. Front. Big Data (2020). https://doi.org/10.3389/fdata.2020.00004 · DOI · Paper page
- Schneider, G.: Mind and machine in drug design. Nat. Mach. Intell. 1(3), 128–130 (2019) · DOI
- Tsamados, A., et al.: The ethics of algorithms: key problems and solutions. SSRN Electron. J. (2020). https://doi.org/10.2139/ssrn.3662302 · DOI
- McLennan, S., Fiske, A., Tigard, D., Müller, R., Haddadin, S., Buyx, A.: Embedded ethics: a proposal for integrating ethics into the development of medical AI. BMC Med. Ethics 23(1), 1–10 (2022) · DOI · Paper page
- Laurie, G., Stevens, L., Jones, K.H. and Dobbs, C.: A review of evidence relating to harm resulting from use of health and biomedical data BT—Nuffield Council on Bioethics (2014)
- Taeihagh, A., Ramesh, M., Howlett, M.: Assessing the regulatory challenges of emerging disruptive technologies. Regul. Gov. 15(4), 1009–1019 (2021) · DOI · Paper page
- Di Maio, P.: Towards a metamodel to support the joint optimization of socio technical systems. Systems 2(3), 273–296 (2014) · DOI
- Lauer, D.: You cannot have AI ethics without ethics. AI Ethics 0123456789, 1–5 (2020)
- Fjeld, J.: Principled Artificial intelligence. IEEE Instrum. Meas. Mag. 23(3), 27–31 (2020) · DOI
- Vakkuri, V., Kemell, K. K., Kultanen, J., Siponen, M. and Abrahamsson, P.: Ethically aligned design of autonomous systems: industry viewpoint and an empirical study. arXiv, (2019)
- Morley, J., Elhalal, A., Garcia, F., et al.: Ethics as a service: a pragmatic operationalisation of AI ethics. Minds Mach. 31, 239–256 (2021). https://doi.org/10.1007/s11023-021-09563-w · DOI · Paper page
- Mitchell, M., et al.: Model cards for model reporting. In: FAT* 2019—Proc. 2019 Conf. Fairness, Accountability, Transpar., no. Figure 2, pp. 220–229 (2019)
- Jotterand, F., Bosco, C.: Keeping the ‘Human in the Loop’ in the age of artificial intelligence: accompanying commentary for ‘correcting the brain?’ by Rainey and Erden. Sci. Eng. Ethics 26(5), 2455–2460 (2020) · DOI
- Cihon, P.: Standards for AI Governance: international standards to enable global coordination in AI research and development. In: Futur. Humanit. Institute, Univ. Oxford, no. April, pp. 1–41 (2019)
- Prunkl, C.E.A., Ashurst, C., Anderljung, M., Webb, H., Leike, J., Dafoe, A.: Institutionalizing ethics in AI through broader impact requirements. Nat. Mach. Intell. 3(2), 104–110 (2021) · DOI
- Cihon, P., Schuett, J., Baum, S.D.: Corporate governance of artificial intelligence in the public interest. Information 12(7), 1–30 (2021) · DOI
- Minkkinen, M., Zimmer, M.P., Mäntymäki, M.: Towards ecosystems for responsible AI: expectations, agendas and networks in EU documents. Springer International Publishing, Berlin (2021) · DOI
- AstraZeneca: AstraZeneca annual report & form 20-F information 2020. Issues Sci. Technol. 25(4), 23–30 (2020)
- Langkafel, P., (ed.) Big Data in Medical Science and Healthcare Management (2015) · doi:10.1515/9783110445381
- Ashenden, S. K., Deswal, S., Bulusu, K. C., Bartosik, A. and Shameer, K.: Data types and resources. In: Era Artif. Intell. Mach. Learn. Data Sci. Pharm. Ind., pp. 27–60 (2021) · DOI
- Lea, H., et al.: Can machine learning augment clinician adjudication of events in cardiovascular trials? A case study of major adverse cardiovascular events (MACE) across CVRM trials. Eur. Heart J. (2021). https://doi.org/10.1093/eurheartj/ehab724.3061 · doi:10.1093/eurheartj/ehab724.3061
- Rizk, J.G., Barr, C.E., Rizk, Y., Lewin, J.C.: The next frontier in vaccine safety and VAERS: lessons from COVID-19 and ten recommendations for action. Vaccine 39(41), 6017 (2021) · DOI
- Mantelero, A.: AI and big data: a blueprint for a human rights, social and ethical impact assessment. Comput. Law Secur. Rev. 34(4), 754–772 (2018) · DOI · Paper page
- Bauer, J.: The necessity of auditing artificial intelligence. SSRN J. 577, 1–16 (2016)
- Mökander, J., Axente, M.: Ethics-based auditing of automated decision-making systems: intervention points and policyimplications. AI & Soc. (2021). https://doi.org/10.1007/s00146-021-01286-x · DOI
- Mittelstadt, B.: Auditing for transparency in content personalization systems. Int. J. Commun. 10(June), 4991–5002 (2016)
- Bass, J. M., Lero, S. B. and Noll, J.: Experience of industry case studies: a comparison of multi-case and embedded case study methods. In: Proc. - Int. Conf. Softw. Eng., pp. 13–20 (2018) · DOI
- Yin, R.K.: Case study research: design and methods, 2nd edn. Sage, Thousand Oaks (1994)
- Thomson, R., Plumridge, L., Holland, J.: Longitudinal qualitative research: a developing methodology. Int. J. Soc. Res. Methodol. Theory Pract. 6(3), 185–187 (2003) · DOI
- Merton, R.K.: Three fragments from a sociologist’s notebooks: establishing the phenomenon, specified ignorance, and strategic research materials. Rev. Lit. Arts Am. 13(1987), 1–28 (1987)
- Vinten, G.: Participant observation: a model for organizational investigation? J. Manag. Psychol. 9(2), 30–38 (1994) · doi:10.1108/02683949410059299
- Woodside, A.G.: “Participant Observation Research in Organizational Behavior”, in Case Study Research, pp. 331–352. Emerald Group Publishing Limited, Boston (2016)
- Edwards, R., Holland, J.: What is Qualitative Interviewing? Bloomsbury Academic, London (2013) · DOI · Paper page
- Given, L.M.: The SAGE Encyclopedia of Qualitative Research Methods. SAGE, Los Angeles (2008) · DOI · Paper page
- Creswell, J., Clark, V.: Designing and Conducting Mixed Methods Research, 3rd edn. SAGE Publications, Berlin (2011)
- Bryman, A.: Social research methods, 5th edn. Oxford (2016)
- Nadler, E., et al.: Treatment patterns and clinical outcomes in patients with advanced non-small cell lung cancer initiating first-line treatment in the US community oncology setting: a real-world retrospective observational study. J. Cancer Res. Clin. Oncol. 147(3), 671–690 (2021) · DOI
- Wang, P.: On defining artificial intelligence. J. Artif. Gen. Intell. 10(2), 1–37 (2019) · DOI · Paper page
- Schuett, J. Defining the scope of AI regulations. arXiv:1909.01095 (2019). Accessed 22 Aug 2021 · DOI
- Fjeld, J.: Principled artificial intelligence. IEEE Instrum. Measur. Mag. 23(3), 27–31 (2020). https://doi.org/10.1109/MIM.2020.9082795 · DOI
- BenevolentAI: AstraZeneca starts artificial intelligence collaboration to accelerate drug discovery | BenevolentAI. Press release (2019). https://www.benevolent.com/news/astrazeneca-starts-artificial-intelligence-collaboration-to-accelerate-drug-discovery. (Accessed: 05-Jan-2022)
- GRAIL: GRAIL Announces Collaborations with Amgen, AstraZeneca, and Bristol Myers Squibb to Evaluate Cancer Early Detection Technology for Minimal Residual Disease – GRAIL. Press release (2021). https://grail.com/press-releases/grail-announces-collaborations-with-amgen-astrazeneca-and-bristol-myers-squibb-to-evaluate-cancer-early-detection-technology-for-minimal-residual-disease/. (Accessed: 05-Jan-2022)
- Dash, A., Mukherjee, A. and Ghosh, S.: A network-centric framework for auditing recommendation systems. In: Proc. - IEEE INFOCOM, vol. April, pp. 1990–1998 (2019) · DOI
- Pasquale, F.: The Black Box Society: the secret algorithms that control money and information. Inf. Commun. Soc. 19(12), 1727–1728 (2016) · DOI · Paper page
- Chopra, A.K. and Singh, M. P.: Sociotechnical systems and ethics in the large. In: AIES 2018 - Proc. 2018 AAAI/ACM Conf. AI, Ethics, Soc., pp. 48–53 (2018) · DOI
- Islam, G., and Greenwood, M.: The metrics of ethics and the ethics of metrics. J. Bus. Ethics 0123456789 (2021) · DOI
- Cugueró-Escofet, N., Rosanas, J.M.: The ethics of metrics: overcoming the dysfunctional effects of performance measurements through justice. J. Bus. Ethics 140(4), 615–631 (2017) · DOI
- Hoffmann, A.L., Roberts, S.T., Wolf, C.T., Wood, S.: Beyond fairness, accountability, and transparency in the ethics of algorithms: contributions and perspectives from LIS. Proc. Assoc. Inf. Sci. Technol. 55(1), 694–696 (2018) · DOI
- Cabrera, Á.A., Epperson, W., Hohman, F., Kahng, M., Morgenstern, J. and Chau, D. H.: FairVis: visual analytics for discovering intersectional bias in machine learning (2019) · DOI · Paper page
- Lee, M.S.A., Floridi, L., Singh, J.: Formalising trade-offs beyond algorithmic fairness: lessons from ethical philosophy and welfare economics. AI Ethics 1, 529–544 (2021). https://doi.org/10.1007/s43681-021-00067-y · DOI · Paper page
- Kusner, M., Loftus, J., Russell, C. and Silva, R.: Counterfactual fairness. Adv. Neural Inf. Process. Syst. 4067–4077 (2017)
- Kearns, M.J. and Roth, A.: The Ethical Algorithm : the Science of Socially Aware Algorithm Design. New York (2020) · DOI · Paper page
- Haataja, M. and Bryson, J. J.: What costs should we expect from the EU’s AI Act?. pp. 1–6 (2021) · DOI
- Dawson, M., Burrell, D.N., Rahim, E., Brewster, S.: Integrating software assurance into the software development life cycle (sdlc) meeting department of defense (dod) demands. J. Inf. Syst. Technol. Plan. 3(6), 49–53 (2010)
- Miles, M.B., Huberman, A.M.: Qualitative Data Analysis: An Expanded Sourcebook. Sage, Thousand Oaks (1994)
- Smith, E.: Research design. In: Reis, H. and Judd, C. (eds) Handbook of Research Methods in Social and Personality Psychology, pp. 27–48 (2014) · DOI
- Maruyama, G., Ryan, C.S.: Research methods in social relations. West Sussex, Chichester (2014)
- Morgan, C.D.L., Krueger, R.A., and Morgan, E.D.L.: Successful Focus Groups: Advancing the State of the Art When to Use Focus Groups and Why,” pp. 3–20 (2016) · DOI · Paper page
- Jackall, R.: Moral Mazes: the World of Corporate Managers, 20th anniv. Oxford University Press, New York (2010)
- BMW Group: Seven Principles for AI: BMW Group Sets Out Code of Ethics for the Use of Artificial Intelligence. Press release (2020). https://www.press.bmwgroup.com/global/article/detail/T0318411EN/seven-principles-for-ai:-bmw-group-sets-out-code-of-ethics-for-the-use-of-artificial-intelligence?language=en. (Accessed: 09-Mar-2021)
- Mökander, J., Morley, J., Taddeo, M., et al.: Ethics-based auditing of automated decision-making systems: nature, scope, andlimitations. Sci. Eng. Ethics 27, 44 (2021). https://doi.org/10.1007/s11948-021-00319-4 · DOI · Paper page
- IEEE: Ethically aligned design. Intell. Syst. Control Autom. Sci. Eng. 95, 11–16 (2019)
- Dunn, M., Hope, R.A.: Medical ethics: a very short introduction, 2nd edn. Oxford (2018) · DOI
- Ashenden, S. K.: Introduction to drug discovery. In: Era Artif. Intell. Mach. Learn. Data Sci. Pharm. Ind., pp. 1–13 (2021) · DOI
- Slee, T.: The incompatible incentives of private-sector AI. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
- Powers, T.M., Ganascia, J.-G.: The ethics of the ethics of AI. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
- Wang,, J. and Yan, Y.: The interview question. In: The SAGE Handbook of Interview Research: The Complexity of the Craft, SAGE Publications Inc., pp. 231–242 (2012) · doi:10.4135/9781452218403.n16
- Saldaña, J.: The Coding Manual for Qualitative Researchers. SAGE, London (2009)
- Diamandis, P., Kotler, S.: Abundance: The Future Is Better Than You Think. Free Press, New York (2012)
- Pammolli, F., Righetto, L., Abrignani, S., Pani, L., Pelicci, P.G., Rabosio, E.: The endless frontier? The recent increase of R&D productivity in pharmaceuticals. J. Transl. Med. 18(1), 1–14 (2020) · DOI · Paper page
- Legg, S. and Hutter, M.: A Collection of Definitions of Intelligence, pp. 1–12 (2007)
- Mökander, J., Sheth, M., Watson, D., Floridi, L.: Models for classifying AI systems: the Switch, the Ladder, and the Matrix. Minds Mach. (2022) · DOI
- Bryson, J.J.: The artificial intelligence of the ethics of artificial intelligence. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
- Dewey, J.: Reconstruction in philosophy, Enl Beacon Press, Boston (1957)
- Gasser, U., Schmitt, C.: The role of professional norms in the governance of artificial intelligence. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
- Grimpe, C., Kaiser, U.: Balancing internal and external knowledge acquisition: the gains and pains from R&D outsourcing. J. Manag. Stud. 47(8), 1483–1509 (2010) · DOI · Paper page
- Diakopoulos, N.: Transparency. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
- Mau, S.: The metric society: On the quantification of the social. UK; Medford, MA, Cambridge (2019)
- Kaplan, R.S., Norton, D.P.: The Balanced Scorecard: Translating Strategy into Action. Harvard Business School Press, Boston (1996)
Cited by
Munn, L. (2023) · AI and Ethics · doi:10.1007/s43681-022-00209-w · Cited by 355
Shaping the future of healthcare: ethical clinical challenges and pathways to trustworthy AI
Goktas, P., & Grzybowski, A. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14051605 · Cited by 336
Auditing large language models: a three-layered approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00289-2 · Cited by 289
Self-citationAuditing of AI: Legal, Ethical and Technical Approaches
Mökander, J. (2023) · Digital Society · doi:10.1007/s44206-023-00074-y · Cited by 152
“In 2021, the biopharmaceutical company contracted an independent third-party auditor to assess whether the company’s use of AI systems to improve drug development processes aligned with its publicly stated AI ethics principles (Mökander & Floridi, 2022b).”
BackgroundSelf-citationTriola, M. M., & Rodman, A. (2025) · Academic Medicine · doi:10.1097/acm.0000000000005963 · Cited by 92
Metadata
- Authors
- Mökander, J., & Floridi, L.
- Venue
- AI and Ethics
- Published
- 2022-05-31
- Volume
- 3
- Issue
- 2
- Pages
- 451-468
- ISSN
- 2730-5953 (ISSN-L)
- 2730-5961
- OpenAlex
- W4281723109
- Cited by
- 129
- References
- 63
- FWCI
- 24.45
- Type
- journal article
- Language
- en
- Update notices
- correction (2022-06-20)
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- AstraZeneca (PhD Studentship)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Operationalising AI governance through ethics-based auditing: an industry case study. https://app.cochat.ai/papers/10.1007/s43681-022-00171-7
- The paper
- Mökander, J., & Floridi, L. (2023). Operationalising AI governance through ethics-based auditing: an industry case study. AI and Ethics. https://doi.org/10.1007/s43681-022-00171-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.