CoChat

Operationalising AI governance through ethics-based auditing: an industry case study

Open access
Mökander, Jakob, Floridi, Luciano · 2023 · AI and Ethics
Cited by 129

The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.

Abstract

Ethics-based auditing (EBA) is a structured process whereby an entity’s past or present behaviour is assessed for consistency with moral principles or norms. Recently, EBA has attracted much attention as a governance mechanism that may help to bridge the gap between principles and practice in AI ethics. However, important aspects of EBA—such as the feasibility and effectiveness of different auditing procedures—have yet to be substantiated by empirical research. In this article, we address this knowledge gap by providing insights from a longitudinal industry case study. Over 12 months, we observed and analysed the internal activities of AstraZeneca, a biopharmaceutical company, as it prepared for and underwent an ethics-based AI audit. While previous literature concerning EBA has focussed on proposing or analysing evaluation metrics or visualisation techniques, our findings suggest that the main difficulties large multinational organisations face when conducting EBA mirror classical governance challenges. These include ensuring harmonised standards across decentralised organisations, demarcating the scope of the audit, driving internal communication and change management, and measuring actual outcomes. The case study presented in this article contributes to the existing literature by providing a detailed description of the organisational context in which EBA procedures must be integrated to be feasible and effective.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s43681-022-00171-7

Cites

63 of 63 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 63 references

Research works printed but not linked: 91

  1. Brundage, M., et al.: Toward trustworthy AI development: mechanisms for supporting verifiable claims. arXiv:2004.07213[cs.CY] (2020) · arXiv
  2. Koshiyama, A., et al.: Towards algorithm auditing: a survey on managing legal, ethical and technological risks of AI, ML and associated algorithms. SSRN Electron. J. 1–31 (2021) · DOI
  3. LaBrie, R.C and Steinke, G. H.: Towards a framework for ethical audits of AI algorithms. In: 25th Am. Conf. Inf. Syst. AMCIS 2019, pp. 1–5 (2019)
  4. Sandvig, C., Hamilton, K., Karahalios, K. and Langbort, C.: Auditing algorithms. In ICA 2014 Data Discrim. Preconference, pp. 1–23 (2014)
  5. Diakopoulos, N.: Algorithmic accountability: journalistic investigation of computational power structures. Digit. Journal. 3(3), 398–415 (2015) · DOI · Paper page
  6. Keyes, O., Hutson, J. and Durbin, M.: A mulching proposal. no. May 2019, pp. 1–11 (2019) · DOI · Paper page
  7. Deloitte: Deloitte introduces trustworthy AI framework to guide organizations in ethical application of technology. Press release (2020). https://www2.deloitte.com/us/en/pages/about-deloitte/articles/press-releases/deloitte-introduces-trustworthy-ai-framework.html. (Accessed: 19-Sep-2020)
  8. KPMG: KPMG offers ethical AI Assurance using CIO Strategy Council standards. Press release (2020) https://home.kpmg/ca/en/home/media/press-releases/2020/11/kpmg-offers-ethical-ai-assurance-using-ciosc-standards.html. (Accessed: 11-Nov-2021)
  9. Buolamwini, J., Gebru, T.: Gender shades: intersectional accuracy disparities in commercial gender classification. Conf. Fairness Accountabil. Transparency 1, 1–15 (2018)
  10. Mahajan, V., Venugopal, V.K., Murugavel, M., Mahajan, H.: The algorithmic audit: working with vendors to validate radiology-AI algorithms—how we do it. Acad. Radiol. 27(1), 132–135 (2020) · DOI · Paper page
  11. Dignum, V.: Responsibility and artificial intelligence. Oxford Handb. Ethics AI, no. November, pp. 213–231 (2020) · DOI · Paper page
  12. Balas, V.E., Kumar, R., Srivastava, R.: Recent Trends and Advances in Artificial Intelligence and Internet of Things. Springer, Cham (2020) · DOI
  13. Kaushik, S., et al.: AI in healthcare: time-series forecasting using statistical, neural, and ensemble architectures. Front. Big Data (2020). https://doi.org/10.3389/fdata.2020.00004 · DOI · Paper page
  14. Schneider, G.: Mind and machine in drug design. Nat. Mach. Intell. 1(3), 128–130 (2019) · DOI
  15. Tsamados, A., et al.: The ethics of algorithms: key problems and solutions. SSRN Electron. J. (2020). https://doi.org/10.2139/ssrn.3662302 · DOI
  16. McLennan, S., Fiske, A., Tigard, D., Müller, R., Haddadin, S., Buyx, A.: Embedded ethics: a proposal for integrating ethics into the development of medical AI. BMC Med. Ethics 23(1), 1–10 (2022) · DOI · Paper page
  17. Laurie, G., Stevens, L., Jones, K.H. and Dobbs, C.: A review of evidence relating to harm resulting from use of health and biomedical data BT—Nuffield Council on Bioethics (2014)
  18. Taeihagh, A., Ramesh, M., Howlett, M.: Assessing the regulatory challenges of emerging disruptive technologies. Regul. Gov. 15(4), 1009–1019 (2021) · DOI · Paper page
  19. Di Maio, P.: Towards a metamodel to support the joint optimization of socio technical systems. Systems 2(3), 273–296 (2014) · DOI
  20. Lauer, D.: You cannot have AI ethics without ethics. AI Ethics 0123456789, 1–5 (2020)
  21. Fjeld, J.: Principled Artificial intelligence. IEEE Instrum. Meas. Mag. 23(3), 27–31 (2020) · DOI
  22. Vakkuri, V., Kemell, K. K., Kultanen, J., Siponen, M. and Abrahamsson, P.: Ethically aligned design of autonomous systems: industry viewpoint and an empirical study. arXiv, (2019)
  23. Morley, J., Elhalal, A., Garcia, F., et al.: Ethics as a service: a pragmatic operationalisation of AI ethics. Minds Mach. 31, 239–256 (2021). https://doi.org/10.1007/s11023-021-09563-w · DOI · Paper page
  24. Mitchell, M., et al.: Model cards for model reporting. In: FAT* 2019—Proc. 2019 Conf. Fairness, Accountability, Transpar., no. Figure 2, pp. 220–229 (2019)
  25. Jotterand, F., Bosco, C.: Keeping the ‘Human in the Loop’ in the age of artificial intelligence: accompanying commentary for ‘correcting the brain?’ by Rainey and Erden. Sci. Eng. Ethics 26(5), 2455–2460 (2020) · DOI
  26. Cihon, P.: Standards for AI Governance: international standards to enable global coordination in AI research and development. In: Futur. Humanit. Institute, Univ. Oxford, no. April, pp. 1–41 (2019)
  27. Prunkl, C.E.A., Ashurst, C., Anderljung, M., Webb, H., Leike, J., Dafoe, A.: Institutionalizing ethics in AI through broader impact requirements. Nat. Mach. Intell. 3(2), 104–110 (2021) · DOI
  28. Cihon, P., Schuett, J., Baum, S.D.: Corporate governance of artificial intelligence in the public interest. Information 12(7), 1–30 (2021) · DOI
  29. Minkkinen, M., Zimmer, M.P., Mäntymäki, M.: Towards ecosystems for responsible AI: expectations, agendas and networks in EU documents. Springer International Publishing, Berlin (2021) · DOI
  30. AstraZeneca: AstraZeneca annual report & form 20-F information 2020. Issues Sci. Technol. 25(4), 23–30 (2020)
  31. Langkafel, P., (ed.) Big Data in Medical Science and Healthcare Management (2015) · doi:10.1515/9783110445381
  32. Ashenden, S. K., Deswal, S., Bulusu, K. C., Bartosik, A. and Shameer, K.: Data types and resources. In: Era Artif. Intell. Mach. Learn. Data Sci. Pharm. Ind., pp. 27–60 (2021) · DOI
  33. Lea, H., et al.: Can machine learning augment clinician adjudication of events in cardiovascular trials? A case study of major adverse cardiovascular events (MACE) across CVRM trials. Eur. Heart J. (2021). https://doi.org/10.1093/eurheartj/ehab724.3061 · doi:10.1093/eurheartj/ehab724.3061
  34. Rizk, J.G., Barr, C.E., Rizk, Y., Lewin, J.C.: The next frontier in vaccine safety and VAERS: lessons from COVID-19 and ten recommendations for action. Vaccine 39(41), 6017 (2021) · DOI
  35. Mantelero, A.: AI and big data: a blueprint for a human rights, social and ethical impact assessment. Comput. Law Secur. Rev. 34(4), 754–772 (2018) · DOI · Paper page
  36. Bauer, J.: The necessity of auditing artificial intelligence. SSRN J. 577, 1–16 (2016)
  37. Mökander, J., Axente, M.: Ethics-based auditing of automated decision-making systems: intervention points and policyimplications. AI & Soc. (2021). https://doi.org/10.1007/s00146-021-01286-x · DOI
  38. Mittelstadt, B.: Auditing for transparency in content personalization systems. Int. J. Commun. 10(June), 4991–5002 (2016)
  39. Bass, J. M., Lero, S. B. and Noll, J.: Experience of industry case studies: a comparison of multi-case and embedded case study methods. In: Proc. - Int. Conf. Softw. Eng., pp. 13–20 (2018) · DOI
  40. Yin, R.K.: Case study research: design and methods, 2nd edn. Sage, Thousand Oaks (1994)
  41. Thomson, R., Plumridge, L., Holland, J.: Longitudinal qualitative research: a developing methodology. Int. J. Soc. Res. Methodol. Theory Pract. 6(3), 185–187 (2003) · DOI
  42. Merton, R.K.: Three fragments from a sociologist’s notebooks: establishing the phenomenon, specified ignorance, and strategic research materials. Rev. Lit. Arts Am. 13(1987), 1–28 (1987)
  43. Vinten, G.: Participant observation: a model for organizational investigation? J. Manag. Psychol. 9(2), 30–38 (1994) · doi:10.1108/02683949410059299
  44. Woodside, A.G.: “Participant Observation Research in Organizational Behavior”, in Case Study Research, pp. 331–352. Emerald Group Publishing Limited, Boston (2016)
  45. Edwards, R., Holland, J.: What is Qualitative Interviewing? Bloomsbury Academic, London (2013) · DOI · Paper page
  46. Given, L.M.: The SAGE Encyclopedia of Qualitative Research Methods. SAGE, Los Angeles (2008) · DOI · Paper page
  47. Creswell, J., Clark, V.: Designing and Conducting Mixed Methods Research, 3rd edn. SAGE Publications, Berlin (2011)
  48. Bryman, A.: Social research methods, 5th edn. Oxford (2016)
  49. Nadler, E., et al.: Treatment patterns and clinical outcomes in patients with advanced non-small cell lung cancer initiating first-line treatment in the US community oncology setting: a real-world retrospective observational study. J. Cancer Res. Clin. Oncol. 147(3), 671–690 (2021) · DOI
  50. Wang, P.: On defining artificial intelligence. J. Artif. Gen. Intell. 10(2), 1–37 (2019) · DOI · Paper page
  51. Schuett, J. Defining the scope of AI regulations. arXiv:1909.01095 (2019). Accessed 22 Aug 2021 · DOI
  52. Fjeld, J.: Principled artificial intelligence. IEEE Instrum. Measur. Mag. 23(3), 27–31 (2020). https://doi.org/10.1109/MIM.2020.9082795 · DOI
  53. BenevolentAI: AstraZeneca starts artificial intelligence collaboration to accelerate drug discovery | BenevolentAI. Press release (2019). https://www.benevolent.com/news/astrazeneca-starts-artificial-intelligence-collaboration-to-accelerate-drug-discovery. (Accessed: 05-Jan-2022)
  54. GRAIL: GRAIL Announces Collaborations with Amgen, AstraZeneca, and Bristol Myers Squibb to Evaluate Cancer Early Detection Technology for Minimal Residual Disease – GRAIL. Press release (2021). https://grail.com/press-releases/grail-announces-collaborations-with-amgen-astrazeneca-and-bristol-myers-squibb-to-evaluate-cancer-early-detection-technology-for-minimal-residual-disease/. (Accessed: 05-Jan-2022)
  55. Dash, A., Mukherjee, A. and Ghosh, S.: A network-centric framework for auditing recommendation systems. In: Proc. - IEEE INFOCOM, vol. April, pp. 1990–1998 (2019) · DOI
  56. Pasquale, F.: The Black Box Society: the secret algorithms that control money and information. Inf. Commun. Soc. 19(12), 1727–1728 (2016) · DOI · Paper page
  57. Chopra, A.K. and Singh, M. P.: Sociotechnical systems and ethics in the large. In: AIES 2018 - Proc. 2018 AAAI/ACM Conf. AI, Ethics, Soc., pp. 48–53 (2018) · DOI
  58. Islam, G., and Greenwood, M.: The metrics of ethics and the ethics of metrics. J. Bus. Ethics 0123456789 (2021) · DOI
  59. Cugueró-Escofet, N., Rosanas, J.M.: The ethics of metrics: overcoming the dysfunctional effects of performance measurements through justice. J. Bus. Ethics 140(4), 615–631 (2017) · DOI
  60. Hoffmann, A.L., Roberts, S.T., Wolf, C.T., Wood, S.: Beyond fairness, accountability, and transparency in the ethics of algorithms: contributions and perspectives from LIS. Proc. Assoc. Inf. Sci. Technol. 55(1), 694–696 (2018) · DOI
  61. Cabrera, Á.A., Epperson, W., Hohman, F., Kahng, M., Morgenstern, J. and Chau, D. H.: FairVis: visual analytics for discovering intersectional bias in machine learning (2019) · DOI · Paper page
  62. Lee, M.S.A., Floridi, L., Singh, J.: Formalising trade-offs beyond algorithmic fairness: lessons from ethical philosophy and welfare economics. AI Ethics 1, 529–544 (2021). https://doi.org/10.1007/s43681-021-00067-y · DOI · Paper page
  63. Kusner, M., Loftus, J., Russell, C. and Silva, R.: Counterfactual fairness. Adv. Neural Inf. Process. Syst. 4067–4077 (2017)
  64. Kearns, M.J. and Roth, A.: The Ethical Algorithm : the Science of Socially Aware Algorithm Design. New York (2020) · DOI · Paper page
  65. Haataja, M. and Bryson, J. J.: What costs should we expect from the EU’s AI Act?. pp. 1–6 (2021) · DOI
  66. Dawson, M., Burrell, D.N., Rahim, E., Brewster, S.: Integrating software assurance into the software development life cycle (sdlc) meeting department of defense (dod) demands. J. Inf. Syst. Technol. Plan. 3(6), 49–53 (2010)
  67. Miles, M.B., Huberman, A.M.: Qualitative Data Analysis: An Expanded Sourcebook. Sage, Thousand Oaks (1994)
  68. Smith, E.: Research design. In: Reis, H. and Judd, C. (eds) Handbook of Research Methods in Social and Personality Psychology, pp. 27–48 (2014) · DOI
  69. Maruyama, G., Ryan, C.S.: Research methods in social relations. West Sussex, Chichester (2014)
  70. Morgan, C.D.L., Krueger, R.A., and Morgan, E.D.L.: Successful Focus Groups: Advancing the State of the Art When to Use Focus Groups and Why,” pp. 3–20 (2016) · DOI · Paper page
  71. Jackall, R.: Moral Mazes: the World of Corporate Managers, 20th anniv. Oxford University Press, New York (2010)
  72. BMW Group: Seven Principles for AI: BMW Group Sets Out Code of Ethics for the Use of Artificial Intelligence. Press release (2020). https://www.press.bmwgroup.com/global/article/detail/T0318411EN/seven-principles-for-ai:-bmw-group-sets-out-code-of-ethics-for-the-use-of-artificial-intelligence?language=en. (Accessed: 09-Mar-2021)
  73. Mökander, J., Morley, J., Taddeo, M., et al.: Ethics-based auditing of automated decision-making systems: nature, scope, andlimitations. Sci. Eng. Ethics 27, 44 (2021). https://doi.org/10.1007/s11948-021-00319-4 · DOI · Paper page
  74. IEEE: Ethically aligned design. Intell. Syst. Control Autom. Sci. Eng. 95, 11–16 (2019)
  75. Dunn, M., Hope, R.A.: Medical ethics: a very short introduction, 2nd edn. Oxford (2018) · DOI
  76. Ashenden, S. K.: Introduction to drug discovery. In: Era Artif. Intell. Mach. Learn. Data Sci. Pharm. Ind., pp. 1–13 (2021) · DOI
  77. Slee, T.: The incompatible incentives of private-sector AI. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
  78. Powers, T.M., Ganascia, J.-G.: The ethics of the ethics of AI. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
  79. Wang,, J. and Yan, Y.: The interview question. In: The SAGE Handbook of Interview Research: The Complexity of the Craft, SAGE Publications Inc., pp. 231–242 (2012) · doi:10.4135/9781452218403.n16
  80. Saldaña, J.: The Coding Manual for Qualitative Researchers. SAGE, London (2009)
  81. Diamandis, P., Kotler, S.: Abundance: The Future Is Better Than You Think. Free Press, New York (2012)
  82. Pammolli, F., Righetto, L., Abrignani, S., Pani, L., Pelicci, P.G., Rabosio, E.: The endless frontier? The recent increase of R&D productivity in pharmaceuticals. J. Transl. Med. 18(1), 1–14 (2020) · DOI · Paper page
  83. Legg, S. and Hutter, M.: A Collection of Definitions of Intelligence, pp. 1–12 (2007)
  84. Mökander, J., Sheth, M., Watson, D., Floridi, L.: Models for classifying AI systems: the Switch, the Ladder, and the Matrix. Minds Mach. (2022) · DOI
  85. Bryson, J.J.: The artificial intelligence of the ethics of artificial intelligence. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
  86. Dewey, J.: Reconstruction in philosophy, Enl Beacon Press, Boston (1957)
  87. Gasser, U., Schmitt, C.: The role of professional norms in the governance of artificial intelligence. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
  88. Grimpe, C., Kaiser, U.: Balancing internal and external knowledge acquisition: the gains and pains from R&D outsourcing. J. Manag. Stud. 47(8), 1483–1509 (2010) · DOI · Paper page
  89. Diakopoulos, N.: Transparency. In: Dubber, M., Pasquale, F., Das, S. (eds.) The Oxford Handbook of Ethics of AI. Oxford University Press, Oxford (2021)
  90. Mau, S.: The metric society: On the quantification of the social. UK; Medford, MA, Cambridge (2019)
  91. Kaplan, R.S., Norton, D.P.: The Balanced Scorecard: Translating Strategy into Action. Harvard Business School Press, Boston (1996)

Cited by

See all 129

Metadata

Authors
Mökander, J., & Floridi, L.
Venue
AI and Ethics
Published
2022-05-31
Volume
3
Issue
2
Pages
451-468
ISSN
  • 2730-5953 (ISSN-L)
  • 2730-5961
OpenAlex
W4281723109
Cited by
129
References
63
FWCI
24.45
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
AstraZeneca (PhD Studentship)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Operationalising AI governance through ethics-based auditing: an industry case study. https://app.cochat.ai/papers/10.1007/s43681-022-00171-7
The paper
Mökander, J., & Floridi, L. (2023). Operationalising AI governance through ethics-based auditing: an industry case study. AI and Ethics. https://doi.org/10.1007/s43681-022-00171-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.