Algorithm Auditing: Managing the Legal, Ethical, and Technological Risks of Artificial Intelligence, Machine Learning, and Associated Algorithms
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Algorithms are becoming ubiquitous. However, companies are increasingly alarmed about their algorithms causing major financial or reputational damage. A new industry is envisaged: auditing and assurance of algorithms with the remit to validate artificial intelligence, machine learning, and associated algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For this reason, researchers like Koshiyama et al. (2022) have proposed procedures for auditing the entire process whereby AI systems are designed and deployed.”
From Auditing of AI: Legal, Ethical and Technical Approaches (2023) · cites this paper as Koshiyama et al. (2022)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“9,10 As with a financial audit, an algo-rithm audit is required to deliver formal assurance that algorithms are legal, ethical, and safe.”
Adversarial machine learning at scale
Kurakin, A., Goodfellow, I., & Bengio, S. (2016) · arXiv · doi:10.48550/arxiv.1611.01236 · Cited by 2,325
The Ethics of AI Ethics: An Evaluation of Guidelines
Hagendorff, T. (2020) · Minds and Machines · doi:10.1007/s11023-020-09517-8 · Cited by 1,911
The Ethics of AI Ethics -- An Evaluation of Guidelines
Hagendorff, T. (2019) · arXiv · doi:10.48550/arxiv.1903.03425 · Cited by 1,907
Bellamy, R. K. E., Dey, K., Hind, M., Hoffman, S. C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., et al. (2018) · arXiv · doi:10.48550/arxiv.1810.01943 · Cited by 1,581
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Inherent Trade-Offs in the Fair Determination of Risk Scores
Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016) · arXiv · doi:10.48550/arxiv.1609.05807 · Cited by 941
Research works printed but not linked: 59
- Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016, October). Deep learning with differential privacy. In Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security (pp. 308-318).
- Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., ... & De Freitas, N. (2016). Learning to learn by gradient descent by gradient descent. In Advances in neural information processing systems (pp. 3981-3989).
- Ateniese, G., Mancini, L. V., Spognardi, A., Villani, A., Vitali, D., & Felici, G. (2015). Hacking smart machines with smarter ones: How to extract meaningful data from machine learning classifiers. International J of Security and Networks, 10(3), 137-150.
- Barabási, A. L. (2016). Network science. Cambridge university press.
- Barrett, C., & Tinelli, C. (2018). Satisfiability modulo theories. In Handbook of Model Checking (pp. 305-343). Springer, Cham.
- Bieker, F., Friedewald, M., Hansen, M., Obersteller, H., & Rost, M. (2016, September). A process for data protection impact assessment under the european general data protection regulation. In Annual Privacy Forum (pp. 21-37). Springer, Cham.
- Hall, P. (2019). An introduction to machine learning interpretability. O'Reilly Media, Incorporated.
- Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: data mining, inference, and prediction. Springer Science & Business Media.
- Hind, M., Mehta, S., Mojsilovic, A., Nair, R., Ramamurthy, K. N., Olteanu, A., & Varshney, K. R. (2018). Increasing trust in AI services through supplier's declarations of conformity. arXiv preprint arXiv:1808.07261. · arXiv
- Hitaj, B., Ateniese, G., & Perez-Cruz, F. (2017, October). Deep models under the GAN: information leakage from collaborative deep learning. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security (pp. 603- 618). https://ico.org.uk/for-organisations/guide-to-data-protection/key-data-protection-themes/explaining-decisions-made- with-ai/
- Huang, L., Joseph, A. D., Nelson, B., Rubinstein, B. I., & Tygar, J. D. (2011, October). Adversarial machine learning. In Proceedings of the 4th ACM workshop on Security and artificial intelligence (pp. 43-58). ACM.
- Kaminski, M. E., & Malgieri, G. (2020, January). Multi-layered explanations from algorithmic impact assessments in the GDPR. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (pp. 68-79).
- Kamiran, F., & Calders, T. (2012). Data preprocessing techniques for classification without discrimination. Knowledge and Information Systems, 33(1), 1-33.
- Kargupta, H., Datta, S., Wang, Q., & Sivakumar, K. (2005). Random-data perturbation techniques and privacy-preserving data mining. Knowledge and Information Systems, 7(4), 387-414.
- Buckman, J., Roy, A., Raffel, C., & Goodfellow, I. (2018, February). Thermometer encoding: One hot way to resist adversarial examples. In International Conference on Learning Representations.
- Bunel, R. R., Turkaslan, I., Torr, P., Kohli, P., & Mudigonda, P. K. (2018). A unified view of piecewise linear neural network verification. In Advances in Neural Information Processing Systems (pp. 4790-4799).
- Butterworth, M. (2018). The ICO and artificial intelligence: The role of fairness in the GDPR framework. Computer Law & Security Review, 34(2), 257-268.
- Chouldechova, A. (2017). Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data, 5(2), 153-163.
- Donini, M., Oneto, L., Ben-David, S., Shawe-Taylor, J. S., & Pontil, M. (2018). Empirical risk minimization under fairness constraints. In Advances in Neural Information Processing Systems (pp. 2791-2801).
- Dvijotham, K., Stanforth, R., Gowal, S., Mann, T. A., & Kohli, P. (2018, March). A Dual Approach to Scalable Verification of Deep Networks. In UAI (Vol. 1, p. 2).
- Dwork, C., & Naor, M. (2010). On the difficulties of disclosure prevention in statistical databases or the case for differential privacy. Journal of Privacy and Confidentiality, 2(1).
- Efron, B., & Hastie, T. (2016). Computer age statistical inference (Vol. 5). Cambridge University Press.
- Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015, August). Certifying and removing disparate impact. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 259-268).
- Finn, C., Abbeel, P., & Levine, S. (2017, August). Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the 34th International Conference on Machine Learning-Volume 70 (pp. 1126-1135). JMLR. org.
- Floridi, L. (2018). Soft ethics, the governance of the digital and the General Data Protection Regulation. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 376(2133), 20180081. Electronic copy available at: https://ssrn.com/abstract=3889612
- Fredrikson, M., Jha, S., & Ristenpart, T. (2015, October). Model inversion attacks that exploit confidence information and basic countermeasures. In Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security (pp. 1322-1333).
- Fredrikson, M., Jha, S., & Ristenpart, T. (2015, October). Model inversion attacks that exploit confidence information and basic countermeasures. In Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security (pp. 1322-1333).
- Ganju, K., Wang, Q., Yang, W., Gunter, C. A., & Borisov, N. (2018, January). Property inference attacks on fully connected neural networks using permutation invariant representations. In Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security (pp. 619-633).
- Goldsteen, A., Ezov, G., Shmelkin, R., Moffie, M., & Farkash, A. (2020). Data Minimization for GDPR Compliance in Machine Learning Models. arXiv preprint arXiv:2008.04113. · arXiv
- Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT press.
- Kim, H., Park, J., Bennis, M., & Kim, S. L. (2019). Blockchained on-device federated learning. IEEE Communications Letters.
- Kleinberg, J., Mullainathan, S., & Raghavan, M. (2016). Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807. · arXiv
- Russell, S. J., & Norvig, P. (2016). Artificial intelligence: a modern approach. Malaysia; Pearson Education Limited.
- Shokri, R., Stronati, M., Song, C., & Shmatikov, V. (2017, May). Membership inference attacks against machine learning models. In 2017 IEEE Symposium on Security and Privacy (SP) (pp. 3-18). IEEE.
- Steinhardt, J., Koh, P. W. W., & Liang, P. S. (2017). Certified defences for data poisoning attacks. In Advances in neural information processing systems (pp. 3517-3529).
- Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. MIT press.
- Tan, T. J. L., & Shokri, R. (2019). Bypassing backdoor detection algorithms in deep learning. arXiv preprint arXiv:1905.13409. · arXiv
- Taylor, S. (Ed.). (2014). Agent-based modeling and simulation. Springer.
- Tjeng, V., & Tedrake, R. (2017). Verifying neural networks with mixed integer programming. arXiv:1711.07356, 945-950. · arXiv
- Tramèr, F., Zhang, F., Juels, A., Reiter, M. K., & Ristenpart, T. (2016). Stealing machine learning models via prediction apis. In 25th USENIX Security Symposium (USENIX Security 16) (pp. 601-618).
- Treleaven, P., & Batrinca, B. (2017). Algorithmic regulation: automating financial compliance monitoring and regulation using AI and blockchain. Journal of Financial Transformation, 45, 14-21.
- Treleaven, P., Barnett, J., & Koshiyama, A. (2019). Algorithms: law and regulation. Computer, 52(2), 32-40.
- Zafar, M. B., Valera, I., Gomez-Rodriguez, M., & Gummadi, K. P. (2019). Fairness Constraints: A Flexible Approach for Fair Classification. J. Mach. Learn. Res., 20(75), 1-42.
- Zemel, R., Wu, Y., Swersky, K., Pitassi, T., & Dwork, C. (2013, February). Learning fair representations. In International Conference on Machine Learning (pp. 325-333).
- Zhang, B. H., Lemoine, B., & Mitchell, M. (2018, December). Mitigating unwanted biases with adversarial learning. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society (pp. 335-340).
- Kusner, M. J., Loftus, J., Russell, C., & Silva, R. (2017). Counterfactual fairness. In Advances in neural information processing systems (pp. 4066-4076).
- Longo, L., Goebel, R., Lecue, F., Kieseberg, P., & Holzinger, A. (2020, August). Explainable Artificial Intelligence: Concepts, Applications, Research Challenges and Visions. In International Cross-Domain Conference for Machine Learning and Knowledge Extraction (pp. 1-16). Springer, Cham.
- Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., & Zhang, G. (2018). Learning under concept drift: A review. IEEE Transactions on Knowledge and Data Engineering, 31(12), 2346-2363.
- Lundberg, S. M., & Lee, S. I. (2017). A unified approach to interpreting model predictions. In Advances in neural information processing systems (pp. 4765-4774).
- McGregor, L., Murray, D., and Ng, V. (2019). International human rights law as a framework for algorithmic accountability. International & Comparative Law Quarterly, 68(2), 309-343.
- Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019, May). Exploiting unintended feature leakage in collaborative learning. In 2019 IEEE Symposium on Security and Privacy (SP) (pp. 691-706). IEEE.
- Meyer, M. (2014). Continuous integration and its tools. IEEE software, 31(3), 14-16.
- Moosavi-Dezfooli, S. M., Fawzi, A., & Frossard, P. (2016). Deepfool: a simple and accurate method to fool deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2574-2582).
- Müller, R., Kornblith, S., & Hinton, G. E. (2019). When does label smoothing help?. In Advances in Neural Information Processing Systems (pp. 4694-4703).
- Neubauer, T., & Heurix, J. (2011). A methodology for the pseudonymization of medical data. International journal of medical informatics, 80(3), 190-204.
- Orekondy, T., Schiele, B., & Fritz, M. (2019). Knockoff nets: Stealing functionality of black-box models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 4954-4963).
- Pleiss, G., Raghavan, M., Wu, F., Kleinberg, J., & Weinberger, K. Q. (2017). On fairness and calibration. In Advances in Neural Information Processing Systems (pp. 5680-5689).
- Puiutta, E., & Veith, E. (2020). Explainable Reinforcement Learning: A Survey. arXiv preprint arXiv:2005.06247. · arXiv
- Ribeiro, M. T., Singh, S., & Guestrin, C. (2016, August). " Why should I trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1135-1144).
Cited by
Auditing Large Language Models: A Three-Layered Approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2023) · doi:10.2139/ssrn.4361607 · Cited by 292
Auditing large language models: a three-layered approach
Mökander, J., Schuett, J., Kirk, H. R., & Floridi, L. (2024) · AI and Ethics · doi:10.1007/s43681-023-00289-2 · Cited by 289
Fairness in recommender systems: research landscape and future directions
Deldjoo, Y., Jannach, D., Bellogin, A., Difonzo, A., & Zanzonelli, D. (2024) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-023-09364-z · Cited by 228
Adopting artificial intelligence in sustainable business
Sipola, J., Saunila, M., & Ukko, J. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.139197 · Cited by 153
Auditing of AI: Legal, Ethical and Technical Approaches
Mökander, J. (2023) · Digital Society · doi:10.1007/s44206-023-00074-y · Cited by 152
“In many jurisdictions, this has meant drafting new legislation.”
Black-Box Access is Insufficient for Rigorous AI Audits
Casper, S., Ezell, C., Siegmann, C., Kolt, N., Curtis, T. L., Bucknall, B., Haupt, A., Wei, K., Scheurer, J., Hobbhahn, M., et al. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3659037 · Cited by 86
ISO/IEC quality standards for AI engineering
Oviedo, J., Rodríguez, M., Trenta, A., Cannas, D., Natale, D., & Piattini, M. G. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100681 · Cited by 78
Mpofu, F. Y. (2023) · International Journal of Research in Business and Social Science (2147-4478) · doi:10.20525/ijrbs.v12i9.2737 · Cited by 71
A Practical Guide to Conversation Research: How to Study What People Say to Each Other
Yeomans, M., Boland, F. K., Collins, H. K., Abi-Esber, N., & Brooks, A. W. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231183919 · Cited by 60
Hartmann, D., de Pereira, J. R. L., Streitbörger, C., & Berendt, B. (2025) · AI and Ethics · doi:10.1007/s43681-024-00595-3 · Cited by 58
“However, the requirements for independence in the DSA still need to be specified.”
The Algorithmic State Architecture (ASA): An Integrated Framework for AI-Enabled GovernmentPreprint
Engin, Z., Crowcroft, J., Hand, D. J., & Treleaven, P. C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.08725 · Cited by 50
Self-citationMeasuring responsible artificial intelligence (RAI) in banking: a valid and reliable instrument
Ratzan, J., & Rahman, N. (2023) · AI and Ethics · doi:10.1007/s43681-023-00321-5 · Cited by 42
Responsible use of AI in military systems: prospects and challenges
Schraagen, J. M. (2023) · Ergonomics · doi:10.1080/00140139.2023.2278394 · Cited by 30
Beyond Code and Algorithms: Navigating Ethical Complexities in Artificial Intelligence
Ľuptáková, I. D., Pospíchal, J., & Huraj, L. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-54813-0_30 · Cited by 29
Majeed, A., & Hwang, S. O. (2023) · IEEE Access · doi:10.1109/access.2023.3235016 · Cited by 28
Resolving Ethics Trade-offs in Implementing Responsible AI
Sanderson, C., Schleiger, E., Douglas, D., Kuhnert, P., & Lu, Q. (2024) · IEEE Conference on Artificial Intelligence (CAI) · doi:10.1109/cai59869.2024.00215 · Cited by 26
Post-Covid-19 Metaverse Cybersecurity and Data Privacy: Present and Future Challenges
Wylde, V., Prakash, E., Hewage, C. T. E. R., & Platts, J. (2023) · Springer eBooks · doi:10.1007/978-3-031-34006-2_1 · Cited by 25
Responsible Use of AI in Military Systems
Schraagen, J. M. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003410379 · Cited by 24
Algorethics in Healthcare: Balancing Innovation and Integrity in AI Development
Lastrucci, A., Pirrera, A., Lepri, G., & Giansanti, D. (2024) · Algorithms · doi:10.3390/a17100432 · Cited by 23
Error Parity Fairness: Testing for Group Fairness in Regression TasksPreprint
Gürsoy, F., & Kakadiaris, I. A. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2208.08279 · Cited by 19
A Survey on the Recent Advancements in Human-Centered Dialog Systems
Oruche, R., Goruganthu, S. K., Akula, R., Cheng, X., Goni, M. A., Shibo, B. W., Kee, K. F., Zampieri, M., & Calyam, P. P. (2025) · ACM Computing Surveys · doi:10.1145/3729220 · Cited by 17
Güvenilir Yapay Zeka ve İç Denetim
Ağdeniz, Ş. (2024) · Denetişim · doi:10.58348/denetisim.1384391 · Cited by 15
“Trust us,” they said. Mapping the contours of trustworthiness in learning analytics
Slade, S., Prinsloo, P., & Khalil, M. (2023) · Information and Learning Sciences · doi:10.1108/ils-04-2023-0042 · Cited by 15
The AI Surge: Transfiguring Audit Profession With AI Technology
Kinana, S. B. B., & Arabiat, O. S. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83608-756-420251004 · Cited by 13
Multi-scale governance and data for sustainable development
Pastor-Escuredo, D., Gardeazabal, A., Koo, J., Imai, A., & Treleaven, P. C. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.1025256 · Cited by 10
Self-citationA Review of Big Data Analytics and Artificial Intelligence in Industry 5.0 for Smart Decision-Making
Kalinaki, K., Yahya, U., Malik, O. A., & Lai, D. T. C. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-2647-3.ch002 · Cited by 10
Mirzaei, A., Hajizade, M., & Hajizade, H. (2022) · International Journal of Health Sciences · doi:10.53730/ijhs.v6ns1.8181 · Cited by 9
Alshehhi, K., Cheaitou, A., & Rashid, H. S. (2024) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-024-02653-9 · Cited by 8
Exploring User Perceptions of Security Auditing in the Web3 Ecosystem
Huang, M. Z., Jiang, R., Sharma, T., & Wang, K. Y. (2025) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2025.240775 · Cited by 8
Ethics-based auditing of automated decision-making systems: considerations, challenges, na
Mökander, J. (2023) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-z5qakao0p · Cited by 12
Judijanto, L., Hardiansyah, A., & Arifudin, O. (2026) · INTERNATIONAL JOURNAL OF SOCIETY REVIEWS · Cited by 8
Lu, L. (2024) · International Conference on Distributed Computing and Optimization Techniques (ICDCOT) · doi:10.1109/icdcot61034.2024.10516154 · Cited by 8
Wang, Y., & Luo, D. (2023) · International Conference on Evolutionary Algorithms and Soft Computing Techniques (EASCT) · doi:10.1109/easct59475.2023.10393747 · Cited by 8
Managing Artificial Intelligence Algorithmic Discrimination: The Internal Audit Function Role
Nzama, L. (2023) · Accounting, finance, sustainability, governance & fraud · doi:10.1007/978-981-99-6327-0_14 · Cited by 7
System Cards for AI-Based Decision-Making for Public Policy
Gursoy, F., & Kakadiaris, I. A. (2022) · arXiv · doi:10.48550/arxiv.2203.04754 · Cited by 7
“also concerned with who are authorized to use the system [32] and should prevent personal or critical data leakage [33].”
BackgroundInfluentialKim, E. (2026) · Policy & Internet · doi:10.1002/poi3.70029 · Cited by 7
A Blueprint for Auditing Generative AIPreprint
Mökander, J., Curl, J., & Kshirsagar, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4887768 · Cited by 7
Scaling Up Customer Support Using Artificial Intelligence and Machine Learning Techniques
Kalinaki, K., Namuwaya, S., Mwamini, A., & Namuwaya, S. (2023) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/978-1-6684-7735-9.ch002 · Cited by 7
On Coordinating LLMs and Platform Knowledge for Software Modernization and New Developments
Truong, H., Vuković, M., & Pavuluri, R. (2024) · IEEE International Conference on Software Services Engineering (SSE) · doi:10.1109/sse62657.2024.00036 · Cited by 7
Advancing AI Audits for Enhanced AI GovernancePreprint
Ema, A., Sato, R., Hase, T., Nakano, M., Kamimura, S., & Kitamura, H. (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2312.00044 · Cited by 7
Advancing Trustworthy Explainable Artificial Intelligence: Principles, Goals, and Strategies
Sadiq, Z., & Aqib, M. (2023) · OALib · doi:10.4236/oalib.1110870 · Cited by 6
Beyond Innovation: Assessing the Risk Terrain of Industry 5.0 TechnologiesPreprint
Gupta, P., Jain, A. K., & Gupta, R. (2023) · Research Square · doi:10.21203/rs.3.rs-3704477/v1 · Cited by 5
The application of digital technologies in external auditing: a double edged sword?
Mpofu, F. Y., & Mpofu, Q. (2025) · International Journal of Business Ecosystem and Strategy (2687-2293) · doi:10.36096/ijbes.v7i1.641 · Cited by 5
A Socio-Technical Feedback Loop for Responsible Military AI Life-Cycles from Governance to Operation
Heijnen, M., Schoonderwoerd, T., Neerincx, M. A., van der Waa, J., Kester, L. J. H. M., van Diggelen, J., & Elands, P. J. M. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003410379-3 · Cited by 5
A Blueprint for Auditing Generative AIPreprint
Mökander, J., Curl, J., & Kshirsagar, M. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2407.05338 · Cited by 5
Assuring trustworthy AI: An integrative review of hierarchical and relational assurance approaches
Guo, Y., Foster, J., Buckley, A., & Zoukas, G. (2026) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2026.100415 · Cited by 4
AI ethics in postcolonial contexts: a critical synthesis of infrastructures, power, and governance
Abraham, I. (2026) · AI & Society · doi:10.1007/s00146-026-03153-z · Cited by 4
Industrial Relations Dispute Simulation System Prototype with Artificial Intelligence Approach
Parmenas, N. H., & Samosir, R. S. (2023) · Buletin Ilmiah Sarjana Teknik Elektro · doi:10.12928/biste.v5i2.7607 · Cited by 4
Human-centric Literature on Trust for SfTI Veracity SpearheadPreprint
Blincoe, K., Luczak–Roesch, M., Miller, T., & Galster, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.00226 · Cited by 4
Auditing in the Digital Age: The Role of IoT, Staff Training and Client Confidentiality
Rawashdeh, A. (2025) · International Journal of Auditing · doi:10.1111/ijau.70024 · Cited by 3
Ethical Concerns and Politicization of Digital Transformation in Bulgaria
Gueorguieva, P. (2024) · Contributions to Public Administration and Public Policy · doi:10.1007/978-3-031-67900-1_12 · Cited by 3
Schraagen, J. M. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003410379-22 · Cited by 3
Brand, D., Hoffmann, M., & der Merwe, J. V. (2025) · JeDEM - eJournal of eDemocracy and Open Government · doi:10.29379/jedem.v17i3.1049 · Cited by 3
Cyberbullying among adolescents: Mapping 25 years of global research
Babar, A., Asif, M. S., Kharub, I., & Beydoun, G. (2026) · Journal of Management & Organization · doi:10.1017/jmo.2026.10094 · Cited by 2
Bias, transparency and accountability in algorithmic human resource management
Ashaye, A. L., Orisakahunsi, O. F., Lawal, O. L., Adeniyi, S. A., Ikeakaonwu, O. M., & Ishaku, P. K. (2026) · Strategic Business Research · doi:10.1016/j.sbr.2026.100308 · Cited by 2
Regulating Artificial Intelligence for CANDU Software Qualifications
Dahaweer, S., Hammad, I., & Thiyagarajan, K. (2025) · Nuclear Engineering and Design · doi:10.1016/j.nucengdes.2025.114322 · Cited by 2
AI-Augmented Financial Ratio Analysis for Early Warning, Monitoring, and Assurance
Mohammad, Y., Mohamed, E. A., & Nachouki, M. (2025) · International Conference on Signal Processing and Information Security (ICSPIS) · doi:10.1109/icspis67605.2025.11318382 · Cited by 2
Chapter 4 Auditing Algorithms in the (Non-)Financial Audit: Status Quo and Way Forward
Bravidor, M. (2024) · De Gruyter eBooks · doi:10.1515/9783110790320-004 · Cited by 2
Overview of Risk Assessment and Management for Intelligent Systems under the AI Act and BeyondPreprint
Irigoyen, J., Daza, R., Morales, A., Fiérrez, J., Tolosana, R., Vera-Rodríguez, R., Jurado, F., & Ortigosa, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.02197 · Cited by 2
Enhancing Audit Evidence Quality Through Artificial Intelligence In Saudi Arabia
Alturki, K. H. (2025) · مجلة العلوم الإدارية و الاقتصادية · doi:10.71422/0427-018-002-004 · Cited by 2
Ethical and Legal Challenges of Using Artificial Intelligence in Digital Businesses
Farzin, O., & Samiei, R. (2023) · Tiknuluzhī dar kār/āfarīnī va mudīriyyat-i istrātizhīk. · doi:10.61838/kman.jtesm.2.2.3 · Cited by 2
Liu, H. (2023) · International Conference on Artificial Intelligence and Automation Control (AIAC) · doi:10.1109/aiac61660.2023.00035 · Cited by 2
Zhu, B. (2023) · International Conference on 3D Immersion, Interaction and Multi-sensory Experiences (ICDIIME) · doi:10.1109/icdiime59043.2023.00064 · Cited by 2
Federated Unlearning in Agentic Energy Systems: Security and Governance Implications
Yazdinejad, A., Niazi, M., Kong, J. D., & Nathwani, J. S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-41864-7_28 · Cited by 1
Mökander, J. (2025) · Wiley eBooks · doi:10.1002/9781394240821.ch12 · Cited by 1
Open Technology Management for Maximizing the Public Value of Large Language Models
Tomita, A. (2024) · Portland International Conference on Management of Engineering and Technology (PICMET) · doi:10.23919/picmet64035.2024.10652994 · Cited by 1
Research on Building System of Audit Evidence Integration Model Driven by Computer Big Data
Feng, L. (2024) · Journal of Electrical Systems · doi:10.52783/jes.1339 · Cited by 1
Gupta, P., Jain, A. K., & Gupta, R. (2024) · doi:10.52783/eel.v14i3.1823 · Cited by 1
Auditing Agentic AI Systems: Governance, Risk, and Control Frameworks
Kadali, R. S. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-8277-7.ch008
Gao, Y., Zhang, R., & Li, X. (2023) · Scientia Sinica Informationis · doi:10.1360/ssi-2023-0076
Almeida, R., & Latini, L. (2025) · The Paris Journal on AI & Digital Ethics · doi:10.65701/m4qf7v2k1n
AI Auditing : Incorporating eXplainable AI in an auditing framework
Van Wingerden, B. (2024) · UTUPub (University of Turku)
İç denetimde yapay zeka kullanımı : Türkiye’deki uygulamalar üzerine bir çalışma
Kuş, M. (2025) · Marmara University Open Access System
Supporting information 1 of Multi-scale governance and data for sustainable development
Pastor-Escuredo, D., Gardeazabal, A., Koo, J., Imai, A., & Treleaven, P. (2022) · doi:10.3389/fdata.2022.1025256.s001
Self-citation(2022) · Kinetic Mechanical Engineering · doi:10.38007/kme.2022.030202
High Level Talent Training Platform Based on Artificial Intelligence Algorithm
Guo, Y. (2023) · Advances in Social Science, Education and Humanities Research/Advances in social science, education and humanities research · doi:10.2991/978-2-38476-068-8_31
Application of Artificial Intelligence Algorithms in Wearable Device Signal Processing Systems
Qi, X., & Xiong, Y. (2023) · International Conference on Data Science and Network Security (ICDSNS) · doi:10.1109/icdsns58469.2023.10245184
Wang, H. (2026) · Lecture notes in mechanical engineering · doi:10.1007/978-981-96-8773-2_50
Advancing AI Audits for Enhanced AI Governance
Unit, T. G. P. R. (2023) · Institutional Repositories DataBase (IRDB)
Metadata
- Authors
- Koshiyama, A., Kazim, E., & Treleaven, P.
- Affiliations
- University College London (GB)
- Venue
- Computer
- Published
- 2022-04
- Volume
- 55
- Issue
- 4
- Pages
- 40-50
- ISSN
- 0018-9162 (ISSN-L)
- 1558-0814
- OpenAlex
- W4223475929
- Cited by
- 55
- References
- 13
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 17 · 2023: 20 · 2022: 3
- FWCI
- 13.61
- Type
- journal article
- Language
- en
- Open access
- green
- discovery.ucl.ac.uk
- Licence
- Locations
- Computer (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- Cisco Research Center (2019-207109, 3696)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- algorithmic auditing, artificial intelligence, machine learning, algorithmic risk, legal risk, ethical risks, reputational risk, financial risk
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.