A systematic review of artificial intelligence impact assessments
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is producing highly beneficial impacts in many domains, from transport to healthcare, from energy distribution to marketing, but it also raises concerns about undesirable ethical and social consequences. AI impact assessments (AI-IAs) are a way of identifying positive and negative impacts early on to safeguard AI’s benefits and avoid its downsides. This article describes the first systematic review of these AI-IAs. Working with a population of 181 documents, the authors identified 38 actual AI-IAs and subjected them to a rigorous qualitative analysis with regard to their purpose, scope, organisational context, expected issues, timeframe, process and methods, transparency and challenges. The review demonstrates some convergence between AI-IAs. It also shows that the field is not yet at the point of full agreement on content, structure and implementation. The article suggests that AI-IAs are best understood as means to stimulate reflection and discussion concerning the social and ethical consequences of AI ecosystems. Based on the analysis of existing AI-IAs, the authors describe a baseline process of implementing AI-IAs that can be implemented by AI developers and vendors and that can be used as a critical yardstick by regulators and external observers to evaluate organisations’ approaches to AI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · cited 1×
“Its significant potential economic, social and health (Iqbal et al. 2016; Topol 2019) benefits are, however, counterbalanced by potential disadvantages (Whitby 1991).”
BackgroundThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 2,245
XAI—Explainable artificial intelligence
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019) · Science Robotics · doi:10.1126/scirobotics.aay7120 · Cited by 2,053
Principles alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886
A Pragmatic View of Thematic Analysis
Aronson, J. (1995) · The Qualitative Report · doi:10.46743/2160-3715/1995.2069 · Cited by 1,758
Fjeld, J., Achten, N., Hilligoss, H., Nagy, A., & Srikumar, M. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3518482 · Cited by 998 · cited 1×
“2017), ethics frameworks (AI HLEG 2019), development methodologies (Martin and Makoundou 2017; Fjeld et al. 2020) etc.”
BackgroundExplainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
Research works printed but not linked: 69
- Access Now (2018) Human rights in the age of artificial intelligence. Access Now
- Access Now Policy Team (2018) The Toronto declaration: protecting the right to equality and non-discrimination in machine learning systems. Access Now Policy Team, Toronto
- Ada Lovelace Institute (2020) Examining tools for assessing algorithmic systems the Black Box. Ada Lovelace Institute, London
- Ada Lovelace Institute (2022) Algorithmic impact assessment: a case study in healthcare. Ada Lovelace Institute, London
- Adner R (2006) Match your innovation strategy to your innovation ecosystem. Harv Bus Rev 84:98–107
- Adner R (2017) Ecosystem as structure: an actionable construct for strategy. J Manag 43:39–58
- AI Now Institute (2018a) Algorithmic impact assessments: a practical framework for public agency accountability. AI Now Institute, New York
- Andrade NNG, Kontschieder V (2021) AI impact assessment: a policy prototyping experiment. OpenLoop · doi:10.2139/ssrn.3772500
- Becker HA (2001) Social impact assessment. Eur J Oper Res 128:311–321. https://doi.org/10.1016/S0377-2217(00)00074-6 · DOI · Paper page
- Boell SK, Cecez-Kecmanovic D (2015) On being ‘systematic’ in literature reviews in IS. J Inf Technol 30:161–173. https://doi.org/10.1057/jit.2014.26 · DOI · Paper page
- Brinkman B, Flick C, Gotterbarn D et al (2017) Listening to professional voices: draft 2 of the ACM code of ethics and professional conduct. Commun ACM 60:105–111. https://doi.org/10.1145/3072528 · DOI · Paper page
- CAHAI Ad Hoc Committee on Artificial Intelligence (2022) Possible elements of a legal framework on artificial intelligence, based on the Council of Europe’s standards on human rights, democracy and the rule of law. CAHAI Ad Hoc Committee on Artificial Intelligence, Strasbourg
- CEN-CENELEC (2017) Ethics assessment for research and innovation—part 2: ethical impact assessment framework. CEN-CENELEC, Brussels
- Clarke R (2009) Privacy impact assessment: its origins and development. Comput Law Secur Rev 25:123–135. https://doi.org/10.1016/j.clsr.2009.02.002 · DOI · Paper page
- Clarke R (2019b) Regulatory alternatives for AI. Comput Law Secur Rev 35:398–409 · DOI
- Coeckelbergh M (2019) Artificial intelligence: some ethical issues and regulatory challenges. Technol Regul 1:31–34. https://doi.org/10.26116/techreg.2019.003 · DOI
- Devitt K, Gan M, Scholz J, Bolia R (2020) A method for ethical AI in defence. Australian Government - Department of Defence, Canberra
- Digital Catapult (2020) Lessons in practical AI ethics: taking the UK’s AI ecosystem from ‘what’ to ‘how.’ Digital Catapult, London
- Eceani G, Koene A, Kumar R et al (2021) A survey of artificial intelligence risk assessment methodologies: The global state of play and leading practices identified. Ernest & Young LLP and Trilateral Research, London
- Elsevier (2018) Artificial intelligence: how knowledge is created, transferred, and used—trends in China, Europe, and the United States. Elsevier, Amsterdam
- European Commission (2022) Proposal for a Directive on adapting non contractual civil liability rules to artificial intelligence. European Commission, Brussels
- European Union (2010) Charter of fundamental rights of the European Union. European Union, Brussels
- European Union Agency for Fundamental Rights (2020) Getting the future right artificial intelligence and fundamental rights; report. European Union Agency for Fundamental Rights, Vienna
- Expert Group on Liability and New Technologies (2019) Liability for artificial intelligence and other emerging digital technologies. European Commission, Luxembourg
- FRA (2020) Getting the future right—artificial intelligence and fundamental rights. European Union Agency for Fundamental Rights, Luxembourg
- Gardner A, Smith AL, Steventon A et al (2021) Ethical funding for trustworthy AI: proposals to address the responsibilities of funders to ensure that projects adhere to trustworthy AI practice. AI Ethics. https://doi.org/10.1007/s43681-021-00069-w · DOI
- GDPR (2016) Regulation (EU) 2016/679 of the European parliament and of the council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). Official Journal of the European Union L119/1
- Gebru T, Morgenstern J, Vecchione B, et al (2020) Datasheets for datasets. https://arxiv.org/abs/1803.09010 · arXiv
- Government Accountability Office (2018) Technology Assessment, Emerging Opportunities, Challenges, and Implications. Government Accountability Office, Washington, D.C.
- Government of Canada (2022) Algorithmic impact assessment tool. Government of Canada, Ottawa
- Hartley N, Wood C (2005) Public participation in environmental impact assessment—implementing the Aarhus Convention. Environ Impact Assess Rev 25:319–340. https://doi.org/10.1016/j.eiar.2004.12.002 · DOI · Paper page
- Hleg AI (2019) Ethics guidelines for trustworthy AI. European Commission - Directorate-General for Communication, Brussels
- Hleg AI (2020) Assessment list for trustworthy AI (ALTAI). European Commission, Brussels
- IEEE (2020a) IEEE 7010-2020a—IEEE recommended practice for assessing the impact of autonomous and intelligent systems on human well-being. IEEE
- IEEE Computer Society (2021) IEEE standard model process for addressing ethical concerns during system design—7000-2021
- Iqbal S, Altaf W, Aslam M et al (2016) Application of intelligent agents in health-care: review. Artif Intell Rev 46:83–112. https://doi.org/10.1007/s10462-016-9457-y · DOI
- Ivanova Y (2020) The data protection impact assessment as a tool to enforce Non-discriminatory AI. In: Antunes L, Naldi M, Italiano GF, Rannenberg K, Drogkaris P (eds) Privacy technologies and policy. Springer International Publishing, pp 3–24. https://doi.org/10.1007/978-3-030-55196-4_1 · DOI
- Kaminski ME, Malgieri G (2019) Algorithmic impact assessments under the GDPR: producing multi-layered explanations. SSRN Electron J. https://doi.org/10.2139/ssrn.3456224 · DOI
- Levy Y, Ellis TJ (2006) A systems approach to conduct an effective literature review in support of information systems research. Informing Sci 9:181–212 · DOI · Paper page
- Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLOS Med 6:e1000100. https://doi.org/10.1371/journal.pmed.1000100 · DOI · Paper page
- Liu W, Zhao J, Du L et al (2021) Intelligent comprehensive evaluation system using artificial intelligence for environmental evaluation. Environ Impact Assess Rev. https://doi.org/10.1016/j.eiar.2020.106495 · doi:10.1016/j.eiar.2020.106495
- Mantelero A (2018) AI and Big Data: a blueprint for a human rights, social and ethical impact assessment. Comput Law Secur Rev 34:754–772. https://doi.org/10.1016/j.clsr.2018.05.017 · DOI · Paper page
- Mantelero A, Esposito MS (2021) An evidence-based methodology for human rights impact assessment (HRIA) in the development of AI data-intensive systems. Comput Law Secur Rev 41:105561. https://doi.org/10.1016/j.clsr.2021.105561 · DOI
- Martin CD, Makoundou TT (2017) Taking the high road ethics by design in AI. ACM Inroads 8:35–37 · DOI
- Moore JF (1993) Predators and prey: a new ecology of competition. Harv Bus Rev 71:75–86
- Muller C (2020) The impact of artificial intelligence on human rights, democracy and the rule of law. Council of Europe, Ad Hoc Committee on Artificial Intelligence (CAHAI), Strasbourg
- Nemitz P (2018) Constitutional democracy and technology in the age of artificial intelligence. Philos Trans R Soc A 376:20180089. https://doi.org/10.1098/rsta.2018.0089 · DOI · Paper page
- NIST (2022) AI risk management framework: second draft. NIST, Gaithersburg
- OECD (2019) Recommendation of the council on artificial intelligence. OECD, Paris
- Oswald M (2018) Algorithmic risk assessment policing models: lessons from the Durham HART model and ‘Experimental’ proportionality. https://doi.org/10.1080/13600834.2018.1458455 · DOI · Paper page
- Park D, Um M-J (2018) Robust decision-making technique for strategic environment assessment with deficient information. Water Resour Manag 32:4953–4970. https://doi.org/10.1007/s11269-018-2066-6 · doi:10.1007/s11269-018-2066-6
- Peng Y, Liu E, Peng S et al (2022) Using artificial intelligence technology to fight COVID-19: a review. Artif Intell Rev. https://doi.org/10.1007/s10462-021-10106-z · DOI
- Persson A (2016) Implicit bias in predictive data profiling within recruitments. In: Lehmann A, Whitehouse D, Fischer-Hübner S et al (eds) Privacy and identity management. Facing up to next steps. Springer International Publishing, Cham, pp 212–230 · DOI
- PWC (2019) A practical guide to responsible artificial intelligence (AI). PWC, London
- Raso FA, Hilligoss H, Krishnamurthy V et al (2018) Artificial intelligence & human rights: opportunities & risks. Social Science Research Network, Rochester
- Rowe F (2014) What literature review is not: diversity, boundaries and recommendations. Eur J Inf Syst 23:241–255. https://doi.org/10.1057/ejis.2014.7 · DOI · Paper page
- Schwarz A, Mehta M, Johnson N, Chin WW (2007) Understanding frameworks and reviews: a commentary to assist us in moving our field forward by analyzing our past. SIGMIS Database 38:29–50. https://doi.org/10.1145/1278253.1278259 · DOI
- Sipior JC (2020) Considerations for development and use of AI in response to COVID-19. Int J Inf Manag 55:102170. https://doi.org/10.1016/j.ijinfomgt.2020.102170 · DOI
- Stahl BC (2021) Artificial intelligence for a better future: an ecosystem perspective on the ethics of AI and emerging digital technologies. Springer International Publishing, Cham · DOI · Paper page
- Stahl BC, Timmermans J, Mittelstadt BD (2016) The ethics of computing: a survey of the computing-oriented literature. ACM Comput Surv 48:55:1-55:38. https://doi.org/10.1145/2871196 · DOI · Paper page
- Stix C (2021) Actionable principles for artificial intelligence policy: three pathways. Sci Eng Ethics 27:15. https://doi.org/10.1007/s11948-020-00277-3 · DOI
- Tate M, Furtmueller E, Evermann J, Bandara W (2015) Introduction to the special issue: the literature review in information systems. Commun Assoc Inf Syst. https://doi.org/10.17705/1CAIS.03705 · DOI
- UNESCO (2020) First version of a draft text of a recommendation on the Ethics of Artificial Intelligence. UNESCO, Paris
- Wallach W, Marchant G (2019) Toward the agile and comprehensive international governance of AI and robotics [point of view]. Proc IEEE 107:505–508. https://doi.org/10.1109/JPROC.2019.2899422 · DOI
- Whitby B (1991) Ethical AI. Artif Intell Rev 5:201–204. https://doi.org/10.1007/BF00143762 · doi:10.1007/bf00143762
- Williams C (2020) A health rights impact assessment guide for artificial intelligence projects—abstract—Europe PMC. Health Hum Rights J 22:55–62
- Wright D (2011) A framework for the ethical impact assessment of information technology. Ethics Inf Technol 13:199–226. https://doi.org/10.1007/s10676-010-9242-6 · DOI · Paper page
- Wright D, Friedewald M (2013) Integrating privacy and ethical impact assessments. Sci Public Policy 40:755–766. https://doi.org/10.1093/scipol/sct083 · DOI
- Xiao Y, Watson M (2019) Guidance on conducting a systematic literature review. J Plan Educ Res 39:93–112. https://doi.org/10.1177/0739456X17723971 · DOI · Paper page
Cited by
The Ethics of ChatGPT-Exploring the Ethical Issues of an Emerging Technology
Stahl, B. C., & Eke, D. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102700 · Cited by 476
Self-citationExploring Artificial Intelligence in Academic Essay: Higher Education Student's Perspective
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki (2023) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2023.100296 · Cited by 418
Artificial intelligence for literature reviews: opportunities and challenges
Bolaños, F., Salatino, A., Osborne, F., & Motta, E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10902-3 · Cited by 246
Harnessing AI to Foster Equity in Education: Opportunities, Challenges, and Emerging Strategies
Roshanaei, M., Olivares, H., & Lopez, R. R. (2023) · Journal of Intelligent Learning Systems and Applications · doi:10.4236/jilsa.2023.154009 · Cited by 147
Assessing AI adoption in developing country academia: A trust and privacy-augmented UTAUT framework
Rana, M. M., Siddiqee, M. S., Sakib, M. N., & Ahamed, M. R. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e37569 · Cited by 143
Metadata
- Authors
- Stahl, B. C., Antoniou, J., Bhalla, N., Brooks, L., Jansen, P., Lindqvist, B., Kirichenko, A., Marchal, S., Rodrigues, R., Santiago, N., Warso, Z., & Wright, D.
- Venue
- Artificial Intelligence Review
- Published
- 2023-03-24
- Volume
- 56
- Issue
- 11
- Pages
- 12799-12831
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W4360856932
- Cited by
- 212
- References
- 21
- FWCI
- 12.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- H2020 Science with and for Society (786641)
- Horizon 2020 Framework Programme (945539)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A systematic review of artificial intelligence impact assessments. https://app.cochat.ai/papers/10.1007/s10462-023-10420-8
- The paper
- Stahl, B. C., Antoniou, J., Bhalla, N., Brooks, L., Jansen, P., Lindqvist, B., Kirichenko, A., Marchal, S., Rodrigues, R., Santiago, N., Warso, Z., & Wright, D. (2023). A systematic review of artificial intelligence impact assessments. Artificial Intelligence Review. https://doi.org/10.1007/s10462-023-10420-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.