CoChat

A systematic review of artificial intelligence impact assessments

Open access
Stahl, Bernd Carsten, Antoniou, Josephina, Bhalla, Nitika, Brooks, Laurence, Jansen, Philip, Lindqvist, Blerta, Kirichenko, Alexey, Marchal, Samuel, Rodrigues, Rowena, Santiago, Nicole, Warso, Zuzanna, Wright, David · 2023 · Artificial Intelligence Review
Cited by 212

The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.

Abstract

Artificial intelligence (AI) is producing highly beneficial impacts in many domains, from transport to healthcare, from energy distribution to marketing, but it also raises concerns about undesirable ethical and social consequences. AI impact assessments (AI-IAs) are a way of identifying positive and negative impacts early on to safeguard AI’s benefits and avoid its downsides. This article describes the first systematic review of these AI-IAs. Working with a population of 181 documents, the authors identified 38 actual AI-IAs and subjected them to a rigorous qualitative analysis with regard to their purpose, scope, organisational context, expected issues, timeframe, process and methods, transparency and challenges. The review demonstrates some convergence between AI-IAs. It also shows that the field is not yet at the point of full agreement on content, structure and implementation. The article suggests that AI-IAs are best understood as means to stimulate reflection and discussion concerning the social and ethical consequences of AI ecosystems. Based on the analysis of existing AI-IAs, the authors describe a baseline process of implementing AI-IAs that can be implemented by AI developers and vendors and that can be used as a critical yardstick by regulators and external observers to evaluate organisations’ approaches to AI.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10462-023-10420-8

Cites

21 of 21 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 21 references

Research works printed but not linked: 69

  1. Access Now (2018) Human rights in the age of artificial intelligence. Access Now
  2. Access Now Policy Team (2018) The Toronto declaration: protecting the right to equality and non-discrimination in machine learning systems. Access Now Policy Team, Toronto
  3. Ada Lovelace Institute (2020) Examining tools for assessing algorithmic systems the Black Box. Ada Lovelace Institute, London
  4. Ada Lovelace Institute (2022) Algorithmic impact assessment: a case study in healthcare. Ada Lovelace Institute, London
  5. Adner R (2006) Match your innovation strategy to your innovation ecosystem. Harv Bus Rev 84:98–107
  6. Adner R (2017) Ecosystem as structure: an actionable construct for strategy. J Manag 43:39–58
  7. AI Now Institute (2018a) Algorithmic impact assessments: a practical framework for public agency accountability. AI Now Institute, New York
  8. Andrade NNG, Kontschieder V (2021) AI impact assessment: a policy prototyping experiment. OpenLoop · doi:10.2139/ssrn.3772500
  9. Becker HA (2001) Social impact assessment. Eur J Oper Res 128:311–321. https://doi.org/10.1016/S0377-2217(00)00074-6 · DOI · Paper page
  10. Boell SK, Cecez-Kecmanovic D (2015) On being ‘systematic’ in literature reviews in IS. J Inf Technol 30:161–173. https://doi.org/10.1057/jit.2014.26 · DOI · Paper page
  11. Brinkman B, Flick C, Gotterbarn D et al (2017) Listening to professional voices: draft 2 of the ACM code of ethics and professional conduct. Commun ACM 60:105–111. https://doi.org/10.1145/3072528 · DOI · Paper page
  12. CAHAI Ad Hoc Committee on Artificial Intelligence (2022) Possible elements of a legal framework on artificial intelligence, based on the Council of Europe’s standards on human rights, democracy and the rule of law. CAHAI Ad Hoc Committee on Artificial Intelligence, Strasbourg
  13. CEN-CENELEC (2017) Ethics assessment for research and innovation—part 2: ethical impact assessment framework. CEN-CENELEC, Brussels
  14. Clarke R (2009) Privacy impact assessment: its origins and development. Comput Law Secur Rev 25:123–135. https://doi.org/10.1016/j.clsr.2009.02.002 · DOI · Paper page
  15. Clarke R (2019b) Regulatory alternatives for AI. Comput Law Secur Rev 35:398–409 · DOI
  16. Coeckelbergh M (2019) Artificial intelligence: some ethical issues and regulatory challenges. Technol Regul 1:31–34. https://doi.org/10.26116/techreg.2019.003 · DOI
  17. Devitt K, Gan M, Scholz J, Bolia R (2020) A method for ethical AI in defence. Australian Government - Department of Defence, Canberra
  18. Digital Catapult (2020) Lessons in practical AI ethics: taking the UK’s AI ecosystem from ‘what’ to ‘how.’ Digital Catapult, London
  19. Eceani G, Koene A, Kumar R et al (2021) A survey of artificial intelligence risk assessment methodologies: The global state of play and leading practices identified. Ernest & Young LLP and Trilateral Research, London
  20. Elsevier (2018) Artificial intelligence: how knowledge is created, transferred, and used—trends in China, Europe, and the United States. Elsevier, Amsterdam
  21. European Commission (2022) Proposal for a Directive on adapting non contractual civil liability rules to artificial intelligence. European Commission, Brussels
  22. European Union (2010) Charter of fundamental rights of the European Union. European Union, Brussels
  23. European Union Agency for Fundamental Rights (2020) Getting the future right artificial intelligence and fundamental rights; report. European Union Agency for Fundamental Rights, Vienna
  24. Expert Group on Liability and New Technologies (2019) Liability for artificial intelligence and other emerging digital technologies. European Commission, Luxembourg
  25. FRA (2020) Getting the future right—artificial intelligence and fundamental rights. European Union Agency for Fundamental Rights, Luxembourg
  26. Gardner A, Smith AL, Steventon A et al (2021) Ethical funding for trustworthy AI: proposals to address the responsibilities of funders to ensure that projects adhere to trustworthy AI practice. AI Ethics. https://doi.org/10.1007/s43681-021-00069-w · DOI
  27. GDPR (2016) Regulation (EU) 2016/679 of the European parliament and of the council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). Official Journal of the European Union L119/1
  28. Gebru T, Morgenstern J, Vecchione B, et al (2020) Datasheets for datasets. https://arxiv.org/abs/1803.09010 · arXiv
  29. Government Accountability Office (2018) Technology Assessment, Emerging Opportunities, Challenges, and Implications. Government Accountability Office, Washington, D.C.
  30. Government of Canada (2022) Algorithmic impact assessment tool. Government of Canada, Ottawa
  31. Hartley N, Wood C (2005) Public participation in environmental impact assessment—implementing the Aarhus Convention. Environ Impact Assess Rev 25:319–340. https://doi.org/10.1016/j.eiar.2004.12.002 · DOI · Paper page
  32. Hleg AI (2019) Ethics guidelines for trustworthy AI. European Commission - Directorate-General for Communication, Brussels
  33. Hleg AI (2020) Assessment list for trustworthy AI (ALTAI). European Commission, Brussels
  34. IEEE (2020a) IEEE 7010-2020a—IEEE recommended practice for assessing the impact of autonomous and intelligent systems on human well-being. IEEE
  35. IEEE Computer Society (2021) IEEE standard model process for addressing ethical concerns during system design—7000-2021
  36. Iqbal S, Altaf W, Aslam M et al (2016) Application of intelligent agents in health-care: review. Artif Intell Rev 46:83–112. https://doi.org/10.1007/s10462-016-9457-y · DOI
  37. Ivanova Y (2020) The data protection impact assessment as a tool to enforce Non-discriminatory AI. In: Antunes L, Naldi M, Italiano GF, Rannenberg K, Drogkaris P (eds) Privacy technologies and policy. Springer International Publishing, pp 3–24. https://doi.org/10.1007/978-3-030-55196-4_1 · DOI
  38. Kaminski ME, Malgieri G (2019) Algorithmic impact assessments under the GDPR: producing multi-layered explanations. SSRN Electron J. https://doi.org/10.2139/ssrn.3456224 · DOI
  39. Levy Y, Ellis TJ (2006) A systems approach to conduct an effective literature review in support of information systems research. Informing Sci 9:181–212 · DOI · Paper page
  40. Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLOS Med 6:e1000100. https://doi.org/10.1371/journal.pmed.1000100 · DOI · Paper page
  41. Liu W, Zhao J, Du L et al (2021) Intelligent comprehensive evaluation system using artificial intelligence for environmental evaluation. Environ Impact Assess Rev. https://doi.org/10.1016/j.eiar.2020.106495 · doi:10.1016/j.eiar.2020.106495
  42. Mantelero A (2018) AI and Big Data: a blueprint for a human rights, social and ethical impact assessment. Comput Law Secur Rev 34:754–772. https://doi.org/10.1016/j.clsr.2018.05.017 · DOI · Paper page
  43. Mantelero A, Esposito MS (2021) An evidence-based methodology for human rights impact assessment (HRIA) in the development of AI data-intensive systems. Comput Law Secur Rev 41:105561. https://doi.org/10.1016/j.clsr.2021.105561 · DOI
  44. Martin CD, Makoundou TT (2017) Taking the high road ethics by design in AI. ACM Inroads 8:35–37 · DOI
  45. Moore JF (1993) Predators and prey: a new ecology of competition. Harv Bus Rev 71:75–86
  46. Muller C (2020) The impact of artificial intelligence on human rights, democracy and the rule of law. Council of Europe, Ad Hoc Committee on Artificial Intelligence (CAHAI), Strasbourg
  47. Nemitz P (2018) Constitutional democracy and technology in the age of artificial intelligence. Philos Trans R Soc A 376:20180089. https://doi.org/10.1098/rsta.2018.0089 · DOI · Paper page
  48. NIST (2022) AI risk management framework: second draft. NIST, Gaithersburg
  49. OECD (2019) Recommendation of the council on artificial intelligence. OECD, Paris
  50. Oswald M (2018) Algorithmic risk assessment policing models: lessons from the Durham HART model and ‘Experimental’ proportionality. https://doi.org/10.1080/13600834.2018.1458455 · DOI · Paper page
  51. Park D, Um M-J (2018) Robust decision-making technique for strategic environment assessment with deficient information. Water Resour Manag 32:4953–4970. https://doi.org/10.1007/s11269-018-2066-6 · doi:10.1007/s11269-018-2066-6
  52. Peng Y, Liu E, Peng S et al (2022) Using artificial intelligence technology to fight COVID-19: a review. Artif Intell Rev. https://doi.org/10.1007/s10462-021-10106-z · DOI
  53. Persson A (2016) Implicit bias in predictive data profiling within recruitments. In: Lehmann A, Whitehouse D, Fischer-Hübner S et al (eds) Privacy and identity management. Facing up to next steps. Springer International Publishing, Cham, pp 212–230 · DOI
  54. PWC (2019) A practical guide to responsible artificial intelligence (AI). PWC, London
  55. Raso FA, Hilligoss H, Krishnamurthy V et al (2018) Artificial intelligence & human rights: opportunities & risks. Social Science Research Network, Rochester
  56. Rowe F (2014) What literature review is not: diversity, boundaries and recommendations. Eur J Inf Syst 23:241–255. https://doi.org/10.1057/ejis.2014.7 · DOI · Paper page
  57. Schwarz A, Mehta M, Johnson N, Chin WW (2007) Understanding frameworks and reviews: a commentary to assist us in moving our field forward by analyzing our past. SIGMIS Database 38:29–50. https://doi.org/10.1145/1278253.1278259 · DOI
  58. Sipior JC (2020) Considerations for development and use of AI in response to COVID-19. Int J Inf Manag 55:102170. https://doi.org/10.1016/j.ijinfomgt.2020.102170 · DOI
  59. Stahl BC (2021) Artificial intelligence for a better future: an ecosystem perspective on the ethics of AI and emerging digital technologies. Springer International Publishing, Cham · DOI · Paper page
  60. Stahl BC, Timmermans J, Mittelstadt BD (2016) The ethics of computing: a survey of the computing-oriented literature. ACM Comput Surv 48:55:1-55:38. https://doi.org/10.1145/2871196 · DOI · Paper page
  61. Stix C (2021) Actionable principles for artificial intelligence policy: three pathways. Sci Eng Ethics 27:15. https://doi.org/10.1007/s11948-020-00277-3 · DOI
  62. Tate M, Furtmueller E, Evermann J, Bandara W (2015) Introduction to the special issue: the literature review in information systems. Commun Assoc Inf Syst. https://doi.org/10.17705/1CAIS.03705 · DOI
  63. UNESCO (2020) First version of a draft text of a recommendation on the Ethics of Artificial Intelligence. UNESCO, Paris
  64. Wallach W, Marchant G (2019) Toward the agile and comprehensive international governance of AI and robotics [point of view]. Proc IEEE 107:505–508. https://doi.org/10.1109/JPROC.2019.2899422 · DOI
  65. Whitby B (1991) Ethical AI. Artif Intell Rev 5:201–204. https://doi.org/10.1007/BF00143762 · doi:10.1007/bf00143762
  66. Williams C (2020) A health rights impact assessment guide for artificial intelligence projects—abstract—Europe PMC. Health Hum Rights J 22:55–62
  67. Wright D (2011) A framework for the ethical impact assessment of information technology. Ethics Inf Technol 13:199–226. https://doi.org/10.1007/s10676-010-9242-6 · DOI · Paper page
  68. Wright D, Friedewald M (2013) Integrating privacy and ethical impact assessments. Sci Public Policy 40:755–766. https://doi.org/10.1093/scipol/sct083 · DOI
  69. Xiao Y, Watson M (2019) Guidance on conducting a systematic literature review. J Plan Educ Res 39:93–112. https://doi.org/10.1177/0739456X17723971 · DOI · Paper page

Cited by

See all 212

Metadata

Authors
Stahl, B. C., Antoniou, J., Bhalla, N., Brooks, L., Jansen, P., Lindqvist, B., Kirichenko, A., Marchal, S., Rodrigues, R., Santiago, N., Warso, Z., & Wright, D.
Venue
Artificial Intelligence Review
Published
2023-03-24
Volume
56
Issue
11
Pages
12799-12831
ISSN
  • 0269-2821 (ISSN-L)
  • 1573-7462
OpenAlex
W4360856932
Cited by
212
References
21
FWCI
12.05
Type
journal article
Language
en
Open access
hybrid
Licence
Funders
  • H2020 Science with and for Society (786641)
  • Horizon 2020 Framework Programme (945539)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A systematic review of artificial intelligence impact assessments. https://app.cochat.ai/papers/10.1007/s10462-023-10420-8
The paper
Stahl, B. C., Antoniou, J., Bhalla, N., Brooks, L., Jansen, P., Lindqvist, B., Kirichenko, A., Marchal, S., Rodrigues, R., Santiago, N., Warso, Z., & Wright, D. (2023). A systematic review of artificial intelligence impact assessments. Artificial Intelligence Review. https://doi.org/10.1007/s10462-023-10420-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.