AI-deploying organizations are key to addressing ‘perfect storm’ of AI risks
Open accessAbstract
We argue that a perfect storm of five conditions heightens the risk of harm to society from artificial intelligence: (1) the powerful, invisible nature of AI, (2) low public awareness and AI literacy, (3) rapid scaled deployment of AI, (4) insufficient regulation, and (5) the gap between trustworthy AI principles and practices. To prevent harm, fit-for-purpose regulation and public AI literacy programs have been recommended, but education and government regulation will not be sufficient: AI-deploying organizations need to play a central role in creating and deploying trustworthy AI in line with the principles of trustworthy AI, and taking accountability to mitigate the risks.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The accelerating shift towards new modes of digital public governance requires an adaptation of the legal framework.
“The accelerating shift towards new modes of digital public governance, therefore, requires an adaptation of the legal framework-and there is broad support for this view (see, e.g., Curtis et al. (2023)).”
From Resh(AI)ping Good Administration: Addressing the Mass Effects of Public Sector Digitalisation (2024) · cites this paper as Curtis et al. (2023)
In “Conditions heightening the risk of harm from AI systems” (page unavailable), the paper says public-sector AI adoption is increasing while regulation of AI systems lags behind. Its policy recommendations support adapting regulation for AI, but it does not address the broader shift to new modes of digital public governance or the legal framework for that shift generally. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · see citing works
High-performance medicine: the convergence of human and artificial intelligence
Topol, E. J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0300-7 · Cited by 10,450 · see citing works
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1× · see citing works
“Many subsequent AI ethics frameworks draw on these ideals, with an emerging convergence on a set of principles [49].”
BackgroundThe role of artificial intelligence in achieving the Sustainable Development Goals
Vinuesa, R., Azizpour, H., Leite, I., Balaam, M., Dignum, V., Domisch, S., Felländer, A., Langhans, S. D., Tegmark, M., & Fuso Nerini, F. (2020) · Nature Communications · doi:10.1038/s41467-019-14108-y · Cited by 3,294 · see citing works
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 1× · see citing works
“The gap in the integration of the trustworthy AI principle of transparency contributes to this low literacy and awareness of AI throughout the general population and has led to calls for the promotion of greater transparency in all aspects of AI design, extending to the intentions of the system creators and disclosure…”
BackgroundBig other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 2,978 · cited 1× · see citing works
“Strong temptations for governments and organizations to gather and access as much data as they can [18, 24] for policy or profit, raises concerns about the possibility of mission creep [25].”
BackgroundA 61-million-person experiment in social influence and political mobilization
Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012) · Nature · doi:10.1038/nature11421 · Cited by 2,575 · see citing works
Principles alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886 · cited 1× · see citing works
“Although some aspects of AI and data use are covered by existing regulatory and human rights frameworks in certain jurisdictions (such as non-discrimination laws and data protection acts), regulation to govern the risks of AI systems has been criticized for lagging behind the technology [42].”
BackgroundCrop yield prediction using machine learning: A systematic literature review
van Klompenburg, T., Kassahun, A., & Catal, C. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105709 · Cited by 1,881 · see citing works
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372873 · Cited by 1,372 · cited 1× · see citing works
“Deeper understanding of how these organizations can translate the principles of trustworthy AI into practice is needed, including methods for the early detection of errors and a focus on contestability and accountability [54].”
Explainable AI: From black box to glass box
Rai, A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00710-5 · Cited by 1,317 · see citing works
Skilful precipitation nowcasting using deep generative models of radar
Ravuri, S., Lenc, K., Willson, M., Kangin, D., Lam, R., Mirowski, P., Fitzsimons, M., Athanassiadou, M., Kashem, S., Madge, S., et al. (2021) · Nature · doi:10.1038/s41586-021-03854-z · Cited by 1,024 · see citing works
Privacy and artificial intelligence: challenges for protecting health information in a new era
Murdoch, B. (2021) · BMC Medical Ethics · doi:10.1186/s12910-021-00687-3 · Cited by 991 · see citing works
Envisioning AI for K-12: What Should Every Child Know about AI?
Touretzky, D., Gardner-McCune, C., Martin, F., & Seehorn, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33019795 · Cited by 918 · see citing works
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781 · see citing works
Larrazabal, A. J., Nieto, N., Peterson, V., Milone, D. H., & Ferrante, E. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919012117 · Cited by 685 · see citing works
Artificial Intelligence and Big Data
O’Leary, D. E. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.39 · Cited by 501 · see citing works
Artificial Intelligence: American Attitudes and Trends
Zhang, B., & Dafoe, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3312874 · Cited by 464 · see citing works
Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting
De-Arteaga, M., Romanov, A., Wallach, H., Chayes, J., Borgs, C., Chouldechova, A., Geyik, S., Kenthapadi, K., & Kalai, A. T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287572 · Cited by 337 · see citing works
Governing AI safety through independent audits
Falco, G., Shneiderman, B., Badger, J., Carrier, R., Dahbura, A., Danks, D., Eling, M., Goodloe, A., Gupta, J., Hart, C., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00370-7 · Cited by 250 · see citing works
Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., & Barnes, P. (2020) · arXiv · doi:10.48550/arxiv.2001.00973 · Cited by 179 · see citing works
Beyond surveillance capitalism: Privacy, regulation and big data in Europe and China
Aho, B., & Duffield, R. (2020) · Economy and Society · doi:10.1080/03085147.2019.1690275 · Cited by 178 · see citing works
Does “ AI ” stand for augmenting inequality in the era of covid-19 healthcare?
Leslie, D., Mazumder, A., Peppin, A., Wolters, M. K., & Hagerty, A. (2021) · BMJ · doi:10.1136/bmj.n304 · Cited by 177 · see citing works
Leslie, D. (2019) · Zenodo · doi:10.5281/zenodo.3240529 · Cited by 126 · see citing works
The growing ubiquity of algorithms in society: implications, impacts and innovations
Olhede, S. C., & Wolfe, P. J. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0364 · Cited by 120 · see citing works
Algorithmic decision-making and system destructiveness: A case of automatic debt recovery
Rinta-Kahila, T., Someh, I., Gillespie, N. A., Indulska, M., & Gregor, S. D. (2021) · European Journal of Information Systems · doi:10.1080/0960085x.2021.1960905 · Cited by 119 · see citing works
Self-citationTrust in artificial Intelligence: a five country study
Gillespie, N., Lockey, S., & Curtis, C. (2021) · doi:10.14264/e34bfa3 · Cited by 104 · see citing works
Self-citationAustralian public understandings of artificial intelligence
Selwyn, N., & Cordoba, B. G. (2021) · AI & Society · doi:10.1007/s00146-021-01268-z · Cited by 71 · see citing works
Susser, D. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3314286 · Cited by 65 · see citing works
Tracking the debate on COVID-19 surveillance tools
Sweeney, Y. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0194-1 · Cited by 57 · see citing works
The influence of algorithms on political and dating decisions
Agudo, U., & Matute, H. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249454 · Cited by 57 · see citing works
Artificial intelligence and rationalized unaccountability: Ideology of the elites?
Vesa, M. J., & Tienari, J. (2020) · Organization · doi:10.1177/1350508420963872 · Cited by 50 · see citing works
Patient data were shared with Google on an “inappropriate legal basis,” says NHS data guardian
Iacobucci, G. (2017) · BMJ · doi:10.1136/bmj.j2439 · Cited by 34 · see citing works
Big Techs in Finance: On the New Nexus Between Data Privacy and Competition
Boissay, F., Ehlers, T., Gambacorta, L., & Shin, H. S. (2021) · Springer eBooks · doi:10.1007/978-3-030-65117-6_31 · Cited by 34 · see citing works
Measuring Automated Influence: Between Empirical Evidence and Ethical Values
Susser, D., & Grimaldi, V. (2021) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3461702.3462532 · Cited by 33 · see citing works
Implementing COVIDSafe: The Role of Trustworthiness and Information Privacy Law
Burdon, M., & Wang, B. T. (2021) · Law Technology and Humans · doi:10.5204/lthj.1808 · Cited by 28 · see citing works
Achieving Trustworthy AI: A Model for Trustworthy Artificial Intelligence
Gillespie, N. A., Curtis, C., Bianchi, R., Akbari, A., & van Vlissingen, R. F. (2020) · The University of Queensland · doi:10.14264/ca0819d · Cited by 11 · see citing works
Self-citationSadowski, J., & Andrejevic, M. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00246-2 · Cited by 4 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [15]Ensign, D., Friedler, S. A., Neville, S., Scheidegger, C., Venkatasubramanian, S.: Runaway Feedback Loops in Predictive Policing. In: Friedler, S.A. Wilson, C. (eds.) Proceedings of the 1st Conference on Fairness, Accountability and Transparency vol. 81 160–171 (PMLR, 2018)
- [17]United Nations Office of the High Commissioner for Human Rights.: Artificial intelligence risks to privacy demand urgent action – Bachelet [Press Release]. https://www.ohchr.org/EN/NewsEvents/Pages/media.aspx (2021)
- [22]Feldstein, S.: The global expansion of AI surveillance. vol. 17 https://carnegieendowment.org/files/WP-Feldstein-AISurveillance_final1.pdf (2019)
Cited by
Sorted by citations
AI Chatbots in Digital Mental Health
Balcombe, L. (2023) · Informatics · doi:10.3390/informatics10040082 · Cited by 170 · see citing works
Diversity, Equity, and Inclusion in Artificial Intelligence: An Evaluation of Guidelines
Cachat-Rosset, G., & Klarsfeld, A. (2023) · Applied Artificial Intelligence · doi:10.1080/08839514.2023.2176618 · Cited by 138 · see citing works
Explainable AI (XAI) in image segmentation in medicine, industry, and beyond: A survey
Gipiškis, R., Tsai, C.-W., & Kurasova, O. (2024) · ICT Express · doi:10.1016/j.icte.2024.09.008 · Cited by 70 · see citing works
Wu, H., Li, D., & Mo, X. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13312-8 · Cited by 52 · see citing works
AI Model for Blockchain Based Industrial Application in Healthcare IoT
Bibhu, V., Das, L., Rana, A., Sharma, S., & Salagrama, S. (2023) · Engineering cyber-physical systems and critical infrastructures · doi:10.1007/978-3-031-31952-5_8 · Cited by 25 · see citing works
Bingley, W., Haslam, S. A., Steffens, N. K., Gillespie, N. A., Worthy, P., Curtis, C., Lockey, S., Bialkowski, A., Ko, R. K. L., & Wiles, J. (2023) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2023.101025 · Cited by 22 · see citing works
Self-citationSamuel-Okon, A. D., Olateju, O. O., Okon, S. U., Olaniyi, O. O., & Igwenagu, U. T. I. (2024) · Archives of Current Research International · doi:10.9734/acri/2024/v24i5735 · Cited by 23 · see citing works
"What Went Wrong? Identifying Risk Factors for Popular Negative Consequences in AI"
Sharma, M., Biros, D. P., Baham, C., & Biros, J. (2024) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00203 · Cited by 15 · see citing works
Care robot literacy: integrating AI ethics and technological literacy in contemporary healthcare
Turja, T., Kork, A., Ilomäki, S., Hellstrand, I., & Koistinen, A.-K. (2024) · AI and Ethics · doi:10.1007/s43681-024-00576-6 · Cited by 17 · see citing works
Topal, A. D., Gökçe, A. T., Eren, C. D., & Geçer, A. K. (2024) · Journal of Learning and Teaching in Digital Age · doi:10.53850/joltida.1440845 · Cited by 15 · see citing works
Resh(AI)ping Good Administration: Addressing the Mass Effects of Public Sector Digitalisation
Sanchez-Graells, A. (2024) · Laws · doi:10.3390/laws13010009 · Cited by 12 · see citing works
den Bosch, K. V., van Diggelen, J., Verdult, S., Haije, T., & van der Waa, J. (2025) · AI and Ethics · doi:10.1007/s43681-024-00647-8 · Cited by 9 · see citing works
AI in Governance and Policy Making
Saxena, A. K. (2024) · International Journal of Science and Research (IJSR) · doi:10.21275/sr24519015426 · Cited by 10 · see citing works
Yoganathan, V., Osburg, V.-S., & Janakiraman, N. (2025) · Journal of services research · doi:10.1177/10946705251345097 · Cited by 8 · see citing works
Haidemariam, T., & Gran, A.-B. (2025) · AI & Society · doi:10.1007/s00146-025-02445-0 · Cited by 10 · see citing works
A short-form AI literacy intervention can reduce over-reliance on AIPreprint
Morrill, J., & Noetel, M. (2023) · doi:10.31234/osf.io/hv9qc · Cited by 6 · see citing works
Strategies for Combating Criminal Use and Abuse of Artificial Intelligence
Ayyaswamy, K., Kathirvel, N., & Vianny, M. M. (2025) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/979-8-3693-7041-4.ch009 · Cited by 8 · see citing works
Artificial Intelligence and Public Policy
Filgueiras, F. D. B. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009572248 · Cited by 5 · see citing works
Linking public awareness to RRI pathways for sustainable AI: a survey from Japan and South Korea
Cho, Y., Wang, S., Kinoshita, S., Ikkatai, Y., & Yokoyama, H. (2025) · AI and Ethics · doi:10.1007/s43681-025-00822-5 · Cited by 4 · see citing works
Park, J.-A., Kim, C. H., & Kim, H.-J. (2025) · Telecommunications Policy · doi:10.1016/j.telpol.2025.103106 · Cited by 5 · see citing works
Integrating ChatGPT into the Exercise Industry: A Disruptive Shift for Industry Professionals
Vickey, T. (2025) · ACSMʼs Health & Fitness Journal · doi:10.1249/fit.0000000000001042 · Cited by 4 · see citing works
How artificial intelligence is changing organizations: Portuguese CEOs’ perspective
Duarte, A., & Dias, P. (2025) · Journal of Communication Management · doi:10.1108/jcom-10-2024-0204 · Cited by 3 · see citing works
AI in Social Worker Recruitment and Training for Bullying Intervention
Maota, Y.-Y., & Maota, T. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-8679-8.ch001 · Cited by 1 · see citing works
Understanding user susceptibility to risks in AI companionship applications
Lombard, A., Flowerday, S., & Hale, J. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.103182 · Cited by 1 · see citing works
Algorithmic Literacy: A Compass to Successfully Navigate the Algorithm-Driven World?
Heimbach, I., Abramova, O., Baumann, A., Krasnova, H., Jussupow, E., Legner, C., Meythaler, A., Müller, O., & Pinski, M. (2026) · Business & Information Systems Engineering · doi:10.1007/s12599-025-00984-w · Cited by 2 · see citing works
Anatomy of AI Risk Perception: Differentiating Privacy, Misinformation, and Technical Failures
Fildor, D., Škrinjarić, B., & Budak, J. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2610439 · Cited by 2 · see citing works
Evaluating generative AI’s potential to dispel misinformation about wind farms
Pearson, S. G., Hornsey, M. J., Bretter, C., MacInnes, S., Nylund, J. L., Rekker, S. A. C., Smith, A. E., & Wade, B. (2026) · Scientific Reports · doi:10.1038/s41598-026-42790-8 · Cited by 1 · see citing works
Xu, Q., Chen, H., Xu, L., & Xu, Y. (2026) · Buildings · doi:10.3390/buildings16152932 · Cited by 1 · see citing works
Context Matters: A Note on the Special Conditions for Effective AI Adoption in OrganizationsPreprint
Frimpong, V. (2025) · Qeios · doi:10.32388/s7irh1 · Cited by 1 · see citing works
Chakraborty, S. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-3384-7.ch015
Ethical and Societal Considerations of AI in Business
Soliman, M., Ali, R. A., Mahmud, I., Hayeemad, M., & Khalid, J. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83708-276-620251005 · Cited by 1 · see citing works
Research Methodology and Materials
Rosa, A. (2025) · Future of business and finance · doi:10.1007/978-3-032-04091-6_5
Rosa, A. (2025) · Future of business and finance · doi:10.1007/978-3-032-04091-6_3
Rosa, A. (2025) · Future of business and finance · doi:10.1007/978-3-032-04091-6_4
Merikko, J., Leppänen, L., & Mannila, L. (2025) · AI & Society · doi:10.1007/s00146-025-02699-8 · Cited by 1 · see citing works
Putri, A. A., & Sekti, B. A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-7996-8.ch005
Contextual determinants of police attitudes toward AI-assisted policing: a vignette experiment
Jian, Y.-S., Sun, I. Y., Wu, Y., Wang, W., & Chen, Y. (2026) · Journal of Experimental Criminology · doi:10.1007/s11292-026-09746-4
Clinical Decision Support System Using GenAI
Chakraborty, S., Saha, S., Banerjee, S., & Bhunia, S. (2026) · Springer optimization and its applications · doi:10.1007/978-3-032-15092-9_17
Ahamed, S., Zaman, M., Mashud, M. A. A., Khan, N., Sarker, F., & Mamun, K. A. (2025) · Gender and Technology Conference (GTC) · doi:10.1109/gtc64325.2025.11478191
The knowledge risk taxonomy revisited: adapting to a changing world
Durst, S., & Zięba, M. (2026) · Knowledge Management Research & Practice · doi:10.1080/14778238.2026.2683417
Layered AI ethics and governance: corporate codes and public instruments in the AI era
Najm, M. (2026) · AI and Ethics · doi:10.1007/s43681-026-01302-0
- Authors
- Curtis, C., Gillespie, N., & Lockey, S.
- Affiliations
- The University of Queensland (AU)
- Corresponding author
- Curtis, Caitlin
- Venue
- AI and Ethics
- Published
- 2022-05-24
- Volume
- 3
- Issue
- 1
- Pages
- 145-153
- ISSN
- 2730-5953 (ISSN-L)
- 2730-5961
- PMC
- PMC9127285
- OpenAlex
- W4282939097
- Cited by
- 43
- References
- 37
- Citations by year
- 2026: 9 · 2025: 21 · 2024: 8 · 2023: 5
- FWCI
- 9.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- AI and Ethics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- KPMG (RM2018001776)
- The University of Queensland
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- AI risks, trustworthy AI, AI literacy, AI regulation, accountability, AI awareness, AI deployment, AI governance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review