CoChat

Reciprocal trust and distrust in artificial intelligence systems: the hard problem of regulation

Open access
Maggetti, Martino · 2026 · AI & SOCIETY

The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.

Abstract

Policymakers, scientists, and the public are increasingly confronted with thorny questions about the regulation of artificial intelligence (AI) systems. A key common thread concerns whether AI can be trusted and the factors that can make it more trustworthy in front of stakeholders and users. This is indeed crucial, as the trustworthiness of AI systems is fundamental for both democratic governance and for the development and deployment of AI. This article advances the discussion by arguing that AI systems should also be recognized, at least to some extent, as artifacts capable of exercising a form of agency, thereby enabling them to engage in relationships of trust or distrust with humans. It further examines the implications of these reciprocal trust dynamics for regulators tasked with overseeing AI systems. The article concludes by identifying key tensions and unresolved dilemmas that these dynamics pose for the future of AI regulation and governance.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s00146-026-02966-2

Cites

83 of 83 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 32

  1. Anisimov, Aleksey Pavlovich, and Anatoliy Jakovlevich Ryzhenkov. 2016. "Thirty years after the accident at the Chernobyl nuclear power plant: historical causes, lessons and legal effects." Journal of Energy & Natural Resources Law 34(3):265-83.
  2. Bengio, Yoshua, Geoffrey Hinton, Andrew Yao, Dawn Song, Pieter Abbeel, Trevor Darrell, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, and Shai Shalev-Shwartz. 2024. "Managing extreme AI risks amid rapid progress." science 384(6698):842-45. · DOI · Paper page
  3. Bostrom, Nick. 2024. Superintelligence : Dunod.
  4. Butlin, Patrick, Robert Long, Eric Elmoznino, Yoshua Bengio, Jonathan Birch, Axel Constant, George Deane, Stephen M Fleming, Chris Frith, and Xu Ji. 2023. "Consciousness in artificial intelligence: insights from the science of consciousness." arXiv preprint arXiv:2308.08708 . · arXiv
  5. Choudhury, M, Anurag Dutta, and A Kumar De. 2023. "Data corroboration of the catastrophic chernobyl tragedy using arc-length estimate conjecture." Vertices: Duke's Undergraduate Research Journal 1(2).
  6. Christian, Brian. 2021. The alignment problem: How can machines learn human values? : Atlantic Books.
  7. Downing, Taylor. 2018. 1983: Reagan, Andropov, and a World on the Brink : Hachette UK.
  8. Greenblatt, Ryan, Carson Denison, Benjamin Wright, Fabien Roger, Monte MacDiarmid, Sam Marks, Johannes Treutlein, Tim Belonax, Jack Chen, and David Duvenaud. 2024. "Alignment faking in large language models." arXiv preprint arXiv:2412.14093 . · arXiv
  9. Guha, Neil, Christie M Lawrence, Lindsey A Gailmard, Kit T Rodolfa, Faiz Surani, Rishi Bommasani, Inioluwa Deborah Raji, Mariano-Florentino Cuéllar, Colleen Honigsberg, and Percy Liang. 2024. "Ai regulation has its own alignment problem: The technical and institutional feasibility of disclosure, registration, licensing, and auditing." Geo. Wash. L. Rev. 92:1473.
  10. Hellemans, Marc. 2009. The safety relief valve handbook: Design and use of process safety valves to ASME and International Codes and Standards : Elsevier.
  11. Hill, Claire A, and Erin O'Hara O'Connor. 2006. "A cognitive theory of trust." Washington University Law Review 84(7):1717-96.
  12. Hoffman, David. 1999. "I had a funny feeling in my gut." Washington Post 10:A19. Hood, Christopher, Henry Rothstein, and Robert Baldwin. 2001.
  13. Ingram, Scott. 2005. The Chernobyl nuclear disaster : Infobase Publishing.
  14. Kaminski, Margot E. 2023. "Regulating the Risks of AI." BUL Rev. 103:1347.
  15. Maggetti, Martino, Yannis Papadopolos, and Edoardo Guaschino. 2023. "Trust and Distrust in Regulatory Governance. White paper integrating the results of the TiGRE project and developing scenarios and recommendations to maintain and restore trust." Pp. 1-12. Lausanne: University of Lausanne.
  16. Malinauskas, AP. 1987. "The Chernobyl accident: Causes and consequences." Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States).
  17. Marcus, Gary, and Ernest Davis. 2019. Rebooting AI: Building artificial intelligence we can trust : Vintage.
  18. McDermott, Drew. 2007. "Artificial intelligence and consciousness." The Cambridge handbook of consciousness :117-50.
  19. Meinke, Alexander, Bronson Schoen, Jérémy Scheurer, Mikita Balesni, Rusheb Shah, and Marius Hobbhahn. 2024. "Frontier models are capable of in-context scheming." arXiv preprint arXiv:2412.04984 . · arXiv
  20. Morgan, Craig A. 1985. "The Downing of Korean Air Lines Flight 007." Yale J. Int'l L. 11:231.
  21. Ord, Toby. 2020. The precipice: Existential risk and the future of humanity : Hachette UK.
  22. Santos, Omar, and Petar Radanliev. 2024. Beyond the Algorithm: AI, Security, Privacy, and Ethics : Addison-Wesley Professional.
  23. Scharowski, Nicolas, Sebastian AC Perrig, Lena Fanya Aeschbach, Nick von Felten, Klaus Opwis, Philipp Wintersberger, and Florian Brühlmann. 2024. "To trust or distrust trust measures: Validating questionnaires for trust in ai." arXiv preprint arXiv:2403.00582 . · arXiv
  24. Singer P (1972) Famine, affluence, and morality. Philos Public Aff 1:229–243
  25. Six, Frédérique, and Koen Verhoest (Eds.). 2017. Trust in regulatory regimes : Edward Elgar Publishing.
  26. Sunstein, Cass R, and Jared H Gaffe. 2024. "An Anatomy of Algorithm Aversion." Colum. Sci. & Tech. L. Rev. 26:290.
  27. Sztompka, Piotr. 1999. Trust: A sociological theory : Cambridge university press.
  28. Tetlock, P., and A. Belkin. 1996. Counterfactual thought experiments in world politics: Logical, methodological, and psychological perspectives : Princeton University Press.
  29. Wang, Yi-Fan, Yu-Che Chen, Shih-Yi Chien, and Pin-Jen Wang. 2024. "Citizens' trust in AI-enabled government systems." Information Polity 29(3):293-312.
  30. Yablokov, Alexey V, Vassily B Nesterenko, Alexey V Nesterenko, and Janette D ShermanNevinger. 2010. Chernobyl: Consequences of the Catastrophe for People and the Environment : John Wiley & Sons.
  31. Bresinsky M, Hager E & Xanthos G (2024). ChatGPT for futures: how large language models can support the development of future scenarios using the Cone of Plausibility. CCEW SYMPOSIUM 2024: Predictive Synergies: Crisis early earning & foresight, 19. und 20. September 2024, München
  32. Wang L (2021). Autonomy vs. artifi cial intelligence : studies on healthcare work and analytics. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/146910

Cited by

See all 2

Metadata

Authors
Maggetti, M.
Affiliations
University of Lausanne (CH)
Corresponding author
Maggetti, Martino
Venue
AI & SOCIETY
Published
2026-03-17
Volume
41
Issue
5
Pages
5009-5026
ISSN
  • 0951-5666 (ISSN-L)
  • 1435-5655
OpenAlex
W7138063264
Cited by
2
References
83
Citations by year
2026: 2
FWCI
11.35
Type
journal article
Language
en
Open access
Licence
Locations
  • AI & Society (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Funders
Open access funding provided by University of Lausanne Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (204521)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Physical Sciences › Computer Science › Computer Networks and Communications › Access Control and Trust
Keywords
AI regulation, trust in AI, distrust, mutual trust, AI agency, human-AI relationship, AI governance, democratic governance, trustworthiness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.