Trust, regulation, and human-in-the-loop AI: within the European region
The DOI matches its Crossref record, with a small difference in title or year; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) systems employ learning algorithms which adapt to their users and environment, with learning either pre-trained or allowed to adapt during deployment. Because AI can optimize its behaviour, a unit's factory model behaviour can diverge after release, often at the perceived expense of safety, reliability, and human controllability. Since the Industrial Revolution, trust has ultimately resided in regulatory systems set up by governments and standards bodies. Research into human interactions with autonomous machines demonstrates a shift in the locus of trust: we must trust non-deterministic systems such as AI to self-regulate, albeit within boundaries. This radical shift is one of the biggest issues facing the deployment of AI in the European region.Trust has no accepted definition, but [Rousseau 1998] define it as "a psychological state comprising the intention to accept vulnerability based upon positive expectations of the intentions or behaviour of another". Trust is an attitude that an agent will behave as expected and can be relied upon to reach its goal. Trust breaks down after an error or a misunderstanding between the agent and the trusting individual. The psychological state of trust in AI is an emergent property of a complex system, usually involving many cycles of design, training, deployment, measurement of performance, regulation, redesign and retraining.Trust matters, especially in critical sectors such as healthcare, defence & security where duty of care is foremost. Trustworthiness must be planned rather than an afterthought. We can trust in AI, such as when a doctor uses algorithms to screen medical images [NHS-X 2021]. We can also trust with AI, such as when journalists reference a social network algorithm to analyse sources of a news story [WeVerify 2021]. Growing adoption of AI into institutional systems relies on citizens to trust in these systems and have confidence in the way these systems are designed and regulated.Regional approaches for managing trust in AI have recently emerged, leading to different regulatory regimes in the United States, the European region and China. We review these regulatory divergences. Within the European region, research programs are examining how trust impacts user acceptance of AI. Examples include the UKRI Trustworthy Autonomous Systems Hub , the French Confidiance.ai project and the German AI Breakthrough Hub . Europe appears to be developing a "third way" alongside the United States and China [Morton 2021].Healthcare contains many examples of AI applications including online harm risk identification [ProTechThem 2021], mental health behaviour classification [SafeSpacesNLP 2021] and automated blood testing [Pinpoint 2021]. In defence and security, examples include combat management systems [DSTL 2021] and using machine learning to identify chemical and biological contamination [Alan Turing Institute 2021]. There is a growing awareness within critical sectors [Kerasidou 2020] [Taddeo 2019] that AI systems need to address a "public trust deficit" by adding reliability into the perception of AI. In the next two sections we discuss research highlights around the key trends of building safer and more reliable AI systems to engender trust and putting humans in the loop with regards AI systems and teams. We conclude with a discussion about applications and what we consider the future outlook is in this area.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The study revealed the tension between the need for human oversight and the limits of human attention and expertise.”
From Human-in-the-Loop Artificial Intelligence: A Systematic Review of Concepts, Methods, and Applications (2026) · cites this paper as [71]
In the citing paper
“However, its limited adoption by Member States might suggest practical challenges in implementing this approach at the national level, where existing regulatory landscapes are more complex, the market presents more AI systems for market surveillance activities, and robust capacity in AI is needed, notably towards the need for public acceptance (Middleton, 2022).”
From Emerging models of national competent authorities under the EU AI Act (2025) · cites this paper as Middleton, 2022
Citations
Cites
Not So Different After All: A Cross-Discipline View Of Trust
Rousseau, D. M., Sitkin, S. B., Burt, R. S., & Camerer, C. (1998) · Academy of Management Review · doi:10.5465/amr.1998.926617 · Cited by 10,274
Digital Twins in Health Care: Ethical Implications of an Emerging Engineering Paradigm
Bruynseels, K., Santoni de Sio, F., & van den Hoven, J. (2018) · Frontiers in Genetics · doi:10.3389/fgene.2018.00031 · Cited by 704
Adversarial NLI: A New Benchmark for Natural Language Understanding
Nie, Y., Williams, A., Dinan, E., Bansal, M., Weston, J., & Kiela, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.441 · Cited by 656
The Chinese approach to artificial intelligence: an analysis of policy, ethics, and regulation
Roberts, H., Cowls, J., Morley, J., Taddeo, M., Wang, V., & Floridi, L. (2021) · AI & SOCIETY · doi:10.1007/s00146-020-00992-2 · Cited by 573
Society-in-the-loop: programming the algorithmic social contract
Rahwan, I. (2018) · Ethics and Information Technology · doi:10.1007/s10676-017-9430-8 · Cited by 553
Trusting artificial intelligence in cybersecurity is a double-edged sword
Taddeo, M., McCutcheon, T., & Floridi, L. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0109-1 · Cited by 256 · cited 1×
“1 There is a growing awareness within critical sectors 15,33 that AI systems need to address a “public trust deficit” by adding reliability to the perception of AI.”
BackgroundAssuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges
Ashmore, R., Calinescu, R., & Paterson, C. (2022) · ACM Computing Surveys · doi:10.1145/3453444 · Cited by 256
Artificial intelligence surgery: how do we get to autonomous actions in surgery?
Gumbs, A. A., Frigerio, I., Spolverato, G., Croner, R., Illanes, A., Chouillard, E., & Elyan, E. (2021) · Sensors · doi:10.3390/s21165526 · Cited by 161
Artificial intelligence and robotic surgery
Bhandari, M., Zeffiro, T., & Reddiboina, M. (2019) · Current Opinion in Urology · doi:10.1097/mou.0000000000000692 · Cited by 159
Principles and Practice of Explainable Machine Learning
Belle, V., & Papantonis, I. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.688969 · Cited by 99
Research works printed but not linked: 8
- 10.1145/3453444 · DOI · Paper page
- Barrett , P. , Hendrix , J. , and Sims , G . How tech platforms fuel U.S. political polarization and what government can do about it. The Brookings Institution 27 ( Nov. 2021 ); https://brook.gs/3sK3Cev Barrett, P., Hendrix, J., and Sims, G. How tech platforms fuel U.S. political polarization and what government can do about it. The Brookings Institution 27 (Nov. 2021); https://brook.gs/3sK3Cev
- Bhargava , R. , Deahl , E. , Letouzé , E. , Noonan , A. , Sangokoya , D. , and Shoup , N . Beyond Data Literacy: Reinventing Community Engagement and Empowerment in the Age of Data , Data-Pop Alliance White Paper. Sept. 29, 2015 ; https://bit.ly/3qNgBtm Bhargava, R., Deahl, E., Letouzé, E., Noonan, A., Sangokoya, D., and Shoup, N. Beyond Data Literacy: Reinventing Community Engagement and Empowerment in the Age of Data, Data-Pop Alliance White Paper. Sept. 29, 2015; https://bit.ly/3qNgBtm
- Ministry of Defense. Commander of Strategic Command RUSI conference speech , May 26, 2021; https://www.gov.uk/government/speeches/commander-of-strategic-command-rusi-conference-speech Ministry of Defense. Commander of Strategic Command RUSI conference speech, May 26, 2021; https://www.gov.uk/government/speeches/commander-of-strategic-command-rusi-conference-speech
- Morton , S. and Booth , M . The EU's "third way" to AI regulation. Pillsbury , Sept. 22 , 2021 ; https://www.internetandtechnologylaw.com/eu-third-way-ai-regulation/ Morton, S. and Booth, M. The EU's "third way" to AI regulation. Pillsbury, Sept. 22, 2021; https://www.internetandtechnologylaw.com/eu-third-way-ai-regulation/
- Schabus , D. The IEEE CertifAIEd Framework for AI Ethics Applied to the City of Vienna . IEEE Standards Assoc . ( 2021 ); https://bit.ly/3EZWzRp Schabus, D. The IEEE CertifAIEd Framework for AI Ethics Applied to the City of Vienna. IEEE Standards Assoc. (2021); https://bit.ly/3EZWzRp
- RUSI-TAS. Trusting Machines ? RUSI-TAS 2021 Conf.; https://www.tas.ac.uk/eventslist/trusting-machines/trust-machines-conference-programme/ RUSI-TAS. Trusting Machines? RUSI-TAS 2021 Conf.; https://www.tas.ac.uk/eventslist/trusting-machines/trust-machines-conference-programme/
- van der Valk , H. , Haße , H. , Möller , F. , Arbter , M. , Henning , J. , and Otto , B . A Taxonomy of digital twins . In Proceedings of AMCIS 2020; https://bit.ly/3HE6ZYI van der Valk, H., Haße, H., Möller, F., Arbter, M., Henning, J., and Otto, B. A Taxonomy of digital twins. In Proceedings of AMCIS 2020; https://bit.ly/3HE6ZYI
Cited by
Grassini, S. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1191628 · Cited by 330
“(2018) suggested that trust in AI could be promoted through employing measures for personal data protection, unbiased decision-making, appropriate regulation, and transparency, a view supported by other recent discussions on trust in AI (Schaefer et al., 2016; Barnes et al., 2019; Sheridan, 2019; Middleton et al., 202…”
ResultArtificial Intelligence and User Experience in reciprocity: Contributions and state of the art
Virvou, M. K. (2023) · Intelligent Decision Technologies · doi:10.3233/idt-230092 · Cited by 218
Groen, A. M., Kraan, R., Amirkhan, S. F., Daams, J. G., & Maas, M. (2022) · European Journal of Radiology · doi:10.1016/j.ejrad.2022.110592 · Cited by 89
Madanchian, M., & Taherdoost, H. (2025) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1619029 · Cited by 123
Toward native explainable and robust AI in 6G networks: Current state, challenges and road ahead
Fiandrino, C., Attanasio, G., Fiore, M., & Widmer, J. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.06.036 · Cited by 63
“The growing interest in promoting trust in ICT systems has been addressed by regulatory bodies at different levels [7].”
Background
Metadata
- Authors
- Middleton, S. E., Letouzé, E., Hossaini, A., & Chapman, A.
- Affiliations
- University of Southampton (GB)
- Universitat Pompeu Fabra (ES)
- King's College London (GB)
- Venue
- Communications of the ACM
- Published
- 2022-03-19
- Volume
- 65
- Issue
- 4
- Pages
- 64-68
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W4220993791
- Cited by
- 73
- References
- 21
- Citations by year
- 2026: 22 · 2025: 25 · 2024: 14 · 2023: 8 · 2022: 4
- FWCI
- 14.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- SOAS Research Online (SOAS University of London) (submittedVersion)
- Funders
- Engineering and Physical Sciences Research Council (EP/V00784X/1)
- Natural Environment Research Council (NE/S015604/1)
- Economic and Social Research Council (ES/V011278/1,ES/R003254/1)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- trust in AI, AI regulation, human-in-the-loop AI, autonomous systems, trustworthiness, AI safety, AI governance, European AI policy, United States AI policy, artificial intelligence in healthcare, AI acceptance, AI self-regulation, algorithmic transparency, explainability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trust, regulation, and human-in-the-loop AI: within the European region. https://app.cochat.ai/papers/10.1145/3511597
- The paper
- Middleton, S. E., Letouzé, E., Hossaini, A., & Chapman, A. (2022). Trust, regulation, and human-in-the-loop AI: within the European region. Communications of the ACM. https://doi.org/10.1145/3511597
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.