The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
Explanation and trust: what to tell the user in security and AI?
Open accessAbstract
There is a common problem in artificial intelligence (AI) and information security. In AI, an expert system needs to be able to justify and explain a decision to the user. In information security, experts need to be able to explain to the public why a system is secure. In both cases, an important goal of explanation is to acquire or maintain the users’ trust. In this paper, I investigate the relation between explanation and trust in the context of computing science. This analysis draws on literature study and concept analysis, using elements from system theory as well as actor-network theory. I apply the conceptual framework to both AI and information security, and show the benefit of the framework for both fields by means of examples. The main focus is on expert systems (AI) and electronic voting systems (security). Finally, I discuss consequences of the analysis for ethics in terms of (un)informed consent and dissent, and the associated division of responsibilities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Without a careful study on these psychological issues before implementing in practice, 6G could cause catastrophic consequences and even deconstruct existing trust in ICTs [81].”
From What should 6G be? (2020) · cites this paper as [81]
In the citing paper
“However, quality assurance requires thorough attention to guarantee safe and reliable behaviour and increase the accountability and responsibility of the involved AI systems [38, 47, 13, 23].”
From The pipeline for the continuous development of artificial intelligence models—Current state of research and practice (2023) · cites this paper as [38]
In the citing paper
“AI characteristics such as the inherent non-determinism lead to a certain degree of uncertainty [46, 47, 38].”
From The pipeline for the continuous development of artificial intelligence models—Current state of research and practice (2023) · cites this paper as [38]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reassembling the Social: An Introduction to Actor-Network-Theory
Latour, B. (2005) · doi:10.1093/oso/9780199256044.001.0001 · Cited by 16,778
Reassembling the social: An introduction to actor‐network‐theory
Turnbull, J. (2008) · New Zealand Geographer · doi:10.1111/j.1745-7939.2008.00151_4.x · Cited by 7,646
Basic concepts and taxonomy of dependable and secure computing
Avižienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. E. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,246
Trust: making and breaking cooperative relations
Gambetta, D. (1989) · Choice Reviews Online · doi:10.5860/choice.26-3664 · Cited by 4,045
A history and theory of informed consent
Kapp, M. B. (1986) · Journal of Legal Medicine · doi:10.1080/01947648609513478 · Cited by 2,328
(2000) · Cited by 1,733
What things do: philosophical reflections on technology, agency, and design
(2005) · Choice Reviews Online · doi:10.5860/choice.43-1523 · Cited by 1,058
Attack trees : Modeling security threats
Schneier, B. (1999) · Medical Entomology and Zoology · Cited by 635
A History and Theory of Informed Consent
Faden, R. R., Beauchamp, T. L., & King, N. M. P. (1986) · Cited by 537
Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
Gregor, S., & Benbasat, I. (1999) · MIS Quarterly · doi:10.2307/249487 · Cited by 535
Mauw, S., & Oostdijk, M. (2006) · Lecture notes in computer science · doi:10.1007/11734727_17 · Cited by 504
Designing trust into online experiences
Shneiderman, B. (2000) · Communications of the ACM · doi:10.1145/355112.355124 · Cited by 432
(1979) · U-M-I Out-of-Print Books on Demand · Cited by 402
Trust building with explanation interfaces
Pu, P., & Chen, L. (2006) · Proceedings of the 11th international conference on Intelligent user interfaces · doi:10.1145/1111449.1111475 · Cited by 300
The Impact of Explanation Facilities on User Acceptance of Expert Systems Advice
Ye, L. R., & Johnson, P. E. (1995) · MIS Quarterly · doi:10.2307/249686 · Cited by 290
Explanation in Case-Based Reasoning—Perspectives and Goals
Sørmo, F., Cassens, J., & Aamodt, A. (2005) · Artificial Intelligence Review · doi:10.1007/s10462-005-4607-7 · Cited by 239
Toward establishing trust in adaptive agents
Glass, A., McGuinness, D. L., & Wolverton, M. J. (2008) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1378773.1378804 · Cited by 217
Vico and Herder: Two Studies in the History of Ideas.
Haddock, B. A., & Berlín, I. (1977) · The Philosophical Quarterly · doi:10.2307/2219432 · Cited by 209
Trust in electronic environments
Chopra, K., & Wallace, W. A. (2003) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2003.1174902 · Cited by 194
Vico and Herder. Two Studies in the History of Ideas.
Gardiner, P., & Berlín, I. (1977) · History and Theory · doi:10.2307/2504578 · Cited by 170
Electronic voting system usability issues
Bederson, B. B., Lee, B., Sherman, R. M., Herrnson, P. S., & Niemi, R. G. (2003) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642638 · Cited by 168
Mercuri, R. T. (2002) · IEEE Spectrum · doi:10.1109/mspec.2002.1038569 · Cited by 139
Taddeo, M. (2009) · International Journal of Technology and Human Interaction · doi:10.4018/jthi.2009040102 · Cited by 128
Freedom and Privacy in Ambient Intelligence
Brey, P. (2005) · Ethics and Information Technology · doi:10.1007/s10676-006-0005-3 · Cited by 111
A Case-Based Explanation System for Black-Box Systems
Nugent, C., & Cunningham, P. (2005) · Artificial Intelligence Review · doi:10.1007/s10462-005-4609-5 · Cited by 84
Randell, B., & Ryan, P. Y. A. (2006) · IEEE Security & Privacy · doi:10.1109/msp.2006.140 · Cited by 53
Mercuri, R. T., & Neumann, P. G. (2003) · Communications of the ACM · doi:10.1145/948383.948413 · Cited by 51
Genomic Research and Data-Mining Technology: Implications for Personal Privacy and Informed Consent
Tavani, H. T. (2004) · Ethics and Information Technology · doi:10.1023/b:etin.0000036156.77169.31 · Cited by 49
Trust in Technological Systems
Nickel, P. J. (2012) · Philosophy of engineering and technology · doi:10.1007/978-94-007-5243-6_14 · Cited by 46
Kosta, E., Pitkänen, O., Niemelä, M., & Kaasinen, E. (2010) · Science and Engineering Ethics · doi:10.1007/s11948-009-9150-5 · Cited by 41
RIES — Internet Voting in Action
Hubbers, E., Jacobs, B., & Pieters, W. (2006) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2005.132 · Cited by 41
Self-citationNikander, P. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44810-1_6 · Cited by 39
Acceptance of Voting Technology: Between Confidence and Trust
Pieters, W. (2006) · Lecture notes in computer science · doi:10.1007/11755593_21 · Cited by 38
Self-citationMapping Goals and Kinds of Explanations to the Knowledge Containers of Case-Based Reasoning Systems
Roth–Berghofer, T., & Cassens, J. (2005) · Lecture notes in computer science · doi:10.1007/11536406_35 · Cited by 38
Security as belief user's perceptions on the security of electronic voting systems
Oostveen, A., & van den Besselaar, P. (2004) · Cited by 30
A Study into Preferred Explanations of Virtual Agent Behavior
Harbers, M., den Bosch, K. V., & Meyer, J. C. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04380-2_17 · Cited by 30
Vico and Herder: Two Studies in the History of Ideas
Berlín, I. (1976) · Cited by 30
Defining Trust and E-trust: Old Theories and New Problems
Taddeo, M. (2009) · Cited by 22
England’s Controversy over the Secret Ballot
Park, J. H. (1931) · Political Science Quarterly · doi:10.2307/2143109 · Cited by 19
Temptations of turnout and modernisation
Pieters, W., & van Haren, R. (2007) · Journal of Information Communication and Ethics in Society · doi:10.1108/14779960710846146 · Cited by 14
Self-citationTowards a Sociological View of Trust in Computer Science
Fahrenholtz, D., & Bartelt, A. (2001) · Cited by 8
Pieters, W. (2010) · Techné Research in Philosophy and Technology · doi:10.5840/techne201014321 · Cited by 5
Self-citationComputer kiosk expedites voter registration
Costlow, T. (2002) · IEEE Spectrum · doi:10.1109/mspec.2002.1038593 · Cited by 4
Will Microsoft verdict miss mark?
Parloff, R. (2002) · IEEE Spectrum · doi:10.1109/mspec.2002.1049260 · Cited by 3
News analysis: multilingual digital library hopes to outdo rest in scope, capabilities
Singh, S. (2002) · IEEE Spectrum · Cited by 3
Research works printed but not linked: 1
- Freuder, E., Likitvivatanavong, C., & Wallace, R. (2000) A case study in explanation and implication. In: CP2000 workshop on analysis and visualization of constraint programs and solvers.
Cited by
Sorted by citations
Human trust in artificial intelligence: Review of empirical research
Glikson, E., & Woolley, A. W. (2020) · Academy of Management Annals · doi:10.5465/annals.2018.0057 · Cited by 2,921
Dang, S., Amin, O., Shihada, B., & Alouini, M.-S. (2020) · Nature Electronics · doi:10.1038/s41928-019-0355-6 · Cited by 1,790
"I always assumed that I wasn't really that close to [her]"
Eslami, M., Rickman, A., Vaccaro, K., Aleyasen, A., Vuong, A., Karahalios, K. G., Hamilton, K., & Sandvig, C. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702556 · Cited by 781
Langer, M., Oster, D., Speith, T., Hermanns, H., Kästner, L., Schmidt, E., Sesing, A., & Baum, K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103473 · Cited by 652
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Metadata
- Authors
- Pieters, W.
- Affiliations
- University of Twente (NL)
- Corresponding author
- Pieters, Wolter
- ORCID
- Pieters, Wolter
- Venue
- Ethics and Information Technology
- Published
- 2010-11-03
- Volume
- 13
- Issue
- 1
- Pages
- 53-64
- ISSN
- 1388-1957 (ISSN-L)
- 1572-8439
- OpenAlex
- W2133761762
- Cited by
- 153
- References
- 46
- Citations by year
- 2026: 11 · 2025: 20 · 2024: 17 · 2023: 15 · 2022: 28 · 2021: 19 · 2020: 13 · 2019: 6 · 2018: 4 · 2017: 6 · 2016: 2 · 2015: 4 · 2014: 4 · 2013: 3
- FWCI
- 1.35
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Ethics and Information Technology (publishedVersion, cc-by-nc)
- University of Twente Research Information (publishedVersion)
- University of Twente Research Information (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Stichting voor de Technische Wetenschappen
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Computer Networks and Communications › Access Control and Trust
- Keywords
- explanation, trust, artificial intelligence, information security, expert systems, electronic voting, justification of decisions, actor-network theory, systems theory, informed consent, dissent, division of responsibilities, AI ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
