Second Chance for a First Impression? Trust Development in Intelligent System Interaction
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
There is a growing use of intelligent systems to support human decision-making across several domains. Trust in intelligent systems, however, is pivotal in shaping their widespread adoption. Little is currently understood about how trust in an intelligent system evolves over time and how it is mediated by the accuracy of the system. We aim to address this knowledge gap by exploring trust formation over time and its relation to system accuracy. To that end, we built an intelligent house recommendation system and carried out a longitudinal study consisting of 201 participants across 3 sessions in a week. In each session, participants were tasked with finding housing that fit a given set of constraints using a conventional web interface that reflected a typical housing search website. Participants could choose to use an intelligent decision support system to help them find the right house. Depending on the group, participants received a variation of accurate or inaccurate advice from the intelligent system throughout each session. We measured trust using a trust in automation scale at the end of each session.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Additionally, we administered the Afnity for Technology Interaction Scale (ATI) [41] to determine participants' level of comfort and familiarity with technology [120].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [120]
In the citing paper
“The subjective trust in the AI system was assessed using the Trust in Automation questionnaire (TiA) [63], which is a commonly employed and validated tool for measuring trust [78, 116, 120].”
From Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making (2024) · cites this paper as [120]
In the citing paper
“In the former, only in three cases the request for the AI's solution was optional (Kumar et al., 2021;Tolmeijer et al., 2021;Baudel et al., 2021), meaning that users could come with a solution to the decision making task on their own.”
From Human-AI collaboration is not very collaborative yet: a taxonomy of interaction patterns in AI-assisted decision making from a systematic review (2025) · cites this paper as Tolmeijer et al., 2021
Citations
Cites
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 3×
“We adopt the following definition of trust as: “the attitude that an agent will help achieve an individual’s goals in a situation characterized by uncertainty and vulnerability” [16].”
BackgroundMethodInfluentialTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799
Bias in data‐driven artificial intelligence systems—An introductory survey
Ntoutsi, E., Fafalios, P., Gadiraju, U., Iosifidis, V., Nejdl, W., Vidal, M., Ruggieri, S., Turini, F., Papadopoulos, S., Krasanakis, E., et al. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1356 · Cited by 1,043 · cited 1×
“Considering that AI systems are now penetrating critical domains [21], one can expect far graver consequences of user trust or the lack of it in such systems.”
BackgroundSelf-citationTrust In and Adoption of Online Recommendation Agents
University of British Columbia, C., Benbasat, I., Wang, W., & University of British Columbia, C. (2005) · Journal of the Association for Information Systems · doi:10.17705/1jais.00065 · Cited by 841
Franke, T., Attig, C., & Wessel, D. (2019) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1456150 · Cited by 828 · cited 2×
“We used the 9-item ‘affinity for technology interaction’ (ATI) to assess a user’s tendency to actively engage in technology interaction [8].”
MethodSchaefer, K. E., Chen, J. Y. C., Szalma, J. L., & Hancock, P. A. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634228 · Cited by 768
Trust and Distrust Definitions: One Bite at a Time
Harrison McKnight, D., & Chervany, N. L. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45547-7_3 · Cited by 747 · cited 2×
“For example, while trusting belief usually has more emphasis on integrity of the trustee, trusting behavior focuses more on integrity and benevolence of the trustee [18].”
BackgroundUnderstanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527 · cited 1×
“The importance of the impression of the system is echoed in work by Yin et al [31].”
Background
Research works printed but not linked: 3
- Hebert Azevedo-Sa , Suresh Kumaar Jayaraman , Connor T Esterwood , X Jessie Yang , Lionel P Robert Jr , and Dawn M Tilbury . 2020 . Comparing the Effects of False Alarms and Misses on Humans’ Trust in (Semi) Autonomous Vehicles. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 113–115 . Hebert Azevedo-Sa, Suresh Kumaar Jayaraman, Connor T Esterwood, X Jessie Yang, Lionel P Robert Jr, and Dawn M Tilbury. 2020. Comparing the Effects of False Alarms and Misses on Humans’ Trust in (Semi) Autonomous Vehicles. In Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 113–115.
- Matthias Beggiato and Josef F Krems . 2013. The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation research part F: traffic psychology and behaviour 18 ( 2013 ), 47–57. Matthias Beggiato and Josef F Krems. 2013. The evolution of mental model, trust and acceptance of adaptive cruise control in relation to initial information. Transportation research part F: traffic psychology and behaviour 18 (2013), 47–57.
- Iyad Rahwan , Manuel Cebrian , Nick Obradovich , Josh Bongard , Jean-François Bonnefon , Cynthia Breazeal , Jacob W Crandall , Nicholas A Christakis , Iain D Couzin , Matthew O Jackson , 2019. Machine behaviour. Nature 568, 7753 ( 2019 ), 477–486. Iyad Rahwan, Manuel Cebrian, Nick Obradovich, Josh Bongard, Jean-François Bonnefon, Cynthia Breazeal, Jacob W Crandall, Nicholas A Christakis, Iain D Couzin, Matthew O Jackson, 2019. Machine behaviour. Nature 568, 7753 (2019), 477–486.
Cited by
Gomez, C., Cho, S. M., Ke, S., Huang, C.-M., & Unberath, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1521066 · Cited by 209
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
“Income prediction [40, 145], number pattern discovery [26, 27], pothole detection [104], classifcation of plants/animals/images [11, 75, 103, 110, 137], meal preparation [12], online dating Others [109, 141], hotel reviews [71], clearing tables [18], fnd housing [43, 124], navigation through buildings [101, 112], long…”
BackgroundZhang, R., Duan, W., Flathmann, C., McNeese, N., Freeman, G., & Williams, A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610072 · Cited by 134
“Prior research has shown that age could impact how humans perceive technologies [32], both of which could impact their trust in the systems [109].”
BackgroundKnowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
He, G., Kuiper, L., & Gadiraju, U. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581025 · Cited by 107
“, dealing with an imperfect AI system) [5, 76].”
BackgroundMethodInfluentialSelf-citationA multifaceted vision of the human-AI collaboration: a comprehensive review
Puerta-Beldarrain, M., Gómez-Carmona, O., Sánchez-Corcuera, R., Casado-Mansilla, D., López-de-Ipiña, D., & Chen, L. (2025) · IEEE Access · doi:10.1109/access.2025.3536095 · Cited by 73
“Additionally, in the interactive collaboration process, initial interactions play a critical role, as demonstrated by Tolmeijer et al. [310].”
Metadata
- Authors
- Tolmeijer, S., Gadiraju, U., Ghantasala, R., Gupta, A., & Bernstein, A.
- Affiliations
- University of Zurich (CH)
- Delft University of Technology (NL)
- Venue
- Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization
- Publisher
- ACM
- Published
- 2021-06-21
- Pages
- 77-87
- OpenAlex
- W3173265486
- Cited by
- 67
- References
- 28
- Citations by year
- 2026: 8 · 2025: 16 · 2024: 18 · 2023: 13 · 2022: 10 · 2021: 2
- FWCI
- 18.34
- Type
- conference paper
- Language
- en
- Open access
- green
- resolver.tudelft.nl
- Locations
- ACM Conference on User Modeling, Adaptation and Personalization (UMAP) (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- Research Repository (Delft University of Technology) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Zurich Open Repository and Archive (University of Zurich)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Keywords
- system accuracy, decision support system, housing recommendation, trust in automation, human-automation interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Second Chance for a First Impression? Trust Development in Intelligent System Interaction. https://app.cochat.ai/papers/10.1145/3450613.3456817
- The paper
- Tolmeijer, S., Gadiraju, U., Ghantasala, R., Gupta, A., & Bernstein, A. (2021). Second Chance for a First Impression? Trust Development in Intelligent System Interaction. Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization. https://doi.org/10.1145/3450613.3456817
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.