Investigating the Effects of (Empty) Promises on Human-Automation Interaction and Trust Repair
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Setting expectations for future behavior with promises is one way to manage human-human trusting relationships. To investigate the effect of promises made by an automated system, we conducted a 2 (reliability: low, high) x 3 (promise type: no-promise, optimistic, realistic) between-subject study where participants collaborated with an Automated Target Detection (ATD) system to classify images in multiple rounds of gameplay. We found that an optimistic promise (i.e., "I promise to do better") initially led to significantly more reliance on automation than a realistic promise (i.e., "I cannot do better than this"), but not in the long-term. High reliability participants relied more on the automation and reported greater perceived trustworthiness compared to low reliability participants. In addition, participants in the no promise group reported a greater degree of frustration compared to the other groups. We discuss the implications of our findings for trust repair in automated systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most commonly, the trust calibration was measured as the statistical diferences of trustworthiness perceptions of systems with high reliability and trustworthiness perceptions of systems with low-reliability groups, examined through analysis of variance (see, e.g., [4, 15, 26, 47, 58, 61, 68-70, 82, 84, 89, 90, 107, 117, 130, 140, 145]).”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [4]
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605
Developing and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 2×
“Next, we looked at the perceived trustworthiness characteristics [22, 24]: ability (4 items, 𝛼 = 0.96), integrity (4 items, 𝛼 = 0.84), Session 1A: Trust and Teamwork HAI '20, November 10–13, 2020, Virtual Event, NSW, Australia reported greater frustration than those in the high reliability…”
BackgroundMethodInfluential(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 1×
“Given that people often apply social rules when interacting with computers [27, 28, 34], we argue that human-human trust literature can shed light on trust repair strategies for human-automation interaction.”
BackgroundTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Developing and Maintaining Trust in Work Relationships
Lewicki, R. J., & Bunker, B. B. (1996) · Trust in Organizations: Frontiers of Theory and Research · doi:10.4135/9781452243610.n7 · Cited by 2,595
Barber, B. (1983) · DigitalGeorgetown (Georgetown University Library) · Cited by 2,495
The effect of the performance appraisal system on trust for management: A field quasi-experiment.
Mayer, R. C., & Davis, J. H. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.1.123 · Cited by 2,247
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“Given that people often apply social rules when interacting with computers [27, 28, 34], we argue that human-human trust literature can shed light on trust repair strategies for human-automation interaction.”
Interpersonal trust, trustworthiness, and gullibility.
Rotter, J. B. (1980) · American Psychologist · doi:10.1037/0003-066x.35.1.1 · Cited by 1,694 · cited 1×
“Trust is fundamental to human relationships and interactions, and has been the subject of study in various disciplines such as communication and psychology [1, 3, 36].”
BackgroundReputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618 · cited 1×
“We recruited participants from Amazon’s Mechanical Turk (MTurk) platform and restricted workers to those 18 years or older, living in the United States, and having completed at least 1000 Human Intelligence Tasks (HIT’s) with an approval rating of 95%, which is recommended in prior work [32].”
MethodPersuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554 · cited 1×
“In human-human trust repair, the łpromise of forbearancež [37] and the sincerity of a promise [7] have been shown to influence the effectiveness of an apology.”
BackgroundBart, Y., Shankar, V., Sultan, F., & Urban, G. L. (2005) · Journal of Marketing · doi:10.1509/jmkg.2005.69.4.133 · Cited by 1,482
Trust, control strategies and allocation of function in human-machine systems
LEE, J., & MORAY, N. (1992) · Ergonomics · doi:10.1080/00140139208967392 · Cited by 1,459
Kim, P. H., Ferrin, D. L., Cooper, C. D., & Dirks, K. T. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.1.104 · Cited by 1,063
MUIR, B. M., & MORAY, N. (1996) · Ergonomics · doi:10.1080/00140139608964474 · Cited by 993
You've been warned: an empirical study of the effectiveness of web browser phishing warnings
Egelman, S., Cranor, L. F., & Hong, J. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357219 · Cited by 607
Kim, P. H., Dirks, K. T., Cooper, C. D., & Ferrin, D. L. (2006) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2005.07.002 · Cited by 557
The benefits of imperfect diagnostic automation: a synthesis of the literature
Wickens, C. D., & Dixon, S. R. (2007) · Theoretical Issues in Ergonomics Science · doi:10.1080/14639220500370105 · Cited by 423 · cited 1×
“These levels of accuracy were chosen based on prior work identifying 70% as the accuracy at which automation is considered better than the lack thereof [41].”
MethodFrom ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interaction
de Visser, E. J., Pak, R., & Shaw, T. H. (2018) · Ergonomics · doi:10.1080/00140139.2018.1457725 · Cited by 398
MEDIA EQUATION: HOW PEOPLE TREAT COMPUTERS, TELEVISION, AND NEW MEDIA LIKE REAL PEOPLE AND PLACES
Soash, R. L. (1999) · Collection Management · doi:10.1300/j105v24n03_14 · Cited by 344
O’Brien, H. L. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2010.04.001 · Cited by 317
Scher, S. J., & Darley, J. M. (1997) · Journal of Psycholinguistic Research · doi:10.1023/a:1025068306386 · Cited by 302
Lewicki, R. J., & Brinsfield, C. (2017) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032516-113147 · Cited by 202
An Exploration of the Structure of Effective Apologies
Lewicki, R. J., Polin, B., & Lount, R. B. (2016) · Negotiation and Conflict Management Research · doi:10.1111/ncmr.12073 · Cited by 136
Hamacher, A., Bianchi-Berthouze, N., Pipe, A. G., & Eder, K. (2016) · 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/roman.2016.7745163 · Cited by 135
Timing Is Key for Robot Trust Repair
Robinette, P., Howard, A. M., & Wagner, A. R. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-25554-5_57 · Cited by 121 · cited 1×
“Robinette, Howard, and Wagner [35] found that apologies and promises were most effective at repairing trust when they were delivered at the time users had to make their next reliance decision, rather than immediately after a robot’s mistake.”
Background“I Don't Believe You”: Investigating the Effects of Robot Trust Violation and Repair
Sebo, S. S., Krishnamurthi, P., & Scassellati, B. (2019) · 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673169 · Cited by 110
Toward a more civilized design: studying the effects of computers that apologize
Tzeng, J. (2004) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2004.01.002 · Cited by 107
Buck, R. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139049825 · Cited by 93
Self-citationOhtsubo, Y., Watanabe, E., Kim, J., Kulas, J., Muluk, H., Nazar, G., Wang, F., & Zhang, J. (2012) · Journal of Evolutionary Psychology · doi:10.1556/jep.10.2012.4.3 · Cited by 64
Do you care if a computer says sorry?: user experience design through affective messages
Park, S. J., MacDonald, C. M., & Khoo, M. (2012) · Proceedings of the Designing Interactive Systems Conference · doi:10.1145/2317956.2318067 · Cited by 26
A Framework for Rebuilding Trust in Social Automation Across Health-Care Domains
Marinaccio, K., Kohn, S., Parasuraman, R., & De Visser, E. J. (2015) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857915041036 · Cited by 26
Jensen, T., Albayram, Y., Khan, M. M. H., Fahim, M. A. A., Buck, R., & Coman, E. (2019) · Proceedings of the 2019 on Designing Interactive Systems Conference · doi:10.1145/3322276.3322349 · Cited by 24
Self-citationTesting the Efficacy of Human-Human Trust Repair Strategies with Machines
Quinn, D. B., Pak, R., & de Visser, E. J. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601930 · Cited by 22
Initial Trustworthiness Perceptions of a Drone System based on Performance and Process Information
Jensen, T., Albayram, Y., Khan, M. M. H., Buck, R., Coman, E., & Fahim, M. A. A. (2018) · Proceedings of the 6th International Conference on Human-Agent Interaction · doi:10.1145/3284432.3284435 · Cited by 19
Self-citation
Research works printed but not linked: 7
- Ewart J De Visser , Marieke MM Peeters , Malte F Jung, Spencer Kohn, Tyler H Shaw, Richard Pak, and Mark A Neerincx. 2019 . Towards a Theory of Longitudinal Trust Calibration in Human--Robot Teams. International Journal of Social Robotics ( 2019), 1--20. Ewart J De Visser, Marieke MM Peeters, Malte F Jung, Spencer Kohn, Tyler H Shaw, Richard Pak, and Mark A Neerincx. 2019. Towards a Theory of Longitudinal Trust Calibration in Human--Robot Teams. International Journal of Social Robotics (2019), 1--20.
- Joseph A Gliem and Rosemary R Gliem . 2003 . Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales . In Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction. Joseph A Gliem and Rosemary R Gliem. 2003. Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. In Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction.
- Klaus Krippendorff . 2009. Testing the reliability of content analysis data. The content analysis reader ( 2009 ), 350--357. Klaus Krippendorff. 2009. Testing the reliability of content analysis data. The content analysis reader (2009), 350--357.
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- 10.1037/0021-9010.84.1.123 · doi:10.1037/0021-9010.84.1.123 · Paper page
- 10.5465/amr.1995.9508080335 · doi:10.5465/amr.1995.9508080335 · Paper page
- Maurice E Schweitzer , John C Hershey , and Eric T Bradlow . 2006. Promises and lies: Restoring violated trust. Organizational behavior and human decision processes , Vol. 101 , 1 ( 2006 ), 1--19. Maurice E Schweitzer, John C Hershey, and Eric T Bradlow. 2006. Promises and lies: Restoring violated trust. Organizational behavior and human decision processes, Vol. 101, 1 (2006), 1--19.
Cited by
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 144
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
“In many cases, trust measures were accompanied by subconstructs of trust such as perceptions of system accuracy [90, 143], predictability [68, 73], and reliability [15, 68, 107, 133], or trust related measures such as perceived usability [4], frustration [4], perceived humanness [26, 27, 55, 58], perceived intelligenc…”
BackgroundMethodA Literature Review of Trust Repair in HRI
Esterwood, C., & Robert, L. P. (2022) · 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/ro-man53752.2022.9900667 · Cited by 54
Having the Right Attitude: How Attitude Impacts Trust Repair in Human—Robot Interaction
Esterwood, C., & Robert, L. P. (2022) · 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889535 · Cited by 36
Chang, W.-C., & Hasanzadeh, S. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5656 · Cited by 42
Metadata
- Authors
- Albayram, Y., Jensen, T., Khan, M. M. H., Fahim, M. A. A., Buck, R., & Coman, E.
- Affiliations
- University of Connecticut (US)
- UConn Health (US)
- Venue
- Proceedings of the 8th International Conference on Human-Agent Interaction
- Publisher
- ACM
- Published
- 2020-11-10
- Pages
- 6-14
- OpenAlex
- W3094895408
- Cited by
- 31
- References
- 39
- Citations by year
- 2026: 1 · 2025: 9 · 2024: 8 · 2023: 6 · 2022: 5 · 2021: 2
- FWCI
- 4.58
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Human-Agent Interaction (HAI) (publishedVersion)
- Funders
- Air Force Office of Scientific Research (FA9550-15-1-0490)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- promise, human-automation interaction, trust repair, trustworthiness, automated target detection, system reliability, reliance on automation, frustration, trust management, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.