Investigating the Effects of (Empty) Promises on Human-Automation Interaction and Trust Repair
The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Setting expectations for future behavior with promises is one way to manage human-human trusting relationships. To investigate the effect of promises made by an automated system, we conducted a 2 (reliability: low, high) x 3 (promise type: no-promise, optimistic, realistic) between-subject study where participants collaborated with an Automated Target Detection (ATD) system to classify images in multiple rounds of gameplay. We found that an optimistic promise (i.e., "I promise to do better") initially led to significantly more reliance on automation than a realistic promise (i.e., "I cannot do better than this"), but not in the long-term. High reliability participants relied more on the automation and reported greater perceived trustworthiness compared to low reliability participants. In addition, participants in the no promise group reported a greater degree of frustration compared to the other groups. We discuss the implications of our findings for trust repair in automated systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Most commonly, the trust calibration was measured as the statistical diferences of trustworthiness perceptions of systems with high reliability and trustworthiness perceptions of systems with low-reliability groups, examined through analysis of variance (see, e.g., [4, 15, 26, 47, 58, 61, 68-70, 82, 84, 89, 90, 107, 117, 130, 140, 145]).”
From Measuring and Understanding Trust Calibrations for Automated Systems: A Survey of the State-Of-The-Art and Future Directions (2023) · cites this paper as [4]
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · cited 1×
“A bottom-up inductive coding approach [25] was used to code responses to the two open-ended questions on participants’ likes and dislikes about the message.”
MethodAn integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · cited 3×
“Mayer, Davis, and Schoor-man [23] defined trust as ł the willingness of a party to be vulnerable to the actions of another party based on the expectation that the other will perform a particular action important to the trustor, irrespective of the ability to monitor or control that party . ž In the…”
BackgroundInfluentialTrust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 3×
“While a large body of research has investigated trust in human-automationinteraction(seeLeeand See[17]andHoffandBashir[10] for reviews), the study of trust repair is relatively novel [4].”
BackgroundMethodInfluentialDeveloping and validating trust measures for e-commerce: an integrative typology
McKnight, D. H., Choudhury, V., & Kacmar, C. (2002) · Information Systems Research · doi:10.1287/isre.13.3.334.81 · Cited by 5,550 · cited 2×
“Next, we looked at the perceived trustworthiness characteristics [22, 24]: ability (4 items, 𝛼 = 0.96), integrity (4 items, 𝛼 = 0.84), Session 1A: Trust and Teamwork HAI '20, November 10–13, 2020, Virtual Event, NSW, Australia reported greater frustration than those in the high reliability…”
BackgroundMethodInfluential(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022 · cited 1×
“Given that people often apply social rules when interacting with computers [27, 28, 34], we argue that human-human trust literature can shed light on trust repair strategies for human-automation interaction.”
BackgroundTrust in Automation: Integrating Empirical Evidence on Factors That Influence Trust
Hoff, K. A., & Bashir, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814547570 · Cited by 2,817
Developing and Maintaining Trust in Work Relationships
Lewicki, R. J., & Bunker, B. B. (1996) · Trust in Organizations: Frontiers of Theory and Research · doi:10.4135/9781452243610.n7 · Cited by 2,595
Barber, B. (1983) · DigitalGeorgetown (Georgetown University Library) · Cited by 2,528
The effect of the performance appraisal system on trust for management: A field quasi-experiment.
Mayer, R. C., & Davis, J. H. (1999) · Journal of Applied Psychology · doi:10.1037//0021-9010.84.1.123 · Cited by 2,247 · cited 2×
“Next, we looked at the perceived trustworthiness characteristics [22, 24]: ability (4 items, 𝛼 = 0.96), integrity (4 items, 𝛼 = 0.84), Session 1A: Trust and Teamwork HAI '20, November 10–13, 2020, Virtual Event, NSW, Australia reported greater frustration than those in the high reliability…”
BackgroundMethodInfluential
Research works printed but not linked: 7
- Ewart J De Visser , Marieke MM Peeters , Malte F Jung, Spencer Kohn, Tyler H Shaw, Richard Pak, and Mark A Neerincx. 2019 . Towards a Theory of Longitudinal Trust Calibration in Human--Robot Teams. International Journal of Social Robotics ( 2019), 1--20. Ewart J De Visser, Marieke MM Peeters, Malte F Jung, Spencer Kohn, Tyler H Shaw, Richard Pak, and Mark A Neerincx. 2019. Towards a Theory of Longitudinal Trust Calibration in Human--Robot Teams. International Journal of Social Robotics (2019), 1--20.
- Joseph A Gliem and Rosemary R Gliem . 2003 . Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales . In Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction. Joseph A Gliem and Rosemary R Gliem. 2003. Calculating, interpreting, and reporting Cronbach's alpha reliability coefficient for Likert-type scales. In Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Eduction.
- Klaus Krippendorff . 2009. Testing the reliability of content analysis data. The content analysis reader ( 2009 ), 350--357. Klaus Krippendorff. 2009. Testing the reliability of content analysis data. The content analysis reader (2009), 350--357.
- 10.1518/hfes.46.1.50.30392 · doi:10.1518/hfes.46.1.50.30392 · Paper page
- 10.1037/0021-9010.84.1.123 · doi:10.1037/0021-9010.84.1.123 · Paper page
- 10.5465/amr.1995.9508080335 · doi:10.5465/amr.1995.9508080335 · Paper page
- Maurice E Schweitzer , John C Hershey , and Eric T Bradlow . 2006. Promises and lies: Restoring violated trust. Organizational behavior and human decision processes , Vol. 101 , 1 ( 2006 ), 1--19. Maurice E Schweitzer, John C Hershey, and Eric T Bradlow. 2006. Promises and lies: Restoring violated trust. Organizational behavior and human decision processes, Vol. 101, 1 (2006), 1--19.
Cited by
Mehrotra, S., Degachi, C., Vereschak, O., Jonker, C. M., & Tielman, M. L. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3696449 · Cited by 144
Wischnewski, M., Krämer, N., & Müller, E. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581197 · Cited by 146
“In many cases, trust measures were accompanied by subconstructs of trust such as perceptions of system accuracy [90, 143], predictability [68, 73], and reliability [15, 68, 107, 133], or trust related measures such as perceived usability [4], frustration [4], perceived humanness [26, 27, 55, 58], perceived intelligenc…”
BackgroundMethodA Literature Review of Trust Repair in HRI
Esterwood, C., & Robert, L. P. (2022) · 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/ro-man53752.2022.9900667 · Cited by 54
“Apology [46], [62], [58] [43], [44] [56] Timing [64], [50]”
BackgroundResultInfluentialHaving the Right Attitude: How Attitude Impacts Trust Repair in Human—Robot Interaction
Esterwood, C., & Robert, L. P. (2022) · 2022 17th ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889535 · Cited by 36
Chang, W.-C., & Hasanzadeh, S. (2024) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-5656 · Cited by 44
Trust Development and Repair in AI-Assisted Decision-Making during Complementary Expertise
Pareek, S., Velloso, E., & Gonçalves, J. (2024) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3630106.3658924 · Cited by 54
Jensen, T., Khan, M. M. H., Fahim, M. A. A., & Albayram, Y. (2021) · Designing Interactive Systems Conference 2021 · doi:10.1145/3461778.3462102 · Cited by 26
“These optimal levels of allocation were established based on prior studies conducted using this experimental platform [1, 17, 18].”
MethodSelf-citationKarli, U. B., Cao, S., & Huang, C. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568162.3576964 · Cited by 43
“Studies found mixed results (from repaired trust to damaged trust) in the efficacy of apologies and denials as robot trust repair strategies [1, 7, 14, 25, 26, 28, 32, 54].”
ResultKox, E. S., Siegling, L. B., & Kerstholt, J. H. (2022) · International Journal of Social Robotics · doi:10.1007/s12369-022-00871-4 · Cited by 22
“To foster a balanced trusting relationship, agents should be equipped with social tactics to recover from mistakes and to repair trust following trust violations [2].”
BackgroundKim, J. Y., Lester, C., & Yang, X. J. (2025) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208251326795 · Cited by 21
“…efforts often involve various actions/strategies such as apolo-gies (Kohn et al., 2019; Mahmood et al., 2022; Natarajan & Gombolay, 2020), denials (Kohn et al., 2019), explanations (Ashktorab et al., 2019; M. Faas et al., 2021; Natarajan & Gombolay, 2020), and promises (Albayram et al., 2020).”
Effects of Failure Types on Trust Repairs in Human–Robot Interactions
Zhang, X., Lee, S. K., Maeng, H., & Hahn, S. (2023) · International Journal of Social Robotics · doi:10.1007/s12369-023-01059-0 · Cited by 30
“…human-automation, human-agent, and human-robot interactions, such as blaming [36, 37], apologizing [38–45], denying [39, 41, 43], promising [42, 45, 46], justifying [47], gaslight-ing [39], engaging in social dialogues [48], offering palpable compensations [40], offering options [40], and…”
BackgroundAI apology: a critical review of apology in AI systems
Harland, H., Dazeley, R., Senaratne, H., Vamplew, P., Cruz, F., & Nakisa, B. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11305-8 · Cited by 19
Kraus, J., Merger, J., Gröner, F., & Pätz, J. (2023) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3568294.3580122 · Cited by 31
“Also, promises have been addressed in human-automation interaction studies with mixed results [1, 49].”
BackgroundTrust or Bust: Ensuring Trustworthiness in Autonomous Weapon Systems
Cools, K., & Maathuis, C. (2024) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom61039.2024.10773908 · Cited by 23
“The autonomous operation of AWS also reduces the cognitive load on human operators, allowing them to focus on higher-level tasks and potentially decreasing the overall size of the military workforce [25], [27], [32].”
(2021) · doi:10.1145/3461778.3461997 · Cited by 14
“Recent efforts looked at various strategies such as blame attribution [6, 29], apology messaging [59, 63], denial [33], promise [1, 59], explanation [33], enhancing transparency [49], etc. to calibrate However, these prior efforts do not directly consider emotional experience while interacting with…”
BackgroundMethodSelf-citationXu, Z., Wang, G., Zhai, S., & Liu, P. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2176986 · Cited by 12
“…2021; T. Kim & Song, 2021; Kohn et al., 2019; Nayyar & Wagner, 2018; Sebo et al., 2019), explanation (Cameron et al., 2021; Choi et al., 2021; Correia et al., 2018; Lyons et al., 2023), promise (Albayram et al., 2020; Nayyar & Wagner, 2018; Robinette et al., 2015), and denial (Sebo et al., 2019).”
A Systematic Review and Taxonomy of Human–Agent Teaming Testbeds
Chung, H., Holder, T., Shah, J., & Yang, X. J. (2025) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208251376898 · Cited by 16
Associations between Trust Dynamics and Personal Characteristics
Chung, H., & Yang, X. J. (2024) · 2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555583 · Cited by 10
“Numerous studies have demonstrated the effectiveness of different trust repair strategies aimed at restoring trust following violations [16], including apologies [17]–[19], denials [18], explanations [17], [20], [21], and promises [22].”
BackgroundTo Err is Automation: Can Trust be Repaired by the Automated Driving System After its Failure?
Liu, P., Chu, Y., Wang, G., & Xu, Z. (2024) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2024.3434680 · Cited by 15
“Tomitigatethisconcern,certainempirical investigationswereconducted,mostfromtherobotcontext(see [52]forareview)andfewfromAVs[59],[60],[61]andother contexts[62],[63],[64].”
BackgroundResultChang, W.-C., Garcia, N. F. G., & Hasanzadeh, S. (2025) · Journal of Computing in Civil Engineering · doi:10.1061/jccee5.cpeng-6302 · Cited by 10
Wang, K., Hou, W., Ma, H., & Hong, L. (2024) · Sensors · doi:10.3390/s24247946 · Cited by 13
The Effect of Voice and Repair Strategy on Trust Formation and Repair in Human-Robot Interaction
Romeo, M., Torre, I., Maguer, S. L., Sleat, A., Cangelosi, A., & Leite, I. (2025) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3711938 · Cited by 15
“…59, 64] Denial Human-human Human-robot [4, 13, 29, 35, 59, 64] Trustworthy action Human-human [4, 8] Promising to be better Human-human Human-robot [1, 13, 30, 56] Providing reasons to trust again Human-robot [56, 57] Justify the failure Human-human Human-robot [10, 13, 30, 35, 59, 62] Human…”
Development and validation of the trust in AI scale (TAIS)
Wischnewski, M., Doebler, P., & Krämer, N. C. (2026) · Journal of Psychology and AI · doi:10.1080/29974100.2026.2715475 · Cited by 19
Robot Broken Promise? Repair strategies for mitigating loss of trust for repeated failures
Nesset, B., Romeo, M., Rajendran, G., & Hastie, H. (2023) · IEEE RO-MAN · doi:10.1109/ro-man57019.2023.10309558 · Cited by 10
“Usually, the robot will apologise for committing a failure, often using additional tools such as emotions or promises [4], [3], [5].”
BackgroundFirst impressions of a humanoid social robot with natural language capabilities
Herath, D. C., Grant, J. B., Rodriguez, A., & Davis, J. L. (2025) · Scientific Reports · doi:10.1038/s41598-025-04274-z · Cited by 11
Experimental Investigation of Trust in Anthropomorphic Agents as Task Partners
Maehigashi, A., Tsumura, T., & Yamada, S. (2022) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3527188.3563921 · Cited by 14
“In particular, several studies experimentally indicated that human trust in an autonomous agent and in a human differ [10, 18].”
BackgroundHuman vs. Automation: Which One Will You Trust More If You Are About to Lose Money?
Fahim, M., Khan, M. M. H., Jensen, T., & Albayram, Y. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2076772 · Cited by 7
“We decided on these reliability levels based on our pilot study and prior work (Albayram et al., 2020; Jensen et al., 2019, 2020).”
BackgroundMethodSelf-citationChung, H., Jiang, R., Shen, S., & Yang, X. J. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2526645 · Cited by 6
“These strategies include offering apologies (Mahmood et al., 2022), denials (Kohn et al., 2019), explanations (Natarajan & Gombolay, 2020), and promises (Albayram et al., 2020).”
Lane, S., Esterwood, C. T., Kulić, D., & Robinson, N. (2024) · IEEE RO-MAN · doi:10.1109/ro-man60168.2024.10731465 · Cited by 4
“[21] and [27] found that promises are effective trust repair strategies, with [21] elaborating that realistic promises work better in the long run than optimistic ones.”
BackgroundPredicting Trust Dynamics Type Using Seven Personal Characteristics
Chung, H., & Yang, X. J. (2025) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2025.3627578 · Cited by 7
“These efforts often involve various actions/strategies such as apologies [33], expressing regrets [34], denials [35], explanations [34], [36], and promises [37].”
Ethical Risks of Human–Robot Interaction in the Construction Industry: A Systematic Review
Wang, L., Li, W., Gu, B., Li, N., & Fang, D. (2025) · CIB Conferences · doi:10.7771/3067-4883.1700 · Cited by 1
Metadata
- Authors
- Albayram, Y., Jensen, T., Khan, M. M. H., Fahim, M. A. A., Buck, R., & Coman, E.
- Affiliations
- University of Connecticut (US)
- UConn Health (US)
- Venue
- Proceedings of the 8th International Conference on Human-Agent Interaction
- Publisher
- ACM
- Published
- 2020-11-10
- Pages
- 6-14
- OpenAlex
- W3094895408
- Cited by
- 31
- References
- 39
- Citations by year
- 2026: 1 · 2025: 9 · 2024: 8 · 2023: 6 · 2022: 5 · 2021: 2
- FWCI
- 4.58
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Human-Agent Interaction (HAI) (publishedVersion)
- Funders
- Air Force Office of Scientific Research (FA9550-15-1-0490)
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- promise, human-automation interaction, trust repair, trustworthiness, automated target detection, system reliability, reliance on automation, frustration, trust management, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.