Warning Signals for Poor Performance Improve Human-Robot Interaction
Open accessAbstract
The present research was aimed at investigating whether human-robot interaction (HRI) can be improved by a robot's nonverbal warning signals. Ideally, when a robot signals that it cannot guarantee good performance, people could take preventive actions to ensure the successful completion of the robot's task. In two experiments, participants learned either that a robot's gestures predicted subsequent poor performance, or they did not. Participants evaluated a robot that uses predictive gestures as more trustworthy, understandable, and reliable compared to a robot that uses gestures that are not predictive of their performance. Finally, participants who learned the relation between gestures and performance improved collaboration with the robot through prevention behavior immediately after a predictive gesture. This limits the negative consequences of the robot's mistakes, thus improving the interaction.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
People tend to be forgiving of robots that cannot guarantee optimal performance, so long as the robot clearly acknowledges its own limitations.
“Fortunately, people tend to be forgiving of robots that cannot guarantee optimal performance, so long as the robot clearly acknowledges its own limitations [40].”
From A Conversational Robot for Older Adults with Alzheimer's Disease (2020) · cites this paper as [40]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · see citing works
<b>lavaan</b> : An <i>R</i> Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955 · see citing works
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
An integrative model of organizational trust
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995) · The Academy of Management Review · doi:10.2307/258792 · Cited by 10,736 · see citing works
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003) · Department of Psychology - University of Koblenz-Landau · doi:10.23668/psycharchives.12784 · Cited by 8,975 · see citing works
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016 · see citing works
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 3× · see citing works
“This transparency may help reducing overreliance (Parasuraman & Riley, 1997) on the system and calibrates the reliance on the robot (Lee & See, 2004, see also Van den Brule et al., 2014) and enables humans to anticipate what the robot will do, so they can intervene at the appropriate moment.”
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567 · see citing works
Inclusion of Other in the Self Scale and the structure of interpersonal closeness.
Aron, A., Aron, E. N., & Smollan, D. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.4.596 · Cited by 5,157 · see citing works
Humans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554 · see citing works
Reflective and Impulsive Determinants of Social Behavior
Strack, F., & Deutsch, R. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0803_1 · Cited by 3,984 · see citing works
Bartneck, C., Kulić, D., Croft, E., & Zoghbi, S. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0001-3 · Cited by 3,193 · see citing works
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162 · cited 1× · see citing works
“As such, they can be considered socially interactive robots (Fong, Nourbakhsh, & Dautenhahn, 2003).”
Calculation of signal detection theory measures
Harold Stanislaw, A., & Todorov, N. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03207704 · Cited by 3,087 · see citing works
Conditioned Reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex.
Pavlov, P. I. (1930) · Archives of Neurology And Psychiatry · doi:10.1001/archneurpsyc.1930.02220110256018 · Cited by 2,681 · see citing works
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 2× · see citing works
“Previous research has shown that trust in robots is mainly affected by a robot’s performance, although other robot attributes also play a role (Hancock et al., 2011).”
The functional basis of face evaluation
Oosterhof, N. N., & Todorov, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805664105 · Cited by 1,819 · see citing works
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Jian, J.-Y., Bisantz, A. M., & Drury, C. G. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_04 · Cited by 1,799 · see citing works
Implicit and explicit prejudice and interracial interaction.
Dovidio, J. F., Kawakami, K., & Gaertner, S. L. (2002) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.82.1.62 · Cited by 1,567 · see citing works
Foundations for an Empirically Determined Scale of Trust in Automated Systems
Lehto, M., House, T., & Papastavrou, J. (2000) · International Journal of Cognitive Ergonomics · doi:10.1207/s15327566ijce0401_05 · Cited by 1,139 · see citing works
Probability of shock in the presence and absence of cs in fear conditioning.
Rescorla, R. A. (1968) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0025984 · Cited by 1,067 · cited 1× · see citing works
“Contingency learning works regardless deviations from a strict contiguity of the CS with the US (i.e., whether the CS occurs at the same time as the US), as shown by Rescorla (1968).”
MUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873 · cited 1× · see citing works
“From a psychological perspective, trust is seen as an important variable that mediates a human’s acceptance of technology (Muir, 1994; Parasuraman & Riley, 1997).”
Genesis of popular but erroneous psychodiagnostic observations.
Chapman, L. J., & Chapman, J. P. (1967) · Journal of Abnormal Psychology · doi:10.1037/h0024670 · Cited by 863 · see citing works
Fundamentals of nonverbal behavior
Feldman, R. S., & Rimé, B. (1991) · Medical Entomology and Zoology · Cited by 750 · see citing works
Ekman, P., Friesen, W. V., & O'Sullivan, M. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.3.414 · Cited by 628 · see citing works
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2015) · American Psychological Association eBooks · doi:10.1037/14805-033 · Cited by 516 · see citing works
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · PsycEXTRA Dataset · doi:10.1037/e519702015-014 · Cited by 462 · see citing works
Anxious Responses to Predictable and Unpredictable Aversive Events.
Grillon, C., Baas, J. P., Lissek, S., Smith, K., & Milstein, J. (2004) · Behavioral Neuroscience · doi:10.1037/0735-7044.118.5.916 · Cited by 349 · see citing works
Expressing thought: Improving robot readability with animation principles
Takayama, L., Dooley, D., & Ju, W. (2011) · IEEE/ACM International Conference on Human-Robot Interaction · doi:10.1145/1957656.1957674 · Cited by 335 · see citing works
The effects of personality and situational variables on behavioral trust.
Schlenker, B. R., Helm, B., & Tedeschi, J. T. (1973) · Journal of Personality and Social Psychology · doi:10.1037/h0034088 · Cited by 327 · see citing works
Bluemke, M., & Friese, M. (2008) · European Journal of Social Psychology · doi:10.1002/ejsp.487 · Cited by 321 · see citing works
Methodology & Themes of Human-Robot Interaction: A Growing Research Field
Dautenhahn, K. (2007) · International Journal of Advanced Robotic Systems · doi:10.5772/5702 · Cited by 272 · see citing works
Asking for Help Using Inverse Semantics
Tellex, S., Knepper, R. A., Li, A., Rus, D., & Roy, N. (2014) · Robotics: Science and Systems Conference · doi:10.15607/rss.2014.x.024 · Cited by 230 · see citing works
Detecting the Trustworthiness of Novel Partners in Economic Exchange
DeSteno, D. A., Breazeal, C., Frank, R. H., Pizarro, D. A., Wormwood, J. B., Dickens, L. R., & Lee, J. J. (2012) · Psychological Science · doi:10.1177/0956797612448793 · Cited by 184 · see citing works
Associationism and cognition: Human contingency learning at 25
Shanks, D. R. (2007) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210601000581 · Cited by 169 · see citing works
Woods, S. N., Walters, M. L., Koay, K. L., & Dautenhahn, K. (2006) · IEEE International Workshop on Advanced Motion Control (AMC) · doi:10.1109/amc.2006.1631754 · Cited by 162 · see citing works
Sung, J.-Y., Grinter, R. E., & Christensen, H. I. (2010) · International Journal of Social Robotics · doi:10.1007/s12369-010-0065-8 · Cited by 149 · see citing works
A History of Implicit Social Cognition Where Is It Coming From? Where Is It Now? Where Is It Going?
Payne, B. K., & Gawronski, B. (2010) · Cited by 147 · see citing works
Sanders, T., Oleson, K. E., Billings, D., Chen, J. Y. C., & Hancock, P. (2011) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181311551298 · Cited by 136 · see citing works
Implicit and Explicit Knowledge about Language
Ellis, N. C. (2008) · Springer eBooks · doi:10.1007/978-0-387-30424-3_143 · Cited by 129 · see citing works
How a robot should give advice
Torrey, C., Fussell, S. R., & Kiesler, S. B. (2013) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2013.6483599 · Cited by 121 · see citing works
Do Robot Performance and Behavioral Style affect Human Trust?
van den Brule, R., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., & Haselager, P. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-014-0231-5 · Cited by 115 · see citing works
Self-citationDisplayed Uncertainty Improves Driving Experience and Behavior
Jung, M. F., Sirkin, D. M., GUER, T. M., & Steinert, M. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702479 · Cited by 113 · see citing works
Competence and warmth in context: The compensatory nature of stereotypic views of national groups
Kervyn, N. O., Yzerbyt, V. Y., Demoulin, S., & Judd, C. M. (2008) · European Journal of Social Psychology · doi:10.1002/ejsp.526 · Cited by 88 · see citing works
Implicit and Explicit Knowledge About Language
Ellis, N. C. (2017) · Springer eBooks · doi:10.1007/978-3-319-02240-6_7 · Cited by 79 · see citing works
Trustworthiness of Command and Control Systems
Sheridan, T. B. (1988) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)53945-2 · Cited by 68 · see citing works
STB: Child-Dependent Sociable Trash Box
Yamaji, Y., Miyake, T., Yoshiike, Y., Silva, P. R. S. D., & Okada, M. (2011) · International Journal of Social Robotics · doi:10.1007/s12369-011-0114-y · Cited by 65 · see citing works
Stanton, C. J., & Stevens, C. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11973-1_34 · Cited by 51 · see citing works
Methodological Issues in Scenario-Based Evaluation of Human–Robot Interaction
Xu, Q., Ng, J., Tan, O., Huang, Z., Tay, B. T. C., & Park, T. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-014-0248-9 · Cited by 41 · see citing works
Syrdal, D. S., Koay, K. L., Gácsi, M., Walters, M. L., & Dautenhahn, K. (2010) · IEEE RO-MAN · doi:10.1109/roman.2010.5598693 · Cited by 40 · see citing works
de Jong, P. J., Merckelbach, H. L. G. J., & Arntz, A. R. (1990) · Biological Psychology · doi:10.1016/0301-0511(90)90034-t · Cited by 23 · see citing works
(2011) · Human-Robot Interaction · Cited by 22 · see citing works
Methodology and themes of human-robot interaction: a growing research field
Dautenhahn, K. (2007) · University of Hertfordshire Research Archive (University of Hertfordshire) · Cited by 12 · see citing works
Signaling Robot Trustworthiness: Effects of Behavioral Cues as Warnings
van den Brule, R., Bijlstra, G., Dotsch, R., Wigboldus, D. H. J., & Haselager, P. (2013) · International Conference on Social Robotics · Cited by 7 · see citing works
Self-citationBeing there: humans and robots in public spaces
Bremner, P., Trigoni, N., Brown, I., Güneş, H., Bevan, C., Fraser, D. S., & Levine, M. (2013) · The University of Bath Online Publications Store (The University of Bath) · doi:10.1007/978-3-319-02675-6 · Cited by 3 · see citing works
Ligthart, M. E. U., van den Brule, R., & Haselager, P. (2013) · Research Repository (Delft University of Technology) · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
2 of the 59 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- [9]9. Dovidio, J. F., Kawakami, K., & Gaertner, S. L. (2002). Implicit and explicity prejudice and interractial interaction. Journal of Personality and Social Psychology, 82(1), 62-68.
- [25]25. Madsen, M., & Gregor, S. (2000). Measuring human-computer trust. In Gable, G., Viatle, M. (Eds.). Proceedings of the 11 th Australasian Conference on Information Systems (pp. 6-8). Brisbane, Australia.
- [27]27. Moon, A., Panton, B., Van der Loos, H. F. M., & Croft, E. A. (2010). Using hesitation gestures for safe and ethical human-robot interaction. In Proceedings of ICRA (pp. 11-13). Retrieved from http://www.sites.mech.ubc.ca/~caris/Publications/Using Hesitation Gestures for Safe and Ethical Human-Robot Interaction.pdf
- [38]38. Schlencker, B. R., Helm, B., & Tedeschi, J. T. (1973). Interpersonal trust, promise credibility, and behavioral trust. Journal of Personality and Social Psychology, 25, 419-427.
Cited by
Sorted by citations
How Robots Influence Humans: A Survey of Nonverbal Communication in Social Human–Robot Interaction
Saunderson, S., & Nejat, G. (2019) · International Journal of Social Robotics · doi:10.1007/s12369-019-00523-0 · Cited by 333 · see citing works
Klumpp, M., Hesenius, M., Meyer, O., Ruiner, C., & Gruhn, V. (2019) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-019-03785-0 · Cited by 114 · see citing works
Designing Human-Agent Collaborations: Commitment, responsiveness, and support
Cila, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517500 · Cited by 65 · see citing works
Intentional machines: A defence of trust in medical artificial intelligence
Starke, G., van den Brule, R., Elger, B. S., & Haselager, P. (2021) · Bioethics · doi:10.1111/bioe.12891 · Cited by 60 · see citing works
Self-citationA Conversational Robot for Older Adults with Alzheimer's Disease
Pou-Prom, C., Raimondo, S., & Rudzicz, F. (2020) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3380785 · Cited by 59 · see citing works
Investigating Strategies for Robot Persuasion in Social Human–Robot Interaction
Saunderson, S., & Nejat, G. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2987463 · Cited by 57 · see citing works
Effect of automation failure type on trust development in driving automation systems
Mishler, S., & Chen, J. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103913 · Cited by 54 · see citing works
Rossi, S., Rossi, A., & Dautenhahn, K. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00650-z · Cited by 47 · see citing works
Design of Hesitation Gestures for Nonverbal Human-Robot Negotiation of Conflicts
Moon, A., Hashmi, M., der Loos, H. F. M. V., Croft, E. A., & Billard, A. (2021) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3418302 · Cited by 19 · see citing works
Human–machine coordination in mixed traffic as a problem of Meaningful Human Control
Mecacci, G., Calvert, S. C., & de Sio, F. S. (2023) · AI & Society · doi:10.1007/s00146-022-01605-w · Cited by 12 · see citing works
Price, M., Lee, J. D., Dinparastdjadid, A., Toyoda, H., & Domeyer, J. E. (2019) · International Journal of Automotive Engineering · doi:10.20485/jsaeijae.10.1_73 · Cited by 10 · see citing works
Bridging HRI Theory and Practice: Design Guidelines for Robot Communication in Dairy Farming
Cila, N., González, I. G., Jacobs, J., & Rozendaal, M. C. (2024) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3610977.3634991 · Cited by 8 · see citing works
Dolgov, I., & Kaltenbach, E. K. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601799 · Cited by 8 · see citing works
Raghu, S. B., Lohrmann, C., Bakshi, A., Kim, J., Herrera, J. C., Hayes, B., & Roncone, A. (2025) · IEEE RO-MAN · doi:10.1109/ro-man63969.2025.11217717 · Cited by 2 · see citing works
Exploratory design of non-verbal politeness of a robotic arm
Kumar, S., Liberman-Pincu, E., Dvir, N., Edan, Y., & Oron-Gilad, T. (2024) · IEEE International Conference on Human-Machine Systems (ICHMS) · doi:10.1109/ichms59971.2024.10555647 · Cited by 1 · see citing works
Towards Wise Objects: The Value of Knowing When to Quit
Haselager, P. (2021) · doi:10.5040/9781350160156.ch-011
Self-citationLim, J. N. Q., Livingston, G., Yu, C. T. K., Sommerlad, A., & Costafreda, S. G. (2026) · doi:10.2196/preprints.94678
- Authors
- Van den Brule, R., Bijlstra, G., Dotsch, R., Haselager, P., & Wigboldus, D. H. J.
- Affiliations
- Radboud University Nijmegen (NL)
- Utrecht University (NL)
- Venue
- Journal of Human-Robot Interaction
- Publisher
- Journal of Human-Robot Interaction
- Published
- 2016-09-10
- Volume
- 5
- Issue
- 2
- Pages
- 69
- ISSN
- 2163-0364 (ISSN-L)
- OpenAlex
- W2519483781
- Semantic Scholar
- 2ef7666770eaae3401dbd10ece7de96e9341d443
- Cited by
- 17
- References
- 59
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 3 · 2020: 3 · 2019: 3 · 2017: 1
- FWCI
- 2.10
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of Human-Robot Interaction (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion)
- Utrecht University Repository (Utrecht University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Engineering › Control and Systems Engineering › Robot Manipulation and Learning
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Keywords
- human-robot interaction, warning signs, nonverbal communication, trust in robots, robot reliability, preventive behavior, human-robot collaboration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
