Empathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
With the popularity of AI-infused systems, conversational agents (CAs) are becoming essential in diverse areas, offering new functionality and convenience, but simultaneously, suffering misuse and verbal abuse. We examine whether conversational agents' response styles under varying abuse types influence those emotions found to mitigate peoples' aggressive behaviors, involving three verbal abuse types (Insult, Threat, Swearing) and three response styles (Avoidance, Empathy, Counterattacking). Ninety-eight participants were assigned to one of the abuse type conditions, interacted with the three spoken (voice-based) CAs in turn, and reported their feelings about guiltiness, anger, and shame after each session. The results show that the agent's response style has a significant effect on user emotions. Participants were less angry and more guilty with the empathy agent than the other two agents. Furthermore, we investigated the current status of commercial CAs' responses to verbal abuse. Our study findings have direct implications for the design of conversational agents.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Pre, post and exit interviews were inductively analysed to develop themes that could be iterated upon and developed further, following an inductive thematic analysis methodology [21].”
From Amazon Echo Show as a Multimodal Human-to-Human Care Support Tool within Self-Isolating Older UK Households (2022) · cites this paper as [21]
Citations
Cites
Buss, A. H., & Perry, M. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.3.452 · Cited by 4,693
The Uncanny Valley [From the Field]
Mori, M., MacDorman, K., & Kageki, N. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2192811 · Cited by 3,542
Bartneck, C., Kulić, D., Croft, E., & Zoghbi, S. (2009) · International Journal of Social Robotics · doi:10.1007/s12369-008-0001-3 · Cited by 3,193 · cited 1×
“We adopted items from the Bartneck et al.’s [8] study to assess the anthropomorphism, likability, and perceived intelligence of an agent.”
MethodPersonal control and stress and coping processes: A theoretical analysis.
Folkman, S. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.46.4.839 · Cited by 2,784
Abusive Supervision in Work Organizations: Review, Synthesis, and Research Agenda
Tepper, B. J. (2007) · Journal of Management · doi:10.1177/0149206307300812 · Cited by 1,698
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469 · cited 1×
“In addition, by operationalizing abuse type as a between-subject factor, we were able to effectively reduce the threats of maturation, testing, and fatigue to internal validity [16].”
BackgroundThe mind in the machine: Anthropomorphism increases trust in an autonomous vehicle
Waytz, A., Heafner, J., & Epley, N. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.01.005 · Cited by 1,439
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 3×
“When using the term conversational agent, people might refer to a chatbot, virtual assistant, interface agent, embodied conversational agent, or avatar [6, 41].”
BackgroundSpreng*, R. N., McKinnon*, M. C., Mar, R. A., & Levine, B. (2009) · Journal of Personality Assessment · doi:10.1080/00223890802484381 · Cited by 1,161
The customer is not always right: customer aggression and emotion regulation of service employees
Grandey, A. A., Dickter, D. N., & Sin, H. (2004) · Journal of Organizational Behavior · doi:10.1002/job.252 · Cited by 936
Gender and aggressive behavior: a meta-analytic review of the social psychological literature.
Eagly, A. H., & Steffen, V. J. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.100.3.309 · Cited by 872
Studies in the Organization of Conversational Interaction
(1978) · Elsevier eBooks · doi:10.1016/c2013-0-11461-4 · Cited by 867
Conscience, Significant Others, and Rational Choice: Extending the Deterrence Model
Grasmick, H. G., & Bursik, R. J. (1990) · Law & Society Review · doi:10.2307/3053861 · Cited by 826
Voice Interfaces in Everyday Life
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 1×
“There are various ways of naming those machines that people can ‘talk to’, including conversational agents and intelligent personal assistants [50].”
BackgroundIn the shades of the uncanny valley: An experimental study of human–chatbot interaction
Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2018.01.055 · Cited by 651
Shamed into anger? The relation of shame and guilt to anger and self-reported aggression.
Tangney, J. P., Wagner, P., Fletcher, C., & Gramzow, R. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.62.4.669 · Cited by 620 · cited 2×
“The inclination to feel shame was also associated with the indirect expression of hostility and anger arousal [65].”
BackgroundTangney, J. P., Wagner, P. E., Hill-Barlow, D., Marschall, D. E., & Gramzow, R. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.4.797 · Cited by 618
Brave, S., Nass, C., & Hutchinson, K. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2004.11.002 · Cited by 511
Community and dating violence among adolescents: Perpetration and victimization
MALIK, S., SORENSON, S., & ANESHENSEL, C. (1997) · Journal of Adolescent Health · doi:10.1016/s1054-139x(97)00143-2 · Cited by 483
Grandey, A. A., Kern, J. H., & Frone, M. R. (2007) · Journal of Occupational Health Psychology · doi:10.1037/1076-8998.12.1.63 · Cited by 478
"Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo
Purington, A., Taft, J. G., Sannon, S., Bazarova, N. N., & Taylor, S. H. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053246 · Cited by 476
What Makes a Good Conversation?: Challenges in Designing Truly Conversational Agents
Clark, L., Pantidi, N., Cooney, O., Doyle, P., Garaialde, D., Edwards, J., Spillane, B., Gilmartin, E., Murad, C., Munteanu, C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300705 · Cited by 461 · cited 2×
“People considered conversational agents as a tool or servant that supports humans and were resistant to the idea of becoming friends with CA [20, 23].”
Background“It doesn’t matter what you are!” Explaining social effects of agents and avatars
von der Pütten, A. M., Krämer, N. C., Gratch, J., & Kang, S.-H. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.06.012 · Cited by 389
MEDIA EQUATION: HOW PEOPLE TREAT COMPUTERS, TELEVISION, AND NEW MEDIA LIKE REAL PEOPLE AND PLACES
Soash, R. L. (1999) · Collection Management · doi:10.1300/j105v24n03_14 · Cited by 344
Workplace anger and aggression: Informing conceptual models with data from specific encounters.
Glomb, T. M. (2002) · Journal of Occupational Health Psychology · doi:10.1037//1076-8998.7.1.20 · Cited by 295
THE EMPATHIC COMPANION: A CHARACTER-BASED INTERFACE THAT ADDRESSES USERS' AFFECTIVE STATES
Prendinger, H., & Ishizuka, M. (2005) · Applied Artificial Intelligence · doi:10.1080/08839510590910174 · Cited by 289
Chatbots, Humbots, and the Quest for Artificial General Intelligence
Grudin, J., & Jacques, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300439 · Cited by 275 · cited 1×
“On the other hand, Intelligent Personal Assistant (IPA) refers to commercial services such as Siri, Cortana, Alexa, Google Assistant, and Bixby, and the main functions of them are to retrieve information such as weather or music, and send notifications about schedules such as meeting schedules for the day [33].”
BackgroundWhy Would I Use This in My Home? A Model of Domestic Social Robot Acceptance
de Graaf, M. M. A., Ben Allouch, S., & van Dijk, J. A. G. M. (2019) · Human–Computer Interaction · doi:10.1080/07370024.2017.1312406 · Cited by 251
Riebel, J., Jäger, R. S., & Fischer, U. C. (2009) · Psychology science · Cited by 249
Coping with bullying in the workplace: the effect of gender, age and type of bullying
Jóhannsdóttir, H. L., & Ólafsson, R. F. (2004) · British Journal of Guidance & Counselling · doi:10.1080/03069880410001723549 · Cited by 237
Qiu, L., & Benbasat, I. (2005) · International Journal of Human-Computer Interaction · doi:10.1207/s15327590ijhc1901_6 · Cited by 231
Sometimes it’s hard to be a robot: A call for action on the ethics of abusing artificial agents
Whitby, B. (2008) · Interacting with Computers · doi:10.1016/j.intcom.2008.02.002 · Cited by 176
Fk yea I swear: cursing and gender in MySpace
Thelwall, M. (2008) · Corpora · doi:10.3366/e1749503208000087 · Cited by 164
Verbal aggressiveness: Messages and reasons
Infante, D. A., Riddle, B. L., Horvath, C. L., & Tumlin, S. A. (1992) · Communication Quarterly · doi:10.1080/01463379209369827 · Cited by 160
Gender affordances of conversational agents
Brahnam, S., & De Angeli, A. (2012) · Interacting with Computers · doi:10.1016/j.intcom.2012.05.001 · Cited by 147
Grasmick, H. G., Bursik, R. J., & Kinsey, K. A. (1991) · Environment and Behavior · doi:10.1177/0013916591232006 · Cited by 136
Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media
Hu, T., Xu, A., Liu, Z., You, Q., Guo, Y., Sinha, V., Luo, J., & Akkiraju, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173989 · Cited by 128
Lee, E. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.01.003 · Cited by 119
Precision and Disclosure in Text and Voice Interviews on Smartphones
Schober, M. F., Conrad, F. G., Antoun, C., Ehlen, P., Stefanie, F., Hupp, A. L., Johnston, M. B., Vickers, L., Yan, H. Y., & Zhang, C. (2015) · PLoS ONE · doi:10.1371/journal.pone.0128337 · Cited by 116
Service skills for service workers: emotional intelligence and beyond
Varca, P. E. (2004) · Managing Service Quality · doi:10.1108/09604520410569793 · Cited by 97
Coping with customer aggression
Goussinsky, R. (2012) · Journal of service management · doi:10.1108/09564231211226105 · Cited by 88
Inducing Bystander Interventions During Robot Abuse with Social Mechanisms
Tan, X. Z., Vázquez, M., Carter, E. J., Morales, C. G., & Steinfeld, A. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171247 · Cited by 87
#MeToo Alexa: How Conversational Systems Respond to Sexual Harassment
Cercas Curry, A., & Rieser, V. (2018) · Proceedings of the Second ACL Workshop on Ethics in Natural Language Processing · doi:10.18653/v1/w18-0802 · Cited by 86
Roommate similarity: Are roommates who are similar in their communication traits more satisfied?
Martin, M. M., & Anderson, C. M. (1995) · Communication Research Reports · doi:10.1080/08824099509362038 · Cited by 84
Anderson, C. M., & Martin, M. M. (1999) · Communication Reports · doi:10.1080/08934219909367705 · Cited by 81
Toward a model of members' methods for recognizing interruptions
Murray, S. O. (1985) · Language in Society · doi:10.1017/s0047404500010927 · Cited by 80
Bailey, J. J., & McCollough, M. A. (2000) · Journal of Professional Services Marketing · doi:10.1300/j090v20n02_05 · Cited by 76
Persuasive computing: Feeling peer pressure from multiple computer agents
Xu, K., & Lombard, M. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.04.043 · Cited by 76 · cited 1×
“CAs offer new functionality and convenience, but at the same time, they continuously fall victim to verbal abuse from their users [10, 74].”
BackgroundSingle or Multiple Conversational Agents?: An Interactional Coherence Comparison
Chaves, A. P., & Gerosa, M. A. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173765 · Cited by 71
Martin, M. M., Anderson, C. M., & Horvath, C. L. (1996) · Communication Research Reports · doi:10.1080/08824099609362066 · Cited by 65
Toward Spoken Human–Computer Tutorial Dialogues
D'Mello, S. K., Graesser, A., & King, B. (2010) · Human–Computer Interaction · doi:10.1080/07370024.2010.499850 · Cited by 50
Unfolding the concept of person by verbal abuse
Semin, G. R., & Rubini, M. (1990) · European Journal of Social Psychology · doi:10.1002/ejsp.2420200602 · Cited by 47
Chin, H., & Yi, M. Y. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312826 · Cited by 47
Self-citationMeasuring Interruption: Syntactic and Contextual Methods of Coding Conversation
Okamoto, D. G., Rashotte, L. S., & Smith-Lovin, L. (2002) · Social Psychology Quarterly · doi:10.2307/3090167 · Cited by 40
Words That Hurt: A Qualitative Study of s Parental Verbal Abuse in the Philippines
Loh, J. M. I., Calleja, F. D., & Restubog, S. L. D. (2010) · Journal of Interpersonal Violence · doi:10.1177/0886260510383031 · Cited by 33
Emotions Associated with Verbal Aggression Expression and Suppression
Aloia, L. S., & Solomon, D. H. (2015) · Western Journal of Communication · doi:10.1080/10570314.2014.943428 · Cited by 22
Research works printed but not linked: 21
- 2017. Gartner Says Worldwide Spending on VPA-Enabled Wireless Speakers Will Top 3.5 Billion dollar by 2021. (2017). Retrieved September 19, 2019 from https://gtnr.it/2AfUFOx
- 2018. Siri owns 46% of the mobile voice assistant market - one and half times Google Assistant's share of the market. (2018). Retrieved September 19, 2019 from https://bit.ly/2kswQ0S
- 2018. U.S. Smart Speaker Users Rise to 57 Million. (2018). Retrieved September 19, 2019 from https://bit.ly/2yLhtnV
- Keith H Basso. 1974. Basic conversation rules. Unpublished manuscript (1974).
- Sheryl Brahnam. 2005. Strategies for handling customer abuse of ECAs. Abuse: The darker side of human-computer interaction (2005), 62--67.
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.
- Richard Catrambone, John Stasko, and Jun Xiao. 2004. ECA as user interface paradigm. In From brows to trust. Springer, 239--267.
- Antonella De Angeli and Sheryl Brahnam. 2008. I hate you! Disinhibition with virtual partners. Interacting with computers 20, 3 (2008), 302--310.
- 10.1037/0022-3514.46.4.839 · DOI · Paper page
- 10.1037/1076-8998.7.1.20 · doi:10.1037/1076-8998.7.1.20 · Paper page
- Annie Hogh and Andrea Dofradottir. 2001. Coping with bullying in the workplace. European journal of work and organizational psychology 10, 4 (2001), 485--495.
- Carroll E Izard. 1993. The Differential Emotions Scale: DES IV-A;[a Method of Measuring the Meaning of Subjective Experience of Discrete Emotions]. University of Delaware.
- Nikolas Martelaro, Victoria C Nneji, Wendy Ju, and Pamela Hinds. 2016. Tell me more: Designing hri to encourage more trust, disclosure, and companionship. In The Eleventh ACM/IEEE International Conference on Human Robot Interaction. IEEE Press, 181--188.
- MM Martin and CM Anderson. 1996. Argumentativeness and verbal aggressiveness. Journal of Social Behavior and Personality 11, 3 (1996), 547.
- Ellen A Skinner, Kathleen Edge, Jeffrey Altman, and Hayley Sherwood. 2003. Searching for the structure of coping: a review and critique of category systems for classifying ways of coping. Psychological bulletin 129, 2 (2003), 216.
- Teresa Elizabeth Stone, Margaret McMillan, and Mike Hazelton. 2015. Back to swear one: A review of English language literature on swearing and cursing in Western health settings. Aggression and violent behavior 25 (2015), 65--74.
- Jeffrey Stuewig and June Price Tangney. 2007. Shame and guilt in antisocial and risky behaviors. The self-conscious emotions: Theory and research (2007), 371--388.
- June Price Tangney, Jeffrey Stuewig, and Debra J Mashek. 2007. What's moral about the self-conscious emotions. The self-conscious emotions: Theory and research (2007), 21--37.
- 10.1037/0022-3514.70.4.797 · DOI · Paper page
- Stephen G Tibbetts. 2003. Self-conscious emotions and criminal offending. Psychological reports 93, 1 (2003), 101--126.
- George Veletsianos, Cassandra Scharber, and Aaron Doering. 2008. When sex, drugs, and violence enter the classroom: Conversations between adolescents and a female pedagogical agent. Interacting with computers 20, 3 (2008), 292--301.
Cited by
Chatbots and mental health: Insights into the safety of generative AI
De Freitas, J., Uğuralp, A. K., Oğuz‐Uğuralp, Z., & Puntoni, S. (2024) · Journal of Consumer Psychology · doi:10.1002/jcpy.1393 · Cited by 211
Janson, A. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107954 · Cited by 187
Park, H., Ahn, D., Hosanagar, K., & Lee, J. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445304 · Cited by 116
Complaint De-Escalation Strategies on Social Media
Herhausen, D., Grewal, L. S., Cummings, K. H., Roggeveen, A. L., Ordenes, F. J. V., & Grewal, D. (2022) · Journal of Marketing · doi:10.1177/00222429221119977 · Cited by 106
A Systematic Review of Voice Assistant Usability: An ISO 9241–11 Approach
Dutsinma, F. L. I., Pal, D., Funilkul, S., & Chan, J. (2022) · SN Computer Science · doi:10.1007/s42979-022-01172-3 · Cited by 104
Metadata
- Authors
- Chin, H., Molefi, L. W., & Yi, M. Y.
- Affiliations
- Korea Advanced Institute of Science and Technology (KR)
- Venue
- Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2020-04-21
- Pages
- 1-13
- OpenAlex
- W3030172318
- Semantic Scholar
- e3fd3b1be871da6e048adaef4a4e201af282fe8e
- Cited by
- 96
- References
- 55
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 14 · 2023: 19 · 2022: 21 · 2021: 14 · 2020: 2
- FWCI
- 5.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, verbal abuse, empathy, response styles, insults, threats, swearing, user emotions, guilt, anger, shame, voice interaction, AI misuse, agent design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.