Immunizing with information – Inoculation messages against conversational agents’ response failures
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Conversational agents (CAs) are often unable to provide meaningful responses to user requests, thereby triggering user resistance and impairing the successful diffusion of CAs. Literature mostly focuses on improving CA responses but fails to address user resistance in the event of further response failures. Drawing on inoculation theory and the elaboration likelihood model, we examine how inoculation messages, as communication that seeks to prepare users for a possible response failure, can be used as an alleviation mechanism. We conducted a randomized experiment with 558 users, investigating how the performance level (high or low) and the linguistic form of the performance information (qualitative or quantitative) affected users’ decision to discontinue CA usage after a response failure. We found that inoculation messages indicating a low performance level alleviate the negative effects of CA response failures on discontinuance. However, quantitative performance level information exhibits this moderating effect on users’ central processing, while qualitative performance level information affected users’ peripheral processing. Extending studies that primarily discuss ex-post strategies, our results provide meaningful insights for practitioners.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dual-Process Theories of Higher Cognition: Advancing the Debate
Evans, J. S. B. T., & Stanovich, K. E. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691612460685 · Cited by 4,271
Agarwal, R., & Prasad, J. (1998) · Information Systems Research · doi:10.1287/isre.9.2.204 · Cited by 3,575
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957 · cited 1×
“Prolific has been found to produce high-quality data in terms of participants’ attention, reliability and reproducibility (Peer et al., 2017).”
BackgroundInfluence Processes for Information Technology Acceptance: An Elaboration Likelihood Model1
Bhattacherjee, A., & Sanford, C. (2006) · MIS Quarterly · doi:10.2307/25148755 · Cited by 1,398 · cited 1×
“According to the ELM, the route of information processing is determined by the elaboration likelihood, which is a temporal state that is influenced by an individual’s cognitive ability and motivation to evaluate the key merits of a focal object (Bhattacherjee & Sanford, 2006).”
MethodAI-based chatbots in customer service and their effects on user compliance
Adam, M., Wessel, M., & Benlian, A. (2021) · Electronic Markets · doi:10.1007/s12525-020-00414-7 · Cited by 1,195 · cited 8×
“We chose digital banking because it has been used as a generalizable case in previous IS research on, for example, automation and recommendation systems (Kim et al., 2018) and compliance with CAs (Adam et al., 2021).”
BackgroundMethodInfluentialLuger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176 · cited 3×
“Often CA response failures lead to an immediate discontinuance of CA usage, giving the system no chance “to make it up” to the user (Ben Mimoun et al., 2012; Luger & Sellen, 2016).”
BackgroundAraujo, T. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.03.051 · Cited by 1,156
Bergen, M., Dutta, S., & Walker, O. C. (1992) · Journal of Marketing · doi:10.1177/002224299205600301 · Cited by 1,105 · cited 1×
“Delegation manifests an agency relationship, as the CA takes responsibility from the users (Bergen et al., 1992).”
BackgroundKim, D. J., Ferrin, D. L., & Rao, H. R. (2009) · Information Systems Research · doi:10.1287/isre.1080.0188 · Cited by 990 · cited 2×
“A system is instrumental to users if they perceive its performance as good and if they believe that continued use will lead to future gains in utility (Kim et al., 2009).”
BackgroundMethodVenkatesh, V., Thong, J. Y. L., Chan, F. K. Y., Hu, P. J.-H., & Brown, S. A. (2011) · Information Systems Journal · doi:10.1111/j.1365-2575.2011.00373.x · Cited by 852
Qiu, L., & Benbasat, I. (2009) · Journal of Management Information Systems · doi:10.2753/mis0742-1222250405 · Cited by 737
Tam, K. Y., & Ho, S. Y. (2006) · MIS Quarterly · doi:10.2307/25148757 · Cited by 609 · cited 1×
“To understand how users process technology-mediated information IS researchers have frequently applied the elaboration likelihood model (ELM), making it a well-established model of informational influence (Sussman & Siegal, 2003; Tam and Ho 2006).”
MethodA Meta-Analysis of Research on Inoculation Theory
Banas, J. A., & Rains, S. A. (2010) · Communication Monographs · doi:10.1080/03637751003758193 · Cited by 510 · cited 1×
“While being largely neglected in IS research, inoculation messages have been successfully applied to areas such as health, politics and marketing, spanning decades of theoretical and empirical (laboratory and field) research (Banas & Rains, 2010; Compton, 2012).”
BackgroundAI-Based Digital Assistants: Opportunities, Threats, and Research Perspectives
Maedche, A., Legner, C., Benlian, A., Berger, B., Gimpel, H., Hess, T., Hinz, O., Morana, S., & Söllner, M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00600-8 · Cited by 432 · cited 2×
“…a high level of social presence through anthropomorphism (Ben Mimoun et al., 2012) 1 , defined as “the attribution of human-like (physical or non-physical) features, behaviors, emotions, characteristics, and attributes to a non-human agent or an inanimate object” (Maedche et al., 2019, p. 538).”
BackgroundLee, S., & Choi, J. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.02.005 · Cited by 388 · cited 1×
“CA technology has seen much improvements over the past decade (Keyser et al., 2019), with positive results, such as service satisfaction (Diederich et al., 2019d) and enjoyment (Lee & Choi, 2017), but response failures remain an ongoing issue for CA acceptance (Følstad & Brandtzæg, 2017).”
BackgroundThe Very Efficient Assessment of Need for Cognition: Developing a Six-Item Version
Lins de Holanda Coelho, G., H. P. Hanel, P., & J. Wolf, L. (2020) · Assessment · doi:10.1177/1073191118793208 · Cited by 358 · cited 2×
“…propensity to trust (Cheung & Lee, 2002; Hampton-Sosa & Koufaris, 2005), personal inno-vativeness (Agarwal and Prasad 1998), need for cognition (Coelho et al., 2018), user’s expertise (Tauchert & Mesbah, 2019), and participants’ perceived degree of realism of the CA usage (Adam et al., 2021)…”
BackgroundPizzi, G., Scarpi, D., & Pantano, E. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.11.006 · Cited by 265
Wang, W., & Benbasat, I. (2008) · Journal of Management Information Systems · doi:10.2753/mis0742-1222240410 · Cited by 241 · cited 1×
“However, users can still be influenced by a qualitative linguistic form, as the mere presence of meaningful information or explanations about the causes of a certain event can signal the provider’s competence to users (Komiak et al., 2004; Wang & Benbasat, 2008).”
BackgroundResilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
Ashktorab, Z., Jain, M., Liao, Q. V., & Weisz, J. D. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300484 · Cited by 224 · cited 4×
“Secondly, those studies that address CA response failures focus on ex-post alleviation mechanisms, thus not providing opportunities to preemptively address users so that they will continuing using the CA after a response failure (Ashktorab et al., 2019; Følstad & Taylor, 2020; Lee et al., 2010; Medhi Thies et al. 2017…”
BackgroundResultInfluentialCompton, J. (2012) · The SAGE Handbook of Persuasion: Developments in Theory and Practice · doi:10.4135/9781452218410.n14 · Cited by 158
Case study—Embodied virtual agents: An analysis on reasons for failure
Ben Mimoun, M. S., Poncin, I., & Garnier, M. (2012) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2012.07.006 · Cited by 136 · cited 5×
“Often CA response failures lead to an immediate discontinuance of CA usage, giving the system no chance “to make it up” to the user (Ben Mimoun et al., 2012; Luger & Sellen, 2016).”
BackgroundInfluentialTowards a Decomposed Expectation-Confirmation Model of IT Continuance: The Role of Usability
University of Turku, Islam, A. K. M. N., Mäntymäki, M., University of Turku, Bhattacherjee, A., & University of South Florida (2017) · Communications of the Association for Information Systems · doi:10.17705/1cais.04023 · Cited by 46 · cited 1×
“The instrumentality of system use is an important reason why individuals continue their usage of a system (Islam et al., 2017).”
BackgroundUniversity of Göttingen, Diederich, S., Lembcke, T.-B., University of Göttingen, Brendel, A. B., Dresden, T., Kolbe, L. M., & University of Göttingen (2021) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00143 · Cited by 40
Teubner, T., Hawlitschek, F., & Adam, M. T. P. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-018-00574-z · Cited by 31 · cited 1×
“Like a growing number of IS papers, we recruited participants from the crowdsourcing platform Prolific Academic (e.g., Adjerid et al., 2018; Betzing et al., 2020; Teubner et al., 2019).”
BackgroundThe intuitive use of contextual information in decisions made with verbal and numerical quantifiers
Liu, D., Juanchich, M., Sirota, M., & Orbell, S. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820903439 · Cited by 15
Cited by
Mariani, M. M., Hashemi, N., & Wirtz, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113838 · Cited by 343
Seeking empathy or suggesting a solution? Effects of chatbot messages on service failure recovery
Haupt, M., Rozumowski, A., Freidank, J., & Haas, A. (2023) · Electronic Markets · doi:10.1007/s12525-023-00673-0 · Cited by 57
“Moreover, the solution message indicates that the chatbot is aware of the linguistic complexity of user input and of options to improve the quality of the chatbot’s answer (Weiler et al., 2022).”
BackgroundMethodInfluentialAI apology: a critical review of apology in AI systems
Harland, H., Dazeley, R., Senaratne, H., Vamplew, P., Cruz, F., & Nakisa, B. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11305-8 · Cited by 19
Gnewuch, U., & Reinkemeier, F. (2026) · MIS Quarterly · doi:10.25300/misq/2025/18742 · Cited by 5
Explainability in AI: Comparing Human-Like and System-Like Trust Repair Strategies
Konopka, B., & Wiesche, M. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10751-1 · Cited by 1
Metadata
- Authors
- Weiler, S., Matt, C., & Hess, T.
- Venue
- Electronic Markets
- Published
- 2021-12-22
- Volume
- 32
- Issue
- 1
- Pages
- 239-258
- ISSN
- 1019-6781 (ISSN-L)
- 1422-8890
- OpenAlex
- W4200355001
- Cited by
- 40
- References
- 25
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.