The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
In the shades of the uncanny valley: An experimental study of human–chatbot interaction
Abstract
This project has been carried out in the context of recent major developments in botics and more widespread usage of virtual agents in personal and professional sphere. The general purpose of the experiment was to thoroughly examine the character of the human–non-human interaction process. Thus, in the paper, we present a study of human–chatbot interaction, focusing on the affective responses of users to different types of interfaces with which they interact. The experiment consisted of two parts: measurement of psychophysiological reactions of chatbot users and a detailed questionnaire that focused on assessing interactions and willingness to collaborate with a bot. In the first quantitative stage, participants interacted with a chatbot, either with a simple text chatbot (control group) or an avatar reading its responses in addition to only presenting them on the screen (experimental group. We gathered the following psychophysiological data from participants: electromyography (EMG), respirometer (RSP), electrocardiography (ECG), and electrodermal activity (EDA). In the last, declarative stage, participants filled out a series of questionnaires related to the experience of interacting with (chat)bots and to the overall human–(chat)bot collaboration assessment. The theory of planned behaviour survey investigated attitude towards cooperation with chatbots in the future. The social presence survey checked how much the chatbot was considered to be a “real” person. The anthropomorphism scale measured the extent to which the chatbot seems humanlike. Our particular focus was on the so-called uncanny valley effect, consisting of the feeling of eeriness and discomfort towards a given medium or technology that frequently appears in various kinds of human–machine interactions. Our results show that participants were experiencing lesser uncanny effects and less negative affect in cooperation with a simpler text chatbot than with the more complex, animated avatar chatbot. The simple chatbot have also induced less intense psychophysiological reactions. Despite major developments in botics, the user’s affective responses towards bots have frequently been neglected. In our view, understanding the user’s side may be crucial for designing better chatbots in the future and, thus, can contribute to advancing the field of human–computer interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.878 · Cited by 7,364
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078
Heart rate variability as an index of regulated emotional responding
Appelhans, B. M., & Luecken, L. J. (2006) · Review of General Psychology · doi:10.1037/1089-2680.10.3.229 · Cited by 1,893
Motivated attention : affect, activation, and action
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997) · Medical Entomology and Zoology · Cited by 1,890
Guidelines for Human Electromyographic Research
Fridlund, A. J., & Cacioppo, J. T. (1986) · Psychophysiology · doi:10.1111/j.1469-8986.1986.tb00676.x · Cited by 1,737
Cited by
Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020) · Telematics and Informatics · doi:10.1016/j.tele.2020.101473 · Cited by 987
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975
Pelau, C., Dabija, D.-C., & Ene, I. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106855 · Cited by 889
Chatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879
Chaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572
“In contrast, designing overly humanized agents results in uncanny feelings and increased expectations (Ciechanowski et al., 2018; Gnewuch et al., 2017), which also negatively impacts the interaction.”
BackgroundInfluentialRediscovering the use of chatbots in education: A systematic literature review
Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22326 · Cited by 483
Chatbots in retailers’ customer communication: How to measure their acceptance?
Rese, A., Ganster, L., & Baier, D. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2020.102176 · Cited by 412
Predicting the intentions to use chatbots for travel and tourism
Melián-González, S., Gutiérrez-Taño, D., & Bulchand-Gidumal, J. (2021) · Current Issues in Tourism · doi:10.1080/13683500.2019.1706457 · Cited by 406
How perceptions of intelligence and anthropomorphism affect adoption of personal intelligent agents
Moussawi, S., Koufaris, M., & Benbunan-Fich, R. (2021) · Electronic Markets · doi:10.1007/s12525-020-00411-w · Cited by 406
Jiang, H., Cheng, Y., Yang, J., & Gao, S. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107329 · Cited by 362
In bot we trust: A new methodology of chatbot performance measures
Przegalinska, A., Ciechanowski, L., Stroz, A., Gloor, P., & Mazurek, G. (2019) · Business Horizons · doi:10.1016/j.bushor.2019.08.005 · Cited by 344
Self-citationSowa, K., Przegalinska, A., & Ciechanowski, L. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.11.038 · Cited by 326
Self-citationPersonalized mobile marketing strategies
Tong, S., Luo, X., & Xu, B. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00693-3 · Cited by 322
Youn, S., & Jin, S. V. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106721 · Cited by 317
Cheng, X., Bao, Y., Zarifis, A., Gong, W., & Mou, J. (2022) · Internet Research · doi:10.1108/intr-08-2020-0460 · Cited by 300
Yen, C., & Chiang, M.-C. (2021) · Behaviour & Information Technology · doi:10.1080/0144929x.2020.1743362 · Cited by 297
What makes you continuously use chatbot services? Evidence from chinese online travel agencies
Li, L., Lee, K. Y., Emokpae, E., & Yang, S.-B. (2021) · Electronic Markets · doi:10.1007/s12525-020-00454-z · Cited by 289
The Perception by University Students of the Use of ChatGPT in Education
Ngo, T. T. A. (2023) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v18i17.39019 · Cited by 285
Castillo, D., Canhoto, A. I., & Said, E. (2021) · The Service Industries Journal · doi:10.1080/02642069.2020.1787993 · Cited by 274
Nguyen, D. M., Chiu, Y.-T. H., & Le, H. D. (2021) · Sustainability · doi:10.3390/su13147625 · Cited by 269
Millennials' Attitude toward Chatbots: An Experimental Study in a Social Relationship Perspective
De Cicco, R., Silva, S. C., & Alparone, F. R. (2020) · International Journal of Retail & Distribution Management · doi:10.1108/ijrdm-12-2019-0406 · Cited by 258
Antecedents and consequences of chatbot initial trust
Mostafa, R. B., & Kasamani, T. (2022) · European Journal of Marketing · doi:10.1108/ejm-02-2020-0084 · Cited by 256
Creepiness: Its antecedents and impact on loyalty when interacting with a chatbot
Rajaobelina, L., Prom Tep, S., Arcand, M., & Ricard, L. (2021) · Psychology & Marketing · doi:10.1002/mar.21548 · Cited by 252
Future directions for chatbot research: An interdisciplinary research agenda
Følstad, A., Araujo, T., Law, E. L.-C., Brandtzaeg, P. B., Papadopoulos, S., Reis, L., Baez, M., Laban, G., McAllister, P., Ischen, C., et al. (2021) · Computing · doi:10.1007/s00607-021-01016-7 · Cited by 247
AI-chatbots on the services frontline addressing the challenges and opportunities of agency
Chong, T., Yu, T., Keeling, D. I., & de Ruyter, K. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102735 · Cited by 245
Song, S. W., & Shin, M. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2121038 · Cited by 244
The effect of social presence and chatbot errors on trust
Toader, D.-C., Boca, G., Toader, R., Măcelaru, M., Toader, C., Ighian, D., & Rădulescu, A. T. (2019) · Sustainability · doi:10.3390/su12010256 · Cited by 233
Lee, S., Lee, N., & Sah, Y. J. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2019.1699748 · Cited by 204
Texting with Humanlike Conversational Agents: Designing for Anthropomorphism
Seeger, A.-M., University of Mannheim, G., Pfeiffer, J., Justus Liebig University Giessen, G., Heinzl, A., & University of Mannheim, G. (2021) · Journal of the Association for Information Systems · doi:10.17705/1jais.00685 · Cited by 200
All hype or the real deal? Investigating user engagement with virtual influencers in tourism
Xie-Carson, L., Magor, T., Benckendorff, P., & Hughes, K. (2023) · Tourism Management · doi:10.1016/j.tourman.2023.104779 · Cited by 195
Janson, A. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107954 · Cited by 187
Kumar, J. A. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00302-w · Cited by 183
Li, T., Ji, Y., & Zhan, Z. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2024.2305163 · Cited by 133
Privacy and smart speakers: A multi-dimensional approach
Lutz, C., & Newlands, G. (2021) · The Information Society · doi:10.1080/01972243.2021.1897914 · Cited by 123
Huang, D., Markovitch, D. G., & Stough, R. A. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2023.103600 · Cited by 125
Wang, Q., Saha, K., Gregori, E., Joyner, D., & Goel, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445645 · Cited by 120
Chatbot ads with a human touch: A test of anthropomorphism, interactivity, and narrativity
Sun, Y., Chen, J., & Sundar, S. S. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114403 · Cited by 115
Empathy Is All You Need: How a Conversational Agent Should Respond to Verbal Abuse
Chin, H., Molefi, L. W., & Yi, M. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376461 · Cited by 96
Is chatting with a sophisticated chatbot as good as chatting online or FTF with a stranger?
Drouin, M., Sprecher, S., Nicola, R., & Perkins, T. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.107100 · Cited by 75
Assessing the Benefits of ChatGPT for Business: An Empirical Study on Organizational Performance
Chu, M.-N. (2023) · IEEE Access · doi:10.1109/access.2023.3297447 · Cited by 69
Lin, M. P.-C., & Chang, D. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100167 · Cited by 69
Robotic Telemedicine for Mental Health: A Multimodal Approach to Improve Human-Robot Engagement
Lima, M. R., Wairagkar, M., Natarajan, N., Vaitheswaran, S., & Vaidyanathan, R. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.618866 · Cited by 64
Khan, M. I., Fatima, J. K., Bahmannia, S., Chatrath, S. K., Dale, N. F., & Johns, R. (2025) · Journal of Service Theory and Practice · doi:10.1108/jstp-10-2023-0282 · Cited by 43
Kocielnik, R., Langevin, R., George, J. S., Akenaga, S., Wang, A., Jones, D. P., Argyle, A., Fockele, C., Anderson, L., Hsieh, D. T., et al. (2021) · CUI 2021 - 3rd Conference on Conversational User Interfaces · doi:10.1145/3469595.3469599 · Cited by 37
Klein, S. H. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-05618-w · Cited by 36
Deng, Z., & Yan, J. (2025) · SAGE Open · doi:10.1177/21582440251365438 · Cited by 29
Guingrich, R. E., & Graziano, M. S. A. (2025) · Oxford Intersections: AI in Society · doi:10.1093/9780198945215.003.0011 · Cited by 28
Driving human–robot value co-creation in hospitality: the role of artificial empathy
Zhu, T., Xie, L., & Liu, C. (2025) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2024.104075 · Cited by 27
The potential scope of a humanoid robot in anatomy education: a review of a unique proposal
Asghar, A., Patra, A., & Ravi, K. S. (2022) · Surgical and Radiologic Anatomy · doi:10.1007/s00276-022-03020-8 · Cited by 23
Israfilzade, K. (2021) · JOURNAL OF LIFE ECONOMICS · doi:10.15637/jlecon.8.4.12 · Cited by 23
Voice Assistant Use in Long-Term Care
Oewel, B., Ammari, T., & Brewer, R. N. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3597135 · Cited by 23
Guingrich, R. E., & Graziano, M. S. A. (2023) · arXiv · doi:10.48550/arxiv.2311.10599 · Cited by 21
New Automation for Social Bots: From Trivial Behavior to AI-Powered Communication
Grimme, C., Pohl, J., Cresci, S., Lüling, R., & Preuss, M. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-18253-2_6 · Cited by 19
Chen, X., Bear, E., Hui, B., Santhi-Ponnusamy, H., & Meurers, D. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-11647-6_120 · Cited by 18
Influence of Rapport and Social Presence with an Ai Psychotherapy Chatbot on Users’ Self-Disclosure
Lee, J., Lee, J.-G., & Lee, D. (2022) · doi:10.2139/ssrn.4063508 · Cited by 127
Understanding the Continuance Intention to Use Chatbot Services
Kim, J., Li, Y., & Choi, J. (2023) · Asia Marketing Journal · doi:10.53728/2765-6500.1613 · Cited by 8
L’italiano delle intelligenze artificiali generative
Cicero, F. (2023) · Italiano LinguaDue · doi:10.54103/2037-3597/21990 · Cited by 5
Examining Humanized Bot Interaction for the Retail Revenue Growth
Kumar, N., Garg, P., Gupta, N., & Upreti, K. (2026) · Journal of Revenue and Pricing Management · doi:10.1057/s41272-025-00549-2 · Cited by 3
From Letters to LINE to AI: Reframing Organizational Communication Norms in the Digital Era
Lee, G. Y. C., & Luarn, P. (2026) · International Journal of Business Communication · doi:10.1177/23294884261415593 · Cited by 1
Metadata
- Authors
- Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P.
- Venue
- Future Generation Computer Systems
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 92
- Pages
- 539-548
- ISSN
- 0167-739X (ISSN-L)
- OpenAlex
- W2792467893
- Cited by
- 651
- References
- 50
- FWCI
- 54.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.