The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
In the shades of the uncanny valley: An experimental study of human–chatbot interaction
Abstract
Abstract This project has been carried out in the context of recent major developments in botics and more widespread usage of virtual agents in personal and professional sphere. The general purpose of the experiment was to thoroughly examine the character of the human–non-human interaction process. Thus, in the paper, we present a study of human–chatbot interaction, focusing on the affective responses of users to different types of interfaces with which they interact. The experiment consisted of two parts: measurement of psychophysiological reactions of chatbot users and a detailed questionnaire that focused on assessing interactions and willingness to collaborate with a bot. In the first quantitative stage, participants interacted with a chatbot, either with a simple text chatbot (control group) or an avatar reading its responses in addition to only presenting them on the screen (experimental group. We gathered the following psychophysiological data from participants: electromyography (EMG), respirometer (RSP), electrocardiography (ECG), and electrodermal activity (EDA). In the last, declarative stage, participants filled out a series of questionnaires related to the experience of interacting with (chat)bots and to the overall human–(chat)bot collaboration assessment. The theory of planned behaviour survey investigated attitude towards cooperation with chatbots in the future. The social presence survey checked how much the chatbot was considered to be a “real” person. The anthropomorphism scale measured the extent to which the chatbot seems humanlike. Our particular focus was on the so-called uncanny valley effect, consisting of the feeling of eeriness and discomfort towards a given medium or technology that frequently appears in various kinds of human–machine interactions. Our results show that participants were experiencing lesser uncanny effects and less negative affect in cooperation with a simpler text chatbot than with the more complex, animated avatar chatbot. The simple chatbot have also induced less intense psychophysiological reactions. Despite major developments in botics, the user’s affective responses towards bots have frequently been neglected. In our view, understanding the user’s side may be crucial for designing better chatbots in the future and, thus, can contribute to advancing the field of human–computer interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.878 · Cited by 7,364
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
A survey of socially interactive robots
Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00372-x · Cited by 3,162
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Mauss, I. B., & Robinson, M. D. (2009) · Cognition and Emotion · doi:10.1080/02699930802204677 · Cited by 2,078
Heart rate variability as an index of regulated emotional responding
Appelhans, B. M., & Luecken, L. J. (2006) · Review of General Psychology · doi:10.1037/1089-2680.10.3.229 · Cited by 1,893
Guidelines for Human Electromyographic Research
Fridlund, A. J., & Cacioppo, J. T. (1986) · Psychophysiology · doi:10.1111/j.1469-8986.1986.tb00676.x · Cited by 1,737
Motivated attention : affect, activation, and action
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997) · Medical Entomology and Zoology · Cited by 1,488
Bukimi no tani [the uncanny valley]
Mori, M. (1970) · Energy · Cited by 1,485
Decety, J., & Lamm, C. (2007) · The Neuroscientist · doi:10.1177/1073858407304654 · Cited by 1,044
Why Psychologists Should by Default Use Welch’s t-test Instead of Student’s t-test
Delacre, M., Lakens, D., & Leys, C. (2017) · International Review of Social Psychology · doi:10.5334/irsp.82 · Cited by 1,037
Hill, J., Randolph Ford, W., & Farreras, I. G. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.026 · Cited by 856
Cacioppo, J. T., Petty, R. E., Losch, M. E., & Kim, H. S. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.50.2.260 · Cited by 800
Measuring Emotion: Behavior, Feeling, and Physiology
Bradley, M. M., & Lang, P. J. (1999) · Cognitive Neuroscience of Emotion · doi:10.1093/oso/9780195118889.003.0011 · Cited by 736
Computer Power and Human Reason: From Judgement to Calculation.
Crowther, J. F., & Weizenbaum, J. (1977) · Contemporary Sociology · doi:10.2307/2062802 · Cited by 722
The uncanny advantage of using androids in cognitive and social science research
MacDorman, K. F., & Ishiguro, H. (2006) · Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.7.3.03mac · Cited by 651
The Cognitive Neuroscience of Emotion
Watt, D. F. (2001) · Neuropsychoanalysis · doi:10.1080/15294145.2001.10773346 · Cited by 608
The Uncanny Valley: Effect of Realism on the Impression of Artificial Human Faces
Seyama, J., & Nagayama, R. S. (2007) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.16.4.337 · Cited by 580
Experimentation in software engineering
Basili, V. R., Selby, R. W., & Hutchens, D. H. (1986) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1986.6312975 · Cited by 553
Survey on Chatbot Design Techniques in Speech Conversation Systems
A., S., & John, D. (2015) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2015.060712 · Cited by 479
Walters, M. L., Syrdal, D. S., Dautenhahn, K., te Boekhorst, R., & Koay, K. L. (2008) · Autonomous Robots · doi:10.1007/s10514-007-9058-3 · Cited by 449
Computer Power And Human Reason: From Judgement To Calculation
Weizenbaum, J. (1991) · Cumulative Index of Computer Aided Architectural Design · Cited by 403
Interpersonal body and neural synchronization as a marker of implicit social interaction
Yun, K., Watanabe, K., & Shimojo, S. (2012) · Scientific Reports · doi:10.1038/srep00959 · Cited by 379
Planning and Understanding: A Computational Approach to Human Reasoning
Wilensky, R. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 353
"Hey Google is it OK if I eat you?": Initial Explorations in Child-Agent Interaction
Druga, S., Williams, R., Breazeal, C., & Resnick, M. (2017) · Proceedings of the 2017 Conference on Interaction Design and Children · doi:10.1145/3078072.3084330 · Cited by 330
Modelling event-related skin conductance responses
Bach, D. R., Flandin, G., Friston, K. J., & Dolan, R. J. (2010) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2010.01.005 · Cited by 215
Kacprzyk, J., & Zadrozny, S. (2010) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2010.2040480 · Cited by 184
Genome-Wide Association Study Reveals Multiple Loci Influencing Normal Human Facial Morphology
Shaffer, J. R., Orlova, E., Lee, M. K., Leslie, E. J., Raffensperger, Z. D., Heike, C. L., Cunningham, M. L., Hecht, J. T., Kau, C. H., Nidey, N. L., et al. (2016) · PLOS Genetics · doi:10.1371/journal.pgen.1006149 · Cited by 172
Schrammel, F., Pannasch, S., Graupner, S., Mojzisch, A., & Velichkovsky, B. M. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00831.x · Cited by 154
Boucher, J.-D., Pattacini, U., Lelong, A., Bailly, G., Elisei, F., Fagel, S., Dominey, P. F., & Ventre‐Dominey, J. (2012) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2012.00003 · Cited by 151
Graphical multiscale Web histories
Hightower, R. R., Ring, L. T., Helfman, J. I., et al. (1998) · doi:10.1145/276627.276634 · Cited by 136
Androids as an Experimental Apparatus: Why Is There an Uncanny Valley and Can We Exploit It?
MacDorman, K. F. (2005) · Cited by 131
Corrugator activity confirms immediate negative affect in surprise
Topolinski, S., & Strack, F. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00134 · Cited by 114
‘Realness’ in Chatbots: Establishing Quantifiable Criteria
Morrissey, K., & Kirakowski, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39330-3_10 · Cited by 86
Assessing Human Likeness by Eye Contact in an Android Testbed
Cowley, S. J., Ishiguro, H., Itakura, S., MacDorman, K. F., Minato, T., & Shimada, M. (2005) · eScholarship (California Digital Library) · Cited by 78
Arousal, valence, and the uncanny valley: psychophysiological and self-report findings
Cheetham, M., Wu, L., Pauli, P., & Jäncke, L. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00981 · Cited by 67
Analysis of User Interaction with Service Oriented Chatbot Systems
Jenkins, M.-C., Churchill, R., Cox, S. J., & Smith, D. J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73110-8_9 · Cited by 66
Bridging the Mechanical and the Human Mind: Spontaneous Mimicry of a Physically Present Android
Hofree, G., Ruvolo, P., Bartlett, M. S., & Winkielman, P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099934 · Cited by 66
(1999) · Springer eBooks · doi:10.1007/978-1-4757-5687-6 · Cited by 66
Computer Power and Human Reason: From Judgment to Calculation
Weizenbaum, J., & McCarthy, J. (1977) · Physics Today · doi:10.1063/1.3037375 · Cited by 62
CONVERSE: a Conversational Companion
Batacharia, B., Levy, D., Catizone, R., Krotov, A., & Wilks, Y. A. (1999) · Springer eBooks · doi:10.1007/978-1-4757-5687-6_17 · Cited by 52
Polish Version of the Negative Attitude Toward Robots Scale (NARS-PL)
Pochwatko, G., Giger, J., Różańska-Walczuk, M., Świdrak, J., Kukiełka, K., Możaryn, J., & Piçarra, N. J. G. (2015) · Journal of Automation Mobile Robotics & Intelligent Systems · doi:10.14313/jamris_3-2015/25 · Cited by 50
Kordik, A., Eska, K., & Schultheiss, O. C. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2012.05.006 · Cited by 45
Corti, K., & Gillespie, A. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00634 · Cited by 28
The Body That Speaks: Recombining Bodies and Speech Sources in Unscripted Face-to-Face Communication
Gillespie, A., & Corti, K. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01300 · Cited by 11
Brain Imaging Investigation of the Neural Correlates of Observing Virtual Social Interactions
Sung, K., Dolcos, S. M., Flor-Henry, S., Zhou, C., Gasior, C., Argo, J., & Dolcos, F. (2011) · Journal of Visualized Experiments · doi:10.3791/2379 · Cited by 10
Social Interaction in Robotic Agents Emulating the Mirror Neuron Function
Barakova, E. I. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73055-2_41 · Cited by 4
Cited by
Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020) · Telematics and Informatics · doi:10.1016/j.tele.2020.101473 · Cited by 987
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975
Pelau, C., Dabija, D.-C., & Ene, I. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106855 · Cited by 889
Chatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879
Chaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572
Metadata
- Authors
- Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P.
- Venue
- Future Generation Computer Systems
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 92
- Pages
- 539-548
- ISSN
- 0167-739X (ISSN-L)
- OpenAlex
- W2792467893
- Cited by
- 651
- References
- 50
- FWCI
- 54.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.