Artificial Intelligence in Conversational Agents: A Study of Factors Related to Perceived Humanness in Chatbots
Open accessThe DOI matches its Crossref record; 55 of the 57 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is gaining traction in service-oriented businesses in the form of chatbots. A chatbot is a popular type of social AI that uses natural language processing to communicate with users. Past studies have shown discrepancies in terms of whether or not a chatbot should communicate and behave like a human. This article aims to explore these discrepancies in order to provide a theoretical contribution of a list of factors related to perceived humanness in chatbots and how these may consequently lead to a positive user experience. The results suggest that a chatbot should have the following characteristics: avoiding small talk and maintaining a formal tone; identifying itself as a bot and asking how it can help; providing specific information and articulating itself with sophisticated choices of words and well-constructed sentences; asking follow-up questions during decision-making processes and; providing an apology when the context is not comprehensible, followed by a question or a statement to dynamically move a conversation forward. These results may have implications for designers working in the field of AI as well as for the wider debates and the broader discourse around the adoption of AI in society.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“many studies suggest that chatbots that can ask on-topic follow-up questions are considered more human-like [67, 94].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [94]
Citations
Cites
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290 · cited 1×
“The term AI was coined in the 1950s, and during this decade Alan Turing published an article which for many scientists marks the birth of AI [17, 51].”
BackgroundComputing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774 · cited 1×
“On one hand, if AI is granted human-equivalent rights and extensive access to decision-making processes, this could lead to AI taking control and consequently result in human beings becoming secondary [28], and this has raised concerns in terms of ethics, transparency and accountability [15, 50].”
BackgroundArtificial intelligence in service
Huang, M.-H., & Rust, R. T. (2018) · Journal of Service Research · doi:10.1177/1094670517752459 · Cited by 3,978
The Uncanny Valley [From the Field]
Mori, M., MacDorman, K., & Kageki, N. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2192811 · Cited by 3,542
Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making
Jarrahi, M. H. (2018) · Business Horizons · doi:10.1016/j.bushor.2018.03.007 · Cited by 2,772
The forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866
What we talk about when we talk about context
Dourish, P. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-003-0253-8 · Cited by 1,529
Bukimi no tani [the uncanny valley]
Mori, M. (1970) · Energy · Cited by 1,485
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Walther, J. B. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2006.05.002 · Cited by 915 · cited 1×
“These factors, in combination with lengthy dialogue, were connected to immediacy and were perceived as an indicator of care [54].”
BackgroundPrinciples and Methods of Development Research
van den Akker, J. (1999) · Design Approaches and Tools in Education and Training · doi:10.1007/978-94-011-4255-7_1 · Cited by 905
Chatbots and the new world of HCI
Følstad, A., & Brandtzæg, P. B. (2017) · Interactions · doi:10.1145/3085558 · Cited by 513
DALE, R. (2016) · Natural Language Engineering · doi:10.1017/s1351324916000243 · Cited by 485
Mori, M. (2020) · The Monster Theory Reader · doi:10.5749/j.ctvtv937f.7 · Cited by 433
Evaluating and Informing the Design of Chatbots
Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196735 · Cited by 376
The media inequality: Comparing the initial human-human and human-AI social interactions
Mou, Y., & Xu, K. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.02.067 · Cited by 328
Social Dialongue with Embodied Conversational Agents
Bickmore, T., & Cassell, J. (2005) · Text, Speech and Language Technology · doi:10.1007/1-4020-3933-6_2 · Cited by 324
Bickmore, T. W., Trinh, H., Olafsson, S., O'Leary, T. K., Asadi, R., Rickles, N. M., & Cruz, R. (2018) · Journal of Medical Internet Research · doi:10.2196/11510 · Cited by 308
The Rise of Bots: A Survey of Conversational Interfaces, Patterns, and Paradigms
Klopfenstein, L. C., Delpriori, S., Malatini, S., & Bogliolo, A. (2017) · Proceedings of the 2017 Conference on Designing Interactive Systems · doi:10.1145/3064663.3064672 · Cited by 252
Lallemand, C., Gronier, G., & Koenig, V. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.048 · Cited by 248
Design research from a curriculum perspective
(2006) · Educational Design Research · doi:10.4324/9780203088364-14 · Cited by 199
Using Health Chatbots for Behavior Change: A Mapping Study
Pereira, J., & Díaz, Ó. (2019) · Journal of Medical Systems · doi:10.1007/s10916-019-1237-1 · Cited by 199 · cited 1×
“The exibility this creates has led to chatbots being used in various elds [2, 48], for instance in customer service [6] (e.g., ChatBot, chatbot.com), libraries [32] (e.g., Pixel, pixel.unl.edu), and health care [42] (e.g., MedWhat, medwhat.com).”
BackgroundA Review of Future and Ethical Perspectives of Robotics and AI
Torresen, J. (2018) · Frontiers in Robotics and AI · doi:10.3389/frobt.2017.00075 · Cited by 180
BDI agents in social simulations: a survey
Adam, C., & Gaudou, B. (2016) · The Knowledge Engineering Review · doi:10.1017/s0269888916000096 · Cited by 165 · cited 1×
“[1, p. 212].”
I'm Sorry, Dave, I'm Afraid I Can't Do That: Chatbot Perception and Expectations
Zamora, J. (2017) · Proceedings of the 5th International Conference on Human Agent Interaction · doi:10.1145/3125739.3125766 · Cited by 164
Artificial intelligence and ambient intelligence
Gams, M., Gu, I. Y., Härmä, A., Muñoz, A., & Tam, V. W. L. (2019) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-180508 · Cited by 142
Skjuve, M., Haugstveit, I. M., Følstad, A., & Brandtzaeg, P. B. (2019) · Human Technology · doi:10.17011/ht/urn.201902201607 · Cited by 138
Designing emotionally sentient agents
McDuff, D., & Czerwinski, M. (2018) · Communications of the ACM · doi:10.1145/3186591 · Cited by 132
Vinciarelli, A., Esposito, A. A., André, E., Bonin, F., Chétouani, M., Cohn, J. F., Cristani, M., Fuhrmann, F., Gilmartin, E., Hammal, Z., et al. (2015) · Cognitive Computation · doi:10.1007/s12559-015-9326-z · Cited by 127
Chang, R. C.-S., Lu, H.-P., & Yang, P. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.02.025 · Cited by 126
15 challenges for AI: Or what AI (currently) can’t do
Hagendorff, T., & Wezel, K. (2020) · AI & SOCIETY · doi:10.1007/s00146-019-00886-y · Cited by 113
Folk Psychology for Human Modelling: Extending the BDI Paradigm
Norling, E. (2004) · Adaptive Agents and Multi-Agents Systems · doi:10.1109/aamas.2004.129 · Cited by 106
Chakrabarti, C., & Luger, G. F. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.04.067 · Cited by 105
Demeure, V., Niewiadomski, R., & Pelachaud, C. (2011) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres_a_00065 · Cited by 102
The Emperor of Strong AI Has No Clothes: Limits to Artificial Intelligence
Braga, A., & Logan, R. (2017) · Information · doi:10.3390/info8040156 · Cited by 101
Review of Chatbots Design Techniques
Akma, N., Hafiz, M., Zainal, A., Fairuz, M., & Adnan, Z. (2018) · International Journal of Computer Applications · doi:10.5120/ijca2018917606 · Cited by 100
Human–computer interaction: A stable discipline, a nascent science, and the growth of the long tail
Dix, A. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.11.007 · Cited by 86
Perceptions on Authenticity in Chat Bots
Neururer, M., Schlögl, S., Brinkschulte, L., & Groth, A. (2018) · Multimodal Technologies and Interaction · doi:10.3390/mti2030060 · Cited by 76
I Believe in a Thing Called Bot: Perceptions of the Humanness of “Chatbots”
Westerman, D., Cross, A. C., & Lindmark, P. G. (2019) · Communication Studies · doi:10.1080/10510974.2018.1557233 · Cited by 76
Chapter 1: Introducing Chatbots in Libraries
McNeal, M. L., & Newyear, D. (2013) · Library Technology Reports · Cited by 69
Passing the Turing Test Does Not Mean the End of Humanity
Warwick, K., & Shah, H. (2016) · Cognitive Computation · doi:10.1007/s12559-015-9372-6 · Cited by 69
A framework for understanding chatbots and their future
Paikari, E., & van der Hoek, A. (2018) · Proceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering · doi:10.1145/3195836.3195859 · Cited by 67
Portela, M., & Granell-Canut, C. (2017) · Proceedings of the XVIII International Conference on Human Computer Interaction · doi:10.1145/3123818.3123826 · Cited by 66
Strait, M., Vujovic, L., Floerke, V., Scheutz, M., & Urry, H. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702415 · Cited by 59
Facilitating Natural Conversational Agent Interactions: Lessons from a Deception Experiment
Schuetzler, R. M., Grimes, G. M., Giboney, J. S., & Buckman, J. R. (2014) · DigitalCommons@UNO · Cited by 53
Perceived Emotional Intelligence in Virtual Agents
Yang, Y., Ma, X., & Fung, P. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3053163 · Cited by 50
Judgment of the Humanness of an Interlocutor Is in the Eye of the Beholder
Lortie, C. L., & Guitton, M. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025085 · Cited by 47
Foulquier, N., Redou, P., Gal, C. L., Rouvière, B., Pers, J., & Saraux, A. (2018) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2018.1475872 · Cited by 31
Mone, G. (2016) · Communications of the ACM · doi:10.1145/2967977 · Cited by 24
Predicting Activism for a Social Cause
Poorisat, T., Boster, F. J., & Salmon, C. T. (2018) · Communication Studies · doi:10.1080/10510974.2018.1504808 · Cited by 17
Rosales, R., Castañón–Puga, M., Lara-Rosano, F. D. J., Evans, R. D., Millán, N. D. C. O., & Flores-Ortiz, M. (2017) · Applied Sciences · doi:10.3390/app7080832 · Cited by 11
Chapter 1: Introducing Chatbots in Libraries
McNeal, M. L., & Newyear, D. (2013) · Library Technology Reports · Cited by 9
Application of the GORITE BDI Framework to Human-Autonomy Teaming: A Case Study
Noorunnisa, S., Jarvis, D., Jarvis, J., & Watson, M. (2019) · Journal of Computing and Information Technology · doi:10.20532/cit.2019.1004396 · Cited by 6
Research works printed but not linked: 9
- Swedish Research Council . 2017. Good research practice. Report . Swedish Research Council . Swedish Research Council. 2017. Good research practice. Report. Swedish Research Council.
- D. Duijst. 2017. Can we improve the user experience of chatbots with personalisation? Thesis. D. Duijst. 2017. Can we improve the user experience of chatbots with personalisation? Thesis.
- J. Hecht . 2018 . Meeting people's expectations. Nature Outlook - Digital Revolution 563 , 7733 (2018), 141--143. J. Hecht. 2018. Meeting people's expectations. Nature Outlook - Digital Revolution 563, 7733 (2018), 141--143.
- Q. V. Liao , M. Hussain , P. Chandar , M. Davis , Y. Khazaen , M. P. Crasso , D. Wang , M. Muller , N. S. Shami , and W. Geyer . 2018. All work and no play? Conversations with a question-and-answer chatbot in the wild . In CHI 2018 . 1--13. Q. V. Liao, M. Hussain, P. Chandar, M. Davis, Y. Khazaen, M. P. Crasso, D. Wang, M. Muller, N. S. Shami, and W. Geyer. 2018. All work and no play? Conversations with a question-and-answer chatbot in the wild. In CHI 2018. 1--13.
- J. McCarthy , M. L. Minsky , N. Rochester , and C. E. Shannon . 1955 /2006. A proposal for the Dartmouth summer research project on artificial intelligence . AI Magazine 27 , 4(1955/2006), 12--14. J. McCarthy, M. L. Minsky, N. Rochester, and C. E. Shannon. 1955/2006. A proposal for the Dartmouth summer research project on artificial intelligence. AI Magazine 27, 4(1955/2006), 12--14.
- M. L. McNeal and D. Newyear . 2013 . Introducing chatbots in libraries . Library Technology Reports 49 , 8 (2013), 5 -- 10 . M. L. McNeal and D. Newyear. 2013. Introducing chatbots in libraries. Library Technology Reports 49, 8 (2013), 5--10.
- K. Panetta . 2017. Gartner top strategic predictions for 2018 and beyond. (2017). Retrieved September 5, 2019 from https://www.gartner.com/smarterwithgartner/gartner-top- strategic-predictions- for- 2018- and-beyond/ K. Panetta. 2017. Gartner top strategic predictions for 2018 and beyond. (2017). Retrieved September 5, 2019 from https://www.gartner.com/smarterwithgartner/gartner-top- strategic-predictions- for- 2018- and-beyond/
- L. Piccolo , M. Mensio , and H. Alani . 2018. Chasing the chatbots: Directions for interaction and design research . In CONVERSATIONS 2018, 5th International Conference on Internet Science. 1--12 . L. Piccolo, M. Mensio, and H. Alani. 2018. Chasing the chatbots: Directions for interaction and design research. In CONVERSATIONS 2018, 5th International Conference on Internet Science. 1--12.
- S. Russell and P. Norvig. 2010. Artificial intelligence: A modern approach. Pearson Upper Saddle River NJ. S. Russell and P. Norvig. 2010. Artificial intelligence: A modern approach. Pearson Upper Saddle River NJ.
Cited by
Rapp, A., Curti, L., & Boldi, A. (2021) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2021.102630 · Cited by 643
Menon, D., & Shilpa, K. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e20962 · Cited by 359
Understanding University Students’ Acceptance of ChatGPT: Insights from the UTAUT2 Model
Grassini, S., Aasen, M. L., & Møgelvang, A. (2024) · Applied Artificial Intelligence · doi:10.1080/08839514.2024.2371168 · Cited by 116
Dual humanness and trust in conversational AI: A person-centered approach
Hu, P., Lu, Y., & Gong, Y. Y. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106727 · Cited by 177
The role of socio-emotional attributes in enhancing human-AI collaboration
Kolomaznik, M., Petrik, V., Slama, M., & Jurik, V. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1369957 · Cited by 103
Metadata
- Authors
- Svenningsson, N., & Faraon, M.
- Affiliations
- Kristianstad University (SE)
- Venue
- Proceedings of the 2019 2nd Artificial Intelligence and Cloud Computing Conference
- Publisher
- ACM
- Published
- 2019-12-21
- Pages
- 151-161
- OpenAlex
- W3008715097
- Cited by
- 56
- References
- 57
- Citations by year
- 2026: 6 · 2025: 10 · 2024: 14 · 2023: 9 · 2022: 6 · 2021: 9 · 2020: 2
- FWCI
- 1.63
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Artificial Intelligence and Cloud Computing Conference (AICCC) (publishedVersion, cc-by)
- Högskolan Kristianstad Publikationer (submittedVersion, other-oa)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, perceived humanness, human-like behavior, user experience, small talk, apology, follow-up questions, social AI, chatbot design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.