The DOI matches its Crossref record; 61 of the 62 references it cites were found in a registry or an index.
The impact of chatbot conversational skill on engagement and perceived humanness
Abstract
Conversational agents (CAs)—frequently operationalized as chatbots—are computer systems that leverage natural language processing to engage in conversations with human users. CAs are often operationalized as chatbots which are used for many applications including technical support, customer service, and digital personal assistants. Despite their widespread use, little research to date has investigated how improving the conversational skill of a CA impacts user perceptions of the agent. To elucidate this relationship, this research uses Social Presence Theory to describe how conversational skill influences perceived social presence and ultimately anthropomorphism of a chatbot. We conducted a series of studies in which 450 participants interacted with CAs exhibiting varying levels of conversational skill. We show that people perceive a more skilled CA to be more socially present and anthropomorphic than a less skilled CA. This research advances the knowledge of computer-human interface in information systems, as CA research to date has largely focused on the technical challenges rather than the behavioral questions of how users interact with CAs.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Evidence suggests that a conversational agent's self-disclosure as a computer artefact can efficiently set user expectations by acknowledging its non-human intelligence [64].”
From System and User Strategies to Repair Conversational Breakdowns of Spoken Dialogue Systems: A Scoping Review (2024) · cites this paper as [64]
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
Applying the Technology Acceptance Model and Flow Theory to Online Consumer Behavior
Koufaris, M. (2002) · Information Systems Research · doi:10.1287/isre.13.2.205.83 · Cited by 3,199
Proceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
Toward a More Robust Theory and Measure of Social Presence: Review and Suggested Criteria
Biocca, F., Harms, C., & Burgoon, J. K. (2003) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474603322761270 · Cited by 2,172
Research works printed but not linked: 13
- Enge E., 2018, 2018
- Gnewuch U., Morana, S.; Adam, M.T.P.; and Maedche, A. Faster is not always better: Understanding the effect of dynamic response delays in human-chatbot interaction
- Guadagno R.E., 2007, Media Psychology, 10, 1
- Ijaz K., In Proceedings of the Thirty-Fourth Australasian Computer Science Conference, 107
- Kang, S.H.; Gratch, J.; Wang, N.; and Watt, J.H. Does the Contingency of Agents’ Nonverbal Feedback Affect Users’ Social Anxiety? In Proceedings of the 7th International Conference on Autonomous Agents and Multiagent Systems . Estoril, Portugal, 2008, pp. 120–127.
- Lee T., 2019, Jagannath, K.; Aggarwal, N.; Sridar, R; Wilde, S; Hill, T.; and Chen Y. Intelligent career advisers in your pocket? A need assessment study of chatbots for student career advising
- Reeves B., 2003, and Nass, C. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places
- Rietz T., Wirtschaftsinformatik 2019 Proceedings, 2019
- Rzepka C., and Berger, B. User interaction with AI-enabled systems: A systematic review of IS research. In Proceedings of the 39th International
- Short J., 1976, Williams, E.; and Christie, B. The Social Psychology of Telecommunications
- Tamir P., 1991, Science Education
- Turing A.M., Mind, LIX, 236, 433
- Wang W., Journal of Management Information Systems, 2007
Cited by
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Mariani, M. M., Hashemi, N., & Wirtz, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113838 · Cited by 343
Ma, X., & Huo, Y. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102362 · Cited by 346
Understanding the user satisfaction and loyalty of customer service chatbots
Hsu, C.-L., & Lin, J. C.-C. (2023) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2022.103211 · Cited by 361
Chandra, S., Shirish, A., & Srivastava, S. C. (2022) · Journal of Management Information Systems · doi:10.1080/07421222.2022.2127441 · Cited by 315
“Human-like conversations may encourage users to anthropomorphize AI, helping them forge effective connections with AI tools [111].”
Background
Metadata
- Authors
- Schuetzler, R. M., Grimes, G. M., & Scott Giboney, J.
- Affiliations
- Brigham Young University (US)
- University of Houston (US)
- Brigham Young University, Provo, UT
- Corresponding author
- Schuetzler, Ryan M.
- Venue
- Journal of Management Information Systems
- Publisher
- Informa UK Limited
- Published
- 2020-07-02
- Volume
- 37
- Issue
- 3
- Pages
- 875-900
- ISSN
- 0742-1222 (ISSN-L)
- 1557-928X
- OpenAlex
- W3101433089
- Cited by
- 357
- References
- 62
- Citations by year
- 2026: 90 · 2025: 86 · 2024: 71 · 2023: 53 · 2022: 43 · 2021: 14
- FWCI
- 10.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Management Information Systems (publishedVersion)
- ScholarsArchive (Brigham Young University) (submittedVersion)
- Funders
- Nebraska Research Initiative
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, user engagement, perceived humanness, anthropomorphism, social presence, social presence theory, user perception, human-agent interaction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The impact of chatbot conversational skill on engagement and perceived humanness. https://app.cochat.ai/papers/10.1080/07421222.2020.1790204
- The paper
- Schuetzler, R. M., Grimes, G. M., & Scott Giboney, J. (2020). The impact of chatbot conversational skill on engagement and perceived humanness. Journal of Management Information Systems. https://doi.org/10.1080/07421222.2020.1790204
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.