The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
In bot we trust: A new methodology of chatbot performance measures
Abstract
Abstract Chatbots are used frequently in business to facilitate various processes, particularly those related to customer service and personalization. In this article, we propose novel methods of tracking human-chatbot interactions and measuring chatbot performance that take into consideration ethical concerns, particularly trust. Our proposed methodology links neuroscientific methods, text mining, and machine learning. We argue that trust is the focal point of successful human-chatbot interaction and assess how trust as a relevant category is being redefined with the advent of deep learning supported chatbots. We propose a novel method of analyzing the content of messages produced in human-chatbot interactions, using the Condor Tribefinder system we developed for text mining that is based on a machine learning classification engine. Our results will help build better social bots for interaction in business or commercial environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Does the chimpanzee have a theory of mind?
Premack, D., & Woodruff, G. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00076512 · Cited by 8,743
Fiske, S. T., Cuddy, A. J. C., Glick, P., & Xu, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.878 · Cited by 7,364
Wimmer, H. (1983) · Cognition · doi:10.1016/0010-0277(83)90004-5 · Cited by 6,305
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452
The Uncanny Valley [From the Field]
Mori, M., MacDorman, K., & Kageki, N. (2012) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2012.2192811 · Cited by 3,542
Kaplan, A., & Haenlein, M. (2019) · Business Horizons · doi:10.1016/j.bushor.2018.08.004 · Cited by 3,140
ELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle
Waytz, A., Heafner, J., & Epley, N. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.01.005 · Cited by 1,439
Feeling and Believing: The Influence of Emotion on Trust.
Dunn, J. R., & Schweitzer, M. E. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.88.5.736 · Cited by 1,301
Tribal marketing: The tribalisation of society and its impact on the conduct of marketing
Cova, B., & Cova, V. (2002) · European Journal of Marketing · doi:10.1108/03090560210423023 · Cited by 888
Cited by
Ashfaq, M., Yun, J., Yu, S., & Loureiro, S. M. C. (2020) · Telematics and Informatics · doi:10.1016/j.tele.2020.101473 · Cited by 987
Rediscovering the use of chatbots in education: A systematic literature review
Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020) · Computer Applications in Engineering Education · doi:10.1002/cae.22326 · Cited by 483
A Literature Survey of Recent Advances in Chatbots
Caldarini, G., Jaf, S., & McGarry, K. (2022) · Information · doi:10.3390/info13010041 · Cited by 470
“[64] The authors argue that trust is at the heart of effective human-chatbot interaction and examine how trust as a meaningful category is being redefined with the introduction of deep learning-enabled chatbots.”
BackgroundChen, J.-S., Le, T.-T.-Y., & Florence, D. (2021) · International Journal of Retail & Distribution Management · doi:10.1108/ijrdm-08-2020-0312 · Cited by 431
Youn, S., & Jin, S. V. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106721 · Cited by 317
Nguyen, D. M., Chiu, Y.-T. H., & Le, H. D. (2021) · Sustainability · doi:10.3390/su13147625 · Cited by 269
“A chatbot, in general, could be understood as AI software that is programmed to automatically communicate with humans via text messages or chats [4].”
BackgroundKushwaha, A. K., Kumar, P., & Kar, A. K. (2021) · Industrial Marketing Management · doi:10.1016/j.indmarman.2021.08.011 · Cited by 258
Antecedents and consequences of chatbot initial trust
Mostafa, R. B., & Kasamani, T. (2022) · European Journal of Marketing · doi:10.1108/ejm-02-2020-0084 · Cited by 256
The impact of chatbots on customer loyalty: a systematic literature review
Jenneboer, L., Herrando, C., & Constantinides, E. (2022) · Journal of Theoretical and Applied Electronic Commerce Research · doi:10.3390/jtaer17010011 · Cited by 249
“[42]; Cheng and Jiang [56]; Nordheim et al.”
BackgroundInfluentialCreepiness: Its antecedents and impact on loyalty when interacting with a chatbot
Rajaobelina, L., Prom Tep, S., Arcand, M., & Ricard, L. (2021) · Psychology & Marketing · doi:10.1002/mar.21548 · Cited by 252
Ledro, C., Nosella, A., & Vinelli, A. (2022) · Journal of Business & Industrial Marketing · doi:10.1108/jbim-07-2021-0332 · Cited by 216
What Makes People Feel Empathy for AI Chatbots? Assessing the Role of Competence and Warmth
Kim, W. B., & Hur, H. J. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2219961 · Cited by 196
Ali, F., Yasar, B., Ali, L., & Dogan, S. (2023) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2023.103588 · Cited by 185
Living and working with service robots: a TCCM analysis and considerations for future research
De Keyser, A., & Kunz, W. H. (2022) · Journal of Service Management · doi:10.1108/josm-12-2021-0488 · Cited by 132
Liu, W., Jiang, M., Li, W., & Mou, J. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123407 · Cited by 98
Interactivity, humanness, and trust: a psychological approach to AI chatbot adoption in e-commerce
Ding, Y., & Najaf, M. (2024) · BMC Psychology · doi:10.1186/s40359-024-02083-z · Cited by 93
Cai, N., Gao, S., & Yan, J. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03212-0 · Cited by 86
Kuhail, M. A., Thomas, J., Alramlawi, S., Shah, S. J. H., & Thornquist, E. (2022) · Informatics · doi:10.3390/informatics9040081 · Cited by 59
AirGPT: Pioneering the convergence of conversational AI with atmospheric science
Song, J., Ma, C., & Ran, M. (2025) · npj Climate and Atmospheric Science · doi:10.1038/s41612-025-01070-4 · Cited by 48
Song, M., Zhu, Y., Xing, X., & Du, J. (2024) · Behaviour & Information Technology · doi:10.1080/0144929x.2023.2285943 · Cited by 49
Murtaza, Z., Sharma, I., & Carbonell, P. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123806 · Cited by 46
Gao, J., Opute, A. P., Jawad, C., & Zhan, M. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115661 · Cited by 36
Students’ Perceptions on Chatbots’ Potential and Design Characteristics in Healthcare Education
Natalia, S., Sokratis, N., Klas, K., Konstantinidis Stathis, T., Bamidis Panagiotis, D., Pattichis Constantinos, S., & Nadia, D. (2020) · Studies in Health Technology and Informatics · doi:10.3233/shti200531 · Cited by 29
Følstad, A., Law, E. L.-C., & van As, N. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3690383 · Cited by 17
Unlocking AI Chatbot Potential in Healthcare: Trust-Enhanced DeLone & McLean IS Success Model
Sarhan, M. Y., Alarify, M., & Khojah, M. (2026) · Healthcare · doi:10.3390/healthcare14101324 · Cited by 2
Metadata
- Authors
- Przegalinska, A., Ciechanowski, L., Stroz, A., Gloor, P., & Mazurek, G.
- Venue
- Business Horizons
- Publisher
- Elsevier BV
- Published
- 2019-11
- Volume
- 62
- Issue
- 6
- Pages
- 785-797
- ISSN
- 0007-6813 (ISSN-L)
- OpenAlex
- W2974124990
- Cited by
- 344
- References
- 54
- FWCI
- 13.24
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.