Evaluating and Informing the Design of Chatbots
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Text messaging-based conversational agents (CAs), popularly called chatbots, received significant attention in the last two years. However, chatbots are still in their nascent stage: They have a low penetration rate as 84% of the Internet users have not used a chatbot yet. Hence, understanding the usage patterns of first-time users can potentially inform and guide the design of future chatbots. In this paper, we report the findings of a study with 16 first-time chatbot users interacting with eight chatbots over multiple sessions on the Facebook Messenger platform. Analysis of chat logs and user interviews revealed that users preferred chatbots that provided either a 'human-like' natural language conversation ability, or an engaging experience that exploited the benefits of the familiar turn-based messaging interface. We conclude with implications to evolve the design of chatbots, such as: clarify chatbot capabilities, sustain conversation context, handle dialog failures, and end conversations gracefully.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous studies have suggested that chatbots should aim to sustain contexts to improve the dialogue efficiency [37].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [37]
In the citing paper
“There is also a growing base of research to inform design of chatbot interactions, whether this concerns conversational design [6], personalization of chatbots [69], the use of interactive elements in chatbots [57], or the use of social cues to indicate social status and capabilities [32].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [57]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Norman, D. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,374
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first chatbot emerged in 1966 from MIT, called ELIZA [44], which emulated a Rogerian psychotherapist.”
BackgroundELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Licklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems
Wen, T.-H., Gasic, M., Mrkšić, N., Su, P.-H., Vandyke, D., & Young, S. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1199 · Cited by 874
A diary study of task switching and interruptions
Czerwinski, M., Horvitz, E., & Wilhite, S. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985715 · Cited by 830
Research works printed but not linked: 16
- 2002. A.L.I.C. E. Foundation website. (2002). Retrieved January 4, 2017 from http://alicebot.org 2002. A.L.I.C.E. Foundation website. (2002). Retrieved January 4, 2017 from http://alicebot.org
- 2013. Mitsuku. ( 2013 ). Retrieved January 4, 2017 from http://www.mitsuku.com 2013. Mitsuku. (2013). Retrieved January 4, 2017 from http://www.mitsuku.com
- 2013. Rose. ( 2013 ). Retrieved January 4, 2017 from http://brilligunderstanding.com/rosedemo.html 2013. Rose. (2013). Retrieved January 4, 2017 from http://brilligunderstanding.com/rosedemo.html
- 2016. Facebook Messenger bots. (2016). Retrieved Dec 1, 2016 from https://chatbottle.co/bots/messenger 2016. Facebook Messenger bots. (2016). Retrieved Dec 1, 2016 from https://chatbottle.co/bots/messenger
- 2017. Facebook Messenger Alterra. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/alterra.cc 2017. Facebook Messenger Alterra. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/alterra.cc
- 2017. Facebook Messenger Call of Duty. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/CallofDuty 2017. Facebook Messenger Call of Duty. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/CallofDuty
- 2017. Facebook Messenger chatShopper. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/chatShopper 2017. Facebook Messenger chatShopper. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/chatShopper
- 2017. Facebook Messenger CNN. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/cnn 2017. Facebook Messenger CNN. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/cnn
- 2017. Facebook Messenger Hi Poncho. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/hiponcho 2017. Facebook Messenger Hi Poncho. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/hiponcho
- 2017. Facebook Messenger Pandorabots. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/chatbots.io 2017. Facebook Messenger Pandorabots. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/chatbots.io
- 2017. Facebook Messenger Swelly. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/swell.bot 2017. Facebook Messenger Swelly. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/swell.bot
- 2017. Facebook Messenger Trivia Blast. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/triviablast1 2017. Facebook Messenger Trivia Blast. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/triviablast1
- Susan Brennan . 1990. Conversation as Direct Manipulation: An Iconoclastic View. The Art of Human-Computer Interface Design ( 1990 ). Susan Brennan. 1990. Conversation as Direct Manipulation: An Iconoclastic View. The Art of Human-Computer Interface Design (1990).
- Orange Hive . 2017. First time bot users deserve good bots. (2017). Retrieved Jan 5, 2018 from https://unfiltered.orangehive.de/ first-time-bot-users-deserve-good-bots/ Orange Hive. 2017. First time bot users deserve good bots. (2017). Retrieved Jan 5, 2018 from https://unfiltered.orangehive.de/ first-time-bot-users-deserve-good-bots/
- J. C. R. Licklider . 1960. IRE Transactions on Human Factors in Electronics HFE-1 (March 1960 ), 4--11. J. C. R. Licklider. 1960. IRE Transactions on Human Factors in Electronics HFE-1 (March 1960), 4--11.
- Statista. 2017. Most popular global mobile messenger apps as of January 2017 . (2017). Retrieved February 7, 2017 from https://www.statista.com/statistics/258749/ most-popular-global-mobile-messenger-apps/ Statista. 2017. Most popular global mobile messenger apps as of January 2017. (2017). Retrieved February 7, 2017 from https://www.statista.com/statistics/258749/ most-popular-global-mobile-messenger-apps/
Cited by
Items 201–300 of 420
How can I help you? Design principles for task-oriented speech dialog systems in customer service
Oesterreich, T. D., Anton, E., Schuir, J., Brehm, A., & Teuteberg, F. (2022) · Information Systems and e-Business Management · doi:10.1007/s10257-022-00570-7 · Cited by 12
The Human Likeness of Government Chatbots – An Empirical Study from Norwegian Municipalities
Følstad, A., Larsen, A. G., & Bjerkreim-Hanssen, N. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-41138-0_8 · Cited by 11
A Review of Greek NLP Technologies for Chatbot Development
Giarelis, N., Mastrokostas, C., Siachos, I., & Karacapilidis, N. I. (2023) · Pan-Hellenic Conference on Progress in Computing and Informatics (PCI) · doi:10.1145/3635059.3635062 · Cited by 9
'A Modern Up-To-Date Laptop' - Vagueness in Natural Language Queries for Product Search
Papenmeier, A., Sliwa, A., Kern, D., Hienert, D., Aker, A., & Fuhr, N. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395489 · Cited by 9
gentiletti, M. G., Bourmaud, G., Fréjus, M., & Decortis, F. (2022) · Activites · doi:10.4000/activites.7428 · Cited by 9
Félix, B., Braga, C., Ntinga, X., Till, S. C., Meoli, L., van Heerden, A. C., Melo, R., Verdezoto, N. X., Densmore, M., & Nunes, F. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661504 · Cited by 9
Designing a Gender-Inclusive Conversational Agent For Pair Programming: An Empirical Investigation
Kuttal, S. K., Sedhain, A., & AuBuchon, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77772-2_4 · Cited by 10
Anticipating User Intentions in Customer Care Dialogue Systems
Mazzei, A., Anselma, L., Sanguinetti, M., Rapp, A., Mana, D., Hossain, M. M., Patti, V., Simeoni, R., & Longo, L. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2022.3184400 · Cited by 9
Designing Supportive Conversational Agents With and For Teens
Lopatovska, I., & Davis, J. (2023) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3576840.3578283 · Cited by 8
GEDİK, Y. (2023) · Journal of Business and Communication Studies · doi:10.29228/jobacs.68836 · Cited by 9
The Design and Evaluation of a Chatbot for Human Resources
Drozdal, J., Chang, A., Fahey, W., Murthy, N., Mogilisetty, L., Sunray, J., Powell, C., & Su, H. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-90176-9_32 · Cited by 9
Bruhn, M., & Hadwich, K. (2021) · Forum Dienstleistungsmanagement · doi:10.1007/978-3-658-34326-2_1 · Cited by 8
Kuksenok, K., & Martyniv, A. (2019) · Workshop on NLP for Conversational AI (NLP4ConvAI) · doi:10.18653/v1/w19-4110 · Cited by 8
An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot
Jalota, R., Trivedi, P., Maheshwari, G., Ngomo, A.-C. N., & Usbeck, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39540-7_2 · Cited by 8
Transparency in Maintenance of Recruitment ChatbotsPreprint
Kuksenok, K., & Praß, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03640 · Cited by 8
A General-purpose AI Avatar in HealthcarePreprint
Yan, N., & Alterovitz, G. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.12981 · Cited by 11
Shirvani, M. S., Liu, J., Chao, T., Martinez, S., Brandt, L., Kim, I.-J., & Yoon, D. (2025) · arXiv (Cornell University) · doi:10.14288/1.0448512 · Cited by 10
The Influence of UI UX Design to Number of Users Between ‘Line’ and ‘Whatsapp’
Devina, S., Nadia, A., Chen, V., & Gunawan, A. A. S. (2021) · doi:10.1109/iccsai53272.2021.9609775 · Cited by 7
Automating Extremism: Mapping the Affective Roles of Artificial Agents in Online Radicalization
Mantello, P. A., Ho, T. M., & Podoletz, L. (2023) · Springer eBooks · doi:10.1007/978-3-031-22552-9_4 · Cited by 9
Should Your Chatbot Joke? Driving Conversion Through the Humour of a Chatbot Greeting
Lekaviciute, V., Auruškevičienė, V., & Reardon, J. (2023) · Organizations and Markets in Emerging Economies · doi:10.15388/omee.2023.14.89 · Cited by 8
“The Implementation of Public Chatbots to Raise Awareness of Computer Crime”
Pimentel, L., Bernardo, M. D. R. M., & Rocha, T. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2508302 · Cited by 7
Conversational Survey Chatbot: User Experience and Perception
Đuka, I., & Njeguš, A. (2021) · International Scientific Conference Sinteza · doi:10.15308/sinteza-2021-322-327 · Cited by 11
Does Media Richness Influence the User Experience of Chatbots: A Pilot Study
Carmichael, L., Poirier, S., Coursaris, C. K., Léger, P., & Sénécal, S. (2021) · Lecture notes in information systems and organisation · doi:10.1007/978-3-030-88900-5_23 · Cited by 9
vRecruit: An Automated Smart Recruitment Webapp using Machine Learning
Mhadgut, S., Koppikar, N., Chouhan, N., Dharadhar, P., & Mehta, P. (2022) · International Conference on Innovative Trends in Information Technology (ICITIIT) · doi:10.1109/icitiit54346.2022.9744135 · Cited by 7
Exploring the Effects of Self-Mockery to Improve Task-Oriented Chatbot’s Social Intelligence
Liu, C., Zhou, S., Zhang, Y., Liu, D., Peng, Z., & Ma, X. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533461 · Cited by 9
Chatbot Design Challenges and the Effect on User Behavior
Almutairi, S., Khan, S., Kuhail, M. A., & Taj, I. (2023) · Advances in web technologies and engineering book series · doi:10.4018/978-1-6684-6234-8.ch002 · Cited by 7
Liu, I., Xiao, Y., Liu, F., Wu, S., & Ni, S. (2022) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3565698.3565789 · Cited by 8
El chatbot como factor de éxito comunicativo, de marketing y empresarial: análisis empírico
Fondevila-Gascón, J.-F., Huamanchumo, A., Martín-Guart, R., de Girona, U., Gutiérrez-Aragón, Ó., & de Girona, U. (2024) · Correspondencias & Análisis · doi:10.24265/cian.2024.n19.02 · Cited by 7
Tamime, R. A., Salminen, J. O., Jung, S., & Jansen, B. J. J. (2024) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc60511.2024.00064 · Cited by 10
Mafra, M. G. S., Nunes, K., Castro, A., Lopes, A., Oran, A. C., Bráz, G., de Almeida, J. D. S., de Paiva, A. C., Silva, A. C., da Rocha, S. V., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05412-9_33 · Cited by 8
Integrating Chatbot Media Automations in Professional Journalism: An Evaluation Framework
Kotenidis, E., Vryzas, N., Veglis, A. A., & Dimoulas, C. A. (2022) · Future Internet · doi:10.3390/fi14110343 · Cited by 8
A Framework and Content Analysis of Social Cues in the Introductions of Customer Service Chatbots
van Hooijdonk, C. M. J., Martijn, G., & Liebrecht, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25581-6_8 · Cited by 9
Designing Context-Aware Chatbots for Product Configuration
Niederer, T., Schloss, D., & Christensen, N. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25581-6_12 · Cited by 7
Proceedings of the First Workshop on NLP for Conversational AI
(2019) · doi:10.18653/v1/w19-41 · Cited by 7
Effect of interaction type and social playfulness on AI recommendation adoption
Park, M., Chung, N., & Koo, C. (2025) · Asia Pacific Journal of Tourism Research · doi:10.1080/10941665.2025.2548855 · Cited by 8
Carlo, L., Cruz, E., Arias, A. C., Baca, M., Carlo, M. P. J., Carpio-Arias, T. V., Waters, W. F., Mackintosh, N. J., & Verdezoto, N. X. (2025) · Digital Health · doi:10.1177/20552076251343684 · Cited by 6
Context Knowledge-Aware Recognition of Composite Intents in Task-Oriented Human-Bot Conversations
Bouguelia, S., Brabra, H., Benatallah, B., Báez, M., Zamanirad, S., & Kheddouci, H. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-07472-1_14 · Cited by 6
Identifying Breakdowns in Conversational Recommender Systems using User Simulation
Bernard, N., & Balog, K. (2024) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3640794.3665539 · Cited by 13
Research on User Experience Design of Artificial Intelligence (AI) Medical Consultation System
Yang, M., & Guo, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60428-7_17 · Cited by 6
Bruhn, M., & Hadwich, K. (2021) · Forum Dienstleistungsmanagement · doi:10.1007/978-3-658-34324-8_1 · Cited by 8
Andrao, M., Balducci, F., Breve, B., Cena, F., Desolda, G., Deufemia, V., Gena, C., Matera, M., Mattioli, A., Paternò, F., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34433-6_7 · Cited by 7
PwR: Exploring the Role of Representations in Conversational ProgrammingPreprint
Pradyumna, Y. M., Ganesan, V., Arumugam, D. K., Gupta, M., Shadagopan, N., Dixit, T., Segal, S., Kumar, P., Jain, M., & Rajamani, S. K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2309.09495 · Cited by 9
Self-citationNavigating Misinformation: Understanding User Frustration in AI-Driven Chatbot Interactions
Rössner, A., Ambach, M., & Pagel, S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93415-5_16 · Cited by 6
Exploring Emotions in Avatar Design to Increase Adherence to Chatbot Technology
Cortes, B., Teles, J. M. V., & Duarte, E. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35708-4_21 · Cited by 5
Hennekeuser, D., Vaziri, D. D., Golchinfar, D., & Stevens, G. (2024) · Interacting with Computers · doi:10.1093/iwc/iwae018 · Cited by 9
Interaction Design Patterns of Web Chatbots
Traubinger, V., & Gaedke, M. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-62362-2_22 · Cited by 5
A Systematic Mapping Study about Technologies for Hedonic Aspects Evaluation in Text-based Chatbots
Mariano, P. A. D. L., Souza, A., Guerino, G. C., Chaves, A. P., & Valentim, N. (2024) · Journal on Interactive Systems · doi:10.5753/jis.2024.4350 · Cited by 5
Understanding Driver-Passenger Interactions in Vehicular Crowdsensing
Agarwal, D. P., Agarwal, S., Singh, V., Kochupillai, R., Pierce-Messick, R., Iyengar, S., & Jain, M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3479869 · Cited by 6
Self-citationPotenziale von Chatbots für den innerbetrieblichen IT-Support
Fiore, D., Thiel, C., & Baldauf, M. (2020) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-019-00578-7 · Cited by 5
Beyond the Scene: A Comparative Analysis of Two Storytelling-based Conversational Agents
Beredo, J. L., & Ong, E. (2021) · Asian CHI Symposium · doi:10.1145/3429360.3468208 · Cited by 8
gentiletti, M. G. (2023) · Activites · doi:10.4000/activites.8541 · Cited by 5
Lee, J., Yang, Z. D., Shi, W., & Liu, Y. (2026) · Computers in Human Behavior · doi:10.1016/j.chb.2026.108955 · Cited by 6
Experience of Using a Virtual Life Coach: A Case Study of Novice Users
Mason-Robbie, V. (2021) · Postdigital science and education · doi:10.1007/978-3-030-65592-1_3 · Cited by 4
Perceptions of the Design and Use Chatbots for Educational Purposes: A Dialogue Partner
Černý, M. (2023) · The Journal of Educators Online · doi:10.9743/jeo.2023.20.4.3 · Cited by 9
Kum, J., Jung, S., & Lee, M. (2024) · Electronics · doi:10.3390/electronics13020430 · Cited by 5
Afjal, M. (2024) · Technology Analysis and Strategic Management · doi:10.1080/09537325.2024.2420617 · Cited by 4
Denecke, K., Rivera-Romero, O., Wynn, R., & Gabarrón, E. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2025.1429304 · Cited by 4
Schirrmacher, B., & Mousavi, N. (2023) · Palgrave Studies in Intermediality · doi:10.1007/978-3-031-42064-1 · Cited by 4
Dutta, N., & Dhar, D. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2298534 · Cited by 6
Jylkäs, T., Augsten, A., & Miettinen, S. (2019) · Conference Proceedings of the Academy for Design Innovation Management · doi:10.33114/adim.2019.04.349 · Cited by 4
Chatbots for Experience Sampling-Initial Opportunities and Challenges
Bemmanna, F., Schoedela, R., van Berkel, N., & Buschek, D. (2021) · VBN Forskningsportal (Aalborg Universitet) · Cited by 8
Actionable conversational quality indicators for improving task-oriented dialog systems
Higgins, M., Widdows, D., Hockey, B. A., Hazare, A., Howell, K., Christian, G., Mathi, S., Brew, C., Maurer, A., Bonev, G., et al. (2024) · Natural Language Engineering · doi:10.1017/s1351324923000372 · Cited by 5
Anton, E., Oesterreich, T. D., Schuir, J., & Teuteberg, F. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.714 · Cited by 6
Information knowledge and technology for development in Africa
Kalusopa, T., Onyancha, O. B., Ngoepe, M., Bwalya, K. J., Kwanya, T., Too, J., & Shongwe, M. M. (2021) · doi:10.4102/aosis.2021.bk262 · Cited by 6
A Review on Chatbot Personality and Its Expected Effects on Users
Феррейра, М., & Barbosa, B. (2023) · Advances in web technologies and engineering book series · doi:10.4018/978-1-6684-6234-8.ch010 · Cited by 5
Meck, A.-M., Draxler, C., & Vogt, T. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2266791 · Cited by 3
“Still, errors need to be answered with dedicated design strategies as users are also found to abandon CUIs because their trust towards an erroneous system diminishes and they enjoy interactions less (Ashktorab et al., 2019; Jain et al., 2018; Luger & Sellen, 2016).”
Wang, S., Zhang, Y., Xiao, Y., & Liang, Z. (2025) · Journal of Chinese Governance · doi:10.1080/23812346.2025.2485740 · Cited by 3
The Effects of Cognitive Engagement and Humanness of Chatbots on Learning Outcomes and Motivation
Kim, J. L., Gweon, G., & Menekşe, M. (2025) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2025.3577950 · Cited by 3
Topic Recommendation to Expand Knowledge and Interest in Question-and-Answer Agents
Yang, A. D.-Y., Noh, Y.-G., & Hong, J.-H. (2021) · Applied Sciences · doi:10.3390/app112210600 · Cited by 3
Giri, U., Sharma, A., Oza, S., Singh, P., Angra, P. K., & Khanna, A. (2024) · International Conference on Emerging Innovations and Advanced Computing (INNOCOMP) · doi:10.1109/innocomp63224.2024.00028 · Cited by 6
Haunschild, J., Henkel, M., & Reuter, C. (2025) · i-com · doi:10.1515/icom-2024-0067 · Cited by 3
Hanafi, M. F., Reiss, F. R., Katsis, Y., Moore, R. J., Falakmasir, M. H., Wang, P. C., Wood, D., & Liu, C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713312 · Cited by 4
Boecking, N. W., Gargari, P. A., Reichel, S., Hoffmann, S., Richter, T., & Wulf, V. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735798 · Cited by 4
Yang, Y., Hsu, C., Tung, H.-C., Shuai, H.-H., & Chang, Y.-J. (2021) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3469595.3469630 · Cited by 3
Milella, F., Natali, C., Scantamburlo, T., Campagner, A., & Cabitza, F. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42283-6_19 · Cited by 6
Introducing an AI Chatbot to Assist in Patient Admission to MRI Examinations
Sharafeddine, M. J., Charara, J., & Geryes, M. (2023) · International Conference on Advances in Biomedical Engineering (ICABME) · doi:10.1109/icabme59496.2023.10293024 · Cited by 3
Predicting and Exploring Abandonment Signals in a Banking Task-Oriented Chatbot Service
Hsu, C., Tung, H.-C., Shuai, H.-H., & Chang, Y.-J. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2282220 · Cited by 7
Creating chatbots to talk with humans: HCI evaluations and perspectives
Galvão, V. F., Maciel, C. D. O., & García, A. C. B. (2019) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3357155.3358460 · Cited by 3
A proposed methodology for investigating chatbot effects in peer review
Lin, M. P.-C. (2020) · Summit (Simon Fraser University) · Cited by 12
Lee, J., Jung, K., Newman, E., Chow, E., & Chen, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2504.13389 · Cited by 4
A Contextualized Government Service Chatbot for Individuals with limited Information Literacy
Lian, Z., Huang, M., & Wang, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-57850-2_15 · Cited by 2
Unpacking the Interface: The Impact of Design Choices on Users' Relationship with Raaji
Khan, K. L., & Azhar, F. (2024) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/3641237.3691662 · Cited by 3
Drivers of Banking Chabot Adoption by M-Banking Customers: Necessary and Sufficient Conditions
Payeng, A., & Baruah, D. (2025) · MANTHAN Journal of Commerce and Management · doi:10.17492/jpi.manthan.v12i1.1212506 · Cited by 2
Designing Knowledge for Conversational AI Applications: A Bloom’s Taxonomy Perspective
Lange, T. C., & Schlimbach, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93976-1_14 · Cited by 2
Mustafina, S. N., Khan, N. K., Islam, M. N., Nusrat, F. S., & Akhtaruzzaman, M. (2025) · MIST INTERNATIONAL JOURNAL OF SCIENCE AND TECHNOLOGY · doi:10.47981/j.mijst.13(01)2025.522(83-97 · Cited by 2
Nguyen, H. V., Yen, Y.-C. G., Shakir, O., Huynh, H., Gutierrez, S., Smith, J. A., Jimenez, S., Abdelgelil, S. E., & MacNeil, S. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3737636 · Cited by 3
Qian, J., & Zhong, Z. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2594143 · Cited by 3
Let’s Chat Internal: User Acceptance of an In-Company Service Desk Chatbot
Stütz, L., & Riener, A. (2021) · Mensch und Computer (MuC) · doi:10.1145/3473856.3474005 · Cited by 2
Li, T. J.-J., Mitchell, T. M., & Myers, B. A. (2021) · Human-computer interaction series · doi:10.1007/978-3-030-82681-9_15 · Cited by 2
Digital Modeling for Everyone: Exploring How Novices Approach Voice-Based 3D Modeling
Desolda, G., Esposito, A., Müller, F., & Feger, S. S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42293-5_11 · Cited by 5
A Flexible, Extendable and Adaptable Model to Support AI Coaching
Duhan, R., Pande, C., & Martin, A. (2023) · Lecture notes in business information processing · doi:10.1007/978-3-031-43126-5_13 · Cited by 2
Musi, E., O’Halloran, K. L., Carmi, E., & Yates, S. J. (2023) · Palgrave Studies in Intermediality · doi:10.1007/978-3-031-42064-1_11 · Cited by 3
Artificial Intelligence Technology to Predict the Financial Crisis in Business Companies
HAMADA, M. A., & Alhyasat, K. M. K. (2023) · The Eurasia Proceedings of Science Technology Engineering and Mathematics · doi:10.55549/epstem.1406233 · Cited by 2
Firdaus, M., Priya, P., & Ekbal, A. (2023) · doi:10.18653/v1/2023.findings-ijcnlp.30 · Cited by 2
Raj, K., Priya, K. M., Senthilkumar, K., Natarajan, S., Arun, R., & Thoti, K. K. (2024) · International Conference on Integrated Intelligence and Communication Systems (ICIICS) · doi:10.1109/iciics63763.2024.10859719 · Cited by 2
Rijo, B., Ribau, C. P., & Sousa, B. B. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-1742-7.ch006 · Cited by 2
Chatbot Deployment for College Recommendation
Padmavathi, K., Prasanna, M., Prathap, K. V. J. R., & Madhu, T. (2025) · doi:10.38124/ijisrt/25may2088 · Cited by 2
Effectiveness of Using AI-Based Chatbots in Increasing Customer Engagement
Sutantri, S. (2025) · OPTIMAL Jurnal Ekonomi dan Manajemen · doi:10.55606/optimal.v5i2.6516 · Cited by 3
Keystroke- Level Model to Evaluate Chatbot Interface for Reservation System
Supriyanto, S., Prahara, A., & Saputro, T. S. (2019) · Proceeding of the Electrical Engineering Computer Science and Informatics · doi:10.23919/eecsi48112.2019.8977029 · Cited by 2
Visualization for Analyzing Usage Status from Dialogue Systems
Seki, Y. (2020) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac48688.2020.00-10 · Cited by 2
Metadata
- Authors
- Jain, M., Kumar, P., Kota, R., & Patel, S. N.
- Affiliations
- University of Washington (US)
- IBM (India) (IN)
- IBM (Canada) (CA)
- Venue
- Proceedings of the 2018 Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2018-06-08
- Pages
- 895-906
- OpenAlex
- W2808216081
- Cited by
- 376
- References
- 32
- Citations by year
- 2026: 18 · 2025: 55 · 2024: 48 · 2023: 61 · 2022: 65 · 2021: 73 · 2020: 32 · 2019: 23 · 2018: 1
- FWCI
- 13.11
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Designing Interactive Systems Conference (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- chatbots, chatbot design, first-time users, user behavior patterns, Facebook Messenger, text messaging, natural language conversation, conversation context, chat logs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.