Evaluating and Informing the Design of Chatbots
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Text messaging-based conversational agents (CAs), popularly called chatbots, received significant attention in the last two years. However, chatbots are still in their nascent stage: They have a low penetration rate as 84% of the Internet users have not used a chatbot yet. Hence, understanding the usage patterns of first-time users can potentially inform and guide the design of future chatbots. In this paper, we report the findings of a study with 16 first-time chatbot users interacting with eight chatbots over multiple sessions on the Facebook Messenger platform. Analysis of chat logs and user interviews revealed that users preferred chatbots that provided either a 'human-like' natural language conversation ability, or an engaging experience that exploited the benefits of the familiar turn-based messaging interface. We conclude with implications to evolve the design of chatbots, such as: clarify chatbot capabilities, sustain conversation context, handle dialog failures, and end conversations gracefully.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous studies have suggested that chatbots should aim to sustain contexts to improve the dialogue efficiency [37].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [37]
In the citing paper
“There is also a growing base of research to inform design of chatbot interactions, whether this concerns conversational design [6], personalization of chatbots [69], the use of interactive elements in chatbots [57], or the use of social cues to indicate social status and capabilities [32].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [57]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Norman, D. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,374
ELIZA—a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1966) · Communications of the ACM · doi:10.1145/365153.365168 · Cited by 4,452 · cited 1×
“The first chatbot emerged in 1966 from MIT, called ELIZA [44], which emulated a Rogerian psychotherapist.”
BackgroundELIZA — a computer program for the study of natural language communication between man and machine
Weizenbaum, J. (1983) · Communications of the ACM · doi:10.1145/357980.357991 · Cited by 2,738
Licklider, J. C. R. (1960) · IRE Transactions on Human Factors in Electronics · doi:10.1109/thfe2.1960.4503259 · Cited by 1,938
Embodied Conversational Agents
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,799
Establishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333
Luger, E., & Sellen, A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858288 · Cited by 1,176
Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue Systems
Wen, T.-H., Gasic, M., Mrkšić, N., Su, P.-H., Vandyke, D., & Young, S. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1199 · Cited by 874
A diary study of task switching and interruptions
Czerwinski, M., Horvitz, E., & Wilhite, S. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985715 · Cited by 830
Research works printed but not linked: 16
- 2002. A.L.I.C. E. Foundation website. (2002). Retrieved January 4, 2017 from http://alicebot.org 2002. A.L.I.C.E. Foundation website. (2002). Retrieved January 4, 2017 from http://alicebot.org
- 2013. Mitsuku. ( 2013 ). Retrieved January 4, 2017 from http://www.mitsuku.com 2013. Mitsuku. (2013). Retrieved January 4, 2017 from http://www.mitsuku.com
- 2013. Rose. ( 2013 ). Retrieved January 4, 2017 from http://brilligunderstanding.com/rosedemo.html 2013. Rose. (2013). Retrieved January 4, 2017 from http://brilligunderstanding.com/rosedemo.html
- 2016. Facebook Messenger bots. (2016). Retrieved Dec 1, 2016 from https://chatbottle.co/bots/messenger 2016. Facebook Messenger bots. (2016). Retrieved Dec 1, 2016 from https://chatbottle.co/bots/messenger
- 2017. Facebook Messenger Alterra. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/alterra.cc 2017. Facebook Messenger Alterra. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/alterra.cc
- 2017. Facebook Messenger Call of Duty. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/CallofDuty 2017. Facebook Messenger Call of Duty. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/CallofDuty
- 2017. Facebook Messenger chatShopper. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/chatShopper 2017. Facebook Messenger chatShopper. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/chatShopper
- 2017. Facebook Messenger CNN. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/cnn 2017. Facebook Messenger CNN. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/cnn
- 2017. Facebook Messenger Hi Poncho. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/hiponcho 2017. Facebook Messenger Hi Poncho. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/hiponcho
- 2017. Facebook Messenger Pandorabots. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/chatbots.io 2017. Facebook Messenger Pandorabots. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/chatbots.io
- 2017. Facebook Messenger Swelly. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/swell.bot 2017. Facebook Messenger Swelly. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/swell.bot
- 2017. Facebook Messenger Trivia Blast. (2017) . Retrieved January 30, 2017 from https://www.messenger.com/t/triviablast1 2017. Facebook Messenger Trivia Blast. (2017). Retrieved January 30, 2017 from https://www.messenger.com/t/triviablast1
- Susan Brennan . 1990. Conversation as Direct Manipulation: An Iconoclastic View. The Art of Human-Computer Interface Design ( 1990 ). Susan Brennan. 1990. Conversation as Direct Manipulation: An Iconoclastic View. The Art of Human-Computer Interface Design (1990).
- Orange Hive . 2017. First time bot users deserve good bots. (2017). Retrieved Jan 5, 2018 from https://unfiltered.orangehive.de/ first-time-bot-users-deserve-good-bots/ Orange Hive. 2017. First time bot users deserve good bots. (2017). Retrieved Jan 5, 2018 from https://unfiltered.orangehive.de/ first-time-bot-users-deserve-good-bots/
- J. C. R. Licklider . 1960. IRE Transactions on Human Factors in Electronics HFE-1 (March 1960 ), 4--11. J. C. R. Licklider. 1960. IRE Transactions on Human Factors in Electronics HFE-1 (March 1960), 4--11.
- Statista. 2017. Most popular global mobile messenger apps as of January 2017 . (2017). Retrieved February 7, 2017 from https://www.statista.com/statistics/258749/ most-popular-global-mobile-messenger-apps/ Statista. 2017. Most popular global mobile messenger apps as of January 2017. (2017). Retrieved February 7, 2017 from https://www.statista.com/statistics/258749/ most-popular-global-mobile-messenger-apps/
Cited by
Items 101–200 of 420
Critiquing for Music Exploration in Conversational Recommender Systems
Cai, W., Jin, Y., & Chen, L. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450657 · Cited by 32
Yang, H., Song, H., Zhang, Y., Ma, E., & Yang, A. (2025) · Tourism Management · doi:10.1016/j.tourman.2025.105273 · Cited by 28
User Expectations of Conversational Chatbots Based on Online Reviews
Svikhnushina, E., Placinta, A., & Pu, P. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462125 · Cited by 35
India, G., Jain, M., Karya, P., Diwakar, N., & Swaminathan, M. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471206 · Cited by 28
Self-citationCommunication and Personality: how COVID-19 government chatbots express themselves
de Melo, D. N. A., & Monteiro, I. T. (2021) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3472301.3484362 · Cited by 28
Alabbas, A., & Alomar, K. (2025) · Future Internet · doi:10.3390/fi17020064 · Cited by 29
PEACE: A Model of Key Social and Emotional Qualities of Conversational Chatbots
Svikhnushina, E., & Pu, P. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3531064 · Cited by 30
Rudroff, T. (2024) · Brain Sciences · doi:10.3390/brainsci14020186 · Cited by 25
Key Qualities of Conversational Chatbots – the PEACE Model
Svikhnushina, E., & Pu, P. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450643 · Cited by 28
Kamoen, N., & Liebrecht, C. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.835505 · Cited by 24
Karusala, N., Victoria, G., Yan, S. D., & Anderson, R. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581553 · Cited by 25
Lucien, R., & Park, S. (2023) · TechTrends · doi:10.1007/s11528-023-00898-y · Cited by 26
Kim, Y., Kang, Y., Kim, B. R., Kim, J., & Kim, G. H. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2362406 · Cited by 27
Tell Me More: Transparency and Time-Fillers to Optimize Chatbots’ Waiting Time Experience
Wintersberger, P., Klotz, T., & Riener, A. (2020) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3419249.3420170 · Cited by 28
Černý, M. (2023) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe13020022 · Cited by 27
A Context-Aware Onboarding Agent for Metaverse Powered by Large Language Models
Hong, J., Lee, Y., Kim, D. H., Choi, D., Yoon, Y.-J., Lee, G.-C., Lee, Z., & Kim, J. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661579 · Cited by 23
Conversational Agents: Acting on the Wave of Research and Development
Jacques, R., Følstad, A., Gerber, E. M., Grudin, J. T., Luger, E. A., Monroy‐Hernández, A., & Wang, D. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3299034 · Cited by 23
Interaction Needs and Opportunities for Failing Robots
Morales, C. G., Carter, E. J., Tan, X. Z., & Steinfeld, A. M. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322345 · Cited by 24
Chatbots for Sexual Health Improvement: A Systematic Review
Fetrati, H., Chan, G., & Orji, R. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2376808 · Cited by 39
Marconi, L., Longo, L., & Cabitza, F. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8020028 · Cited by 29
Exploring Design Principles for Enterprise Chatbots: An Analytic Hierarchy Process Study
Feine, J., Adam, M., Benke, I., Maedche, A., & Benlian, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-64823-7_13 · Cited by 22
Pan, L., Yu, C., Li, J., Huang, T. Y., Bi, X., & Shi, Y. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517459 · Cited by 30
Moldt, J.-A., Wietek, T. F., Mamlouk, A. M., & Herrmann‐Werner, A. (2022) · Digital Health · doi:10.1177/20552076221139092 · Cited by 24
Fridolin: participatory design and evaluation of a nutrition chatbot for older adults
Weber, P. P., Mahmood, F., Ahmadi, M., von Jan, V., Ludwig, T. G., & Wieching, R. (2023) · i-com · doi:10.1515/icom-2022-0042 · Cited by 22
Cox, S. R., Lee, Y., & Ooi, W. T. (2023) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3623809.3623875 · Cited by 32
Auto Response Generation in Online Medical Chat Services
Jahanshahi, H., Kazmi, S., & Çevik, M. (2022) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-022-00118-x · Cited by 22
Elevating Business Experiences: AI-Powered Chatbots Reforming Marketing and E-Commerce
Waghambare, M. A., Prabhu, S., Ashok, P., & Natraj, N. A. (2024) · Advances in finance, accounting, and economics book series · doi:10.4018/979-8-3693-1503-3.ch001 · Cited by 30
Lim, J., & Hwang, W. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2446510 · Cited by 23
Guo, J., Guo, J., Yang, C., Wu, Y., & Sun, L. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445129 · Cited by 26
Li, B., Tauseef, S., Truong, K. N., & Mariakakis, A. T. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713613 · Cited by 22
Choi, S. (2025) · Journal of Consumer Behaviour · doi:10.1002/cb.2505 · Cited by 21
Lewandowski, T., Kučević, E., Leible, S., Poser, M., & Böhmann, T. (2023) · Electronic Markets · doi:10.1007/s12525-023-00662-3 · Cited by 24
El impacto de ChatGPT en la formación y producción académica: que no cunda el pánico
Sánchez, O. Z. (2024) · RIDE Revista Iberoamericana para la Investigación y el Desarrollo Educativo · doi:10.23913/ride.v14i28.1867 · Cited by 19
Rubric Development and Validation for Assessing Tasks' Solving via AI Chatbots
Hmoud, M., Swaity, H., Anjass, E., & Ramírez, E. M. A. (2024) · The Electronic Journal of e-Learning · doi:10.34190/ejel.22.6.3292 · Cited by 21
Digital Facilitation Assistance for Collaborative, Creative Design Processes
Bittner, E. A. C., Mirbabaie, M., & Morana, S. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.044 · Cited by 20
Task-Oriented User Evaluation on Critiquing-Based Recommendation Chatbots
Cai, W., Jin, Y., & Chen, L. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3131674 · Cited by 19
“Mhm...” – Conversational Strategies For Product Search Assistants
Papenmeier, A., Frummet, A., & Kern, D. (2022) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3498366.3505809 · Cited by 20
Klein, S. H., Papies, D., & Utz, S. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2351707 · Cited by 23
Exploring Interaction with Remote Autonomous Systems using Conversational Agents
Robb, D. A., Lopes, J., Padilla, S., Laskov, A., Garcia, F. J. C., Liu, X., Willners, J. S., Valeyrie, N., Lohan, K. S., Lane, D. M., et al. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322318 · Cited by 20
Bhattacharya, A., Nagar, R., Jenness, J. L., Munson, S. A., & Kientz, J. A. (2021) · JMIR Formative Research · doi:10.2196/20969 · Cited by 20
Svikhnushina, E., & Pu, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.13883 · Cited by 19
Tasks Over Traits: User Perception of Humanlike Features in Goal-Oriented Chatbots
Haresamudram, K., van As, N., & Larsson, S. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2470311 · Cited by 17
XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees
Roth, A. M., Liang, J., & Manocha, D. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636759 · Cited by 20
Assessing Open-Ended Human-Computer Collaboration Systems: Applying a Hallmarks Approach
Kozierok, R., Aberdeen, J. S., Clark, C., Garay, C. D., Goodman, B. A., Korves, T. M., Hirschman, L., McDermott, P. L., & Peterson, M. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.670009 · Cited by 22
Quality Assessment Methods for Textual Conversational Interfaces: A Multivocal Literature Review
Coppola, R., & Ardito, L. (2021) · Information · doi:10.3390/info12110437 · Cited by 18
Autonomy Is An Acquired Taste: Exploring Developer Preferences for GitHub Bots
Ghorbani, A., Cassee, N., Robinson, D. J. S., Alami, A., Ernst, N., Serebrenik, A., & Wąsowski, A. (2023) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse48619.2023.00123 · Cited by 23
Hoque, M. N., Mahfuz, A. A., Kindi, M. S., & Hassan, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642007 · Cited by 17
Assessing Cognitive and Social Awareness among Group Members in AI-assisted Collaboration
de Jong, S., Wester, J., Schrills, T., Secher, K. S., Griggio, C. F., & van Berkel, N. (2024) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3701571.3701582 · Cited by 19
Losing Its Touch: Understanding User Perception of Multimodal Interaction and Smart Assistance
Esau, M., Krauß, V., Lawo, D., & Stevens, G. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533455 · Cited by 18
Kim, H., Jung, I., & Lim, Y.-K. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533528 · Cited by 22
Lee, J., Jung, K., Newman, E., Chow, E., & Chen, Y. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713244 · Cited by 18
Culturally responsive AI chatbots: From framework to field evidence
Naidoo, V., & CHADHA, K. K. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100224 · Cited by 19
Ge, R. (2024) · Communications in Humanities Research · doi:10.54254/2753-7064/2024.19122 · Cited by 15
Interactive Search on the Web: The Story So Far
Aghaei, S., Angele, K., Huaman, E., Bushati, G., Schiestl, M., & Fensel, A. (2022) · Information · doi:10.3390/info13070324 · Cited by 15
Shams, G., & Kim, K. (2024) · Journal of Hospitality & Tourism Research · doi:10.1177/10963480241280991 · Cited by 14
Measuring Artificial Intelligence Customer Experience: Scale Development and Validation
Keng, C., Sung, P.-F., & Chen, Y.-H. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2466064 · Cited by 18
Promoting mindful consumption through a chatbot with an experiential mind
Seo, J. K., & Yoon, H. J. (2025) · Journal of Consumer Marketing · doi:10.1108/jcm-05-2024-6844 · Cited by 16
CASExplorer: A Conversational Academic and Career Advisor for College Students
Lee, T., Zhu, T., Liu, S. Z., Trac, L., Huang, Z., & Chen, Y. (2021) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3490355.3490368 · Cited by 18
Technology Applications in the Asian Tourism Industry in Future
İştin, A. E., ERYILMAZ, G., & Üzülmez, M. (2022) · Springer eBooks · doi:10.1007/978-981-16-5461-9_27 · Cited by 15
Artificial Intelligence Synergetic Opportunities in Services: Conversational Systems Perspective
Rozenes, S., & Cohen, Y. (2022) · Applied Sciences · doi:10.3390/app12168363 · Cited by 15
A chatbot response generation system
Feine, J., Morana, S., & Maedche, A. (2020) · Mensch und Computer (MuC) · doi:10.1145/3404983.3405508 · Cited by 14
Development of a practical training method for a healthcare artificial intelligence (AI) chatbot
Lin, J., Joseph, T., Parga-Belinkie, J. J., Mandel, A., Schumacher, R., Neumann, K., Scalise, L., Gaulton, J., Christ, L., Leitner, K., et al. (2021) · BMJ Innovations · doi:10.1136/bmjinnov-2020-000530 · Cited by 13
Toward a linguistically grounded dialog model for chatbot design
Dall’Acqua, A., & Tamburini, F. (2021) · Italian Journal of Computational Linguistics · doi:10.4000/ijcol.900 · Cited by 15
Towards task-sensitive assistance in public spaces
Kilian, M. A., Kattenbeck, M., Ferstl, M., Ludwig, B., & Alt, F. (2019) · Aslib Journal of Information Management · doi:10.1108/ajim-07-2018-0179 · Cited by 13
Making Time Fly: Using Fillers to Improve Perceived Latency in Crowd-Powered Conversational Systems
Abbas, T., Gadiraju, U., Khan, V.-J., & Markopoulos, P. (2021) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v9i1.18935 · Cited by 16
Towards Chatbots to Support Bibliotherapy Preparation and Delivery
McAllister, P. M., Kerr, J., McTear, M., Mulvenna, M. D., Bond, R., Kirby, K., Morning, J., & Glover, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-39540-7_9 · Cited by 14
Wang, S., Ma, S., Lai, G.-H., & Chao, C.-H. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.07.029 · Cited by 14
Farah, J. C., Sharma, V., Ingram, S., & Gillet, D. (2021) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3472307.3484677 · Cited by 14
Comparing users' perception of different chatbot interaction paradigms: a case study
Valério, F. A. M., Guimarães, T. G., Prates, R. O., & Candello, H. C. D. S. P. (2020) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3424953.3426501 · Cited by 12
Do, H. J., Yang, S. H., Choi, B.-G., Fu, W. T., & Bailey, B. P. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450659 · Cited by 12
Assessing the Reusability of Design Principles in the Realm of Conversational Agents
Elshan, E., Engel, C., Ebel, P., & Siemon, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-06516-3_10 · Cited by 14
An exploratory study of reactions to bot comments on GitHub
Farah, J. C., Spaenlehauer, B., Lu, X., Ingram, S., & Gillet, D. (2022) · doi:10.1145/3528228.3528409 · Cited by 12
Brachman, M., Pan, Q., Do, H. J., Dugan, C., Chaudhary, A., Johnson, J. M., Rai, P., Chakraborti, T., Gschwind, T., Laredo, J. A., et al. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584088 · Cited by 11
Um Estudo Exploratório sobre Métodos de Avaliação de User Experience em Chatbots
Barbosa, M., Valle, P. H. D., Nakamura, W. T., Guerino, G. C., Finger, A. F., Lunardi, G. M., & Silva, W. (2022) · Escola Regional de Engenharia de Software (ERES) · doi:10.5753/eres.2022.227723 · Cited by 11
When design workshops meet chatbots: Meaningful participation at scale?
Yang, S., Dortheimer, J., Sprecher, A., & Yang, Q. (2024) · International Journal of Architectural Computing · doi:10.1177/14780771241253440 · Cited by 12
A Survey on the Recent Advancements in Human-Centered Dialog Systems
Oruche, R., Goruganthu, S. K., Akula, R., Cheng, X., Goni, M. A., Shibo, B. W., Kee, K. F., Zampieri, M., & Calyam, P. P. (2025) · ACM Computing Surveys · doi:10.1145/3729220 · Cited by 18
Mediating Quizzes as Assessment Tool through WhatsApp Auto-response in ELT Online Class
Sabiq, A. H. A., & Fahmi, M. I. (2020) · Langkawi Journal of The Association for Arabic and English · doi:10.31332/lkw.v6i2.2216 · Cited by 15
Kamoen, N., McCartan, T., & Liebrecht, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-94890-0_10 · Cited by 11
The Role of Artificial Intelligence in Interactive Marketing: Improving Customer-Brand Relationship
Aslam, W., & Farhat, K. (2023) · Springer eBooks · doi:10.1007/978-3-031-14961-0_9 · Cited by 14
StockBabble: A Conversational Financial Agent to support Stock Market Investors
Sharma, S., Brennan, J., & Nurse, J. R. C. (2021) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3469595.3469620 · Cited by 11
PrintAssist—a conversational human-machine interface for 3D printers
Jasche, F., Weber, P. P., Liu, S., & Ludwig, T. G. (2023) · i-com · doi:10.1515/icom-2022-0045 · Cited by 12
Knowledge-based Conversational Search
Vakulenko, S. (2019) · arXiv (Cornell University) · doi:10.34726/hss.2019.72687 · Cited by 15
Wang, K., Lu, Y., & Pan, Z. (2024) · Data Science and Management · doi:10.1016/j.dsm.2024.09.001 · Cited by 11
Exploring Users’ Preferences for Chatbot’s Guidance Type and Timing
Wu, M.-H., Yeh, S.-F., Chang, X.-J., & Chang, Y.-J. (2021) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3462204.3481756 · Cited by 10
Chagas, B. A., Ferreguetti, K., Ferreira, T. C., Marcolino, M. S., Ribeiro, L. B., Pagano, A. S., Reis, Z. S. N., Prates, R. O., Meira, W., & Ribeiro, A. L. P. (2021) · CLEI electronic journal · doi:10.19153/cleiej.24.3.6 · Cited by 10
Cannanure, V. K., Ávila-Uribe, E., Ngoon, T. J., Adji, Y. T., Wolf, S., Jasińska, K. K., Brown, T. X., & Ogan, A. (2022) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3530190.3534794 · Cited by 34
Intelligent Personal Assistant in Business-Context: Key-feature Evaluation for User Acceptance
Hüsson, D., Holland, A., & Sánchez, R. A. (2020) · Business Systems Research Journal · doi:10.2478/bsrj-2020-0032 · Cited by 11
Intelligent Interactive Technologies for Mental Health and Well-Being
Jovanovic, M., Jevremović, A., & Pejovic-Milovancevic, M. M. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-72711-6_18 · Cited by 14
Husson, D., Holland, A., Fathi, M., & Sánchez, R. A. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9659298 · Cited by 11
On the Pragmatics of the Turing Test
Jacquet, B., Jamet, F., & Baratgin, J. (2021) · International Conference on Information and Digital Technologies (IDT) · doi:10.1109/idt52577.2021.9497570 · Cited by 10
Fahn, V., & Riener, A. (2021) · Mensch und Computer (MuC) · doi:10.1145/3473856.3473872 · Cited by 14
Lubbe, I., Roberts-Lombard, M., & Langerman, J. (2025) · European Business Review · doi:10.1108/ebr-06-2024-0190 · Cited by 12
The News Says, the Bot Says: How Immigrants and Locals Differ in Chatbot-Facilitated News Reading
Zhang, Y., Nguyen-Le, P.-A., Singh, K., & Gao, G. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714050 · Cited by 14
Zhou, J., Shen, R., You, Y., DiSalvo, C. F., Dombrowski, L. S., & MacLellan, C. J. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735831 · Cited by 12
Understanding People’s Expectations When Designing a Chatbot for Cancer Patients
Félix, B., & Ribeiro, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-94890-0_3 · Cited by 9
Silva, G. R. S., Rodrigues, G. N., & Canedo, E. D. (2023) · JUCS - Journal of Universal Computer Science · doi:10.3897/jucs.91311 · Cited by 9
Cannanure, V. K., Ngoon, T. J., Wolf, S., Jasińska, K. K., Brown, T. X., & Ogan, A. (2024) · ACM Journal on Computing and Sustainable Societies · doi:10.1145/3675762 · Cited by 9
Ryoo, Y., Halfacre, V., Kim, E. A., & Yoon, H. J. (2025) · International Journal of Advertising · doi:10.1080/02650487.2025.2452048 · Cited by 9
Liu, J., Song, K., Kang, Y., He, G., Jiang, Z., Sun, C., Lu, W. P., & Liu, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.767 · Cited by 12
Metadata
- Authors
- Jain, M., Kumar, P., Kota, R., & Patel, S. N.
- Affiliations
- University of Washington (US)
- IBM (India) (IN)
- IBM (Canada) (CA)
- Venue
- Proceedings of the 2018 Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2018-06-08
- Pages
- 895-906
- OpenAlex
- W2808216081
- Cited by
- 376
- References
- 32
- Citations by year
- 2026: 18 · 2025: 55 · 2024: 48 · 2023: 61 · 2022: 65 · 2021: 73 · 2020: 32 · 2019: 23 · 2018: 1
- FWCI
- 13.11
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Designing Interactive Systems Conference (publishedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Keywords
- chatbots, chatbot design, first-time users, user behavior patterns, Facebook Messenger, text messaging, natural language conversation, conversation context, chat logs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.