The Chatbot Usability Scale: the Design and Pilot of a Usability Scale for Interaction with AI-Based Conversational Agents
Open accessThe DOI matches its Crossref record; 67 of the 68 references it cites were found in a registry or an index.
Abstract
Standardised tools to assess a user’s satisfaction with the experience of using chatbots and conversational agents are currently unavailable. This work describes four studies, including a systematic literature review, with an overall sample of 141 participants in the survey (experts and novices), focus group sessions and testing of chatbots to (i) define attributes to assess the quality of interaction with chatbots and (ii) the designing and piloting a new scale to measure satisfaction after the experience with chatbots. Two instruments were developed: (i) A diagnostic tool in the form of a checklist (BOT-Check). This tool is a development of previous works which can be used reliably to check the quality of a chatbots experience in line with commonplace principles. (ii) A 15-item questionnaire (BOT Usability Scale, BUS-15) with estimated reliability between .76 and .87 distributed in five factors. BUS-15 strongly correlates with UMUX-LITE by enabling designers to consider a broader range of aspects usually not considered in satisfaction tools for non-conversational agents, e.g. conversational efficiency and accessibility, quality of the chatbot’s functionality and so on. Despite the convincing psychometric properties, BUS-15 requires further testing and validation. Designers can use it as a tool to assess products, thus building independent databases for future evaluation of its reliability, validity and sensitivity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Answering the Call for a Standard Reliability Measure for Coding Data
Hayes, A. F., & Krippendorff, K. (2007) · Communication Methods and Measures · doi:10.1080/19312450709336664 · Cited by 4,225 · cited 2×
“The agreement among the participants was equal to 0.780, which is acceptably higher than the minimum level of .667 for the Krippendorff ’ s Alpha [35].”
MethodResultInfluentialFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
The measurement of user information satisfaction
Ives, B., Olson, M. H., & Baroudi, J. J. (1983) · Communications of the ACM · doi:10.1145/358413.358430 · Cited by 1,820
Service loyalty: The effects of service quality and the mediating role of customer satisfaction
Caruana, A. (2002) · European Journal of Marketing · doi:10.1108/03090560210430818 · Cited by 1,528
Trust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185
Go, E., & Sundar, S. S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.01.020 · Cited by 1,089
Research works printed but not linked: 13
- Charlton JI (2000) Nothing about us without us: Disability oppression and empowerment. Univ of California Press
- DeVellis, R. F. (2016). Scale development: Theory and applications (Vol. 26). Sage publications.
- Dillon A (2001) Beyond Usability: Process, Outcome and Affect in human computer interactions. Canadian Journal of Information and Library Science 26(4)
- Feine, J., Morana, S., & Gnewuch, U. (2019). Measuring service encounter satisfaction with customer service chatbots using sentiment analysis 14th International Conference on Wirtschaftsinformatik (WI2019), Siegen, Germany. https://aisel.aisnet.org/wi2019/
- Harkous, H., Fawaz, K., Shin, K. G., & Aberer, K. (2016). Pribots: Conversational privacy with chatbots 12th Symposium on Usable Privacy and Security, Denver, Colorado, US.
- Lewis, J. R. (2001). Psychometric properties of the mean opinion scale. Proceedings of HCI International 2001: Usability Evaluation and Interface Design, 149-153.
- Munteanu, C., & Boldea, M. (2000). MDWOZ: A Wizard of Oz Environment for Dialog Systems Development International Conference on Language Resources and Evaluation (LREC’00), Athens, Greece.
- Peras, D. (2018). Chatbot evaluation metrics. Economic and Social Development: Book of Proceedings, 89-97
- Radziwill, N. M., & Benton, M. C. (2017). Evaluating quality of chatbots and intelligent conversational agents. arXiv preprint arXiv:1704.04579. · arXiv
- Revelle W (2011) An overview of the psych package. Department of Psychology Northwestern University. Accessed on March 3(2012):1–25
- Saenz, J., Burgess, W., Gustitis, E., Mena, A., & Sasangohar, F. (2017). The usability analysis of chatbot technologies for internal personnel communications Industrial and Systems Engineering Conference Pittsburgh, Pennsylvania, US.
- Tay L, Jebb A (2017) Scale Creation. In: Rogelberg SG (ed) The SAGE encyclopedia of industrial and organizational psychology, 2nd edn. SAGE Publications, Inc.
- Wilson HJ, Daugherty P, Bianzino N (2017) The jobs that artificial intelligence will create. MIT Sloan Management Review 58(4):14
Cited by
Items 101–200 of 361
An optimal deep feature–based AI chat conversation system for smart medical application
Lal, M., & Neduncheliyan, S. (2023) · Personal and Ubiquitous Computing · doi:10.1007/s00779-023-01713-4 · Cited by 9
Natural Language Processing in Teacher Training : a systematic review
Zhu, Q. (2023) · Lecture Notes in Education Psychology and Public Media · doi:10.54254/2753-7048/18/20231293 · Cited by 9
Advanced Healthcare Chat Bot using Python
Santhosham, S., & Sah, C. P. (2023) · International Conference for Innovation in Technology (INOCON) · doi:10.1109/inocon57975.2023.10101239 · Cited by 9
Audit of Literature on Chatbot Applications
Bialkova, S. (2024) · Springer eBooks · doi:10.1007/978-3-031-56471-0_2 · Cited by 8
Al-Shamaileh, O., Mubin, O., & Nizamuddin, N. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2532712 · Cited by 8
Mortazavi, A., Taheran, F., & Amiri, D. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2543989 · Cited by 8
Mafra, M. G. S., Nunes, K., Castro, A., Lopes, A., Oran, A. C., Bráz, G., de Almeida, J. D. S., de Paiva, A. C., Silva, A. C., da Rocha, S. V., et al. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05412-9_33 · Cited by 8
Chat-bot in the Library: Optimizing of User Interaction
Neshcheret, M. Y. (2025) · Bibliosphere · doi:10.20913/1815-3186-2025-3-50-59 · Cited by 7
Pervasive Chatbots: Investigating Chatbot Interventions for Multi-Device Applications
Olapade, M., Hasanli, T., Ottun, A.-R. O., Akintola, A., Liyanage, M., & Flores, H. (2024) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3627043.3659570 · Cited by 7
Chatbot User Experience: Design and Evaluation
Peras, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-76806-4_6 · Cited by 7
“The Implementation of Public Chatbots to Raise Awareness of Computer Crime”
Pimentel, L., Bernardo, M. D. R. M., & Rocha, T. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2508302 · Cited by 7
Shifting from social media to AI Chatbots: Saying goodbye to digital mental harms?
Fattouh, D. (2025) · Strategic Business Research · doi:10.1016/j.sbr.2025.100011 · Cited by 7
Bots and their Uses in Software Development: A Systematic Mapping Study
Moguel-Sánchez, R., Palacios, C. S. M., Ocharán-Hernández, J. O., Limón, X., & Sánchez-García, Á. J. (2022) · International Conference in Software Engineering Research and Innovation (CONISOFT) · doi:10.1109/conisoft55708.2022.00027 · Cited by 7
Sun, X., Krahmer, E., de Wit, J., Wiers, R. W. H. J., & Bosch, J. A. (2023) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3584931.3606998 · Cited by 7
Transforming Consumer Experience Through ChatGPT: Challenges and Opportunities
Damaševičius, R., & Zailskaitė‐Jakštė, L. (2024) · Advances in business information systems and analytics book series · doi:10.4018/979-8-3693-0815-8.ch008 · Cited by 7
User Experiences and Usability Evaluation of COVID-19 Application
Nagro, S. A. (2023) · Journal of Computer Science · doi:10.3844/jcssp.2023.372.388 · Cited by 7
Poglitsch, C., & Pirker, J. (2024) · IEEE Conference on Games (CoG) · doi:10.1109/cog60054.2024.10645560 · Cited by 6
Towards Teams being Led by a Conversational Agent
Simpson, J., Stening, H., Nalepka, P., Dras, M., Kallen, R. W., Hosking, S. G., Richardson, M. J., & Richards, D. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736614 · Cited by 6
Pan, Y., Zhang, J., Yu, J., & Pan, Z. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13671-w · Cited by 6
AXAI-CDSS: An Affective Explainable AI-Driven Clinical Decision Support System for Cannabis Use
Zhang, T., Chung, T. A., Dey, A. K., & Bae, S. W. (2025) · International Conference on Activity and Behavior Computing (ABC) · doi:10.1109/abc64332.2025.11118599 · Cited by 6
Exploring the Customer Experience Regarding AI-Powered Fintech Chatbots in Terms of SOR Theory
Çam, S., Tuna, M. F., & Bayır, T. (2026) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer21020049 · Cited by 6
Polat, S., & Renner, G. (2026) · Contemporary Educational Technology · doi:10.30935/cedtech/17878 · Cited by 6
Ma, H., Cui, H., Yu, H., Pei, R., Li, S., Wang, A., Tang, X., Liu, G., & Piao, M. (2026) · Digital Health · doi:10.1177/20552076261421367 · Cited by 6
Virtual Support for Real-World Movement: Using Chatbots to Overcome Barriers to Physical Activity
Sun, X., Casula, D., Navaratnam, A., Popp, A., Knopp, F., Busini, G., Wesołowski, J., Reeth, M. V., Reich, E., Wiers, R. W. H. J., et al. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230084 · Cited by 6
Fekets, G. (2025) · Journal of Baltic Science Education · doi:10.33225/jbse/25.24.878 · Cited by 5
Kayani, M. B., Niazi, A., Jabeen, Q., & Idress, S. (2026) · Sustainable Futures · doi:10.1016/j.sftr.2025.101627 · Cited by 5
Can an AI agent lead human teams?
Simpson, J., Patil, G., Stening, H., Kamruddin, A. B., Somerville, D., Seage, S., Nalepka, P., Dras, M., Hosking, S. G., Kallen, R. W., et al. (2026) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2026.100278 · Cited by 5
Kollig, F., Voelker, K., Ryan, E., Pfafman, R., & Nova, F. F. (2026) · JMIR Mental Health · doi:10.2196/77876 · Cited by 5
Shen, P., Peng, D., & Xu, J. (2026) · Journal of Business Research · doi:10.1016/j.jbusres.2026.116338 · Cited by 5
Person-based design and evaluation of MIA, a digital medical interview assistant for radiology
Denecke, K., Reichenpfader, D., Willi, D., Kennel, K., Bonél, H., Nairz, K., Čihorić, N., Papaux, D., & von Tengg‐Kobligk, H. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1431156 · Cited by 5
Pham, C., Nguyen, K.-H., & Le, D. T. (2025) · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany · doi:10.1007/978-3-031-90194-2_35 · Cited by 5
Nurtanto, M., Adyani, A., Aziz, M. K. N. A., Umar, N., Sutrisno, V. L. P., Nawanksari, S., Thoharudin, M., Ilma, A. Z., & Kholifah, N. (2025) · Salud Ciencia y Tecnología · doi:10.56294/saludcyt20251669 · Cited by 5
Reimann, M. M., Kunneman, F., Oertel, C., & Hindriks, K. V. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3736629 · Cited by 5
AI-Driven User Interface Design for Solving a Rubik’s Cube: A Scaffolding Design Perspective
Wu, D., Tang, H., Bradley, C., Capps, B., Singh, P., Wyandt, K., Wong, K., Irvin, M. J., Agostinelli, F., & Srivastava, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17615-9_34 · Cited by 5
Understanding Voice Shopping Value Co-Creation: A Sem-Fsqca Method
Yang, S., Xie, W., Chen, Y., Li, Y., & Wei, J. (2024) · Journal of Computer Information Systems · doi:10.1080/08874417.2024.2338935 · Cited by 5
Discovering Accessible Financial Systems Resources for Emergent Users
Teran, L. A., Carvalho, C., Caruso, J. Á., & Mota, M. P. (2025) · Journal on Interactive Systems · doi:10.5753/jis.2025.4476 · Cited by 5
Improving Perceived Emotional Intelligence of Embodied Chatbot Haru via Multi-Modal Interaction
Yu, H., Tang, F., Zhang, L., Gómez, R., Nichols, E., & Li, G. (2024) · IEEE International Conference on Robotics and Biomimetics (ROBIO) · doi:10.1109/robio64047.2024.10907584 · Cited by 5
A psychological platform for GenAI and human co-piloting in education
Fryer, L. K. (2025) · Frontline Learning Research · doi:10.14786/flr.v13i1.1523 · Cited by 5
Invisible failures in human-AI interactionsPreprint
Potts, C., & Sudhof, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.15423 · Cited by 5
The TEVV-Athlon Framework for Evaluating AI Systems (Draft)
Phillips, J. (2026) · doi:10.6028/nist.ai.200-2.ipd · Cited by 5
Predicting Interaction Quality Aspects Using Level-Based Scores for Conversational Agents
Reimann, M. M., Oertel, C., Kunneman, F. A., & Hindriks, K. V. (2023) · Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3570945.3607332 · Cited by 4
A Virtual 3D Chemistry Laboratory with an Enhanced AI Chatbot to Facilitate Learning Effectiveness
Chen, B.-J., Chen, C., & Huang, C.-L. (2024) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai63651.2024.00151 · Cited by 4
Tumedei, G., Ceccarini, C., & Prandi, C. (2025) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3689050.3705984 · Cited by 4
Aktaş, N. B., Şişman, B., & Borsci, S. (2025) · Universal Access in the Information Society · doi:10.1007/s10209-025-01211-9 · Cited by 4
Self-citationEvaluating an AI-Driven Chatbot Tutor for Enhancing Introductory Programming Learning
Briceño, P. A. G., Cárdenas, D. O., Piramanrique, R. F. M., Rosero, E. E. R., & Puccini, M. E. S. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98281-1_19 · Cited by 4
Gutiérrez-Carreón, G., & Bucio, P. M. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-16848-1_12 · Cited by 4
Speaking with Screens: Design Space and Guidelines for Informational Robot Screens
Kim, Y., Lee, C. P., & Mutlu, B. (2026) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3757279.3785557 · Cited by 4
Ibrahim, A., & Nemt-allah, M. A. (2026) · Scientific Reports · doi:10.1038/s41598-026-62798-4 · Cited by 4
Exploring AI in Education: A Quantitative Study of a Service-Oriented University Chatbot
Fersch, M.-L., Schacht, S., & Woldai, B. (2023) · The Paris Conference on Education, official conference proceedings · doi:10.22492/issn.2758-0962.2023.37 · Cited by 4
Zabel, S., Blaurock, M., Büttgen, M., & Otto, S. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2491790 · Cited by 4
AI-powered chatbots for improving interactive user experience: state-of-the-art
Zhou, T., Liu, Y., & Kumar, M. (2024) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 4
Valente, P., Fornelos, T., Ferreira, R., Silva, D., Tavares, D., Correia, N. M. R., Magalhães, J., & Nóbrega, R. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-42283-6_15 · Cited by 4
ChatGPT and U(X): A Rapid Review on Measuring the User ExperiencePreprint
Seaborn, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.15808 · Cited by 4
AXAI-CDSS : An Affective Explainable AI-Driven Clinical Decision Support System for Cannabis UsePreprint
Zhang, T., Chung, T., Dey, A. K., & Bae, S. W. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2503.06463 · Cited by 4
Incorporating Artificial Intelligence into Design Criteria Considerations
Drzyzga, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60611-3_10 · Cited by 3
Towards Tool Support for Design Science Research Understanding of Novice Researchers
Bierschwale, D., Gottschewski-Meyer, P. O., Steuck, P.-F., & Knackstedt, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93567-1_3 · Cited by 3
VibrationLLM: Enabling personalized risk management for hand-arm vibration exposure in construction
Altheimer, J., & Schneider, J. (2026) · Safety Science · doi:10.1016/j.ssci.2026.107141 · Cited by 3
An Enhanced AI Chatbot to Facilitate Learning Performance in a Virtual 3D Chemistry Laboratory
Chen, C. S., Chen, B.-J., & Huang, C.-L. (2026) · Journal of Science Education and Technology · doi:10.1007/s10956-026-10319-3 · Cited by 3
Nabila, K., & Abdulmajid, N. W. (2026) · Integrated Science Education Journal · doi:10.37251/isej.v7i2.2682 · Cited by 3
Liu, T., Sun, Y., Wei, Z.-Q., & Lo, T.-Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1827571 · Cited by 3
Capes, N., Patel, H., Sarhan, I., Ashwood, N., Dekker, A., & Shehata, R. (2023) · International Journal of Intelligence Science · doi:10.4236/ijis.2023.133005 · Cited by 3
Ferland, L., Owan, R., Kunkel, Z., Qu, H., Gini, M. L., & Koutstaal, W. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3725738 · Cited by 3
Hildebrandt, K., Ortmann, T., & Putzar, L. (2025) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3733155.3734906 · Cited by 3
Tu, C., Russo, A., & Zhang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61351-7_23 · Cited by 3
Sogemeier, D., Mandl, S., Hensch, A.-C., Forster, Y., & Strobel, A. (2024) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3641308.3685031 · Cited by 3
Chatbots in Hospitality: Decoding Tourist Behaviour Among Indian and Filipino Travelers
Srivastava, P., & Rodiris, L. J. (2024) · Advances in hospitality, tourism and the services industry (AHTSI) book series · doi:10.4018/979-8-3693-3972-5.ch009 · Cited by 3
A Conversation History-Based Q&A Cache Mechanism for Multi-Layered Chatbot Services
Makhkamova, O., & Kim, D.-H. (2021) · Applied Sciences · doi:10.3390/app11219981 · Cited by 3
Insert-expansions for Tool-enabled Conversational AgentsPreprint
Göldi, A., & Rietsche, R. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2307.01644 · Cited by 3
Gigliotti, S. (2025) · LUTPub (LUT University) · Cited by 3
Human-Centered Evaluation of RAG outputs: a framework and questionnaire for human-AI collaborationPreprint
Mangold, A., & Hoffmann, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.26205 · Cited by 3
Measuring the Chatbot-User Interaction: Scale Development and Validation
Mehmood, S., Zhou, Z., & Khan, S. (2024) · International Conference on Robotics, Automation and Artificial Intelligence (RAAI) · doi:10.1109/raai64504.2024.10949554 · Cited by 2
Designing XAI Chatbots to Enhance Self-Efficacy in Youth in Pathfinding Problem Domains
Lookingbill, V., Fu, J. L., Irvin, M. J., Wu, D., & Agostinelli, F. (2025) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3713043.3731492 · Cited by 2
AI Agents: Design and Evaluation of Gamified Conversational Agents
Poglitsch, C., Seiser, M., Buchsteiner, M., & Pirker, J. (2025) · IEEE Conference on Games (CoG) · doi:10.1109/cog64752.2025.11114224 · Cited by 2
Sebastian, A. T., Jansons, P., Ng, E. L., David, S., & Maddison, R. (2025) · JMIR Research Protocols · doi:10.2196/78923 · Cited by 2
Pre‐Service Teachers' Process of Developing and Using Content With AI
Yaman, N. D. (2025) · European Journal of Education · doi:10.1111/ejed.70277 · Cited by 2
Conversational Web Browsing: Where Do Existing DesignGuidelines Fall Short?
Piro, L., Verma, H., & Matera, M. (2025) · Biannual Conference of the Italian SIGCHI Chapter (CHItaly) · doi:10.1145/3750069.3750161 · Cited by 2
Call, Text, or Face-to-Face? Evaluating GenAI Chatbot Interface Preferences of Older Adults
Nanayakkara, S., & Huff, E. W. (2025) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3663547.3759749 · Cited by 2
Jelica, S., Milenković, I., Minović, M., & Maričić, M. (2025) · Computer Applications in Engineering Education · doi:10.1002/cae.70105 · Cited by 2
Pengembangan Chatbot AI untuk Informasi Pendaftaran Mahasiswa Baru di FTI UAP
Habib, C., Zulkifli, Z., Aminudin, N., & Andini, D. Y. A. (2025) · Jurnal Rekayasa Perangkat Lunak · Cited by 2
Liu, Y., & Zhang, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321477 · Cited by 2
Geiger, J.-M., & Wenzel, A. (2025) · MedienPädagogik Zeitschrift für Theorie und Praxis der Medienbildung · doi:10.21240/mpaed/65/2025.07.15.x · Cited by 2
The Impact of Technology on Customer Engagement: Comparing the Chatbots and the Customer Executives
Tickoo, K. (2024) · Journal of Electrical Systems · Cited by 2
Tahir, S. A., Abu-Khalaf, J., Shah, S. A. A., & Johnson, J. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0573-6_15 · Cited by 2
Impact of Al Tool-Chatbot on Customer Experience in Singapore
Tiwari, D., & Rangaswamy, E. (2025) · Studies in systems, decision and control · doi:10.1007/978-3-031-86708-8_18 · Cited by 2
Chatbot to Provide Initial Assistance to Erasmus Students in Case of Emergency
Mena, R. F. G., Balderas, A., Huerta, M., Dodero, J. M., & Mora, N. (2023) · Lecture notes in educational technology · doi:10.1007/978-981-99-0942-1_78 · Cited by 2
A Review Transformation Customer Service with Customer Relationship Management (CRM) Based Chatbots
Widyastuti, N., Ferdiana, R., & Nugroho, L. E. (2023) · International Workshop on Artificial Intelligence and Image Processing (IWAIIP) · doi:10.1109/iwaiip58158.2023.10462818 · Cited by 2
Automotive Multilingual Fault DiagnosisPreprint
Pavlopoulos, J., Romell, A., Curman, J., Steinert, O., Lindgren, T., & Borg, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.06918 · Cited by 2
Human AI conversational systems: when humans and machines start to chat
Borsci, S., Chamberlain, A., Nichele, E., Bødker, M., & Turchi, T. (2024) · Personal and Ubiquitous Computing · doi:10.1007/s00779-024-01837-1 · Cited by 2
Self-citationWhy Report Failed Interactions With Robots?! Towards Vignette-based Interaction QualityPreprint
Axelsson, A. J., Reimann, M. M., Cumbal, R., Pelikan, H. R. M., & Lala, D. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2508.10603 · Cited by 2
The Triadic Loop: A Framework for Negotiating Alignment in AI Co-hosted LivestreamingPreprint
Wang, K., Bianchi‐Berthouze, N., & Singh, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.18850 · Cited by 2
Chatbot usability scale: Adaptation to turkish and validation/reliability analysis
Yavuz, M., Kayalı, B., Balat, Ş., & Çalışan, M. (2023) · i-manager’s Journal on Educational Psychology · doi:10.26634/jet.20.1.19758 · Cited by 1
Воронин, А. Н., & Palenova, V. V. (2024) · Perspectives of science and education · doi:10.32744/pse.2024.5.40 · Cited by 1
Scalia, J. L., Laprise, J. K., Thrift, J. R., Farrell, C. L., & Sarasua, S. M. (2026) · JMIR AI · doi:10.2196/76400 · Cited by 1
Ye, J., Ye, J., Yoon, S., Yoon, S., Park, H., Park, H., Baek, Y., Baek, Y., Koo, Y., & Koo, Y. (2025) · Archives of Design Research · doi:10.15187/adr.2025.05.38.2.433 · Cited by 1
Masood, S., Anum, L., Qamar, M., Zahid, S., Arshad, S., Shahid, R., & Sattar, H. (2025) · Journal of Management & Social Science · doi:10.63075/bxmka661 · Cited by 1
Evaluating Chatbot usability: Adaptation of the BUS-11 Questionnaire for a Russian-speaking sample
Семеновна, Р. А., & Воронин, А. Н. (2025) · Experimental Psychology (Russia) · doi:10.17759/exppsy.2025180313 · Cited by 1
Is our chatbot telling lies? Assessing correctness of an LLM-based Dutch support chatbot
Lassche, H., Overeem, M., & Rastogi, A. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112699 · Cited by 1
Consumer Perceptions of GenAI in Service Delivery: Scale Development and Validation
van Esch, P., Cui, Y. G., Arli, D. I., & Eskridge, B. (2025) · Australasian Marketing Journal (AMJ) · doi:10.1177/14413582251395758 · Cited by 1
28. Pazarlama Kongresi Tam Metin Bildiri Kitabı
Sarıyer, N., Işık, D. A., Kitapçı, H., Yazar, E. E., Karabulut, A. N., & TUNCER, B. (2025) · Özgür Yayınları eBooks · doi:10.58830/ozgur.pub988 · Cited by 1
Borsci, S., Haeri, M. A., Schmettow, M., & Federici, S. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-025-01266-8 · Cited by 1
Self-citation
Metadata
- Authors
- Borsci, S., Malizia, A., Schmettow, M., van der Velde, F., Tariverdiyeva, G., Balaji, D., & Chamberlain, A.
- Affiliations
- Imperial College London (GB)
- University of Pisa (IT)
- University of Twente (NL)
- University of Amsterdam (NL)
- University of Nottingham (GB)
- Corresponding author
- Chamberlain, Alan
- Venue
- Personal and Ubiquitous Computing
- Published
- 2021-07-21
- Volume
- 26
- Issue
- 1
- Pages
- 95-119
- ISSN
- 1617-4909 (ISSN-L)
- 1617-4917
- OpenAlex
- W3187911027
- Cited by
- 266
- References
- 68
- Citations by year
- 2026: 87 · 2025: 78 · 2024: 52 · 2023: 39 · 2022: 9 · 2021: 1
- FWCI
- 8.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Personal and Ubiquitous Computing (publishedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (publishedVersion, other-oa)
- University of Twente Research Information (publishedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (submittedVersion, cc-by)
- CINECA IRIS Institutial research information system (University of Pisa) (submittedVersion, other-oa)
- NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
- University of Twente Research Information (submittedVersion, cc-by)
- Funders
- Engineering and Physical Sciences Research Council (EP/T51729X/1)
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- chatbots, user satisfaction, accessibility, chatbot evaluation, psychometric properties
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.