Automating the Development of Task-oriented LLM-based Chatbots
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Task-oriented chatbots are increasingly used to access all sorts of services – like booking a flight, or setting a medical appointment – through natural language conversation. There are many technologies for implementing task-oriented chatbots, including Dialogflow, Watson, and Rasa. They rely on an explicit definition of the user intents, conversation flows, and chatbot outputs, which is costly to specify, and sometimes results in suboptimal user experiences and artificial conversations with limited diversity of chatbot responses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the wake of this breakthrough, the AI landscape underwent a rapid transformation, shifting from the use of standalone LLMs toward more autonomous, task-oriented frameworks [30].”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [30]
Citations
Cites
A Survey on Evaluation of Large Language Models
Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., Chen, H., Yi, X., Wang, C., Wang, Y., et al. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3641289 · Cited by 4,254
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
ReAct: Synergizing Reasoning and Acting in Language Models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., & Cao, Y. (2022) · arXiv · doi:10.48550/arxiv.2210.03629 · Cited by 608
A systematic evaluation of large language models of code
Xu, F. F., Alon, U., Neubig, G., & Hellendoorn, V. J. (2022) · Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming · doi:10.1145/3520312.3534862 · Cited by 540
Choosing a Chatbot Development Tool
Pérez-Soler, S., Juárez-Puerta, S., Guerra, E., & Lara, J. D. (2021) · IEEE Software · doi:10.1109/ms.2020.3030198 · Cited by 94
Self-citationHallucination Detection: Robustly Discerning Reliable Answers in Large Language Models
Chen, Y., Fu, Q., Yuan, Y., Wen, Z., Fan, G., Liu, D., Zhang, D., Li, Z., & Xiao, Y. (2023) · Proceedings of the 32nd ACM International Conference on Information and Knowledge Management · doi:10.1145/3583780.3614905 · Cited by 94
Herding AI Cats: Lessons from Designing a Chatbot by Prompting GPT-3
Zamfirescu-Pereira, J. D., Wei, H., Xiao, A., Gu, K., Jung, G., Lee, M. G., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3596138 · Cited by 69
Evaluation Techniques for Chatbot Usability: A Systematic Mapping Study
Ren, R., Castro, J. W., Acuña, S. T., & de Lara, J. (2019) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194019400163 · Cited by 63
Research works printed but not linked: 24
- Anthropic. last access in 2024. Claude. https://www.anthropic.com/news/introducing-claude.
- Tom Bocklisch, Thomas Werkmeister, Daksh Varshneya, and Alan Nichol. 2024. Task-oriented dialogue with in-context learning. arXiv preprint arXiv:2402.12234 (2024). · arXiv
- Y. Cheng, J. Chen, Q. Huang, Z. Xing, X. Xu, and Q. Lu. 2023. Prompt Sapper: A LLM-empowered production tool for building AI chains. ACM Trans. Softw. Eng. Methodol. In press (2023), 22 pages.
- R. Clarisó and J. Cabot. 2023. Model-driven prompt engineering. In 2023 ACM/IEEE 26th International Conference on Model Driven Engineering Languages and Systems (MODELS). IEEE, 47–54.
- J. de Wit and A. Braggaar. 2023. Tilbot: A visual design platform to facilitate open science research into conversational user interfaces. In 5th International Conference on Conversational User Interfaces, CUI. ACM, 55:1–55:5.
- [10] Dialogflow. last access in 2024. https://dialogflow.com/.
- A. J. Fiannaca, C. Kulkarni, C. J. Cai, and M. Terry. 2023. Programming without a programming language: Challenges and opportunities for designing developer tools for prompt programming. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, CHI EA. ACM, 235:1–235:7.
- Google. last access in 2024. Gemini. https://gemini.google.com/.
- E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen. 2022. LoRA: Low-rank adaptation of large language models. In 10th International Conference on Learning Representations, ICLR. OpenReview.net.
- [14] LangChain. last access in 2024. https://www.langchain.com/.
- [15] LangFlow. last access in 2024. https://www.langflow.org/.
- P. S. H. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-T. Yih, T. Rocktäschel, S. Riedel, and D. Kiela. 2020. Retrieval-augmented generation for knowledge-intensive NLP tasks. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020. 16 pages.
- [17] Lex. last access in 2024. https://aws.amazon.com/en/lex/.
- Robert J. Moore and Raphael Arar. 2019. Conversational UX Design: A Practitioner’s Guide to the Natural Conversation Framework. ACM Books, Vol. 27. ACM.
- [19] OpenAI. last access in 2024. https://openai.com/.
- [20] Pandorabots. last access in 2023. https://home.pandorabots.com/.
- S. Pérez-Soler, E. Guerra, and J. de Lara. 2020. Model-driven chatbot development. In ER(LNCS, Vol. 12400). Springer, 207–222.
- [24] Rasa. last access in 2024. https://rasa.com/.
- E. Ruane, R. Smith, D. Bean, M. Tjalve, and A. Ventresque. 2020. Developing a conversational agent with a globally distributed team: An experience report. In 15th IEEE/ACM International Conference on Global Software Engineering, ICGSE. ACM, 122–126.
- M. Skjuve, A. Følstad, and P. B. Brandtzaeg. 2023. The user experience of ChatGPT: Findings from a questionnaire study of early users. In 5th International Conference on Conversational User Interfaces, CUI. ACM, 2:1–2:10.
- A. Vaswani N. Shazeer N. Parmar J. Uszkoreit L. Jones A. N. Gomez L. Kaiser and I. Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems 30. 5998–6008.
- [33] Watson. last access in 2024. https://www.ibm.com/cloud/watson-assistant/.
- Jing Wei Sungdong Kim Hyunhoon Jung and Young-Ho Kim. 2024. Leveraging large language models to power chatbots for collecting user self-reported data. In CSCW. See also https://arxiv.org/abs/2301.05843. · arXiv
- J. D. Zamfirescu-Pereira, R. Y. Wong, B. Hartmann, and Q. Yang. 2023. Why Johnny can’t prompt: How non-AI experts try (and fail) to design LLM prompts. In 2023 CHI Conference on Human Factors in Computing Systems, CHI. ACM, Article 437, 21 pages.
Cited by
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · arXiv · doi:10.48550/arxiv.2505.10468 · Cited by 295
“This evolution progressed through two major post-generative phases: AI Agents and Agentic AI.”
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 671
“This evolution progressed through two major post-generative phases: AI Agents and Agentic AI.”
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15161 · Cited by 186
How the Choice of LLM and Prompt Engineering Affects Chatbot Effectiveness
Pawlik, Ł. (2025) · Electronics · doi:10.3390/electronics14050888 · Cited by 36
Large Language Models and Rule-Based Approaches in Domain-Specific Communication
Halvoník, D., & Kapusta, J. (2024) · IEEE Access · doi:10.1109/access.2024.3436902 · Cited by 30
“Despite the existence of numerous tools for creating chatbots [37], one of the most popular tools for hybrid models is RASA.”
MethodPrompt Engineering for Requirements Engineering: A Literature Review and Roadmap
Huang, K., Wang, F., Huang, Y., & Arora, C. (2025) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew66121.2025.00081 · Cited by 41
Ouaddi, C., Benaddi, L., Bouziane, E. M., Naimi, L., Rahouti, M., Jakimi, A., & Saadane, R. (2025) · Scientific African · doi:10.1016/j.sciaf.2025.e02649 · Cited by 22
ChainBuddy: An AI-assisted Agent System for Generating LLM Pipelines
Zhang, J., & Arawjo, I. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714085 · Cited by 25
Limna, P., & Kraiwanit, T. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/7zmssq60 · Cited by 13
Chatbots in Psychology: Revolutionizing Clinical Support and Mental Health Care
de Filippis, R., & Foysal, A. A. (2024) · Voice of the Publisher · doi:10.4236/vp.2024.103025 · Cited by 18
LLM-DaaS: LLM-Driven Drone-as-a-Service Operations from Text User Requests
Wassim, L., Mohamed, K., & Hamdi, A. (2025) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-91354-9_9 · Cited by 14
Code Generation Templates for Accelerating Chatbot Development in Smart Tourism
Benaddi, L., Ouaddi, C., Souha, A., Jakimi, A., & Ouchao, B. (2024) · International Conference on Advanced Communication Technologies and Networking (CommNet) · doi:10.1109/commnet63022.2024.10793260 · Cited by 10
“They are classified into two types [4], intent-based chatbots and AI-based chatbots.”
LLMPi: Optimizing LLMs for High-Throughput on Raspberry Pi
Ardakani, M., Malekar, J., & Zand, R. (2025) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw67362.2025.00634 · Cited by 22
“Conversational AI has revolutionized human-computer interaction, enabling real-time, intelligent dialogue in domains such as customer service, healthcare, and education [30].”
Li, M., Wang, D., Purwanto, E., Selig, T., Zhang, Q., & Liang, H. (2025) · SoftwareX · doi:10.1016/j.softx.2025.102072 · Cited by 14
Impact of Chatbots on User Experience and Data Quality on Citizen Science Platforms
Kessel, A.-L., Sahri, S., Groppe, S., Groppe, J., Khorashadizadeh, H., Pignal, M., Pimparé, E. P., & Vignes‐Lebbe, R. (2025) · Computers · doi:10.3390/computers14010021 · Cited by 7
Sezgın, E., Jackson, D., Kaufman, K. M., Skeens, M. A., Gerhardt, C. A., & Moscato, E. L. (2025) · Digital Health · doi:10.1177/20552076251326160 · Cited by 11
“72,73 Recent advancements in arti fi cial intelligence and LLMs indicate an increasing ability for VAs to provide tailored information based on individual queries, which might be instrumental to address core needs for personalization.”
Test Case Generation for Dialogflow Task-Based Chatbots
Rapisarda, R. G., Ginelli, D., Clerissi, D., & Mariani, L. (2025) · IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) · doi:10.1109/icstw64639.2025.10962471 · Cited by 5
AI chatbots in higher education: Comparing expectations to evidence
Thoeni, A., & Fryer, L. K. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101061 · Cited by 4
A PDF Chatbot System: Enhancing Document Interaction with Natural Language Processing
Singh, V. K., Gaurang, & Kumar, S. R. (2025) · OPJU International Technology Conference on Smart Computing for Innovation and Advancement in Industry (OTCON) · doi:10.1109/otcon65728.2025.11070367 · Cited by 4
SHERPA: A Model-Driven Framework for Large Language Model Execution
Chen, B., Chene, K., López, J. A. H., Mussbacher, G., Varró, D., & Feizpour, A. (2025) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems (MODELS) · doi:10.1109/models67397.2025.00024 · Cited by 7
Streamlining College Enquiries: Integrating Amazon Lex and Twilio for WhatsApp Chatbot Accessibility
Kavyashree, M. K., Anupama, S., Keerthana, B. G. T., Krishnagiri, K., S, S. N., & Spoorthy, H. U. (2024) · OITS International Conference on Information Technology (OCIT) · doi:10.1109/ocit65031.2024.00078 · Cited by 1
“The chatbot has optimized the workflows in operations and reduced the response times by automating routine inquiries, thereby increasing administrative efficiency and freeing up precious human resources [16].”
Remembering Things Makes Chatbots Sound Smarter, but Less Trustworthy - A Pilot Study
Yan, Z., Fischer, J. E., & Clos, J. (2025) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3719160.3737617 · Cited by 5
Automated Exploration of Conversational Agents for the Synthesis of Testing Profiles
del Horno, I. S., Pozzo, A., Guerra, E., & Lara, J. D. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05188-2_14 · Cited by 1
Self-citationRodríguez‐Sánchez, M. J., Callejas, Z., Ruíz-Zafra, Á., & Benghazi, K. (2025) · Computing · doi:10.1007/s00607-025-01568-y · Cited by 1
Assessing Machine Learning Models for Enhancing Intent Detection in Tourism Chatbots
Ouaddi, C., Benaddi, L., Jakimi, A., Chehri, A., & Saadane, R. (2025) · Procedia Computer Science · doi:10.1016/j.procs.2025.09.441 · Cited by 2
Rodríguez‐Sánchez, M. J., Callejas, Z., Ruíz-Zafra, Á., & Benghazi, K. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0805-8_13 · Cited by 1
Masserini, E., Clerissi, D., Micucci, D., Campos, J. R., & Mariani, L. (2025) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre66568.2025.00060 · Cited by 1
Overcoming COPD Care Barriers in Northern Ontario with AI- A Perspective
Ghahremani, A., Neveditsin, N., Siddiqui, A., & Mago, V. (2024) · IEEE International Conference on Collaborative Advances in Software and Computing (CASCON) · doi:10.1109/cascon62161.2024.10838170
StockAI - Stock Analysis Tool Agent
Kowshik, S. B., Nair, S., Kiruthika, S. U., & Athanesious, J. J. (2024) · International Conference on Computing and Intelligent Reality Technologies (ICCIRT) · doi:10.1109/iccirt59484.2024.10921844
AI-Associate: A Lightweight Architecture for Conversational Agents
Gani, U. A. S., Madankar, A., Shinde, A., Sonwane, A., & Durbade, S. (2025) · OPJU International Technology Conference on Smart Computing for Innovation and Advancement in Industry (OTCON) · doi:10.1109/otcon65728.2025.11070569
AI-Enhanced Landmark Recognition For Self-Guided Tour Application Using Large Language Models
Karmaker, P., Korre, D., Rehman, M. H. U., & Khodadadzadeh, M. (2025) · International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI Adjunct) · doi:10.1145/3737821.3748524
Darmono, D., Setiawan, R. J., Ma'ruf, K., & Shen, M. Y. (2025) · Research Square · doi:10.21203/rs.3.rs-7673432/v1 · Cited by 1
Development of an Admission Chatbot for a University Using LLMs
Singh, G., Suri, D., & Joshi, N. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-8796-1_29
A Repository-First Framework for Democratizing Chatbot Development
Boonsri, R., & Buranasaksee, U. (2025) · doi:10.1109/incit66780.2025.11276047
Comparison of E2E and Pipeline Conversational Architectures for Production Line Rebalancing
Manssouri, M., Bouguelia, S., & Bentaha, M. L. (2025) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai66417.2025.00172
“Other alternatives include end-to-end memory networks [24], transformer-based models, and LLMs [25].”
MathBuddy: An LLM-Based Chatbot for Elementary Math Education
Iqbal, S., Pobee, S. B., Adhikari, A., & Schooley, B. L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13174-4_25
The effect of non-facial emojis-text congruency on user satisfaction in chatbot interactions
Pescatore, M., & Farace, S. (2026) · Italian Journal of Marketing · doi:10.1007/s43039-025-00126-w · Cited by 1
“…increasingly being refined and enhanced through the integration of cutting-edge technologies such as large language models (LLMs), giving rise to a new generation of AI-powered or LLM-based chatbots capable of more natural, context-aware, and flexible interactions (Sánchez Cuadrado et al., 2024).”
Han, L., Wei, M., Chen, Q., Wang, A., Pang, R., & Yip, D. K. M. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789085
“The rapid advancement of large language models (LLMs) has transformed this space: LLM-powered systems can generate coherent, context-aware dialogue through in-context learning [70].”
A DSL-Based Approach for Developing Dialogflow Chatbots: Modeling and Code Generation Templates
Benaddi, L., Ouaddi, C., Souha, A., Jakimi, A., Saadane, R., & Chehri, A. (2025) · International Conference on Networking, Information Systems & Security (NISS) · doi:10.1109/niss66502.2025.00029
SmartTicket: Chatbot-Based Ticketing System for Museums
Sundaramurthy, S., Chothia, M., Iqbal, A., & Jothi Kumar, C. (2025) · International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT) · doi:10.1109/3ict68299.2025.11442073
Smart Chatbots for Human Assistance
Joshi, G. K., Deshpande, S., Salgar, V., Chipade, S., Kagane, A., & Mahamuni, N. (2026) · International Conference on Emerging Trends and Innovations in ICT (ICEI) · doi:10.1109/icei65890.2026.11447700
“The often use of chatbots for different tasks is based on the scope of usage or the user requirements [11].”
PiCASO: A Real-time Pi-Integrated Conversational AI System with Optimized LLMs
Ardakani, M., Malekar, J., & Zand, R. (2026) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/3787109.3815259 · Cited by 1
Helmy, H., Rabah, C. B., & Serag, A. (2026) · AI · doi:10.3390/ai7070261 · Cited by 1
Simpson, J., Stening, H., Patil, G., Nalepka, P., Kamruddin, A. B., Dras, M., Kallen, R. W., Hosking, S. G., Richardson, M. J., & Richards, D. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816268
Is CUI a Dated Way of Saying LLM?
Simpson, J. (2026) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3816046.3816302
Rewriting the Script: Conversation Design’s Evolution with LLM Co-design
Guyre, M., Gonzalez, L., Davis, M., & Divekar, R. R. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-26717-7_13
Reverse Engineering of Chatbot Behaviour for Automated Testing
del Horno, I. S., Pozzo, A., Guerra, E., & de Lara, J. (2026) · SN Computer Science · doi:10.1007/s42979-026-05237-5 · Cited by 1
“Example Figure 3 shows the model that results from applying the Exploration and Refinement phases to a chatbot for a pizzeria built with Taskyto, which we took from [9].”
Self-citationAutomated Testing of Conversational Agents with Chatbot Dōjō
del Horno, I. S., Pozzo, A., Guerra, E., & Lara, J. D. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3774748.3787604
Self-citationÖzdenizci, B., Coşkun, V., & Baysalli, U. (2026) · Sustainability · doi:10.3390/su18199907
Metadata
- Authors
- Sánchez Cuadrado, J., Pérez-Soler, S., Guerra, E., & De Lara, J.
- Affiliations
- Universidad de Murcia, Spain
- Universidad Autónoma de Madrid (ES)
- Computer Science, Universidad Autonoma de Madrid, Spain
- Venue
- ACM Conversational User Interfaces 2024
- Publisher
- ACM
- Published
- 2024-07-08
- Pages
- 1-10
- OpenAlex
- W4400397477
- Cited by
- 46
- References
- 12
- Citations by year
- 2026: 12 · 2025: 26 · 2024: 8
- FWCI
- 13.60
- Type
- conference paper
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- Locations
- ACM Conference on Conversational User Interfaces (CUI) (publishedVersion)
- Biblos-e Archivo (Universidad Autónoma de Madrid) (submittedVersion, public-domain)
- Funders
- Agencia Estatal de Investigación (PID2021-122270OB-I00, PID2022-140109NB-I00, RED2022-134647-T, TED2021-129381B-C22)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- task-oriented chatbots, large language models, conversation flow, service booking, medical appointment scheduling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.