Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis
Abstract
Chatbots are becoming a ubiquitous trend in many fields such as medicine, product and service industry, and education. Chatbots are computer programs used to conduct auditory or textual conversations. A growing body of evidence suggests that these programs have the potential to change the way students learn and search for information. Especially in large-scale learning scenarios with more than 100 students per lecturer, chatbots are able to solve the problem of individual student support. However, until now, there has been no systematic, structured overview of their use in education. The aim of this paper is therefore to conduct a systematic literature review based on a multi-perspective framework, from which we have derived initial search questions, synthesized past research, and highlighted future research directions. We reviewed titles and abstracts of 1405 articles drawn from management, education, information systems, and psychology literature before examining and individually coding a relevant subset of 80 articles. The results show that chatbots are in the very beginning of entering education. Few studies suggest the potential of chatbots for improving learning processes and outcomes. Nevertheless, past research has revealed that the effectiveness of chatbots in education is complex and depends on a variety of factors. With our literature review, we make two principal contributions: first, we structure and synthesize past research by using an input-process-output framework, and secondly, we use the framework to highlight research gaps for guiding future research in that area.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most published literature suggests that ChatGPT could pose a challenge to various aspects of post-secondary education, such as academic integrity, ethical considerations, and student assessments outside the classroom.
“While these studies are ongoing, most published literature suggest that this AI chatbot could pose a challenge to various aspects of post-secondary education, such as academic integrity, ethical considerations, and student assessments outside the classroom [11,30,32].”
From Exploring ChatGPT’s impact on post-secondary education: A qualitative study (2023) · cites this paper as [30]
The technology can be a pivoting point for higher education, particularly in student assignments and assessments.
“The technology can be a pivoting point for higher education, particularly in the realm of student assignments and assessments [30].”
From Exploring ChatGPT’s impact on post-secondary education: A qualitative study (2023) · cites this paper as [30]
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · see citing works
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846 · see citing works
Self-Efficacy and Academic Motivation
Schunk, D. H. (1991) · Educational Psychologist · doi:10.1080/00461520.1991.9653133 · Cited by 4,292 · see citing works
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425 · see citing works
Response to a relational agent by hospital patients with depressive symptoms
Bickmore, T. W., Mitchell, S. E., Jack, B. W., Paasche-Orlow, M. K., Pfeifer, L. M., & O’Donnell, J. (2010) · Interacting with Computers · doi:10.1016/j.intcom.2009.12.001 · Cited by 218 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
ChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371 · see citing works
Revolutionizing education with AI: Exploring the transformative potential of ChatGPT
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13152 · Cited by 975 · see citing works
“It significantly improves learning outcomes and student happiness (Winkler & Söllner, 2018), maximizing student learning abilities and achievement (Clarizia et al., 2018).”
BackgroundChatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879 · see citing works
Interacting with educational chatbots: A systematic review
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11177-3 · Cited by 841 · see citing works
Sajja, R., Sermet, Y., Cikmaz, M., Cwiertny, D., & Demir, I. (2024) · Information · doi:10.3390/info15100596 · Cited by 620 · see citing works
Chen, Y., Jensen, S., Albert, L. J., Gupta, S., & Lee, T. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10291-4 · Cited by 685 · see citing works
Chaves, A. P., & Gerosa, M. A. (2021) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1841438 · Cited by 572 · see citing works
Are We There Yet? - A Systematic Literature Review on Chatbots in Education
Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.654924 · Cited by 557 · see citing works
“…(DC2) derived from several publications, provide another classi fi cation schema, which distinguishes between “ retrieval vs. generative ” based technology, the “ ability to incorporate context data, ” and “ speech or text interface ” (Winkler and Soellner, 2018; Smutny and Schreiberova, 2020).”
BackgroundInfluentialWhat ChatGPT means for universities: Perceptions of scholars and students
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.22 · Cited by 431 · see citing works
“…technologies can enhance student interaction and learning processes (D’Mello et al., 2014), enrich learning experiences by impacting student success in higher education (Winkler & Söllner, 2018), and potentially improve student motivation, engagement, and learning outcomes (Deng & Yu, 2023).”
BackgroundPredicting the intentions to use chatbots for travel and tourism
Melián-González, S., Gutiérrez-Taño, D., & Bulchand-Gidumal, J. (2021) · Current Issues in Tourism · doi:10.1080/13683500.2019.1706457 · Cited by 406 · see citing works
Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023) · Sustainability · doi:10.3390/su151712921 · Cited by 370 · see citing works
“For example, Winkler and Söllner [46] reviewed the application of chatbots in improving student learning outcomes and suggested that chatbots could support individuals’ development of procedural knowledge and competency skills such as information searching, data collection, decision making, and…”
BackgroundKumar, J. A. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00302-w · Cited by 183 · see citing works
Chatbot application in a 5th grade science course
Deveci Topal, A., Dilek Eren, C., & Kolburan Geçer, A. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10627-8 · Cited by 182 · see citing works
Optimizing Students’ Mental Health and Academic Performance: AI-Enhanced Life Crafting
Dekker, I., De Jong, E. M., Schippers, M. C., De Bruijn-Smolders, M., Alexiou, A., & Giesbers, B. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01063 · Cited by 176 · see citing works
Schöbel, S., Schmitt, A., Benner, D., Saqr, M., Janson, A., & Leimeister, J. M. (2024) · Information Systems Frontiers · doi:10.1007/s10796-023-10375-9 · Cited by 127 · see citing works
Proposing a task-oriented chatbot system for EFL learners speaking practice
Hsu, M.-H., Chen, P.-S., & Yu, C.-S. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1960864 · Cited by 119 · see citing works
Online chat and chatbots to enhance mature student engagement in higher education
Abbas, N., Whitfield, J., Atwell, E., Bowman, H., Pickard, T., & Walker, A. (2022) · International Journal of Lifelong Education · doi:10.1080/02601370.2022.2066213 · Cited by 116 · see citing works
Al-Abdullatif, A. M. (2023) · Education Sciences · doi:10.3390/educsci13111151 · Cited by 102 · see citing works
Adapting to the Future: ChatGPT as a Means for Supporting Constructivist Learning Environments
Kim, M., & Adlof, L. (2024) · TechTrends · doi:10.1007/s11528-023-00899-x · Cited by 97 · see citing works
Al-Abdullatif, A. M., Al-Dokhny, A. A., & Drwish, A. M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1129070 · Cited by 80 · see citing works
“…large-scale learning environments by assisting the instructor in instantly replying to students’ queries, training learners using a variety of learning resources, reintroducing course content and materials, and collecting feedback on training courses (Winkler and Söllner, 2018; Almurtadha, 2019).”
BackgroundExploring ChatGPT’s impact on post-secondary education: A qualitative study
Rajabi, P., Taghipour, P., Cukierman, D., & Doleck, T. (2023) · Proceedings of the 25th Western Canadian Conference on Computing Education · doi:10.1145/3593342.3593360 · Cited by 57 · see citing works
Designing learning technology collaboratively: analysis of a chatbot co-design
Durall Gazulla, E., Martins, L., & Fernández-Ferrer, M. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11162-w · Cited by 46 · see citing works
Lister, K., Coughlan, T., Kenny, I., Tudor, R., & Iniesto, F. (2021) · Education Sciences · doi:10.3390/educsci11100587 · Cited by 38 · see citing works
Chatbots in Healthcare Curricula: The Case of a Conversational Virtual Patient
Dolianiti, F., Tsoupouroglou, I., Antoniou, P., Konstantinidis, S., Anastasiades, S., & Bamidis, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-60735-7_15 · Cited by 37 · see citing works
Chatbot-mediated Learning: Conceptual Framework for the Design of Chatbot Use Cases in Education
Sonderegger, S., & Seufert, S. (2022) · Proceedings of the 14th International Conference on Computer Supported Education · doi:10.5220/0010999200003182 · Cited by 29 · see citing works
“…traditional intelligent tutoring systems or pedagogical agents in e-learning scenarios, chatbots do not only give instructions or provide feedback, but can also react to individual intents and create a real personalization and more importantly, a learner-centred approach (Winkler & Söllner, 2018).”
BackgroundInfluentialPolat, M., Karataş, İ. H., & Varol, N. (2025) · Leadership and Policy in Schools · doi:10.1080/15700763.2024.2412204 · Cited by 28 · see citing works
AI chatbots: A disguised enemy for academic integrity?
Niloy, A. C., Hafiz, R., Hossain, B. M., Gulmeher, F., Sultana, N., Islam, K. F., Bushra, F., Islam, S., Hoque, S. I., Rahman, M., et al. (2024) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2024.100396 · Cited by 26 · see citing works
Hobert, S., & Berens, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-39540-7_18 · Cited by 24 · see citing works
Scaling mentoring support with distributed artificial intelligence
Klamma, R., de Lange, P., Neumann, A. T., Hensen, B., Kravcik, M., Wang, X., & Kuzilek, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49663-0_6 · Cited by 25 · see citing works
Reina-Parrado, M., Román-Graván, P., & Hervás-Gómez, C. (2025) · European Journal of Educational Research · doi:10.12973/eu-jer.14.1.249 · Cited by 13 · see citing works
Exploring Student Perspectives on ChatGPT in Higher Education
Shard, Vaidya, P., Koul, S., Arora, A., Sonia, & Jain, P. (2024) · 2024 3rd Edition of IEEE Delhi Section Flagship Conference (DELCON) · doi:10.1109/delcon64804.2024.10866660 · Cited by 3 · see citing works
- Authors
- Winkler, R., & Soellner, M.
- Affiliations
- University of Kassel (DE)
- ORCID
- Winkler, Rainer
- Venue
- Academy of Management Proceedings
- Publisher
- Academy of Management
- Published
- 2018-08
- Volume
- 2018
- Issue
- 1
- Pages
- 15903
- ISSN
- 0065-0668 (ISSN-L)
- 2151-6561
- OpenAlex
- W2795277066
- Cited by
- 581
- References
- 5
- Citations by year
- 2026: 79 · 2025: 151 · 2024: 108 · 2023: 85 · 2022: 62 · 2021: 49 · 2020: 31 · 2019: 14 · 2018: 2
- Type
- conference abstract
- Language
- en
- Open access
- closed
- Locations
- Academy of Management Proceedings (publishedVersion)
- Alexandria (UniSG) (University of St.Gallen) (acceptedVersion)
- Alexandria (UniSG) (University of St.Gallen) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › AI in Service Interactions
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- chatbots, chatbot-assisted learning, educational technology, large-scale machine learning, individual student support, learning outcomes, research gaps, input-process-output framework, future research directions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review