Development of mobile interactive courses based on an artificial intelligence chatbot on the communication software LINE
Abstract
Fighter jets are a critical national asset. Because of the high cost of their manufacture and that of their related equipment, both pilots and maintenance personnel must complete intensive training before coming into contact with a jet. Due to gradual military downsizing, one-on-one training is often impracticable, and the level of familiarization with procedures among personnel is difficult to measure. The US military introduced a chatbot as part of its digital training material to enhance training effectiveness and avoid equipment damage. In this study, the contribution of an artificial intelligence (AI) chatbot in training is explored. To evaluate the necessity of an AI chatbot, research samples were divided into two groups, namely an experimental and a control group, with 20 people in each group. A paired t test was employed for differentiation analysis of pretest and posttest average scores, revealing that the two groups exhibited a statistically significant improvement in their learning performance. In addition, the blend of analysis of variance results indicated significant differences between the two groups. The chatbot training was more effective than traditional instructor teaching in terms of trainee performance improvement.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Chatbots were designed to give encouraging messages if students failed to correctly answer questions.
“Chatbots were designed to give encouraging messages if students failed to correctly answer questions [30].”
From A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education (2023) · cites this paper as [30]
Cites
null (2016) · Philosophy Study · doi:10.17265/2159-5313/2016.09.003 · Cited by 28,317 · see citing works
Handbook of Latent Semantic Analysis
(2007) · Psychology Press eBooks · doi:10.4324/9780203936399 · Cited by 1,571 · see citing works
The computer for the 21 st century
Weiser, M. (1999) · ACM SIGMOBILE Mobile Computing and Communications Review · doi:10.1145/329124.329126 · Cited by 1,234 · see citing works
Journal of Applied Sciences Research
(2020) · Journal of Applied Sciences Research · doi:10.22587/jasr · Cited by 898 · see citing works
Xie, H., Chu, H.-C., Hwang, G.-J., & Wang, C.-C. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103599 · Cited by 713 · see citing works
Anderson, J. R., Boyle, C., & Reiser, B. (1985) · Science · doi:10.1126/science.228.4698.456 · Cited by 699 · see citing works
A New Chatbot for Customer Service on Social Media
Xu, A., Liu, Z., Guo, Y., Sinha, V. S., & Akkiraju, R. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025496 · Cited by 589 · see citing works
AutoTutor: A tutor with dialogue in natural language
Graesser, A. C., Lu, S., Jackson, G. T., Mitchell, H. H., Ventura, M., Olney, A. M., & Louwerse, M. M. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195563 · Cited by 567 · see citing works
Advances in Intelligent Tutoring Systems
Nkambou, R., Mizoguchi, R., & Bourdeau, J. (2010) · Studies in computational intelligence · doi:10.1007/978-3-642-14363-2 · Cited by 388 · see citing works
Conversations with AutoTutor Help Students Learn
Graesser, A. C. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0086-4 · Cited by 202 · see citing works
Schlesinger, A., O'Hara, K. P., & Taylor, A. S. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173889 · Cited by 142 · see citing works
Detection of Emotions during Learning with AutoTutor
Chipman, P., D’Mello, S. K., Gholson, B., Graesser, A. C., McDaniel, B., & Witherspoon, A. M. (2006) · eScholarship (California Digital Library) · Cited by 122 · see citing works
Abu-Naser, S. S. (2012) · International Journal of Artificial Intelligence & Applications · doi:10.5121/ijaia.2012.3206 · Cited by 104 · see citing works
An overview of artificial intelligence based chatbots and an example chatbot application
Albayrak, N., Ozdemir, A., & Zeydan, E. (2018) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu.2018.8404430 · Cited by 89 · see citing works
Martin, J. L., & Torok-Gerard, S. E. (2019) · doi:10.5040/9798400644078 · Cited by 89 · see citing works
Reinventing the Role of Information and Communications Technologies in Education
Dede, C. (2007) · Yearbook of the National Society for the Study of Education · doi:10.1111/j.1744-7984.2007.00113.x · Cited by 85 · see citing works
Chakrabarti, C., & Luger, G. F. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.04.067 · Cited by 83 · see citing works
Chandra, Y. W., & Suyanto, S. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.08.179 · Cited by 73 · see citing works
Chu, H., Chen, J., Hwang, G., & Chen, T.-W. (2017) · Universal Access in the Information Society · doi:10.1007/s10209-017-0588-y · Cited by 72 · see citing works
Development of Ubiquitous Learning Environment Based on Moodle Learning Management System
Suartama, I. K., Setyosarı, P., Sulthoni, S., & Ulfa, S. U. (2020) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v14i14.11775 · Cited by 65 · see citing works
Abu-Naser, S. S. (2006) · Information Technology Journal · doi:10.3923/itj.2006.916.922 · Cited by 60 · see citing works
Janarthanam, S. (2017) · CERN Document Server (European Organization for Nuclear Research) · Cited by 55 · see citing works
Sung, H., Hwang, G., Wu, P.-H., & Lin, D.-Q. (2018) · Interactive Learning Environments · doi:10.1080/10494820.2018.1437049 · Cited by 43 · see citing works
Computer Assisted Language Learning
Sudaryanto, A., & Andri, D. (2019) · Cited by 32 · see citing works
Baker, D. L., Ma, H., Polanco, P., Conry, J. M., Kamata, A., Otaiba, S. A., Ward, W., & Cole, R. (2020) · Journal of Research on Technology in Education · doi:10.1080/15391523.2020.1762519 · Cited by 28 · see citing works
Liao, C.-H., Kuo, B., Tsao, C.-J., & Mok, M. M. C. (2020) · Educational Psychology · doi:10.1080/01443410.2020.1771286 · Cited by 18 · see citing works
BRAIN. Broad Research in Artificial Intelligence and Neuroscience
Mavroudis, I. A., Petridis, F. E., Kazis, D., Ionescu, C., Petroaie, A., Romila, L., Kamal, F. Z., Ciobîcă, A., Moroșan, G., Novac, B., et al. (2020) · BRAIN BROAD RESEARCH IN ARTIFICIAL INTELLIGENCE AND NEUROSCIENCE · doi:10.18662/brain/ · Cited by 15 · see citing works
Domain knowledge query conversation bots in instant messaging (IM)
Goh, O. S., Fung, C. C., & Depickere, A. A. (2008) · Knowledge-Based Systems · doi:10.1016/j.knosys.2008.03.055 · Cited by 12 · see citing works
A Conversation-Based Intelligent Tutoring System Benefits Adult Readers with Low Literacy Skills
Fang, Y., Lippert, A. M., Cai, Z., Hu, X., & Graesser, A. C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22341-0_47 · Cited by 10 · see citing works
Application of Human-Machine Dialogue in Foreign Language Teaching at Universities
Liu, T., Yuizono, T., Lu, Y., & Wang, Z. (2019) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/573/1/012047 · Cited by 9 · see citing works
Westberg, S. (2019) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 7 · see citing works
QnAMaker: Data to Bot in 2 Minutes
Agrawal, P., Menon, T., Kam, A., Naim, M., Chouragade, C., Singh, G., Kulkarni, R., Suri, A., Katakam, S., Pratik, V., et al. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366424.3383525 · Cited by 7 · see citing works
Goldberg, B., Sinatra, A. M., Sottilare, R. A., Moss, J. D., & Graesser, A. C. (2015) · doi:10.13140/rg.2.1.3464.6482 · Cited by 5 · see citing works
Sur les tensions des dépôts électrolytiques des métaux
Marie, C., & Thon, N. (1932) · Journal de Chimie Physique · doi:10.1051/jcp/1932290011 · Cited by 4 · see citing works
A Dialog-Based Intelligent Tutoring System for Practicing Battle Command Reasoning
Ryder, J. M., Graesser, A. C., Mentec, J.-C. L., Louwerse, M. M., & Karnavat, A. (2004) · doi:10.21236/ada425430 · Cited by 2 · see citing works
Kuo, B., Lin, C.-H., Pai, K.-C., Shih, S.-C., & Liao, C.-H. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22341-0_34 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Deng, X., & Yu, Z. (2023) · Sustainability · doi:10.3390/su15042940 · Cited by 298 · see citing works
An analysis of children’ interaction with an AI chatbot and its impact on their interest in reading
Liu, C.-C., Liao, M.-G., Chang, C.-H., & Lin, H.-M. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104576 · Cited by 240 · see citing works
Tai, T., & Chen, H. H.-J. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105112 · Cited by 281 · see citing works
Zhang, R., Zou, D., & Cheng, G. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2202704 · Cited by 117 · see citing works
Chai, C. S., Chiu, T. K. F., Wang, X., Jiang, F., & Lin, X. (2022) · Sustainability · doi:10.3390/su15010605 · Cited by 101 · see citing works
“Yuan et al. [37] indicated that the benefit of AI chatbots lies in promoting students’ self-learning without an instructor in mobile interactive courses.”
Durak, H. Y. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11149-7 · Cited by 91 · see citing works
Artificial intelligence in classroom discourse: A systematic review of the past decade
Wang, D., Yang, T., & Chen, G. (2023) · International Journal of Educational Research · doi:10.1016/j.ijer.2023.102275 · Cited by 84 · see citing works
Xu, Y., Zhu, J., Wang, M., Qian, F., Yang, Y., & Zhang, J. (2024) · Applied Sciences · doi:10.3390/app14156418 · Cited by 60 · see citing works
Vázquez-Parra, J. C., Henao-Rodríguez, C., Lis-Gutiérrez, J. P., & Palomino-Gámez, S. (2024) · Societies · doi:10.3390/soc14080141 · Cited by 37 · see citing works
“By integrating AI training into their curricula, universities equip their students with the technical skills necessary to navigate and thrive in increasingly digitized work environments and foster a more profound understanding of these technologies’ ethical, social, and economic implications [3].”
BackgroundHong, J., & Tai, T. (2024) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2024.2347884 · Cited by 40 · see citing works
Using ChatGPT for medical education: the technical perspective
Chan, K. Y., Yuen, T. H., & Co, M. (2025) · BMC Medical Education · doi:10.1186/s12909-025-06785-9 · Cited by 34 · see citing works
“For offline learning scenarios, AI chatbots have been implemented to assist students across diverse subjects such as English [41], Chinese [42], engineering [43], clinical chemistry laboratory [44], and computer science [45, 46].”
Designing chatbots in language classrooms: an empirical investigation from user learning experience
Wiboolyasarin, W., Wiboolyasarin, K., Tiranant, P., Boonyakitanont, P., & Jinowat, N. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00319-4 · Cited by 27 · see citing works
“” Derived from previous literature in relevant fields (Annamalai et al., 2023a, 2023b; Chen et al., 2020; Guo et al., 2023; Yuan et al., 2023; Zhang et al., 2023c), these question items were translated into Thai to ensure response validity, following recommended steps of forward translation,…”
BackgroundMethodResultInfluentialRücker, C. R., & Becker, S. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100315 · Cited by 15 · see citing works
An Examination of Studies on the Use of Chatbot Technology in the Field of Education
Durak, H. Y., & Onan, A. (2023) · International Conference on Applied Engineering and Natural Sciences · doi:10.59287/icaens.978 · Cited by 14 · see citing works
“For instance, Villegas-Ch et al. [18] and Yuan et al. [19] developed AI-based chatbot designs, while Yildiz Durak [17] implemented a rule-based chatbot design.”
MethodBARAN, Z., & Karaca, Ş. (2024) · Current Issues in Tourism · doi:10.1080/13683500.2024.2440809 · Cited by 13 · see citing works
“Yuan et al. (2021) found that chatbot applications significantly impact customer attitude, Leppäniemi et al. (2017) demonstrated the significant effect of interactive response systems on customer attitude, and Wang et al. (2021) reported a significant impact of augmented reality applications on…”
Design based Retrieval Augmented Generation Oriented Education Chatbot: Edubot
Pandey, T., Yadav, A., Sharma, J., & Singhal, S. (2024) · International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT) · doi:10.1109/icaiccit64383.2024.10912174 · Cited by 12 · see citing works
“Studies have shown that AI chatbots can be more effective than teachers at guiding students as they learn [11].”
Dünya, B. A., & Durak, H. Y. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01800-x · Cited by 12 · see citing works
“Yuan et al. (2021) suggested embedding educational interactive tutorials and videos to chatbots to improve students’ learning experience and user practicality.”
Perception of AI tool adoption and training: initial validation using GSEM method
Parra, J. C. V., Henao-Rodríguez, C., Lis-Gutiérrez, J.-P., Palomino-Gámez, S., & Suárez-Brito, P. (2024) · Applied Computing and Informatics · doi:10.1108/aci-09-2024-0370 · Cited by 6 · see citing works
AI-Driven User Interface Design for Solving a Rubik’s Cube: A Scaffolding Design Perspective
Wu, D., Tang, H., Bradley, C., Capps, B., Singh, P., Wyandt, K., Wong, K., Irvin, M. J., Agostinelli, F., & Srivastava, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17615-9_34 · Cited by 2 · see citing works
Matsumoto, K., Sasayama, M., & Kirihara, T. (2022) · Sensors · doi:10.3390/s22020694 · Cited by 2 · see citing works
Ichou, S., & Veress, Á. (2024) · Acta Polytechnica Hungarica · doi:10.12700/aph.21.6.2024.6.10 · Cited by 1 · see citing works
Ararat-Isaeva, M., Ararat-Isaev, M. Y., Tokmakova, M., & Lapin, V. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-78776-8_27 · Cited by 1 · see citing works
(2023) · دراسات تربوية ونفسية مجلة کلية التربية بالزقازيق · doi:10.21608/sec.2023.335163
Deciphering User Gaze Dynamics: Interacting an AI-Driven Platform with a Chatbot for Problem Solving
Fu, J. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-71385-9_3
Does AI-assisted Learning Improve Students' Learning Outcomes? Evidence From A Meta-analysis
Liu, C., Meng, H., Zhu, H., & Rong, C. (2026) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-026-01104-2 · Cited by 1 · see citing works
“…17 motivation Interactive learning environments 46 Yang ( 2023) 18 16 motivation, learning achievement International journal of educational technology in higher education 47 Yuan. et al. (2021 ) 20 20 learning achievement Interactive learning environments Table 1 The included studies (N = 49) 1 3”
Using chatbot in education – A systematic review and research agenda
Wut, T. M., Low, M. P., & Tam, K.-W. (2026) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2026.102956
- Authors
- Yuan, C.-C., Li, C.-H., & Peng, C.-C.
- Affiliations
- National Taichung University of Education (TW)
- The 3rd Tactical Fighter Wing of ROC Air Force
- Corresponding author
- Yuan, Chia-Ching
- Venue
- Interactive Learning Environments
- Publisher
- Informa UK Limited
- Published
- 2021-06-09
- Volume
- 31
- Issue
- 6
- Pages
- 3562-3576
- ISSN
- 1049-4820 (ISSN-L)
- 1744-5191
- OpenAlex
- W3169680066
- Cited by
- 26
- References
- 36
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 10 · 2023: 6 · 2022: 5
- FWCI
- 1.86
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Interactive Learning Environments (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Keywords
- AI chatbots, LINE messaging app, mobile learning, military education, training effectiveness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
