Advantages and constraints of a hybrid model K–12 e-learning assistant chatbot
Open accessThe DOI matches its Crossref record; 38 of the 39 references it cites were found in a registry or an index.
Abstract
E-Learning has become more and more popular in recent years with the advance of new technologies. Using their mobile devices, people can expand their knowledge anytime and anywhere. E-Learning also makes it possible for people to manage their learning progression freely and follow their own learning style. However, studies show that E-Learning can cause the user to experience feelings of isolation and detachment due to the lack of human-like interactions in most E-Learning platforms. These feelings could reduce the user's motivation to learn. In this paper, we explore and evaluate how well current chatbot technologies assist users' learning on E-Learning platforms and how these technologies could possibly reduce problems such as feelings of isolation and detachment. For evaluation, we specifically designed a chatbot to be an E-Learning assistant. The NLP core of our chatbot is based on two different models: a retrieval-based model and a QANet model. We designed this two-model hybrid chatbot to be used alongside an E-Learning platform. The core response context of our chatbot is not only designed with course materials in mind but also everyday conversation and chitchat, which make it feel more like a human companion. Experiment and questionnaire evaluation results show that chatbots could be helpful in learning and could potentially reduce E-Learning users' feelings of isolation and detachment. Our chatbot also performed better than the teacher counselling service in the E-Learning platform on which the chatbot is based.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For example, a study by Wu et al. (p.77798, [32]) reported that student engagement with a responsive chatbot that acted as both a teaching assistant and companion “could reduce feelings of isolation and detachment with greater effect than teacher counselling services”.”
From Generative Artificial Intelligence: Implications and Considerations for Higher Education Practice (2023) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · cited 2×
“We evaluated EM/F1 scores with SQuAD standardize datasets from [50] and [51], placing performance test of response context design and training time of our implemented QANet model in section IV.”
MethodReading Wikipedia to answer open-domain questions
Chen, D., Fisch, A., Weston, J., & Bordes, A. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1171 · Cited by 1,546
Bidirectional Attention Flow for Machine Comprehension
Seo, M. J., Kembhavi, A., Farhadi, A., & Hajishirzi, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01603 · Cited by 1,445
From Eliza to XiaoIce: Challenges and opportunities with social chatbots
Shum, H.-Y., He, X.-D., & Li, D. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700826 · Cited by 749 · cited 1×
“These AI advancements show that early rule-based dialogue or conversational systems like Eliza and Alice mentioned in [19] could be greatly improved by machine learning.”
BackgroundAmbient Intelligence—the Next Step for Artificial Intelligence
Ramos, C., Augusto, J. C., & Shapiro, D. (2008) · IEEE Intelligent Systems · doi:10.1109/mis.2008.19 · Cited by 431
Machine Comprehension Using Match-LSTM and Answer Pointer
Wang, S., & Jiang, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.07905 · Cited by 408
QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension
Yu, A. W., Dohan, D., Luong, M.-T., Zhao, R., Chen, K., Norouzi, M., & Le, Q. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.09541 · Cited by 368
Artificial Intelligence as an Effective Classroom Assistant
du Boulay, B. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.93 · Cited by 213 · cited 1×
“In [14], Benedict du Boulay discusses using AI in the education field to assist in learning.”
BackgroundReinforced Mnemonic Reader for Machine Reading Comprehension
Hu, M., Peng, Y., Huang, Z., Qiu, X., Wei, F., & Zhou, M. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/570 · Cited by 199
Stochastic Answer Networks for Machine Reading Comprehension
Liu, X., Shen, Y., Duh, K., & Gao, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1157 · Cited by 197
Smart Reply: Automated Response Suggestion for Email
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G., Lukacs, L., Ganea, M., Young, P., et al. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939801 · Cited by 183
Making Neural QA as Simple as Possible but not Simpler
Weissenborn, D., Wiese, G., & Seiffe, L. (2017) · Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) · doi:10.18653/v1/k17-1028 · Cited by 164
Smart Reply: Automated Response Suggestion for Email
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G. S., Lukacs, L., Ganea, M., Young, P., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04870 · Cited by 134
Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media
Hu, T., Xu, A., Liu, Z., You, Q., Guo, Y., Sinha, V., Luo, J., & Akkiraju, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173989 · Cited by 128
FusionNet: Fusing via Fully-Aware Attention with Application to Machine Comprehension
Huang, H.-Y., Zhu, C., Shen, Y., & Chen, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07341 · Cited by 123
EEG-Based Mobile Robot Control Through an Adaptive Brain–Robot Interface
Gandhi, V., Prasad, G., Coyle, D., Behera, L., & McGinnity, T. M. (2014) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2014.2313317 · Cited by 108
Artificial Intelligence Markup Language: A Brief Tutorial
Bruno Marietto, M. D. G., Aguiar, R. V., Barbosa, G. D. O., Botelho, W. T., Pimentel, E., Franca, R. D. S., & da Silva, V. L. (2013) · International Journal of Computer Science & Engineering Survey · doi:10.5121/ijcses.2013.4301 · Cited by 97
Designing and Implementing a Human–Robot Team for Social Interactions
Zheng, K., Glas, D. F., Kanda, T., Ishiguro, H., & Hagita, N. (2013) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmca.2012.2216870 · Cited by 46
Structural Embedding of Syntactic Trees for Machine Comprehension
Liu, R., Hu, J., Wei, W., Yang, Z., & Nyberg, E. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1085 · Cited by 45
Isolation and distinctiveness in the design of e-learning systems influence user preferences
Al‐Samarraie, H., Selim, H. M., Teo, T. P., & Zaqout, F. (2016) · Interactive Learning Environments · doi:10.1080/10494820.2016.1138313 · Cited by 43
TickTock: A Non-Goal-Oriented Multimodal Dialog System with Engagement Awareness
Zhou, Y., Papangelis, A., & Rudnicky, A. I. (2015) · National Conference on Artificial Intelligence · Cited by 41
Bernik, A., Bubaš, G., & Radošević, D. (2018) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro.2018.8400149 · Cited by 37
Contextualized Word Representations for Reading Comprehension
Salant, S., & Berant, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2088 · Cited by 33
Tutor as an important e-learning support
Klímová, B., & Poulová, P. (2011) · Procedia Computer Science · doi:10.1016/j.procs.2011.01.036 · Cited by 32
Enhancing e-Learning Content by Using Semantic Web Technologies
García-González, H., Gayo, J. E. L., & Ruiz, M. P. P. (2016) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2629475 · Cited by 30
Schumaker, R. P., & Chen, H. (2009) · IEEE Transactions on Systems Man and Cybernetics - Part A Systems and Humans · doi:10.1109/tsmca.2009.2029603 · Cited by 29
Muñoz‐Merino, P. J., Kloos, C. D., & Muñoz-Organero, M. (2010) · IEEE Transactions on Education · doi:10.1109/te.2010.2045001 · Cited by 25
System Interactive Cyber Presence for E learning to Break Down Learner Isolation
Mourad, B., Ayaou, T., Karim, A., & Estraillier, P. (2015) · International Journal of Computer Applications · doi:10.5120/19626-1544 · Cited by 25
Production Ready Chatbots: Generate if not RetrievePreprint
Tammewar, A., Pamecha, M., Jain, C., Nagvenkar, A. S., & Modi, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09684 · Cited by 18
Multi-agent systems in e-learning
Nadrljanski, M., Vukić, Đ., & Nadrljanski, Đ. (2018) · International Convention on Information and Communication Technology, Electronics and Microelectronics · doi:10.23919/mipro.2018.8400181 · Cited by 18
Cloud computing and e-learning and their benefits for the institutions of higher learning
Klímová, B., & Marešová, P. (2016) · IEEE Conference on e-Learning, e-Management and e-Services (IC3e) · doi:10.1109/ic3e.2016.8009043 · Cited by 16
Austin, R., Sharma, M., Moore, P. T., & Newell, D. (2013) · ... International Conference on Complex, Intelligent and Software Intensive Systems · doi:10.1109/cisis.2013.95 · Cited by 12
Improving Retrieval Modeling Using Cross Convolution Networks And Multi Frequency Word EmbeddingPreprint
An, G., Shafiee, M., & Shamsi, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05373 · Cited by 7
Wu, E. H., Chuang, S.-M., Shih, C., Hsueh, H., Huang, S., & Huang, H. (2017) · Software Practice and Experience · doi:10.1002/spe.2479 · Cited by 6
Self-citationE-learning paradigms: A model to address known issues
Montebello, M. (2017) · 2017 Computing Conference · doi:10.1109/sai.2017.8252240 · Cited by 6
Transformer-DARwIn: A miniature humanoid for potential robot companion
Vaz, J. C., & Oh, P. (2018) · International Conference on Consumer Electronics · doi:10.1109/icce.2018.8326294 · Cited by 3
Research works printed but not linked: 27
- 2018, The Messenger
- graesser, 2018, AutoTutor
- 2018, Chatfuel
- 2018, Microsoft Bot Framework
- 2018, Telegram
- 2018, Jill Watson
- 2018, Deakin Genie
- 2018, IBM Watson
- 2017, The Summit Learning Platform
- 2018, Siri
- 2018, XiaoIce
- 2018, Alexa
- 2018, Forbes Asia Bot
- 2018, Got It Study
- 2018, TaxiGo Bot
- 2018, SQuAD
- 2018, Y R NLP MARS (Ensemble) Multi-Attention Readers
- 2017, R-NET Machine Reading Comprehension with Self-matching Networks
- 2018, Github Fxsjy/Jieba
- 2018, DeepMind
- 2018, Google Assistant
- 2018, Google I/O
- 2018, Google AI Blog Google Duplex
- dn, 2017, E-learning
- 2017, Docebo-eLearning-Trends-for-2018 Whitepaper
- 2018, CNN News Messenger Bot
- 2018, Pizza Hut Messenger Bot
Cited by
Chatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879
Do AI chatbots improve students learning outcomes? Evidence from a meta‐analysis
Wu, R., & Yu, Z. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13334 · Cited by 576
A review of opportunities and challenges of chatbots in education
Hwang, G.-J., & Chang, C.-Y. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1952615 · Cited by 530
“, 2015), and improving learners’ learning efficiency (Wu et al., 2020).”
BackgroundDu, J., & Daniel, B. K. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100230 · Cited by 522
Generative Artificial Intelligence: Implications and Considerations for Higher Education Practice
Farrelly, T., & Baker, N. (2023) · Education Sciences · doi:10.3390/educsci13111109 · Cited by 414
“For example, a study by Wu et al. (p. 77798, [32]) reported that student engagement with a responsive chatbot that acted as both a teaching assistant and companion “could reduce feelings of isolation and detachment with greater effect than teacher counselling services”.”
Background
Metadata
- Authors
- Wu, E. H.-K., Lin, C.-H., Ou, Y.-Y., Liu, C.-Z., Wang, W.-K., & Chao, C.-Y.
- Affiliations
- National Central University (TW)
- Yuan Ze University (TW)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 77788-77801
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3016364508
- Cited by
- 205
- References
- 39
- Citations by year
- 2026: 18 · 2025: 35 · 2024: 51 · 2023: 50 · 2022: 29 · 2021: 19 · 2020: 3
- FWCI
- 9.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Ministry of Science and Technology, Taiwan (108-2221-E-008-034)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- chatbots, online learning, K-12 education, retrieval-based chatbots, student motivation, chatbot evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.