Using a Chatbot to Provide Formative Feedback: A Longitudinal Study of Intrinsic Motivation, Cognitive Load, and Learning Performance
The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
This study aimed to examine sustainable effects of chatbot-based formative feedback on intrinsic motivation, cognitive load, and learning performance. A longitudinal quasi-experimental design with 173 undergraduate students was conducted. The experiment is a between-subject design. Students either received formative feedback from a chatbot or a teacher. Utilizing linear mixed model (LMM) and T-test for data analysis, results showed that (1) chatbot-based feedback resulted in increased learning interest, perceived choice, and value while decreasing perceived pressure over time; (2) chatbot-based feedback was effective in reducing cognitive load, particularly when learning contents involved conceptual or difficult knowledge; and (3) chatbot-based feedback was found to be more efficient and effective in supporting the mastery of application-based knowledge compared to teacher-based feedback. This study has practical implications for the design of chatbots, it also enriches the methods of providing ongoing formative feedback in large-scale classrooms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Ryan, R. M., & Deci, E. L. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101860 · Cited by 6,037
Cognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023
Sweller, J., Ayres, P., & Kalyuga, S. (2011) · doi:10.1007/978-1-4419-8126-4 · Cited by 5,531
Fitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9781119513469 · Cited by 4,639
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
McAuley, E., Duncan, T., & Tammen, V. V. (1989) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1989.10607413 · Cited by 2,694
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Why Some Material Is Difficult to Learn
Sweller, J., & Chandler, P. (1994) · Cognition and Instruction · doi:10.1207/s1532690xci1203_1 · Cited by 1,455
Instructional control of cognitive load in the training of complex cognitive tasks
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Educational Psychology Review · doi:10.1007/bf02213420 · Cited by 968 · cited 1×
“AccordingtothePaasandMerrienboermodel[43], thementalloadcanbedeterminedbasedonourcurrentunder-standingofthetaskandsubjectcharacteristics.”
Engineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2023) · 2023 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon54358.2023.10125121 · Cited by 707 · cited 1×
“To address these challenges, previous researchers proposed incorporating artificial intelligence (AI) technology to provide personalized and instant feedback, as well as create interactive learning materials (e.g., interactive quizzes or games) to increase student engagement [5].”
BackgroundUnleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis
Winkler, R., & Soellner, M. (2018) · Academy of Management Proceedings · doi:10.5465/ambpp.2018.15903abstract · Cited by 581
Chatbot learning partners: connecting learning experiences, interest and competence
Fryer, L. K., Nakao, K., & Thompson, A. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.023 · Cited by 470
Learning science in virtual reality multimedia environments: Role of methods and media
Moreno, R., & Mayer, R. E. (2002) · Journal of Educational Psychology · doi:10.1037/0022-0663.94.3.598 · Cited by 438
Essel, H. B., Vlachopoulos, D., Tachie-Menson, A., Johnson, E. E., & Baah, P. K. (2022) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-022-00362-6 · Cited by 428 · cited 1×
“For example, Essel et al. [27] used a chatbot that automatically responds to a student’s question.”
BackgroundThe challenges of feedback in higher education
Henderson, M., Ryan, T., & Phillips, M. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1599815 · Cited by 335 · cited 1×
“Ingeneral,teacher-basedfeedbacklackspersonalization, immediacy, and interactive elements [21], [22].”
Lee, Y.-F., Hwang, G.-J., & Chen, P.-Y. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10142-8 · Cited by 323
Formative assessment and feedback: Making learning visible
Havnes, A., Smith, K., Dysthe, O., & Ludvigsen, K. (2012) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2012.04.001 · Cited by 276
A ChatBot for Learning Chinese: Learning Achievement and Technology Acceptance
Chen, H.-L., Vicki Widarso, G., & Sutrisno, H. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633120929622 · Cited by 220
Han, J.-W., Park, J., & Lee, H. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03898-3 · Cited by 187
Fidan, M., & Gencel, N. (2022) · Journal of Educational Computing Research · doi:10.1177/07356331221077901 · Cited by 186
AcaWriter: A learning analytics tool for formative feedback on academic writing
Knight, S., Shibani, A., Abel, S., Gibson, A., & Ryan, P. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.06 · Cited by 151
Cited by
Sun, L., & Zhou, L. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241277937 · Cited by 129
“…2022; Qureshi, 2023), foster critical thinking (Essien et al., 2024), and stimulate interest in learning (Han et al., 2022), enhancing motivation (Yilmaz & Yilmaz, 2023), learning engagement (Ouyang et al., 2022), learning satisfaction (Li, 2023), and learning self-ef fi cacy (Yin et al., 2024).”
Understanding the place and value of GenAI feedback: a recognition-based framework
Corbin, T., Tai, J., & Flenady, G. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2459641 · Cited by 73
Xia, Q., Li, W., Yang, Y., Weng, X., & Chiu, T. K. F. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100455 · Cited by 45
Effects of different AI-driven Chatbot feedback on learning outcomes and brain activity
Yin, J., Xu, H., Pan, Y., & Hu, Y. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00311-8 · Cited by 41
Self-citationHuang, Y.-M., Chen, P.-H., Lee, H.-Y., Sandnes, F. E., & Wu, T.-T. (2025) · Computers in Human Behavior · doi:10.1016/j.chb.2025.108659 · Cited by 35
Metadata
- Authors
- Yin, J., Goh, T.-T., & Hu, Y.
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2024
- Volume
- 17
- Pages
- 1378-1389
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W4391661558
- Cited by
- 64
- References
- 24
- FWCI
- 9.52
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.