The relationship between student interaction with generative artificial intelligence and learning achievement: serial mediating roles of self-efficacy and cognitive engagement
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Generative artificial intelligence (GAI) shocked the world with its unprecedented ability and raised significant tensions in the education field. Educators inevitably transition to an educational future that embraces GAI rather than shuns it. Understanding the mechanism between students interacting with GAI tools and their achievement is important for educators and schools, but relevant empirical evidence is relatively lacking. Due to the characteristics of personalization and real-time interactivity of GAI tools, we propose that the students–GAI interaction would affect their learning achievement through serial mediators of self-efficacy and cognitive engagement. Based on questionnaire surveys that include 389 participants as the objective, this study finds that: (1) in total, there is a significantly positive relationship between student–GAI interaction and learning achievement. (2) This positive relationship is mediated by self-efficacy, with a significant mediation effect value of 0.015. (3) Cognitive engagement also acts as a mediator in the mechanism between the student–GAI interaction and learning achievement, evidenced by a significant and relatively strong mediating effect value of 0.046. (4) Self-efficacy and cognitive engagement in series mediate this positive association, with a serial mediating effect value of 0.011, which is relatively small in comparison but also shows significance. In addition, the propensity score matching (PSM) method is applied to alleviate self-selection bias, reinforcing the validity of the results. The findings offer empirical evidence for the incorporation of GAI in teaching and learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
SPSS and SAS procedures for estimating indirect effects in simple mediation models
Preacher, K. J., & Hayes, A. F. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206553 · Cited by 17,383 · cited 1×
“The bootstrap method is a kind of non-parametric Monte Carlo method (Preacher and Hayes, 2004, 2008).”
MethodChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004
Do Psychosocial and Study Skill Factors Predict College Outcomes? A Meta-Analysis.
Robbins, S. B., Lauver, K., Le, H., Davis, D., Langley, R., & Carlstrom, A. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.2.261 · Cited by 2,479
Creativity in the design process: co-evolution of problem–solution
Dorst, K., & Cross, N. (2001) · Design Studies · doi:10.1016/s0142-694x(01)00009-6 · Cited by 2,357
ChatGPT: five priorities for research
van Dis, E. A. M., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023) · Nature · doi:10.1038/d41586-023-00288-7 · Cited by 1,842 · cited 1×
“In addition, ChatGPT may give fake or erroneous references and generate flaw-and-confident answers (Van Dis et al., 2023).”
BackgroundThe influence of academic self-efficacy on academic performance: a systematic review.
Honicke, T., & Broadbent, J. (2016) · Educational Research Review · doi:10.1016/j.edurev.2015.11.002 · Cited by 1,554
The development of academic self-efficacy
Schunk, D. H., & Pajares, F. (2002) · Development of Achievement Motivation · doi:10.1016/b978-012750053-9/50003-6 · Cited by 1,426 · cited 1×
“…out that self-efficacy and cognitive engagement play mediating roles in relation to students’ motivation, understanding, learning and achievements (Schunk and Pajares, 2001; Bandura, 2006; Van Dinther et al., 2011; Chong et al., 2018; Nagadeepa, 2021; Chhetri and Baniya, 2022; Wei et al., 2023).”
BackgroundLim, W. M., Gunasekara, A., Pallant, J. L., Pallant, J. I., & Pechenkina, E. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100790 · Cited by 1,261
Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2304.01852 · Cited by 1,172
General self-efficacy in various domains of human functioning: evidence from five countries
Luszczynska, A., Gutiérrez‐Doña, B., & Schwarzer, R. (2005) · International Journal of Psychology · doi:10.1080/00207590444000041 · Cited by 1,127
Factors affecting students’ self-efficacy in higher education
van Dinther, M., Dochy, F., & Segers, M. (2011) · Educational Research Review · doi:10.1016/j.edurev.2010.10.003 · Cited by 967 · cited 1×
“…out that self-efficacy and cognitive engagement play mediating roles in relation to students’ motivation, understanding, learning and achievements (Schunk and Pajares, 2001; Bandura, 2006; Van Dinther et al., 2011; Chong et al., 2018; Nagadeepa, 2021; Chhetri and Baniya, 2022; Wei et al., 2023).”
BackgroundChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868
Summary of ChatGPT-Related research and perspective towards the future of large language models
Liu, Y., Han, T., Ma, S., Zhang, J., Yang, Y., Tian, J., He, H., Li, A., He, M., Liu, Z., et al. (2023) · Meta-Radiology · doi:10.1016/j.metrad.2023.100017 · Cited by 855
Loneliness and Social Internet Use: Pathways to Reconnection in a Digital World?
Nowland, R., Necka, E. A., & Cacioppo, J. T. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617713052 · Cited by 783
Self-Efficacy and Education and Instruction
Schunk, D. H. (1995) · The Plenum Series in Social/Clinical Psychology · doi:10.1007/978-1-4419-6868-5_10 · Cited by 720
Wang, M., & Eccles, J. S. (2012) · Journal of Research on Adolescence · doi:10.1111/j.1532-7795.2011.00753.x · Cited by 667 · cited 1×
“The higher level of cognitive engagement students exhibit in the learning process can result in better related academic outcomes (Zhu et al., 2009; Sedaghat et al., 2011; Wang and Eccles, 2012; Pietarinen et al., 2014).”
BackgroundAbstracts written by ChatGPT fool scientists
Else, H. (2023) · Nature · doi:10.1038/d41586-023-00056-7 · Cited by 611
Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?
O’Connor, S., & ChatGPT (2023) · Nurse Education in Practice · doi:10.1016/j.nepr.2022.103537 · Cited by 585 · cited 1×
“First, GAI has incredible capabilities to perform complex tasks such as writing articles (O’Connor, 2022), stories, poems, essays (Lucy and Bamman, 2021), images (Reed et al., 2023), providing textual summaries or extensions or even writing and debugging raw computer code (Kalliamvakou, 2022; Tate…”
MethodPeres, R., Schreier, M., Schweidel, D., & Sorescu, A. (2023) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2023.03.001 · Cited by 535
Resilience Building in Students: The Role of Academic Self-Efficacy
Cassidy, S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01781 · Cited by 495 · cited 1×
“On the other hand, higher self-efficacy links to improved academic performance has been extensively studied in the existing educational literature (Schunk, 1995; Robbins et al., 2004; Cassidy, 2015; Honicke and Broadbent, 2016; Doménech-Betoret et al., 2017; Yokoyama, 2019).”
BackgroundYu, H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1181712 · Cited by 409 · cited 1×
“In the evaluation system, in order to avoid plagiarism and other moral issues caused by using GAI, more attention should be paid to creativity, in-depth thinking and analysis, problem-solving and creative process, ability improvement etc. (Liu et al., ; Yu, 2023).”
Gender and Representation Bias in GPT-3 Generated Stories
Lucy, L., & Bamman, D. (2021) · Proceedings of the Third Workshop on Narrative Understanding · doi:10.18653/v1/2021.nuse-1.5 · Cited by 287
Chatterjee, J., & Dethlefs, N. (2023) · Patterns · doi:10.1016/j.patter.2022.100676 · Cited by 263
AI in higher education: A literature review of ChatGPT and guidelines for responsible implementation
Perera, P., & Lankathilaka, M. (2023) · International Journal of Research and Innovation in Social Science · doi:10.47772/ijriss.2023.7623 · Cited by 85
AI Image-Generation as a Teaching Strategy in Nursing Education
Reed, J., Alterio, B., Coblenz, H., O'Lear, T., & Metz, T. (2023) · Journal of Interactive Learning Research · doi:10.70725/729255gdiorw · Cited by 38 · cited 1×
“…incredible capabilities to perform complex tasks such as writing articles (O’Connor, 2022), stories, poems, essays (Lucy and Bamman, 2021), images (Reed et al., 2023), providing textual summaries or extensions or even writing and debugging raw computer code (Kalliamvakou, 2022; Tate et al., 2023).”
BackgroundALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments
Jia, Q., Cui, J., Xiao, Y., Liu, C., Rashid, P., & Gehringer, E. F. (2021) · arXiv · doi:10.48550/arxiv.2110.03895 · Cited by 33
GPT-3-driven pedagogical agents for training children's curious question-asking skills
Abdelghani, R., Wang, Y.-H., Yuan, X., Wang, T., Lucas, P., Sauzéon, H., & Oudeyer, P.-Y. (2022) · arXiv · doi:10.48550/arxiv.2211.14228 · Cited by 19
Cited by
Zhang, L., & Xu, J. (2025) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100978 · Cited by 168
Hwang, Y., & Wu, Y. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1455015 · Cited by 104
Bai, Y., & Wang, S. (2025) · Scientific Reports · doi:10.1038/s41598-025-08697-6 · Cited by 86
“Interaction theory provides a robust framework for analyzing human-machine interactions and human-environmental dynamics 15 .”
InfluentialMorales-García, W. C., Sairitupa-Sanchez, L. Z., Morales-García, S. B., & Morales-García, M. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1293437 · Cited by 54
Jia, W., Pan, L., & Neary, S. (2025) · Behavioral Sciences · doi:10.3390/bs15101348 · Cited by 45
“University students’ GenAI use involves their emotional needs, including feelings of efficacy, convenience, and trust (J. Liang et al., 2023; Biswas & Murray, 2024).”
Metadata
- Authors
- Liang, J., Wang, L., Luo, J., Yan, Y., & Fan, C.
- Venue
- Frontiers in Psychology
- Publisher
- Frontiers Media SA
- Published
- 2023-12-22
- Volume
- 14
- Pages
- 1285392-1285392
- ISSN
- 1664-1078 (ISSN-L)
- OpenAlex
- W4390111395
- Cited by
- 150
- References
- 32
- FWCI
- 35.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.