Can Multimodal Large Language Models Enhance Performance Benefits Among Higher Education Students? An Investigation Based on the Task–Technology Fit Theory and the Artificial Intelligence Device Use Acceptance Model
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
The current study highlights the potential of multimodal large language models (MLLMs) to transform higher education by identifying key factors influencing their acceptance and effectiveness. Aligning technology features with educational needs can enhance student engagement and learning outcomes. The study examined the role of MLLMs in enhancing performance benefits among higher education students, using the task–technology fit (T-TF) theory and the artificial intelligence device use acceptance (AIDUA) model. A structured questionnaire was used to assess the perceptions of 550 Saudi university students from various academic disciplines. The data were analyzed via structural equation modeling (SEM) using SmartPLS 3.0. The findings revealed that social influence negatively affected effort expectancy regarding MLLMs and that hedonic motivation was also negatively related to effort expectancy. The findings revealed that social influence and hedonic motivation negatively affected effort expectancy for MLLMs. Effort expectancy was also negatively associated with T-TF in the learning context. In contrast, task and technology characteristics significantly influenced T-TF, which positively impacted both performance benefits and the willingness to accept the use of MLLMs. A strong relationship was found between adoption willingness and improved performance benefits. The findings empower educators to strategically enhance MLLMs adoption strategically, driving transformative learning outcomes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021) · Classroom Companion: Business · doi:10.1007/978-3-030-80519-7 · Cited by 10,343 · cited 2×
“According to Hair et al. [96], PLS-SEM does not require data to follow a normal distribution, allowing it to handle datasets with significant deviations from normality, such as skewness and kurtosis.”
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 2×
“…found for technology characteristics and T-TF ( β = − 0.692, t = 4.952, p < 0.01), T-TF and performance benefits ( β = 0.515, t = 5.104, p < 0.01), and T-TF and the willingness to accept the use of MLLMs ( β = 0.555, t = 4.594, p < 0.01); thus, Hypotheses 5, 6, and 7, respectively, were accepted.”
InfluentialTask-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006 · cited 6×
“Understanding these components is essential for selecting the appropriate technology that meets users’ needs and supports their goals efficiently and effectively [14].”
InfluentialBAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
Progress on a cognitive-motivational-relational theory of emotion
Lazarus, R. S. (1991) · American Psychologist · doi:10.1037/0003-066x.46.8.819 · Cited by 3,272
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004 · cited 3×
“These models are the result of tremendous progress in the field of NLP, as they provide extensive possibilities for creating diverse content by utilizing available digital content (video, images, graphics, texts, etc.) [24].”
Cognition and motivation in emotion.
Lazarus, R. S. (1991) · American Psychologist · doi:10.1037/0003-066x.46.4.352 · Cited by 2,096
A survey on large language model based autonomous agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40231-1 · Cited by 1,941
A Survey on Large Language Model based Autonomous Agents
Wang, L., Ma, C., Feng, X., Zhang, Z., Yang, H., Zhang, J., Chen, Z., Tang, J., Chen, X., Lin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2308.11432 · Cited by 1,925
Consumers acceptance of artificially intelligent (AI) device use in service delivery
Gursoy, D., Chi, O. H., Lu, L., & Nunkoo, R. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.03.008 · Cited by 1,437 · cited 5×
“Several other studies concur with this result [21,97,101,102].”
InfluentialExamining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263 · cited 1×
“[28], 2023, Australia, cited by 750.”
Challenges and Opportunities of Generative AI for Higher Education as Explained by ChatGPT
Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R., & Gerardou, F. S. (2023) · Education Sciences · doi:10.3390/educsci13090856 · Cited by 877 · cited 3×
“This feedback contributes to improving the learning process and adapting it to the needs of each student [24,25].”
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839
Strzelecki, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2209881 · Cited by 807 · cited 2×
“In e-learning, hedonic motivation notably influences learners’ attitudes toward AI tools, increasing the likelihood of adoption for technologies that enhance enjoyment and engagement [44,45].”
Raza, S. A., Qazi, W., Khan, K. A., & Salam, J. (2021) · Journal of Educational Computing Research · doi:10.1177/0735633120960421 · Cited by 510
Prompt Engineering in Large Language Models
Marvin, G., Hellen, N., Jjingo, D., & Nakatumba-Nabende, J. (2024) · Algorithms for Intelligent Systems · doi:10.1007/978-981-99-7962-2_30 · Cited by 403
Menon, D., & Shilpa, K. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e20962 · Cited by 359
Large Language Models Are Human-Level Prompt Engineers
Zhou, Y., Muresanu, A. I., Han, Z., Paster, K., Pitis, S., Chan, H., & Ba, J. (2022) · arXiv · doi:10.48550/arxiv.2211.01910 · Cited by 330 · cited 2×
“Furthermore, the integration of different technologies into one model can contribute to creating a smoother and more effective user experience [18].”
ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model
Huang, H., Zheng, O., Wang, D., Yin, J., Wang, Z., Ding, S., Yin, H., Xu, C., Yang, R., Zheng, Q., et al. (2023) · International Journal of Oral Science · doi:10.1038/s41368-023-00239-y · Cited by 324 · cited 1×
“MLLMs are effective in achieving valuable learning outcomes for higher education students [4,5], especially regarding learning methods and strategies [6].”
Camilleri, M. A. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123247 · Cited by 261
Alyoussef, I. Y. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e13751 · Cited by 181
Tran, A. Q., Nguyen, L. H., Nguyen, H. S. A., Nguyen, C. T., Vu, L. G., Zhang, M., Vu, T. M. T., Nguyen, S. H., Tran, B. X., Latkin, C. A., et al. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.755644 · Cited by 87
Al-Abdullatif, A. M., Al-Dokhny, A. A., & Drwish, A. M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1129070 · Cited by 80
Self-citationSchepart, A., Burton, A., Durkin, L., Fuller, A., Charap, E., Bhambri, R., & Ahmad, F. S. (2023) · Cardiovascular Digital Health Journal · doi:10.1016/j.cvdhj.2023.04.003 · Cited by 40
Cited by
Zhang, J., & Liu, W. (2026) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2026.2682435 · Cited by 25
Shen, M., Shen, Y., & Shi, Z. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104612 · Cited by 8
Cobelli, N., Grimaldi, M., Ugolini, M. M., Maione, G., & De Cristofaro, C. (2026) · Springer Proceedings in Complexity · doi:10.1007/978-3-032-09062-1_1 · Cited by 1
Metadata
- Authors
- Al-Dokhny, A., Alismaiel, O., Youssif, S., Nasr, N., Drwish, A., & Samir, A.
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2024-12-09
- Volume
- 16
- Issue
- 23
- Pages
- 10780
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W4405191005
- Cited by
- 38
- References
- 25
- FWCI
- 14.49
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.