Does ChatGPT Play a Double-Edged Sword Role in the Field of Higher Education? An In-Depth Exploration of the Factors Affecting Student Performance
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
The application of generative artificial intelligence in the field of education has been receiving increasing attention, with the performance of chatbot ChatGPT being particularly prominent. This study aims to explore in depth the performance impact on higher education students utilizing ChatGPT. To this end, we conducted a survey on 448 university students and employed the partial-least squares (PLS) method of structural equation modeling for data analysis. The results indicate that all eight hypothetical paths posited in this study were supported, and surprisingly, the hypothesis that technology characteristics have a direct effect on performance impact was supported. Moreover, the study found that overall quality is a crucial factor determining performance impact. Overall quality indirectly affects performance impact through task-technology fit, technology characteristics, and compatibility, among which the mediating effect of compatibility is most significant, followed by technology characteristics. This study offers practical recommendations for students on the proper use of ChatGPT during the learning process and assists developers in enhancing the services of the ChatGPT system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Task-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
Sallam, M. (2023) · Healthcare · doi:10.3390/healthcare11060887 · Cited by 3,126
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004
Wu, J.-H., & Wang, S.-C. (2005) · Information & Management · doi:10.1016/j.im.2004.07.001 · Cited by 2,284
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003
ChatGPT is fun, but not an author
Thorp, H. H. (2023) · Science · doi:10.1126/science.adg7879 · Cited by 1,437
Cited by
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
Batista, J., Mesquita, A., & Carnaz, G. (2024) · Information · doi:10.3390/info15110676 · Cited by 256
ChatGPT in the higher education: A systematic literature review and research challenges
Baig, M. I., & Yadegaridehkordi, E. (2024) · International Journal of Educational Research · doi:10.1016/j.ijer.2024.102411 · Cited by 208
Does ChatGPT Help Novice Programmers Write Better Code? Results From Static Code Analysis
Haindl, P., & Weinberger, G. (2024) · IEEE Access · doi:10.1109/access.2024.3445432 · Cited by 45
“This aligns with findings from Chen et al. [28] and Rahman and Watanobe [30], which highlighted potential drawbacks of over-reliance on AI tools, such as reduced critical thinking and the risk of not developing independent problem-solving skills.”
MethodResult
Metadata
- Authors
- Chen, J., Zhuo, Z., & Lin, J.
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2023-12-18
- Volume
- 15
- Issue
- 24
- Pages
- 16928
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W4389894817
- Cited by
- 61
- References
- 35
- FWCI
- 14.33
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does ChatGPT Play a Double-Edged Sword Role in the Field of Higher Education? An In-Depth Exploration of the Factors Affecting Student Performance. https://app.cochat.ai/papers/10.3390/su152416928
- The paper
- Chen, J., Zhuo, Z., & Lin, J. (2023). Does ChatGPT Play a Double-Edged Sword Role in the Field of Higher Education? An In-Depth Exploration of the Factors Affecting Student Performance. Sustainability. https://doi.org/10.3390/su152416928
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.