Human–Machine Cocreation: The Effects of ChatGPT on Students’ Learning Performance, AI Awareness, Critical Thinking, and Cognitive Load in a STEM Course Toward Entrepreneurship
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
The advent of generative artificial intelligence (GAI), exemplified by ChatGPT, has introduced both new opportunities and challenges in science, technology, engineering, and mathematics (STEM) and entrepreneurship education. This exploratory quasi-experimental study examined the effects of ChatGPT-assisted collaborative learning (CCL) on students’ learning performance, artificial intelligence (AI) awareness, critical thinking, and cognitive load. A total of 36 sophomore undergraduates participated in an eight-week instructional experiment, dedicating 3 h per week to applying STEM and entrepreneurship knowledge in the creation of cultural products. The experimental group (N= 21) participated in CCL, while the control group (N= 15) engaged in non-ChatGPT-assisted collaborative learning (NCCL). The results indicated that the CCL group outperformed the NCCL group in terms of learning performance, AI awareness, and cognitive load, while the NCCL group excelled in critical thinking. The findings confirm that ChatGPT offers significant potential and advantages in addressing complex problems within group collaboration and stimulating group creativity, providing new insights into fostering students’ entrepreneurial spirit and skills. However, overreliance on and misuse of ChatGPT may hinder student learning outcomes. Future research should focus on the cocreative problem-solving mechanisms between humans and machines in entrepreneurial education, particularly the interplay of knowledge, thinking, emotions, and actions in collaborative processes involving GAI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Overreliance on GenAI tools can lead to cognitive dependency, diminishing students' ability to formulate original arguments, critically assess alternative perspectives and decision-making processes [33,80,100].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [100]
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Artificial Intelligence in Education: A Review
Chen, L., Chen, P., & Lin, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2988510 · Cited by 4,133 · cited 1×
“As AI technology advances, representative teaching robots [18] and intelligent agents [19] have increasingly evolved into quasi-subjects.”
BAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004 · cited 2×
“It provides expert-like explanations of STEM or entrepreneurship concepts, thereby deepening learners’ comprehension of these subjects [13].”
Building machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Building Machines That Learn and Think Like People
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2016) · arXiv · doi:10.48550/arxiv.1604.00289 · Cited by 2,550
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463 · cited 1×
“Furthermore, the inherent “bias,” “discrimination,” and “preset” characteristics of technology can lead to ethical dilemmas, including false information identification, digital privacy breaches, and compromised academic integrity [31].”
Hollan, J., Hutchins, E., & Kirsh, D. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/353485.353487 · Cited by 2,300 · cited 1×
“This theory posits that cognition extends beyond the individual mind, being distributed across an entire ecosystem comprising people, culture, technology, and artifacts [17].”
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., & Chartash, D. (2023) · JMIR Medical Education · doi:10.2196/45312 · Cited by 2,078
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806 · cited 1×
“It facilitates multiperspective and comprehensive analysis of the real-world context, which often contains contradictory information, thereby enabling students to solve complex problems more efficiently [33].”
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · cited 1×
“Specifically, ChatGPT can enhance students’ learning by offering tailored support such as demand-based customization, real-time interaction, innovative feedback, creative inspiration, information synthesis, and personalized guidance [34].”
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263 · cited 1×
“Thisstandsinsparkingcontrastto thefindingsofEmmert-Streib[62]andCooper[63],whoargue thattheuseofChatGPTcanenhancestudents’criticalthinking.”
Critical Thinking and Subject Specificity: Clarification and Needed Research
Ennis, R. H. (1989) · Educational Researcher · doi:10.2307/1174885 · Cited by 1,055
Instructional control of cognitive load in the training of complex cognitive tasks
Paas, F. G. W. C., & Van Merriënboer, J. J. G. (1994) · Educational Psychology Review · doi:10.1007/bf02213420 · Cited by 968 · cited 1×
“4) Cognitive load: According to the framework outlined in [47], cognitive load can be evaluated through the measurement of mental load, mental effort, and performance.”
ChatGPT and Open-AI Models: A Preliminary Review
Roumeliotis, K. I., & Tselikas, N. D. (2023) · Future Internet · doi:10.3390/fi15060192 · Cited by 706
Liu, G., & Ma, C. (2024) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2023.2240316 · Cited by 511 · cited 1×
“This finding indicates that the advantages of GAI in convenience, timeliness, and creativity significantly facilitated the development of students’ AI awareness, aligning with the findings of [55] and [56].”
Xia, Q., Chiu, T. K. F., Lee, M., Sanusi, I. T., Dai, Y., & Chai, C. S. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104582 · Cited by 469
Guo, K., & Wang, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12146-0 · Cited by 449 · cited 1×
“Research has showed that chatbots and other intelligent support systems can significantly improve students’ learning experiences [24].”
Advancing the Science of Collaborative Problem Solving
Graesser, A. C., Fiore, S. M., Greiff, S., Andrews-Todd, J., Foltz, P. W., & Hesse, F. W. (2018) · Psychological Science in the Public Interest · doi:10.1177/1529100618808244 · Cited by 390 · cited 1×
“Inpracticalsettings,traditionalcollaborativelearningoften faceschallenges,suchasinadequateguidance,limitedgroup interaction, a narrow approach to solving complex problems, and difficulties in integrating knowledge across different disciplines [22], [23].”
Fuchs, K. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1166682 · Cited by 353
Hirosawa, T., Harada, Y., Yokose, M., Sakamoto, T., Kawamura, R., & Shimizu, T. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043378 · Cited by 343
Using Chatbots as AI Conversational Partners in Language Learning
Belda-Medina, J., & Calvo-Ferrer, J. R. (2022) · Applied Sciences · doi:10.3390/app12178427 · Cited by 306 · cited 1×
“This finding indicates that the advantages of GAI in convenience, timeliness, and creativity significantly facilitated the development of students’ AI awareness, aligning with the findings of [55] and [56].”
Linking AI quality performance and customer engagement: The moderating effect of AI preference
Prentice, C., Weaven, S., & Wong, I. A. (2020) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2020.102629 · Cited by 303
Deng, X., & Yu, Z. (2023) · Sustainability · doi:10.3390/su15042940 · Cited by 298 · cited 1×
“They actively engage in communication and interaction with learners within learning communities, facilitating information exchange, stimulating ideas, and providing timely evaluation [20].”
Disentangling competences: Interrelationships on creativity, innovation and entrepreneurship
Edwards-Schachter, M., García-Granero, A., Sánchez-Barrioluengo, M., Quesada-Pineda, H., & Amara, N. (2015) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2014.11.006 · Cited by 291
Shaik, T., Tao, X., Li, Y., Dann, C., McDonald, J., Redmond, P., & Galligan, L. (2022) · IEEE Access · doi:10.1109/access.2022.3177752 · Cited by 286
On the Psychophysics of Workload: Why Bother with Subjective Measures?
Gopher, D., & Braune, R. (1984) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088402600504 · Cited by 280
Feeling Creative, Being Creative: An Empirical Study of Diversity and Creativity in Teams
Kurtzberg, T. R. (2005) · Creativity Research Journal · doi:10.1207/s15326934crj1701_5 · Cited by 264
Should we welcome robot teachers?
Sharkey, A. J. C. (2016) · Ethics and Information Technology · doi:10.1007/s10676-016-9387-z · Cited by 249
Wu, T.-T., Lee, H.-Y., Li, P.-H., Huang, C.-N., & Huang, Y.-M. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331231191125 · Cited by 249
Kim, N. J., Belland, B. R., & Walker, A. E. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9419-1 · Cited by 220 · cited 1×
“Inpracticalsettings,traditionalcollaborativelearningoften faceschallenges,suchasinadequateguidance,limitedgroup interaction, a narrow approach to solving complex problems, and difficulties in integrating knowledge across different disciplines [22], [23].”
Promoting student creativity and entrepreneurship through real-world problem-based maker education
Weng, X., Chiu, T. K. F., & Tsang, C. C. (2022) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2022.101046 · Cited by 212
Ebadi, S., & Amini, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2022.2096638 · Cited by 179
Kelly, A., Sullivan, M., & Strampel, K. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.6.12 · Cited by 177
Susi, T., & Ziemke, T. (2001) · Cognitive Systems Research · doi:10.1016/s1389-0417(01)00053-5 · Cited by 159
Skavronskaya, L., Hadinejad, A. (., & Cotterell, D. (2023) · Journal of Teaching in Travel & Tourism · doi:10.1080/15313220.2023.2196658 · Cited by 148
Alneyadi, S., & Wardat, Y. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13417 · Cited by 142
Li, T., Ji, Y., & Zhan, Z. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2024.2305163 · Cited by 133 · cited 4×
“Furthermore,priorresearchhaspredominantlyconceptual- izedChatGPTasanAIchattooldesignedforindividualone-on-oneinteractionswithlearners[11].”
InfluentialSelf-citationRedefining entrepreneurship education in the age of artificial intelligence: An explorative analysis
Vecchiarini, M., & Somià, T. (2023) · The International Journal of Management Education · doi:10.1016/j.ijme.2023.100879 · Cited by 124 · cited 3×
“By emulating human learning and thinking, it helps students deepen their understanding of complex STEM concepts [8], offers real-time entrepreneurial guidance and market analysis [9], and accelerates the divergence and convergence of individual and group thinking [10].”
Students’ attitudes towards using ChatGPT as a learning tool: the case of the University of Jordan.
O. Ajlouni, A., Abd-Alkareem Wahba, F., & Salem Almahaireh, A. (2023) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v17i18.41753 · Cited by 116
Colombo, M. G., & Piva, E. (2020) · Research Policy · doi:10.1016/j.respol.2020.103993 · Cited by 115
Chatgpt: a meta-analysis after 2.5 months
Leiter, C., Zhang, R., Chen, Y., Belouadi, J., Larionov, D., Fresen, V., & Eger, S. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100541 · Cited by 115
Yang, Y. C., & Chou, H. (2008) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2007.00767.x · Cited by 110
Miço, H., & Cungu, J. (2023) · Administrative Sciences · doi:10.3390/admsci13010022 · Cited by 110
Spennemann, D. H. R. (2023) · Knowledge · doi:10.3390/knowledge3030032 · Cited by 93
Eltanahy, M., Forawi, S., & Mansour, N. (2020) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2020.100697 · Cited by 91
الکنعان, ه. م. ن. (2022) · International Journal of Instruction · doi:10.29333/iji.2022.15348a · Cited by 90
Entrepreneurship Education at the Dawn of Generative Artificial Intelligence
Winkler, C., Hammoda, B., Noyes, E., & Van Gelderen, M. (2023) · Entrepreneurship Education and Pedagogy · doi:10.1177/25151274231198799 · Cited by 81
Oyewo, O. A., Ramaila, S. M., & Mavuru, L. (2022) · Education Sciences · doi:10.3390/educsci12110780 · Cited by 78
Zheng, R. Z., & Gupta, U. (2020) · European Journal of STEM Education · doi:10.20897/ejsteme/9252 · Cited by 59
Can Pair Learning Improve Students’ Troubleshooting Performance in Robotics Education?
Zhong, B., & Li, T. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119829191 · Cited by 56
Self-citationA Sociological Conversation with ChatGPT about AI Ethics, Affect and Reflexivity
Balmer, A. (2023) · Sociology · doi:10.1177/00380385231169676 · Cited by 51
Cribben, I., & Zeinali, Y. (2023) · doi:10.2139/ssrn.4404276 · Cited by 46
Primario, S., Rippa, P., & Secundo, G. (2022) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2022.3199709 · Cited by 45
An approach to human–machine collaboration in innovation
McCaffrey, T., & Spector, L. (2018) · Artificial Intelligence for Engineering Design, Analysis and Manufacturing · doi:10.1017/s0890060416000524 · Cited by 41
Effects of STEM-focused Arduino practical activities on problem-solving and entrepreneurship skills
Sarı, U., Çelik, H., Pektaş, H. M., et al. (2022) · Australasian Journal of Educational Technology · doi:10.14742/ajet.7293 · Cited by 36
Postdigital Duoethnography: An Inquiry into Human-Artificial Intelligence Synergies
Brailas, A. (2024) · Postdigital Science and Education · doi:10.1007/s42438-024-00455-7 · Cited by 36
Ji, Y., Zou, X., Li, T., & Zhan, Z. (2023) · Proceedings of the 2023 6th International Conference on Educational Technology Management · doi:10.1145/3637907.3637948 · Cited by 29
Self-citationLuan, L., Lin, X. Y., & Li, W. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.04818 · Cited by 24
ChatGPT for Founding Teams: An Entrepreneurial Pedagogical Innovation
Hammoda, B. (2024) · International Journal of Technology in Education · doi:10.46328/ijte.530 · Cited by 18
Su, Y. (2023) · International Journal of New Developments in Education · doi:10.25236/ijnde.2023.051301 · Cited by 17
Goel, R. K., & Nelson, M. A. (2024) · The Journal of Technology Transfer · doi:10.1007/s10961-024-10089-3 · Cited by 14
Creativity Through Intrapersonal Communication Dialog
Hyatt, K. S. (1992) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1992.tb01158.x · Cited by 9
The Trends in Entrepreneurship and STEM Education Studies: A Bibliometric Study
Kaya-Capocci, S. (2023) · İnönü Üniversitesi Eğitim Fakültesi Dergisi · doi:10.17679/inuefd.1320031 · Cited by 8
Importance of critical thinking to understand ChatGPT
Emmert‐Streib, F. (2023) · European Journal of Human Genetics · doi:10.1038/s41431-023-01443-4 · Cited by 7
Reader Response: Neurology Education in 2035: The Neurology Future Forecasting Series
Das, S. (2023) · Neurology · doi:10.1212/wnl.0000000000207441 · Cited by 3
Cited by
Helal, M. Y. I., Elgendy, I. A., Albashrawi, M. A., Dwivedi, Y. K., Al-Ahmadi, S., & Jeon, I. (2025) · Information Discovery and Delivery · doi:10.1108/idd-05-2025-0125 · Cited by 80
Balart, T., Díaz, B., & Shryock, K. (2026) · Algorithms · doi:10.3390/a19030179 · Cited by 29
“Overreliance on GenAI tools can lead to cognitive dependency, diminishing students’ ability to formulate original arguments, critically assess alternative perspectives and decision-making processes [33,80,100].”
Gao, L., Jong, M. S., Chai, C. S., & Li, K. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105504 · Cited by 19
Kalogiannakis, M., Papakonstantinou, N., & Sotiropoulos, D. J. (2025) · Creative Education · doi:10.4236/ce.2025.169083 · Cited by 8
AI self-efficacy and knowledge graph-integrated generative AI feedback in higher education
Tu, Y.-F., Liu, G.-P., Hwang, G., Chen, X.-W., & Guo, X.-G. (2026) · The Internet and Higher Education · doi:10.1016/j.iheduc.2026.101079 · Cited by 9
Metadata
- Authors
- Ji, Y., Zhan, Z., Li, T., Zou, X., & Lyu, S.
- Affiliations
- South China Normal University (CN)
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2025
- Volume
- 18
- Pages
- 402-415
- ISSN
- 1939-1382 (ISSN-L)
- 2372-0050
- OpenAlex
- W4408858436
- Cited by
- 42
- References
- 69
- Citations by year
- 2026: 31 · 2025: 11
- FWCI
- 44.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Learning Technologies (publishedVersion)
- Funders
- 2024 Guangdong Province Undergraduate Universities Teaching Quality
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- ChatGPT, generative AI, cooperative learning, AI awareness, critical thinking, cognitive load, learning performance, entrepreneurship education, STEM education, team creativity, overreliance on AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.