The effects of critical thinking intervention on reliance behaviors, problem-solving quality, and creativity during human-Generative AI collaborative learning
Open accessAbstract
As Generative AI becomes increasingly used in various educational contexts, understanding how students engage with these tools during collaborative problem-solving is critical. While prior research suggests that critical thinking is essential in human-AI problem-solving, few studies have examined how instructional interventions, targeting critical thinking, might shape their reliance behaviors and collaborative outcomes. This study investigates the effects of a critical thinking intervention embedded in a problem-based learning (PBL) environment where students are engaged with Generative AI. The intervention combined strategies that foster critical thinking, including authentic instruction, structured dialogue, and AI-supported peer mentoring, aiming to promote students’ thoughtful engagement and improve problem-solving performance. Participants (N = 226) were assigned to experimental (with critical thinking interventions) or comparison (without critical thinking interventions) conditions. We used pre- and post-surveys to measure participants’ trust, critical thinking, and AI reliance behaviors, and group reports and chat histories to assess their problem-solving quality and creativity. Results revealed that the intervention did not produce significant improvement in self-reported critical thinking, possibly due to the short intervention duration. However, the intervention led to a marginal reduction in students’ thoughtless use of Generative AI and significantly reduced the…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Written justification can complement broader instruction or training in critical thinking and AI literacy by prompting students to exercise critical evaluation during their interactions with a specific AI suggestion.
“Rather than replacing broader instruction or training in critical thinking and AI literacy (e.g., Hou et al., 2026), written justification can complement these approaches by prompting students to exercise critical evaluation during their interactions with a specific AI suggestion.”
From Think Before You Accept: Can Written Justification Reduce Uncritical Uptake of AI Writing Suggestions? (2026) · cites this paper as Hou et al., 2026
Cites
The standard definition of creativity
Runco, M. A., & Jaeger, G. J. (2012) · Creativity Research Journal · doi:10.1080/10400419.2012.650092 · Cited by 3,895 · see citing works
Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq)
Pintrich, P. R., Smith, D. A. F., Garcia, T., & Mckeachie, W. J. (1993) · Educational and Psychological Measurement · doi:10.1177/0013164493053003024 · Cited by 3,646 · see citing works
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M. T., & Weld, D. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445717 · Cited by 757 · see citing works
Trust and reliance on AI — An experimental study on the extent and costs of overreliance on AI
Klingbeil, A., Grützner, C., & Schreck, P. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108352 · Cited by 450 · see citing works
Explanations Can Reduce Overreliance on AI Systems During Decision-Making
Vasconcelos, H., Jörke, M., Grunde-McLaughlin, M., Gerstenberg, T., Bernstein, M. S., & Krishna, R. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579605 · Cited by 402 · see citing works
ChatGPT improves creative problem-solving performance in university students: An experimental study
Urban, M., Děchtěrenko, F., Lukavský, J., Hrabalová, V., Svacha, F., Brom, C., & Urban, K. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105031 · Cited by 396 · see citing works
The Crowdless Future? Generative AI and Creative Problem Solving
Boussioux, L., N. Lane, J., Zhang, M., Jacimovic, V., & Lakhani, K. R. (2023) · doi:10.2139/ssrn.4533642 · Cited by 343 · see citing works
Trusting Automation: Designing for Responsivity and Resilience
Chiou, E. K., & Lee, J. D. (2023) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211009995 · Cited by 301 · see citing works
Effects of chatbot-assisted in-class debates on students’ argumentation skills and task motivation
Guo, K., Zhong, Y., Li, D., & Chu, S. K. W. (2023) · Computers & Education · doi:10.1016/j.compedu.2023.104862 · Cited by 188 · see citing works
Relations between scripted online peer feedback processes and quality of written argumentative essay
Noroozi, O., Biemans, H., & Mulder, M. (2016) · The Internet and Higher Education · doi:10.1016/j.iheduc.2016.05.002 · Cited by 176 · see citing works
Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
Gajos, K. Z., & Mamykina, L. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511138 · Cited by 127 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Tao, Y., Meyer, J., & Kizilcec, R. F. (2026) · arXiv · doi:10.48550/arxiv.2609.23936
- Authors
- Hou, C., Zhu, G., Liu, Y., Sudarshan, V., Chong, J. L. L., Zhang, F. Y., Tan, M. Y. H., & Ong, Y. S.
- Affiliations
- Nanyang Technological University (SG)
- Corresponding author
- Zhu, Gaoxia
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2026-07
- Volume
- 247
- Pages
- 105576
- ISSN
- 0360-1315 (ISSN-L)
- OpenAlex
- W7124760248
- Cited by
- 39
- References
- 11
- Citations by year
- 2026: 39
- FWCI
- 174.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Computers & Education (publishedVersion, cc-by-nc-nd)
- DR-NTU (Nanyang Technological University) (submittedVersion)
- NIE Digital Repository (National Institute of Education, Nanyang Technological University) (submittedVersion)
- Funders
- Infocomm Media Development Authority
- National Research Foundation of Singapore
- Ministry of Education - Singapore (RG133/24, T2EP40124- 0004)
- Topics
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Social Sciences › Education › Problem and Project Based Learning
- Social Sciences › Education › Education and Critical Thinking Development
- Keywords
- generative AI, human-AI collaboration, AI reliance, problem-based learning, collaborative problem solving, creativity, trust in AI, peer mentoring, AI-generated content, student use of AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review