The DOI matches its Crossref record; 78 of the 82 references it cites were found in a registry or an index, and 4 are not checked yet; 3 of the 23 sources its claims cite were checked for support.
Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction
Open accessAbstract
In the evolving landscape of higher education, challenges such as the COVID-19 pandemic have underscored the necessity for innovative teaching methodologies. These challenges have catalyzed the integration of technology into education, particularly in blended learning environments, to bolster self-regulated learning (SRL) and higher-order thinking skills (HOTS). However, increased autonomy in blended learning can lead to learning disruptions if issues are not promptly addressed. In this context, OpenAI's ChatGPT, known for its extensive knowledge base and immediate feedback capability, emerges as a significant educational resource. Nonetheless, there are concerns that students might become excessively dependent on such tools, potentially hindering their development of HOTS. To address these concerns, this study introduces the Guidance-based ChatGPT-assisted Learning Aid (GCLA). This approach modifies the use of ChatGPT in educational settings by encouraging students to attempt problem-solving independently before seeking ChatGPT assistance. When engaged, the GCLA provides guidance through hints rather than direct answers, fostering an environment conducive to the development of SRL and HOTS. A randomized controlled trial (RCT) was employed to examine the impact of the GCLA compared to traditional ChatGPT use in a foundational chemistry course within a blended learning setting. This study involved 61 undergraduate students from a university in Taiwan. The findings reveal that the GCLA enhances SRL, HOTS, and knowledge construction compared to traditional ChatGPT use. These results directly align with the research objective to improve learning outcomes through providing guidance rather than answers by ChatGPT. In conclusion, the introduction of the GCLA has not only facilitated more effective learning experiences in blended learning environments but also ensured that students engage more actively in their educational journey. The implications of this study highlight the potential of ChatGPT-based tools in enhancing the quality of higher education, particularly in fostering essential skills such as self-regulation and HOTS. Furthermore, this research offers insights regarding the more effective use of ChatGPT in education.
Verified 2026-10-23 · 4 references not checked yet
Overview
CoChat Summary
TL;DR
This randomized controlled trial with 61 Taiwanese undergraduates found that a Guidance-based ChatGPT-assisted Learning Aid (GCLA), which requires students to attempt answers before receiving hints, improved self-regulated learning engagement/self-efficacy, higher-order thinking skills, and chemistry knowledge construction compared with traditional ChatGPT use in blended learning. The paper reports mixed/inconsistent prose on motivation, but its tables show GCLA advantages on several SRL and learning outcomes.
Key findings
- SRL: GCLA group scored higher than control on cognitive engagement (34.5 vs. 27.4), behavioral engagement (20.1 vs. 17.4), and self-efficacy (31.2 vs. 25.8); ANCOVA p < .001 for each, partial η² = .369, .333, and .313. The paper also reports significant differences for intrinsic motivation and amotivation, but its prose is inconsistent about direction; Table 6 shows TG intrinsic motivation 18.9 vs. CG 16.1 and amotivation 8.53 vs. 12.0.
- HOTS: GCLA group outperformed control on critical thinking (17.3 vs. 13.8), problem-solving (15.9 vs. 13.1), and creativity (11.0 vs. 10.1); ANCOVA p < .001, p < .001, and p = .004, with partial η² = .418, .400, and .134.
- Knowledge construction: GCLA group scored higher on post-test chemistry knowledge (79.7 vs. 74.7) and delayed test (75.9 vs. 69.3); ANCOVA p = .017 and p = .006, partial η² = .100 and .124. Pre-test scores showed no significant group difference (F = 0.231, p = .632).
- The study concludes GCLA enhanced SRL, HOTS, and knowledge construction compared with traditional ChatGPT use, though it did not clearly support motivation-related SRL benefits.
Methods
- Randomized controlled trial with 61 first-year undergraduate students in a compulsory chemistry course at a university in southern Taiwan; 31 males and 30 females. Participants were randomly assigned to a Treatment Group (n = 31; 16 males, 15 females) using GCLA or a Control Group (n = 30; 15 males, 15 females) using standard ChatGPT on iOS. Both groups had the same instructor, materials, learning environment, and iPads.
- GCLA used Apple Shortcuts with ChatGPT model gpt-3.5-turbo-16k, parameters max_tokens = 4000, temperature = 0.6, presence_penalty = 0.2. It required students to submit their own proposed answer first, then provided hints rather than direct answers, and kept a learning log.
- Measures included pre-, post-, and delayed chemistry multiple-choice tests (20 items × 5 points = 100), an 11-item HOTS scale (critical thinking, problem-solving, creativity), and a 46-item SRL scale (motivation 20, engagement 18, self-efficacy 8) on 5-point Likert scales. Analysis used ANCOVA with pre-test covariates, Levene’s tests, partial η² effect sizes, and JAMOVI 2.4.
Limitations
- Stated: the sample was relatively small and from a single university in Taiwan, limiting generalizability; the study covered only chemistry and one blended learning setting; and it measured only short-term and medium-term effects via post-tests and delayed tests, not long-term retention, transfer, or application.
- Evident from the text: convenience sampling was used, so despite random assignment within the sample, the participants were not representative; the sample size of 61 is small.
- Evident from the text: the prose describing intrinsic motivation and amotivation is inconsistent with Table 6, which may complicate interpretation of the SRL motivation findings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
2 Valid · 2 Not valid · 17 Not checked · 82 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Nevertheless, it could also foster a dependency that might impede the development of HOTS.The ease of accessing information and problemsolving assistance through tools like ChatGPT could discourage students from engaging in thorough thinking or independent problem-solving (Chan & Hu, 2023;Ding et al., 2023).”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Introduction
What the sources say
- Supportedcites Chan & Hu, 2023 source
In the discussion of challenges (p. 11), the paper says over-reliance on AI may hinder intellectual development and quotes a student concerned that it could reduce critical thinking and willingness to think independently. Table 4 (p. 8) also records concerns about over-reliance and the development of problem-solving skills. These are reported as potential risks, consistent with the citing sentence’s hedged wording. (LLM, conf=0.91)
- Partly supportedcites Ding et al., 2023 sourceExperimental — accuracy not yet measured
The Implications section reports that many students blindly trusted ChatGPT and heavily relied on its answers, and recommends strengthening critical thinking. It does not establish that this reliance impeded the development of higher-order thinking skills or discouraged independent problem-solving. (LLM, conf=0.84)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The findings reveal that the GCLA enhances SRL, HOTS, and knowledge construction compared to traditional ChatGPT use.”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The findings reveal that the GCLA enhances SRL, HOTS, and knowledge construction compared to traditional ChatGPT use.”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The findings reveal that the GCLA enhances SRL, HOTS, and knowledge construction compared to traditional ChatGPT use.”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and amotivation (M EG = 8.53 < M CG = 12.0, this being an adverse indicator).”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > The impact of GCLA on self-regulated learning (SRL)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
35 more claims
Create a free account to see all 103 claims and every source verdict.
- Probably not a substantial claim. 43
- It may state two separate claims as one. 32
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Within this evolving paradigm, there is a growing consensus that AI tools should be conceptualized not merely as corrective devices but as mediational instruments capable of scaffolding higher-order thinking, self-regulation, and learner agency (Lan & Zhou, 2025;Lee et al., 2024).”
From Generative AI, visual scaffolds, and metacognition in EFL writing (2026) · cites this paper as Lee et al., 2024
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These tools enable students to engage in iterative dialogue, receive real-time feedback, and explore alternative viewpoints, features aligned with key CT processes such as analysis, synthesis, inference, and evaluation [28].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Students benefit from adaptive feedback mechanisms inherent in GenAI tools like ChatGPT, which prompt them to reflect on their assumptions and refine their reasoning iteratively [28,32].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [28]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Also, it fits the wider pattern in recent studies, in which scaffolding forms of GenAI use have preserved post-intervention performance while unlimited use has not (Bastani et al., 2025; Lee et al., 2024).”
From Effects of Partial vs. Full Cognitive Offloading with Generative AI on Learning Retention (2026) · cites this paper as Lee et al., 2024
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“These approaches keep students cognitively engaged and make it more difficult for them to drift into passive acceptance or superficial completion (Lee et al., 2024; Joo et al., 2026; Lukešová & Jennings, 2025; Sun et al., 2026; R. Zhou et al., 2025).”
From Generative AI, Cognitive Offloading, and Learner Agency in Higher Education: A Scoping Review (2026) · cites this paper as Lee et al., 2024
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Conclusion
“the GCLA did not have a significant effect on students' intrinsic motivation and amotivation”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > The impact of GCLA on self-regulated learning (SRL)
“statistically significant differences were observed in intrinsic motivation, amotivation, cognitive engagement, behavioral engagement, and self-efficacy.”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > The impact of GCLA on self-regulated learning (SRL)
“the CG notably outperformed the TG in terms of intrinsic motivation (M EG = 18.9 > M CG = 16.1)”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Future directions
“| Intrinsic motivation | 16.2 | 1.88 | 18.9 | 2.82 | 16.0 | 2.46 | 16.1 | 2.55 |”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > • Week 1: Forethought phase
“A delayed test in Week 15 was designed to evaluate the persistence of their acquired knowledge.”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Details of pre-test of and post-test
“The delayed tests, taking place two weeks following the intervention, were 20 min long.”
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Discussion
“traditional ChatGPT holds a slight edge, particularly in higher education contexts.Its ability to provide immediate feedback seems to foster motivation and stave off feelings of helplessness”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > The impact of GCLA on self-regulated learning (SRL)
“amotivation (M EG = 8.53 < M CG = 12.0, this being an adverse indicator)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Measurement
“For engagement, the Math and Science Engagement Scales proposed by Wang et al. (2016) was adapted, dividing engagement into cognitive, behavioral, and emotional aspects.”
§ Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction > Future directions
“| | Social engagement | 0.77 |”
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,473
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
ภู่พันธ์, ศ. (2018) · วารสารวิธีวิทยาการวิจัย (Journal of Research Methodology: JRM) · Cited by 13,070
A revision of bloom's taxonomy: an overview
Krathwohl, D. R. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4104_2 · Cited by 8,132 · cited 1×
“This level of scrutiny encourages learners to not just passively accept information but to actively engage in questioning and appraising its validity and utility (Krathwohl, 2002).”
BackgroundChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1×
“Investigations by Kasneci et al. (2023) elucidate how ChatGPT engenders engagement and fosters a more interactive learning paradigm.”
BackgroundZimmerman, B. J. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50031-7 · Cited by 6,069
The Role of Goal Orientation in Self-Regulated Learning
Pintrich, P. R. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50043-3 · Cited by 5,173
Zimmerman, B. J. (2008) · American Educational Research Journal · doi:10.3102/0002831207312909 · Cited by 3,735 · cited 2×
“Wu et al., (2023a) under-line the importance of sustaining motivation in the forethought phase (Pintrich, 2000; Zimmerman, 2000, 2008), actively engaging in the performance phase (Bernardo et al., 2022; Doo & Bonk, 2020), and enhancing self-efficacy during self-reflection (Rabin et al., 2020;…”
BackgroundSelf-Regulated Learning and Academic Achievement: An Overview
Zimmerman, B. J. (1990) · Educational Psychologist · doi:10.1207/s15326985ep2501_2 · Cited by 3,687 · cited 5×
“…settings, as noted by Rasheed et al. (2020), SRL necessitates significant self-disci-pline and initiative, especially online where learners choose their engagement levels—a dynamic essential for the self-reflection phase, as discussed by Hood et al. (2015) and grounded in Zimmerman (1990)’s work.”
BackgroundMethodInfluential
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Zhang, L., & Xu, J. (2025) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100978 · Cited by 168
Sardi, J., Darmansyah, Candra, O., Yuliana, D. F., Habibullah, Yanto, D. T. P., & Eliza, F. (2025) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v15i1.53379 · Cited by 105
Banihashem, S. K., Bond, M., Bergdahl, N., Khosravi, H., & Noroozi, O. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00548-8 · Cited by 82
“…learning, where students became more independent and self-directed learners (Pierrot et al., 2021; Sandoval Peña et al., 2023)., AI’s role in facilitating knowledge construction was noted in two studies (2%), aiding students in building and organizing knowledge (Lee et al., 2024; Wu et al., 2024).”
Lin, C.-J., Lee, H.-Y., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-13072-5 · Cited by 83
“…of technology, especially the development of natural language processing and large language models such as GPT, has brought significant changes to the field of digital education and has enriched the reflection process in STEM learning with more diverse learning experiences (Lee et al., 2024 ).”
Self-citation
Metadata
- Authors
- Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T.
- Affiliations
- National Cheng Kung University (TW)
- National Yunlin University of Science and Technology (TW)
- Corresponding author
- Huang, Yueh-Min
- Venue
- International Journal of Educational Technology in Higher Education
- Published
- 2024-03-04
- Volume
- 21
- Issue
- 1
- ISSN
- 2365-9440 (ISSN-L)
- OpenAlex
- W4392342858
- Cited by
- 273
- References
- 74
- Citations by year
- 2026: 133 · 2025: 110 · 2024: 30
- FWCI
- 102.19
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- International Journal of Educational Technology in Higher Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Science and Technology Council (110-2511-H-006-008-MY3, 112-2410-H-006-053-MY3)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- ChatGPT, blended learning, student self-regulation, higher-order thinking skills, knowledge construction, AI-assisted learning, chemistry education, student independence, undergraduate students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction. https://app.cochat.ai/papers/10.1186/s41239-024-00447-4
- The paper
- Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2024). Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-024-00447-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.