Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 78 of the 82 references it cites were found in a registry or an index, and 4 are not checked yet; 3 of the 23 sources its claims cite were checked for support.

Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction

Open access
Lee, Hsin-Yu, Chen, Pei-Hua, Wang, Wei-Sheng, Huang, Yueh-Min, Wu, Ting-Ting · 2024 · International Journal of Educational Technology in Higher Education

Abstract

In the evolving landscape of higher education, challenges such as the COVID-19 pandemic have underscored the necessity for innovative teaching methodologies. These challenges have catalyzed the integration of technology into education, particularly in blended learning environments, to bolster self-regulated learning (SRL) and higher-order thinking skills (HOTS). However, increased autonomy in blended learning can lead to learning disruptions if issues are not promptly addressed. In this context, OpenAI's ChatGPT, known for its extensive knowledge base and immediate feedback capability, emerges as a significant educational resource. Nonetheless, there are concerns that students might become excessively dependent on such tools, potentially hindering their development of HOTS. To address these concerns, this study introduces the Guidance-based ChatGPT-assisted Learning Aid (GCLA). This approach modifies the use of ChatGPT in educational settings by encouraging students to attempt problem-solving independently before seeking ChatGPT assistance. When engaged, the GCLA provides guidance through hints rather than direct answers, fostering an environment conducive to the development of SRL and HOTS. A randomized controlled trial (RCT) was employed to examine the impact of the GCLA compared to traditional ChatGPT use in a foundational chemistry course within a blended learning setting. This study involved 61 undergraduate students from a university in Taiwan. The findings reveal that the GCLA enhances SRL, HOTS, and knowledge construction compared to traditional ChatGPT use. These results directly align with the research objective to improve learning outcomes through providing guidance rather than answers by ChatGPT. In conclusion, the introduction of the GCLA has not only facilitated more effective learning experiences in blended learning environments but also ensured that students engage more actively in their educational journey. The implications of this study highlight the potential of ChatGPT-based tools in enhancing the quality of higher education, particularly in fostering essential skills such as self-regulation and HOTS. Furthermore, this research offers insights regarding the more effective use of ChatGPT in education.

Verified 2026-10-23 · 4 references not checked yet

Overview

CoChat Summary

TL;DR

This randomized controlled trial with 61 Taiwanese undergraduates found that a Guidance-based ChatGPT-assisted Learning Aid (GCLA), which requires students to attempt answers before receiving hints, improved self-regulated learning engagement/self-efficacy, higher-order thinking skills, and chemistry knowledge construction compared with traditional ChatGPT use in blended learning. The paper reports mixed/inconsistent prose on motivation, but its tables show GCLA advantages on several SRL and learning outcomes.

Key findings

  • SRL: GCLA group scored higher than control on cognitive engagement (34.5 vs. 27.4), behavioral engagement (20.1 vs. 17.4), and self-efficacy (31.2 vs. 25.8); ANCOVA p < .001 for each, partial η² = .369, .333, and .313. The paper also reports significant differences for intrinsic motivation and amotivation, but its prose is inconsistent about direction; Table 6 shows TG intrinsic motivation 18.9 vs. CG 16.1 and amotivation 8.53 vs. 12.0.
  • HOTS: GCLA group outperformed control on critical thinking (17.3 vs. 13.8), problem-solving (15.9 vs. 13.1), and creativity (11.0 vs. 10.1); ANCOVA p < .001, p < .001, and p = .004, with partial η² = .418, .400, and .134.
  • Knowledge construction: GCLA group scored higher on post-test chemistry knowledge (79.7 vs. 74.7) and delayed test (75.9 vs. 69.3); ANCOVA p = .017 and p = .006, partial η² = .100 and .124. Pre-test scores showed no significant group difference (F = 0.231, p = .632).
  • The study concludes GCLA enhanced SRL, HOTS, and knowledge construction compared with traditional ChatGPT use, though it did not clearly support motivation-related SRL benefits.

Methods

  • Randomized controlled trial with 61 first-year undergraduate students in a compulsory chemistry course at a university in southern Taiwan; 31 males and 30 females. Participants were randomly assigned to a Treatment Group (n = 31; 16 males, 15 females) using GCLA or a Control Group (n = 30; 15 males, 15 females) using standard ChatGPT on iOS. Both groups had the same instructor, materials, learning environment, and iPads.
  • GCLA used Apple Shortcuts with ChatGPT model gpt-3.5-turbo-16k, parameters max_tokens = 4000, temperature = 0.6, presence_penalty = 0.2. It required students to submit their own proposed answer first, then provided hints rather than direct answers, and kept a learning log.
  • Measures included pre-, post-, and delayed chemistry multiple-choice tests (20 items × 5 points = 100), an 11-item HOTS scale (critical thinking, problem-solving, creativity), and a 46-item SRL scale (motivation 20, engagement 18, self-efficacy 8) on 5-point Likert scales. Analysis used ANCOVA with pre-test covariates, Levene’s tests, partial η² effect sizes, and JAMOVI 2.4.

Limitations

  • Stated: the sample was relatively small and from a single university in Taiwan, limiting generalizability; the study covered only chemistry and one blended learning setting; and it measured only short-term and medium-term effects via post-tests and delayed tests, not long-term retention, transfer, or application.
  • Evident from the text: convenience sampling was used, so despite random assignment within the sample, the participants were not representative; the sample size of 61 is small.
  • Evident from the text: the prose describing intrinsic motivation and amotivation is inconsistent with Table 6, which may complicate interpretation of the SRL motivation findings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s41239-024-00447-4

Cites

78 of 82 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 2 The workflow of GCLA
Fig. 2 The workflow of GCLACC-BY · From the PDF
Image 2
CC-BY · From the PDF
Fig. 3 The development interface of Shortcuts
Fig. 3 The development interface of ShortcutsCC-BY · From the PDF
Fig. 4 Inputting the problem into GCLA
Fig. 4 Inputting the problem into GCLACC-BY · From the PDF
Fig. 5 Submitting an initial answer in GCLA
Fig. 5 Submitting an initial answer in GCLACC-BY · From the PDF
Fig. 6 The guidance from GCLA
Fig. 6 The guidance from GCLACC-BY · From the PDF
Fig. 7 Refining the answer with GCLA guidance until correct
Fig. 7 Refining the answer with GCLA guidance until correctCC-BY · From the PDF
Fig. 8 The interface of ChatGPT on iOS
Fig. 8 The interface of ChatGPT on iOSCC-BY · From the PDF
Fig. 9 Experimental procedure
Fig. 9 Experimental procedureCC-BY · From the PDF

Verification

Claims the paper makes

2 Valid · 2 Not valid · 17 Not checked · 82 Own results and interpretations

35 more claims

Create a free account to see all 103 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 43
  • It may state two separate claims as one. 32

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

3 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 74 references

Cited by

See all 273

Metadata

Authors
Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T.
Affiliations
  • National Cheng Kung University (TW)
  • National Yunlin University of Science and Technology (TW)
Corresponding author
Huang, Yueh-Min
Venue
International Journal of Educational Technology in Higher Education
Published
2024-03-04
Volume
21
Issue
1
ISSN
2365-9440 (ISSN-L)
OpenAlex
W4392342858
Cited by
273
References
74
Citations by year
2026: 133 · 2025: 110 · 2024: 30
FWCI
102.19
Type
journal article
Language
en
Open access
Licence
Locations
  • International Journal of Educational Technology in Higher Education (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
National Science and Technology Council (110-2511-H-006-008-MY3, 112-2410-H-006-053-MY3)
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Keywords
ChatGPT, blended learning, student self-regulation, higher-order thinking skills, knowledge construction, AI-assisted learning, chemistry education, student independence, undergraduate students

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-23, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-23 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction. https://app.cochat.ai/papers/10.1186/s41239-024-00447-4
The paper
Lee, H.-Y., Chen, P.-H., Wang, W.-S., Huang, Y.-M., & Wu, T.-T. (2024). Empowering ChatGPT with guidance mechanism in blended learning: effect of self-regulated learning, higher-order thinking skills, and knowledge construction. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-024-00447-4

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.