PreprintCited by 1Artificial Intelligence in EducationIntelligent Tutoring Systems and Adaptive LearningInnovative Teaching and Learning Methods

The Role of Instructional Guidance in Generative AI-Assisted Learning: Empirical Evidence from Construction Engineering Education

Open access
Hou, Xiaoyu, Xiao, Bo, Liu, Hexu, Mueller, Shane·2026·arXiv

Abstract

Generative artificial intelligence (AI) is increasingly used to support self-directed learning, yet student interaction with such systems often remains unstructured, limiting engagement in deeper cognitive processes. This study examines how instructional guidance shapes student and AI interaction in construction education. A five-step prompting framework grounded in Generative Learning Theory (GLT) is introduced to guide learner interaction during review activities. A controlled experiment compares three learning conditions: slide-based learning, unprompted AI-supported learning, and prompted AI-supported learning. Learning performance is assessed using multiple-choice and open-ended tasks, and user experience is measured using the User Experience Questionnaire (UEQ). Performance differences are concentrated on tasks requiring explanation and reasoning. The prompted condition achieves higher open-ended scores, with an improvement of approximately 2 or 3 points on a scale of 18 (p < 0.01), while no significant differences are observed in multiple-choice performance. The unprompted condition remains comparable to slide-based learning. These findings indicate that the effectiveness of AI-supported learning depends on how interaction is structured. The proposed framework provides a basis for integrating learning science principles into generative AI systems for construction education.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2606.05509

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Six experiments randomize how learners are steered to use the same AI tool.

    “We identified six experiments that randomize how learners are steered to use the same AI tool: a tutoring prompt that withholds answers (Bastani et al., 2025), a scaffolded tutor (Bassner et al., 2026), a structured sequence of prompts (Hou et al., 2026), written guidance (Gallegos, 2026; Franco et al., 2026), and a note-taking requirement (Kreijkes et al., 2026).”

    From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Hou et al., 2026

  • Steering learners toward augmentation raises subsequent test scores in four of the six experiments.

    “Steering learners toward augmentation raises subsequent test scores in four of the six experiments: by 0.18 SD in Bastani et al. (2025), 0.22 SD in Gallegos (2026), 0.78 SD in Hou et al. (2026), and 0.13 to 0.14 SD in Kreijkes et al. (2026).”

    From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Hou et al., 2026

  • Hou et al. (2026) found that steering learners toward augmentation raises subsequent test scores by 0.78 SD.

    “Steering learners toward augmentation raises subsequent test scores in four of the six experiments: by 0.18 SD in Bastani et al. (2025), 0.22 SD in Gallegos (2026), 0.78 SD in Hou et al. (2026), and 0.13 to 0.14 SD in Kreijkes et al. (2026).”

    From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Hou et al., 2026

  • In Hou et al. (2026), guided AI use raised unassisted post-test total scores by 0.86 SD compared to lecture slides.

    “guided AI use raised total scores by 0.86 SD, while unguided use produced a near-zero effect (0.09 SD).”

    From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Hou et al. (2026)

  • In Hou et al. (2026), unguided AI use produced a near-zero effect (0.09 SD) on unassisted post-test total scores.

    “guided AI use raised total scores by 0.86 SD, while unguided use produced a near-zero effect (0.09 SD).”

    From Experimental Evidence on the Learning Impact of Generative AI (2026) · cites this paper as Hou et al. (2026)

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

2 of the 25 references couldn’t be matched to a known paper.

Research works printed but not linked: 11

  1. Azevedo, R., and Cromley, J. G. (2004). "Does training on self-regulated learning facilitate students' learning with hypermedia?" Journal of Educational Psychology, 96(3), 523-535.
  2. Bisra, K., Liu, Q., Nesbit, J. C., Salimi, F., and Winne, P. H. (2018). "Inducing self-explanation: A meta-analysis." Educational Psychology Review, 30(3), 703-725.
  3. Engelmann, K., Bannert, M., and Melzner, N. (2021). "Do self-created metacognitive prompts promote short-and long-term effects in computer-based learning environments?" Research and Practice in Technology Enhanced Learning, 16(1), 3.
  4. Fiorella, L., and Mayer, R. E. (2015). Learning as a generative activity. Cambridge University Press.
  5. Fiorella, L., and Mayer, R. E. (2016). "Eight ways to promote generative learning." Educational Psychology Review, 28(4), 717-741.
  6. Jelodar, M. B. (2025). "Generative AI, large language models, and ChatGPT in construction education, training, and practice." Buildings, 15(6), 933.
  7. Maalek, R. (2024). "Integrating generative artificial intelligence and problem-based learning into the digitization in construction curriculum." Buildings, 14(11), 3642.
  8. Matzakos, N., and Moundridou, M. (2025). "Exploring large language models integration in higher education: A case study in a mathematics laboratory for civil engineering students." Computer Applications in Engineering Education, 33(3), e70049.
  9. Mueller, S. T., Carlson, K., Wang, Y., Liu, H., and Xiao, B. (2025). "Using LLMs, knowledge space representations and worked examples to support adaptive cybertraining in construction education." In Lecture Notes in Computer Science, Springer, 222-231.
  10. Schrepp, M., Hinderks, A., and Thomaschewski, J. (2017). "Construction of a benchmark for the User Experience Questionnaire (UEQ)." International Journal of Interactive Multimedia and Artificial Intelligence, 4(4), 40-44.
  11. Zhan, Y., Boud, D., Dawson, P., and Yan, Z. (2025). "Generative artificial intelligence as an enabler of student feedback engagement: A framework." Higher Education Research & Development, 44(5), 1289-1304.

Cited by

Sorted by citations

Authors
Hou, X., Xiao, B., Liu, H., & Mueller, S.
Affiliations
  • Michigan Technological University (US)
  • Western Michigan University (US)
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7163696605
Cited by
0
References
25
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Science Foundation (2417804)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Keywords
instructional guidance, prompting framework, construction engineering education, student-AI interaction, self-directed learning, user experience, open-ended tasks, learning performance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review