Beyond the “Wow” Factor: Using Generative AI for Increasing Generative Sense-Making
Open accessThe DOI matches its Crossref record; 129 of the 129 references it cites were found in a registry or an index.
Abstract
Generative artificial intelligence (GenAI) has emerged as a transformative tool in education, offering scalable individualized learning. However, there is a lack of theoretically informed and methodologically rigorous research on how GenAI can effectively augment learning. This manuscript addresses this gap by investigating the potential of a theory-informed GenAI chatbot, ChatTutor—designed for students—to facilitate generative sense-making by leveraging principles from generative learning theory. The study aimed to (1) extend theory by proposing how GenAI can support generative sense-making and (2) test its effects on conceptual knowledge, self-efficacy, and trust post-use and on conceptual knowledge, enjoyment, and behavioral intentions in a delayed follow-up. We conducted two between-subjects design experiments. Study 1 was a pre-registered experiment with 175 university students in an authentic cognitive psychology course, comparing ChatTutor with a generic GenAI system (ChatGPT) and a teaching-as-usual control. Study 2 replicated the design with 234 high school students, comparing ChatTutor to ChatGPT, and a re-study control. Results showed that ChatTutor significantly enhanced trust and enjoyment in both studies, and behavioral intentions in Study 1, compared to ChatGPT. It also improved conceptual knowledge over ChatGPT immediately in both studies and at follow-up in Study 2. ChatTutor outperformed the control condition in conceptual knowledge, although this difference was only significant in the follow-up of Study 1 and the immediate test of Study 2. Differences in self-efficacy were not significant. The research underscores the importance of integrating human-centered design and educational psychology theories into GenAI applications and offers directions for future research and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Makransky et al. (2025 ), who cautioned that GenAI tools may enhance generative sense-making only when purposefully embedded in well-structured learning tasks-otherwise, the initial engagement ('wow' effect) might not translate into meaningful learning gains.”
From Enhancing School Students' Self-Regulated Learning through Generative AI Support: A Randomized Controlled Trial (2026) · cites this paper as Makransky et al. (2025)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“The widespread use of GenAI has surged with the release of publicly available large language models such as BERT (Devlin et al., 2019), Llama (Touvron et al., 2023), OpenAI (Helmore, 2023), Claude (Anthopic, 2024), and GPT-4 (Edwards, 2023).”
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · cited 2×
“An a priori power analysis using G*Power (Faul et al., 2007) was conducted to determine the number of participants necessary to detect a medium effect size ( f = 0.25) for a one-way ANOVA with three groups, with α = 0.05 and power = 0.80.”
InfluentialBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“The widespread use of GenAI has surged with the release of publicly available large language models such as BERT (Devlin et al., 2019), Llama (Touvron et al., 2023), OpenAI (Helmore, 2023), Claude (Anthopic, 2024), and GPT-4 (Edwards, 2023).”
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925 · cited 1×
“…its potential to foster higher-order cognitive processes, such as conceptual understanding (Anderson & Krathwohl, 2001), while also promoting self-efficacy (Bandura, 1977), trust (Gulati et al., 2019), enjoyment (Davis et al., 1992; Huang & Zou, 2024), and behavioral intentions (Lee & Choi, 2017).”
Social Cognitive Theory: An Agentic Perspective
Bandura, A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.1 · Cited by 15,510
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539 · cited 1×
“This procedure ensures that the family-wise error rate is maintained at the desired level (e.g., Kirk, 2013).”
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 1×
“This positive emotional experience can reinforce satisfaction with the learning process and increase the intention to continue using AI-enhanced educational platforms (Venkatesh & Bala, 2008), leading to sustained engagement and ultimately more widespread adoption (Dai et al., 2024).”
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 2×
“Generative artificial intelligence (GenAI) has received increasing public interest and research (Kasneci et al., 2023; Lorenz et al., 2023; Yan et al., 2024).”
Research works printed but not linked: 2
- Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assesing. A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy (pp. 1–336). Longman Publishing. https://eduq.info/xmlui/handle/11515/18824
- (Ed) Collaborative-learning: Cognitive and computational approaches, (pp. 1-19). Elsevier Science. Retrieved June 2, 2025, from https://telearn.hal.science/hal-00190240/document
Cited by
Liu, M., Zhang, L. J., & Neufeld, T. J. E. (2025) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2025.2549754 · Cited by 22
Does using ChatGPT change your brain activity? Study sparks debate
Jones, N. B. (2025) · Nature · doi:10.1038/d41586-025-02005-y · Cited by 7
Fütterer, T., Bardach, L., Kuhn, J., Keller, S. D., & Gerjets, P. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10133-8 · Cited by 17
A Framework for Designing an AI Chatbot to Support Scientific Argumentation
Watts, F. M., Liu, L., Ober, T. M., Yi, S., Valle, E. J.-D., Zhaı, X., Wang, Y., & Liu, N. (2025) · Education Sciences · doi:10.3390/educsci15111507 · Cited by 9
Re-Experiencing vs. Self-Explaining: Comparing Generative Learning Activities in VR
Stenberdt, V. A., Shiwalia, B. M., & Makransky, G. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10096-2 · Cited by 5
Self-citation
Metadata
- Authors
- Makransky, G., Shiwalia, B. M., Herlau, T., & Blurton, S.
- Affiliations
- University of Copenhagen (DK)
- Technical University of Denmark (DK)
- Corresponding author
- Makransky, Guido
- Venue
- Educational Psychology Review
- Published
- 2025-06-16
- Volume
- 37
- Issue
- 3
- ISSN
- 1040-726X (ISSN-L)
- 1573-336X
- OpenAlex
- W4411329208
- Cited by
- 27
- References
- 118
- Citations by year
- 2026: 22 · 2025: 5
- FWCI
- 28.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Educational Psychology Review (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- Research at the University of Copenhagen (University of Copenhagen) (publishedVersion, other-oa)
- Funders
- This study was not funded
- Copenhagen University
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- generative AI, AI chatbots in education, conceptual knowledge, self-efficacy, trust in AI, student enjoyment, behavioral intention, ChatGPT comparison, human-centered design, personalized learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Beyond the “Wow” Factor: Using Generative AI for Increasing Generative Sense-Making. https://app.cochat.ai/papers/10.1007/s10648-025-10039-x
- The paper
- Makransky, G., Shiwalia, B. M., Herlau, T., & Blurton, S. (2025). Beyond the “Wow” Factor: Using Generative AI for Increasing Generative Sense-Making. Educational Psychology Review. https://doi.org/10.1007/s10648-025-10039-x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.