Harnessing large language models to develop research-based learning assistants for formative feedback
Open accessThe DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Effectively supporting students in mastering all facets of self-regulated learning is a central aim of teachers and educational researchers. Prior research could demonstrate that formative feedback is an effective way to support students during self-regulated learning. In this light, we propose the application of Large Language Models (LLMs) to guide students towards problem-solving through formative feedback. We present LEAP, a novel platform that utilizes advanced LLMs, such as GPT-4o. LEAP empowers teachers with the ability to effectively pre-prompt and assign tasks to the LLM, resulting in formative feedback that stimulates students’ cognitive and metacognitive processes, thereby enhancing self-regulated learning. We demonstrate that a systematic prompt design can provide a wide range of types of scaffolds to students. These scaffolds, which are rooted in educational research, include sense-making, elaboration, self-explanation, partial task-solution scaffolds, as well as metacognitive and motivational scaffolds. Through this approach, we emphasize the critical importance of synchronizing educational technological advances with empirical research and theoretical frameworks. This alignment could potentially ensures the positive and effective application of LLMs in the educational landscape.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The ability to upload files with exercises and solutions ensures the precision of the GPT’s responses, a critical feature in educational environments15.”
From On opportunities and challenges of large multimodal foundation models in education (2025) · cites this paper as [15]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“GenAI-driven tools may offer scalable and personalized support for reducing teachers' workloads (Fütterer et al., 2023; Kasneci et al., 2023; Steinert et al., 2024)”
From Enhancing School Students' Self-Regulated Learning through Generative AI Support: A Randomized Controlled Trial (2026) · cites this paper as Steinert et al., 2024
In the citing paper
“In this way, LLMs are aware of the correct solution and can guide the learner towards it without generating hallucinations15.”
From On opportunities and challenges of large multimodal foundation models in education (2025) · cites this paper as [15]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 2×
“Despite their potential, LLMs have demonstrated certain biases [5, 6] and are prone to errors, particularly in the realms of physics and mathematics [7, 8].”
Becoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197 · cited 5×
“Cognition is the mental act of acquiring knowledge and understanding [15, 16].”
InfluentialChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
Self-citationChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1×
“For instance, racial biases, risks of misuse, inappropriate or unethical deployment, and loss of integrity are all valid concerns [9].”
Self-citationKluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · cited 1×
“Kluger and colleagues highlight that formative feed-back needs to be specifically related to the task or the learning process to be truly effective [22].”
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846 · cited 1×
“A crucial component to support SRL strategies among learners is formative feedback [21].”
Feedback and Self-Regulated Learning: A Theoretical Synthesis
Butler, D. L., & Winne, P. H. (1995) · Review of Educational Research · doi:10.3102/00346543065003245 · Cited by 3,334 · cited 3×
“It plays an important role in the learning process as it provides students with insights into their areas of proficiency and where additional effort is required [1].”
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 1×
“Such a development could revolutionize education by eliminating barriers such as geographical constraints, limited interaction, language barriers, and the fear of asking questions.”
The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research
Wisniewski, B., Zierer, K., & Hattie, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03087 · Cited by 1,199
Research works printed but not linked: 3
- Mamlok-Naaman, R. (2011). How can we motivate high school students to study science? Science Education Interna- Tional, 22, 5.
- S. Narciss, Feedback strategies for interactive learning tasks, In: Handbook of research on educational communications and technology (Routledge, 2008) pp. 125–143.
- Wittrock, M. C. (2000). Knowledge acquisition and education. The Journal of Mind and Behavior, 205-212.
Cited by
Fan, Y., Tang, L., Le, H., Shen, K., Tan, S., Zhao, Y., Shen, Y., Li, X., & Gašević, D. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13544 · Cited by 805
On opportunities and challenges of large multimodal foundation models in education
Küchemann, S., Avila, K. E., Dinc, Y., Hortmann, C., Revenga, N., Ruf, V., Stausberg, N., Steinert, S., Fischer, F., Fischer, M., et al. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00301-w · Cited by 47
“In this way, LLMs are aware of the correct solution and can guide the learner towards it without generating hallucinations 15 .”
InfluentialSelf-citationKüchemann, S., Steinert, S., Kühn, J., Avila, K. E., & Ruzika, S. (2024) · The Physics Teacher · doi:10.1119/5.0212374 · Cited by 38
Self-citationUsing ChatGPT for teaching physics
Avila, K. E., Steinert, S., Ruzika, S., Kühn, J., & Küchemann, S. (2024) · The Physics Teacher · doi:10.1119/5.0227132 · Cited by 25
Self-citationÇoban, A., Dzsotjan, D., Küchemann, S., Durst, J., Kühn, J., & Hoyer, C. (2025) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-025-00310-z · Cited by 39
Self-citation
Metadata
- Authors
- Steinert, S., Avila, K. E., Ruzika, S., Kuhn, J., & Küchemann, S.
- Affiliations
- Ludwig-Maximilians-Universität München (DE)
- Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (DE)
- Corresponding author
- Avila, Karina E.
- Venue
- Smart Learning Environments
- Published
- 2024-12-19
- Volume
- 11
- Issue
- 1
- ISSN
- 2196-7091 (ISSN-L)
- OpenAlex
- W4405531030
- Cited by
- 73
- References
- 41
- Citations by year
- 2026: 39 · 2025: 24 · 2024: 10
- FWCI
- 10.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Smart Learning Environments (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- large language models, formative feedback, student self-regulation, learning assistants, prompt engineering, scaffolding, self-explanation, sensemaking, elaboration, GPT-4o, problem-solving support, student motivation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Harnessing large language models to develop research-based learning assistants for formative feedback. https://app.cochat.ai/papers/10.1186/s40561-024-00354-1
- The paper
- Steinert, S., Avila, K. E., Ruzika, S., Kuhn, J., & Küchemann, S. (2024). Harnessing large language models to develop research-based learning assistants for formative feedback. Smart Learning Environments. https://doi.org/10.1186/s40561-024-00354-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.