The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.
A review of automated feedback systems for learners: Classification framework, challenges and opportunities
Open accessAbstract
Abstract Teacher feedback provided to learners in real-time is a crucial factor for their knowledge and skills acquisition. However, providing real-time feedback at an individual level is often infeasible, considering limited teaching resources. Fortunately, recent technological advancements have allowed for developing of various computer tutoring systems, which can support learners at any place and time by generating personalized feedback automatically. Such systems have emerged in various domains, tackle different educational tasks, and often are designed in very distinctive ways. Consequently, the knowledge in the field of automated feedback systems is rather scattered across different domains and applications, as we illustrate in this study. This paper aims to outline the state-of-the-art of recently developed systems for delivering automated feedback, and thus serves as a source of systematic information for educators, researchers in the educational domain and system developers. More specifically, the contribution of this study is twofold. Firstly, we offer an extensive literature review of the field. As a result of a rigorous selection process, consisting of 4 phases, a total of 109 automated feedback systems is selected for a detailed review and thoroughly classified against numerous dimensions. Secondly, based on a detailed analysis of the recent literature sources and following the design science research approach, a classification framework for automated feedback systems is developed. This framework is used to classify the selected systems, and thus give a detailed overview of the predominantly available educational technologies, the educational settings in which they are applied, the properties of automated feedback they deliver, and the approaches for their design and evaluation. Based on this analysis, several important observations and recommendations are put forward as an outcome of the study. In particular, our study outlines the current fragmentation of the field, discusses a need for a common reference framework, and calls for more personalized, data-driven and student-centered solutions to exploit a larger set of opportunities offered in this age of data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · Cited by 13,930
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234
The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Rethinking models of feedback for learning: the challenge of design
Boud, D., & Molloy, E. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2012.691462 · Cited by 1,636
Cited by
Artificial Intelligence in Education: The Three Paradigms
Ouyang, F., & Jiao, P. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100020 · Cited by 991
Ouyang, F., Zheng, L., & Jiao, P. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10925-9 · Cited by 831
Impact of AI assistance on student agency
Darvishi, A., Khosravi, H., Sadiq, S., Gašević, D., & Siemens, G. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104967 · Cited by 548
“…learning resources (Bodily & Verbert, 2017), automated feedback systems provide real-time feedback on students ’ work (Cavalcanti et al., 2021; Deeva, Bogdanova, Serral, Snoeck, & De Weerdt, 2021), personalised nudging systems remind students of upcoming deadlines (Damgaard & Nielsen, 2018)…”
BackgroundLiang, J.-C., Hwang, G.-J., Chen, M.-R. A., & Darmawansah, D. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1958348 · Cited by 378
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00406-5 · Cited by 332
Feedback sources in essay writing: peer-generated or AI-generated feedback?
Banihashem, S. K., Kerman, N. T., Noroozi, O., Moon, J., & Drachsler, H. (2024) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-024-00455-4 · Cited by 282
“…(LA), have presented promising avenues to elevate feedback practices through the facilitation of scalable, timely, and personalized feedback (Banihashem et al., 2023; Deeva et al., 2021; Drachsler, 2023; Drachsler & Kalz, 2016; Pardo et al., 2019; Zawacki-Richter et al., 2019; Rüdian et al., 2020).”
BackgroundHarnessing Generative AI (GenAI) for Automated Feedback in Higher Education: A Systematic Review
Lee, S. S., & Moore, R. L. (2024) · Online Learning · doi:10.24059/olj.v28i3.4593 · Cited by 181
Muthmainnah, Ibna Seraj, P. M., & Oteir, I. (2022) · Education Research International · doi:10.1155/2022/6468995 · Cited by 153
Automated feedback and writing: a multi-level meta-analysis of effects on students' performance
Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2023.1162454 · Cited by 145
“Review articles have either looked at the use of digital technologies in writing instruction in general (Williams and Beam, 2019; Al-Wasy, 2020) or focused on tools and how they work rather than their effectiveness (Allen et al., 2016; Strobl et al., 2019; Deeva et al., 2021).”
BackgroundBa, S., Yang, L., Yan, Z., Looi, C. K., & Gašević, D. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100284 · Cited by 91
Artificial intelligence in multimodal learning analytics: a systematic literature review
Mohammadi, M., Tajik, E., Martinez-Maldonado, R., Sadiq, S., Tomaszewski, W., & Khosravi, H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100426 · Cited by 85
Liang, H., Hwang, G., Hsu, T., & Yeh, J. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13448 · Cited by 78
Steinert, S., Avila, K. E., Ruzika, S., Kuhn, J., & Küchemann, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00354-1 · Cited by 73
A Comprehensive Systematic Review of AI-Driven Approaches to Self-Directed Learning
Younas, M., Abdel Salam El-Dakhs, D., & Jiang, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3546319 · Cited by 63
Zheng, L., Niu, J., Long, M., & Fan, Y. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13283 · Cited by 49
Large language models meet user interfaces: The case of provisioning feedback
Pozdniakov, S., Brazil, J., Abdi, S., Bakharia, A., Sadiq, S., Gašević, D., Denny, P., & Khosravi, H. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100289 · Cited by 43
AI-assisted automated scoring of picture-cued writing tasks for language assessment
Zhao, R., Zhuang, Y., Zou, D., Xie, Q., & Yu, P. L. H. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11473-y · Cited by 40
Towards Giving Timely Formative Feedback and Hints to Novice Programmers
Jeuring, J., Keuning, H., Marwan, S., Bouvier, D., Izu, C., Kiesler, N., Lehtinen, T., Lohr, D., Peterson, A., & Sarsa, S. (2022) · Proceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3571785.3574124 · Cited by 40
“[15] with a detailed literature review of automated feedback technologies published between 2008 and 2019.”
BackgroundTeacher, peer, or AI? Comparing effects of feedback sources in higher education
Weidlich, J., Gotsch, F., Schudel, K., Marusic-Würscher, C., Mazzarella, J., Bolten, H., Bütler, D., Luger, S., Wohlfender, B., & Merki, K. M. (2025) · Computers and Education Open · doi:10.1016/j.caeo.2025.100300 · Cited by 36
Bauer, E., Richters, C., Pickal, A. J., Klippert, M., Sailer, M., & Stadler, M. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13609 · Cited by 33
Lu, G., & Ba, S. (2026) · Educational Psychology · doi:10.1080/01443410.2025.2489784 · Cited by 24
Lee, H.-Y., Chen, P.-H., Lin, C.-J., Huang, Y.-M., & Wu, T.-T. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13733-z · Cited by 21
Analytics of learner-centered feedback: A large-scale case study in higher education
Aldino, A. A., Tsai, Y.-S., Gupte, S., Henderson, M., Nath, D., Gašević, D., & Chen, G. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105360 · Cited by 19
Effects of learner choice over automated, immediate feedback
Kuklick, L. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102065 · Cited by 15
How Technology Assists the Feedback Process in a Learning Environment: A Review
Huang, W., Brown, G. T. L., & Stephens, J. M. (2023) · 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt58122.2023.00101 · Cited by 4
Exploring the role of automated feedback in programming education: a systematic literature review
Jung, Y., Lee, Y., Bae, J., Kim, D., Choi, H., Kang, M., & Lee, U. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2701430 · Cited by 4
A Tripartite Feedback Framework for AI-Assisted Assessment of Complex Reports in Higher Education
Venetsanos, D. T. (2026) · AI in Education · doi:10.3390/aieduc2030026
Metadata
- Authors
- Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J.
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 162
- Pages
- 104094
- ISSN
- 0360-1315 (ISSN-L)
- OpenAlex
- W3113108648
- Cited by
- 289
- References
- 136
- FWCI
- 6.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.