The DOI matches its Crossref record; 72 of the 75 references it cites were found in a registry or an index.
Personalized feedback in digital learning environments: Classification framework and literature review
Open accessAbstract
Digital learning technologies offer many opportunities to personalize instruction and learning in K-12 and higher education. In the last ten years, a growing body of research described personalized feedback implementations and investigated their effects on educational outcomes. Building on personalized education and adaptive learning systems models, this review provides an analytic framework to summarize key features of personalized feedback implementations and main empirical results. The systematic literature search resulted in 39 studies published in the last ten years. We found that scholars developed and investigated personalized feedback on the microscale, mesoscale, and macroscale of digital learning environments. However, the adaptive sources (To what is feedback adapted?) are mainly restricted to the current knowledge level and learning behavior data. Other interesting data sources for feedback adaptation remain underresearched, e.g., emotional state measures, progress measures, learning goals, or personality traits. Only a minority of the reviewed studies provided an empirical or theoretical rationale for assigning feedback messages to different types of students. Most studies report positive or at least mixed or neutral effects of personalized feedback on educational outcomes. This review discusses several implications for future directions in research on digitalized and personalized feedback. This study also adds to previous literature reviews on automatic and adaptive feedback that did not clearly distinguish task-adaptiveness and student-adaptiveness in digital feedback examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Handbook of research on educational communications and technology
(2004) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2004.00409_15.x · Cited by 1,840
Vision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435
The instructional effect of feedback in test-like events.
Bangert-Drowns, R. L., Kulik, C.-L. C., Kulik, J. A., & Morgan, M. (1991) · Review of Educational Research · doi:10.3102/00346543061002213 · Cited by 1,313
Artificial Intelligence in Education: The Three Paradigms
Ouyang, F., & Jiao, P. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100020 · Cited by 991
Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
AI-enabled adaptive learning systems: A systematic mapping of the literature
Kabudi, T., Pappas, I., & Olsen, D. H. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100017 · Cited by 734
Van der Kleij, F. M., Feskens, R. C. W., & Eggen, T. J. H. M. (2015) · Review of Educational Research · doi:10.3102/0034654314564881 · Cited by 714
Automatic feedback in online learning environments: A systematic literature review
Cavalcanti, A. P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y.-S., Gašević, D., & Mello, R. F. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100027 · Cited by 440
Using learning analytics to scale the provision of personalised feedback
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12592 · Cited by 425
A systematic literature review of automated feedback generation for programming exercises
Keuning, H., Jeuring, J., & Heeren, B. (2019) · ACM Transactions on Computing Education · doi:10.1145/3231711 · Cited by 370
Martin, F., Chen, Y., Moore, R. L., & Westine, C. D. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09793-2 · Cited by 306
Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021) · Computers & Education · doi:10.1016/j.compedu.2020.104094 · Cited by 289
Developing Personalized Education: A Dynamic Framework
Tetzlaff, L., Schmiedek, F., & Brod, G. (2021) · Educational Psychology Review · doi:10.1007/s10648-020-09570-w · Cited by 266
Exploring feedback and student characteristics relevant for personalizing feedback strategies
Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., & Melis, E. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.09.011 · Cited by 260
Analytics of Learning Strategies: Associations with Academic Performance and Feedback
Matcha, W., Gašević, D., Uzir, N. A., Jovanović, J., & Pardo, A. (2019) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3303772.3303787 · Cited by 202
Effects of different evaluative feedback on students’ self-efficacy in learning
Chan, J. C.-Y., & Lam, S. (2008) · Instructional Science · doi:10.1007/s11251-008-9077-2 · Cited by 177
Active Learning is About More Than Hands-On: A Mixed-Reality AI System to Support STEM Education
Yannier, N., Hudson, S. E., & Koedinger, K. R. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00194-3 · Cited by 175
Adaptive feedback in computer-based learning environments: a review
Bimba, A. T., Idris, N. B., Al-Hunaiyyan, A. A., Mahmud, R. B., & Shuib, L. M. (2017) · Adaptive Behavior · doi:10.1177/1059712317727590 · Cited by 165
Lim, L.-A., Gentili, S., Pardo, A., Kovanović, V., Whitelock-Wainwright, A., Gašević, D., & Dawson, S. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.003 · Cited by 159
Kim, J., Jo, I., & Park, Y. (2015) · Asia Pacific Education Review · doi:10.1007/s12564-015-9403-8 · Cited by 157
Yang, Y.-T. C., Chuang, Y.-C., Li, L.-Y., & Tseng, S.-S. (2013) · Computers & Education · doi:10.1016/j.compedu.2012.12.012 · Cited by 147
Zimbardi, K., Colthorpe, K. L., Dekker, A., ENGSTROM, C. M., Bugarc̀ić, A., Worthy, P., Victor, R., Chunduri, P., Bryan‐Lluka, L. J., & Long, P. (2016) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2016.1174187 · Cited by 129
Jones, A., & Castellano, G. (2018) · International Journal of Social Robotics · doi:10.1007/s12369-017-0458-z · Cited by 126
Timmers, C. F., & Veldkamp, B. P. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.11.007 · Cited by 114
Azcona, D., Hsiao, I.-H., & Smeaton, A. F. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09234-7 · Cited by 114
Lim, L.-A., Dawson, S., Gašević, D., Joksimović, S., Pardo, A., Fudge, A., & Gentili, S. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1782831 · Cited by 113
Kochmar, E., Vu, D. D., Belfer, R., Gupta, V., Serban, I. V., & Pineau, J. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00267-x · Cited by 112
Motivational beliefs, student effort, and feedback behaviour in computer-based formative assessment
Timmers, C. F., den Broek, J. B.-V., & van den Berg, S. M. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.07.007 · Cited by 97
Koenka, A. C., & Anderman, E. M. (2019) · Middle School Journal · doi:10.1080/00940771.2019.1674768 · Cited by 87
Artificial intelligence in constructing personalized and accurate feedback systems for students
Xu, W., Meng, J., Raja, S. K. S., Priya, M. P., & Devi, M. K. (2021) · Advances in Complex Systems · doi:10.1142/s1793962323410015 · Cited by 83
Personalized Affective Feedback to Address Students’ Frustration in ITS
Rajendran, R., Iyer, S. R., & Murthy, S. (2018) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2807447 · Cited by 72
Using achievement goal-based personalized motivational feedback to enhance online learning
Wang, H., & Lehman, J. D. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-09940-3 · Cited by 72
Feedback adaptation in web-based learning systems
Vasilyeva, E. E., Puuronen, S. J., Pechenizkiy, M., & Räsänen, P. (2007) · International Journal of Continuing Engineering Education and Life-Long Learning · doi:10.1504/ijceell.2007.015046 · Cited by 69
Computer-Tailored Student Support in Introductory Physics
Huberth, M., Chen, P., Tritz, J., & McKay, T. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0137001 · Cited by 67
Students’ sense-making of personalised feedback based on learning analytics
Lim, L.-A., Dawson, S., Gašević, D., Joksimović, S., Fudge, A., Pardo, A., & Gentili, S. (2020) · Australasian Journal of Educational Technology · doi:10.14742/ajet.6370 · Cited by 66
An Adaptive Feedback System to Improve Student Performance Based on Collaborative Behavior
Awais, M., Habiba, U., Khalid, H., Shoaib, M., & Arshad, S. (2019) · IEEE Access · doi:10.1109/access.2019.2931565 · Cited by 62
Paiva, R. C., Ferreira, M., & Frade, M. (2017) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12186 · Cited by 61
Advances in Web-based Education: Personalized Learning Environments
Magoulas, G. D., & Chen, S. Y. (2005) · Cited by 58
Gamification and Smart Feedback: Experiences with a Primary School Level Math App
Kickmeier-Rust, M., Hillemann, E.-C., & Albert, D. (2014) · International Journal of Game-Based Learning · doi:10.4018/ijgbl.2014070104 · Cited by 54
Automatic Assessment of Students’ Engineering Design Performance Using a Bayesian Network Model
Xing, W., Li, C., Chen, G., Huang, X., Chao, J., Massicotte, J., & Xie, C. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633120960422 · Cited by 51
Sun, J. C.-Y., Yu, S.-J., & Chao, C.-H. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1527291 · Cited by 49
Iraj, H., Fudge, A. L., Khan, H., Faulkner, M., Pardo, A., & Kovanović, V. (2021) · Journal of Learning Analytics · doi:10.18608/jla.2021.7184 · Cited by 49
Mousavi, A., Schmidt, M., Squires, V., & Wilson, K. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00210-6 · Cited by 47
Zheng, L., Zhong, L., Niu, J., Long, M., & Zhao, J. (2021) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 43
Developing pedagogically-guided algorithms for intelligent writing feedback
Roscoe, R. D., Varner, L. K., Crossley, S. A., & McNamara, D. S. (2013) · International Journal of Learning Technology · doi:10.1504/ijlt.2013.059131 · Cited by 42
Lenhard, W., Baier, H., Endlich, D., Schneider, W., & Hoffmann, J. (2011) · Journal of Research in Reading · doi:10.1111/j.1467-9817.2011.01505.x · Cited by 38
Dart, S., & Spratt, B. (2020) · Student Success · doi:10.5204/ssj.1543 · Cited by 34
OntoPeFeGe: Ontology-Based Personalized Feedback Generator
Demaidi, M. N., Gaber, M. M., & Filer, N. P. (2018) · IEEE Access · doi:10.1109/access.2018.2846398 · Cited by 33
An Adaptive Feedback Framework to Support Reflection, Guiding and Tutoring
Gouli, E., Γόγουλου, Α., Papanikolaou, K. A., & Grigoriadou, M. (2006) · IGI Global eBooks · doi:10.4018/978-1-59140-690-7.ch008 · Cited by 30
An Expanded Control Model for the Use of Instructional Feedback
Hancock, T. E., Thurman, R. A., & Hubbard, D. C. (1995) · Contemporary Educational Psychology · doi:10.1006/ceps.1995.1028 · Cited by 30
Using Software Tools To Provide Students in Large Classes with Individualized Formative Feedback
Hedtrich, S., & Graulich, N. (2018) · Journal of Chemical Education · doi:10.1021/acs.jchemed.8b00173 · Cited by 28
Using Semantic Technologies for Formative Assessment and Scoring in Large Courses and MOOCs
Lancho, M. S., Benítez, M. H., Paniagua, Á. S.-E., Encabo, J. M. L., & Jorge‐Botana, G. (2018) · Journal of Interactive Media in Education · doi:10.5334/jime.468 · Cited by 26
Maier, U. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104306 · Cited by 25
Self-citationWarm elaborated feedback. Exploring its benefits on post-feedback behaviour
Herrera, R. D. S., Mañá, A., Clemente, V. Á., & Sánchez, E. F. (2019) · Educational Psychology · doi:10.1080/01443410.2019.1687853 · Cited by 23
Dispositional Learning Analytics for Supporting Individualized Learning Feedback
Tempelaar, D. T., Rienties, B., & Nguyen, Q. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.703773 · Cited by 23
Scaffolding a Complex Task of Experimental Design in Chemistry with a Computer Environment
Girault, I., & d’Ham, C. (2013) · Journal of Science Education and Technology · doi:10.1007/s10956-013-9481-5 · Cited by 18
Personalized Feedback Emails: A Case Study on Online Introductory Computer Science Courses
Voghoei, S., Tonekaboni, N. H., Yazdansepas, D., Soleymani, S., Farahani, A., & Arabnia, H. R. (2020) · ACM Southeast Regional Conference (ACMSE) · doi:10.1145/3374135.3385274 · Cited by 18
Young, K. R., Schaffer, H. E., James, J. B., & Gallardo-Williams, M. T. (2020) · Innovative Higher Education · doi:10.1007/s10755-020-09527-5 · Cited by 18
Lewis, S., Heath, G., Lim, L., & Roberts, R. (2021) · Student Success · doi:10.5204/ssj.1623 · Cited by 17
Beneroso, D., & Robinson, J. P. (2021) · Education for Chemical Engineers · doi:10.1016/j.ece.2021.02.002 · Cited by 16
Personalized and Automated Feedback in Summative Assessment Using Recommender Systems
de Schipper, E., Feskens, R. C. W., & Keuning, J. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.652070 · Cited by 16
Automatic Assessment of the Design Quality of Python Programs with Personalized FeedbackPreprint
Orr, J. W., & Russell, N. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.01399 · Cited by 15
The Effects of Adaptive Feedback on Student’s Learning Gains
Bimba, A. T., Idris, N. B., Al-Hunaiyyan, A. A., Ibrahim, S. U., Mustafa, N., Supa'at, I., Zainal, N., & Ahmad, M. Y. (2021) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2021.0120709 · Cited by 14
Suryadi, A., & Kusairi, S. (2021) · Journal of Technology and Science Education · doi:10.3926/jotse.1100 · Cited by 9
Nobel, K., & Grünke, M. (2020) · Cited by 6
Gandini, E. A. M., & Horák, T. (2020) · Language Learning in Higher Education · doi:10.1515/cercles-2020-2012 · Cited by 4
Cited by
Human-centred learning analytics and AI in education: A systematic literature review
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100215 · Cited by 281
Integrating AI literacy into teacher education: a critical perspective paper
Daher, R. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00475-7 · Cited by 244
Yaseen, H., Mohammad, A. S., Ashal, N., Abusaimeh, H., Ali, A., & Sharabati, A.-A. A. (2025) · Sustainability · doi:10.3390/su17031133 · Cited by 207
Wang, C., Zou, B., Du, Y., & Wang, Z. (2024) · System · doi:10.1016/j.system.2024.103533 · Cited by 194
Personalized learning through AI: Pedagogical approaches and critical insights
Vorobyeva, K. I., Belous, S. V., Savchenko, N. V., Smirnova, L. M., Nikitina, S. A., & Zhdanov, S. P. (2025) · Contemporary Educational Technology · doi:10.30935/cedtech/16108 · Cited by 184
Metadata
- Authors
- Maier, U., & Klotz, C.
- Venue
- Computers and Education: Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2022
- Volume
- 3
- Pages
- 100080
- ISSN
- 2666-920X (ISSN-L)
- OpenAlex
- W4281386260
- Cited by
- 181
- References
- 75
- FWCI
- 10.82
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.