The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.
A review of automated feedback systems for learners: Classification framework, challenges and opportunities
Open accessAbstract
Abstract Teacher feedback provided to learners in real-time is a crucial factor for their knowledge and skills acquisition. However, providing real-time feedback at an individual level is often infeasible, considering limited teaching resources. Fortunately, recent technological advancements have allowed for developing of various computer tutoring systems, which can support learners at any place and time by generating personalized feedback automatically. Such systems have emerged in various domains, tackle different educational tasks, and often are designed in very distinctive ways. Consequently, the knowledge in the field of automated feedback systems is rather scattered across different domains and applications, as we illustrate in this study. This paper aims to outline the state-of-the-art of recently developed systems for delivering automated feedback, and thus serves as a source of systematic information for educators, researchers in the educational domain and system developers. More specifically, the contribution of this study is twofold. Firstly, we offer an extensive literature review of the field. As a result of a rigorous selection process, consisting of 4 phases, a total of 109 automated feedback systems is selected for a detailed review and thoroughly classified against numerous dimensions. Secondly, based on a detailed analysis of the recent literature sources and following the design science research approach, a classification framework for automated feedback systems is developed. This framework is used to classify the selected systems, and thus give a detailed overview of the predominantly available educational technologies, the educational settings in which they are applied, the properties of automated feedback they deliver, and the approaches for their design and evaluation. Based on this analysis, several important observations and recommendations are put forward as an outcome of the study. In particular, our study outlines the current fragmentation of the field, discusses a need for a common reference framework, and calls for more personalized, data-driven and student-centered solutions to exploit a larger set of opportunities offered in this age of data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · Cited by 13,930
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631
Wohlin, C. (2014) · Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/2601248.2601268 · Cited by 4,234
The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Rethinking models of feedback for learning: the challenge of design
Boud, D., & Molloy, E. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2012.691462 · Cited by 1,636
Design Science Research in Information Systems
Hevner, A., & Chatterjee, S. (2010) · Integrated Series in Information Systems · doi:10.1007/978-1-4419-5653-8_2 · Cited by 1,411
What is user engagement? A conceptual framework for defining user engagement with technology
O'Brien, H. L., & Toms, E. G. (2008) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20801 · Cited by 1,397
Design Research in Information Systems: Theory and Practice
Hevner, A., & Chatterjee, S. (2010) · Integrated Series in Information Systems · doi:10.1007/978-1-4419-5653-8 · Cited by 1,382
Technologies for foreign language learning: a review of technology types and their effectiveness
Golonka, E. M., Bowles, A. R., Frank, V. M., Richardson, D. L., & Freynik, S. (2014) · Computer Assisted Language Learning · doi:10.1080/09588221.2012.700315 · Cited by 1,144
Hwang, G.-J. (2014) · Smart Learning Environments · doi:10.1186/s40561-014-0004-5 · Cited by 655
A Virtual Reality Dance Training System Using Motion Capture Technology
Chan, J. C. P., Leung, H., Tang, J. K. T., & Komura, T. (2011) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2010.27 · Cited by 460
Student perceptions of quality feedback in teacher education
Ferguson, P. (2011) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903197883 · Cited by 427
Using learning analytics to scale the provision of personalised feedback
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12592 · Cited by 425
Automated feedback generation for introductory programming assignments
Singh, R., Gulwani, S., & Solar-Lezama, A. (2013) · Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2491956.2462195 · Cited by 383
Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2011) · Learning and Instruction · doi:10.1016/j.learninstruc.2010.07.004 · Cited by 382
A systematic literature review of automated feedback generation for programming exercises
Keuning, H., Jeuring, J., & Heeren, B. (2019) · ACM Transactions on Computing Education · doi:10.1145/3231711 · Cited by 370
Feedback Strategies for Interactive Learning Tasks
Narciss, S. (2007) · doi:10.4324/9780203880869.ch11 · Cited by 350
Martin, F., Chen, Y., Moore, R. L., & Westine, C. D. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09793-2 · Cited by 306
Wilson, J., & Czik, A. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.05.004 · Cited by 297
Exploring feedback and student characteristics relevant for personalizing feedback strategies
Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., & Melis, E. (2014) · Computers & Education · doi:10.1016/j.compedu.2013.09.011 · Cited by 260
Proceedings of the 49th ACM Technical Symposium on Computer Science Education
(2018) · doi:10.1145/3159450 · Cited by 252
Identification of personal traits in adaptive learning environment: Systematic literature review
Afini Normadhi, N. B., Shuib, L., Md Nasir, H. N., Bimba, A., Idris, N., & Balakrishnan, V. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.11.005 · Cited by 204
A systematic, tool-supported method for conducting literature reviews in information systems
Bandara, W., Miskon, S., & Fielt, E. (2011) · QUT ePrints (Queensland University of Technology) · Cited by 194
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
Zacharia, Z. C., Manoli, C., Xenofontos, N., de Jong, T., Pedaste, M., van Riesen, S. A. N., Kamp, E. T., Mäeots, M., Siiman, L., & Tsourlidaki, E. (2015) · Educational Technology Research and Development · doi:10.1007/s11423-015-9370-0 · Cited by 170
Basu, S., Biswas, G., & Kinnebrew, J. S. (2017) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-017-9187-0 · Cited by 169
Kyan, M. J., Sun, G., Li, H., Zhong, L., Muneesawang, P., Dong, N., Elder, B., & Guan, L. (2015) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2735951 · Cited by 165
Types and frequencies of feedback interventions in classroom interaction in secondary education
Voerman, L., Meijer, P. C., Korthagen, F. A. J., & Simons, R. J. (2012) · Teaching and Teacher Education · doi:10.1016/j.tate.2012.06.006 · Cited by 162
The importance of perceived control: fact or fantasy?
(1977) · PubMed · Cited by 150
(2008) · International journal on e-learning · Cited by 148
Automated feedback generation for introductory programming assignments
Singh, R., Gulwani, S., & Solar-Lezama, A. (2013) · ACM SIGPLAN Notices · doi:10.1145/2499370.2462195 · Cited by 146
Dzikovska, M. O., Steinhauser, N. B., Farrow, E., Moore, J. D., & Campbell, G. E. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0017-9 · Cited by 127
Instructional Message Design: Principles from the Behavioral Sciences
Fleming, M. L., & Levie, W. H. (1979) · Medical Entomology and Zoology · Cited by 126
Adaptive feedback in computer-based learning environments: a review
Bimba, A. T., Idris, N. B., Al-Hunaiyyan, A. A., Mahmud, R. B., & Shuib, L. M. (2017) · Adaptive Behavior · doi:10.1177/1059712317727590 · Cited by 123
The impact of online automated feedback on students' reflective journal writing in an EFL course
Cheng, G. (2017) · The Internet and Higher Education · doi:10.1016/j.iheduc.2017.04.002 · Cited by 120
Automated Essay Feedback Generation and Its Impact on Revision
Liu, M., Yi, L., Xu, W., & Liu, L. (2016) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2612659 · Cited by 114
Ai, H. (2017) · ReCALL · doi:10.1017/s095834401700012x · Cited by 114
Lee, H., Pallant, A., Pryputniewicz, S., Lord, T., Mulholland, M., & Liu, O. L. (2019) · Science Education · doi:10.1002/sce.21504 · Cited by 107
Spoken grammar practice and feedback in an ASR-based CALL system
de Vries, B. P., Catia Cucchiarini, A., Bodnar, S., Strik, H., & van Hout, R. W. N. M. (2014) · Computer Assisted Language Learning · doi:10.1080/09588221.2014.889713 · Cited by 106
Affective learning: Improving engagement and enhancing learning with affect-aware feedback
Grawemeyer, B., Mavrikis, M., Holmes, W., Gutiérrez-Santos, S., Wiedmann, M., & Rummel, N. (2017) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-017-9188-z · Cited by 105
Intelligent dental training simulator with objective skill assessment and feedback
Rhienmora, P., Haddawy, P., Suebnukarn, S., & Dailey, M. N. (2011) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2011.04.003 · Cited by 103
Ask-Elle: an Adaptable Programming Tutor for Haskell Giving Automated Feedback
Gerdes, A., Heeren, B. J., Jeuring, J. T., & van Binsbergen, L. T. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0080-x · Cited by 102
The effect of positive feedback in a constraint-based intelligent tutoring system
Mitrović, A., Ohlsson, S., & Barrow, D. K. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.07.002 · Cited by 101
Providing Real-time Feedback for Student Teachers in a Virtual Rehearsal Environment
Barmaki, R., & Hughes, C. E. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830604 · Cited by 86
PROGRAMMING ASSIGNMENTS AUTOMATIC GRADING: REVIEW OF TOOLS AND IMPLEMENTATIONS
Caiza, J. C., & Álamo, J. M. D. (2013) · Hispana · Cited by 83
My science tutor: A conversational multimedia virtual tutor.
Ward, W., Cole, R., Bolaños, D., Buchenroth-Martin, C., Svirsky, E., & Weston, T. (2013) · Journal of Educational Psychology · doi:10.1037/a0031589 · Cited by 81
Control of feedback in computer-assisted instruction
Pridemore, D., & Klein, J. D. (1991) · Educational Technology Research and Development · doi:10.1007/bf02296569 · Cited by 75
Ochôa, X., Domínguez, F., Guamán, B., Maya, R., Falcones, G., & Castells, J. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170406 · Cited by 73
Investigating the impact of automated feedback on students’ scientific argumentation
Zhu, M., Lee, H., Wang, T., Liu, O. L., Belur, V. K., & Pallant, A. (2017) · International Journal of Science Education · doi:10.1080/09500693.2017.1347303 · Cited by 69
Hülsmann, F., Göpfert, J. P., Hammer, B., Kopp, S., & Botsch, M. (2018) · Computers & Graphics · doi:10.1016/j.cag.2018.08.003 · Cited by 68
Smart Education and e-Learning 2017
Lněnička, M., Máchová, R., Komárková, J., & Pásler, M. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-59451-4 · Cited by 67
Personalized Affective Feedback to Address Students’ Frustration in ITS
Rajendran, R., Iyer, S. R., & Murthy, S. (2018) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2807447 · Cited by 67
Sung, Y., Liao, C.-N., Chang, T.-H., Chen, C., & Chang, K.-E. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.12.003 · Cited by 65
Efficacy of an ICALL tutoring system and process-oriented corrective feedback
Choi, I.-C. (2014) · Computer Assisted Language Learning · doi:10.1080/09588221.2014.960941 · Cited by 61
J-Latte: a Constraint-Based Tutor for Java
Holland, J., Mitrović, A., & Martin, B. (2009) · UC Research Repository (University of Canterbury) · Cited by 59
Students' Conceptions of Tutor and Automated Feedback in Professional Writing
Calvo, R. A., & Ellis, R. A. (2010) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2010.tb01072.x · Cited by 57
Can You Help Me with My Pitch? Studying a Tool for Real-Time Automated Feedback
Schneider, J., Börner, D., van Rosmalen, P., & Specht, M. M. (2016) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2627043 · Cited by 57
Mich, O., Pianta, E., & Mana, N. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.01.016 · Cited by 55
A mobile learning application for parsons problems with automatic feedback
Karavirta, V., Helminen, J., & Ihantola, P. (2012) · Koli Calling International Conference on Computing Education Research · doi:10.1145/2401796.2401798 · Cited by 55
A Review of AI-Supported Tutoring Approaches for Learning Programming
Le, N.-T., Strickroth, S., Groß, S., & Niels Pinkwart, C. (2013) · Studies in computational intelligence · doi:10.1007/978-3-319-00293-4_20 · Cited by 52
How automated feedback through text mining changes plagiaristic behavior in online assignments
Akçapınar, G. (2015) · Comput. Educ. · doi:10.1016/j.compedu.2015.04.007 · Cited by 51
Personalized feedback for self assessment in lifelong learning environments based on semantic web
Belcadhi, L. C. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.07.042 · Cited by 49
Domain-specific knowledge representation and inference engine for an intelligent tutoring system
Arevalillo‐Herráez, M., Arnau, D., & Marco-Giménez, L. (2013) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.04.017 · Cited by 49
VanLehn, K. A., Wetzel, J., Grover, S., & van de Sande, B. (2016) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2016.2514422 · Cited by 49
Sun, J. C.-Y., Yu, S.-J., & Chao, C.-H. (2019) · Educational Psychology · doi:10.1080/01443410.2018.1527291 · Cited by 49
Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale
(2017) · doi:10.1145/3051457 · Cited by 48
Benotti, L., Aloi, F., Bulgarelli, F. L., & Gómez, M. J. (2018) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3159450.3159579 · Cited by 45
Perikos, I., Grivokostopoulou, F., & Hatzilygeroudis, I. (2017) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-017-0139-y · Cited by 44
Data Driven Automatic Feedback Generation in the iList Intelligent Tutoring System.
Fossati, D., Eugenio, B. D., Ohlsson, S., Brown, C. W., & Chen, L. (2015) · Cited by 43
Qian, Y., & Lehman, J. D. (2019) · Sage Open · doi:10.1177/2158244019885136 · Cited by 42
Generating Data-Driven Hints for Open-Ended Programming.
Price, T., Dong, Y., & Barnes, T. M. (2016) · Educational Data Mining · Cited by 41
Motivation and emotion predict medical students’ attention to computer-based feedback
Naismith, L. M., & Lajoie, S. P. (2017) · Advances in Health Sciences Education · doi:10.1007/s10459-017-9806-x · Cited by 41
ROC speak: semi-automated personalized feedback on nonverbal behavior from recorded videos
Fung, M., Jin, Y., Zhao, R., & Hoque, M. E. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804265 · Cited by 38
Sedrakyan, G., Poelmans, S., & Snoeck, M. (2016) · Information and Software Technology · doi:10.1016/j.infsof.2016.11.001 · Cited by 37
Self-citationKnowledge maps: a tool for online assessment with automated feedback
Ho, V. W., Harris, P., Kumar, R. K., & Velan, G. M. (2018) · Medical Education Online · doi:10.1080/10872981.2018.1457394 · Cited by 37
OntoPeFeGe: Ontology-Based Personalized Feedback Generator
Demaidi, M. N., Gaber, M. M., & Filer, N. P. (2018) · IEEE Access · doi:10.1109/access.2018.2846398 · Cited by 33
Online feedback system for public speakers
Nguyen, A.-T., Chen, W., & Rauterberg, M. (2012) · IEEE Conference on e-Learning, e-Management and e-Services (IC3e) · doi:10.1109/is3e.2012.6414963 · Cited by 32
Liu, C., Calvo, R. A., & Lim, R. (2016) · Frontiers in ICT · doi:10.3389/fict.2016.00011 · Cited by 31
Cutumisu, M., Blair, K. P., Chin, D. B., & Schwartz, D. L. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0137-5 · Cited by 31
Adaptive Feedback Based on Student Emotion in a System for Programming Practice
Tiam-Lee, T. J., & Sumi, K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91464-0_24 · Cited by 31
Automating Individualized Formative Feedback in Large Classes Based on a Directed Concept Graph
Schaffer, H. E., Young, K. R., Ligon, E. W., & Chapman, D. D. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00260 · Cited by 30
A feedback system to provide affective support to students
Jiménez, S., Juárez‐Ramírez, R., Castillo, V. H., Licea, G., Noriega, A. D. R., & Inzunza, S. (2018) · Computer Applications in Engineering Education · doi:10.1002/cae.21900 · Cited by 30
Semantic Web technologies for generating feedback in online assessment environments
Vera, M. D. M. S., Fernández‐Breis, J. T., Castellanos–Nieves, D., Frutos-Morales, F., & Espinosa, M. P. P. (2012) · Knowledge-Based Systems · doi:10.1016/j.knosys.2012.03.010 · Cited by 29
Dancing Salsa with Machines—Filling the Gap of Dancing Learning Solutions
Romano, G., Schneider, J., & Drachsler, H. (2019) · Sensors · doi:10.3390/s19173661 · Cited by 29
Some insights into the impact of affective information when delivering feedback to students
Cabestrero, R., Quirós, P., Santos, O., Salmeron-Majadas, S., Uria-Rivas, R., Boticario, J., Arnau, D., Arevalillo-Herráez, M., & Ferri, F. (2018) · Behavior and Information Technology · doi:10.1080/0144929x.2018.1499803 · Cited by 28
Mining interactions in immersive learning environments for real-time student feedback
Kennedy, G. E., Ioannou, I., Zhou, Y., Bailey, J., & O’Leary, S. J. (2013) · Australasian Journal of Educational Technology · doi:10.14742/ajet.700 · Cited by 26
Learning Programming Languages through Corrective Feedback and Concept Visualisation
Watson, C., Li, F. W. B., & Lau, R. W. H. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25813-8_2 · Cited by 25
Marcus, N., Ben-Naim, D., & Bain, M. (2011) · International Conference on Information Technology: New Generations · doi:10.1109/itng.2011.111 · Cited by 24
Employing UMLS for generating hints in a tutoring system for medical problem-based learning
Kazi, H., Haddawy, P., & Suebnukarn, S. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2012.02.010 · Cited by 24
Analysis and feedback of erroneous Arabic verbs
Shaalan, K. F., Magdy, M., & Fahmy, A. (2013) · Natural Language Engineering · doi:10.1017/s1351324913000223 · Cited by 22
Individualizing Tutoring with Learning Style Based Feedback
Parvez, S. M., & Blank, G. D. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-69132-7_33 · Cited by 21
An Automated Feedback System Based on Adaptive Testing: Extending the Model
Barker, T. (2010) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v5i2.1235 · Cited by 21
Fujita, T., Jones, K., & Miyazaki, M. (2018) · ZDM · doi:10.1007/s11858-018-0950-4 · Cited by 21
Leveraging a Domain Ontology to Increase the Quality of Feedback in an Intelligent Tutoring System
Kazi, H., Haddawy, P., & Suebnukarn, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13388-6_12 · Cited by 20
Motivational and metacognitive feedback in SQL-Tutor*
Hull, A., & du Boulay, B. (2015) · Computer Science Education · doi:10.1080/08993408.2015.1033143 · Cited by 20
Data-Driven Feedback Generator for Online Programing Courses
Wang, K., Lin, B., Rettig, B., Pardi, P., & Singh, R. (2017) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3051457.3053999 · Cited by 20
Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization
Tkalcic, M., Thakker, D., Germanakos, P., Herder, E., & Bielikova, M. (2017) · doi:10.1145/3099023 · Cited by 20
Inventado, P. S., Legaspi, R., The Duy, B. U. I., & Suarez, M. T. (2010) · International Conference on Computers in Education · doi:10.58459/icce.2010.41 · Cited by 19
CodeRunnerGL - An Interactive Web-Based Tool for Computer Graphics Teaching and Assessment
Wünsche, B. C., Huang, E., Shaw, L. A., Suselo, T., Leung, K., Dimalen, D., van der Mark, W., Luxton-Reilly, A., & Lobb, R. (2019) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.23919/elinfocom.2019.8706402 · Cited by 19
Feedback and Revising in an Intelligent Tutoring System for Writing Strategies
Roscoe, R. D., Snow, E. L., & McNamara, D. S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39112-5_27 · Cited by 17
Exploring the effectiveness of a novel feedback mechanism within an intelligent tutoring system
Sullins, J., Craig, S. D., & Hu, X. (2015) · International Journal of Learning Technology · doi:10.1504/ijlt.2015.072358 · Cited by 17
Autonomous Agent that Provides Automated Feedback Improves Negotiation Skills
Monahan, S., Johnson, E., Lucas, G., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2_41 · Cited by 15
Designing feedback to support language acquisition using the ingenio authoring tool
Sanz, A. M. G., & Macario, D.-S. J. (2009) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2009.01.221 · Cited by 12
Data Mining to Generate Individualised Feedback
Dominguez, A. K., Yacef, K., & Curran, J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13437-1_52 · Cited by 12
An Adaptive Approach to Provide Feedback for Students in Programming Problem Solving
Silva, P., Costa, E. D. B., & de Araújo, J. M. F. R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22244-4_3 · Cited by 12
Be Brief, And They Shall Learn: Generating Concise Language Feedback for a Computer Tutor
Eugenio, B. D., Fossati, D., Haller, S., Yu, D., & Glass, M. (2008) · doi:10.5555/1497124.1497127 · Cited by 11
Learning Persian grammar with the aid of an intelligent feedback generator
Mirzaeian, V. R., Kohzadi, H., & Azizmohammadi, F. (2015) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2015.09.012 · Cited by 11
McGuire, P., Tu, S., Logue, M. E., Mason, C. A., & Ostrow, K. (2017) · Educational Media International · doi:10.1080/09523987.2017.1384161 · Cited by 11
Stranieri, A., & Yearwood, J. L. (2008) · Interactive Learning Environments · doi:10.1080/10494820802114176 · Cited by 10
Adaptive Training Environment without Prior Knowledge
Frenoy, R., Soullard, Y., Thouvenin, I., & Gapenne, O. (2016) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/2930238.2930256 · Cited by 10
Providing Effective Real-Time Feedback in Simulation-Based Surgical Training
Ma, X., Wijewickrema, S. N. R., Zhou, Y., Zhou, S., O'Leary, S., & Bailey, J. (2017) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/978-3-319-66185-8_64 · Cited by 10
Conceptual Framework for Feedback Automation in SLEs
Serral, E., & Snoeck, M. (2016) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-39690-3_9 · Cited by 9
Self-citationdos Santos, A. D. P., Yacef, K., & Martínez‐Maldonado, R. (2017) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3099023.3099032 · Cited by 9
Higher Education Learner Experience with Fuzzy Feedback in a Digital Learning Environment
Björn, M. H., Ravyse, W. S., Villafruella, D. S., et al. (2018) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2018.8639910 · Cited by 8
Simple but effective feedback generation to tutor abstract problem solving
Lu, X., Eugenio, B. D., Ohlsson, S., & Fossati, D. (2008) · International Conference on Natural Language Generation · doi:10.3115/1708322.1708343 · Cited by 6
Feedback Authoring for Exploratory Activities: The Case of a Logo-Based 3D Microworld
Karkalas, S., Mavrikis, M., Xenos, M., & Kynigos, C. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-63184-4_14 · Cited by 6
Gui-driven intelligent tutoring system with affective support to help learning the algebraic method
Arevalillo‐Herráez, M., Arnau, D., Ferri, F. J., & Santos, O. C. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8123062 · Cited by 6
Enhancing Feedback to Students in Automated Diagram Assessment
Correia, H., Leal, J. P., & Paiva, J. C. (2017) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.slate.2017.11 · Cited by 5
Hautala, J., Baker, D. L., Keurulainen, A., Ronimus, M., Richardson, U., & Cole, R. A. (2018) · Educational Technology Research and Development · doi:10.1007/s11423-017-9558-6 · Cited by 5
MatchMySound: Introducing Feedback to Online Music Education
Kão, K., & Niitsoo, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13296-9_24 · Cited by 3
Designing Formative and Adaptive Feedback Using Incremental User Models
Höhn, S., & Ras, E. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-47440-3_19 · Cited by 3
Improving quality of feedback using a technology-supported learning system
Grigoriou, T., & Cheong, C. (2015) · RMIT Research Repository (RMIT University Library) · Cited by 2
Delivering Tutoring Feedback Using Persuasive Dialogues
Rahati, A., & Kabanza, F. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13437-1_35 · Cited by 1
Cited by
Artificial Intelligence in Education: The Three Paradigms
Ouyang, F., & Jiao, P. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100020 · Cited by 991
Ouyang, F., Zheng, L., & Jiao, P. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10925-9 · Cited by 831
Impact of AI assistance on student agency
Darvishi, A., Khosravi, H., Sadiq, S., Gašević, D., & Siemens, G. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104967 · Cited by 548
“…learning resources (Bodily & Verbert, 2017), automated feedback systems provide real-time feedback on students ’ work (Cavalcanti et al., 2021; Deeva, Bogdanova, Serral, Snoeck, & De Weerdt, 2021), personalised nudging systems remind students of upcoming deadlines (Damgaard & Nielsen, 2018)…”
BackgroundLiang, J.-C., Hwang, G.-J., Chen, M.-R. A., & Darmawansah, D. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1958348 · Cited by 378
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00406-5 · Cited by 332
Metadata
- Authors
- Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J.
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 162
- Pages
- 104094
- ISSN
- 0360-1315 (ISSN-L)
- OpenAlex
- W3113108648
- Cited by
- 289
- References
- 136
- FWCI
- 6.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.