A comparative analysis of the skilled use of automated feedback tools through the lens of teacher feedback literacy
Open accessAbstract
Effective learning depends on effective feedback, which in turn requires a set of skills, dispositions and practices on the part of both students and teachers which have been termed feedback literacy. A previously published teacher feedback literacy competency framework has identified what is needed by teachers to implement feedback well. While this framework refers in broad terms to the potential uses of educational technologies, it does not examine in detail the new possibilities of automated feedback (AF) tools, especially those that are open by offering varying degrees of transparency and control to teachers. Using analytics and artificial intelligence, open AF tools permit automated processing and feedback with a speed, precision and scale that exceeds that of humans. This raises important questions about how human and machine feedback can be combined optimally and what is now required of teachers to use such tools skillfully. The paper addresses two research questions: Which teacher feedback competencies are necessary for the skilled use of open AF tools? and What does the skilled use of open AF tools add to our conceptions of teacher feedback competencies? We conduct an analysis of published evidence concerning teachers’ use of open AF tools through the lens of teacher feedback literacy, which produces summary matrices revealing relative strengths and weaknesses in the literature, and the relevance of the feedback literacy framework. We conclude firstly, that when used effectively, open AF tools exercise a range of teacher feedback competencies. The paper thus offers a detailed account of the nature of teachers’ feedback literacy practices within this context. Secondly, this analysis reveals gaps in the literature, signalling opportunities for future work. Thirdly, we propose several examples of automated feedback literacy, that is, distinctive teacher competencies linked to the skilled use of open AF tools.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent work has suggested that the educational use of automated feedback depends on how human and machine roles are distributed within feedback processes, and that AI assistance may weaken student agency when critique is accepted too readily or when difficult judgments are outsourced to the system.
“Recent work has suggested that the educational use of automated feedback depends on how human and machine roles are distributed within feedback processes, and that AI assistance may weaken student agency when critique is accepted too readily or when difficult judgments are outsourced to the system (Buckingham Shum et al., 2023;Darvishi et al., 2024).”
From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredThe findings add empirical weight to the argument that the pedagogical value of GenAI depends not only on what the tool can generate, but also on whether surrounding feedback designs amplify or displace students' evaluative responsibility.
“In this respect, the findings add empirical weight to the argument that the pedagogical value of GenAI depends not only on what the tool can generate, but also on whether surrounding feedback designs amplify or displace students' evaluative responsibility(Buckingham Shum et al., 2023;Darvishi et al., 2024).”
From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023
The Conclusion (page unavailable) says open automated-feedback tools can cultivate learner agency and productive action rather than passive feedback processes. The ‘Changing conceptions of feedback’ section likewise says students must actively make sense of feedback. The paper supports the importance of feedback design and student agency, but its analysis of automated-feedback tools does not establish the claim specifically for GenAI or whether GenAI designs displace students’ evaluative responsibility. (LLM, conf=0.84)
Experimental — accuracy not yet measuredFor higher education digital learning, the central implication is not whether students can access GenAI feedback, but how GenAI feedback is pedagogically organized so that human evaluative work remains at the center.
“For higher education digital learning, the central implication is therefore not whether students can access GenAI feedback, but how GenAI feedback is pedagogically organized so that human evaluative work remains at the center (Buckingham Shum et al., 2023; Xia et al., 2024).”
From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023
The Introduction and Conclusion emphasize designing automated feedback around active student participation and teachers’ skilled use of technology; the ‘Crafts appropriate inputs to students’ section says such tools should augment teachers rather than automate them out of the loop. This supports the claim’s focus on pedagogical organization and human work, but the paper does not frame that implication specifically around students’ access to GenAI feedback. (LLM, conf=0.85)
Experimental — accuracy not yet measuredThe advantages of reflective and hybrid designs appear to reflect a more productive organization of evaluative activity rather than short-term score improvement alone.
“Their advantages therefore appear to reflect a more productive organization of evaluative activity rather than short-term score improvement alone(Carless & Boud, 2018;Buckingham Shum et al., 2023).”
From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023
The sections “Designs for feedback dialogues and cycles” and “Manages tensions between feedback and grading” describe feedback organized around revision and learning processes rather than grade justification. The paper does not establish the comparative advantages of reflective and hybrid designs or assess short-term score improvement, so those parts of the attributed claim remain unsupported. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 1× · see citing works
“Significantly, educational analytics and AI have emerged from the lab into mainstream products in the last decade, with most products offering analytics, and a growing number AI-enabled feedback, catalysed most recently by developments in large language models (Kasneci et al., 2023).”
BackgroundThe development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428 · see citing works
Self-citationRethinking models of feedback for learning: the challenge of design
Boud, D., & Molloy, E. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2012.691462 · Cited by 1,636 · cited 2× · see citing works
“Conventionally, feedback has been regarded as an input to students , such as comments on a student’s assignment, but there has been a shift in recent years to recognise that feedback is necessarily a process in which students have an essential role (Boud & Molloy, 2013).”
BackgroundSelf-citationThe Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research
Wisniewski, B., Zierer, K., & Hattie, J. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.03087 · Cited by 1,199 · cited 1× · see citing works
“Hattie and others have argued (Wisniewki et al., 2020) that it is the greatest contributor identified in meta-analyses of the effects of different kinds of intervention on learning.”
BackgroundWinstone, N. E., Nash, R. A., Parker, M., & Rowntree, J. (2017) · Educational Psychologist · doi:10.1080/00461520.2016.1207538 · Cited by 884 · cited 3× · see citing works
“Furthermore, students’ feedback literacy is enhanced when they trust their teachers (Boud & Carless, 2018; Winstone et al., 2017).”
BackgroundDeveloping a learning-centred framework for feedback literacy
Molloy, E., Boud, D., & Henderson, M. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1667955 · Cited by 555 · cited 1× · see citing works
“This focus on feedback literacy led Molloy, et al. (2020) to develop a learner -centred framework for feedback literacy based on the analysis of data from students’ experience of feedback, and Boud and Dawson (2021) to propose an empirically-derived competency framework to identify the attributes…”
MethodSelf-citationFeedback loops and the longer-term: towards feedback spirals
Carless, D. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1531108 · Cited by 328 · cited 5× · see citing works
“…S R E S t o c a p t u r e p e r f o r m a n c e i n i n ‑ c l a ss a ss e ss m e n t s , r e s u l t i n g i n m o r e e ffi ‑ c i e n t m a r k i n g p r o c e ss e s a n d m o r e d e t a i l e d f ee d b a c k ( A r t h a r s e t a l ., 2019 ) U s i n g t h e r i g h t t oo l f o r t h e j o b —”
BackgroundInfluentialLim, L.-A., Gentili, S., Pardo, A., Kovanović, V., Whitelock-Wainwright, A., Gašević, D., & Dawson, S. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.003 · Cited by 159 · cited 7× · see citing works
“Finally, there is emerging evidence that learners’ attributes have some influence on their feedback literacy, such as prior academic performance (Lim et al., 2021a), self-efficacy and baseline self-regulation (Tsai et al., 2021), or performance goals (Brown et al., 2019).”
BackgroundMethodInfluentialSelf-citationAcaWriter: A learning analytics tool for formative feedback on academic writing
Knight, S., Shibani, A., Abel, S., Gibson, A., & Ryan, P. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.06 · Cited by 151 · see citing works
Development of a Short Form of the Test Anxiety Inventory (TAI)
Taylor, J., & Deane, F. P. (2002) · The Journal of General Psychology · doi:10.1080/00221300209603133 · Cited by 147 · see citing works
From Data to Insights: A Layered Storytelling Approach for Multimodal Learning Analytics
Martinez-Maldonado, R., Echeverria, V., Fernandez Nieto, G., & Buckingham Shum, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376148 · Cited by 123 · see citing works
Educator perspectives on learning analytics in classroom practice
Shibani, A., Knight, S., & Buckingham Shum, S. (2020) · The Internet and Higher Education · doi:10.1016/j.iheduc.2020.100730 · Cited by 86 · see citing works
Preparing University Assessment for a World With AI: Tasks for Human Intelligence
Bearman, M., & Luckin, R. (2020) · The enabling power of assessment · doi:10.1007/978-3-030-41956-1_5 · Cited by 74 · cited 1× · see citing works
“Computers can complete tasks at scale, rapidly and reliably (Bearman & Luckin, 2020).”
BackgroundStudents’ sense-making of personalised feedback based on learning analytics
Lim, L.-A., Dawson, S., Gašević, D., Joksimović, S., Fudge, A., Pardo, A., & Gentili, S. (2020) · Australasian Journal of Educational Technology · doi:10.14742/ajet.6370 · Cited by 66 · see citing works
Self-citationLim, L.-A., Gasevic, D., Matcha, W., Ahmad Uzir, N., & Dawson, S. (2021) · LAK21: 11th International Learning Analytics and Knowledge Conference · doi:10.1145/3448139.3448174 · Cited by 47 · see citing works
Self-citationStudent appreciation of data-driven feedback: A pilot study on OnTask
Tsai, Y.-S., Mello, R. F., Jovanović, J., & Gašević, D. (2021) · LAK21: 11th International Learning Analytics and Knowledge Conference · doi:10.1145/3448139.3448212 · Cited by 41 · see citing works
Flagged first, then by citations
Research works printed but not linked: 58
- Arthars, N., & Liu, D.Y.-T. (2020). How and why faculty adopt learning analytics. In D. Ifenthaler & D. Gibson (Eds.), Adoption of Data Analytics in Higher Education Learning and Teaching (pp. 201-220). Springer International Publishing. https:// doi. org/ 10. 1007/ 978-3-030-47392-1_ 11 · DOI
- Arthars, N., Dollinger, M., Vigentini, L., Liu, D.Y.-T., Kondo, E., & King, D. M. (2019). Empowering teachers to personalize learning support. In D. Ifenthaler, D.-K. Mah, & J.Y.-K. Yau (Eds.), Utilizing Learning Analytics to Support Study Success (pp. 223-248). Springer International Publishing. https:// doi. org/ 10. 1007/ 978-3-319-64792-0_ 13 · DOI
- Askew, S., & Lodge, C. (2000). Gifts, ping-pong and loops-linking feedback and learning. In S. Askew (Ed.), Feedback for Learning (pp. 1-17). Routledge. https:// doi. org/ 10. 4324/ 97802 03017 678 · DOI
- Baker, R. SJd. & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. Journal of Educa- tional Data Mining, 1(1), 3-17. https:// doi. org/ 10. 5281/ zenodo. 35546 57 · DOI
- Bearman, M., Lambert, S., & O'Donnell, M. (2021). How a centralised approach to learning design influences students: A mixed methods study. Higher Education Research & Development, 40(4), 692-705. https:// doi. org/ 10. 1080/ 07294 360. 2020. 17928 · DOI
- Blumenstein, M., Liu, D.Y.-T., Richards, D., Leichtweis, S., & Stephens, J. (2019). Data-informed nudges for student engage- ment and success. In J. M. Lodge, J. C. Horvath, & L. Corrin (Eds.), Learning Analytics in the Classroom: Translating Learning Analytics for Teachers (pp. 185-207). Routledge.
- Bodily, R., & Verbert, K. (2017). Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies, 10(4), 405-418. https:// doi. org/ 10. 1109/ TLT. 2017. 27401 · DOI · Paper page
- Boell, S. K., & Cecez-Kecmanovic, D. (2015). On being 'systematic' in literature reviews in IS. Journal of Information Technol- ogy, 30(2), 161-173. https:// doi. org/ 10. 1057/ jit. 2014. 26 · DOI
- Boud, D., & Dawson, P. (2021). What feedback literate teachers do: an empirically derived competency framework. Assess- ment and Evaluation in Higher Education. https:// doi. org/ 10. 1080/ 02602 938. 2021. 19109 28 · DOI
- Broadbent, J., Panadero, E., Lodge, J. M., & de Barba, P. (2020). Technologies to enhance self-regulated learning in online and computer mediated learning environments. In M. J. Bishop, J. Elen, E. Boling, & V. Svihla (Eds.), Handbook of Research in Educational Communications and Technology. Springer.
- Brown, M. G., Schiltz, J., Derry, H., & Holman, C. (2019). Implementing online personalized social comparison nudges in a web-enabled coaching system. The Internet and Higher Education, 43, 100691. https:// doi. org/ 10. 1016/j. iheduc. 2019. 100691 · DOI
- Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy. Teaching in Higher Education. https:// doi. org/ 10. 1080/ 13562 517. 2020. 17823 · DOI · Paper page
- Carroll, J. M., & Rosson, M. B. (1992). Getting around the task-artifact cycle: How to make claims and design by scenario. ACM Transactions on Information Systems, 10(2), 181-212. https:// doi. org/ 10. 1145/ 146802. 146834 · DOI
- Chen, P., Chavez, O., Ong, D. C., & Gunderson, B. (2017). Strategic resource use for learning: A self-administered interven- tion that guides self-reflection on effective resource use enhances academic performance. Psychological Science, 28(6), 774-785. https:// doi. org/ 10. 1177/ 09567 97617 696456 · DOI · Paper page
- Dawson, P., Carless, D., & Lee, P. P. W. (2021). Authentic feedback: Supporting learners to engage in disciplinary feedback practices. Assessment & Evaluation in Higher Education, 46(2), 286-296. https:// doi. org/ 10. 1080/ 02602 938. 2020. 17690 · DOI
- de Barba, P., & Corrin, L. (2014). Exploring students' interpretation of feedback delivered through learning analytics dash- boards. Proceedings of the 31st Annual Conference of the Australian Society for Computers in Tertiary Education (ASCILITE 2014), Dunedin, NZ, 23-26 Nov. 2014, pp. 629-633. http:// hdl. handle. net/ 1959.3/ 447675
- Dede, C., Richards, J., & Saxberg, B. (2018). Learning Engineering for Online Education: Theoretical Contexts and Design-Based Examples (1st ed.). Routledge. https:// doi. org/ 10. 4324/ 97813 51186 193 · DOI
- du Boulay, B. (2019). Escape from the skinner box: The case for contemporary intelligent learning environments. British Journal of Educational Technology, 50(6), 2902-2919. https:// doi. org/ 10. 1111/ bjet. 12860 · DOI
- Echeverria, V., Martinez-Maldonado, R., Granda, R., Chiluiza, K., Conati, C., & Buckingham Shum, S. (2018). Driving data storytelling from learning design. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, Sydney, New South Wales, Australia. https:// doi. org/ 10. 1145/ 31703 58. 31703 80 · DOI · Paper page
- Esterhazy, R. (2018). What matters for productive feedback? Disciplinary practices and their relational dynamics. Assess- ment & Evaluation in Higher Education, 43(8), 1302-1314. https:// doi. org/ 10. 1080/ 02602 938. 2018. 14633 · DOI · Paper page
- Feng, S., & Law, N. (2021). Mapping artificial intelligence in education research: A network-based keyword analysis. Inter- national Journal of Artificial Intelligence in Education, 31(2), 277-303. https:// doi. org/ 10. 1007/ s40593-021-00244-4 · DOI
- Fernandez-Nieto, G., Echeverria, V., Buckingham Shum, S., Mangaroska, K., Kitto, K., Palominos, E., Axisa, C., & Martinez- Maldonado, R. (2021). Storytelling with learner data: Guiding student reflection on multimodal team data. IEEE Transactions on Learning Technologies, 14(5), 695-708. https:// doi. org/ 10. 1109/ tlt. 2021. 31318 42 · DOI
- Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5/6), 304-317. https:// doi. org/ 10. 1504/ IJTEL. 2012. 051816 · DOI
- Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information and Libraries Journal, 26, 91-108. https:// doi. org/ 10. 1111/j. 1471-1842. 2009. 00848.x · DOI · Paper page
- Greer, J. E., Frost, S., Banow, R., Thompson, C., Kuleza, S., Wilson, K., & Koehn, G. (2015). The Student Advice Recommender Agent: SARA. 5th International Workshop on Personalization Approaches in Learning Environments, 23rd Conference on User Modeling, Adaptation, and Personalization. http:// ceur-ws. org/ Vol-1388/ PALE2 015-paper2. pdf
- Heckman, S., & King, J. (2018). Developing Software Engineering Skills using Real Tools for Automated Grading. Proceed- ings of the 49th ACM Technical Symposium on Computer Science Education. ACM, New York, NY, USA, 794-799. https:// doi. org/ 10. 1145/ 31594 50. 31595 95 · DOI
- Henderson, M., Molloy, E., Ajjawi, R., & Boud, D. (2019b). Designing feedback for impact. In M. Henderson, R. Ajjawi, D. Boud, & E. Molloy (Eds.), The Impact of Feedback in Higher Education: Improving Assessment Outcomes for Learners (pp. 267-285). Springer International Publishing. https:// doi. org/ 10. 1007/ 978-3-030-25112-3_ 15 · DOI
- Henderson, M., Ryan, T., Boud, D., Dawson, P., Phillips, M., Molloy, E., & Mahoney, P. (2019a). Conditions that enable effec- tive feedback. Higher Education Research and Development, 38(7), 1401-1416. https:// doi. org/ 10. 1080/ 07294 360. 2019. 16578 · DOI · Paper page
- Huberth, M., Chen, P., Tritz, J., & McKay, T. A. (2015). Computer-tailored student support in introductory physics. PLoS ONE, 10(9), e0137001. https:// doi. org/ 10. 1371/ journ al. pone. 01370 01 · DOI
- Iraj, H., Fudge, A., Faulkner, M., Pardo, A., & Kovanović, V. (2020). Understanding students' engagement with personalised feedback messages. In Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK '20), March 23-27, 2020, Frankfurt, Germany. (pp. 438-447). ACM. https:// doi. org/ 10. 1145/ 33754 62. 33755 27 · DOI
- Jensen, L. X., Bearman, M., & Boud, D. (2021). Understanding feedback in online learning-A critical review and metaphor analysis. Computers & Education, 173, 104271. https:// doi. org/ 10. 1016/j. compe du. 2021. 104271 · DOI
- Joksimovic, S., Siemens, G., Wang, Y. E., San Pedro, M. O. Z., & Way, J. (2020). Beyond cognitive ability: Enabling assessment of 21st century skills through learning analytics (editorial). Journal of Learning Analytics, 7(1), 1-4. https:// doi. org/ 10. 18608/ jla. 2020. 71.1 · DOI
- Knight, S., Buckingham Shum, S., Ryan, P., Sándor, Á., & Wang, X. (2018). Designing academic writing analytics for civil law student self-assessment. International Journal of Artificial Intelligence in Education, 28(1), 1-28. https:// doi. org/ 10. 1007/ s40593-016-0121-0 · DOI
- Koedinger, K. R., & Aleven, V. (2016). An interview reflection on "intelligent tutoring goes to school in the big city. " Interna- tional Journal of Artificial Intelligence in Education, 26(1), 13-24. https:// doi. org/ 10. 1007/ s40593-015-0082-8 · DOI
- Lim, L.-A., Dawson, S., Gašević, D., Joksimović, S., Pardo, A., Fudge, A., & Gentili, S. (2021c). Students' perceptions of, and emotional responses to, personalised learning analytics-based feedback: An exploratory study of four courses. Assessment & Evaluation in Higher Education, 46(3), 339-359. https:// doi. org/ 10. 1080/ 02602 938. 2020. 17828 · DOI · Paper page
- Lim, L.-A., Fudge, A., & Dawson, S. (2019). Feeling supported: Enabling students in diverse cohorts through personalised, data-informed feedback. In Y. W. Chew, K. M. Chan & A. Alphonso (Eds.), Personalised Learning. Diverse Goals. One Heart. ASCILITE 2019 Singapore (pp. 206-215). https:// 2019c onfer ence. ascil ite. org/ assets/ papers/ Paper-111. pdf
- Liu, D. Y.-T., Bartimote-Aufflick, K., Pardo, A., & Bridgeman, A. J. (2017). Data-driven personalization of student learning support in higher education. In A. Peña-Ayala (Ed.), Learning Analytics: Fundaments, Applications, and Trends, Studies in Systems, Decision and Control, 94 (pp. 143-169). https:// doi. org/ 10. 1007/ 978-3-319-52977-6 · DOI
- Lovett, M., Meyer, O., & Thille, C. (2008). The open learning initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning. Journal of Interactive Media in Education, 14, (1), Article 13.https:// doi. org/ 10. 5334/ 2008-14/ · DOI
- Lucas, C., Buckingham Shum, S., Liu, M., & Bebawy, M. (2021). Implementing AcaWriter as a novel strategy to support pharmacy students' reflective practice in scientific research. American Journal of Pharmaceutical Education. https:// doi. org/ 10. 5688/ ajpe8 320 · DOI
- Luckin, R. (2018). Machine Learning and Human Intelligence: The Future of Education for the 21st Century. UCL IOE Press.
- Malecka, B., Boud, D., & Carless, D. (2020). Eliciting, processing and enacting feedback: Mechanisms for embedding student feedback literacy within the curriculum. Teaching in Higher Education. https:// doi. org/ 10. 1080/ 13562 517. 2020. 17547 84 · DOI
- Buckingham Shum et al. Int J Educ Technol High Educ (2023) 20:40 Learning Analytics and Knowledge Conference (LAK21), April 12-16, 2021, Irvine, CA, USA. (pp. 216-225). ACM. https:// doi. org/ 10. 1145/ 34481 39. 34481 · DOI
- Mousavi, A., Schmidt, M., Squires, V., & Wilson, K. (2021). Assessing the effectiveness of student advice recommender agent (SARA): The case of automated personalized feedback. International Journal of Artificial Intelligence in Educa- tion, 31(3), 603-621. https:// doi. org/ 10. 1007/ s40593-020-00210-6 · DOI
- Murphy, R., Roschelle, J., Feng, M., & Mason, C. A. (2020). Investigating efficacy, moderators and mediators for an online mathematics homework intervention. Journal of Research on Educational Effectiveness, 13(2), 235-270. https:// doi. org/ 10. 1080/ 19345 747. 2019. 17108 85 · DOI
- Pardo, A., Bartimote, K., Buckingham Shum, S., Dawson, S., Gao, J., Gašević, D., Leichtweis, S., Liu, D., Martínez-Maldonado, R., Mirriahi, N., Moskal, A. C. M., Schulte, J., Siemens, G., & Vigentini, L. (2018). OnTask: Delivering data-informed personalized learning support actions. Journal of Learning Analytics, 5(3), 235-249. https:// doi. org/ 10. 18608/ jla. 2018. 53. 15 · DOI
- Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019). Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology, 50(1), 128-138. https:// doi. org/ 10. 1111/ bjet. 12592 · DOI · Paper page
- Pardo, A., Poquet, O., Martinez-Maldonado, R., & Dawson, S. (2017). Provision of data-driven student feedback in LA and EDM. In C. Lang, G. Siemens, A. F. Wise & D. Gašević (Eds.), Handbook of Learning Analytics (pp. 163-174). https:// doi. org/ 10. 18608/ hla17. 014 · DOI
- Pintrich, P. R., & de Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic per- formance. Journal of Educational Psychology, 82(1), 33-40. https:// doi. org/ 10. 1037/ 0022-0663. 82.1. 33 · DOI · Paper page
- Prieto, L. P., Rodriguez-Triana, M. J., Martinez-Maldonado, R., & Dimitriadis, Y. (2019). Orchestrating learning analytics (OrLA): Supporting inter-stakeholder communication about adoption of learning analytics at the classroom level. Australasian Journal of Educational Technology, 35(4), 14-33.
- Schneider, B., Dowell, N., & Thompson, K. (2021). Collaboration analytics-Current state and potential futures. Journal of Learning Analytics, 8(1), 1-12. https:// doi. org/ 10. 18608/ jla. 2021. 7447 · DOI
- Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., Gillet, D., & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transac- tions on Learning Technologies, 10(1), 30-41. https:// doi. org/ 10. 1109/ tlt. 2016. 25995 22 · DOI
- Selwyn, N. (2014). Digital Technology and the Contemporary University: Degrees of Digitization. Routledge.
- Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Millán (Eds.), Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science. (Vol. 12164). Springer. https:// doi. org/ 10. 1007/ 978-3-030-52240-7_ 52 · DOI
- Shibani, A., Knight, S., & Buckingham Shum, S. (2019). Contextualizable Learning Analytics Design. Contextualizable Learning Analytics Design: A Generic Model and Writing Analytics Evaluations. In Proceedings of the International Conference on Learning Analytics and Knowledge (LAK19), March, 2019, Tempe, AZ, USA. ACM, New York, NY, USA (pp.210-219). https:// doi. org/ 10. 1145/ 33037 72. 33037 85 · DOI
- Shibani, A., Knight, S., & Buckingham Shum, S. (2022). Questioning learning analytics? Cultivating critical engagement as student automated feedback literacy. 12th International Learning Analytics and Knowledge Conference (LAK22). ACM, New York, NY, USA, 326-335. https:// doi. org/ 10. 1145/ 35068 60. 35069 12 · DOI
- Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380-1400. https:// doi. org/ 10. 1177/ 00027 64213 498851 · DOI · Paper page
- Teasley, S. D. (2017). Student facing dashboards: One size fits all? Technology, Knowledge and Learning, 22(3), 377-384. https:// doi. org/ 10. 1007/ s10758-017-9314-3 · DOI
- Winstone, N. E., & Boud, D. (2020). The need to disentangle assessment and feedback in higher education. Studies in Higher Education. https:// doi. org/ 10. 1080/ 03075 079. 2020. 17796 · DOI
Cited by
Sorted by citations
AI or Human? Evaluating Student Feedback Perceptions in Higher Education
Nazaretsky, T., Mejia-Domenzain, P., Swamy, V., Frej, J., & Käser, T. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-72315-5_20 · Cited by 76 · see citing works
Ates, H. (2026) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-026-00614-9 · Cited by 4 · see citing works
- Authors
- Buckingham Shum, S., Lim, L.-A., Boud, D., Bearman, M., & Dawson, P.
- Affiliations
- University of Technology Sydney (AU)
- Deakin University (AU)
- Venue
- International Journal of Educational Technology in Higher Education
- Published
- 2023-07-12
- Volume
- 20
- Issue
- 1
- ISSN
- 2365-9440 (ISSN-L)
- OpenAlex
- W4383873837
- Cited by
- 77
- References
- 16
- Citations by year
- 2026: 37 · 2025: 25 · 2024: 12 · 2023: 2
- FWCI
- 33.94
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- International Journal of Educational Technology in Higher Education (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Universitat Oberta de Catalunya
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- automated feedback, artificial intelligence in education, educational analytics, university teaching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review