Cited by 77Student Assessment and FeedbackArtificial Intelligence in EducationOnline Learning and Analytics

A comparative analysis of the skilled use of automated feedback tools through the lens of teacher feedback literacy

Open access
Buckingham Shum, Simon, Lim, Lisa-Angelique, Boud, David, Bearman, Margaret, Dawson, Phillip·2023·International Journal of Educational Technology in Higher Education

Abstract

Effective learning depends on effective feedback, which in turn requires a set of skills, dispositions and practices on the part of both students and teachers which have been termed feedback literacy. A previously published teacher feedback literacy competency framework has identified what is needed by teachers to implement feedback well. While this framework refers in broad terms to the potential uses of educational technologies, it does not examine in detail the new possibilities of automated feedback (AF) tools, especially those that are open by offering varying degrees of transparency and control to teachers. Using analytics and artificial intelligence, open AF tools permit automated processing and feedback with a speed, precision and scale that exceeds that of humans. This raises important questions about how human and machine feedback can be combined optimally and what is now required of teachers to use such tools skillfully. The paper addresses two research questions: Which teacher feedback competencies are necessary for the skilled use of open AF tools? and What does the skilled use of open AF tools add to our conceptions of teacher feedback competencies? We conduct an analysis of published evidence concerning teachers’ use of open AF tools through the lens of teacher feedback literacy, which produces summary matrices revealing relative strengths and weaknesses in the literature, and the relevance of the feedback literacy framework. We conclude firstly, that when used effectively, open AF tools exercise a range of teacher feedback competencies. The paper thus offers a detailed account of the nature of teachers’ feedback literacy practices within this context. Secondly, this analysis reveals gaps in the literature, signalling opportunities for future work. Thirdly, we propose several examples of automated feedback literacy, that is, distinctive teacher competencies linked to the skilled use of open AF tools.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s41239-023-00410-9

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Recent work has suggested that the educational use of automated feedback depends on how human and machine roles are distributed within feedback processes, and that AI assistance may weaken student agency when critique is accepted too readily or when difficult judgments are outsourced to the system.

    “Recent work has suggested that the educational use of automated feedback depends on how human and machine roles are distributed within feedback processes, and that AI assistance may weaken student agency when critique is accepted too readily or when difficult judgments are outsourced to the system (Buckingham Shum et al., 2023;Darvishi et al., 2024).”

    From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023

    Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured
  • The findings add empirical weight to the argument that the pedagogical value of GenAI depends not only on what the tool can generate, but also on whether surrounding feedback designs amplify or displace students' evaluative responsibility.

    “In this respect, the findings add empirical weight to the argument that the pedagogical value of GenAI depends not only on what the tool can generate, but also on whether surrounding feedback designs amplify or displace students' evaluative responsibility(Buckingham Shum et al., 2023;Darvishi et al., 2024).”

    From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023

    The Conclusion (page unavailable) says open automated-feedback tools can cultivate learner agency and productive action rather than passive feedback processes. The ‘Changing conceptions of feedback’ section likewise says students must actively make sense of feedback. The paper supports the importance of feedback design and student agency, but its analysis of automated-feedback tools does not establish the claim specifically for GenAI or whether GenAI designs displace students’ evaluative responsibility. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • For higher education digital learning, the central implication is not whether students can access GenAI feedback, but how GenAI feedback is pedagogically organized so that human evaluative work remains at the center.

    “For higher education digital learning, the central implication is therefore not whether students can access GenAI feedback, but how GenAI feedback is pedagogically organized so that human evaluative work remains at the center (Buckingham Shum et al., 2023; Xia et al., 2024).”

    From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023

    The Introduction and Conclusion emphasize designing automated feedback around active student participation and teachers’ skilled use of technology; the ‘Crafts appropriate inputs to students’ section says such tools should augment teachers rather than automate them out of the loop. This supports the claim’s focus on pedagogical organization and human work, but the paper does not frame that implication specifically around students’ access to GenAI feedback. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • The advantages of reflective and hybrid designs appear to reflect a more productive organization of evaluative activity rather than short-term score improvement alone.

    “Their advantages therefore appear to reflect a more productive organization of evaluative activity rather than short-term score improvement alone(Carless & Boud, 2018;Buckingham Shum et al., 2023).”

    From Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation (2026) · cites this paper as Buckingham Shum et al., 2023

    The sections “Designs for feedback dialogues and cycles” and “Manages tensions between feedback and grading” describe feedback organized around revision and learning processes rather than grade justification. The paper does not establish the comparative advantages of reflective and hybrid designs or assess short-term score improvement, so those parts of the attributed claim remain unsupported. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 58

  1. Arthars, N., & Liu, D.Y.-T. (2020). How and why faculty adopt learning analytics. In D. Ifenthaler & D. Gibson (Eds.), Adoption of Data Analytics in Higher Education Learning and Teaching (pp. 201-220). Springer International Publishing. https:// doi. org/ 10. 1007/ 978-3-030-47392-1_ 11 · DOI
  2. Arthars, N., Dollinger, M., Vigentini, L., Liu, D.Y.-T., Kondo, E., & King, D. M. (2019). Empowering teachers to personalize learning support. In D. Ifenthaler, D.-K. Mah, & J.Y.-K. Yau (Eds.), Utilizing Learning Analytics to Support Study Success (pp. 223-248). Springer International Publishing. https:// doi. org/ 10. 1007/ 978-3-319-64792-0_ 13 · DOI
  3. Askew, S., & Lodge, C. (2000). Gifts, ping-pong and loops-linking feedback and learning. In S. Askew (Ed.), Feedback for Learning (pp. 1-17). Routledge. https:// doi. org/ 10. 4324/ 97802 03017 678 · DOI
  4. Baker, R. SJd. & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. Journal of Educa- tional Data Mining, 1(1), 3-17. https:// doi. org/ 10. 5281/ zenodo. 35546 57 · DOI
  5. Bearman, M., Lambert, S., & O'Donnell, M. (2021). How a centralised approach to learning design influences students: A mixed methods study. Higher Education Research & Development, 40(4), 692-705. https:// doi. org/ 10. 1080/ 07294 360. 2020. 17928 · DOI
  6. Blumenstein, M., Liu, D.Y.-T., Richards, D., Leichtweis, S., & Stephens, J. (2019). Data-informed nudges for student engage- ment and success. In J. M. Lodge, J. C. Horvath, & L. Corrin (Eds.), Learning Analytics in the Classroom: Translating Learning Analytics for Teachers (pp. 185-207). Routledge.
  7. Bodily, R., & Verbert, K. (2017). Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies, 10(4), 405-418. https:// doi. org/ 10. 1109/ TLT. 2017. 27401 · DOI · Paper page
  8. Boell, S. K., & Cecez-Kecmanovic, D. (2015). On being 'systematic' in literature reviews in IS. Journal of Information Technol- ogy, 30(2), 161-173. https:// doi. org/ 10. 1057/ jit. 2014. 26 · DOI
  9. Boud, D., & Dawson, P. (2021). What feedback literate teachers do: an empirically derived competency framework. Assess- ment and Evaluation in Higher Education. https:// doi. org/ 10. 1080/ 02602 938. 2021. 19109 28 · DOI
  10. Broadbent, J., Panadero, E., Lodge, J. M., & de Barba, P. (2020). Technologies to enhance self-regulated learning in online and computer mediated learning environments. In M. J. Bishop, J. Elen, E. Boling, & V. Svihla (Eds.), Handbook of Research in Educational Communications and Technology. Springer.
  11. Brown, M. G., Schiltz, J., Derry, H., & Holman, C. (2019). Implementing online personalized social comparison nudges in a web-enabled coaching system. The Internet and Higher Education, 43, 100691. https:// doi. org/ 10. 1016/j. iheduc. 2019. 100691 · DOI
  12. Carless, D., & Winstone, N. (2020). Teacher feedback literacy and its interplay with student feedback literacy. Teaching in Higher Education. https:// doi. org/ 10. 1080/ 13562 517. 2020. 17823 · DOI · Paper page
  13. Carroll, J. M., & Rosson, M. B. (1992). Getting around the task-artifact cycle: How to make claims and design by scenario. ACM Transactions on Information Systems, 10(2), 181-212. https:// doi. org/ 10. 1145/ 146802. 146834 · DOI
  14. Chen, P., Chavez, O., Ong, D. C., & Gunderson, B. (2017). Strategic resource use for learning: A self-administered interven- tion that guides self-reflection on effective resource use enhances academic performance. Psychological Science, 28(6), 774-785. https:// doi. org/ 10. 1177/ 09567 97617 696456 · DOI · Paper page
  15. Dawson, P., Carless, D., & Lee, P. P. W. (2021). Authentic feedback: Supporting learners to engage in disciplinary feedback practices. Assessment & Evaluation in Higher Education, 46(2), 286-296. https:// doi. org/ 10. 1080/ 02602 938. 2020. 17690 · DOI
  16. de Barba, P., & Corrin, L. (2014). Exploring students' interpretation of feedback delivered through learning analytics dash- boards. Proceedings of the 31st Annual Conference of the Australian Society for Computers in Tertiary Education (ASCILITE 2014), Dunedin, NZ, 23-26 Nov. 2014, pp. 629-633. http:// hdl. handle. net/ 1959.3/ 447675
  17. Dede, C., Richards, J., & Saxberg, B. (2018). Learning Engineering for Online Education: Theoretical Contexts and Design-Based Examples (1st ed.). Routledge. https:// doi. org/ 10. 4324/ 97813 51186 193 · DOI
  18. du Boulay, B. (2019). Escape from the skinner box: The case for contemporary intelligent learning environments. British Journal of Educational Technology, 50(6), 2902-2919. https:// doi. org/ 10. 1111/ bjet. 12860 · DOI
  19. Echeverria, V., Martinez-Maldonado, R., Granda, R., Chiluiza, K., Conati, C., & Buckingham Shum, S. (2018). Driving data storytelling from learning design. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, Sydney, New South Wales, Australia. https:// doi. org/ 10. 1145/ 31703 58. 31703 80 · DOI · Paper page
  20. Esterhazy, R. (2018). What matters for productive feedback? Disciplinary practices and their relational dynamics. Assess- ment & Evaluation in Higher Education, 43(8), 1302-1314. https:// doi. org/ 10. 1080/ 02602 938. 2018. 14633 · DOI · Paper page
  21. Feng, S., & Law, N. (2021). Mapping artificial intelligence in education research: A network-based keyword analysis. Inter- national Journal of Artificial Intelligence in Education, 31(2), 277-303. https:// doi. org/ 10. 1007/ s40593-021-00244-4 · DOI
  22. Fernandez-Nieto, G., Echeverria, V., Buckingham Shum, S., Mangaroska, K., Kitto, K., Palominos, E., Axisa, C., & Martinez- Maldonado, R. (2021). Storytelling with learner data: Guiding student reflection on multimodal team data. IEEE Transactions on Learning Technologies, 14(5), 695-708. https:// doi. org/ 10. 1109/ tlt. 2021. 31318 42 · DOI
  23. Ferguson, R. (2012). Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5/6), 304-317. https:// doi. org/ 10. 1504/ IJTEL. 2012. 051816 · DOI
  24. Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information and Libraries Journal, 26, 91-108. https:// doi. org/ 10. 1111/j. 1471-1842. 2009. 00848.x · DOI · Paper page
  25. Greer, J. E., Frost, S., Banow, R., Thompson, C., Kuleza, S., Wilson, K., & Koehn, G. (2015). The Student Advice Recommender Agent: SARA. 5th International Workshop on Personalization Approaches in Learning Environments, 23rd Conference on User Modeling, Adaptation, and Personalization. http:// ceur-ws. org/ Vol-1388/ PALE2 015-paper2. pdf
  26. Heckman, S., & King, J. (2018). Developing Software Engineering Skills using Real Tools for Automated Grading. Proceed- ings of the 49th ACM Technical Symposium on Computer Science Education. ACM, New York, NY, USA, 794-799. https:// doi. org/ 10. 1145/ 31594 50. 31595 95 · DOI
  27. Henderson, M., Molloy, E., Ajjawi, R., & Boud, D. (2019b). Designing feedback for impact. In M. Henderson, R. Ajjawi, D. Boud, & E. Molloy (Eds.), The Impact of Feedback in Higher Education: Improving Assessment Outcomes for Learners (pp. 267-285). Springer International Publishing. https:// doi. org/ 10. 1007/ 978-3-030-25112-3_ 15 · DOI
  28. Henderson, M., Ryan, T., Boud, D., Dawson, P., Phillips, M., Molloy, E., & Mahoney, P. (2019a). Conditions that enable effec- tive feedback. Higher Education Research and Development, 38(7), 1401-1416. https:// doi. org/ 10. 1080/ 07294 360. 2019. 16578 · DOI · Paper page
  29. Huberth, M., Chen, P., Tritz, J., & McKay, T. A. (2015). Computer-tailored student support in introductory physics. PLoS ONE, 10(9), e0137001. https:// doi. org/ 10. 1371/ journ al. pone. 01370 01 · DOI
  30. Iraj, H., Fudge, A., Faulkner, M., Pardo, A., & Kovanović, V. (2020). Understanding students' engagement with personalised feedback messages. In Proceedings of the 10th International Conference on Learning Analytics and Knowledge (LAK '20), March 23-27, 2020, Frankfurt, Germany. (pp. 438-447). ACM. https:// doi. org/ 10. 1145/ 33754 62. 33755 27 · DOI
  31. Jensen, L. X., Bearman, M., & Boud, D. (2021). Understanding feedback in online learning-A critical review and metaphor analysis. Computers & Education, 173, 104271. https:// doi. org/ 10. 1016/j. compe du. 2021. 104271 · DOI
  32. Joksimovic, S., Siemens, G., Wang, Y. E., San Pedro, M. O. Z., & Way, J. (2020). Beyond cognitive ability: Enabling assessment of 21st century skills through learning analytics (editorial). Journal of Learning Analytics, 7(1), 1-4. https:// doi. org/ 10. 18608/ jla. 2020. 71.1 · DOI
  33. Knight, S., Buckingham Shum, S., Ryan, P., Sándor, Á., & Wang, X. (2018). Designing academic writing analytics for civil law student self-assessment. International Journal of Artificial Intelligence in Education, 28(1), 1-28. https:// doi. org/ 10. 1007/ s40593-016-0121-0 · DOI
  34. Koedinger, K. R., & Aleven, V. (2016). An interview reflection on "intelligent tutoring goes to school in the big city. " Interna- tional Journal of Artificial Intelligence in Education, 26(1), 13-24. https:// doi. org/ 10. 1007/ s40593-015-0082-8 · DOI
  35. Lim, L.-A., Dawson, S., Gašević, D., Joksimović, S., Pardo, A., Fudge, A., & Gentili, S. (2021c). Students' perceptions of, and emotional responses to, personalised learning analytics-based feedback: An exploratory study of four courses. Assessment & Evaluation in Higher Education, 46(3), 339-359. https:// doi. org/ 10. 1080/ 02602 938. 2020. 17828 · DOI · Paper page
  36. Lim, L.-A., Fudge, A., & Dawson, S. (2019). Feeling supported: Enabling students in diverse cohorts through personalised, data-informed feedback. In Y. W. Chew, K. M. Chan & A. Alphonso (Eds.), Personalised Learning. Diverse Goals. One Heart. ASCILITE 2019 Singapore (pp. 206-215). https:// 2019c onfer ence. ascil ite. org/ assets/ papers/ Paper-111. pdf
  37. Liu, D. Y.-T., Bartimote-Aufflick, K., Pardo, A., & Bridgeman, A. J. (2017). Data-driven personalization of student learning support in higher education. In A. Peña-Ayala (Ed.), Learning Analytics: Fundaments, Applications, and Trends, Studies in Systems, Decision and Control, 94 (pp. 143-169). https:// doi. org/ 10. 1007/ 978-3-319-52977-6 · DOI
  38. Lovett, M., Meyer, O., & Thille, C. (2008). The open learning initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning. Journal of Interactive Media in Education, 14, (1), Article 13.https:// doi. org/ 10. 5334/ 2008-14/ · DOI
  39. Lucas, C., Buckingham Shum, S., Liu, M., & Bebawy, M. (2021). Implementing AcaWriter as a novel strategy to support pharmacy students' reflective practice in scientific research. American Journal of Pharmaceutical Education. https:// doi. org/ 10. 5688/ ajpe8 320 · DOI
  40. Luckin, R. (2018). Machine Learning and Human Intelligence: The Future of Education for the 21st Century. UCL IOE Press.
  41. Malecka, B., Boud, D., & Carless, D. (2020). Eliciting, processing and enacting feedback: Mechanisms for embedding student feedback literacy within the curriculum. Teaching in Higher Education. https:// doi. org/ 10. 1080/ 13562 517. 2020. 17547 84 · DOI
  42. Buckingham Shum et al. Int J Educ Technol High Educ (2023) 20:40 Learning Analytics and Knowledge Conference (LAK21), April 12-16, 2021, Irvine, CA, USA. (pp. 216-225). ACM. https:// doi. org/ 10. 1145/ 34481 39. 34481 · DOI
  43. Mousavi, A., Schmidt, M., Squires, V., & Wilson, K. (2021). Assessing the effectiveness of student advice recommender agent (SARA): The case of automated personalized feedback. International Journal of Artificial Intelligence in Educa- tion, 31(3), 603-621. https:// doi. org/ 10. 1007/ s40593-020-00210-6 · DOI
  44. Murphy, R., Roschelle, J., Feng, M., & Mason, C. A. (2020). Investigating efficacy, moderators and mediators for an online mathematics homework intervention. Journal of Research on Educational Effectiveness, 13(2), 235-270. https:// doi. org/ 10. 1080/ 19345 747. 2019. 17108 85 · DOI
  45. Pardo, A., Bartimote, K., Buckingham Shum, S., Dawson, S., Gao, J., Gašević, D., Leichtweis, S., Liu, D., Martínez-Maldonado, R., Mirriahi, N., Moskal, A. C. M., Schulte, J., Siemens, G., & Vigentini, L. (2018). OnTask: Delivering data-informed personalized learning support actions. Journal of Learning Analytics, 5(3), 235-249. https:// doi. org/ 10. 18608/ jla. 2018. 53. 15 · DOI
  46. Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (2019). Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology, 50(1), 128-138. https:// doi. org/ 10. 1111/ bjet. 12592 · DOI · Paper page
  47. Pardo, A., Poquet, O., Martinez-Maldonado, R., & Dawson, S. (2017). Provision of data-driven student feedback in LA and EDM. In C. Lang, G. Siemens, A. F. Wise & D. Gašević (Eds.), Handbook of Learning Analytics (pp. 163-174). https:// doi. org/ 10. 18608/ hla17. 014 · DOI
  48. Pintrich, P. R., & de Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic per- formance. Journal of Educational Psychology, 82(1), 33-40. https:// doi. org/ 10. 1037/ 0022-0663. 82.1. 33 · DOI · Paper page
  49. Prieto, L. P., Rodriguez-Triana, M. J., Martinez-Maldonado, R., & Dimitriadis, Y. (2019). Orchestrating learning analytics (OrLA): Supporting inter-stakeholder communication about adoption of learning analytics at the classroom level. Australasian Journal of Educational Technology, 35(4), 14-33.
  50. Schneider, B., Dowell, N., & Thompson, K. (2021). Collaboration analytics-Current state and potential futures. Journal of Learning Analytics, 8(1), 1-12. https:// doi. org/ 10. 18608/ jla. 2021. 7447 · DOI
  51. Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., Gillet, D., & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transac- tions on Learning Technologies, 10(1), 30-41. https:// doi. org/ 10. 1109/ tlt. 2016. 25995 22 · DOI
  52. Selwyn, N. (2014). Digital Technology and the Contemporary University: Degrees of Digitization. Routledge.
  53. Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Millán (Eds.), Artificial Intelligence in Education. AIED 2020. Lecture Notes in Computer Science. (Vol. 12164). Springer. https:// doi. org/ 10. 1007/ 978-3-030-52240-7_ 52 · DOI
  54. Shibani, A., Knight, S., & Buckingham Shum, S. (2019). Contextualizable Learning Analytics Design. Contextualizable Learning Analytics Design: A Generic Model and Writing Analytics Evaluations. In Proceedings of the International Conference on Learning Analytics and Knowledge (LAK19), March, 2019, Tempe, AZ, USA. ACM, New York, NY, USA (pp.210-219). https:// doi. org/ 10. 1145/ 33037 72. 33037 85 · DOI
  55. Shibani, A., Knight, S., & Buckingham Shum, S. (2022). Questioning learning analytics? Cultivating critical engagement as student automated feedback literacy. 12th International Learning Analytics and Knowledge Conference (LAK22). ACM, New York, NY, USA, 326-335. https:// doi. org/ 10. 1145/ 35068 60. 35069 12 · DOI
  56. Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380-1400. https:// doi. org/ 10. 1177/ 00027 64213 498851 · DOI · Paper page
  57. Teasley, S. D. (2017). Student facing dashboards: One size fits all? Technology, Knowledge and Learning, 22(3), 377-384. https:// doi. org/ 10. 1007/ s10758-017-9314-3 · DOI
  58. Winstone, N. E., & Boud, D. (2020). The need to disentangle assessment and feedback in higher education. Studies in Higher Education. https:// doi. org/ 10. 1080/ 03075 079. 2020. 17796 · DOI

Cited by

Sorted by citations

Authors
Buckingham Shum, S., Lim, L.-A., Boud, D., Bearman, M., & Dawson, P.
Affiliations
  • University of Technology Sydney (AU)
  • Deakin University (AU)
Venue
International Journal of Educational Technology in Higher Education
Published
2023-07-12
Volume
20
Issue
1
ISSN
2365-9440 (ISSN-L)
OpenAlex
W4383873837
Cited by
77
References
16
Citations by year
2026: 37 · 2025: 25 · 2024: 12 · 2023: 2
FWCI
33.94
Type
journal article
Language
en
Open access
Locations
  • International Journal of Educational Technology in Higher Education (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
Universitat Oberta de Catalunya
Topics
  • Social Sciences › Education › Student Assessment and Feedback
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
Keywords
automated feedback, artificial intelligence in education, educational analytics, university teaching

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review