Cited by 284Online Learning and AnalyticsIntelligent Tutoring Systems and Adaptive LearningArtificial Intelligence in Education

The DOI matches its Crossref record; 205 of the 219 references it cites were found in a registry or an index, and 14 are not checked yet.

Human-centred learning analytics and AI in education: A systematic literature review

Open access
Alfredo, Riordan, Echeverria, Vanessa, Jin, Yueqiao, Yan, Lixiang, Swiecki, Zachari, Gašević, Dragan, Martinez-Maldonado, Roberto·2024·Computers and Education: Artificial Intelligence

Abstract

The rapid expansion of Learning Analytics (LA) and Artificial Intelligence in Education (AIED) offers new scalable, data-intensive systems but raises concerns about data privacy and agency. Excluding stakeholders—like students and teachers—from the design process can potentially lead to mistrust and inadequately aligned tools. Despite a shift towards human-centred design in recent LA and AIED research, there remain gaps in our understanding of the importance of human control, safety, reliability, and trustworthiness in the design and implementation of these systems. We conducted a systematic literature review to explore these concerns and gaps. We analysed 108 papers to provide insights about i) the current state of human-centred LA/AIED research; ii) the extent to which educational stakeholders have contributed to the design process of human-centred LA/AIED systems; iii) the current balance between human control and computer automation of such systems; and iv) the extent to which safety, reliability and trustworthiness have been considered in the literature. Results indicate some consideration of human control in LA/AIED system design, but limited end-user involvement in actual design. Based on these findings, we recommend: 1) carefully balancing stakeholders' involvement in designing and deploying LA/AIED systems throughout all design phases 2) actively involving target end-users, especially students, to delineate the balance between human control and automation, and 3) exploring safety, reliability, and trustworthiness as principles in future human-centred LA/AIED systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.caeai.2024.100215

Cites

205 of 219 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 211 references

Research works printed but not linked: 4

  1. Chatti, 2020, How to design effective learning analytics indicators?, vol. 12315
  2. Moya, 2023, Academic integrity and artificial intelligence in higher education contexts: A rapid scoping review protocol, Canadian Perspectives on Academic Integrity, 5, 59
  3. Ternblad, 2018, Do preschoolers ‘game the system’? A case study of children's intelligent (mis)use of a teachable agent based play-&-learn game in mathematics, vol. 10947, 557
  4. Wiley, 2023

Cited by

Sorted by citations

Metadata

Authors
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R.
Affiliations
Monash University (AU)
Corresponding author
Alfredo, Riordan
Venue
Computers and Education: Artificial Intelligence
Publisher
Elsevier BV
Published
2024-06
Volume
6
Pages
100215
ISSN
2666-920X (ISSN-L)
OpenAlex
W4392769397
Cited by
281
References
211
Citations by year
2026: 165 · 2025: 93 · 2024: 22
FWCI
21.16
Type
journal article
Language
en
Open access
Locations
  • Computers and Education Artificial Intelligence (publishedVersion, cc-by-nc)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Monash University Research Portal (Monash University) (submittedVersion, cc-by-nc)
  • HAL (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University) (cc-by)
Funders
  • Australian Research Council
  • Jacobs Foundation
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
learning analytics, artificial intelligence in education, human-centered design, stakeholder engagement, human control, automation, data privacy, agency, trustworthiness, safety and reliability, end-user involvement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review