Cited by 54Online Learning and AnalyticsEvaluation of Teaching PracticesIntelligent Tutoring Systems and Adaptive Learning

Synergies of Learning Analytics and Learning Design: A Systematic Review of Student Outcomes

Open access
Blumenstein, Marion·2020·Journal of Learning Analytics

Abstract

The field of learning analytics (LA) has seen a gradual shift from purely data-driven approaches to more holistic views of improving student learning outcomes through data-informed learning design (LD). Despite the growing potential of LA in higher education (HE), the benefits are not yet convincing to the practitioner, in particular aspects of aligning LA data with LD toward desired learning outcomes. This review presents a systematic evaluation of effect sizes reported in 38 key studies in pursuit of effective LA approaches to measuring student learning gain for the enhancement of HE pedagogy and delivery. Large positive effects on student outcomes were found in LDs that fostered socio-collaborative and independent learning skills. Recent trends in personalization of learner feedback identified a need for the integration of student-idiosyncratic factors to improve the student experience and academic outcomes. Finally, key findings are developed into a new three-level framework, the LA Learning Gain Design (LALGD) model, to align meaningful data capture with pedagogical intentions and their learning outcomes. Suitable for various settings — face to face, blended, or fully online — the model contributes to data-informed learning and teaching pedagogies in HE.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18608/jla.2020.73.3

Cites

88 of 88 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Cooper, A. (2012). What is analytics? Definition and essential characteristics. CETIS Analytics Series, 1(5), 1-10. Retrieved from http://publications.cetis.ac.uk/2012/521
  2. McConnell, M. (2019). Using OnTask in a large first year Commercial Law course on a Bachelor of Commerce degree. In A. Pardo, D. Y. T. Liu, L. Vigentini, & M. Blumenstein (Eds.), Scaling personalised student communication - Current initiatives and future directions (Workshop). Australian Learning Analytics Summer Institute (ALASI), University of Wollongong, NSW. Retrieved from https://www.ontasklearning.org/scaling-personalised-student- communication-current-initiatives-future-directions/

Cited by

Sorted by citations

Authors
Blumenstein, M.
Affiliations
University of Auckland (NZ)
Corresponding author
Blumenstein, Marion
Venue
Journal of Learning Analytics
Published
2020-12-17
Volume
7
Issue
3
Pages
13-32
ISSN
1929-7750 (ISSN-L)
OpenAlex
W3111465890
Cited by
54
References
88
Citations by year
2026: 8 · 2025: 14 · 2024: 5 · 2023: 13 · 2022: 7 · 2021: 7
FWCI
1.16
Type
journal article
Language
en
Open access
Licence
cc-by-nc-nd
Locations
  • Journal of Learning Analytics (publishedVersion, cc-by-nc-nd)
  • ResearchSpace (University of Auckland) (submittedVersion, cc-by)
Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Social Sciences › Education › Evaluation of Teaching Practices
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
Keywords
learning analytics, learning design, learning outcomes, university teaching, data-driven instruction, learning gains, cooperative learning, independent learning skills, effect size

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review