From students with love: An empirical study on learner goals, self-regulated learning and sense-making of learning analytics in higher education
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Unequal stakeholder engagement is a common pitfall of adoption approaches of learning analytics in higher education leading to lower buy-in and flawed tools that fail to meet the needs of their target groups. With each design decision, we make assumptions on how learners will make sense of the visualisations, but we know very little about how students make sense of dashboard and which aspects influence their sense-making. We investigated how learner goals and self-regulated learning (SRL) skills influence dashboard sense-making following a mixed-methods research methodology: a qualitative pre-study followed-up with an extensive quantitative study with 247 university students. We uncovered three latent variables for sense-making: transparency of design, reference frames and support for action. SRL skills are predictors for how relevant students find these constructs. Learner goals have a significant effect only on the perceived relevance of reference frames. Knowing which factors influence students' sense-making will lead to more inclusive and flexible designs that will cater to the needs of both novice and expert learners.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254
Nicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
New Effect Size Rules of Thumb
Sawilowsky, S. S. (2009) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1257035100 · Cited by 3,254
Multiple goals, multiple pathways: The role of goal orientation in learning and achievement
Pintrich, P. R. (2000) · Journal of Educational Psychology · doi:10.1037/0022-0663.92.3.544 · Cited by 2,254
Zimmerman, B. J., & Martinez-Pons, M. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.51 · Cited by 1,825
Broadbent, J., & Poon, W. L. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.04.007 · Cited by 1,692
Kizilcec, R. F., Pérez-Sanagustín, M., & Maldonado, J. J. (2017) · Computers & Education · doi:10.1016/j.compedu.2016.10.001 · Cited by 1,003
O'Donovan, J., & Smyth, B. (2005) · Proceedings of the 10th international conference on Intelligent user interfaces · doi:10.1145/1040830.1040870 · Cited by 865
The current landscape of learning analytics in higher education
Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2018.07.027 · Cited by 766
Feedback : all that effort, but what is the effect?
Price, M., Handley, K., Millar, J., & O'Donovan, B. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903541007 · Cited by 735
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
A metacognitive view of individual differences in self-regulated learning
Winne, P. H. (1996) · Learning and Individual Differences · doi:10.1016/s1041-6080(96)90022-9 · Cited by 486
Bodily, R., & Verbert, K. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2740172 · Cited by 306
Roth, A., Ogrin, S., & Schmitz, B. (2016) · Educational Assessment, Evaluation and Accountability · doi:10.1007/s11092-015-9229-2 · Cited by 294
Tsai, Y.-S., & Gasevic, D. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027400 · Cited by 211
How do we start? An approach to learning analytics adoption in higher education
Gasevic, D., Tsai, Y.-S., Dawson, S., & Pardo, A. (2019) · The International Journal of Information and Learning Technology · doi:10.1108/ijilt-02-2019-0024 · Cited by 103
The SHEILA Framework: Informing Institutional Strategies and Policy Processes of Learning Analytics
Tsai, Y.-S., Moreno-Marcos, P. M., Jivet, I., Scheffel, M., Tammets, K., Kollom, K., & Gašević, D. (2018) · Journal of Learning Analytics · doi:10.18608/jla.2018.53.2 · Cited by 93
Self-citationAre We on Our Way to Becoming a “Helicopter University”? Academics’ Views on Learning Analytics
Howell, J. A., Roberts, L. D., Seaman, K., & Gibson, D. C. (2018) · Technology, Knowledge and Learning · doi:10.1007/s10758-017-9329-9 · Cited by 84
Cited by
Jin, S.-H., Im, K., Yoo, M., Roll, I., & Seo, K. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00406-5 · Cited by 332
Rodriguez-Gomez, D., Muñoz-Moreno, J. L., & Ion, G. (2024) · Sustainability · doi:10.3390/su16073021 · Cited by 13
Xu, J., & Qiu, X. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.763889 · Cited by 13
Velander, J., Otero, N., Pargman, T. C., & Milrad, M. (2021) · Advances in Analytics for Learning and Teaching · doi:10.1007/978-3-030-81222-5_15 · Cited by 8
Mumcu, B. B., & Çebi, A. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00537-x · Cited by 26
Metadata
- Authors
- Jivet, I., Scheffel, M., Schmitz, M., Robbers, S., Specht, M., & Drachsler, H.
- Venue
- The Internet and Higher Education
- Publisher
- Elsevier BV
- Published
- 2020-10
- Volume
- 47
- Pages
- 100758
- ISSN
- 1096-7516 (ISSN-L)
- OpenAlex
- W3042155677
- Cited by
- 162
- References
- 19
- FWCI
- 19.80
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.