From prediction to impact: evaluation of a learning analytics retention program
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Learning analytics research has often been touted as a means to address concerns regarding student retention outcomes. However, few research studies to date, have examined the impact of the implemented intervention strategies designed to address such retention challenges. Moreover, the methodological rigor of some of the existing studies has been challenged. This study evaluates the impact of a pilot retention program. The study contrasts the findings obtained by the use of different methods for analysis of the effect of the intervention. The pilot study was undertaken between 2012 and 2014 resulting in a combined enrolment of 11,160 students. A model to predict attrition was developed, drawing on data from student information system, learning management system interactions, and assessment. The predictive model identified some 1868 students as academically at-risk. Early interventions were implemented involving learning and remediation support. Common statistical methods demonstrated a positive association between the intervention and student retention. However, the effect size was low. The use of more advanced statistical methods, specifically mixed-effect methods explained higher variability in the data (over 99%), yet found the intervention had no effect on the retention outcomes. The study demonstrates that more data about individual differences is required to not only explain retention but to also develop more effective intervention approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905
A general and simple method for obtaining R 2 from generalized linear mixed‐effects models
Nakagawa, S., & Schielzeth, H. (2013) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2012.00261.x · Cited by 10,356 · cited 1×
“To estimate the variance explained by the mixed-models, we used a pseudo R 2 method suggested by Nakagawa and Schielzeth [23].”
MethodEducational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
Framing student engagement in higher education
Kahu, E. R. (2013) · Studies in Higher Education · doi:10.1080/03075079.2011.598505 · Cited by 2,103 · cited 1×
“…‘at risk’, the program was engaging with individuals that have a heightened propensity and vulnerability to be socially and academically disengaged from the institution [15; 33], or have their academic experiences mediated by a variety of differing and often extenuating personal factors [11; 33].”
BackgroundMining LMS data to develop an “early warning system” for educators: A proof of concept
Macfadyen, L. P., & Dawson, S. (2010) · Computers & Education · doi:10.1016/j.compedu.2009.09.008 · Cited by 1,045
Self-citationKift, S., Nelson, K., & Clarke, J. (2010) · The International Journal of the First Year in Higher Education · doi:10.5204/intjfyhe.v1i1.13 · Cited by 377
Cited by
Utilising learning analytics to support study success in higher education: a systematic review
Ifenthaler, D., & Yau, J. Y.-K. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09788-z · Cited by 659
Lim, L.-A., Gentili, S., Pardo, A., Kovanović, V., Whitelock-Wainwright, A., Gašević, D., & Dawson, S. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.003 · Cited by 159
Self-citationAnalytics of time management strategies in a flipped classroom
Ahmad Uzir, N., Gašević, D., Matcha, W., Jovanović, J., & Pardo, A. (2020) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12392 · Cited by 129
Self-citationKlein, C., Lester, J., Rangwala, H., & Johri, A. (2019) · Journal of Computing in Higher Education · doi:10.1007/s12528-019-09210-5 · Cited by 83
The Student Expectations of Learning Analytics Questionnaire
Whitelock‐Wainwright, A., Gašević, D., Tejeiro, R., Tsai, Y., & Bennett, K. (2019) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12366 · Cited by 63
Self-citation
Metadata
- Authors
- Dawson, S., Jovanovic, J., Gašević, D., & Pardo, A.
- Venue
- Proceedings of the Seventh International Learning Analytics & Knowledge Conference
- Publisher
- ACM
- Published
- 2017-03-13
- Pages
- 474-478
- OpenAlex
- W2593803760
- Cited by
- 65
- References
- 6
- FWCI
- 6.58
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From prediction to impact: evaluation of a learning analytics retention program. https://app.cochat.ai/papers/10.1145/3027385.3027405
- The paper
- Dawson, S., Jovanovic, J., Gašević, D., & Pardo, A. (2017). From prediction to impact: evaluation of a learning analytics retention program. Proceedings of the Seventh International Learning Analytics & Knowledge Conference. https://doi.org/10.1145/3027385.3027405
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.