Learning dashboards at scale: Early warning and overall first year experience
Open accessAbstract
In this study, we present a case study involving two self-service dashboards providing feedback on learning and study skills and on academic achievement. These dashboards were offered to first-year university students in several study programmes in Flanders, Belgium. Data for this study were collected using usage tracking (N = 2875) and a survey taken at the beginning of the second year before (N = 484) and after (N = 538) the introduction of the dashboards. We found that early dashboard usage is related to academic achievement later in the academic year and that students’ review of the feedback received in the first year improved. Although these results are modest in comparison to how high the bar is sometimes set for learning analytics applications, we argue that low-cost deployments of self-service dashboards are an interesting approach to start building experience with similar tools and to start paving the way for future developments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Survey data-based LA can foster predictive feedback, recommendation, reflective feedback, and assessment.
“Selected studies suggest that survey data-based LA can foster predictive feedback (Broos et al., 2020), recommendation (Perikos et al., 2017), reflective feedback (Smith, 2020; Tsai et al., 2021), and assessment (Dalla Valle et al., 2018).”
From A systematic review of the role of learning analytics in enhancing feedback practices in higher education (2022) · cites this paper as Broos et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A theory of social comparison processes
Festinger, L. (1954) · Human Relations · doi:10.1177/001872675400700202 · Cited by 20,926 · see citing works
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · see citing works
The development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428 · see citing works
The State of Educational Data Mining in 2009: A Review and Future Visions
Baker, R. S. J. D., & Yacef, K. (2009) · Journal of Educational Data Mining · doi:10.5281/zenodo.3554657 · Cited by 1,365 · see citing works
Learning analytics and educational data mining
Siemens, G., & Baker, R. S. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330661 · Cited by 1,091 · see citing works
Students’ engagement in first‐year university
Krause, K., & Coates, H. (2008) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930701698892 · Cited by 1,075 · see citing works
Course signals at Purdue: using learning analytics to increase student success
Arnold, K. E., & Pistilli, M. D. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330666 · Cited by 987 · see citing works
Burston, J. (2013) · IALLT Journal of Language Learning Technologies · doi:10.17161/iallt.v43i2.8528 · Cited by 897 · see citing works
Hu, S., & Kuh, G. D. (2002) · Research in Higher Education · doi:10.1023/a:1020114231387 · Cited by 622 · see citing works
Building bridges: understanding student transition to university
Briggs, A. R. J., Clark, J., & Hall, I. (2012) · Quality in Higher Education · doi:10.1080/13538322.2011.614468 · Cited by 498 · see citing works
Learning dashboards: an overview and future research opportunities
Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Assche, F. V., Parra, G., & Klerkx, J. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-013-0751-2 · Cited by 456 · see citing works
Self-citationWinstone, N. E., Nash, R. A., Rowntree, J., & Parker, M. (2017) · Studies in Higher Education · doi:10.1080/03075079.2015.1130032 · Cited by 417 · see citing works
Improving the Retention of Students from Lower Socio-economic Groups
Yorke, M., & Thomas, L. (2003) · Journal of Higher Education Policy and Management · doi:10.1080/13600800305737 · Cited by 355 · see citing works
Bodily, R., & Verbert, K. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2740172 · Cited by 306 · see citing works
Self-citationJivet, I., Scheffel, M., Specht, M. M., & Drachsler, H. (2018) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3170358.3170421 · Cited by 290 · see citing works
Developing early warning systems to predict students’ online learning performance
Hu, Y., Lo, C., & Shih, S.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.002 · Cited by 278 · see citing works
Jamshardian, M., & Jalal, S. (2010) · eScholarship (California Digital Library) · Cited by 222 · see citing works
A qualitative evaluation of evolution of a learning analytics tool
Ali, L., Hatala, M., Gašević, D., & Jovanović, J. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.08.030 · Cited by 204 · see citing works
Using technology to encourage student engagement with feedback: a literature review
Hepplestone, S., Holden, G., Irwin, B., Parkin, H. J., & Thorpe, L. (2011) · Research in Learning Technology · doi:10.3402/rlt.v19i2.10347 · Cited by 201 · see citing works
The student activity meter for awareness and self-reflection
Govaerts, S., Verbert, K., Duval, E., & Pardo, A. (2012) · CHI '12 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2212776.2212860 · Cited by 193 · see citing works
Self-citationLearning Analytics Dashboards to Support Adviser-Student Dialogue
Charleer, S., Moere, A. V., Klerkx, J., Verbert, K., & Laet, T. D. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2720670 · Cited by 109 · see citing works
Self-citationAn Interactive Teacher’s Dashboard for Monitoring Groups in a Multi-tabletop Learning Environment
Maldonado, R. M., Kay, J., Yacef, K., & Schwendimann, B. A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30950-2_62 · Cited by 107 · see citing works
The design, development, and implementation of student-facing learning analytics dashboards
Bodily, R., Ikahihifo, T. K., Mackley, B., & Graham, C. R. (2018) · Journal of Computing in Higher Education · doi:10.1007/s12528-018-9186-0 · Cited by 91 · see citing works
Leony, D., Pardo, A., de‐la‐Fuente‐Valentín, L., de Castro, D. S., & Kloos, C. D. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330642 · Cited by 90 · see citing works
Pinxten, M., Soom, C. V., Peeters, C., Laet, T. D., & Langie, G. (2017) · European Journal of Psychology of Education · doi:10.1007/s10212-017-0361-x · Cited by 90 · see citing works
Self-citationA feedback model for data-rich learning experiences
Pardo, A. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2017.1356905 · Cited by 82 · see citing works
Shneiderman, B. (2016) · doi:10.1093/acprof:oso/9780198758839.001.0001 · Cited by 75 · see citing works
KU Leuven, B., Klerkx, J., Verbert, K., KU Leuven, B., Duval, E., & KU Leuven, B. (2017) · Society for Learning Analytics Research (SoLAR) eBooks · doi:10.18608/hla17.012 · Cited by 67 · see citing works
Self-citationThe New ABCs of Research: Achieving Breakthrough Collaborations
Shneiderman, B. (2016) · Cited by 56 · see citing works
Podgorelec, V., & Kuhar, S. (2011) · Elektronika ir Elektrotechnika · doi:10.5755/j01.eee.114.8.708 · Cited by 50 · see citing works
How did the e-learning session go? The Student Inspector
Scheuer, O., & Zinn, C. (2007) · Cited by 43 · see citing works
Pinxten, M., Fraine, B. D., Noortgate, W. V. D., Damme, J. V., Boonen, T., & Vanlaar, G. (2014) · Studies in Higher Education · doi:10.1080/03075079.2014.914904 · Cited by 41 · see citing works
Self-citationDashboard for Actionable Feedback on Learning Skills: Scalability and Usefulness
Broos, T., Peeters, L., Verbert, K., Soom, C. V., Langie, G., & Laet, T. D. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-58515-4_18 · Cited by 30 · see citing works
Self-citationBarr, J., & Gunawardena, A. D. (2012) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/2157136.2157196 · Cited by 25 · see citing works
Review of Tell Me More Spanish
Lafford, B. A. (2004) · Language learning & technology · doi:10.64152/10125/25248 · Cited by 25 · see citing works
Towards Balanced Discussions in the Classroom Using Ambient Information Visualisations
Charleer, S., Klerkx, J., Duval, E., & Verbert, K. (2017) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2017.10002503 · Cited by 22 · see citing works
Self-citationSmall data as a conversation starter for learning analytics
Broos, T., Verbert, K., Langie, G., Soom, C. V., & Laet, T. D. (2017) · Journal of Research in Innovative Teaching & Learning · doi:10.1108/jrit-05-2017-0010 · Cited by 20 · see citing works
Self-citationTowards balanced discussions in the classroom using ambient information visualisations
Charleer, S., Klerkx, J., Duval, E., Laet, T. D., & Verbert, K. (2017) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2017.084501 · Cited by 13 · see citing works
Self-citationFagen, W., & Kamin, S. (2012) · EdMedia: World Conference on Educational Media and Technology · Cited by 6 · see citing works
Broos, T., Verbert, K., Langie, G., Soom, C. V., & Laet, T. D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-98572-5_30 · Cited by 2 · see citing works
Self-citationKravčík, M., Mikroyannidis, A., Pammer‐Schindler, V., & Prilla, M. (2017) · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 6
- Corrin, L., and P. de Barba. 2014. "Exploring students' interpretation of feedback delivered through learning analytics dashboards." In Proceedings of the ascilite 2014 conference, 629- 633.
- Dollár, A., and P. S. Steif. 2012. "Web-based statics course with learning dashboard for in- structors." Proceedings of computers and advanced technology in education (CATE 2012), Napoli, Italy .
- Leony, D., A. Pardo, L. de la Fuente Valentín, D. S. de Castro, and C. D. Kloos. 2012. "GLASS: a learning analytics visualization tool." In Proceedings of the 2nd international conference on learning analytics and knowledge, 162-163. ACM.
- Olivier, I., M. Lacante, and V. Briers. 2015. "A re-calibration of the LASSI norm scores for a Flemish educational context." Master's thesis, Katholieke Universiteit Leuven, Belgium.
- Rojas, I. G., R. M. C. García, and C. D. Kloos. 2011. "Orchestration and feedback in lab sessions: improvements in quick feedback provision." In European Conference on Technology Enhanced Learning, 424-429. Springer.
- Vanderoost, J., C. Van Soom, G. Langie, J. Van den Bossche, R. Callens, J. Vandewalle, and T. De Laet. 2015. "Engineering and science positioning tests in Flanders: powerful predictors for study success?" In Proceedings of the 43rd Annual SEFI Conference, 1-8.
Cited by
Sorted by citations
Banihashem, S. K., Noroozi, O., van Ginkel, S., Macfadyen, L. P., & Biemans, H. J. A. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100489 · Cited by 246 · see citing works
Paulsen, L., & Lindsay, E. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12401-4 · Cited by 111 · see citing works
Williamson, K., & Kizilcec, R. F. (2022) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3506860.3506900 · Cited by 73 · see citing works
Formative assessment strategies for students' conceptions—The potential of learning analytics
Stanja, J., Gritz, W., Krugel, J., Hoppe, A., & Dannemann, S. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13288 · Cited by 70 · see citing works
Visualizations and Dashboards for Learning Analytics: A Systematic Literature Review
Şahi̇n, M., & Ifenthaler, D. (2021) · Advances in analytics for learning and teaching · doi:10.1007/978-3-030-81222-5_1 · Cited by 43 · see citing works
Technology enhanced assessment: Ottawa consensus statement and recommendations
Fuller, R., Joynes, V. C. T., Nadarajah, V. D., Treasure-Jones, T., Yeates, P., Scott, K. M., Webb, A. L., Valter, K., & Pyörälä, E. (2022) · Medical Teacher · doi:10.1080/0142159x.2022.2083489 · Cited by 38 · see citing works
Dobashi, K., Ho, C. P., Fulford, C. P., Grace Lin, M.-F., & Higa, C. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100105 · Cited by 35 · see citing works
Early Warning System for Online STEM Learning—A Slimmer Approach Using Recurrent Neural Networks
Yu, C.-C., & Wu, L. Y. (2021) · Sustainability · doi:10.3390/su132212461 · Cited by 24 · see citing works
Everaert, P. C., Opdecam, E., & van der Heijden, H. (2022) · Accounting Education · doi:10.1080/09639284.2022.2145570 · Cited by 25 · see citing works
Interactive and Explainable Advising Dashboard Opens the Black Box of Student Success Prediction
Scheers, H., & Laet, T. D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86436-1_5 · Cited by 18 · see citing works
Students’ Emotional Reactions to Social Comparison via a Learner Dashboard
Bennett, L., & Folley, S. (2021) · Advances in analytics for learning and teaching · doi:10.1007/978-3-030-81222-5_11 · Cited by 12 · see citing works
Figueroa-Cañas, J., & Vinuesa, T. S. (2021) · Open Learning The Journal of Open Distance and e-Learning · doi:10.1080/02680513.2021.1971963 · Cited by 11 · see citing works
Blondeel, E., Everaert, P. C., & Opdecam, E. (2023) · Studies in Higher Education · doi:10.1080/03075079.2023.2288170 · Cited by 10 · see citing works
Ahern, S. J. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.531424 · Cited by 10 · see citing works
Guisñan, P. A. B., Lara, J. A., Cano, A., Cerezo, R., & Romero, C. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-025-01278-4 · Cited by 9 · see citing works
Wu, M., Zhang, H., Liang, J., Shafiabady, N., Lu, H., Gide, E., Dasanayake, D. W. M. N. C., Jha, M., & Duan, S. (2025) · PLoS ONE · doi:10.1371/journal.pone.0321077 · Cited by 5 · see citing works
Human-centered Approaches to Data-informed Feedback
Tsai, Y., & Martínez‐Maldonado, R. (2022) · Solar eBooks · doi:10.18608/hla22.021 · Cited by 5 · see citing works
Şahi̇n, M. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2023.2194935 · Cited by 3 · see citing works
Designing an Online Self-assessment for Informed Study Decisions: The User Perspective
Delnoij, L. E. C., Janssen, J., Dirkx, K., & Martens, R. L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-57717-9_6 · Cited by 3 · see citing works
Why Do Accounting Students Procrastinate? A Qualitative Analysis Using ChatGPTPreprint
Blondeel, E., Everaert, P. C., & Opdecam, E. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4632334 · Cited by 3 · see citing works
Exploring the Utility of Social Content for Understanding Future In-Demand Skills
Mahdavimoghaddam, J., Bahuguna, A., & Ebrahim Bagheri, A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555114 · Cited by 2 · see citing works
Öğrenme analitiği sürecine yönelik modellere genel bir bakış: Kavramsal bir çerçeve önerisi
Önder, A., ÖZTAŞ, G. S., & Akçapınar, G. (2023) · Açıköğretim Uygulamaları ve Araştırmaları Dergisi · doi:10.51948/auad.1163540 · Cited by 2 · see citing works
Development and Evaluation of a Student-Facing Gamified Learning Analytics Dashboard
Akçapınar, G., & Hasnine, M. N. (2021) · Advances in analytics for learning and teaching · doi:10.1007/978-3-030-81222-5_13 · Cited by 2 · see citing works
Towards an Online Self-Assessment for Informed Study Decisions–A Mixed-Methods Validation Study
Delnoij, L. E. C., Janssen, J., Dirkx, K., & Martens, R. L. (2022) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.949160 · Cited by 2 · see citing works
Ontong, J. M., Bruwer, A., & Schonken, C. (2022) · Perspectives in Education · doi:10.38140/pie.v40i4.6469 · Cited by 2 · see citing works
What Do MOOC Dashboards Present to Learners?
Sun, W., Schumacher, C., Chen, L., & Niels Pinkwart, C. (2021) · Advances in analytics for learning and teaching · doi:10.1007/978-3-030-81222-5_6 · Cited by 1 · see citing works
The Utility of Social Media in Understanding the Future of Work
Mahdavimoghaddam, J. (2022) · CSCW Companion · doi:10.1145/3500868.3561397 · Cited by 2 · see citing works
Ontong, J. M., Arendse-Fourie, S.-L., & Schonken, C. (2022) · South African Journal of Higher Education · doi:10.20853/36-3-4662
door onderzoek geïnformeerde ontwikkeling van een Learning Analytics dashboard.
Bruyne, E. D., Herrewijn, L., Hoefkens, A., Heirman, W., Vanthournout, G., & Depessemier, P. (2023) · Tijdschrift voor Hoger Onderwijs · doi:10.59532/tvho.v41i1.13948
Een kritisch constructief perspectief op Learning Analytics
Laet, T. D. (2023) · Tijdschrift voor Hoger Onderwijs · doi:10.59532/tvho.v41i1.13957
Why Do Business Economics Students Procrastinate? A Qualitative AnalysisPreprint
Blondeel, E., Everaert, P. C., & Opdecam, E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4776638
Advancing Global Education Through Learning Analytics
Martins, H. F. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-2622-1.ch004
- Authors
- Broos, T., Pinxten, M., Delporte, M., Verbert, K., & De Laet, T.
- Affiliations
- KU Leuven (BE)
- Faculty of Engineering Science, KU Leuven, Leuven, Belgium;
- Corresponding author
- Broos, Tom
- Venue
- Assessment & Evaluation in Higher Education
- Publisher
- Informa UK Limited
- Published
- 2019-11-27
- Volume
- 45
- Issue
- 6
- Pages
- 855-874
- ISSN
- 0260-2938 (ISSN-L)
- 1469-297X
- OpenAlex
- W2990738880
- Cited by
- 32
- References
- 41
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 2 · 2023: 6 · 2022: 12 · 2021: 7 · 2020: 2
- FWCI
- 5.68
- Type
- journal article
- Language
- en
- Open access
- green
- lirias.kuleuven.be
- Licence
- other-oa
- Locations
- Assessment & Evaluation in Higher Education (publishedVersion)
- Lirias (submittedVersion, other-oa)
- Funders
- European Commission
- Erasmus+ (562167-EPP-1-2015-1-BE-EPPKA3-PI-FORWARD)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Higher Education Research Studies
- Keywords
- learning analytics dashboards, first-year students, academic performance, study skills, early warning systems, low-cost deployment, learning analytics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
