The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard Research
Open accessAbstract
This paper presents a systematic literature review of the state-of-the-art of research on learning dashboards in the fields of Learning Analytics and Educational Data Mining. Research on learning dashboards aims to identify what data is meaningful to different stakeholders and how data can be presented to support sense-making processes. Learning dashboards are becoming popular due to the increased use of educational technologies, such as Learning Management Systems (LMS) and Massive Open Online Courses (MOOCs). The initial search of five main academic databases and GScholar resulted in 346 papers out of which 55 papers were included in the final analysis. Our review distinguishes different kinds of research studies as well as various aspects of learning dashboards and their maturity regarding evaluation. As the research field is still relatively young, most studies are exploratory and proof-of-concept. The review concludes by offering a definition for learning dashboards and by outlining open issues and future lines of work in the area of learning dashboards. There is a need for longitudinal research in authentic settings and studies that systematically compare different dashboard designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,472
Research design: qualitative, quantitative, and mixed methods approaches
Caldas, M. P. (2003) · Revista de Administração Contemporânea · doi:10.1590/s1415-65552003000100015 · Cited by 18,745
Scholarship Reconsidered: Priorities of the Professoriate
Poston, L., & Boyer, E. L. (1992) · Academe · doi:10.2307/40250362 · Cited by 6,829
Educational data mining: A survey from 1995 to 2005
Romero, C., & Ventura, S. (2007) · Expert Systems with Applications · doi:10.1016/j.eswa.2006.04.005 · Cited by 1,482
Learning analytics: drivers, developments and challenges
Ferguson, R. (2012) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2012.051816 · Cited by 1,354
Learning Analytics Dashboard Applications
Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013) · American Behavioral Scientist · doi:10.1177/0002764213479363 · Cited by 632
Soller, A., Martínez, A., Jermann, P., & Muehlenbrock, M. (2005) · International Journal of Artificial Intelligence in Education · doi:10.3233/irg-2005-15(4)02 · Cited by 587
Social learning analytics: five approaches
Ferguson, R., & Buckingham Shum, S. (2012) · Proceedings of the 2nd International Conference on Learning Analytics and Knowledge · doi:10.1145/2330601.2330616 · Cited by 523
Learning dashboards: an overview and future research opportunities
Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2013) · Personal and Ubiquitous Computing · doi:10.1007/s00779-013-0751-2 · Cited by 453
Attention please!: learning analytics for visualization and recommendation
Duval, E. (2011) · Proceedings of the 1st International Conference on Learning Analytics and Knowledge · doi:10.1145/2090116.2090118 · Cited by 325
Design and Implementation of a Learning Analytics Toolkit for Teachers
Dyckhoff, A. L., Zielke, D., Bultmann, M., Chatti, M. A., & Schroeder, U. (2012) · Cited by 315
Developing early warning systems to predict students’ online learning performance
Hu, Y.-H., Lo, C.-L., & Shih, S.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.002 · Cited by 278
Learning Analytics: Definitions, Processes and Potential
Elias, T. (2011) · Cited by 245
Development of the Learning Analytics Dashboard to Support Students' Learning Performance
Jo, I.-H., & Park, Y. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.3217/jucs-021-01-0110 · Cited by 203
Ruipérez‐Valiente, J. A., Muñoz‐Merino, P. J., Leony, D., & Kloos, C. D. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.07.002 · Cited by 163
Big data for education data mining, data analytics and web dashboards
Milevski, Z., Gelova, E., & Zdravev, Z. (2015) · Goce Delchev University Repository (Goce Delčev University of Štip) · Cited by 160
Methodological challenges for collaborative learning research
Strijbos, J.-W., & Fischer, F. (2007) · Learning and Instruction · doi:10.1016/j.learninstruc.2007.03.004 · Cited by 158
Providing collaborative learning support with social media in an integrated environment
Popescu, E. (2012) · World Wide Web · doi:10.1007/s11280-012-0172-6 · Cited by 121
A framework to support educational decision making in mobile learning
Fulantelli, G., Taibi, D., & Arrigo, M. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.045 · Cited by 110
Goal-oriented visualizations of activity tracking
Santos, J. L., Govaerts, S., Verbert, K., & Duval, E. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330639 · Cited by 106
Leony, D., Pardo, A., de‐la‐Fuente‐Valentín, L., de Castro, D. S., & Kloos, C. D. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330642 · Cited by 90
Addressing learner issues with StepUp!
Santos, J. L., Verbert, K., Govaerts, S., & Duval, E. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460301 · Cited by 88
Educational Dashboards for Smart Learning: Review of Case Studies
Yoo, Y., Lee, H., Jo, I., & Park, Y. (2014) · Lecture notes in educational technology · doi:10.1007/978-3-662-44188-6_21 · Cited by 80
Exploring students’ interpretation of feedback delivered through learning analytics dashboards
Corrin, L., & Barba, P. D. (2014) · ASCILITE Publications · doi:10.14742/apubs.2014.1300 · Cited by 79
Learning analytics beyond the LMS
Kitto, K., Cross, S., Waters, Z., & Lupton, M. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723627 · Cited by 78
Visual insights: a practical guide to making sense of data
Börner, K., Börner, K., Parts, T., & Polley, T. (2015) · Choice Reviews Online · doi:10.5860/choice.187405 · Cited by 77
GradeCraft: what can we learn from a game-inspired learning management system?
Holman, C., Aguilar, S. J., & Fishman, B. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460350 · Cited by 70
Visual Insights: A Practical Guide to Making Sense of Data
(2014) · Online Information Review · doi:10.1108/oir-10-2014-0230 · Cited by 69
Application of Learning Analytics in educational videogames
Serrano-Laguna, Á., Torrente, J., Pablo Moreno-ger, A., & Fernández‐Manjón, B. (2014) · Entertainment Computing · doi:10.1016/j.entcom.2014.02.003 · Cited by 68
Perceptions and use of an early warning system during a higher education transition program
Aguilar, S. J., Lonn, S., & Teasley, S. D. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567625 · Cited by 63
Competency map: visualizing student learning to promote student success
Grann, J., & Bushway, D. J. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567622 · Cited by 60
Socially augmented argumentation tools: Rationale, design and evaluation of a debate dashboard
Iandoli, L., Quinto, I., De Liddo, A., & Buckingham Shum, S. (2014) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2013.08.006 · Cited by 54
Using Learning Analytics to Visualise Computer Science Teamwork
Tarmazdi, H., Vivian, R., Szabo, C., Falkner, K. E. K., & Falkner, N. (2015) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/2729094.2742613 · Cited by 51
Martínez‐Maldonado, R., Yacef, K., & Kay, J. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2015.05.001 · Cited by 48
Towards Portable Learning Analytics Dashboards
Vozniuk, A., Govaerts, S., & Gillet, D. (2013) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2013.126 · Cited by 47
Self-citationImproving awareness and reflection through collaborative, interactive visualizations of badges.
Charleer, S., Klerkx, J., Santos, J. L., & Duval, E. (2013) · Lirias · Cited by 45
Florián-Gaviria, B., Glahn, C., & Fabregat, R. (2013) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2013.18 · Cited by 41
Exploring the Impact of a Learning Dashboard on Student Affect
Müldner, K., Wixon, M., Rai, D., Burleson, W., Woolf, B. P., & Arroyo, I. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_31 · Cited by 38
Learning Analytics on federated remote laboratories: Tips and techniques
Orduña, P., Almeida, A., López–de–Ipiña, D., & García-Zubía, J. (2014) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon.2014.6826107 · Cited by 36
Towards the development of a learning analytics extension in open edX
Ruiz, J. S., Pijeira‐Díaz, H. J., Ruipérez‐Valiente, J. A., et al. (2014) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/2669711.2669914 · Cited by 34
Moissa, B., Gasparini, I., & Kemczinski, A. (2015) · International Journal of Distance Education Technologies · doi:10.4018/ijdet.2015070101 · Cited by 31
Use of Dashboards and Visualization Techniques to Support Teacher Decision Making
Mottus, A., Kinshuk, K., Sabine Graf, A., & Chen, N. (2014) · Lecture notes in educational technology · doi:10.1007/978-3-662-44659-1_10 · Cited by 29
Sutherland, R., Joubert, M., & Eagle, S. (2012) · Bristol Research (University of Bristol) · Cited by 29
moocRP: An Open-source Analytics Platform
Pardos, Z. A., & Kao, K. (2015) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2724660.2724683 · Cited by 28
Topic facet modeling: semantic visual analytics for online discussion forums
Hsiao, I., & Awasthi, P. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723613 · Cited by 27
Tracking Data in Open Learning Environments
Duval, E., Klerkx, J., Santos, J. L., et al. (2020) · DSpace (Open University in the Netherlands) · doi:10.3217/jucs-021-07-0976 · Cited by 27
Martínez‐Maldonado, R., Clayphan, A. J., & Kay, J. (2015) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-015-9217-6 · Cited by 24
Improving Teacher Awareness Through Activity, Badge and Content Visualizations
Charleer, S., Santos, J. L., Klerkx, J., & Duval, E. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-13296-9_16 · Cited by 23
Visualising Multiple Data Sources in an Independent Open Learner Model
Bull, S., Johnson, M. D., Alotaibi, M., Byrne, W., & Cierniak, G. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39112-5_21 · Cited by 22
STEMscopes: contextualizing learning analytics in a K-12 science curriculum
Monroy, C. R., Rangel, V. S., & Whitaker, R. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460339 · Cited by 21
Towards Textual Reporting in Learning Analytics Dashboards
Ramos-Soto, A., Lama, M., Vázquez-Barreiros, B., Bugarín, A., & Mucientes, M. (2015) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2015.96 · Cited by 20
Learning dashboards & learnscapes
Duval, E., Klerkx, J., Verbert, K., Nagel, T., Govaerts, S., Chico, G. A. P., Odriozola, J. L. S., & Vandeputte, B. (2012) · Lirias · Cited by 18
Learning analytics in serious games: a review of the literature
Chaudy, Y., Connolly, T. M., & Hainey, T. (2014) · Cited by 18
Elaachak, L., Belahbibe, A., & Bouhorma, M. (2015) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v5i2.pp344-354 · Cited by 17
Ji, M., Michel, C., Lavoué, É., & George, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11200-8_39 · Cited by 15
Supporting competency-assessment through a learning analytics approach using enriched rubrics
Rayón, A., Guenaga, M., & Núñez, A. (2014) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/2669711.2669913 · Cited by 15
Learning, Learning Analytics, Activity Visualisation and Open Learner Model: Confusing?
Susan Bull, A., Kickmeier-Rust, M., Vatrapu, R., Johnson, M. D., Hammermüller, K., Byrne, W., Hernandez-Munoz, L. U., Giorgini, F., & Meissl-Egghart, G. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40814-4_51 · Cited by 14
Visual learning analytics techniques applied in software engineering subjects
Conde, M. Á., García‐Peñalvo, F. J., Aguilar, D. A. G., & Therón, R. (2014) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2014.7044486 · Cited by 14
Learning Analytics and Educational Data Mining: An Overview of Recent Techniques
Steiner, C., Kickmeier-Rust, M., & Albert, D. (2014) · PHSG #Proforis (St.Gallen University of Teacher Education) · Cited by 14
Addressing learner issues with StepUp! : an evaluation
Santos, J., Verbert, K. K., Govaerts, S., & Duval, E. (2013) · TU/e Research Portal · Cited by 8
Turning learners into effective better learners: The use of the askMe! System for learning analytics
Saul, C., & Wuttke, H. (2014) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 6
Learning process analytics for a self-study class in a Semantic Mediawiki
Schneider, D., Class, B., Benetos, K., Costa, J. D., & Follonier, V. (2014) · International Symposium on Open Collaboration · doi:10.1145/2641580.2641605 · Cited by 5
Cited by
Automatic feedback in online learning environments: A systematic literature review
Cavalcanti, A. P., Barbosa, A., Carvalho, R., Freitas, F., Tsai, Y.-S., Gašević, D., & Mello, R. F. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100027 · Cited by 440
Matcha, W., Uzir, N. A., Gasevic, D., & Pardo, A. (2020) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2019.2916802 · Cited by 399
Postdigital Education in Design and Practice
Fawns, T. (2019) · Postdigital Science and Education · doi:10.1007/s42438-018-0021-8 · Cited by 365
Bodily, R., & Verbert, K. (2017) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2017.2740172 · Cited by 306
License to evaluate: preparing learning analytics dashboards for educational practice
Jivet, I., Scheffel, M., Specht, M., & Drachsler, H. (2018) · Proceedings of the 8th International Conference on Learning Analytics and Knowledge · doi:10.1145/3170358.3170421 · Cited by 277
Metadata
- Authors
- Schwendimann, B. A., Rodriguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Boroujeni, M. S., Holzer, A., Gillet, D., & Dillenbourg, P.
- Venue
- IEEE Transactions on Learning Technologies
- Published
- 2017-01-01
- Volume
- 10
- Issue
- 1
- Pages
- 30-41
- ISSN
- 1939-1382 (ISSN-L)
- OpenAlex
- W2509533451
- Cited by
- 545
- References
- 62
- FWCI
- 5.46
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.