The Question-driven Dashboard: How Can We Design Analytics Interfaces Aligned to Teachers’ Inquiry?
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
One of the ultimate goals of several learning analytics (LA) initiatives is to close the loop and support students’ and teachers’ reflective practices. Although there has been a proliferation of end-user interfaces (often in the form of dashboards), various limitations have already been identified in the literature such as key stakeholders not being involved in their design, little or no account for sense-making needs, and unclear effects on teaching and learning. There has been a recent call for human-centred design practices to create LA interfaces in close collaboration with educational stakeholders to consider the learning design, and their authentic needs and pedagogical intentions. This paper addresses the call by proposing a question-driven LA design approach to ensure that end-user LA interfaces explicitly address teachers’ questions. We illustrate the approach in the context of synchronous online activities, orchestrated by pairs of teachers using audio-visual and text-based tools (namely Zoom and Google Docs). This study led to the design and deployment of an open-source monitoring tool to be used in real-time by teachers when students work collaboratively in breakout rooms, and across learning spaces.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Stimulated recall: A method for research on teaching
CALDERHEAD, J. (1981) · British Journal of Educational Psychology · doi:10.1111/j.2044-8279.1981.tb02474.x · Cited by 533
From Data to Insights: A Layered Storytelling Approach for Multimodal Learning Analytics
Martinez-Maldonado, R., Echeverria, V., Fernandez Nieto, G., & Buckingham Shum, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376148 · Cited by 123 · cited 1×
“A learning design-driven storytelling approach [27] is particularly plausible for addressing this call, but in this work, designers still had to configure the LA interface for teachers to be fully adapted to the learning designs.”
BackgroundHow do we start? An approach to learning analytics adoption in higher education
Gasevic, D., Tsai, Y.-S., Dawson, S., & Pardo, A. (2019) · The International Journal of Information and Learning Technology · doi:10.1108/ijilt-02-2019-0024 · Cited by 103 · cited 1×
“We see this as one of the key challenges in one of the grand themes in Learning Analytics, namely, the ability of learning analytics to support personalised targeted interventions [17, 39].”
BackgroundSelf-citationReflective writing analytics for actionable feedback
Gibson, A., Aitken, A., Sándor, Á., Buckingham Shum, S., Tsingos-Lucas, C., & Knight, S. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027436 · Cited by 83
Driving data storytelling from learning design
Echeverria, V., Martinez-Maldonado, R., Granda, R., Chiluiza, K., Conati, C., & Buckingham Shum, S. (2018) · Proceedings of the 8th International Conference on Learning Analytics and Knowledge · doi:10.1145/3170358.3170380 · Cited by 80
Staying on target: A systematic literature review on learner‐facing learning analytics dashboards
Valle, N., Antonenko, P., Dawson, K., & Huggins‐Manley, A. C. (2021) · British Journal of Educational Technology · doi:10.1111/bjet.13089 · Cited by 79
Planning prompts increase and forecast course completion in massive open online courses
Yeomans, M., & Reich, J. (2017) · Proceedings of the Seventh International Learning Analytics & Knowledge Conference · doi:10.1145/3027385.3027416 · Cited by 61
Cited by
The promise and challenges of generative AI in education
Giannakos, M., Azevedo, R., Brusilovsky, P., Cukurova, M., Dimitriadis, Y., Hernandez-Leo, D., Järvelä, S., Mavrikis, M., & Rienties, B. (2025) · Behaviour & Information Technology · doi:10.1080/0144929x.2024.2394886 · Cited by 543
Self-citationCukurova, M. (2025) · British Journal of Educational Technology · doi:10.1111/bjet.13514 · Cited by 302
Self-citationHuman-centred learning analytics and AI in education: A systematic literature review
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100215 · Cited by 281
Self-citationBulathwela, S., Pérez-Ortiz, M., Holloway, C., Cukurova, M., & Shawe-Taylor, J. (2024) · Sustainability · doi:10.3390/su16020781 · Cited by 269
“In addition, a human-centred approach to AIEd provides opportunities for better value alignment of AI tools and their intended end user [99].”
Self-citationPan, Z., Biegley, L., Taylor, A., & Zheng, H. (2024) · Journal of Learning Analytics · doi:10.18608/jla.2023.8093 · Cited by 76
“However, there are persistent calls for a more extensive exploration of dashboard evaluation methodology (Verbert et al., 2020), including the alignment of dashboard design with teacher inquiries (Pozdniakov et al., 2022).”
Background
Metadata
- Authors
- Pozdniakov, S., Martinez-Maldonado, R., Tsai, Y.-S., Cukurova, M., Bartindale, T., Chen, P., Marshall, H., Richardson, D., & Gasevic, D.
- Venue
- LAK22: 12th International Learning Analytics and Knowledge Conference
- Publisher
- ACM
- Published
- 2022-03-21
- Pages
- 175-185
- OpenAlex
- W4214813753
- Cited by
- 37
- References
- 7
- FWCI
- 10.07
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.