The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
When used in classrooms, personalized learning software allows students to work at their own pace, while freeing up the teacher to spend more time working one-on-one with students. Yet such personalized classrooms also pose unique challenges for teachers, who are tasked with monitoring classes working on divergent activities, and prioritizing help-giving in the face of limited time. This paper reports on the co-design, implementation, and evaluation of a wearable classroom orchestration tool for K-12 teachers: mixed-reality smart glasses that augment teachers' realtime perceptions of their students' learning, metacognition, and behavior, while students work with personalized learning software. The main contributions are: (1) the first exploration of the use of smart glasses to support orchestration of personalized classrooms, yielding design findings that may inform future work on real-time orchestration tools; (2) Replay Enactments: a new prototyping method for real-time orchestration tools; and (3) an in-lab evaluation and classroom pilot using a prototype of teacher smart glasses (Lumilo), with early findings suggesting that Lumilo can direct teachers' time to students who may need it most.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Effectiveness of Intelligent Tutoring Systems: A Meta-Analytic Review
Kulik, J. A., & Fletcher, J. D. (2016) · Review of Educational Research · doi:10.3102/0034654315581420 · Cited by 930
UX Design Innovation: Challenges for Working with Machine Learning as a Design Material
Dove, G., Halskov, K., Forlizzi, J., & Zimmerman, J. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025739 · Cited by 391 · cited 1×
“Doing so allows for earlier observation of the interplay between human and machine judgments (cf. [7]), such as ways a system’s false positives and negatives may impact the experience of using a data-driven intelligent system.”
Background
Cited by
State of the art and practice in AI in education
Holmes, W., & Tuomi, I. (2022) · European Journal of Education · doi:10.1111/ejed.12533 · Cited by 1,093
Celik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
The impact of artificial intelligence on learner–instructor interaction in online learning
Seo, K., Tang, J., Roll, I., Fels, S., & Yoon, D. (2021) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-021-00292-9 · Cited by 788
“AI analytics allows instructors to understand students’ performance, progress, and potential by decrypting their clickstream data (Roll & Winne, 2015; Fong et al., 2019; Seo et al., 2021; Holstein et al., 2018).”
BackgroundImproving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
“X for ML” has begun to explore new forms of prototyping for ML systems, to provide earlier insights into the complex, interacting UX impacts of particular dataset, modeling, and system-design choices [30, 44, 51, 109]. In addition, a growing body of research focuses on the design and development of programmer tools th…”
BackgroundSelf-citationChounta, I.-A., Bardone, E., Raudsep, A., & Pedaste, M. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00243-5 · Cited by 441
Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI Complementarity
Holstein, K., McLaren, B. M., & Aleven, V. (2019) · Journal of Learning Analytics · doi:10.18608/jla.2019.62.3 · Cited by 390
Self-citationLeading teachers' perspective on teacher-AI collaboration in education
Kim, J. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12109-5 · Cited by 376
Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms
Holstein, K., McLaren, B. M., & Aleven, V. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93843-1_12 · Cited by 235
“We present Lumilo [19]: mixed-reality smart glasses, co-designed with middleschool mathematics teachers, that tune teachers in to the rich analytics generated by ITSs (cf.”
BackgroundMethodInfluentialSelf-citationHolstein, K., McLaren, B. M., & Aleven, V. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-23204-7_14 · Cited by 189
Self-citationDesigning for human–AI complementarity in K‐12 education
Holstein, K., & Aleven, V. (2022) · AI Magazine · doi:10.1002/aaai.12058 · Cited by 156
Self-citationLearning analytics dashboards: the past, the present and the future
Verbert, K., Ochoa, X., De Croon, R., Dourado, R. A., & De Laet, T. (2020) · Proceedings of the Tenth International Conference on Learning Analytics & Knowledge · doi:10.1145/3375462.3375504 · Cited by 129
“An additional recent trend is the use of participatory design methods to better address the actual needs and issues of end-users [8, 16, 21].”
BackgroundPark, H., & Ahn, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642785 · Cited by 84
“To solve such problems, Holstein et al. [29] created Lumilo, smart glasses that support teachers to assist students struggling learning with AI tutor by displaying real-time information about the students (i.e., their learning, meta cognition, and behavior).”
BackgroundThe TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms
An, P., Holstein, K., d'Anjou, B., Eggen, B., & Bakker, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376277 · Cited by 69
“Selective shared awareness: In between these two ends of the spectrum lies a rich design space for systems that facilitate real-time teacher control over which information is shared with which individuals or groups [50, 52, 82].”
BackgroundInfluentialSelf-citationThe equalizing effect of teacher dashboards on feedback in K-12 classrooms
Knoop-van Campen, C. A. N., Wise, A., & Molenaar, I. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1931346 · Cited by 58
Chang, M. A., Tissenbaum, M., Philip, T. M., & D’Mello, S. K. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100364 · Cited by 12
Metadata
- Authors
- Holstein, K., Hong, G., Tegene, M., McLaren, B. M., & Aleven, V.
- Venue
- Proceedings of the 8th International Conference on Learning Analytics and Knowledge
- Publisher
- ACM
- Published
- 2018-03-07
- Pages
- 79-88
- OpenAlex
- W2791111658
- Cited by
- 129
- References
- 2
- FWCI
- 4.08
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.