Empowering Teachers with AI: Co-Designing a Learning Analytics Tool for Personalized Instruction in the Science Classroom
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
AI-based educational technology that is designed to support teachers in providing personalized instruction can enhance their ability to address the needs of individual students, hopefully leading to better learning gains. This paper presents results from participatory research aimed at co-designing with science teachers a learning analytics tool that will assist them in implementing a personalized pedagogy in blended learning contexts. The development process included three stages. In the first, we interviewed a group of teachers to identify where and how personalized instruction may be integrated into their teaching practices. This yielded a clustering-based personalization strategy. Next, we designed a mock-up of an AI-based tool that supports this strategy and worked with another group of teachers to define an `explainable learning analytics' scheme that explains each cluster in a way that is both pedagogically meaningful and can be generated automatically. Third, we developed an AI algorithm that supports this `explainable clusters' pedagogy and conducted a controlled experiment that evaluated its contribution to teachers' ability to plan personalized learning sequences. The planned sequences were evaluated in a blinded fashion by an expert, and the results demonstrated that the experimental group -- teachers who received the clusters with the explanations -- designed sequences that addressed the difficulties exhibited by different groups of students better than those designed by teachers who received the clusters without explanations. The main contribution of this study is twofold. First, it presents an effective personalization approach that fits blended learning in the science classroom, which combines a real-time clustering algorithm with an explainable-AI scheme that can automatically build pedagogically meaningful explanations from item-level meta-data (Q Matrix). Second, it demonstrates how such an end-to-end learning analytics solution can be built with teachers through a co-design process and highlights the types of knowledge that teachers add to system-provided analytics in order to apply them to their local context. As a practical contribution, this process informed the design of a new learning analytics tool that was integrated into a free online learning platform that is being used by more than 1000 science teachers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Number of Clusters in a Data Set Via the Gap Statistic
Tibshirani, R., Walther, G., & Hastie, T. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00293 · Cited by 6,205
Educational Data Mining: A review of the state of the art
Romero, C., & Ventura, S. (2010) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2010.2053532 · Cited by 2,251
XAI—Explainable artificial intelligence
Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019) · Science Robotics · doi:10.1126/scirobotics.aay7120 · Cited by 2,053
Romero, C., & Ventura, S. (2013) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1075 · Cited by 869
Stupid tutoring systems, intelligent humans
Baker, R. S. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-016-0105-0 · Cited by 425 · cited 1×
“Blending technology into the classroom, and in particular, Artificial Intelligence (AI) and Learning Analytics tools that provide actionable analytics that are based on rich process data, have the potential to support teachers in adopting personalized pedagogy [6, 19, 21, 32].”
BackgroundData in Practice: Conceptualizing the Data-Based Decision-Making Phenomena
Spillane, J. P. (2012) · American Journal of Education · doi:10.1086/663283 · Cited by 308
Learning analytics dashboards: the past, the present and the future
Verbert, K., Ochoa, X., De Croon, R., Dourado, R. A., & De Laet, T. (2020) · Proceedings of the Tenth International Conference on Learning Analytics & Knowledge · doi:10.1145/3375462.3375504 · Cited by 129
The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms
An, P., Holstein, K., d'Anjou, B., Eggen, B., & Bakker, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376277 · Cited by 69 · cited 1×
“, educational dashboards, teaching augmentation tools) were designed within this conceptual framework (see for example [3, 43]).”
Method
Cited by
Adaptive Learning Using Artificial Intelligence in e-Learning: A Literature Review
Gligorea, I., Cioca, M., Oancea, R., Gorski, A.-T., Gorski, H., & Tudorache, P. (2023) · Education Sciences · doi:10.3390/educsci13121216 · Cited by 980
“Usage /Remarks [65] Heterogeneous value difference metric (HVDM) Naïve Bayes classifier (NBC) HVDM is a similarity measure used to determine the similarity between learners.”
MethodArtificial intelligence and learning analytics in teacher education: A systematic review
Salas-Pilco, S., Xiao, K., & Hu, X. (2022) · Education Sciences · doi:10.3390/educsci12080569 · Cited by 326
“Lastly, it is important that more teachers, practitioners, educational authorities, and decision-makers become involved and understand the opportunities and challenges that AI and LA technologies could bring to teacher education.”
BackgroundHuman-centred learning analytics and AI in education: A systematic literature review
Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gašević, D., & Martinez-Maldonado, R. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100215 · Cited by 281
“…automation, such as educators actively utilising and interpreting the visualised data generated by an AI-powered system which automatically make inferences by analysing complex and large amount of students’ learning data (e.g., Alfredo et al., 2023; Nazaretsky et al., 2022b; Conijn et al., 2020b).”
MethodHuman-centered evaluation of explainable AI applications: a systematic review
Kim, J., Maathuis, H., & Sent, D. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1456486 · Cited by 130
Shaping integrity: why generative artificial intelligence does not have to undermine education
Tan, M. J. T., & Maravilla, N. M. A. T. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1471224 · Cited by 78
Metadata
- Authors
- Nazaretsky, T., Bar, C., Walter, M., & Alexandron, G.
- Venue
- LAK22: 12th International Learning Analytics and Knowledge Conference
- Publisher
- ACM
- Published
- 2022-03-21
- Pages
- 1-12
- OpenAlex
- W4220659381
- Cited by
- 67
- References
- 8
- FWCI
- 18.46
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Empowering Teachers with AI: Co-Designing a Learning Analytics Tool for Personalized Instruction in the Science Classroom. https://app.cochat.ai/papers/10.1145/3506860.3506861
- The paper
- Nazaretsky, T., Bar, C., Walter, M., & Alexandron, G. (2022). Empowering Teachers with AI: Co-Designing a Learning Analytics Tool for Personalized Instruction in the Science Classroom. LAK22: 12th International Learning Analytics and Knowledge Conference. https://doi.org/10.1145/3506860.3506861
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.