Multimodal teaching analytics: Automated extraction of orchestration graphs from wearable sensor data
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The pedagogical modelling of everyday classroom practice is an interesting kind of evidence, both for educational research and teachers' own professional development. This paper explores the usage of wearable sensors and machine learning techniques to automatically extract orchestration graphs (teaching activities and their social plane over time) on a dataset of 12 classroom sessions enacted by two different teachers in different classroom settings. The dataset included mobile eye‐tracking as well as audiovisual and accelerometry data from sensors worn by the teacher. We evaluated both time‐independent and time‐aware models, achieving median F1 scores of about 0.7–0.8 on leave‐one‐session‐out k‐fold cross‐validation. Although these results show the feasibility of this approach, they also highlight the need for larger datasets, recorded in a wider variety of classroom settings, to provide automated tagging of classroom practice that can be used in everyday practice across multiple teachers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“This importance has been highlighted by educational research efforts in naturalistic settings, including inquiry-based learning experiences (e.g., Kirschner et al. 2006), computer-supported collaborative writing (e.g., Onrubia & Engel 2012), and many others.”
BackgroundVideo and Image based Emotion Recognition Challenges in the Wild: EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2829994 · Cited by 305
Classroom Orchestration: Synthesis
Roschelle, J., Dimitriadis, Y., & Hoppe, U. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.04.010 · Cited by 150 · cited 1×
“Indeed, the understanding of specific problems and phenomena that arise in the implementation of educational innovations in authentic settings (also known as ‘orchestration’) is considered one of the foremost challenges in the field of TEL (Fischer et al. 2014; Roschelle et al. 2013).”
Background
Cited by
The promises and challenges of artificial intelligence for teachers: A systematic review of research
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022) · TechTrends · doi:10.1007/s11528-022-00715-y · Cited by 984
“, 2020), and their pedagogically meaningful and productive teaching incidents can serve as models for AI-based educational systems (Prieto et al., 2018).”
BackgroundMangaroska, K., & Giannakos, M. (2019) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2018.2868673 · Cited by 378
From Data to Insights: A Layered Storytelling Approach for Multimodal Learning Analytics
Martinez-Maldonado, R., Echeverria, V., Fernandez Nieto, G., & Buckingham Shum, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376148 · Cited by 123
“firefighting [73] and medical education [14]), or to contexts using multimodal learning analytics to model complex behaviours, such as collocated collaborative learning [20], designing in maker-spaces [98], or teacher activity in the classroom [71].”
BackgroundMangaroska, K., Sharma, K., Gašević, D., & Giannakos, M. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12590 · Cited by 100
Self-citationScalability, Sustainability, and Ethicality of Multimodal Learning Analytics
Yan, L., Zhao, L., Gasevic, D., & Martinez-Maldonado, R. (2022) · LAK22: 12th International Learning Analytics and Knowledge Conference · doi:10.1145/3506860.3506862 · Cited by 83
Metadata
- Authors
- Prieto, L. P., Sharma, K., Kidzinski, Ł., Rodríguez‐Triana, M. J., & Dillenbourg, P.
- Venue
- Journal of Computer Assisted Learning
- Publisher
- Wiley
- Published
- 2018-01-24
- Volume
- 34
- Issue
- 2
- Pages
- 193-203
- ISSN
- 0266-4909 (ISSN-L)
- 1365-2729
- OpenAlex
- W2793185901
- Cited by
- 119
- References
- 3
- FWCI
- 16.18
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.