The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Multimodal Learning Analytics and Education Data Mining: using computational technologies to measure complex learning tasks
Open accessAbstract
New high-frequency multimodal data collection technologies and machine learning analysis techniques could offer new insights into learning, especially when students have the opportunity to generate unique, personalized artifacts, such as computer programs, robots, and solutions engineering challenges. To date most of the work on learning analytics and educational data mining has been focused on online courses and cognitive tutors, both of which provide a high degree of structure to the tasks, and are restricted to interactions that occur in front of a computer screen. In this paper, we argue that multimodal learning analytics can offer new insights into students’ learning trajectories in more complex and open-ended learning environments. We present several examples of this work and its educational application.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776
(1980) · Medical Entomology and Zoology · Cited by 7,534
(2011) · Cited by 2,752
Freiré, P. (1970) · Cited by 2,448
Dewey, J. (2024) · doi:10.55094/holistence.497 · Cited by 1,484
Klahr, D., & Nigam, M. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00737.x · Cited by 977
Baker, R. S. J. D., D'Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.12.003 · Cited by 936
Free viewpoint action recognition using motion history volumes
Weinland, D., Ronfard, R., & Boyer, E. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.07.013 · Cited by 896
Jung, C. G. (1956) · Collected Works, Volume 14 · doi:10.1515/9781400845927 · Cited by 885 · cited 1×
“…— which has become pervaded by technology and threatened by challenging global problems such as climate change — both K–12 and university-level engineering education (Dym, 1999) demand higher-level, complex problem-solving as opposed to performance in routine cognitive tasks (Levy & Murnane, 2004).”
BackgroundRichardson, D. C., & Dale, R. (2005) · Cognitive Science · doi:10.1207/s15516709cog0000_29 · Cited by 641
Gesture recognition with a Wii controller
Schlömer, T., Poppinga, B., Henze, N., & Boll, S. (2008) · Proceedings of the 2nd international conference on Tangible and embedded interaction · doi:10.1145/1347390.1347395 · Cited by 461
Actions Sketch: A Novel Action Representation
Yilmaz, A., & Shah, M. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.58 · Cited by 421
Empirically Building and Evaluating a Probabilistic Model of User Affect
Conati, C., & Maclaren, H. (2009) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-009-9062-8 · Cited by 328
Automatic detection of learner’s affect from conversational cues
D’Mello, S. K., Craig, S. D., Witherspoon, A., McDaniel, B., & Graesser, A. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9037-6 · Cited by 317
Attention guidance in learning from a complex animation: Seeing is understanding?
de Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.02.010 · Cited by 306
Web Usage Mining for a Better Web-Based Learning Environment
Zai͏̈ane, O. R. (2001) · PubMed · doi:10.7939/r3736m20p · Cited by 260
The new division of labor: how computers are creating the next job market
(2004) · Choice Reviews Online · doi:10.5860/choice.42-2306 · Cited by 200
Craig, S. D., D'Mello, S., Witherspoon, A., & Graesser, A. (2008) · Cognition & Emotion · doi:10.1080/02699930701516759 · Cited by 196
Spontaneous activity in education
Montessori, M. (1965) · Cited by 177
The construct of psychophysiological reactivity: Statistical and psychometric issues
Burt, K. B., & Obradović, J. (2013) · Developmental Review · doi:10.1016/j.dr.2012.10.002 · Cited by 173
Real-time mutual gaze perception enhances collaborative learning and collaboration quality
Schneider, B., & Pea, R. (2013) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-013-9181-4 · Cited by 173
Learning Engineering: Design, Languages, and Experiences*
Dym, C. L. (1999) · Journal of Engineering Education · doi:10.1002/j.2168-9830.1999.tb00425.x · Cited by 171
An Eye-Tracking Study of Learning From Science Text With Concrete and Abstract Illustrations
Mason, L., Pluchino, P., Tornatora, M. C., & Ariasi, N. (2013) · The Journal of Experimental Education · doi:10.1080/00220973.2012.727885 · Cited by 162
CogSketch: Sketch Understanding for Cognitive Science Research and for Education
Forbus, K. D., Usher, J., Lovett, A., Lockwood, K., & Wetzel, J. (2011) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2011.01149.x · Cited by 162
Pardos, Z. A., Baker, R. S. J. D., San Pedro, M. O. C. Z., Gowda, S. M., & Gowda, S. M. (2013) · Proceedings of the Third International Conference on Learning Analytics and Knowledge · doi:10.1145/2460296.2460320 · Cited by 159
Prospects and challenges for inquiry-based approaches to learning
Barron, B., & Darling‐Hammond, L. (2010) · Educational research and innovation · doi:10.1787/9789264086487-11-en · Cited by 133
The mathematical imagery trainer: from embodied interaction to conceptual learning
Howison, M., Trninić, D., Reinholz, D. L., & Abrahamson, D. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979230 · Cited by 120
The new division of labor how computers are creating the next job market
Levy, F. S., & Murnane, R. J. (2004) · Cited by 99
Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor
Hussain, M. S., AlZoubi, O., Calvo, R. A., & D’Mello, S. K. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21869-9_19 · Cited by 97
Luft, C. D. B., Nolte, G., & Bhattacharya, J. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.2565-12.2013 · Cited by 90
Russ, R. S., Lee, V. R., & Sherin, B. L. (2012) · Science Education · doi:10.1002/sce.21014 · Cited by 90
Sherin, B. L. (2013) · Journal of the Learning Sciences · doi:10.1080/10508406.2013.836654 · Cited by 79
The relative impact of student affect on performance models in a spoken dialogue tutoring system
Forbes-Riley, K., Rotaru, M., & Litman, D. J. (2007) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-007-9038-5 · Cited by 69
Towards the development of multimodal action based assessment
Worsley, M. B., & Blikstein, P. (2013) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2460296.2460315 · Cited by 68
Self-citationA Framework for Multi-Domain Sketch Recognition
Alvarado, C., Oltmans, M., & Davis, R. (2002) · Cited by 67
Multimodal human behavior analysis: learning correlation and interaction across modalities
Song, Y., Morency, L., & Davis, R. (2012) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2388676.2388684 · Cited by 61
Stevens, R. H., Galloway, T. L., & Berka, C. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73078-1_22 · Cited by 57
A study of the usability of handwriting recognition for text entry by children
Read, J. C. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2006.08.009 · Cited by 54
Cardiovascular physiology predicts learning effects in a serious game activity
Cowley, B. U., Ravaja, N., & Heikura, T. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.07.014 · Cited by 54
Collaborative Gaze Footprints: Correlates of Interaction Quality
Jermann, P., Mullins, D., Nüssli, M.-A., & Dillenbourg, P. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 53
Schneider, B., & Pea, R. D. (2014) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-014-9202-y · Cited by 49
Dynamically constructed Bayes nets for multi-domain sketch understanding
Alvarado, C., & Davis, R. (2007) · ACM SIGGRAPH Courses · doi:10.1145/1281500.1281544 · Cited by 44
Multimodal Learning Analytics as a Tool for Bridging Learning Theory and Complex Learning Behaviors
Worsley, M. B. (2014) · doi:10.1145/2666633.2666634 · Cited by 42
Self-citationScherer, S. J., Glodek, M., Layher, G., Schels, M., Schmidt, M., Brosch, T., Tschechne, S., Schwenker, F., Heiko Neumann, B., & Palm, G. (2012) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-012-0093-9 · Cited by 41
“Yes!”: Using Tutor and Sensor Data to Predict Moments of Delight during Instructional Activities
Müldner, K., Burleson, W., & VanLehn, K. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13470-8_16 · Cited by 39
Worsley, M. B., & Blikstein, P. (2011) · Educational Data Mining · Cited by 36
Self-citationUsing galvanic skin response measures to identify areas of frustration for older web 2.0 users
Lunn, D., & Harper, S. (2010) · International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1805986.1806032 · Cited by 31
Sleepers' lag - study on motion and attention
Raca, M., Tormey, R., & Dillenbourg, P. (2014) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2567574.2567581 · Cited by 30
3D Tangibles Facilitate Joint Visual Attention in Dyads
Schneider, B., Sharma, K., Cuendet, S., Zufferey, G., Dillenbourg, P., & Pea, R. D. (2015) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.22318/cscl2015.182 · Cited by 29
The Usability of Handwriting Recognition for Writing in the Primary Classroom
Read, J. C., MacFarlane, S., & Horton, M. (2007) · Springer eBooks · doi:10.1007/1-84628-062-1_9 · Cited by 25
Dynamically constructed Bayes nets for multi-domain sketch understanding
Alvarado, C., & Davis, R. (2006) · ACM SIGGRAPH Conference (SIGGRAPH) · doi:10.1145/1185657.1185793 · Cited by 25
Using learning analytics to study cognitive disequilibrium in a complex learning environment
Worsley, M. B., & Blikstein, P. (2015) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2723576.2723659 · Cited by 24
Self-citationAdapting handwriting recognition for applications in algebra learning
Anthony, L., Yang, J., & Koedinger, K. R. (2007) · ACM International Workshop on Educational Multimedia and Multimedia Education (EMME) · doi:10.1145/1290144.1290153 · Cited by 24
Drawing on Experience: Use of Sketching to Evaluate Knowledge of Spatial Scientific Concepts
Jee, B. D., Dedre Gentner, C., Forbus, K. D., Sageman, B. B., & Uttal, D. H. (2009) · eScholarship (California Digital Library) · Cited by 24
Gomes, J. S., Yassine, M., Worsley, M. B., & Blikstein, P. (2013) · Cited by 22
Self-citationWorsley, M. B., & Blikstein, P. (2014) · doi:10.1145/2666633.2666637 · Cited by 21
Self-citationEEG Dynamics Reflect the Distinct Cognitive Process of Optic Problem Solving
She, H., Jung, T., Chou, W.-C., Huang, L.-Y., Wang, C.-Y., & Lin, G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040731 · Cited by 20
Unraveling Students' Interaction Around a Tangible Interface Using Gesture Recognition.
Schneider, B., & Blikstein, P. (2014) · Cited by 13
Self-citationUsing Quantitative Information to Improve Analogical Matching Between Sketches
Chang, M., & Forbus, K. D. (2012) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v26i2.18968 · Cited by 11
Cited by
Utilising learning analytics to support study success in higher education: a systematic review
Ifenthaler, D., & Yau, J. Y.-K. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09788-z · Cited by 659
Spikol, D., Ruffaldi, E., Dabisias, G., & Cukurova, M. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12263 · Cited by 180
The promise and challenges of multimodal learning analytics
Cukurova, M., Giannakos, M., & Martinez‐Maldonado, R. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.13015 · Cited by 169
What multimodal data can tell us about the students’ regulation of their learning process?
Järvelä, S., Malmberg, J., Haataja, E., Sobocinski, M., & Kirschner, P. A. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.004 · Cited by 163
Lim, L.-A., Gentili, S., Pardo, A., Kovanović, V., Whitelock-Wainwright, A., Gašević, D., & Dawson, S. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.003 · Cited by 159
Metadata
- Authors
- Blikstein, P., & Worsley, M.
- Venue
- Journal of Learning Analytics
- Published
- 2016-09-17
- Volume
- 3
- Issue
- 2
- Pages
- 220-238
- ISSN
- 1929-7750 (ISSN-L)
- OpenAlex
- W2520384474
- Cited by
- 469
- References
- 59
- FWCI
- 41.56
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.