A multimodal real-time feedback platform based on spoken interactions for remote active learning support
Open accessAbstract
While technology has helped improve process efficiency in several domains, it still has an outstanding debt to education. In this article, we introduce NAIRA, a Multimodal Learning Analytics platform that provides Real-Time Feedback to foster collaborative learning activities' efficiency. NAIRA provides real-time visualizations for students' verbal interactions when working in groups, allowing teachers to perform precise interventions to ensure learning activities' correct execution. We present a case study with 24 undergraduate subjects performing a remote collaborative learning activity based on the Jigsaw learning technique within the COVID-19 pandemic context. The main goals of the study are (1) to qualitatively describe how the teacher used NAIRA's visualizations to perform interventions and (2) to identify quantitative differences in the number and time between students' spoken interactions among two different stages of the activity, one of them supported by NAIRA's visualizations. The case study showed that NAIRA allowed the teacher to monitor and facilitate the learning activity's supervised stage execution, even in a remote learning context, with students working in separate virtual classrooms with their video cameras off. The quantitative comparison of spoken interactions suggests the existence of differences in the distribution between the monitored and unmonitored stages of the activity, with a more homogeneous speaking time distribution in the NAIRA supported stage.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
LA-based feedback provides assistance with monitoring students learning activities and progress for educators.
“For educators, LAbased feedback provides assistance with monitoring students learning activities and progress (e.g. Cornide-Reyes et al., 2020)”
From A systematic review of the role of learning analytics in enhancing feedback practices in higher education (2022) · cites this paper as Cornide-Reyes et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Active learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787 · see citing works
Does Active Learning Work? A Review of the Research
Prince, M. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00809.x · Cited by 7,334 · see citing works
Overview of Problem-based Learning: Definitions and Distinctions
Savery, J. R. (2006) · Interdisciplinary Journal of Problem-based Learning · doi:10.7771/1541-5015.1002 · Cited by 2,686 · cited 1× · see citing works
“However, evaluating collaboration is a challenging problem [22,23].”
BackgroundRapanta, C., Botturi, L., Goodyear, P., Guàrdia, L., & Koole, M. (2020) · Postdigital Science and Education · doi:10.1007/s42438-020-00155-y · Cited by 2,130 · cited 1× · see citing works
“The remote academic activities have generated new challenges in the monitoring of the teaching-learning processes [19].”
BackgroundThe World’s Technological Capacity to Store, Communicate, and Compute Information
Hilbert, M., & López, P. (2011) · Science · doi:10.1126/science.1200970 · Cited by 1,643 · see citing works
Voogt, J., & Roblin, N. P. (2012) · Journal of Curriculum Studies · doi:10.1080/00220272.2012.668938 · Cited by 1,561 · see citing works
Collaborative learning and the “conversation of mankind”
Bruffee, K. A. (1984) · College English · doi:10.2307/376924 · Cited by 1,016 · see citing works
Analysis of User Satisfaction with Online Education Platforms in China during the COVID-19 Pandemic
Chen, T., Peng, L., Yin, X., Rong, J., Yang, J., & Cong, G. (2020) · Healthcare · doi:10.3390/healthcare8030200 · Cited by 541 · see citing works
Blikstein, P., & Worsley, M. B. (2016) · Journal of Learning Analytics · doi:10.18608/jla.2016.32.11 · Cited by 471 · see citing works
Häkkinen, P., Järvelä, S., Mäkitalo‐Siegl, K., Ahonen, A. K., Näykki, P., & Valtonen, T. (2016) · Teachers and Teaching · doi:10.1080/13540602.2016.1203772 · Cited by 406 · see citing works
Handbook of Learning Analytics
Lang, C. E., Siemens, G. E., Wise, A. E., & Gašević, D. (2017) · Society for Learning Analytics Research (SoLAR) eBooks · doi:10.18608/hla17 · Cited by 401 · see citing works
Elrehail, H., Emeagwali, O. L., Alsaad, A. K., & Alzghoul, A. (2017) · Telematics and Informatics · doi:10.1016/j.tele.2017.09.018 · Cited by 322 · see citing works
OVERVIEW OF PROBLEM-BASED LEARNING:
Savery, J. (2015) · Purdue University Press eBooks · doi:10.2307/j.ctt6wq6fh.6 · Cited by 293 · see citing works
Rock, M. L., Gregg, M., Thead, B. K., Acker, S. E., Gable, R. A., & Zigmond, N. P. (2009) · Teacher Education and Special Education The Journal of the Teacher Education Division of the Council for Exceptional Children · doi:10.1177/0888406408330872 · Cited by 192 · see citing works
Kivunja, C. (2014) · International Journal of Higher Education · doi:10.5430/ijhe.v3n4p37 · Cited by 163 · see citing works
Collaborative Learning and the “Conversation of Mankind”
Bruffee, K. A. (1984) · College English · doi:10.58680/ce198413335 · Cited by 155 · see citing works
Integrating Soft Skills Through Active Learning In The Management Classroom
Nealy, C. (2005) · Journal of College Teaching & Learning (TLC) · doi:10.19030/tlc.v2i4.1805 · Cited by 116 · see citing works
Picatoste, J., Pérez-Ortiz, L., & Ruesga-Benito, S. M. (2018) · Telematics and Informatics · doi:10.1016/j.tele.2017.09.014 · Cited by 98 · see citing works
Providing Real-time Feedback for Student Teachers in a Virtual Rehearsal Environment
Barmaki, R., & Hughes, C. E. (2015) · ACM International Conference on Multimodal Interaction (ICMI) · doi:10.1145/2818346.2830604 · Cited by 76 · see citing works
Chandrasegaran, S. K., Bryan, C., Shidara, H., Chuang, T.-Y., & Ma, K. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300807 · Cited by 63 · see citing works
Using multimodal learning analytics to study collaboration on discussion groups
Riquelme, F., Muñoz, R., Lean, R. M., Villarroel, R. H., Barcelos, T., & de Albuquerque, V. H. C. (2019) · Universal Access in the Information Society · doi:10.1007/s10209-019-00683-w · Cited by 52 · see citing works
Self-citationVrzáková, H., Amon, M. J., Stewart, A., Duran, N. D., & D’Mello, S. K. (2020) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3375462.3375467 · Cited by 49 · see citing works
Cooperation through social influence
Molinero, X., Riquelme, F., & Serna, M. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.11.006 · Cited by 44 · see citing works
Self-citationThe Teacher Effectiveness Movement
Imig, D. G., & Imig, S. R. (2006) · Journal of Teacher Education · doi:10.1177/0022487105285672 · Cited by 44 · see citing works
Noël, R., Riquelme, F., Lean, R. M., Merino, E., Cechinel, C., Barcelos, T., Villarroel, R. H., & Muñoz, R. (2018) · IEEE Access · doi:10.1109/access.2018.2876801 · Cited by 43 · see citing works
Self-citationSharma, K., Leftheriotis, I., & Giannakos, M. N. (2020) · Sensors · doi:10.3390/s20071964 · Cited by 36 · see citing works
Cornide-Reyes, H., Noël, R., Riquelme, F., Gajardo, M., Cechinel, C., Lean, R. M., Becerra, C., Villarroel, R. H., & Muñoz, R. (2019) · Sensors · doi:10.3390/s19153291 · Cited by 34 · see citing works
Self-citationde Souza, A. A., Merino, E., da Silva, L. H. G., Muñoz, R., Guiñez, R., Villarroel, R., & Barcelos, T. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.3217/jucs-024-02-0149 · Cited by 21 · see citing works
Self-citationWhere are You? Exploring Micro-Location in Indoor Learning Environments
Riquelme, F., Noël, R., Cornide-Reyes, H., Geldes, G., Cechinel, C., Miranda, D., Villarroel, R. H., & Muñoz, R. (2020) · IEEE Access · doi:10.1109/access.2020.3008327 · Cited by 21 · see citing works
Self-citationMacNeil (2019) · doi:10.1145/3300115.3309528 · Cited by 15 · see citing works
Motion Capture as an Instrument in Multimodal Collaborative Learning Analytics
Vujović, M., Tassani, S., & Hernández‐Leo, D. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29736-7_49 · Cited by 11 · see citing works
Group Coach for Co-located Collaboration
Praharaj, S., Scheffel, M., Drachsler, H., & Specht, M. M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29736-7_77 · Cited by 9 · see citing works
Evaluation of Online Teaching Platforms Based on AHP in the Context of COVID-19
Cao, C., Li, J., Zhu, Y., Gong, Y., & Gao, M. (2020) · Open Journal of Social Sciences · doi:10.4236/jss.2020.87029 · Cited by 5 · see citing works
The Evidence for the Effectiveness of Active Learning
Jain, A. (2014) · Oriental journal of computer science and technology · Cited by 3 · see citing works
Flagged first, then by citations
2 of the 36 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [31]Chandrasegaran S. Bryan C. Shidara H. Chuang T.Y. Ma K.L. TalkTraces: Real-time capture and visualization of verbal content in meetings Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems Scotland, UK 4–9 May 2019 1 14
Cited by
Sorted by citations
Banihashem, S. K., Noroozi, O., van Ginkel, S., Macfadyen, L. P., & Biemans, H. J. A. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100489 · Cited by 246 · see citing works
Learning analytics for online game-Based learning: a systematic literature review
Banihashem, S. K., Dehghanzadeh, H., Clark, D. B., Noroozi, O., & Biemans, H. J. A. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2255301 · Cited by 92 · see citing works
Alwahaby, H., Cukurova, M., Papamitsiou, Z. K., & Giannakos, M. N. (2022) · Springer eBooks · doi:10.1007/978-3-031-08076-0_12 · Cited by 67 · see citing works
Investigating Students’ Experiences with Collaboration Analytics for Remote Group Meetings
Zhou, Q., Suraworachet, W., Pozdniakov, S., Martínez‐Maldonado, R., Bartindale, T., Chen, P., Richardson, D., & Cukurova, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78292-4_38 · Cited by 32 · see citing works
Towards Providing Effective Data-Driven Responses to Predict the Covid-19 in São Paulo and Brazil
Amaral, F., Casaca, W. C. D. O., Oishi, C. M., & Cuminato, J. A. (2021) · Sensors · doi:10.3390/s21020540 · Cited by 30 · see citing works
A Review of Multimodal Interaction in Remote Education: Technologies, Applications, and Challenges
Xie, Y., Yang, L., Zhang, M., Chen, S., & Li, J. (2025) · Applied Sciences · doi:10.3390/app15073937 · Cited by 29 · see citing works
IoT-based Multimodal Analysis for Smart Education: Current Status, Challenges and Opportunities
Gan, W., Dao, M.-S., Zettsu, K., & Sun, Y. (2022) · ACM Workshop on Intelligent Cross-Data Analysis and Retrieval (ICDAR) · doi:10.1145/3512731.3534208 · Cited by 27 · see citing works
Yürüm, O. R. (2025) · IEEE Access · doi:10.1109/access.2025.3572467 · Cited by 16 · see citing works
Alwahaby, H., Cukurova, M., Papamitsiou, Z., & Giannakos, M. (2021) · doi:10.35542/osf.io/sd23y · Cited by 15 · see citing works
Iyamuremye, A., Twagilimana, I., & Niyonzima, F. N. (2025) · Discover Education · doi:10.1007/s44217-025-00548-w · Cited by 14 · see citing works
Privacy-Driven Learning Analytics
Joksimovíc, S., Marshall, R., Rakotoarivelo, T., Ladjal, D., Zhan, C., & Pardo, A. (2021) · Smart innovation, systems and technologies · doi:10.1007/978-3-030-86316-6_1 · Cited by 14 · see citing works
A systematic review of multimodal learning analytics in computer-supported collaborative learning
Ouyang, F., & Bai, X. (2026) · Computers & Education · doi:10.1016/j.compedu.2026.105574 · Cited by 13 · see citing works
Ngoon, T. J., Kovalev, D., Patidar, P., Harrison, C., Agarwal, Y., Zimmerman, J., & Ogan, A. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596079 · Cited by 13 · see citing works
Relationships Between Social Interactions and Belbin Role Types in Collaborative Agile Teams
Monsalves, D., Cornide-Reyes, H., & Riquelme, F. (2023) · IEEE Access · doi:10.1109/access.2023.3245325 · Cited by 13 · see citing works
Self-citationZheng, L., Shi, Z., Fu, Z., & Liu, S. (2025) · Journal of Science Education and Technology · doi:10.1007/s10956-025-10204-5 · Cited by 11 · see citing works
Suraworachet, W., Zhou, Q., & Cukurova, M. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70103 · Cited by 8 · see citing works
Enhancing ESL learners’ narrative writing proficiency: The role of multimodal online feedback
Eak, A. D., & Annamalai, N. (2025) · Language Teaching Research · doi:10.1177/13621688251374430 · Cited by 5 · see citing works
Supporting Online Collaborative Work at Scale: A Mixed-Methods Study of a Learning Analytics Tool
Ochôa, X., Echeverría, V., Carrillo, G., Heredia-Jiménez, V., & Chiluiza, K. (2023) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/3573051.3596165 · Cited by 4 · see citing works
A real-time speech interaction analytics framework for group activities using SNA and LLM techniques
Monsalves, D., Riquelme, F., & Cornide-Reyes, H. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128948 · Cited by 3 · see citing works
Self-citationGuiding Multiple Remote Users in Physical Tasks with Language-driven Robotic Telepresence
Li, R., Guo, J., Zhang, X., Zhang, X., Li, Z., Li, J., & Gong, J. (2025) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3749472 · Cited by 3 · see citing works
Игоревич, К. А., & Bogdanova, A. V. (2025) · Высшее образование в России · doi:10.31992/0869-3617-2025-34-11-81-107 · Cited by 3 · see citing works
Feng, L., & Ji, Y. (2024) · Scalable Computing Practice and Experience · doi:10.12694/scpe.v25i5.3026 · Cited by 3 · see citing works
Analysis of Collaborative Work through Conversational Patterns
Torres-Rodríguez, S. N., Ruiz-Ramírez, J. A., & Morán-Mirabal, L. F. (2024) · Complexity in Engineering (COMPENG) · doi:10.1109/compeng60905.2024.10741512 · Cited by 3 · see citing works
A Review of Anatomy Education: From Traditional Teaching to Smart Education
Li, J., & Tang, H. (2025) · Open Journal of Social Sciences · doi:10.4236/jss.2025.139012 · Cited by 2 · see citing works
Testing individual and group markers of collaboration in a team-based learning classroom
Chua, Y. H. V., Dauwels, J., Rajalingam, P., Teo, C. L., & Styles, S. J. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102215 · Cited by 2 · see citing works
Enhancing Education through Multimodal Learning Analytics and AI-as-a-Service
Monsalves, D., Riquelme, F., & Cornide-Reyes, H. (2023) · IEEE CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON) · doi:10.1109/chilecon60335.2023.10418760 · Cited by 2 · see citing works
Self-citationAnalítica multimodal del aprendizaje en Chile: Una revisión sistemática
Monsalves, D., Cornide-Reyes, H., & Riquelme, F. (2023) · Apuntes de Ciencia & Sociedad · doi:10.18259/acs.2023008 · Cited by 2 · see citing works
Self-citationCornide-Reyes, H., Muñoz, G., Monsalves, D., & Riquelme, F. (2023) · IEEE CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON) · doi:10.1109/chilecon60335.2023.10418720 · Cited by 2 · see citing works
Self-citationSuryandari, S., & Yuanta, F. (2023) · Education and Human Development Journal · doi:10.33086/ehdj.v8i2.5290 · Cited by 2 · see citing works
An Investigation into the Application of Learning Analytics in Collaborative Learning
Wong, B. T. M., Li, K. C., & Liu, M. (2024) · Communications in computer and information science · doi:10.1007/978-981-96-0205-6_16 · Cited by 1 · see citing works
Panorama da percepção dos acadêmicos frente a ensino-aprendizagem no contexto da pandemia
Silva, M. C. D. A., da Silva, J. F. G., Athie, G. R., Campos, E. L., & Perez, A. P. D. S. (2021) · Itinerarius Reflectionis · doi:10.5216/rir.v17i3.70358 · Cited by 1 · see citing works
Uso de técnicas de aprendizaje colaborativo en el contexto de pandemia COVID – 19
Farfán, C. A. E., Cárdenas, M. C. G., & Ticlla, E. R. (2021) · Revista Iberoamericana de la Educación · doi:10.31876/ie.vi.123 · Cited by 1 · see citing works
MultiCoCoA: Multimodal data collector from collocated collaborative activities
Miranda, D., Godoy, J., Noël, R., Cechinel, C., & Muñoz, R. (2025) · SoftwareX · doi:10.1016/j.softx.2025.102202 · Cited by 1 · see citing works
Self-citationPrácticas evaluativas de profesores de matemáticas durante la pandemia
Gaona, J., & Donoso, M. M. P. (2023) · Revista Chilena de Educación Matemática · doi:10.46219/rechiem.v15i1.123
Cioci, G. (2023) · EDUCATION SCIENCES AND SOCIETY · doi:10.3280/ess1-2023oa15278
Virtual Education as an Enabler of Autonomous Learning
Magallanes, M. C. R. (2023) · American Journal of Education and Information Technology · doi:10.11648/j.ajeit.20230702.14
Classroom Orchestration in CSCL: Exploring Functions and Visualizations of Teacher Dashboards
Kim, D., Lee, D., & Lim, K. Y. (2024) · The Journal of Korean Association of Computer Education · doi:10.32431/kace.2024.27.7.007
Auliannisa, I. A., Arni, F., Aruji, S. M., Handayani, W., Apriani, W., Ghufron, R., Ainiyah, N., & Rosy, B. (2025) · Jurnal Penelitian Pendidikan dan Pengajaran JPPP · doi:10.30596/jppp.v6i1.23948
Cognitive Engagement Analysis in CSCL: Exploring Educational Potential of Generative AI
Jin, M., Park, E. J., & Lim, K. Y. (2025) · The Journal of Korean Association of Computer Education · doi:10.32431/kace.2025.28.4.004
A systematic literature review on the definition and core components of learning analytics systems
Mun, S., & Jo, I. (2025) · The Journal of Korean Association of Computer Education · doi:10.32431/kace.2025.28.7.001
Algoritmos de aprendizaje profundo para el análisis de interacciones de habla
Cornide-Reyes, H., Pallauta, J. L. J., & Monsalves, D. (2026) · Ingeniare. Revista chilena de ingeniería · doi:10.64966/ingeniare.v33.32
Self-citationRafiq, A., Melnik, E. A., Samoylov, A., Kozlovskiy, A., & Борисовна, С. И. (2026) · Big Data and Cognitive Computing · doi:10.3390/bdcc10040123
Wardani, T. K., Jamaludin, G. M., & Syamsul, E. M. (2026) · Reslaj Religion Education Social Laa Roiba Journal · doi:10.47467/reslaj.v8i7.12219
- Authors
- Cornide-Reyes, H., Riquelme, F., Monsalves, D., Noel, R., Cechinel, C., Villarroel, R., Ponce, F., & Munoz, R.
- Affiliations
- Departamento de Ingeniería Informática y Ciencias de la Computación, Universidad de Atacama, Copiapó 1534146, Chile
- University of Valparaíso (CL)
- Escuela de Ingeniería Informática, Universidad de Valparaíso, Valparaíso 2362905, Chile
- Universidade Federal de Santa Catarina (BR)
- Pontificia Universidad Católica de Valparaíso (CL)
- ORCID
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-11-06
- Volume
- 20
- Issue
- 21
- Pages
- 6337
- ISSN
- 1424-8220 (ISSN-L)
- PMC
- PMC7664242
- OpenAlex
- W3097268482
- Cited by
- 40
- References
- 36
- Citations by year
- 2026: 2 · 2025: 14 · 2024: 4 · 2023: 11 · 2022: 3 · 2021: 6
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Sensors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Universidad de Atacama (DIUDA-Regular 22386)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- multimodal learning analytics, real-time feedback, online collaborative learning, Jigsaw cooperative learning, teacher intervention, COVID-19 remote learning
- MeSH terms
- Betacoronavirus, COVID-19, SARS-CoV-2, Feedback, Humans, Learning, Pneumonia, Viral, Students, Coronavirus Infections, Education, Distance, Pandemics, Social Networking, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
