Artificial intelligence based cognitive state prediction in an e-learning environment using multimodal data
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ALPs have been found to increase student engagement through personalized challenges and feedback based on the learner's real-time performance, keeping them motivated and on track.
“ALPs have been found to increase student engagement through personalized challenges and feedback based on the learner's real-time performance, keeping them motivated and on track [116,117].”
From Leveraging AI in E-Learning: Personalized Learning and Adaptive Assessment through Cognitive Neuropsychology—A Systematic Analysis (2024) · cites this paper as [117]
Cites
A Literature Review on Impact of COVID-19 Pandemic on Teaching and Learning
Pokhrel, S., & Chhetri, R. (2021) · Higher Education for the Future · doi:10.1177/2347631120983481 · Cited by 2,400 · see citing works
Ardakani, A. A., Kanafi, A. R., Acharya, U. R., Khadem, N., & Mohammadi, A. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103795 · Cited by 848 · see citing works
The Faces of Engagement: Automatic Recognition of Student Engagementfrom Facial Expressions
Whitehill, J., Serpell, Z. N., Lin, Y.-C., Foster, A., & Movellan, J. R. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2316163 · Cited by 694 · see citing works
ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors
Subramanian, R., Wache, J., Abadi, M. K., Vieriu, R. L., WINKLER, S. S., & Sebe, N. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2625250 · Cited by 536 · see citing works
Simamora, R. M. (2020) · Studies in Learning and Teaching · doi:10.46627/silet.v1i2.38 · Cited by 424 · see citing works
Facial Landmark Detection: A Literature Survey
Wu, Y., & Ji, Q. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1097-z · Cited by 421 · see citing works
Multimodal sentiment analysis using hierarchical fusion with context modeling
Majumder, N., Hazarika, D., Gelbukh, A. F., Cambria, E., & Poria, S. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.07.041 · Cited by 385 · see citing works
Advanced, Analytic, Automated (AAA) Measurement of Engagement During Learning
D’Mello, S. K., Dieterle, E., & Duckworth, A. L. (2017) · Educational Psychologist · doi:10.1080/00461520.2017.1281747 · Cited by 378 · see citing works
Gaze tutor: A gaze-reactive intelligent tutoring system
D'Mello, S. K., Olney, A., Williams, C., & Hays, P. (2012) · Int. J. Hum. Comput. Stud. · doi:10.1016/j.ijhcs.2012.01.004 · Cited by 365 · see citing works
D’Mello, S. K. (2013) · Journal of Educational Psychology · doi:10.1037/a0032674 · Cited by 305 · see citing works
Pay attention!: designing adaptive agents that monitor and improve user engagement
Szafir, D., & Mutlu, B. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207679 · Cited by 304 · see citing works
Audio-Visual Emotion Recognition in Video Clips
Noroozi, F., Marjanovic, M., Njeguš, A., Escalera, S., & Anbarjafari, G. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2713783 · Cited by 269 · see citing works
Towards an intelligent framework for multimodal affective data analysis
Poria, S., Cambria, E., Hussain, A., & Huang, G.-B. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.10.005 · Cited by 236 · see citing works
Gupta, S., Kumar, P., & Tekchandani, R. K. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13558-9 · Cited by 232 · see citing works
Self-citationZhang, X., Liu, J., Shen, J. G., Li, S., Hou, K., Hu, B., Gao, J. G., Zhang, T., & Hu, B. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2987575 · Cited by 209 · see citing works
EmotiCon: Context-Aware Multimodal Emotion Recognition Using Frege’s Principle
Mittal, T., Guhan, P., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01424 · Cited by 187 · see citing works
Automatic Detection of Learning-Centered Affective States in the Wild
Bosch, N., D'Mello, S., Baker, R., Ocumpaugh, J., Shute, V., Ventura, M., Wang, L., & Zhao, W. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701397 · Cited by 178 · see citing works
Jalal, A., & Mahmood, M. (2019) · Education and Information Technologies · doi:10.1007/s10639-019-09892-5 · Cited by 172 · see citing works
Krithika, L. B., & Priya, G. G. L. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.05.264 · Cited by 166 · see citing works
Audio-visual emotion fusion (AVEF): A deep efficient weighted approach
Ma, Y., Hao, Y., Chen, M., Chen, J., Lu, P., & Košir, A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.003 · Cited by 155 · see citing works
E-Learning: Challenges and Research Opportunities Using Machine Learning & Data Analytics
Moubayed, A., Injadat, M., Nassif, A. B., Lutfiyya, H. L., & Shami, A. A. (2018) · IEEE Access · doi:10.1109/access.2018.2851790 · Cited by 154 · see citing works
Automatic Recognition of Student Engagement Using Deep Learning and Facial Expression
Nezami, O. M., Dras, M., Hamey, L., Richards, D., Wan, S., & Paris, C. L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46133-1_17 · Cited by 138 · see citing works
Towards multimodal emotion recognition in e-learning environments
Bahreini, K., Nadolski, R., & Westera, W. (2016) · Interactive Learning Environments · doi:10.1080/10494820.2014.908927 · Cited by 137 · see citing works
Frey, J., Grabli, M., Slyper, R., & Cauchard, J. R. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174219 · Cited by 135 · see citing works
Νικολοπούλου, Κ. (2020) · Journal of Computers in Education · doi:10.1007/s40692-020-00156-7 · Cited by 135 · see citing works
Iwendi, C., Khan, S. A., Anajemba, J. H., et al. (2020) · Sensors · doi:10.3390/s20092559 · Cited by 130 · see citing works
Acı, Ç. İ., Kaya, M., & Mishchenko, Y. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.05.057 · Cited by 127 · see citing works
Mental effort detection using EEG data in E-learning contexts
Lin, F., & Kao, C.-M. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.03.020 · Cited by 122 · see citing works
Mittal, M., Iwendi, C., Khan, S. A., & Javed, A. R. (2020) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.3997 · Cited by 120 · see citing works
Predicting student engagement in classrooms using facial behavioral cues
Thomas, C., & Jayagopi, D. B. (2017) · doi:10.1145/3139513.3139514 · Cited by 111 · see citing works
Javed, A. R., Sarwar, M. U., Khan, S. A., Iwendi, C., Mittal, M., & Kumar, N. (2020) · Sensors · doi:10.3390/s20082216 · Cited by 110 · see citing works
Multi-cue fusion for emotion recognition in the wild
Yan, J., Zheng, W., Cui, Z., Tang, C., Zhang, T., & Zong, Y. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.03.068 · Cited by 98 · see citing works
The role of usability on e-learning user interactions and satisfaction: a literature review
Gunesekera, A., Bao, Y., & Kibelloh, M. (2019) · Journal of Systems and Information Technology · doi:10.1108/jsit-02-2019-0024 · Cited by 96 · see citing works
Augmented Reality Experience: Initial Perceptions of Higher Education Students
Süral, İ. (2018) · International Journal of Instruction · doi:10.12973/iji.2018.11435a · Cited by 93 · see citing works
Mai, S., Xing, S., & Hu, H. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2925966 · Cited by 89 · see citing works
Multimodal Deep Learning Framework for Mental Disorder Recognition
Zhang, Z., Lin, W., Liu, M., & Mahmoud, M. (2020) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg47880.2020.00033 · Cited by 89 · see citing works
Dhanamjayulu, C., Nizhal, U. N., Maddikunta, P. K. R., Gadekallu, T. R., Iwendi, C., Wei, C., & Xin, Q. (2021) · IET Image Processing · doi:10.1049/ipr2.12222 · Cited by 88 · see citing works
Behera, A., Matthew, P. W., Keidel, A., Vangorp, P., Fang, H., & Canning, S. (2020) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-020-00195-2 · Cited by 85 · see citing works
A Survey of Computational Methods for Online Mental State Assessment on Social Media
Ríssola, E. A., Losada, D. E., & Crestani, F. (2021) · ACM Transactions on Computing for Healthcare · doi:10.1145/3437259 · Cited by 84 · see citing works
N-Sanitization: A semantic privacy-preserving framework for unstructured medical datasets
Iwendi, C., Moqurrab, S. A., Anjum, A., Khan, S., Mohan, S., & Srivastava, G. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.07.032 · Cited by 80 · see citing works
Facial Expression Recognition With Two-Branch Disentangled Generative Adversarial Network
Xie, S., Hu, H., & Chen, Y. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3024201 · Cited by 76 · see citing works
Mittal, M., de Prado, R. P., Kawai, Y., et al. (2021) · Energies · doi:10.3390/en14113125 · Cited by 72 · see citing works
Understanding Attention to Adaptive Hints in Educational Games: An Eye-Tracking Study
Conati, C., Jaques, N., & Muir, M. (2013) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-013-0002-8 · Cited by 68 · see citing works
Deep Convolutional Neural Network for Facial Expression Recognition Using Facial Parts
Nwosu, L., Wang, H., Lu, J., et al. (2017) · IEEE International Conference on Dependable, Autonomic and Secure Computing, International Conference on Pervasive Intelligence and Computing, International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech) · doi:10.1109/dasc-picom-datacom-cyberscitec.2017.213 · Cited by 68 · see citing works
Nuamah, J. K., & Seong, Y. (2017) · Brain-Computer Interfaces · doi:10.1080/2326263x.2017.1338012 · Cited by 65 · see citing works
EmoBed: Strengthening Monomodal Emotion Recognition via Training with Crossmodal Emotion Embeddings
Han, J., Zhang, Z., Ren, Z. X., & Schuller, B. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2928297 · Cited by 64 · see citing works
Face Detection Based on Viola-Jones Algorithm Applying Composite Features
Wen-yao, L. U., & Yang, M. (2019) · International Conference on Robots & Intelligent System · doi:10.1109/icris.2019.00029 · Cited by 63 · see citing works
Iwendi, C., Huescas, C. G. Y., Chakraborty, C., & Mohan, S. (2022) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2022.2058097 · Cited by 58 · see citing works
Online Learners’ Reading Ability Detection Based on Eye-Tracking Sensors
Zhan, Z., Zhang, L., Hu, M. Y., & Fong, P. S. W. (2016) · Sensors · doi:10.3390/s16091457 · Cited by 53 · see citing works
DeepCU: Integrating both Common and Unique Latent Information for Multimodal Sentiment Analysis
Verma, S., Wang, C., Zhu, L., & Liu, W. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/503 · Cited by 53 · see citing works
Peng, C.-J., Chen, Y., Chen, C., Chen, S.-J., Cagneau, B., & Chassagne, L. (2019) · Journal of Medical and Biological Engineering · doi:10.1007/s40846-019-00500-y · Cited by 52 · see citing works
Mobile devices in early childhood education: teachers’ views on benefits and barriers
Νικολοπούλου, Κ. (2021) · Education and Information Technologies · doi:10.1007/s10639-020-10400-3 · Cited by 50 · see citing works
Chauhan, S., Mittal, M., Woźniak, M., Gupta, S., & de Prado, R. P. (2021) · Symmetry · doi:10.3390/sym13081545 · Cited by 47 · see citing works
Self-citationToward active and unobtrusive engagement assessment of distance learners
Booth, B. M., Ali, A., Narayanan, S. S., Bennett, I., & Farag, A. A. (2017) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2017.8273641 · Cited by 45 · see citing works
A Neuro-Fuzzy Approach for Intrusion Detection in Energy Efficient Sensor Routing
Mittal, M., Saraswat, L. K., Iwendi, C., et al. (2019) · International Conference on Internet of Things: Smart Innovation and Usages (IoT-SIU) · doi:10.1109/iot-siu.2019.8777501 · Cited by 42 · see citing works
Detection of Human Attention Using EEG Signals
Alirezaei, M., & Sardouie, S. H. (2017) · National and International Iranian Conference on Biomedical Engineering (ICBME) · doi:10.1109/icbme.2017.8430244 · Cited by 39 · see citing works
EEG-based recognition of attention state using wavelet and support vector machine
Djamal, E. C., Pangestu, D. P., & Dewi, D. A. (2016) · International Seminar on Intelligent Technology and Its Applications · doi:10.1109/isitia.2016.7828648 · Cited by 38 · see citing works
Learning Representations for Facial Actions From Unlabeled Videos
Li, Y., Zeng, J., & Shan, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3011063 · Cited by 38 · see citing works
Boucsein, W., Haarmann, A., & Schaefer, F. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-73331-7_70 · Cited by 36 · see citing works
Exploring the Predictive Role of E-Learning Readiness and E-Learning Style on Student Engagement
Ergün, E., & Kurnaz, F. B. (2019) · Open Praxis · doi:10.5944/openpraxis.12.2.1072 · Cited by 35 · see citing works
Gauging attention of students in an e-learning environment
Revadekar, A., Oak, S., Gadekar, A., & Bide, P. J. (2020) · IEEE Conference on Information and Communication Technology (CICT) · doi:10.1109/cict51604.2020.9312048 · Cited by 35 · see citing works
A Correction Model for Real-word Errors
Sharma, S., & Gupta, S. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.10.047 · Cited by 34 · see citing works
Self-citationImproved Advance Encryption Standard with a Privacy Database Structure for IoT Nodes
Anajemba, J. H., Iwendi, C., Mittal, M., et al. (2020) · IEEE International Conference on Communication Systems and Network Technologies (CSNT) · doi:10.1109/csnt48778.2020.9115741 · Cited by 34 · see citing works
Network Lifetime Enhancement of Homogeneous Sensor Network Using ART1 Neural Network
Mittal, M., & Kumar, K. (2014) · International Conference on Computational Intelligence and Communication Networks (CICN) · doi:10.1109/cicn.2014.110 · Cited by 31 · see citing works
Multimodal Framework for Analyzing the Affect of a Group of People
Huang, X., Dhall, A., Goecke, R., Pietikäinen, M., & Zhao, G. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818015 · Cited by 31 · see citing works
Attention monitoring for synchronous distance learning
Abate, A. F., Cascone, L., Nappi, M., Narducci, F., & Passero, I. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.07.026 · Cited by 30 · see citing works
A dynamic multimodal approach for assessing learners' interaction experience
Jraidi, I., Chaouachi, M., & Frasson, C. (2013) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2522848.2522896 · Cited by 29 · see citing works
Teaching automation with Factory I/O under a competency-based curriculum
Vargas, H., Heradio, R., Donoso, M., et al. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-14047-9 · Cited by 29 · see citing works
Mittal, M., Kobielnik, M., Gupta, S., et al. (2022) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-022-00344-z · Cited by 26 · see citing works
Self-citationAttention Recognition System in Online Learning Platform Using EEG Signals
Gupta, S., & Kumar, P. (2021) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-1550-4_15 · Cited by 25 · see citing works
Self-citationLiu, Y., Chen, J., Zhang, M., & Rao, C. (2018) · Multimedia Tools and Applications · doi:10.1007/s11042-018-6017-2 · Cited by 24 · see citing works
M3ER: Multiplicative Multimodal Emotion Recognition using Facial, Textual, and Speech Cues
Mittal, T., Bhattacharya, U., Chandra, R., Bera, A., & Manocha, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i02.5492 · Cited by 23 · see citing works
Joint low rank embedded multiple features learning for audio–visual emotion recognition
Wang, Z., Wang, L., & Huang, H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.017 · Cited by 23 · see citing works
Combining Facial Expression and Touch for Perceiving Emotional Valence
Tsalamlal, M. Y., Amorim, M., Martin, J., & Ammi, M. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2631469 · Cited by 20 · see citing works
Copula Ordinal Regression Framework for Joint Estimation of Facial Action Unit Intensity
Walecki, R., Rudovic, O. O., Pavlović, V., & Pantić, M. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2728534 · Cited by 18 · see citing works
Facial Features Detection and Localization
Hassaballah, M., Bekhet, S., Rashed, A., et al. (2018) · Studies in computational intelligence · doi:10.1007/978-3-030-03000-1_2 · Cited by 17 · see citing works
Smart Learning System Based on EEG Signals
Sharma, A. S., Gupta, S., Kaur, S., & Kumar, P. (2019) · Communications in computer and information science · doi:10.1007/978-981-13-9942-8_44 · Cited by 13 · see citing works
Self-citationSuhail, T. A., Indiradevi, K. P., Suhara, E. M., Suresh, P. A., & Anitha, A. (2021) · Cognitie, Creier, Comportament · doi:10.24193/cbb.2021.25.08 · Cited by 13 · see citing works
Type-2 fuzzy ontology-based multi-agents system for wireless sensor network
Mittal, M., Srinivasan, S., Rani, M., et al. (2017) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon.2017.8228350 · Cited by 12 · see citing works
Gupta, S., & Gouttam, D. (2017) · doi:10.1109/icstm.2017.8089120 · Cited by 11 · see citing works
Self-citationAudio-Visual Emotion Forecasting: Characterizing and Predicting Future Emotion Using Deep Learning
Shahriar, S., & Kim, Y. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756599 · Cited by 10 · see citing works
Cross-modality interaction between EEG signals and facial expression
Rayatdoost, S. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3137034 · Cited by 5 · see citing works
Siriaraya, P., Kiriu, T., She, W. J., et al. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4066272 · Cited by 3 · see citing works
Krishnan, R., Jeba, S., James, M., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-2207225/v1 · Cited by 3 · see citing works
Experimental Study on Deep Learning Oriented to Learning Engagement Recognition
Cao, X., Zhang, Y., Pan, M., et al. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-02116-0_33 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Halkiopoulos, C., & Gkintoni, E. (2024) · Electronics · doi:10.3390/electronics13183762 · Cited by 328 · see citing works
“ALPs have been found to increase student engagement through personalized challenges and feedback based on the learner’s real-time performance, keeping them motivated and on track [116,117].”
- Authors
- Gupta, S., Kumar, P., & Tekchandani, R.
- Affiliations
- Thapar Institute of Engineering & Technology (IN)
- Whitman College (US)
- Corresponding author
- Gupta, Swadha
- Venue
- Multimedia Tools and Applications
- Published
- 2024-01-16
- Volume
- 83
- Issue
- 24
- Pages
- 64467-64498
- ISSN
- 1380-7501 (ISSN-L)
- 1573-7721
- OpenAlex
- W4390915216
- Semantic Scholar
- 33f56f8fc524407261b3dc2342d900f1be6a101d
- Cited by
- 14
- References
- 85
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 2
- FWCI
- 5.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Multimedia Tools and Applications (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- cognitive state prediction, online learning, student attention, multimodal fusion, facial expression recognition, eye blink detection, head movement detection, EEG, NeuroSky headset, instructor feedback, COVID-19 remote learning, student engagement monitoring
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review