Video-based emotion recognition in the wild using deep transfer learning and score fusion
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589 · see citing works
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584 · see citing works
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398 · see citing works
Least Squares Support Vector Machine Classifiers
Suykens, J., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,481 · see citing works
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,564 · see citing works
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479 · see citing works
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303 · see citing works
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335 · see citing works
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846 · see citing works
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797 · see citing works
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642 · see citing works
Generalized Inverse of Matrices and Its Applications
Banerjee, K. S. (1973) · Technometrics · doi:10.1080/00401706.1973.10489026 · Cited by 2,291 · see citing works
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,167 · see citing works
2007 IEEE Conference on Computer Vision and Pattern Recognition
(2007) · doi:10.1109/cvpr12085.2007 · Cited by 1,726 · see citing works
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719 · see citing works
Fisher Kernels on Visual Vocabularies for Image Categorization
Perronnin, F., & Dance, C. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383266 · Cited by 1,641 · see citing works
Wold, H. (2005) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1914.pub2 · Cited by 1,535 · see citing works
Encyclopedia of Statistical Sciences 2.
Dawid, A. P., Kotz, S., Johnson, N. L., & Read, C. B. (1984) · Biometrics · doi:10.2307/2530789 · Cited by 1,494 · see citing works
Generalized Inverse of Matrices and its Applications
Mayne, A. J. (1972) · Journal of the Operational Research Society · doi:10.1057/jors.1972.96 · Cited by 1,213 · see citing works
Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771 · see citing works
DEX: Deep EXpectation of Apparent Age from a Single Image
Rothe, R., Timofte, R., & Gool, L. V. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.41 · Cited by 711 · see citing works
Challenges in representation learning: A report on three machine learning contests
Goodfellow, I. J., Erhan, D., Luc Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.005 · Cited by 697 · see citing works
Return of the Devil in the Details: Delving Deep into Convolutional NetsPreprint
Chatfield, K., Simonyan, K., Vedaldi, A., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.3531 · Cited by 663 · see citing works
Collecting Large, Richly Annotated Facial-Expression Databases from Movies
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.26 · Cited by 658 · see citing works
Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning
Ng, H.-W., Nguyen, V. D., Vonikakis, V., & Winkler, S. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830593 · Cited by 657 · cited 3× · see citing works
“In [36] the authors exploited pre-trained models based on the ImageNet dataset, followed by two stages of fine-tuning, on FER 2013 and Static Facial Expression Sub-Challenge (SFEW) Dataset from the EmotiW 2015 Challenge, respectively [8].”
MethodImage based Static Facial Expression Recognition with Multiple Deep Network Learning
Yu, Z., & Zhang, C. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830595 · Cited by 602 · see citing works
Valstar, M., Schuller, B. W., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., & Pantić, M. (2013) · doi:10.1145/2512530.2512533 · Cited by 581 · see citing works
The INTERSPEECH 2010 paralinguistic challenge
Schuller, B. W., Steidl, S., Batliner, A. M., Burkhardt, F., Devillers, L. Y., Müller, C. A., & Narayanan, S. S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-739 · Cited by 577 · see citing works
Face Detection without Bells and Whistles
Mathias, M., Benenson, R., Pedersoli, M., & Gool, L. V. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_47 · Cited by 505 · see citing works
Efficient Visual Search of Videos Cast as Text Retrieval
Sivic, J., & Zisserman, A. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.111 · Cited by 499 · see citing works
A survey on face detection in the wild: Past, present and future
Zafeiriou, S. P., Zhang, C., & Zhang, Z.-Y. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.03.015 · Cited by 495 · see citing works
Valstar, M., Schuller, B. W., Smith, K., Almaev, T. R., Eyben, F., Krajewski, J., Cowie, R., & Pantić, M. (2014) · International Workshop on Audio/Visual Emotion Challenge (AVEC) · doi:10.1145/2661806.2661807 · Cited by 476 · see citing works
Active and dynamic information fusion for facial expression understanding from image sequences
Zhang, Y., & Ji, Q. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.93 · Cited by 460 · see citing works
Facial dynamics as indicators of trustworthiness and cooperative behavior.
Krumhuber, E., Manstead, A. S. R., Cosker, D., Marshall, D., Rosin, P. L., & Kappas, A. (2007) · Emotion · doi:10.1037/1528-3542.7.4.730 · Cited by 407 · see citing works
Combining modality specific deep neural networks for emotion recognition in video
Kahou, S. E., Pal, C., Bouthillier, X., Froumenty, P., Gülçehre, Ç., Memisevic, R., Vincent, P., Courville, A., Bengio, Y., Ferrari, R. C., et al. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531745 · Cited by 391 · see citing works
Recurrent Neural Networks for Emotion Recognition in Video
Kahou, S. E., Michalski, V., Konda, K., Memisevic, R., & Pal, C. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830596 · Cited by 386 · see citing works
Deeply Learning Deformable Facial Action Parts Model for Dynamic Expression Analysis
Liu, M., Li, S., Shan, S., Wang, R., & Chen, X. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_10 · Cited by 332 · see citing works
openSMILE - The Munich Versatile and Fast Open-Source Audio Feature Extractor
Eyben, F. ;. (2013) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 322 · see citing works
British Machine Vision Conference, 2014
Crowley, E. J., & Zisserman, A. (2014) · Cited by 321 · see citing works
Video and Image based Emotion Recognition Challenges in the Wild: EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2829994 · Cited by 305 · see citing works
Kim, B.-K., Roh, J., Dong, S.-Y., & Lee, S.-Y. (2016) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0209-0 · Cited by 244 · see citing works
Action unit detection using sparse appearance descriptors in space-time video volumes
Jiang, B., Valstar, M., & Pantić, M. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771416 · Cited by 236 · see citing works
McDuff, D., el Kaliouby, R., Senechal, T., Amr, M., Cohn, J. F., & Picard, R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.130 · Cited by 234 · see citing works
Emotion Recognition In The Wild Challenge 2014
Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2666275 · Cited by 216 · see citing works
Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition
Almaev, T. R., & Valstar, M. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.65 · Cited by 203 · see citing works
Combining Multiple Kernel Methods on Riemannian Manifold for Emotion Recognition in the Wild
Liu, M., Wang, R., Li, S., Shan, S., Huang, Z., & Chen, X. (2014) · Proceedings of the 16th International Conference on Multimodal Interaction · doi:10.1145/2663204.2666274 · Cited by 202 · see citing works
Survey on audiovisual emotion recognition: databases, features, and data fusion strategies
Wu, C., Lin, J., & Wei, W.-L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2014.11 · Cited by 185 · see citing works
Emotion recognition in the wild challenge 2013
Dhall, A., Goecke, R., Joshi, J., Wagner, M., & Gedeon, T. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531739 · Cited by 178 · see citing works
Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles
Dibeklioğlu, H., Salah, A. A., & Gevers, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_38 · Cited by 168 · see citing works
Self-citationCapturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition
Wang, Z., Wang, S., & Ji, Q. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.439 · Cited by 154 · see citing works
EmotiW 2016: video and group-level emotion recognition challenges
Dhall, A., Goecke, R., Joshi, J., Hoey, J., & Gedeon, T. (2016) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2993148.2997638 · Cited by 147 · see citing works
A Dynamic Appearance Descriptor Approach to Facial Actions Temporal Modeling
Jiang, B., Valstar, M., Martínez, B., & Pantić, M. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2249063 · Cited by 146 · see citing works
D'Mello, S. K., & Kory, J. (2012) · International Conference on Multimodal Interaction · doi:10.1145/2388676.2388686 · Cited by 122 · see citing works
AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and ChallengePreprint
Valstar, M., Gratch, J. S., Schuller, B. W., Ringeval, F., Lalanne, D., Torres, M. T., Scherer, S. J., Stratou, G., Cowie, R., & Pantić, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01600 · Cited by 121 · see citing works
Multiple kernel learning for emotion recognition in the wild
Sikka, K., Dykstra, K., Sathyanarayana, S., Littlewort, G., & Bartlett, M. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531741 · Cited by 119 · see citing works
Capturing AU-Aware Facial Features and Their Latent Relations for Emotion Recognition in the Wild
Yao, A., Shao, J., Ma, N., & Chen, Y. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830585 · Cited by 96 · see citing works
ChaLearn Joint Contest on Multimedia Challenges Beyond Visual Analysis: An overview
Escalante, H. J., Ponce-López, V., Wan, J., Riegler, M. A., Chen, B., Clapés, A., Escalera, S., Guyon, I., Baró, X., Halvorsen, P., et al. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899609 · Cited by 84 · see citing works
Sun, B., Li, L., Zuo, T., Chen, Y., Zhou, G., & Wu, X. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2666272 · Cited by 71 · see citing works
Contrasting and Combining Least Squares Based Learners for Emotion Recognition in the Wild
Kaya, H., Gürpınar, F., Afshar, S., & Salah, A. A. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830588 · Cited by 63 · see citing works
Self-citationPartial least squares regression on grassmannian manifold for emotion recognition
Liu, M., Wang, R., Huang, Z., Shan, S., & Chen, X. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531738 · Cited by 62 · see citing works
Fisher vectors with cascaded normalization for paralinguistic analysis
Kaya, H., Karpov, A. A., & Salah, A. A. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-193 · Cited by 60 · see citing works
Self-citationMultimodal fusion of audio, scene, and face features for first impression estimation
Gürpınar, F., Kaya, H., & Salah, A. A. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899605 · Cited by 52 · see citing works
Self-citationCombining modality-specific extreme learning machines for emotion recognition in the wild
Kaya, H., & Salah, A. A. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0175-6 · Cited by 39 · see citing works
Self-citationEmotion recognition in the Wild Challenge 2014 : baseline, data and protocol
Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · University of Canberra Research Portal · Cited by 29 · see citing works
Video and image based emotion recognition challenges in the wild : EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · University of Canberra Research Portal · Cited by 25 · see citing works
Improved Blur Insensitivity for Decorrelated Local Phase Quantization
Heikkilä, J., Ojansivu, V., & Rahtu, E. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.206 · Cited by 21 · see citing works
Video modeling and learning on Riemannian manifold for emotion recognition in the wild
Liu, M., Wang, R., Li, S., Huang, Z., Shan, S., & Chen, X. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0204-5 · Cited by 8 · see citing works
Flagged first, then by citations
5 of the 73 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Deep Facial Expression Recognition: A Survey
Li, S., & Deng, W. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2981446 · Cited by 2,043 · see citing works
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806 · see citing works
A Review of Deep Transfer Learning and Recent Advancements
Iman, M., Arabnia, H. R., & Rasheed, K. (2023) · Technologies · doi:10.3390/technologies11020040 · Cited by 687 · see citing works
Emotion recognition using deep learning approach from audio–visual emotional big data
Hossain, M. S., & Muhammad, G. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.09.008 · Cited by 454 · see citing works
Local Learning With Deep and Handcrafted Features for Facial Expression Recognition
Georgescu, M.-I., Ionescu, R. T., & Popescu, M. (2019) · IEEE Access · doi:10.1109/access.2019.2917266 · Cited by 334 · see citing works
Multi-Scale Metric Learning for Few-Shot Learning
Jiang, W. R., Huang, K., Geng, J., & Deng, X. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2995754 · Cited by 301 · see citing works
Integrating Machine Learning with Human Knowledge
Deng, C., Ji, X., Rainey, C., Zhang, J., & Lu, W. (2020) · iScience · doi:10.1016/j.isci.2020.101656 · Cited by 243 · see citing works
Deep learning for human affect recognition: Insights and new developments
Rouast, P. V., Adam, M. T. P., & Chiong, R. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890471 · Cited by 243 · see citing works
Rahate, A., Walambe, R., Ramanna, S., & Kotecha, K. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.003 · Cited by 214 · see citing works
Deep learning-based late fusion of multimodal information for emotion classification of music video
Pandeya, Y. R., & Lee, J. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08836-3 · Cited by 222 · see citing works
Temporal multimodal fusion for video emotion classification in the wild
Vielzeuf, V., Pateux, S., & Jurie, F. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3143011 · Cited by 179 · see citing works
Shoumy, N. J., Ang, L.-M., Seng, K. P., Rahaman, D. M. M., & Zia, T. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102447 · Cited by 171 · see citing works
Sajjad, M., Ullah, F. U. M., Ullah, M., Christodoulou, G., Cheikh, F. A., Hijji, M., Muhammad, K., & Rodrigues, J. J. P. C. (2023) · Alexandria Engineering Journal · doi:10.1016/j.aej.2023.01.017 · Cited by 196 · see citing works
Awais, M., Raza, M., Singh, N. K., Bashir, K., Manzoor, U., Islam, S. U., & Rodrigues, J. J. P. C. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3044031 · Cited by 166 · see citing works
Spontaneous Speech Emotion Recognition Using Multiscale Deep Convolutional LSTM
Zhang, S., Zhao, X., & Tian, Q. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2947464 · Cited by 154 · see citing works
Predicting CO and NOxemissions from gas turbines: novel data and abenchmark PEMS
Kaya, H., Tüfekçi, P., & Uzun, E. (2019) · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · doi:10.3906/elk-1807-87 · Cited by 119 · see citing works
Self-citationFacial Expression Recognition in Videos Using Dynamic Kernels
Perveen, N., Roy, D., & Mohan, C. K. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3011846 · Cited by 116 · see citing works
Dalvi, C., Rathod, M., Patil, S., Gite, S., & Kotecha, K. V. (2021) · IEEE Access · doi:10.1109/access.2021.3131733 · Cited by 122 · see citing works
Modeling, Recognizing, and Explaining Apparent Personality From Videos
Escalante, H. J., Kaya, H., Salah, A. A., Escalera, S., Güçlütürk, Y., Guclu, U., Baró, X., Guyon, I., Jacques, J. C. S., Madadi, M., et al. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2973984 · Cited by 107 · see citing works
Self-citationOn-Road Driver Emotion Recognition Using Facial Expression
Xiao, H., Li, W., Zeng, G., Wu, Y., Xue, J., Zhang, J., Li, C., & Guo, G. (2022) · Applied Sciences · doi:10.3390/app12020807 · Cited by 112 · see citing works
Emotion recognition using secure edge and cloud computing
Hossain, M. S., & Muhammad, G. (2019) · Information Sciences · doi:10.1016/j.ins.2019.07.040 · Cited by 104 · see citing works
A comprehensive review of facial expression recognition techniques
Rashmi Adyapady, R., & Annappa, B. (2022) · Multimedia Systems · doi:10.1007/s00530-022-00984-w · Cited by 98 · see citing works
Savchenko, A. (2019) · PeerJ Computer Science · doi:10.7717/peerj-cs.197 · Cited by 88 · see citing works
Deep-Learning-Based Multimodal Emotion Classification for Music Videos
Pandeya, Y. R., Bhattarai, B., & Lee, J. (2021) · Sensors · doi:10.3390/s21144927 · Cited by 86 · see citing works
A Review of Generalizable Transfer Learning in Automatic Emotion Recognition
Feng, K., & Chaspari, T. (2020) · Frontiers in Computer Science · doi:10.3389/fcomp.2020.00009 · Cited by 82 · see citing works
In search of a robust facial expressions recognition model: A large-scale visual cross-corpus study
Рюмина, Е. В., Dresvyanskiy, D., & Karpov, A. A. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.10.013 · Cited by 81 · see citing works
Kumar, T. S. (2020) · Journal of Innovative Image Processing · doi:10.36548/jiip.2020.3.002 · Cited by 78 · see citing works
Recognizing Induced Emotions of Movie Audiences from Multimodal Information
Muszyński, M., Tian, L., Lai, C., Moore, J. D., Κωστούλας, Θ., Lombardo, P., Pun, T., & Chanel, G. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2902091 · Cited by 78 · see citing works
Group-level emotion recognition using transfer learning from face identification
Rassadin, A. G., Gruzdev, A., & Savchenko, A. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3143007 · Cited by 73 · see citing works
Learning deep facial expression features from image and optical flow sequences using 3D CNN
Zhao, J., Mao, X., & Zhang, J. (2018) · The Visual Computer · doi:10.1007/s00371-018-1477-y · Cited by 75 · see citing works
Kaya, H., Gürpınar, F., & Salah, A. A. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.210 · Cited by 67 · see citing works
Self-citationMultimodal emotion recognition: A comprehensive review, trends, and challenges
Ramaswamy, M. P. A., & Palaniswamy, S. (2024) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1563 · Cited by 70 · see citing works
PRATIT: a CNN-based emotion recognition system using histogram equalization and data augmentation
Mungra, D., Agrawal, A., Sharma, P., Tanwar, S., & Obaidat, M. S. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08397-0 · Cited by 62 · see citing works
Facial emotion recognition using temporal relational network: an application to E-learning
Pise, A. A., Vadapalli, H., & Sanders, I. D. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10133-y · Cited by 58 · see citing works
Emotion, age, and gender classification in children’s speech by humans and machines
Kaya, H., Salah, A. A., Karpov, A. A., Frolova, O. V., Grigorev, A., & Lyakso, E. E. (2017) · Computer Speech & Language · doi:10.1016/j.csl.2017.06.002 · Cited by 57 · see citing works
Self-citationDTL-I-ResNet18: facial emotion recognition based on deep transfer learning and improved ResNet18
Helaly, R., Messaoud, S., Bouaafia, S., Hajjaji, M. A., & Mtibaa, A. (2023) · Signal Image and Video Processing · doi:10.1007/s11760-023-02490-6 · Cited by 61 · see citing works
The Turkish Audio-Visual Bipolar Disorder Corpus
Çiftçi, E., Kaya, H., Güleç, H., & Salah, A. A. (2018) · Asian Conference on Affective Computing and Intelligent Interaction (ACII Asia) · doi:10.1109/aciiasia.2018.8470362 · Cited by 55 · see citing works
Self-citationTransfer Learning Based Fault Diagnosis with Missing Data Due to Multi-Rate Sampling
Chen, D., Yang, S., & Zhou, F. (2019) · Sensors · doi:10.3390/s19081826 · Cited by 54 · see citing works
Hemanth, D. J., Anitha, J., & Sơn, L. H. (2018) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2018.04.006 · Cited by 53 · see citing works
Generative adversarial networks and their application to 3D face generation: A survey
Toshpulatov, M., Lee, W., & Lee, S. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2021.104119 · Cited by 56 · see citing works
Fusing dynamic deep learned features and handcrafted features for facial expression recognition
Fan, X., & Tjahjadi, T. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.102659 · Cited by 50 · see citing works
Val-Calvo, M., Álvarez, J. R., Vicente, J. M. F., & Fernández, E. (2020) · IEEE Access · doi:10.1109/access.2020.3007109 · Cited by 48 · see citing works
Context-Aware Emotion Recognition Based on Visual Relationship Detection
Hoang, M.-H., Kim, S.-H., Yang, H.-J., & Lee, G.-S. (2021) · IEEE Access · doi:10.1109/access.2021.3091169 · Cited by 48 · see citing works
Multimodal emotion recognition based on a fusion of audiovisual information with temporal dynamics
Salas-Cáceres, J., Lorenzo-Navarro, J., Freire-Obregón, D., & Castrillón-Santana, M. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20227-6 · Cited by 45 · see citing works
Modeling multimodal cues in a deep learning-based framework for emotion recognition in the wild
Pini, S., Ahmed, O. B., Cornia, M., Baraldi, L., Cucchiara, R., & Huet, B. (2017) · Proceedings of the 19th ACM International Conference on Multimodal Interaction · doi:10.1145/3136755.3143006 · Cited by 44 · see citing works
Gao, H., Wu, M., Chen, Z., Li, Y., Wang, X., An, S., Li, J., & Liu, C. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.11.025 · Cited by 44 · see citing works
Kang, J.-S., Kavuri, S., & Lee, M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2942587 · Cited by 44 · see citing works
Hafiz, R., Haque, M. R., Rakshit, A., & Uddin, M. S. (2020) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.08.015 · Cited by 42 · see citing works
Feature-Level and Model-Level Audiovisual Fusion for Emotion Recognition in the Wild
Cai, J., Meng, Z., Khan, A. S., Li, Z., O’Reilly, J. D., Han, S., Liu, P., Chen, M., & Tong, Y. (2019) · IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) · doi:10.1109/mipr.2019.00089 · Cited by 41 · see citing works
Banskota, N., Alsadoon, A., Prasad, P. W. C., Dawoud, A., Rashid, T. A., & Alsadoon, O. H. (2022) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13567-8 · Cited by 41 · see citing works
Deep Continual Learning for Emerging Emotion Recognition
Thuseethan, S., Rajasegarar, S., & Yearwood, J. L. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3116434 · Cited by 41 · see citing works
Hsu, J.-H., & Wu, C. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3258900 · Cited by 39 · see citing works
Visual Scene-aware Hybrid Neural Network Architecture for Video-based Facial Expression Recognition
Lee, M. K., Choi, D. Y., Kim, D. H., & Song, B. C. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756551 · Cited by 38 · see citing works
Pre-training Strategies and Datasets for Facial Representation Learning
Bulat, A., Cheng, S., Yang, J., Garbett, A., Sánchez, E., & Tzimiropoulos, G. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19778-9_7 · Cited by 38 · see citing works
Multi-modal Correlated Network for emotion recognition in speech
Ren, M., Nie, W., Liu, A.-A., & Su, Y. (2019) · Visual Informatics · doi:10.1016/j.visinf.2019.10.003 · Cited by 39 · see citing works
A Hybrid Driver Fatigue and Distraction Detection Model Using AlexNet Based on Facial Features
Anber, S., Alsaggaf, W., & Shalash, W. M. (2022) · Electronics · doi:10.3390/electronics11020285 · Cited by 36 · see citing works
Adversarial Domain Generalized Transformer for Cross-Corpus Speech Emotion Recognition
Gao, Y., Wang, L., Liu, J., Dang, J., & Okada, S. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3290795 · Cited by 35 · see citing works
Convolutional Neural Network Based Offline Signature Verification Application
Yapıcı, M. M., Tekerek, A., & Topaloğlu, N. (2018) · International Congress on Big Data, Deep Learning and Fighting Cyber Terrorism (IBIGDELFT) · doi:10.1109/ibigdelft.2018.8625290 · Cited by 35 · see citing works
End-to-End Modeling and Transfer Learning for Audiovisual Emotion Recognition in-the-Wild
Dresvyanskiy, D., Рюмина, Е. В., Kaya, H., Markitantov, M., Karpov, A. A., & Minker, W. (2022) · Multimodal Technologies and Interaction · doi:10.3390/mti6020011 · Cited by 35 · see citing works
Self-citationTime efficient real time facial expression recognition with CNN and transfer learning
Podder, T., Bhattacharya, D., & Majumdar, A. (2022) · Sadhana · doi:10.1007/s12046-022-01943-x · Cited by 35 · see citing works
A Multimodal Emotion Recognition System Using Facial Landmark Analysis
Rahdari, F., Rashedi, E., & Eftekhari, M. (2018) · Iranian Journal of Science and Technology Transactions of Electrical Engineering · doi:10.1007/s40998-018-0142-9 · Cited by 32 · see citing works
Seng, J. K. P., & Ang, L.-M. (2019) · IEEE Access · doi:10.1109/access.2019.2926751 · Cited by 32 · see citing works
Teacher-Student Training and Triplet Loss for Facial Expression Recognition under Occlusion
Georgescu, M.-I., & Ionescu, R. T. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412493 · Cited by 32 · see citing works
Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspects
Rahmani, S., Hosseini, S., Zall, R., Kangavari, M. R., Kamran, S., & Hua, W. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110219 · Cited by 33 · see citing works
Moorthy, S., & Moon, Y.-K. (2025) · Mathematics · doi:10.3390/math13071100 · Cited by 31 · see citing works
Recognizing Facial Expressions of Occluded Faces Using Convolutional Neural Networks
Georgescu, M.-I., & Ionescu, R. T. (2019) · Communications in computer and information science · doi:10.1007/978-3-030-36808-1_70 · Cited by 31 · see citing works
Bellamkonda, S., & Gopalan, N. P. (2019) · International Journal of Ambient Computing and Intelligence · doi:10.4018/ijaci.2020010103 · Cited by 31 · see citing works
Reducing Videoconferencing Fatigue through Facial Emotion Recognition
Rößler, J., Sun, J., & Gloor, P. A. (2021) · Future Internet · doi:10.3390/fi13050126 · Cited by 32 · see citing works
A Graph-Structured Representation with BRNN for Static-based Facial Expression Recognition
Zhong, L., Bai, C., Li, J., Chen, T., Li, S., & Liu, Y. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756615 · Cited by 29 · see citing works
Towards Facial Expression Recognition for On-Farm Welfare Assessment in Pigs
Hansen, M., Baxter, E., Rutherford, K., Futro, A., Smith, M. L., & Smith, L. N. (2021) · Agriculture · doi:10.3390/agriculture11090847 · Cited by 30 · see citing works
Explaining First Impressions: Modeling, Recognizing, and Explaining Apparent Personality from VideosPreprint
Escalante, H. J., Kaya, H., Salah, A. A., Escalera, S., Güçlütürk, Y., Güçlü, U., Baró, X., Guyon, I., Jacques, J. C. S., Madadi, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.00745 · Cited by 30 · see citing works
Self-citationMUMBAI: multi-person, multimodal board game affect and interaction analysis dataset
Doyran, M., Schimmel, A., Baki, P., Ergin, K., Türkmen, B., Salah, A. A. A., Bakkes, S. C. J., Kaya, H., Poppe, R. W., & Salah, A. A. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00364-0 · Cited by 30 · see citing works
Self-citationBoosting Face in Video Recognition via CNN Based Key Frame Extraction
Qi, X., Liu, C., & Schuckers, S. (2018) · International Conference on Biometrics · doi:10.1109/icb2018.2018.00030 · Cited by 28 · see citing works
Digital trace data collection through data donationPreprint
Boeschoten, L., Ausloos, J., Möller, J. E., Araujo, T., & Oberski, D. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.09851 · Cited by 28 · see citing works
Liu, J., Ang, M. C., Chaw, J. K., Kor, A.-L., & Ng, K. W. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120857 · Cited by 27 · see citing works
A discriminative deep association learning for facial expression recognition
Jin, X., Sun, W., & Jin, Z. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-019-01024-2 · Cited by 27 · see citing works
A Hybrid Model for Bipolar Disorder Classification from Visual Information
Abaei, N., & Osman, H. A. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9054648 · Cited by 26 · see citing works
Meta-transfer learning for emotion recognition
Nguyen, D., Nguyen, T. T., Sridharan, S., Denman, S., Nguyen, T. T., Dean, D., & Fookes, C. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08248-y · Cited by 26 · see citing works
Jointly Aligning and Predicting Continuous Emotion Annotations
Khorram, S., McInnis, M. G., & Provost, E. M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2019.2917047 · Cited by 25 · see citing works
Zhu, J., Wang, X., Kou, L., Zheng, L., & Zhang, H. (2021) · Applied Surface Science · doi:10.1016/j.apsusc.2021.150098 · Cited by 24 · see citing works
ATL-BP: A Student Engagement Dataset and Model for Affect Transfer Learning for Behavior Prediction
Ruiz, N., Yu, H., Allessio, D., Jalal, M., Joshi, A., Murray, T., Magee, J., Delgado, K. A. M., Ablavsky, V., Sclaroff, S., et al. (2022) · IEEE Transactions on Biometrics Behavior and Identity Science · doi:10.1109/tbiom.2022.3210479 · Cited by 24 · see citing works
Joint low rank embedded multiple features learning for audio–visual emotion recognition
Wang, Z., Wang, L., & Huang, H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.017 · Cited by 23 · see citing works
Pain-attentive network: a deep spatio-temporal attention model for pain estimation
Huang, D. J., Xia, Z., Mwesigye, J., & Feng, X. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09397-1 · Cited by 23 · see citing works
Dynamic Facial Models for Video-Based Dimensional Affect Estimation
Song, S., Sánchez, E., Tellamekala, M. K., Shen, L., Johnston, A., & Valstar, M. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00200 · Cited by 23 · see citing works
Demochkina, P., & Savchenko, A. V. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68821-9_25 · Cited by 23 · see citing works
Text-based Interpretable Depression Severity Modeling via Symptom Predictions
Steijn, F. V., Sogancioglu, G., & Kaya, H. (2022) · International Conference on Multimodal Interaction · doi:10.1145/3536221.3556579 · Cited by 21 · see citing works
Self-citationLSTM Based Cross-corpus and Cross-task Acoustic Emotion Recognition
Kaya, H., Fedotov, D., Yeşilkanat, A., Verkholyak, O., Zhang, Y., & Karpov, A. A. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-2298 · Cited by 22 · see citing works
Self-citationMulti-view laplacian eigenmaps based on bag-of-neighbors for RGB-D human emotion recognition
Liu, S., Guo, S., Wang, W., Qiao, H., Wang, Y., & Luo, W. (2019) · Information Sciences · doi:10.1016/j.ins.2019.08.035 · Cited by 22 · see citing works
Teacher–student training and triplet loss to reduce the effect of drastic face occlusion
Georgescu, M.-I., Duţǎ, G.-E., & Ionescu, R. T. (2021) · Machine Vision and Applications · doi:10.1007/s00138-021-01270-x · Cited by 23 · see citing works
Han, J., Zhang, Z., Pantić, M., & Schuller, B. W. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.08.002 · Cited by 22 · see citing works
A Systematic Literature Review on Machine Learning Algorithms for Human Status Detection
Sardar, S. K., Kumar, N., V, & Lee, S. C. (2022) · IEEE Access · doi:10.1109/access.2022.3190967 · Cited by 21 · see citing works
Incongruity-Aware Cross-Modal Attention for Audio-Visual Fusion in Dimensional Emotion Recognition
Praveen, R. G., & Alam, J. (2024) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2024.3422823 · Cited by 21 · see citing works
Incipient Fault Diagnosis Based on DNN with Transfer Learning
Chen, D., Yang, S., & Zhou, F. (2018) · International Conference on Control, Automation and Information Sciences (ICCAIS) · doi:10.1109/iccais.2018.8570702 · Cited by 21 · see citing works
Meta transfer learning for facial emotion recognition
Nguyen, D., Nguyen, K., Sridharan, S., Abbasnejad, I., Dean, D., & Fookes, C. (2018) · QUT ePrints (Queensland University of Technology) · Cited by 21 · see citing works
Cornejo, J. Y. R., & Pedrini, H. (2019) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2019.8914193 · Cited by 21 · see citing works
Multimodal affect analysis of psychodynamic play therapy
Halfon, S., Doyran, M., Türkmen, B., Oktay, E., & Salah, A. A. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1839141 · Cited by 21 · see citing works
Self-citationSheng, D., Yuan, J., Xie, Q., & Li, L. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.08.001 · Cited by 21 · see citing works
Subject independent emotion recognition using EEG and physiological signals – a comparative study
Ramaswamy, M. P. A., & Palaniswamy, S. (2022) · Applied Computing and Informatics · doi:10.1108/aci-03-2022-0080 · Cited by 19 · see citing works
RS-Xception: A Lightweight Network for Facial Expression Recognition
Liao, L., Wu, S., Song, C., & Fu, J. (2024) · Electronics · doi:10.3390/electronics13163217 · Cited by 19 · see citing works
Content-based multimedia recommendation systems: Definition and application domains
Deldjoo, Y., Schedl, M., Cremonesi, P., & Pasi, G. (2018) · BOA (University of Milano-Bicocca) · Cited by 19 · see citing works
- Authors
- Kaya, H., Gürpınar, F., & Salah, A. A.
- Affiliations
- Tekirdağ Namık Kemal University (TR)
- Boğaziçi University (TR)
- Corresponding author
- Kaya, Heysem
- Venue
- Image and Vision Computing
- Publisher
- Elsevier BV
- Published
- 2017-09
- Volume
- 65
- Pages
- 66-75
- ISSN
- 0262-8856 (ISSN-L)
- OpenAlex
- W2585658440
- Cited by
- 235
- References
- 73
- Citations by year
- 2026: 6 · 2025: 12 · 2024: 13 · 2023: 19 · 2022: 31 · 2021: 37 · 2020: 42 · 2019: 41 · 2018: 26 · 2017: 8
- FWCI
- 41.68
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Image and Vision Computing (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- video-based emotion recognition, in-the-wild emotion recognition, multimodal emotion recognition, facial expression recognition, transfer learning, score-level fusion, audiovisual integration, convolutional neural network features, fine-tuning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review