Cited by 235Emotion and Mood RecognitionFace recognition and analysisFace and Expression Recognition

The DOI matches its Crossref record; 68 of the 73 references it cites were found in a registry or an index.

Video-based emotion recognition in the wild using deep transfer learning and score fusion

Kaya, Heysem, Gürpınar, Furkan, Salah, Albert Ali·2017·Image and Vision Computing

DOI 10.1016/j.imavis.2017.01.012

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/j.imavis.2017.01.012

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Least Squares Support Vector Machine Classifiers
Suykens, J., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,481
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2011) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,575
Deep Face Recognition
Parkhi, O. M., Vedaldi, A., & Zisserman, A. (2015) · Procedings of the British Machine Vision Conference 2015 · doi:10.5244/c.29.41 · Cited by 5,479
The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642
Generalized Inverse of Matrices and Its Applications
Banerjee, K. S., Rao, C. R., & Mitra, S. K. (1973) · Technometrics · doi:10.1080/00401706.1973.10489026 · Cited by 2,320
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,167
Generalized Inverse of Matrices and Its Applications
Mayne, A. J., Rao, C. R., & Mitra, S. K. (1972) · Journal of the Operational Research Society · doi:10.1057/jors.1972.96 · Cited by 2,036
2007 IEEE Conference on Computer Vision and Pattern Recognition
(2007) · doi:10.1109/cvpr12085.2007 · Cited by 1,726
Challenges in Representation Learning: A Report on Three Machine Learning Contests
Goodfellow, I. J., Erhan, D., Carrier, P. L., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-42051-1_16 · Cited by 1,719
Fisher Kernels on Visual Vocabularies for Image Categorization
Perronnin, F., & Dance, C. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383266 · Cited by 1,641
Partial Least Squares
Wold, H. (2005) · Wiley eBooks · doi:10.1002/0471667196.ess1914.pub2 · Cited by 1,545
Encyclopedia of Statistical Sciences 2.
Dawid, A. P., Kotz, S., Johnson, N. L., & Read, C. B. (1984) · Biometrics · doi:10.2307/2530789 · Cited by 1,494
Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions
Ringeval, F., Sonderegger, A., Sauer, J., & Lalanne, D. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553805 · Cited by 771
DEX: Deep EXpectation of Apparent Age from a Single Image
Rothe, R., Timofte, R., & Gool, L. V. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.41 · Cited by 711
Challenges in representation learning: A report on three machine learning contests
Goodfellow, I. J., Erhan, D., Luc Carrier, P., Courville, A., Mirza, M., Hamner, B., Cukierski, W., Tang, Y., Thaler, D., Lee, D.-H., et al. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.005 · Cited by 697
Return of the Devil in the Details: Delving Deep into Convolutional NetsPreprint
Chatfield, K., Simonyan, K., Vedaldi, A., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.3531 · Cited by 663
Collecting Large, Richly Annotated Facial-Expression Databases from Movies
Dhall, A., Goecke, R., Lucey, S., & Gedeon, T. (2012) · IEEE Multimedia · doi:10.1109/mmul.2012.26 · Cited by 658
Deep Learning for Emotion Recognition on Small Datasets using Transfer Learning
Ng, H.-W., Nguyen, V. D., Vonikakis, V., & Winkler, S. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2830593 · Cited by 657 · cited 3×
“In [36] the authors exploited pre-trained models based on the ImageNet dataset, followed by two stages of fine-tuning, on FER 2013 and Static Facial Expression Sub-Challenge (SFEW) Dataset from the EmotiW 2015 Challenge, respectively [8].”
Method
Image based Static Facial Expression Recognition with Multiple Deep Network Learning
Yu, Z., & Zhang, C. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830595 · Cited by 602
AVEC 2013
Valstar, M., Schuller, B. W., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., & Pantić, M. (2013) · doi:10.1145/2512530.2512533 · Cited by 581
The INTERSPEECH 2010 paralinguistic challenge
Schuller, B. W., Steidl, S., Batliner, A. M., Burkhardt, F., Devillers, L. Y., Müller, C. A., & Narayanan, S. S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-739 · Cited by 577
Face Detection without Bells and Whistles
Mathias, M., Benenson, R., Pedersoli, M., & Gool, L. V. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_47 · Cited by 508
Efficient Visual Search of Videos Cast as Text Retrieval
Sivic, J., & Zisserman, A. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.111 · Cited by 499
AVEC 2014
Valstar, M., Schuller, B. W., Smith, K., Almaev, T. R., Eyben, F., Krajewski, J., Cowie, R., & Pantić, M. (2014) · International Workshop on Audio/Visual Emotion Challenge (AVEC) · doi:10.1145/2661806.2661807 · Cited by 476
A survey on face detection in the wild: Past, present and future
Zafeiriou, S. P., Zhang, C., & Zhang, Z. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.03.015 · Cited by 476
Active and dynamic information fusion for facial expression understanding from image sequences
Zhang, Y., & Ji, Q. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.93 · Cited by 460
Facial dynamics as indicators of trustworthiness and cooperative behavior.
Krumhuber, E., Manstead, A. S. R., Cosker, D., Marshall, D., Rosin, P. L., & Kappas, A. (2007) · Emotion · doi:10.1037/1528-3542.7.4.730 · Cited by 407
Recurrent Neural Networks for Emotion Recognition in Video
Kahou, S. E., Michalski, V., Konda, K., Memisevic, R., & Pal, C. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830596 · Cited by 396
Combining modality specific deep neural networks for emotion recognition in video
Kahou, S. E., Pal, C., Bouthillier, X., Froumenty, P., Gülçehre, Ç., Memisevic, R., Vincent, P., Courville, A., Bengio, Y., Ferrari, R. C., et al. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531745 · Cited by 391
Deeply Learning Deformable Facial Action Parts Model for Dynamic Expression Analysis
Liu, M., Li, S., Shan, S., Wang, R., & Chen, X. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_10 · Cited by 333
openSMILE - The Munich Versatile and Fast Open-Source Audio Feature Extractor
Eyben, F. ;. (2013) · mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) · Cited by 322
British Machine Vision Conference, 2014
Crowley, E. J., & Zisserman, A. (2014) · Cited by 321
Video and Image based Emotion Recognition Challenges in the Wild: EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2829994 · Cited by 305
Hierarchical committee of deep convolutional neural networks for robust facial expression recognition
Kim, B.-K., Roh, J., Dong, S.-Y., & Lee, S.-Y. (2016) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0209-0 · Cited by 244
Action unit detection using sparse appearance descriptors in space-time video volumes
Jiang, B., Valstar, M., & Pantić, M. (2011) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2011.5771416 · Cited by 236
Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected "In-the-Wild"
McDuff, D., el Kaliouby, R., Senechal, T., Amr, M., Cohn, J. F., & Picard, R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.130 · Cited by 234
Emotion Recognition In The Wild Challenge 2014
Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2666275 · Cited by 216
Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition
Almaev, T. R., & Valstar, M. (2013) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2013.65 · Cited by 203
Combining Multiple Kernel Methods on Riemannian Manifold for Emotion Recognition in the Wild
Liu, M., Wang, R., Li, S., Shan, S., Huang, Z., & Chen, X. (2014) · Proceedings of the 16th International Conference on Multimodal Interaction · doi:10.1145/2663204.2666274 · Cited by 202
Survey on audiovisual emotion recognition: databases, features, and data fusion strategies
Wu, C., Lin, J., & Wei, W.-L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2014.11 · Cited by 185
Emotion recognition in the wild challenge 2013
Dhall, A., Goecke, R., Joshi, J., Wagner, M., & Gedeon, T. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531739 · Cited by 178
Are You Really Smiling at Me? Spontaneous versus Posed Enjoyment Smiles
Dibeklioğlu, H., Salah, A. A., & Gevers, T. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_38 · Cited by 168
Self-citation
Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition
Wang, Z., Wang, S., & Ji, Q. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.439 · Cited by 154
EmotiW 2016: video and group-level emotion recognition challenges
Dhall, A., Goecke, R., Joshi, J., Hoey, J., & Gedeon, T. (2016) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2993148.2997638 · Cited by 148
A Dynamic Appearance Descriptor Approach to Facial Actions Temporal Modeling
Jiang, B., Valstar, M., Martínez, B., & Pantić, M. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2249063 · Cited by 146
AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and ChallengePreprint
Valstar, M., Gratch, J. S., Schuller, B. W., Ringeval, F., Lalanne, D., Torres, M. T., Scherer, S. J., Stratou, G., Cowie, R., & Pantić, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01600 · Cited by 129
Multiple kernel learning for emotion recognition in the wild
Sikka, K., Dykstra, K., Sathyanarayana, S., Littlewort, G., & Bartlett, M. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531741 · Cited by 119
Consistent but modest
D’Mello, S. K., & Kory-Westlund, J. M. (2012) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2388676.2388686 · Cited by 104
Capturing AU-Aware Facial Features and Their Latent Relations for Emotion Recognition in the Wild
Yao, A., Shao, J., Ma, N., & Chen, Y. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830585 · Cited by 96
ChaLearn Joint Contest on Multimedia Challenges Beyond Visual Analysis: An overview
Escalante, H. J., Ponce-López, V., Wan, J., Riegler, M. A., Chen, B., Clapés, A., Escalera, S., Guyon, I., Baró, X., Halvorsen, P., et al. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899609 · Cited by 86
Combining Multimodal Features with Hierarchical Classifier Fusion for Emotion Recognition in the Wild
Sun, B., Li, L., Zuo, T., Chen, Y., Zhou, G., & Wu, X. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2666272 · Cited by 71
Contrasting and Combining Least Squares Based Learners for Emotion Recognition in the Wild
Kaya, H., Gürpınar, F., Afshar, S., & Salah, A. A. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2830588 · Cited by 63
Self-citation
Partial least squares regression on grassmannian manifold for emotion recognition
Liu, M., Wang, R., Huang, Z., Shan, S., & Chen, X. (2013) · Proceedings of the 15th ACM on International conference on multimodal interaction · doi:10.1145/2522848.2531738 · Cited by 62
Fisher vectors with cascaded normalization for paralinguistic analysis
Kaya, H., Karpov, A. A., & Salah, A. A. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-193 · Cited by 60
Self-citation
Multimodal fusion of audio, scene, and face features for first impression estimation
Gürpınar, F., Kaya, H., & Salah, A. A. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899605 · Cited by 52
Self-citation
Combining modality-specific extreme learning machines for emotion recognition in the wild
Kaya, H., & Salah, A. A. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0175-6 · Cited by 39
Self-citation
Emotion recognition in the Wild Challenge 2014 : baseline, data and protocol
Dhall, A., Goecke, R., Joshi, J., Sikka, K., & Gedeon, T. (2014) · University of Canberra Research Portal · Cited by 29
Video and image based emotion recognition challenges in the wild : EmotiW 2015
Dhall, A., Ramana Murthy, O. V., Goecke, R., Joshi, J., & Gedeon, T. (2015) · University of Canberra Research Portal · Cited by 25
Improved Blur Insensitivity for Decorrelated Local Phase Quantization
Heikkilä, J., Ojansivu, V., & Rahtu, E. (2010) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2010.206 · Cited by 21
Video modeling and learning on Riemannian manifold for emotion recognition in the wild
Liu, M., Wang, R., Li, S., Huang, Z., Shan, S., & Chen, X. (2015) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-015-0204-5 · Cited by 11

Flagged first, then by citations

5 of the 73 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

Rao, 1971, vol. 7
Rifkin, 2003, Regularized least-squares classification, NATO Sci. Ser. Sub Ser. III Comput. Syst. Sci., 190, 131

Sorted by citations

Deep Facial Expression Recognition: A Survey
Li, S., & Deng, W. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2981446 · Cited by 2,175
“[116] suggested that VGG-Face, which was trained for FR, overwhelmed ImageNet, which was developed for objected recognition.”
Background
Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review
Zhang, J., Yin, Z., Chen, P., & Nichele, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.011 · Cited by 806
A Review of Deep Transfer Learning and Recent Advancements
Iman, M., Arabnia, H. R., & Rasheed, K. (2023) · Technologies · doi:10.3390/technologies11020040 · Cited by 789
“[32] 2017 Video-based emotion recognition in the wild using deep transfer learning and score fusion video (audio & visual) yes Finetuning yes VGG-Face Human science / psychology”
Method
Emotion recognition using deep learning approach from audio–visual emotional big data
Hossain, M. S., & Muhammad, G. (2018) · Information Fusion · doi:10.1016/j.inffus.2018.09.008 · Cited by 460
Local Learning With Deep and Handcrafted Features for Facial Expression Recognition
Georgescu, M.-I., Ionescu, R. T., & Popescu, M. (2019) · IEEE Access · doi:10.1109/access.2019.2917266 · Cited by 351
“[30] employed SIFT, HOG and Local Gabor Binary Patterns (LGBP).”
BackgroundMethodInfluential

See all 235

Authors: Kaya, H., Gürpınar, F., & Salah, A. A.
Affiliations: Tekirdağ Namık Kemal University (TR)
Boğaziçi University (TR)
Corresponding author: Kaya, Heysem
ORCID: Kaya, Heysem
Gürpınar, Furkan
Salah, Albert Ali
Venue: Image and Vision Computing
Publisher: Elsevier BV
Published: 2017-09
Volume: 65
Pages: 66-75
ISSN: 0262-8856 (ISSN-L)
DOI: 10.1016/j.imavis.2017.01.012
OpenAlex: W2585658440
Cited by: 235
References: 73
Citations by year: 2026: 6 · 2025: 12 · 2024: 13 · 2023: 19 · 2022: 31 · 2021: 37 · 2020: 42 · 2019: 41 · 2018: 26 · 2017: 8
FWCI: 41.68
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Image and Vision Computing (publishedVersion)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
Keywords: video-based emotion recognition, in-the-wild emotion recognition, multimodal emotion recognition, facial expression recognition, transfer learning, score-level fusion, audiovisual integration, convolutional neural network features, fine-tuning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Video-based emotion recognition in the wild using deep transfer learning and score fusion

Overview

Integrity signals

Verification

Claims the paper makes

Citations

Cites

Cited by

Related

Metadata

Record

About these checks