Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications

Corneanu, Ciprian Adrian, Simon, Marc Oliu, Cohn, Jeffrey F., Guerrero, Sergio Escalera·2016·IEEE Transactions on Pattern Analysis and Machine Intelligence
DOI 10.1109/tpami.2016.2515606

Cites (261)

Items 201–261 of 261

  1. Combining video, audio and lexical indicators of affect in spontaneous conversation via particle filtering
    Arman Savran, Houwei Cao, Miraj Shah, Ani Nenkova, Ragini Verma · 2012 · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
  2. Static posed and evoked facial expressions of emotions in schizophrenia
    Kohler, Christian G., Martin, Elizabeth A., Stolar, Neal, Barrett, Fred S., Verma, Ragini, Brensinger, Colleen, Bilker, Warren, Gur, Raquel E., Gur, Ruben C. · 2008 · Schizophrenia Research
  3. Facial expression recognition using thermal image processing and neural network
    Yoshitomi, Y., Miyawaki, N., Tomita, S., Kimura, S. · 2002 · Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI
  4. Facial expression recognition – A real time approach
    Geetha, A., Ramalingam, V., Palanivel, S., Palaniappan, B. · 2009 · Expert Systems with Applications
  5. Mapping the contribution of single muscles to facial movements in the rhesus macaque
    Waller, B.M., Parr, L.A., Gothard, K.M., Burrows, A.M., Fuglevand, A.J. · 2008 · Physiology & Behavior
  6. Emotion Recognition and Depression Diagnosis by Acoustic and Visual Features: A Multimodal Approach
    Sidorov, Maxim, Minker, Wolfgang · 2014 · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge
  7. Local normal binary patterns for 3D facial action unit detection
    Sandbach, Georgia, Zafeiriou, Stefanos, Pantic, Maja · 2012 · 2012 19th IEEE International Conference on Image Processing
  8. Facial Expression of Emotion
    Armindo Freitas-Magalhaes · 2012 · Elsevier eBooks
  9. Facial Expression Recognition Using Kinect Depth Sensor and Convolutional Neural Networks
    Earnest Paul Ijjina, Chalavadi Krishna Mohan · 2014 · International Conference on Machine Learning and Applications
  10. Temporal Bayesian Fusion for Affect Sensing: Combining Video, Audio, and Lexical Modalities
    Savran, Arman, Houwei Cao, Nenkova, Ani, Verma, Ragini · 2015 · IEEE Transactions on Cybernetics
  11. Real time 3D face alignment with Random Forests-based Active Appearance Models
    Gabriele Fanelli, Matthias Dantone, Luc Van Gool · 2013 · IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  12. Automatic measurement of ad preferences from facial responses gathered over the Internet
    McDuff, Daniel, El Kaliouby, Rana, Senechal, Thibaud, Demirdjian, David, Picard, Rosalind · 2014 · Image and Vision Computing
  13. Emotion recognition from thermal infrared images using deep Boltzmann machine
    Wang, Shangfei, He, Menghua, Gao, Zhen, He, Shan, Ji, Qiang · 2014 · Frontiers of Computer Science
  14. MULTIMODAL AFFECT MODELING AND RECOGNITION FOR EMPATHIC ROBOT COMPANIONS
    CASTELLANO, GINEVRA, LEITE, IOLANDA, PEREIRA, ANDRÉ, MARTINHO, CARLOS, PAIVA, ANA, MCOWAN, PETER W. · 2013 · International Journal of Humanoid Robotics
  15. 4D facial expression recognition
    Tianhong Fang, Xi Zhao, Shishir K. Shah, Ioannis A. Kakadiaris · 2011 · IEEE International Conference on Computer Vision Workshops
  16. An automatic 3D expression recognition framework based on sparse representation of conformal images
    Zeng, Wei, Li, Huibin, Chen, Liming, Morvan, Jean-Marie, Gu, Xianfeng David · 2013 · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  17. Segmentation Algorithm for Multiple Face Detection in Color Images with Skin Tone Regions using Color Spaces and Edge Detection Techniques
    H.C. Vijay Lakshmi, S. PatilKulakarni · 2010 · International Journal of Computer Theory and Engineering
  18. A Thermal Facial Emotion Database and Its Analysis
    Nguyen, Hung, Kotani, Kazunori, Chen, Fan, Le, Bac · 2014 · Lecture Notes in Computer Science
  19. Estimating smile intensity: A better way
    Girard, Jeffrey M., Cohn, Jeffrey F., De la Torre, Fernando · 2015 · Pattern Recognition Letters
  20. Facial Expression Recognition Using Deep Boltzmann Machine from Thermal Infrared Images
    Shan He, Shangfei Wang, Wuwei Lan, Huan Fu, Qiang Ji · 2013 · International Conference on Affective Computing and Intelligent Interaction and workshops
  21. Gaze-X: Adaptive, Affective, Multimodal Interface for Single-User Office Scenarios
    Maat, Ludo, Pantic, Maja · 2007 · Lecture Notes in Computer Science
  22. Emotion Recognition Using Hidden Markov Models from Facial Temperature Sequence
    Zhilei Liu, Shang-Fei Wang · 2011 · Affective Computing and Intelligent Interaction
  23. Spatiotemporal analysis of RGB-D-T facial images for multimodal pain level recognition
    Irani, Ramin, Nasrollahi, Kamal, Simon, Marc O., Corneanu, Ciprian A., Escalera, Sergio, Bahnsen, Chris, Lundtoft, Dennis H., Moeslund, Thomas B., Pedersen, Tanja L., Klitgaard, Maria-Louise et al. · 2015 · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
  24. Mining multimodal sequential patterns: a case study on affect detection
    Martínez, Héctor P., Yannakakis, Georgios N. · 2011 · Proceedings of the 13th international conference on multimodal interfaces
  25. Analyzing Facial Expressions Using Intensity-Variant 3D Data For Human Computer Interaction
    Lijun Yin, Xiaozhou Wei, Pierluigi Longo, A. Bhuvanesh · 2006 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  26. Untitled work
    2012 · ANU Open Research (Australian National University)
  27. THE TIMING OF FACIAL MOTION IN POSED AND SPONTANEOUS SMILES
    Jeffrey F. Cohn, Karen L. Schmidt · 2003 · Active Media Technology
  28. Facial expression recognition for speaker using thermal image processing and speech recognition system
    Yasunari Yoshitomi · 2010
  29. Inference of personality traits and affect schedule by analysis of spontaneous reactions to affective videos
    Abadi, Mojtaba Khomami, Correa, Juan Abdon Miranda, Wache, Julia, Heng Yang, Patras, Ioannis, Sebe, Nicu · 2015 · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  30. A unified probabilistic framework for measuring the intensity of spontaneous facial action units
    Yongqiang Li, Mavadati, S. Mohammad, Mahoor, Mohammad H., Ji, Qiang · 2013 · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  31. Multi-instance Hidden Markov Model for facial expression recognition
    Chongliang Wu, Shangfei Wang, Qiang Ji · 2015 · International Conference on Automatic Face and Gesture Recognition
  32. A feasibility study in using facial expressions analysis to evaluate player experiences
    Chek Tien Tan, Daniel Rosser, Sander C. J. Bakkes, Yusuf Pisan · 2012 · Australasian Conference On Interactive Entertainment
  33. A multimodal fuzzy inference system using a continuous facial expression representation for emotion detection
    Soladié, Catherine, Salam, Hanan, Pelachaud, Catherine, Stoiber, Nicolas, Séguier, Renaud · 2012 · Proceedings of the 14th ACM international conference on Multimodal interaction
  34. 3D facial expression recognition using swarm intelligence
    Iordanis Mpiperis, Sotiris Malassiotis, Vassilios Petridis, M.G. Strintzis · 2008 · IEEE International Conference on Acoustics Speech and Signal Processing
  35. Bimodal Emotion Recognition by Man and Machine
    Thomas S. Huang, Lawrence S. Chen, Tao Hai, Tsutomu Miyasato, Ryohei Nakatsu · 1998
  36. A Validated Method for Dense Non-rigid 3D Face Registration
    Tena, J., Hamouz, Miroslav, Hilton, Adrian, Illingworth, John · 2006 · 2006 IEEE International Conference on Video and Signal Based Surveillance
  37. Inferring mood in ubiquitous conversational video
    Dairazalia Sánchez-Cortés, Joan-Isaac Biel, Shiro Kumano, Junji Yamato, Kazuhiro Otsuka, Daniel Gática-Pérez · 2013 · International Conference on Mobile and Ubiquitous Multimedia (MUM)
  38. Communication and Automatic Interpretation of Affect from Facial Expressions
    Albert Ali Salah, Nicu Sebe, Theo Gevers · 2011 · IGI Global eBooks
  39. 3D facial expression recognition using Zernike moments on depth images
    Nicholas Vretos, Nikos Nikolaidis, Ioannis Pitas · 2011 · Proceedings - International Conference on Image Processing
  40. Untitled work
    2000
  41. A unified probabilistic framework for automatic 3D facial expression analysis based on a Bayesian belief inference and statistical feature models
    Zhao, Xi, Dellandréa, Emmanuel, Zou, Jianhua, Chen, Liming · 2013 · Image and Vision Computing
  42. Spontaneous facial expression analysis based on temperature changes and head motions
    Peng Liu, Lijun Yin · 2015 · IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  43. Towards an affective interface for assessment of psychological distress
    Gale Lucas, Jonathan S. Gratch, Stefan J. Scherer, Jill Boberg, Giota Stratou · 2015 · International Conference on Affective Computing and Intelligent Interaction and workshops
  44. Continuous Generalized Procrustes analysis
    Laura Igual, Xavier Perez-Sala, Sérgio Escalera · 2013 · Pattern Recognition
  45. Dynamic facial expression recognition by joint static and multi-time gap transition classification
    Dapogny, Arnaud, Bailly, Kevin, Dubuisson, Severine · 2015 · 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
  46. A facial expression recognition for a speaker of a phoneme of vowel using thermal image processing and a speech recognition system
    Y. Koda, Yasunari Yoshitomi, Mikio Nakano · 2009 · IEEE RO-MAN
  47. Group Expression Intensity Estimation in Videos via Gaussian Processes
    Abhinav Dhall, Roland Goecke · 2012
  48. Robust facial action recognition from real-time 3D streams
    Filareti Tsalakanidou, Sotiris Malassiotis · 2009 · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
  49. Why is facial expression analysis in the wild challenging?
    Gehrig, Tobias, Ekenel, Hazım Kemal · 2013 · Proceedings of the 2013 on Emotion recognition in the wild challenge and workshop
  50. Non-rigid registration of 3D surfaces by deformable 2D triangular meshes
    Arman Savran, Bülent Sankur · 2008 · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
  51. Clustering of video-patches on Grassmannian manifold for facial expression recognition from 3D videos
    Hayat, Munawar, Bennamoun, Mohammed, El-Sallam, Amar A. · 2013 · 2013 IEEE Workshop on Applications of Computer Vision (WACV)
  52. Adaptive Registration for Occlusion Robust 3D Face Recognition
    Neşe Alyüz, Berk Gökberk, Lale Akarun · 2012 · Lecture notes in computer science
  53. Constructing dense correspondences to analyze 3D facial change
    Zhili Mao, Julia Siebert, W.P. Cockshott · 2004 · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition
  54. Comparative Anatomy of the Face
    Anne M. Burrows, Jeffrey F. Cohn · 2015 · Encyclopedia of Biometrics
  55. Estimation of facial action intensities on 2d and 3D data
    Bilge, Mustafa, Sankur, B., Savran, Arman · 2011 · Zenodo
  56. Intensity measurement of spontaneous facial actions: Evaluation of different image representations
    Zaker, Nazanin, Mahoor, Mohammad H., Mattson, Whitney I., Messinger, Daniel S., Cohn, Jeffrey F. · 2012 · 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL)
  57. Nonlinear Nonnegative Component Analysis
    Stefanos P. Zafeiriou, Maria Petrou · 2009 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  58. Fast and Robust Smile Intensity Estimation by Cascaded Support Vector Machines
    Shimada, Keiji, Noguchi, Yoshihiro, Kuria, Takio · 2013 · International Journal of Computer Theory and Engineering
  59. Toward a Universal Language of Motion: Reflections on a Seventeenth-Century Muscle Man
    Stephen Greenblatt · 1994 · LiNQ (Literature in North Queensland)
  60. Communication and Automatic Interpretation of Affect from Facial Expressions
    Albert Ali Salah, Nicu Sebe, Theo Gevers · 2011 · IGI Global eBooks
  61. Comparative Anatomy of the Face
    Burrows, Anne M., Cohn, Jeffrey F. · 2014 · Encyclopedia of Biometrics