The DOI matches its Crossref record; 126 of the 126 references it cites were found in a registry or an index.
Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms
Open accessAbstract
Unlike the conventional facial expressions, micro-expressions are involuntary and transient facial expressions capable of revealing the genuine emotions that people attempt to hide. Therefore, they can provide important information in a broad range of applications such as lie detection, criminal detection, etc. Since micro-expressions are transient and of low intensity, however, their detection and recognition is difficult and relies heavily on expert experiences. Due to its intrinsic particularity and complexity, video-based micro-expression analysis is attractive but challenging, and has recently become an active area of research. Although there have been numerous developments in this area, thus far there has been no comprehensive survey that provides researchers with a systematic overview of these developments with a unified evaluation. Accordingly, in this survey paper, we first highlight the key differences between macro- and micro-expressions, then use these differences to guide our research survey of video-based micro-expression analysis in a cascaded structure, encompassing the neuropsychological basis, datasets, features, spotting algorithms, recognition algorithms, applications and evaluation of state-of-the-art approaches. For each aspect, the basic techniques, advanced developments and major challenges are addressed and discussed. Furthermore, after considering the limitations of existing micro-expression datasets, we present and release a new dataset — calledmicro-and-macro expression warehouse(MMEW) — containing more video samples and more labeled emotion types. We then perform a unified comparison of representative methods on CAS(ME)$^2$for spotting, and on MMEW and SAMM for recognition, respectively. Finally, some potential future research directions are explored and outlined.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
Self-citationCootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., & Matthews, I. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops · doi:10.1109/cvprw.2010.5543262 · Cited by 4,303
What are emotions? And how can they be measured?
Scherer, K. R. (2005) · Social Science Information · doi:10.1177/0539018405058216 · Cited by 4,264
The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life
Ekman, P. (2003) · Cited by 2,237
Detection and Tracking of Point Features
Tomasi, C. (1991) · Cited by 2,231
Pattern Classification (2nd Edition)
Duda, R. O., Hart, P. E., & Stork, D. G. (2000) · Wiley-Interscience eBooks · Cited by 2,070
Ekman, P., & Rosenberg, E. L. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195179644.001.0001 · Cited by 1,941
Nonverbal Leakage and Clues to Deception †
Ekman, P., & Friesen, W. V. (1969) · Psychiatry · doi:10.1080/00332747.1969.11023575 · Cited by 1,854
Deep Facial Expression Recognition: A Survey
Li, S., & Deng, W. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.2981446 · Cited by 1,753
Graph-based approach for airborne light detection and ranging segmentation
Vilariño, D. L., Cabaleiro, J. C., Martínez, J., Rivera, F. F., & Pena, T. F. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.015020 · Cited by 1,721
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,716
Wright, J. N., Ganesh, A., Rao, S., Peng, Y., & Ma, Y. (2009) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1,495
CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation
Yan, W.-J., Li, X., Wang, S.-J., Zhao, G., Liu, Y.-J., Chen, Y.-H., & Fu, X. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086041 · Cited by 993 · cited 5×
“Here, we evaluate three alignment algorithms, namely ASM+LWM [32], DRMF+Optical flow alignment (OFA) [85] and joint cascade face detection and alignment (JCFDA) [113], for face alignment on the MMEW dataset.”
BackgroundMethodResultInfluentialSelf-citationDoretto, G., Chiuso, A., Wu, Y. N., & Soatto, S. (2003) · International Journal of Computer Vision · doi:10.1023/a:1021669406132 · Cited by 885
Rinn, W. E. (1984) · Psychological Bulletin · doi:10.1037//0033-2909.95.1.52 · Cited by 772
The Expression Of The Emotions In Man And Animals
Darwin, C. (1998) · doi:10.1093/oso/9780195112719.001.0001 · Cited by 732
Detecting deception from the body or face.
Ekman, P., & Friesen, W. V. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0036006 · Cited by 730
Feature Detection and Tracking with Constrained Local Models
Cristinacce, D., & Cootes, T. F. (2006) · Procedings of the British Machine Vision Conference 2006 · doi:10.5244/c.20.95 · Cited by 718
SAMM: A Spontaneous Micro-Facial Movement Dataset
Davison, A. K., Lansley, C., Costen, N., Tan, K., & Yap, M. H. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2573832 · Cited by 708
A Spontaneous Micro-expression Database: Inducement, collection and baseline
Li, X., Pfister, T., Huang, X., Zhao, G., & Pietikainen, M. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553717 · Cited by 665
The Expression Of The Emotions In Man And Animals
Darwin, C. (1998) · The Expression Of The Emotions In Man And Animals · doi:10.1093/oso/9780195112719.002.0002 · Cited by 650
Darwin, Deception, and Facial Expression
EKMAN, P. (2003) · Annals of the New York Academy of Sciences · doi:10.1196/annals.1280.010 · Cited by 624
Chaudhry, R., Ravichandran, A., Hager, G., & Vidal, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206821 · Cited by 621
Sun, D., Roth, S., & Black, M. J. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-013-0644-x · Cited by 614
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · arXiv · doi:10.48550/arxiv.1902.04885 · Cited by 600
Self-citationRobust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
Liu, Y.-J., Zhang, J.-K., Yan, W.-J., Wang, S.-J., Zhao, G., & Fu, X. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2485205 · Cited by 520
Self-citationPorter, S., & ten Brinke, L. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02116.x · Cited by 463
Recognising spontaneous facial micro-expressions
Pfister, T., Li, X., Zhao, G., & Pietikainen, M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126401 · Cited by 450
How Fast are the Leaked Facial Expressions: The Duration of Micro-Expressions
Yan, W.-J., Wu, Q., Liang, J., Chen, Y.-H., & Fu, X. (2013) · Journal of Nonverbal Behavior · doi:10.1007/s10919-013-0159-8 · Cited by 445
Joint Cascade Face Detection and Alignment
Chen, D., Ren, S., Wei, Y., Cao, X., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_8 · Cited by 405
The ability to detect deceit generalizes across different types of high-stake lies.
Frank, M. G., & Ekman, P. (1997) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.72.6.1429 · Cited by 403
Multi-Directional Multi-Level Dual-Cross Patterns for Robust Face Recognition
Ding, C., Choi, J., Tao, D., & Davis, L. S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2462338 · Cited by 381
CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces
Yan, W.-J., Wu, Q., Liu, Y.-J., Wang, S.-J., & Fu, X. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553799 · Cited by 338
Self-citationLie Catching and Microexpressions
Ekman, P. (2009) · The Philosophy of Deception · doi:10.1093/acprof:oso/9780195327939.003.0008 · Cited by 332
Li, X., Hong, X., Moilanen, A., Huang, X., Pfister, T., Zhao, G., & Pietikainen, M. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2667642 · Cited by 323
Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor
Polikovsky, S., Kameda, Y., & Ohta, Y. (2009) · 3rd International Conference on Imaging for Crime Detection and Prevention (ICDP 2009) · doi:10.1049/ic.2009.0244 · Cited by 312
Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns
Huang, X., Zhao, G., Hong, X., Zheng, W., & Pietikäinen, M. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.10.096 · Cited by 303
Wang, Y., See, J., Phan, R. C.-W., & Oh, Y.-H. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16865-4_34 · Cited by 295
CAS(ME): A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition
Qu, F., Wang, S.-J., Yan, W.-J., Li, H., Wu, S., & Fu, X. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2654440 · Cited by 293
Self-citationDeep facial expression recognition: a survey
Shan, L., 北京邮电大学人工智能学院, 北. 1. S. O. A. I., & Weihong, D. (2020) · Journal of Image and Graphics · doi:10.11834/jig.200233 · Cited by 291
Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions
Xia, Z., Hong, X., Gao, X., Feng, X., & Zhao, G. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2931351 · Cited by 290
Microexpression Identification and Categorization Using a Facial Dynamics Map
Xu, F., Zhang, J., & Wang, J. Z. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2518162 · Cited by 283
Self-citationDeception Detection using Real-life Trial Data
Pérez-Rosas, V., Abouelenien, M., Mihalcea, R., & Burzo, M. (2015) · Proceedings of the 2015 ACM on International Conference on Multimodal Interaction · doi:10.1145/2818346.2820758 · Cited by 269
Explanation Methods in Deep Learning: Users, Values, Concerns and Challenges
Ras, G., van Gerven, M., & Haselager, P. (2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4_2 · Cited by 255
Evidence for training the ability to read microexpressions of emotion
Matsumoto, D., & Hwang, H. S. (2011) · Motivation and Emotion · doi:10.1007/s11031-011-9212-2 · Cited by 245
Enriched Long-Term Recurrent Convolutional Network for Facial Micro-Expression Recognition
Khor, H.-Q., See, J., Phan, R. C. W., & Lin, W. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00105 · Cited by 230
Macro- and micro-expression spotting in long videos using spatio-temporal strain
Shreve, M., Godavarthy, S., Goldgof, D., & Sarkar, S. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771451 · Cited by 218
CapsuleNet for Micro-Expression Recognition
Quang, N. V., Chun, J., & Tokuyama, T. (2019) · 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019) · doi:10.1109/fg.2019.8756544 · Cited by 215
Huang, X., Wang, S.-J., Zhao, G., & Piteikainen, M. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.10 · Cited by 203
Self-citationDifferentiating emotion elicited and deliberate emotional facial expressions
Hess, U., & Kleck, R. E. (1990) · European Journal of Social Psychology · doi:10.1002/ejsp.2420200502 · Cited by 200
Kim, D. H., Baddar, W. J., & Ro, Y. M. (2016) · Proceedings of the 24th ACM international conference on Multimedia · doi:10.1145/2964284.2967247 · Cited by 198
Huang, X., Wang, S.-J., Liu, X., Zhao, G., Feng, X., & Pietikainen, M. (2019) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2713359 · Cited by 194
Self-citationMicro-Expression Recognition Using Color Spaces
Wang, S.-J., Yan, W.-J., Li, X., Zhao, G., Zhou, C.-G., Fu, X., Yang, M., & Tao, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2496314 · Cited by 193
Self-citationDetecting Deception from Emotional and Unemotional Cues
Warren, G., Schertler, E., & Bull, P. (2009) · Journal of Nonverbal Behavior · doi:10.1007/s10919-008-0057-7 · Cited by 189
Selective deep features for micro-expression recognition
Patel, D., Hong, X., & Zhao, G. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899972 · Cited by 189
Dual Temporal Scale Convolutional Neural Network for Micro-Expression Recognition
Peng, M., Wang, C., Chen, T., Liu, G., & Fu, X. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01745 · Cited by 185
Wang, S.-J., Chen, H.-L., Yan, W.-J., Chen, Y.-H., & Fu, X. (2014) · Neural Processing Letters · doi:10.1007/s11063-013-9288-7 · Cited by 178
Self-citationLEARNet: Dynamic Imaging Network for Micro Expression Recognition
Verma, M., Vipparthi, S. K., Singh, G., & Murala, S. (2019) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2912358 · Cited by 173
Active Shape Models with SIFT Descriptors and MARS
Milborrow, S., & Nicolls, F. (2014) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0004680003800387 · Cited by 166
A Survey of Automatic Facial Micro-Expression Analysis: Databases, Methods, and Challenges
Oh, Y.-H., See, J., Le Ngo, A. C., Phan, R. C. W., & Baskaran, V. M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.01128 · Cited by 163
Wang, S., Li, B., Liu, Y., Yan, W., Ou, X., Huang, X., Xu, F., & Fu, X. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.107 · Cited by 162
Self-citationFrom Macro to Micro Expression Recognition: Deep Learning on Small Datasets Using Transfer Learning
Peng, M., Wu, Z., Zhang, Z., & Chen, T. (2018) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2018.00103 · Cited by 158
Learning From Hierarchical Spatiotemporal Descriptors for Micro-Expression Recognition
Zong, Y., Huang, X., Zheng, W., Cui, Z., & Zhao, G. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2820321 · Cited by 155
Can Micro-Expression be Recognized Based on Single Apex Frame?
Li, Y., Huang, X., & Zhao, G. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451376 · Cited by 147
Efficient Spatio-Temporal Local Binary Patterns for Spontaneous Facial Micro-Expression Recognition
Wang, Y., See, J., Phan, R. C. ‐., & Oh, Y.-H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0124674 · Cited by 146
Automatic apex frame spotting in micro-expression database
Liong, S., See, J., Wong, K., Ngo, A. C. L., Oh, Y.-H., & Phan, R. C. ‐. (2015) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2015.7486586 · Cited by 143
A survey: facial micro-expression recognition
Takalkar, M. A., Xu, M. G., Wu, Q., & Chaczko, Z. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-5317-2 · Cited by 133
Nonverbal leakage and clues to deception
Ekman, P., & Friesen, W. V. (1969) · PsycEXTRA Dataset · doi:10.1037/e525532009-012 · Cited by 130
Spotting Rapid Facial Movements from Videos Using Appearance-Based Feature Difference Analysis
Moilanen, A., Zhao, G., & Pietikäinen, M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.303 · Cited by 125
Towards macro- and micro-expression spotting in video using strain patterns
Shreve, M., Godavarthy, S., Manohar, V., Goldgof, D., & Sarkar, S. (2009) · 2009 Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2009.5403044 · Cited by 124
Wang, S., Yan, W., Zhao, G., Fu, X., & Zhou, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16178-5_23 · Cited by 109
Self-citationSubtle Expression Recognition Using Optical Strain Weighted Features
Liong, S., See, J., Phan, R. C. ‐., Ngo, A. C. L., Oh, Y.-H., & Wong, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16631-5_47 · Cited by 106
Ekman, P., & O’Sullivan, M. (2006) · Behavioral Sciences & the Law · doi:10.1002/bsl.729 · Cited by 102
A Causal Dirichlet Mixture Model for Causal Inference from Observational Data
Lin, A., Lü, J., Xuan, J., Zhu, F., & Zhang, G. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3379500 · Cited by 102
A main directional maximal difference analysis for spotting facial movements from long-term videos
Wang, S., Wu, S., Qian, X., Li, J., & Fu, X. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.12.034 · Cited by 99
Self-citationSparse MDMO: Learning a Discriminative Feature for Spontaneous Micro-Expression Recognition
Liu, Y., Li, B.-J., & Lai, Y. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2854166 · Cited by 97
Self-citationChaudhry, R., Ravichandran, A., Hager, G., et al. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206821 · Cited by 94
Facial Micro-Expression Detection in Hi-Speed Video Based on Facial Action Coding System (FACS)
Polikovsky, S., Kameda, Y., & Ohta, Y. (2012) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e96.d.81 · Cited by 82
Domain Regeneration for Cross-Database Micro-Expression Recognition
Zong, Y., Zheng, W., Huang, X., Shi, J., Cui, Z., & Zhao, G. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2797479 · Cited by 81
Spontaneous micro-expression spotting via geometric deformation modeling
Xia, Z., Feng, X., Peng, J., Peng, X., & Zhao, G. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.12.006 · Cited by 72
Executing Facial Control During Deception Situations
Hurley, C. M., & Frank, M. G. (2011) · Journal of Nonverbal Behavior · doi:10.1007/s10919-010-0102-1 · Cited by 70
Eulerian emotion magnification for subtle expression recognition
Ngo, A. C. L., Oh, Y.-H., Phan, R. C. ‐., & See, J. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7471875 · Cited by 69
Spatiotemporal Integration of Optical Flow Vectors for Micro-expression Detection
Patel, D., Zhao, G., & Pietikäinen, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25903-1_32 · Cited by 66
Micro-Facial Movement Detection Using Individualised Baselines and Histogram-Based Descriptors
Davison, A. K., Yap, M. H., & Lansley, C. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.326 · Cited by 65
Automatic expression spotting in videos
Shreve, M., Brizzi, J., Fefilatyev, S., Luguev, T. S., Goldgof, D. B., & Sarkar, S. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.04.010 · Cited by 63
Ben, X., Jia, X., Yan, R., Zhang, X., & Meng, W. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.07.010 · Cited by 61
Self-citationQuantifying Micro-expressions with Constraint Local Model and Local Binary Pattern
Yan, W., Wang, S., Chen, Y.-H., Zhao, G., & Fu, X. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16178-5_20 · Cited by 59
Self-citationMonogenic Riesz wavelet representation for micro-expression recognition
Oh, Y.-H., Ngo, A. C. L., See, J., Liong, S., Phan, R. C. ‐., & Ling, H.-C. (2015) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2015.7252078 · Cited by 57
Spatiotemporal feature extraction for facial expression recognition
Kamarol, S. K. A., Jaward, M. H., Parkkinen, J. P. S., & Parthiban, R. (2016) · IET Image Processing · doi:10.1049/iet-ipr.2015.0519 · Cited by 56
Ben, X., Zhang, P., Yan, R., Yang, M., & Ge, G. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-2031-8 · Cited by 55
Self-citationWojciechowski, J., Stolarski, M., & Matthews, G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092570 · Cited by 53
Multi-task mid-level feature learning for micro-expression recognition
He, J., Hu, J., Lu, X., & Zheng, W. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.11.029 · Cited by 53
Micro-expression recognition based on CBP-TOP feature with ELM
Guo, Y., Xue, C., Wang, Y., & Yu, M. (2015) · Optik · doi:10.1016/j.ijleo.2015.08.167 · Cited by 51
Silent talker: a new computer-based system for the analysis of facial cues to deception
Rothwell, J., Bandar, Z. A., O’Shea, J. D., & McLean, D. (2006) · Applied Cognitive Psychology · doi:10.1002/acp.1204 · Cited by 51
Macro-to-micro transformation model for micro-expression recognition
Jia, X., Ben, X., Yuan, H., Kpalma, K., & Meng, W. (2017) · Journal of Computational Science · doi:10.1016/j.jocs.2017.03.016 · Cited by 51
Self-citationA Delaunay-Based Temporal Coding Model for Micro-expression Recognition
Lu, Z., Luo, Z., Zheng, H., Chen, J., & Li, W. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16631-5_51 · Cited by 49
Study of Facial Micro-expressions in Psychology
Bhushan, B. (2014) · Springer eBooks · doi:10.1007/978-81-322-1934-7_13 · Cited by 44
Capturing correlations of local features for image representation
Hong, X., Zhao, G., Zafeiriou, S. P., Pantić, M., & Pietikäinen, M. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.07.134 · Cited by 43
Encoding Local Binary Patterns using the re-parametrization of the second order Gaussian jet
Ruiz-Hernandez, J. A., & Pietikäinen, M. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553709 · Cited by 39
Micro-Expression Recognition by Aggregating Local Spatio-Temporal Patterns
Zhang, S., Feng, B., Chen, Z., & Huang, X. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-51811-4_52 · Cited by 37
Micro-expression recognition system
Zhang, P., Ben, X., Yan, R., Wu, C. H., & Guo, C. Y. (2015) · Optik · doi:10.1016/j.ijleo.2015.10.217 · Cited by 34
Self-citationToward Bridging Microexpressions From Different Domains
Zong, Y., Zheng, W., Cui, Z., Zhao, G., & Hu, B. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2914512 · Cited by 32
Insights on Spontaneous Facial Expressions from Automatic Expression Measurement
Bartlett, M. S., Littlewort, G. C., Vural, E., Whitehill, J., Wu, T., Lee, K., & Movellan, J. R. (2010) · The MIT Press eBooks · doi:10.7551/mitpress/9780262014533.003.0015 · Cited by 26
Multi-task Micro-expression Recognition Combining Deep and Handcrafted Features
Hu, C., Jiang, D., Zou, H., Zuo, X., & Shu, Y. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8545555 · Cited by 24
Coupled source domain targetized with updating tag vectors for micro-expression recognition
Zhu, X., Ben, X., Liu, S., Yan, R., & Meng, W. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4943-z · Cited by 22
Self-citationCFD: A Collaborative Feature Difference Method for Spontaneous Micro-Expression Spotting
Han, Y., Li, B., Lai, Y., & Liu, Y. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451065 · Cited by 22
Self-citationEmotion recognition using fixed length micro-expressions sequence and weighting method
Chen, M., Ma, H. T., Li, J., & Wang, H. (2016) · IEEE International Conference on Real-time Computing and Robotics (RCAR) · doi:10.1109/rcar.2016.7784067 · Cited by 21
Facial Micro-expression Spotting and Recognition Using Time Contrasted Feature with Visual Memory
Nag, S., Bhunia, A. K., Konwer, A., & Roy, P. P. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683737 · Cited by 19
Intrinsic two-dimensional local structures for micro-expression recognition
Oh, Y.-H., Ngo, A. C. L., Phari, R. C.-W., See, J., & Ling, H.-C. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7471997 · Cited by 17
Differentiating Emotion Elicited and Deliberate Emotional Facial Expressions
Hess, U. S., & Kleck, R. E. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195179644.003.0013 · Cited by 16
Polikovsky, S., Kameda, Y., & Ohta, Y. (2010) · 電子情報通信学会技術研究報告. HIP, ヒューマン情報処理 · Cited by 13
Zeng, X., Wu, Q., Zhang, S., Liu, Z., Zhou, Q., & Zhang, M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02015 · Cited by 13
Discriminative Video Representation with Temporal Order for Micro-expression Recognition
Niu, M., Tao, J., Li, Y., Huang, J., & Lian, Z. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682295 · Cited by 13
(2014) · doi:10.5555/2627435.2697065
Cited by
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
Pan, B., Hirota, K., Jia, Z., & Dai, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126866 · Cited by 142
Saffaryazdi, N., Wasim, S. T., Dileep, K., Nia, A. F., Nanayakkara, S., Broadbent, E., & Billinghurst, M. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.864047 · Cited by 69
Metadata
- Authors
- Ben, X., Ren, Y., Zhang, J., Wang, S.-J., Kpalma, K., Meng, W., & Liu, Y.-J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021
- Volume
- 44
- Issue
- 9
- Pages
- 1-1
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W3137274787
- Cited by
- 306
- References
- 126
- FWCI
- 43.88
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.