The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Less is more: Micro-expression recognition from video using apex frame
Open accessAbstract
Despite recent interest and advances in facial micro-expression research, there is still plenty of room for improvement in terms of micro-expression recognition. Conventional feature extraction approaches for micro-expression video consider either the whole video sequence or a part of it, for representation. However, with the high-speed video capture of micro-expressions (100–200 fps), are all frames necessary to provide a sufficiently meaningful representation? Is the luxury of data a bane to accurate recognition? A novel proposition is presented in this paper, whereby we utilize only two images per video, namely, the apex frame and the onset frame. The apex frame of a video contains the highest intensity of expression changes among all frames, while the onset is the perfect choice of a reference frame with neutral expression. A new feature extractor, Bi-Weighted Oriented Optical Flow (Bi-WOOF) is proposed to encode essential expressiveness of the apex frame. We evaluated the proposed method on five micro-expression databases—CAS(ME) 2 , CASME II, SMIC-HS, SMIC-NIR and SMIC-VIS. Our experiments lend credence to our hypothesis, with our proposed technique achieving a state-of-the-art F1-score recognition performance of 0.61 and 0.62 in the high frame rate CASME II and SMIC-HS databases respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Least Squares Support Vector Machine Classifiers
Suykens, J. A. K., & Vandewalle, J. (1999) · Neural Processing Letters · doi:10.1023/a:1018628609742 · Cited by 9,362
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Constants across cultures in the face and emotion.
Ekman, P., & Friesen, W. V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030377 · Cited by 5,509
Ekman, P. (1993) · American Psychologist · doi:10.1037/0003-066x.48.4.384 · Cited by 3,441
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Computer vision and pattern recognition
Zheng, N., Loizou, G., Jiang, X., Lan, X., & Li, X. (2007) · International Journal of Computer Mathematics · doi:10.1080/00207160701303912 · Cited by 2,463
Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life
Ekman, P. (2003) · Cited by 2,238
Nonverbal Leakage and Clues to Deception †
Ekman, P., & Friesen, W. V. (1969) · Psychiatry · doi:10.1080/00332747.1969.11023575 · Cited by 1,854
A Duality Based Approach for Realtime TV-L 1 Optical Flow
Zach, C., Pock, T., & Bischof, H. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74936-3_22 · Cited by 1,658 · cited 2×
“We employed TV-L1 [34] for optical flow approximation due to its two major advantages: better noise robustness and the ability to preserve flow discontinuities.”
CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation
Yan, W.-J., Li, X., Wang, S.-J., Zhao, G., Liu, Y.-J., Chen, Y.-H., & Fu, X. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086041 · Cited by 993
A Spontaneous Micro-expression Database: Inducement, collection and baseline
Li, X., Pfister, T., Huang, X., Zhao, G., & Pietikainen, M. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553717 · Cited by 665
Chaudhry, R., Ravichandran, A., Hager, G., & Vidal, R. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206821 · Cited by 621
Handbook of Mathematical Models in Computer Vision
(2006) · doi:10.1007/0-387-28831-7 · Cited by 574
Robust Discriminative Response Map Fitting with Constrained Local Models
Asthana, A., Zafeiriou, S., Cheng, S., & Pantic, M. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.442 · Cited by 557
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
Liu, Y.-J., Zhang, J.-K., Yan, W.-J., Wang, S.-J., Zhao, G., & Fu, X. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2485205 · Cited by 520
Porter, S., & ten Brinke, L. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02116.x · Cited by 463
Fleet, D., & Weiss, Y. (2005) · Handbook of Mathematical Models in Computer Vision · doi:10.1007/0-387-28831-7_15 · Cited by 372
CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces
Yan, W.-J., Wu, Q., Liu, Y.-J., Wang, S.-J., & Fu, X. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553799 · Cited by 338
Lie Catching and Microexpressions
Ekman, P. (2009) · The Philosophy of Deception · doi:10.1093/acprof:oso/9780195327939.003.0008 · Cited by 332
Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor
Polikovsky, S., Kameda, Y., & Ohta, Y. (2009) · 3rd International Conference on Imaging for Crime Detection and Prevention (ICDP 2009) · doi:10.1049/ic.2009.0244 · Cited by 312
Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized Patterns
Huang, X., Zhao, G., Hong, X., Zheng, W., & Pietikäinen, M. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.10.096 · Cited by 303
Wang, Y., See, J., Phan, R. C.-W., & Oh, Y.-H. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16865-4_34 · Cited by 295
Self-citationCAS(ME): A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition
Qu, F., Wang, S.-J., Yan, W.-J., Li, H., Wu, S., & Fu, X. (2018) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2654440 · Cited by 293
Image registration by local approximation methods
Goshtasby, A. (1988) · Image and Vision Computing · doi:10.1016/0262-8856(88)90016-9 · Cited by 291
Microexpression Identification and Categorization Using a Facial Dynamics Map
Xu, F., Zhang, J., & Wang, J. Z. (2017) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2518162 · Cited by 283
Huang, X., Wang, S.-J., Zhao, G., & Piteikainen, M. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.10 · Cited by 203
Micro-Expression Recognition Using Color Spaces
Wang, S.-J., Yan, W.-J., Li, X., Zhao, G., Zhou, C.-G., Fu, X., Yang, M., & Tao, J. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2496314 · Cited by 193
Police lie detection accuracy: The effect of lie scenario.
O'Sullivan, M., Frank, M. G., Hurley, C. M., & Tiwana, J. (2009) · Law and Human Behavior · doi:10.1007/s10979-008-9166-4 · Cited by 161
Automatic apex frame spotting in micro-expression database
Liong, S., See, J., Wong, K., Ngo, A. C. L., Oh, Y.-H., & Phan, R. C. ‐. (2015) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2015.7486586 · Cited by 132
Self-citationNonverbal leakage and clues to deception
Ekman, P., & Friesen, W. V. (1969) · PsycEXTRA Dataset · doi:10.1037/e525532009-012 · Cited by 130
Spotting Rapid Facial Movements from Videos Using Appearance-Based Feature Difference Analysis
Moilanen, A., Zhao, G., & Pietikäinen, M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.303 · Cited by 125
Towards macro- and micro-expression spotting in video using strain patterns
Shreve, M., Godavarthy, S., Manohar, V., Goldgof, D., & Sarkar, S. (2009) · 2009 Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2009.5403044 · Cited by 124
Wang, S., Yan, W., Zhao, G., Fu, X., & Zhou, C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16178-5_23 · Cited by 109
Subtle Expression Recognition Using Optical Strain Weighted Features
Liong, S., See, J., Phan, R. C. ‐., Ngo, A. C. L., Oh, Y.-H., & Wong, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16631-5_47 · Cited by 106
Self-citationA main directional maximal difference analysis for spotting facial movements from long-term videos
Wang, S., Wu, S., Qian, X., Li, J., & Fu, X. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.12.034 · Cited by 99
Chaudhry, R., Ravichandran, A., Hager, G., et al. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206821 · Cited by 94
Sparsity in Dynamics of Spontaneous Subtle Emotions: Analysis and Application
Ngo, A. C. L., See, J., & Phan, R. C. ‐. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2016.2523996 · Cited by 81
Self-citationOptical strain based recognition of subtle emotions
Liong, S., Phan, R. C. ‐., See, J., Oh, Y.-H., & Wong, K. (2014) · International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS) · doi:10.1109/ispacs.2014.7024448 · Cited by 77
Self-citationSpontaneous subtle expression detection and recognition based on facial strain
Liong, S., See, J., Phan, R. C. ‐., Oh, Y.-H., Ngo, A. C. L., Wong, K., & Tan, S. (2016) · Signal Processing Image Communication · doi:10.1016/j.image.2016.06.004 · Cited by 76
Self-citationSpontaneous Subtle Expression Recognition: Imbalanced Databases and Solutions
Ngo, A. C. L., Phan, R. C. ‐., & See, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16817-3_3 · Cited by 68
Self-citationAutomatic Micro-expression Recognition from Long Video Using a Single Spotted Apex
Liong, S., See, J., Wong, K., & Phan, R. C. ‐. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-54427-4_26 · Cited by 66
Self-citationMicro-Facial Movement Detection Using Individualised Baselines and Histogram-Based Descriptors
Davison, A. K., Yap, M. H., & Lansley, C. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.326 · Cited by 65
Automatic expression spotting in videos
Shreve, M., Brizzi, J., Fefilatyev, S., Luguev, T. S., Goldgof, D. B., & Sarkar, S. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.04.010 · Cited by 63
Quantifying Micro-expressions with Constraint Local Model and Local Binary Pattern
Yan, W., Wang, S., Chen, Y.-H., Zhao, G., & Fu, X. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16178-5_20 · Cited by 59
Monogenic Riesz wavelet representation for micro-expression recognition
Oh, Y.-H., Ngo, A. C. L., See, J., Liong, S., Phan, R. C. ‐., & Ling, H.-C. (2015) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2015.7252078 · Cited by 57
Self-citationBen, X., Zhang, P., Yan, R., Yang, M., & Ge, G. (2015) · Neural Computing and Applications · doi:10.1007/s00521-015-2031-8 · Cited by 55
Sparse tensor canonical correlation analysis for micro-expression recognition
Wang, S., Yan, W., Sun, T., Zhao, G., & Fu, X. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.05.083 · Cited by 54
Esposito, A. A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-71505-4_13 · Cited by 46
An Image-Based Visual Speech Animation System
Zhou, Z., Zhao, G., Guo, Y., & Pietikäinen, M. (2012) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2012.2199399 · Cited by 35
Micro-expression recognition system
Zhang, P., Ben, X., Yan, R., Wu, C. H., & Guo, C. Y. (2015) · Optik · doi:10.1016/j.ijleo.2015.10.217 · Cited by 34
Reading Hidden Emotions: Spontaneous Micro-expression Spotting and Recognition.Preprint
Li, X., Hong, X., Moilanen, A., Huang, X., Pfister, T., Zhao, G., & Pietikäinen, M. (2015) · arXiv (Cornell University) · Cited by 25
Are subtle expressions too sparse to recognize?
Ngo, A. C. L., Liong, S., See, J., & Phan, R. C. ‐. (2015) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2015.7252080 · Cited by 18
Self-citation
Cited by
OFF-ApexNet on micro-expression recognition system
Gan, Y. S., Liong, S.-T., Yau, W.-C., Huang, Y.-C., & Tan, L.-K. (2019) · Signal Processing: Image Communication · doi:10.1016/j.image.2019.02.005 · Cited by 303
Self-citationSpatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions
Xia, Z., Hong, X., Gao, X., Feng, X., & Zhao, G. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2931351 · Cited by 290
Shallow Triple Stream Three-dimensional CNN (STSTNet) for Micro-expression Recognition
Liong, S.-T., Gan, Y. S., See, J., Khor, H.-Q., & Huang, Y.-C. (2019) · 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019) · doi:10.1109/fg.2019.8756567 · Cited by 253
Self-citationRecognizing Facial Expressions Using a Shallow Convolutional Neural Network
Miao, S., Xu, H., Han, Z., & Zhu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2921220 · Cited by 110
Metadata
- Authors
- Liong, S.-T., See, J., Wong, K., & Phan, R. C.-W.
- Venue
- Signal Processing: Image Communication
- Publisher
- Elsevier BV
- Published
- 2018-03
- Volume
- 62
- Pages
- 82-92
- ISSN
- 0923-5965 (ISSN-L)
- OpenAlex
- W2478411578
- Cited by
- 394
- References
- 53
- FWCI
- 25.48
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.