The DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index.
Towards macro- and micro-expression spotting in video using strain patterns
Abstract
This paper presents a novel method for automatic spotting (temporal segmentation) of facial expressions in long videos comprising of continuous and changing expressions. The method utilizes the strain impacted on the facial skin due to the non-rigid motion caused during expressions. The strain magnitude is calculated using the central difference method over the robust and dense optical flow field of each subjects face. Testing has been done on 2 datasets (which includes 100 macro-expressions) and promising results have been obtained. The method is robust to several common drawbacks found in automatic facial expression segmentation including moderate in-plane and out-of-plane motion. Additionally, the method has also been modified to work with videos containing micro-expressions. Micro-expressions are detected utilizing their smaller spatial and temporal extent. A subject's face is divided in to sub-regions (mouth, cheeks, forehead, and eyes) and facial strain is calculated for each of these regions. Strain patterns in individual regions are used to identify subtle changes which facilitate the detection of micro-expressions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Before the publication of the CASME and the SMIC dataset in 2013, methods were usually trained with posed non-public data [245], [246], [248].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [245]
In the citing paper
“For this reason, a main trend in microexpression analysis is to use appearance representations captured locally in a dynamic way [245], [246], [247].”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [245]
In the citing paper
“Detection and classification of posed [245], [246], [248] and more recently spontaneous microexpressions [247] have been proposed.”
From Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications (2016) · cites this paper as [245]
Citations
Cites
Performance of optical flow techniques
Barron, J. L., Fleet, D. J., & Beauchemin, S. S. (1994) · International Journal of Computer Vision · doi:10.1007/bf01420984 · Cited by 4,305
Ekman, P., & Friesen, W. V. (1975) · Cited by 3,569
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,716
The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields
Black, M. J., & Anandan, P. (1996) · Computer Vision and Image Understanding · doi:10.1006/cviu.1996.0006 · Cited by 1,607
A 3D Facial Expression Database For Facial Behavior Research
Yin, L., Wei, X., Sun, Y., Wang, J., & Rosato, M. J. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.6 · Cited by 1,171
Porter, S., & ten Brinke, L. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02116.x · Cited by 499
Facial expressions of emotion: an old controversy and new findings
Ekman, P. (1992) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.1992.0008 · Cited by 432
Tissue elasticity reconstruction using linear perturbation method
Kallel, F., & Bertrand, M. J. (1996) · IEEE Transactions on Medical Imaging · doi:10.1109/42.500139 · Cited by 330
Facial expression recognition using a dynamic model and motion energy
Essa, I. A., & Pentland, A. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466916 · Cited by 253
Facial expression decomposition
Wang, H., & Ahuja (2003) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2003.1238452 · Cited by 199
Research works printed but not linked: 1
- 0, Optical Flow source
Cited by
Sorted by citations
Items 101–124 of 124
Detection of facial parts via deformable part model using part annotation
Nishida, K., Enami, N., & Ariki, Y. (2015) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.1109/apsipa.2015.7415501 · Cited by 1
Micro Expression Recognition Using the Eulerian Video Magnification Method
Zarezadeh, E., & Rezaeian, M. (2016) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 1
Neurological and Mental Disorders
Bernstam, V. A. (2019) · CRC Press eBooks · doi:10.1201/9780429187421-25 · Cited by 1
Micro-Expression Spotting Based on VoVNet, Driven by Multi-Scale Features
Yang, J., Wu, Z., & Wu, R. (2023) · Electronics · doi:10.3390/electronics12214459 · Cited by 1
Facial Micro-Expression Analysis
Li, J. (2019) · theses.fr (ABES) · doi:10.70675/c6be032dzaef5z41a8za74cz1bc6decd5ee4 · Cited by 1
The Application of Evolutionary Algorithms to the Classification of Emotion from Facial Expressions
Shi, C. (2014) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Achieving excellence through collaboration.
Topi, H. (2010) · ACM Inroads
Micro-expressions recognition using center symmetric local mapped pattern
Goh, K. M., & Lim, L. L. (2019) · International Conference on Machine Vision · doi:10.1117/12.2522843
Neurological and mental disorders
Ramachandran, T. S. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199655786.003.0036
Neurological and Mental Disorders
Fatima-Shad, K., & Doğan, K. H. (2019) · IntechOpen eBooks · doi:10.5772/intechopen.87273
Composite Binary Pattern Assisted Micro-Expressions Spotting Through Feature Difference Analysis
Seelothu, S., & Rao, K. V. (2021) · Journal of University of Shanghai for Science and Technology · doi:10.51201/jusst/21/07171
Detection of Kinship through Microexpression Using Colour Features and Extreme Learning Machine
Fibriani, I., Mardiyanto, R., & Purnomo, M. H. (2021) · International Seminar on Intelligent Technology and Its Applications · doi:10.1109/isitia52817.2021.9502247
Micro-expression Detection Using Main Directional Maximal Differential Analysis (MDMD) Method
Mohta, R., Singla, R., Thareja, P., & Lamba, P. S. (2021) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-76167-7_5
Understanding the Dynamics of Gross and Informal Employment Clusters
Guerrero, P. A. J., Montenegro, B. D. N., Samaniego, J. M. G., & Gómez, H. F. (2023) · Smart innovation, systems and technologies · doi:10.1007/978-981-99-5414-8_8
ExpressionFlow: A Microexpression Descriptor for Efficient Recognition
Xu, F., Yuan, Y., Zhang, J., & Wang, J. Z. (2023) · Springer eBooks · doi:10.1007/978-3-031-50269-9_8
Micro-expressions spotting: Unveiling hidden emotions and thoughts
Malik, P., & Singh, J. (2024) · CRC Press eBooks · doi:10.1201/9781003471059-77
Chang, H., Xie, Z., & Yang, F. (2025) · Complex & Intelligent Systems · doi:10.1007/s40747-025-01855-3
Yi, H., Dou, Y., Yan, N., & Wang, X. (2025) · Research Square · doi:10.21203/rs.3.rs-6539700/v1
Macro and Micro-Expressions Spotting Based on Cross-Attention Transformer Progressive Fusion Network
Lv, Q., Zhou, Z., Li, C.-C., & Xie, Z. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9794-6_21
Robust Micro-expression Recognition Based on Fused Optimized VGG16 Architecture
Zhang, S., Liang, S., Shi, J., & Li, X. (2025) · Journal of intelligence and knowledge engineering. · doi:10.62517/jike.202504406
Analysis of Micro-Expressions based on the Riesz Pyramid : Application to Spotting and Recognition
Duque, C. A. (2018) · theses.fr (ABES) · doi:10.70675/7a5de57ezd0d3z4109zbcbezee32fab1669b · Cited by 1
Perception des émotions chez les petits ruminants
Bellegarde, L. (2017) · theses.fr (ABES) · doi:10.70675/1f98fe1ezbb04z4e97zaa8ezdf734d486106
Torres-Carrión, P., Urbina, E. V. C., Vivar, S. M., Chalacán, L. J. M., Peña, E. F. R., & Tapia, S. A. A. (2026) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-026-05084-5
Metadata
- Authors
- Shreve, M., Godavarthy, S., Manohar, V., Goldgof, D., & Sarkar, S.
- Affiliations
- University of South Florida (US)
- Venue
- 2009 Workshop on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2009-12
- Pages
- 1-6
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W2113977317
- Cited by
- 124
- References
- 18
- Citations by year
- 2026: 1 · 2025: 10 · 2024: 9 · 2023: 7 · 2022: 6 · 2021: 14 · 2020: 7 · 2019: 14 · 2018: 11 · 2017: 12 · 2016: 10 · 2015: 7 · 2014: 6 · 2013: 3 · 2012: 1
- FWCI
- 1.90
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Winter Conference on Applications of Computer Vision (publishedVersion)
- Funders
- U.S. Forest Service
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- macro-expressions, micro-expressions, temporal segmentation, optical flow
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
