The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
SAMM: A Spontaneous Micro-Facial Movement Dataset
Open accessAbstract
Micro-facial expressions are spontaneous, involuntary movements of the face when a person experiences an emotion but attempts to hide their facial expression, most likely in a high-stakes environment. Recently, research in this field has grown in popularity, however publicly available datasets of micro-expressions have limitations due to the difficulty of naturally inducing spontaneous micro-expressions. Other issues include lighting, low resolution and low participant diversity. We present a newly developed spontaneous micro-facial movement dataset with diverse participants and coded using the Facial Action Coding System. The experimental protocol addresses the limitations of previous datasets, including eliciting emotional responses from stimuli tailored to each participant. Dataset evaluation was completed by running preliminary experiments to classify micro-movements from non-movements. Results were obtained using a selection of spatio-temporal descriptors and machine learning. We further evaluate the dataset on emerging methods of feature difference analysis and propose an Adaptive Baseline Threshold that uses individualised neutral expression to improve the performance of micro-movement detection. In contrast to machine learning approaches, we outperform the state of the art with a recall of 0.91. The outcomes show the dataset can become a new standard for micro-movement data, with future work expanding on data representation and analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538
(1974) · Medical Entomology and Zoology · Cited by 7,295
Comparison of the predicted and observed secondary structure of T4 phage lysozyme
Matthews, B. W. (1975) · Biochimica et Biophysica Acta (BBA) - Protein Structure · doi:10.1016/0005-2795(75)90109-9 · Cited by 5,399 · cited 1×
“For binary classification, the MCC introduced by Mat-thews et al. [41] takes into account the true and false positives (TP and FP) and true and false negatives (TN and FN) to obtain a balanced coefficient measure between (cid:4) 1 and 1, where 1 is perfect classification, 0 is random chance and…”
MethodDynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions
Zhao, G., & Pietikainen, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1110 · Cited by 2,846
Ekman, P., & Rosenberg, E. L. (2005) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195179644.001.0001 · Cited by 1,941
Automatic facial expression analysis: a survey
Fasel, B., & Luettin, J. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00052-3 · Cited by 1,810
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,716
Dollar, P., Tu, Z., Perona, P., & Belongie, S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.91 · Cited by 1,237
CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation
Yan, W.-J., Li, X., Wang, S.-J., Zhao, G., Liu, Y.-J., Chen, Y.-H., & Fu, X. (2014) · PLoS ONE · doi:10.1371/journal.pone.0086041 · Cited by 993
Culture, emotion regulation, and adjustment.
Matsumoto, D., Rules, M. S. O. C. D., Yoo, S. H., & Nakagawa, S. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.6.925 · Cited by 968
A Spontaneous Micro-expression Database: Inducement, collection and baseline
Li, X., Pfister, T., Huang, X., Zhao, G., & Pietikainen, M. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553717 · Cited by 665
A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition
Liu, Y.-J., Zhang, J.-K., Yan, W.-J., Wang, S.-J., Zhao, G., & Fu, X. (2016) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2015.2485205 · Cited by 520
Automatic Recognition of Facial Actions in Spontaneous Expressions
Bartlett, M. S., Littlewort, G. C., Frank, M. G., Lainscsek, C., Fasel, I. R., & Movellan, J. R. (2006) · Journal of Multimedia · doi:10.4304/jmm.1.6.22-35 · Cited by 468
Recognising spontaneous facial micro-expressions
Pfister, T., Li, X., Zhao, G., & Pietikainen, M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126401 · Cited by 450
How Fast are the Leaked Facial Expressions: The Duration of Micro-Expressions
Yan, W.-J., Wu, Q., Liang, J., Chen, Y.-H., & Fu, X. (2013) · Journal of Nonverbal Behavior · doi:10.1007/s10919-013-0159-8 · Cited by 445
CASME database: A dataset of spontaneous micro-expressions collected from neutralized faces
Yan, W.-J., Wu, Q., Liu, Y.-J., Wang, S.-J., & Fu, X. (2013) · 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) · doi:10.1109/fg.2013.6553799 · Cited by 338
Lie Catching and Microexpressions
Ekman, P. (2009) · The Philosophy of Deception · doi:10.1093/acprof:oso/9780195327939.003.0008 · Cited by 332
Facial micro-expressions recognition using high speed camera and 3D-gradient descriptor
Polikovsky, S., Kameda, Y., & Ohta, Y. (2009) · 3rd International Conference on Imaging for Crime Detection and Prevention (ICDP 2009) · doi:10.1049/ic.2009.0244 · Cited by 312
Emotions Revealed : Understanding Faces and Feelings
Ekman, P. (2003) · Medical Entomology and Zoology · Cited by 291
Voluntary Smiling Changes Regional Brain Activity
Ekman, P., & Davidson, R. J. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00576.x · Cited by 260
Evidence for training the ability to read microexpressions of emotion
Matsumoto, D., & Hwang, H. S. (2011) · Motivation and Emotion · doi:10.1007/s11031-011-9212-2 · Cited by 245
Macro- and micro-expression spotting in long videos using spatio-temporal strain
Shreve, M., Godavarthy, S., Goldgof, D., & Sarkar, S. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771451 · Cited by 218
Localization of emotional and volitional facial paresis
Hopf, H. C., MD, W. M.-F., & Hopf, N. J. (1992) · Neurology · doi:10.1212/wnl.42.10.1918 · Cited by 164
Grin and Bear It: The Influence of Manipulated Facial Expression on the Stress Response
Kraft, T. L., & Pressman, S. D. (2012) · Psychological Science · doi:10.1177/0956797612445312 · Cited by 160
Micro-expression Recognition Using Dynamic Textures on Tensor Independent Color Space
Wang, S., Yan, W., Li, X., Zhao, G., & Fu, X. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.800 · Cited by 147
Effects of the duration of expressions on the recognition of microexpressions
Shen, X., Wu, Q., & Fu, X. (2012) · Journal of Zhejiang University SCIENCE B · doi:10.1631/jzus.b1100063 · Cited by 141
Spotting Rapid Facial Movements from Videos Using Appearance-Based Feature Difference Analysis
Moilanen, A., Zhao, G., & Pietikäinen, M. (2014) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2014.303 · Cited by 125
Representation of facial muscles in human motor cortex
Paradiso, G. O., Cunic, D. I., Gunraj, C. A., & Chen, R. E. (2005) · The Journal of Physiology · doi:10.1113/jphysiol.2005.088542 · Cited by 78
Facial Micro-Expression Detection in Hi-Speed Video Based on Facial Action Coding System (FACS)
Polikovsky, S., Kameda, Y., & Ohta, Y. (2012) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.e96.d.81 · Cited by 74
Spatiotemporal Integration of Optical Flow Vectors for Micro-expression Detection
Patel, D., Zhao, G., & Pietikäinen, M. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25903-1_32 · Cited by 66
Micro-Facial Movement Detection Using Individualised Baselines and Histogram-Based Descriptors
Davison, A. K., Yap, M. H., & Lansley, C. (2015) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2015.326 · Cited by 65
Self-citationAutomatic expression spotting in videos
Shreve, M., Brizzi, J., Fefilatyev, S., Luguev, T. S., Goldgof, D. B., & Sarkar, S. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.04.010 · Cited by 63
Spontaneous Facial Expression Of Emotions In Brain-Damaged Patients
Mammucari, A., Caltagirone, C., Ekman, P., Friesen, W. V., Gainotti, G., Pizzamiglio, L., & Zoccolotti, P. (1988) · Cortex · doi:10.1016/s0010-9452(88)80046-7 · Cited by 62
Natural affect data — Collection & annotation in a learning context
Afzal, S., & Robinson, P. (2009) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2009.5349537 · Cited by 48
Micro-Facial Movements: An Investigation on Spatio-Temporal Descriptors
Davison, A. K., Yap, M. H., Costen, N. P., Tan, K., Lansley, C., & Leightley, D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16181-5_8 · Cited by 47
Self-citationA Delaunay-Based Temporal Coding Model for Micro-expression Recognition
Lu, Z., Luo, Z., Zheng, H., Chen, J., & Li, W. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16631-5_51 · Cited by 46
Facial Behavioral Analysis: A Case Study in Deception Detection
Yap, M. H. (2014) · British Journal of Applied Science & Technology · doi:10.9734/bjast/2014/6369 · Cited by 16
Self-citationFace detection by cascade of Gaussian derivates classifiers calculated with a half-octave pyramid
Ruiz-Hernandez, J. A., Lux, A., & Crowley, J. L. (2008) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2008.4813457 · Cited by 8
Cited by
A systematic review on affective computing: emotion models, databases, and recent advances
Wang, Y., Song, W., Tao, W., Liotta, A., Yang, D., Li, X., Gao, S., Sun, Y., Ge, W., Zhang, W., et al. (2022) · Information Fusion · doi:10.1016/j.inffus.2022.03.009 · Cited by 615
Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms
Ben, X., Ren, Y., Zhang, J., Wang, S.-J., Kpalma, K., Meng, W., & Liu, Y.-J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3067464 · Cited by 306
OFF-ApexNet on micro-expression recognition system
Gan, Y. S., Liong, S.-T., Yau, W.-C., Huang, Y.-C., & Tan, L.-K. (2019) · Signal Processing: Image Communication · doi:10.1016/j.image.2019.02.005 · Cited by 303
Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-Expressions
Xia, Z., Hong, X., Gao, X., Feng, X., & Zhao, G. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2931351 · Cited by 290
Recognizing Facial Expressions Using a Shallow Convolutional Neural Network
Miao, S., Xu, H., Han, Z., & Zhu, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2921220 · Cited by 110
Metadata
- Authors
- Davison, A. K., Lansley, C., Costen, N., Tan, K., & Yap, M. H.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2018-01-01
- Volume
- 9
- Issue
- 1
- Pages
- 116-129
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2426188534
- Cited by
- 708
- References
- 42
- FWCI
- 23.74
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.