The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
The Automatic Detection of Chronic Pain-Related Expression: Requirements, Challenges and the Multimodal EmoPain Dataset
Open accessAbstract
Pain-related emotions are a major barrier to effective self rehabilitation in chronic pain. Automated coaching systems capable of detecting these emotions are a potential solution. This paper lays the foundation for the development of such systems by making three contributions. First, through literature reviews, an overview of how pain is expressed in chronic pain and the motivation for detecting it in physical rehabilitation is provided. Second, a fully labelled multimodal dataset (named `EmoPain') containing high resolution multiple-view face videos, head mounted and room audio signals, full body 3D motion capture and electromyographic signals from back muscles is supplied. Natural unconstrained pain related facial expressions and body movement behaviours were elicited from people with chronic pain carrying out physical exercises. Both instructed and non-instructed exercises were considered to reflect traditional scenarios of physiotherapist directed therapy and home-based self-directed therapy. Two sets of labels were assigned: level of pain from facial expressions annotated by eight raters and the occurrence of six pain-related body behaviours segmented by four experts. Third, through exploratory experiments grounded in the data, the factors and challenges in the automated recognition of such expressions and behaviour are described, the paper concludes by discussing potential avenues in the context of these findings also highlighting differences for the two exercise scenarios addressed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiresolution gray-scale and rotation invariant texture classification with local binary patterns
Ojala, T., Pietikainen, M., & Maenpaa, T. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1017623 · Cited by 15,398
Depression and quality of life in older persons: A review
Sivertsen, H., Bjørkløf, G. H., Engedal, K., Selbæk, G., & Helvik, A.-S. (2015) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000437299 · Cited by 14,152
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903
Ahmed, N., Natarajan, T., & Rao, K. R. (1974) · IEEE Transactions on Computers · doi:10.1109/t-c.1974.223784 · Cited by 5,156
Fear-avoidance and its consequences in chronic musculoskeletal pain: a state of the art.
Vlaeyen, J. W. S., & Linton, S. J. (2000) · Pain · doi:10.1016/s0304-3959(99)00242-0 · Cited by 4,931
Lecrubier, Y., Sheehan, D., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H., Janavs, J., & Dunbar, G. (1997) · European Psychiatry · doi:10.1016/s0924-9338(97)83296-8 · Cited by 3,513
The biopsychosocial approach to chronic pain: Scientific advances and future directions.
Gatchel, R. J., Peng, Y. B., Peters, M. L., Fuchs, P. N., & Turk, D. C. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.581 · Cited by 3,392
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
The fear-avoidance model of musculoskeletal pain: Current state of scientific evidence
Leeuw, M., Goossens, M. E. J. B., Linton, S. J., Crombez, G., Boersma, K., & Vlaeyen, J. W. S. (2007) · Journal of Behavioral Medicine · doi:10.1007/s10865-006-9085-0 · Cited by 2,261
Cognitive and emotional control of pain and its disruption in chronic pain
Bushnell, M. C., Čeko, M., & Low, L. A. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3516 · Cited by 2,076
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 1×
“2 Automatic Recognition of Pain Expression and Behaviour Although there is much research in the automated recognition of affect from facial expression (for surveys see: [41], [57]) there is a smaller body of work that has focused on the automated recognition of pain related expressions.”
Psychological therapies for the management of chronic pain (excluding headache) in adults
Williams, A. C. D. C., Eccleston, C., & Morley, S. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007407.pub3 · Cited by 1,634
Self-citationEmbodiment in attitudes, social perception, and emotion
Niedenthal, P. M., Barsalou, L. W., Winkielman, P., Krauth-Gruber, S., & Ric, F. (2005) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0903_1 · Cited by 1,484
Pain as a global public health priority
Goldberg, D. S., & McGee, S. J. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-770 · Cited by 1,471 · cited 1×
“In this paper, we focus on chronic musculoskeletal pain which affects an estimated one in ten adults globally [13].”
Collaborative Management of Chronic Illness
Von Korff, M., Gruman, J., Schaefer, J., Curry, S. J., & Wagner, E. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-12-199712150-00008 · Cited by 1,269 · cited 1×
“Although management of all chronic conditions is generally subject to moderating factors that affect adoption and adherence to their respective therapies [9], CP differs in that pain conveys threat [10].”
Psychological factors in chronic pain: Evolution and revolution
Turk, D. C., & Okifuji, A. (2002) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.70.3.678 · Cited by 1,017
Fear-Avoidance Model of Chronic Pain: The Next Generation
Crombez, G., Eccleston, C., Van Damme, S., Vlaeyen, J. W. S., & Karoly, P. (2012) · The Clinical Journal of Pain · doi:10.1097/ajp.0b013e3182385392 · Cited by 960
Prkachin, K. M., & Solomon, P. E. (2008) · Pain · doi:10.1016/j.pain.2008.04.010 · Cited by 472 · cited 2×
“A temporally concurrent pain score based on the Prkachin and Solomon Pain Intensity (PSPI) measure [53] is assigned to each video sequence.”
How neuroimaging studies have challenged us to rethink: Is chronic pain a disease?
Tracey, I., & Bushnell, M. C. (2009) · The Journal of Pain · doi:10.1016/j.jpain.2009.09.001 · Cited by 455
The first facial expression recognition and analysis challenge
Valstar, M. F., Jiang, B., Mehu, M., Pantic, M., & Scherer, K. (2011) · Face and Gesture 2011 · doi:10.1109/fg.2011.5771374 · Cited by 385
Self-citationThe painful face – Pain expression recognition using active appearance models
Ashraf, A. B., Lucey, S., Cohn, J. F., Chen, T., Ambadar, Z., Prkachin, K. M., & Solomon, P. E. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.05.007 · Cited by 355
Continuous Pain Intensity Estimation from Facial Expressions
Kaltwang, S., Rudovic, O., & Pantic, M. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33191-6_36 · Cited by 245
Self-citationAutomatic coding of facial expressions displayed during posed and genuine pain
Littlewort, G. C., Bartlett, M. S., & Lee, K. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2008.12.010 · Cited by 216
Automatic detection of pain intensity
Hammal, Z., & Cohn, J. F. (2012) · Proceedings of the 14th ACM international conference on Multimodal interaction · doi:10.1145/2388676.2388688 · Cited by 185
A Kinect-based system for cognitive rehabilitation exercises monitoring
González-Ortega, D., Díaz-Pernas, F. J., Martínez-Zarzuela, M., & Antón-Rodríguez, M. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.10.014 · Cited by 167
Cited by
Updating the definition of pain
Williams, A. C. D. C., & Craig, K. D. (2016) · Pain · doi:10.1097/j.pain.0000000000000613 · Cited by 744
Self-citationMultimodal Spontaneous Emotion Corpus for Human Behavior Analysis
Zhang, Z., Girard, J. M., Wu, Y., Zhang, X., Liu, P., Ciftci, U., Canavan, S., Reale, M., Horowitz, A., Yang, H., et al. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.374 · Cited by 424
Deep Affect Prediction in-the-Wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond
Kollias, D., Tzirakis, P., Nicolaou, M. A., Papaioannou, A., Zhao, G., Schuller, B., Kotsia, I., & Zafeiriou, S. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01158-4 · Cited by 377
Aff-Wild: Valence and Arousal ‘In-the-Wild’ Challenge
Zafeiriou, S., Kollias, D., Nicolaou, M. A., Papaioannou, A., Zhao, G., & Kotsia, I. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.248 · Cited by 297
Multimodal Data Fusion based on the Global Workspace Theory
Bao, C., Fountas, Z., Olugbade, T., & Bianchi-Berthouze, N. (2020) · arXiv · doi:10.48550/arxiv.2001.09485 · Cited by 9
Self-citation
Metadata
- Authors
- Aung, M. S. H., Kaltwang, S., Romera-Paredes, B., Martinez, B., Singh, A., Cella, M., Valstar, M., Meng, H., Kemp, A., Shafizadeh, M., Elkins, A. C., Kanakam, N., de Rothschild, A., Tyler, N., Watson, P. J., Williams, A. C. D. C., Pantic, M., & Bianchi-Berthouze, N.
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2016-10-01
- Volume
- 7
- Issue
- 4
- Pages
- 435-451
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2162825184
- Cited by
- 219
- References
- 25
- FWCI
- 17.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.