Towards Analyzing and Predicting the Experience of Live Performances with Wearable Sensing
Open accessThe DOI matches its Crossref record; 56 of the 58 references it cites were found in a registry or an index.
Abstract
We present an approach to interpret the response of audiences to live performances by processing mobile sensor data. We apply our method on three different datasets obtained from three live performances, where each audience member wore a single tri-axial accelerometer and proximity sensor embedded inside a smart sensor pack. Using these sensor data, we developed a novel approach to predict audience members’ self-reported experience of the performances in terms of enjoyment, immersion, willingness to recommend the event to others, and change in mood. The proposed method uses an unsupervised method to identify informative intervals of the event, using the linkage of the audience members’ bodily movements, and uses data from these intervals only to estimate the audience members’ experience. We also analyze how the relative location of members of the audience can affect their experience and present an automatic way of recovering neighborhood information based on proximity sensors. We further show that the linkage of the audience members’ bodily movements is informative of memorable moments which were later reported by the audience.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers found that joint coordination in acceleration variance enabled them to distinguish salient from non-salient moments of the performance, as they could predict self-report responses from acceleration data.”
From Using Wearable Sensors to Measure Interpersonal Synchrony in Actors and Audience Members During a Live Theatre Performance (2023) · cites this paper as [19]
In the citing paper
“Importantly, wearable sensing happens in the background without distracting the audience from the unfolding performance, and does not require retrospective judgement [19].”
From Using Wearable Sensors to Measure Interpersonal Synchrony in Actors and Audience Members During a Live Theatre Performance (2023) · cites this paper as [19]
In the citing paper
“Therefore aligned with previous research in dance [19, 36, 57, 60] and public visual art [38] spaces, we were able to extract various frequencies of movement, and through time stamps and video footage were able to dissect the movements that were occurring to make observations about human social behaviour.”
From Using Wearable Sensors to Measure Interpersonal Synchrony in Actors and Audience Members During a Live Theatre Performance (2023) · cites this paper as [19]
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · cited 1×
“Our classifier is a Linear Support VectorMachine (SVM, [55]).”
MethodThe social life of small urban spaces
Whyte, W. H. (1980) · Cited by 3,426
Activity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · cited 1×
“such as the recognition of outdoor [42] or household activities [43],”
BackgroundActivity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 1×
“such as the recognition of outdoor [42] or household activities [43],”
BackgroundA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Comprehensive database for facial expression analysis
Kanade, T., Cohn, J. F., & Tian, Y. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840611 · Cited by 2,591
Appraisal Processes in Emotion: Theory, Methods, Research
(2001) · doi:10.1093/oso/9780195130072.001.0001 · Cited by 2,384
The Experience of Presence: Factor Analytic Insights
Schubert, T., Friedmann, F., & Regenbrecht, H. (2001) · Presence: Teleoperators and Virtual Environments · doi:10.1162/105474601300343603 · Cited by 2,303 · cited 1×
“For measuring “enjoyment”, we adapted and selected questions presented in [51]; for “immersion”, we selected involvement questions from the Igroup Presence Questionnaire [52]; for “recommendation” we used items from O’Brien’s questionnaire [53].”
MethodThe Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816 · cited 1×
“We selected balanced accuracy [56] as our performance metric to account for the class imbalance.”
MethodAutomatic analysis of facial expressions: the state of the art
Pantie, M., & Rothkrantz, L. J. M. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895976 · Cited by 1,778 · cited 2×
“Most of the early work focused on video and/or audio inputs [9], used datasets of single input modalities [20], included a limited set of deliberate affec-”
Background
Research works printed but not linked: 1
- gonzalez, 2008, Digital Image Processing
Cited by
Sun, Y., Greaves, D. A., Orgs, G., de C. Hamilton, A. F., Day, S., & Ward, J. A. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580781 · Cited by 35
“Moving on to the data preprocessing stage, we compared the traditional time shift-only method and the proposed shift and interpolation-based data synchronisation technique.”
InfluentialLinking Audience Physiology to Choreography
Han, J., Chernyshov, G., Sugawa, M., Zheng, D., Hynds, D., Furukawa, T., Macieira, M. P., Marky, K., Minamizawa, K., Ward, J. A., et al. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3557887 · Cited by 26
“Sensing live audiences has been explored using a variety of different sensor technologies including EDA [55, 84, 101], HR /HRV [7, 82, 98], brain computer interfaces (BCI) [38], and body movement [35, 90, 94] (see Table 1).”
Self-powered and self-sensing wearable devices from a comfort perspective
Zou, R., Chen, H., Pan, H., Zhang, H., Kong, L., Zhang, Z., Xiang, Z., Zhi, J., & Xu, Y. (2024) · Device · doi:10.1016/j.device.2024.100466 · Cited by 19
Research on Emotion Recognition for Online Learning in a Novel Computing Model
Chen, M., Xie, L., Li, C., & Wang, Z. (2022) · Applied Sciences · doi:10.3390/app12094236 · Cited by 16
Zhao, Y., Liu, Z., Ting-ting, L., Yuan-yi, W., & YanJie, C. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15162-x · Cited by 15
“In [17, 38, 54] identified posture and movement features from RGB gaits videos by conducting a perception experiment.”
Li, X., & Zheng, H. W. (2020) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2020.103743 · Cited by 11
RetractedBaihan, A., Amoon, M., Altameem, T. A., & Hashem, M. (2025) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3524279 · Cited by 10
“WSs are fixed in the crowd to capture the distance maintained among the people [9], [15].”
Stamm, J. C., Richardson, D. C., & Ward, J. A. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3651886 · Cited by 6
“Generally, reactions in dynamic art forms are probably delayed by a few seconds and people typically have different timings [16, 43].”
BackgroundWang, J., & Wang, P. (2020) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2020.103625 · Cited by 1
RetractedKunze, K., Xu, M., Peng, D., de Oliveira, L. O., Shao, R., Meng, X., Hoppe, M., & Barbareschi, G. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3795056
“Research has demonstrated the feasibility of using wearable sensing to analyze and predict live performance experiences [18], while other work has explored how body movements can reveal audience responses to contemporary dance [56].”
Metadata
- Authors
- Gedik, E., Cabrera-Quiros, L., Martella, C., Englebienne, G., & Hung, H.
- Affiliations
- Delft University of Technology (NL)
- Google (United Kingdom) (GB)
- University of Twente (NL)
- Venue
- IEEE Transactions on Affective Computing
- Published
- 2021-01-01
- Volume
- 12
- Issue
- 1
- Pages
- 269-276
- ISSN
- 1949-3045 (ISSN-L)
- 2371-9850
- OpenAlex
- W2896657604
- Cited by
- 10
- References
- 58
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 2 · 2022: 2
- FWCI
- 0.25
- Type
- journal article
- Language
- en
- Open access
- green
- research.utwente.nl
- Licence
- Locations
- IEEE Transactions on Affective Computing (publishedVersion)
- VU Research Portal (publishedVersion)
- TU/e Research Portal (submittedVersion)
- University of Twente Research Information (submittedVersion, other-oa)
- Research Repository (Delft University of Technology) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Dutch national program COMMIT
- European Commission (601033 - MOnarCH)
- Costa Rican Institute of Technology
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- audience response, wearable sensors, triaxial accelerometer, proximity sensors, immersion, mood changes, memorable moments, neighborhood recovery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.