Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Physiological and affective computing propose methods to improve human–machine interactions by adapting machines to the users’ states. Recently, social signal processing (SSP) has proposed to apply similar methods to human–human interactions with the hope of better understanding and modeling social interactions. Most of the social signals employed are facial expressions, body movements and speech, but studies using physiological signals remain scarce. In this paper, we motivate the use of physiological signals in the context of social interactions. Specifically, we review studies which have investigated the relationship between various physiological indices and social interactions. We then propose two main directions to apply physiological SSP: using physiological signals of individual users as new social cues displayed in the group and using inter-user physiology to measure properties of the interactions such as conflict and social presence. We conclude that physiological measures have the potential to enhance social interactions and to connect people.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
DEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Moral Emotions and Moral Behavior
Tangney, J. P., Stuewig, J., & Mashek, D. J. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070145 · Cited by 3,222 · cited 1×
“This research was supported by the National Center of Competence in Research (NCCR) Affective sciences financed by the Swiss National Science Foundation (n° 51NF40-104897) and hosted by the University of Geneva.”
MethodLooking at pictures: Affective, facial, visceral, and behavioral reactions
LANG, P. J., GREENWALD, M. K., BRADLEY, M. M., & HAMM, A. O. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb03352.x · Cited by 3,190
Autonomic nervous system activity in emotion: a review
Kreibig, S. D. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.03.010 · Cited by 3,188 · cited 2×
“Different signals assessing the peripheral and central nervous system activity have been associated with emotional responses (Kreibig, 2010) and found relevant for the detection of emotions (Christian Mühl, Allison, et al., 2014; Novak, Mihelj, & Munih, 2012).”
BackgroundA Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Autonomic nervous system activity distinguishes among emotions
Ekman, P., Levenson, R. W., & Friesen, W. V. (1983) · Science · doi:10.1126/science.6612338 · Cited by 2,692
Emotion recognition in human-computer interaction
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. G. (2001) · IEEE Signal Processing Magazine · doi:10.1109/79.911197 · Cited by 2,603
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications
Calvo, R. A., & D'Mello, S. (2010) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2010.1 · Cited by 1,893 · cited 2×
“The video capture of facial expressions together with voice capture are certainly the most studied modalities for the purpose of emotion assessment (Calvo & D’Mello, 2010; Cowie et al., 2001; Gunes et al., 2008; Pantic & Rothkrantz, 2003; Zeng et al., 2009).”
BackgroundMethodA Multimodal Database for Affect Recognition and Implicit Tagging
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.25 · Cited by 1,664
Cited by
What multimodal data can tell us about the students’ regulation of their learning process?
Järvelä, S., Malmberg, J., Haataja, E., Sobocinski, M., & Kirschner, P. A. (2021) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.04.004 · Cited by 163
“Combining physiological measures such as EDA (Chanel & Mühl, 2015; Pecchinenda & Smith, 1996) to track skin reactivity changes in challenging moments (i.e., emotional arousal) and video observations to reveal SRL's sequential and temporal dynamics can provide a fundamentally new approach using…”
BackgroundMultimodal data to design visual learning analytics for understanding regulation of learning
Noroozi, O., Alikhani, I., Järvelä, S., Kirschner, P. A., Juuso, I., & Seppänen, T. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2018.12.019 · Cited by 140
“Whilst physiological measures such as EDA can be used to trace skin reactivity changes of learners in challenging moments (i.e., emotional arousal; Chanel & Mühl, 2015; Pecchinenda & Smith, 1996), video data can be used to reveal sequential and temporal dynamics of learners’ regulated learning…”
BackgroundMethodInfluentialWhat does physiological synchrony reveal about metacognitive experiences and group performance?
Dindar, M., Järvelä, S., & Haataja, E. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.12981 · Cited by 70
Metadata
- Authors
- Chanel, G., & Mühl, C.
- Venue
- Interacting with Computers
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-04-26
- Volume
- 27
- Issue
- 5
- Pages
- 534-550
- ISSN
- 0953-5438 (ISSN-L)
- 1873-7951
- OpenAlex
- W2114909357
- Cited by
- 60
- References
- 43
- FWCI
- 9.90
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.