Blink as you sync: uncovering eye and nod synchrony in conversation using wearable sensing
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
We tend to synchronize our movements to the person we are talking to during face-to-face conversation. Higher interpersonal synchrony is linked to greater empathy and more effortless interactions. This paper presents a first method and a corresponding dataset to explore synchrony in natural conversation by capturing eye and head movement using commodity smart eyewear. We present a 17 hour dataset, using Electrooculography and inertial sensing, of 42 people in conversation (21 dyads: 10 in Japanese, 10 in English, 1 in Chinese). Initial results on 18 dyads show significant interpersonal synchrony of blink and head nod behaviour during conversation (at frequencies of 0.2 to 0.5 Hz). We also find that people are more likely to synchronise blinks at around 1 Hz when conversing back-to-back than when face-to-face.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Recently, cross-wavelets were used to analyse movement features from dyads in conversation, and revealed how people tend to synchronise with one another at specific frequencies [14, 23, 24].”
From Using Wearable Sensors to Measure Interpersonal Synchrony in Actors and Audience Members During a Live Theatre Performance (2023) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Practical Guide to Wavelet Analysis
Torrence, C., & Compo, G. P. (1998) · Bulletin of the American Meteorological Society · doi:10.1175/1520-0477(1998)079<0061:apgtwa>2.0.co;2 · Cited by 14,890 · cited 1×
“Wavelets allow us to decompose a signal into its frequency components while preserving temporal information, and without the need for windowing [26].”
Application of the cross wavelet transform and wavelet coherence to geophysical time series
Grinsted, A., Moore, J. C., & Jevrejeva, S. (2004) · Nonlinear Processes in Geophysics · doi:10.5194/npg-11-561-2004 · Cited by 6,285 · cited 3×
“Two related methods of combining these include the cross-wavelet transform, which highlights the frequencies with high common power, and the wavelet coherence transform, which highlights common frequencies regardless of power [8].”
Stance, Alignment, and Affiliation During Storytelling: When Nodding Is a Token of Affiliation
Stivers, T. (2008) · Research on Language and Social Interaction · doi:10.1080/08351810701691123 · Cited by 1,408 · cited 1×
“It is used to express attentiveness [17], as well as stance and affiliation [23].”
Gesture and coparticipation in the activity of searching for a word
HARNESS GOODWIN, M., & GOODWIN, C. (1986) · Semiotica · doi:10.1515/semi.1986.62.1-2.51 · Cited by 793 · cited 1×
“Nods and blinks are used due to their importance as non-verbal signals [6], their connection to cognitive processes like sustained attention [16], and the relative ease of collecting this data using commercial head-worn wearables.”
Interpersonal synchrony: a survey of evaluation methods across disciplines.
Delaherche, E., Chetouani, M., Mahdhaoui, A., Saint-Georges, C., Viaux, S., & Cohen, D. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2012.12 · Cited by 474 · cited 1×
“Interpersonal synchrony reveals the degree of temporal coordination between people during social interaction, and can provide cues on things like social engagement, and affect [2].”
Blink Rate: A Possible Measure of Fatigue
Stern, J. A., Boyer, D., & Schroeder, D. (1994) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872089403600209 · Cited by 463 · cited 1×
“Eye blinks are a useful cognitive indicator [22, 25], but they also reveal information on social interaction.”
The attentional blink: Past, present, and future of a blind spot in perceptual awareness
Martens, S., & Wyble, B. (2010) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2009.12.005 · Cited by 376 · cited 1×
“Nods and blinks are used due to their importance as non-verbal signals [6], their connection to cognitive processes like sustained attention [16], and the relative ease of collecting this data using commercial head-worn wearables.”
Nonverbal synchrony and affect in dyadic interactions.
Tschacher, W., Rees, G. M., & Ramseyer, F. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.01323 · Cited by 351 · cited 3×
“Tschacher et al. found a link between interpersonal synchrony and affect [27], revealing that if people move in sync, they tend to feel more positive towards one another.”
Sensing and modeling human networks using the sociometer
Choudhury, T., & Pentland, A. (2004) · Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings. · doi:10.1109/iswc.2003.1241414 · Cited by 227 · cited 1×
“This grew out of the initial efforts by Choudhury and Pentland to use wearable motion and audio to analyse group interactions [1].”
Synchronization of spontaneous eyeblinks while viewing video stories
Nakano, T., Yamamoto, Y., Kitajo, K., Takahashi, T., & Kitazawa, S. (2009) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2009.0828 · Cited by 225 · cited 2×
“It may be also that the lack of visual connection leads to a higher dependence on auditory attention to be able to follow the conversation, which results in synchronized eye blinks due to increased engagement [19].”
BackgroundRelationship between vocalizations and head nods as listener responses.
Dittmann, A. T., & Llewellyn, L. G. (1968) · Journal of Personality and Social Psychology · doi:10.1037/h0025722 · Cited by 192 · cited 1×
“This reinforces the early observations of Dittmann et al [4], which linked blink (and nod) synchrony to coordinating breakpoints in speech.”
Head movement during listening turns in conversation
Hadar, U., Steiner, T. J., & Rose, F. C. (1985) · Journal of Nonverbal Behavior · doi:10.1007/bf00986881 · Cited by 151 · cited 1×
“There is a long history in applied psychology dedicated to the study of nonverbal interaction using movement [9, 10, 27].”
SocioPhone: everyday face-to-face interaction monitoring platform using multi-phone sensor fusion
Lee, Y., Min, C., Hwang, C., Lee, J., Hwang, I., Ju, Y., Yoo, C., Moon, M., Lee, U., & Song, J. (2013) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2462456.2465426 · Cited by 121 · cited 1×
“Much of the work on non-verbal analysis of social signals use either computer vision, or pocket worn sensing (e.g. mobile phones) [12, 13, 28].”
From Context Awareness to Socially Aware Computing
Lukowicz, P., Pentland, S., & Ferscha, A. (2012) · IEEE Pervasive Computing · doi:10.1109/mprv.2011.82 · Cited by 118 · cited 1×
“The work has two ultimate goals: to evaluate a new, wearable, approach for psychologists wishing to study interpersonal synchrony in-the-wild, and to provide a dataset of head and eye movement during conversation for researchers interested in building socially aware wearable applications [14].”
Annual Meeting of the Berkeley Linguistics Society
Lamarque, R., & German, J. S. (2015) · Proceedings of the Annual Meeting of the Berkeley Linguistics Society · doi:10.3765/bls · Cited by 91
(2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730652 · Cited by 86
Social Sensing for Psychology: Automated Interpersonal Behavior Assessment
Schmid Mast, M., Gatica-Perez, D., Frauendorfer, D., Nguyen, L., & Choudhury, T. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721414560811 · Cited by 85 · cited 2×
“However there is growing interest in the topic of social sensing, i.e. the in-situ capture and analysis of human social behavior using unobtrusive devices [20].”
Sensing, Understanding, and Shaping Social Behavior
Shmueli, E., Singh, V. K., Lepri, B., & Pentland, A. (2014) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2014.2307438 · Cited by 83 · cited 1×
“Our work is closely related to the field of Social Sensing [20, 21].”
Are You on My Wavelength? Interpersonal Coordination in Dyadic Conversations
Hale, J., Ward, J. A., Buccheri, F., Oliver, D., & Hamilton, A. F. D. C. (2020) · Journal of Nonverbal Behavior · doi:10.1007/s10919-019-00320-3 · Cited by 83
Self-citationMulac, A., Erlandson, K., FARRAR, W. J., Hallett, J. S., Molloy, J. L., & Prescott, M. E. (1998) · Communication Research · doi:10.1177/009365098025006004 · Cited by 82
Tag, B., Vargo, A. W., Gupta, A., Chernyshov, G., Kunze, K. S., & Dingler, T. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300694 · Cited by 78 · cited 1×
“Eye blinks are a useful cognitive indicator [22, 25], but they also reveal information on social interaction.”
Self-citationEvaluating Interpersonal Synchrony: Wavelet Transform Toward an Unstructured Conversation
Fujiwara, K., & Daibo, I. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00516 · Cited by 67 · cited 1×
“It has since been used to measure interpersonal synchrony of head movements in conversation [5, 10].”
Helweg-Larsen, M., Cunningham, S. J., Carrico, A., & Pergram, A. M. (2004) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.2004.00152.x · Cited by 57 · cited 1×
“Nodding is a particularly useful back-channel in conversation [11].”
The eye blink electro-oculogram.
Denney, D., & Denney, C. (1984) · British Journal of Ophthalmology · doi:10.1136/bjo.68.4.225 · Cited by 53 · cited 1×
“V signal [3].”
Towards Collaborative Group Activity Recognition Using Mobile Devices
Gordon, D., Hanne, J.-H., Berchtold, M., Shirehjini, A. A. N., & Beigl, M. (2012) · Mobile Networks and Applications · doi:10.1007/s11036-012-0415-x · Cited by 52 · cited 1×
“Gordan et al. pursue collaborative activity recognition for group activities [7], while Ward et al. use audio and movement to uncover within-group collaborations [29].”
Ward, J. A., Richardson, D., Orgs, G., Hunter, K., & Hamilton, A. (2018) · Proceedings of the 2018 ACM International Symposium on Wearable Computers · doi:10.1145/3267242.3267263 · Cited by 51 · cited 2×
“Ward et al. show interpersonal synchrony can be captured between actors and autistic children in theatre – and suggest how this might be used as a measure of social engagement [30].”
Self-citationLack of eyeblink entrainments in autism spectrum disorders
Nakano, T., Kato, N., & Kitazawa, S. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2011.06.007 · Cited by 47 · cited 1×
“The social importance of blinks was also demonstrated in a further work by Nakano et al. showing a lack of eye blink synchrony in autism [18], a condition characterised by communication difficulties.”
Madan, A., Caneel, R., & Pentland, A. (2004) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1027933.1027983 · Cited by 23 · cited 1×
“show how the head nods of remote users can be reproduced in real time to facilitate group discussion [15].”
Recognizing conversational context in group interaction using privacy-sensitive mobile sensors
Jayagopi, D. B., Kim, T. J., Pentland, A., & Gática-Pérez, D. (2010) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/1899475.1899483 · Cited by 12 · cited 1×
“Much of the work on non-verbal analysis of social signals use either computer vision, or pocket worn sensing (e.g. mobile phones) [12, 13, 28].”
Detecting physical collaborations in a group task using body-worn microphones and accelerometers
Ward, J. A., Pirkl, G., Hevesi, P., & Lukowicz, P. (2017) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2017.7917570 · Cited by 10 · cited 1×
“Gordan et al. pursue collaborative activity recognition for group activities [7], while Ward et al. use audio and movement to uncover within-group collaborations [29].”
Self-citationFine-grained social relationship extraction from real activity data under coarse supervision
Tsubouchi, K., Saisho, O., Sato, J., Araki, S., & Shimosaka, M. (2015) · Proceedings · doi:10.1145/2802083.2808402 · Cited by 8 · cited 1×
“Much of the work on non-verbal analysis of social signals use either computer vision, or pocket worn sensing (e.g. mobile phones) [12, 13, 28].”
Are you on my wavelength? Interpersonal coordination in naturalistic conversationsPreprint
Wetton, J. D., Ward, J. A., Buccheri, F., Oliver, D., & Hamilton, A. F. D. C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5r4mj · Cited by 8 · cited 3×
“There is a long history in applied psychology dedicated to the study of nonverbal interaction using movement [9, 10, 27].”
Self-citation
Cited by
Sun, Y., Greaves, D. A., Orgs, G., de C. Hamilton, A. F., Day, S., & Ward, J. A. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580781 · Cited by 35
“The study was ethically approved by the psychology department’s ethics committee at Goldsmiths, University of London.”
Self-citationAdaptive virtual agent: Design and evaluation for real-time human-agent interaction
Woo, J., Shidara, K., Achard, C., Tanaka, H., Nakamura, S., & Pélachaud, C. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103321 · Cited by 39
Agrawal, C., & Peiris, R. L. (2021) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/3441852.3471209 · Cited by 31
ASAP: Endowing Adaptation Capability to Agent in Human-Agent Interaction
Woo, J., Pélachaud, C., & Achard, C. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584081 · Cited by 18
Think before you speak: An investigation of eye activity patterns during conversations using eyewear
Li, H., Epps, J., & Chen, S. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102468 · Cited by 17
Metadata
- Authors
- Gupta, A., Strivens, F. L., Tag, B., Kunze, K., & Ward, J. A.
- Affiliations
- Keio University (JP)
- Goldsmiths University of London (GB)
- Venue
- Proceedings of the 23rd International Symposium on Wearable Computers
- Publisher
- ACM
- Published
- 2019-09-09
- Pages
- 66-71
- OpenAlex
- W2977597077
- Cited by
- 27
- References
- 32
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 3 · 2023: 9 · 2022: 1 · 2021: 7 · 2020: 3
- FWCI
- 4.54
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Symposium on Wearable Computers (publishedVersion)
- Topics
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Keywords
- interpersonal synchrony, head nodding, eye movements, head movement, natural conversation, dyadic interaction, smart glasses, electrooculography, inertial sensing, face-to-face communication, nonverbal communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.