Gaze and turn-taking behavior in casual conversational interactions

Data Mining: Practical Machine Learning Tools and Techniques

Witten, I. H., Frank, E., & Hall, M. A. (2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,493 · see citing works

A simplest systematics for the organization of turn-taking for conversation

Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350 · see citing works

Data Mining

Witten, I. H. (2008) · Cited by 9,115 · see citing works

Gesture Visible Action as Utterance

Kendon, A. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807572 · Cited by 3,987 · see citing works

Origins of Human Communication

Tomasello, M. (2008) · The MIT Press eBooks · doi:10.7551/mitpress/7551.001.0001 · Cited by 3,205 · see citing works

Language within our grasp.

Rizzolatti, G., & Arbib, M. A. (1998) · Trends in Neurosciences · doi:10.1016/s0166-2236(98)01260-0 · Cited by 2,858 · see citing works

Toward a mechanistic psychology of dialogue.

Pickering, M. J., & Garrod, S. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000056 · Cited by 2,678 · see citing works

Some functions of gaze-direction in social interaction

Kendon, A. (1967) · Acta Psychologica · doi:10.1016/0001-6918(67)90005-4 · Cited by 2,524 · see citing works

Conversational Organization: Interaction Between Speakers and Hearers

Goodwin, C. (1981) · Cited by 2,333 · see citing works

Origins of human communication

(2009) · Choice Reviews Online · doi:10.5860/choice.46-3671 · Cited by 2,235 · see citing works

Embodied Conversational Agents

(2000) · The MIT Press eBooks · doi:10.7551/mitpress/2697.001.0001 · Cited by 1,817 · see citing works

Contributing to discourse

Clark, H. H., & Schaefer, E. F. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_7 · Cited by 1,699 · see citing works

Eye Tracking in Human-Computer Interaction and Usability Research

Jacob, R. J. K., & Karn, K. S. (2003) · Elsevier eBooks · doi:10.1016/b978-044451020-4/50031-1 · Cited by 1,575 · see citing works

Inductive learning algorithms and representations for text categorization

Dumais, S., Platt, J. C., Heckerman, D. E., & Sahami, M. (1998) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/288627.288651 · Cited by 1,463 · see citing works

Gaze and Mutual Gaze

Argyle, M., Cook, M., & Cramer, D. (1994) · The British Journal of Psychiatry · doi:10.1017/s0007125000073980 · Cited by 1,304 · see citing works

Interactional units in conversation: syntactic, intonational, and pragmatic resources for the management of turns

Ford, C. E., & Thompson, S. A. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620874.003 · Cited by 985 · see citing works

How representational gestures help speaking

Kita, S. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620850.011 · Cited by 640 · see citing works

Proceedings of the 36th annual meeting on Association for Computational Linguistics -

(1998) · doi:10.3115/980845 · Cited by 636 · see citing works

Getting a Word in Edgewise

(1998) · Duke University Press eBooks · doi:10.2307/j.ctv11cw36q.8 · Cited by 585 · see citing works

ANVIL - a generic annotation tool for multimodal dialogue

Kipp, M. (2001) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2001-354 · Cited by 572 · see citing works

Explorations in engagement for humans and robots

Sidner, C. L., Lee, C. W., Kidd, C. D., Lesh, N. B., & Rich, C. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2005.03.005 · Cited by 559 · see citing works

The construction of units in conversational talk

Selting, M. (2000) · Language in Society · doi:10.1017/s0047404500004012 · Cited by 528 · see citing works

Statistical Techniques for the Study of Language and Language Behaviour

Rietveld, T. C. M., & van Hout, R. (1993) · Mouton eBooks · doi:10.1515/9783110871609 · Cited by 441 · see citing works

Eye gaze patterns in conversations

Vertegaal, R., Slagter, R. J., van der Veer, G. C., & Nijholt, A. (2001) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365119 · Cited by 415 · see citing works

Interactive gestures

Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992) · Discourse Processes · doi:10.1080/01638539209544823 · Cited by 349 · see citing works

An Analysis of Turn-Taking and Backchannels Based on Prosodic and Syntactic Features in Japanese Map Task Dialogs

Koiso, H., Horiuchi, Y., Tutiya, S., Ichikawa, A., & Den, Y. (1998) · Language and Speech · doi:10.1177/002383099804100404 · Cited by 272 · see citing works

The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena

Allwood, J. S., Cerrato, L., Jokinen, K., Navarretta, C., & Paggio, P. (2007) · Computers and the Humanities · doi:10.1007/s10579-007-9061-5 · Cited by 262 · see citing works

Proceedings of the 14th Conference for the European Chapter of the Association for Computational Linguistics (EACL)

Rohde, H., Elsner, M., & Clarke, A. V. (2014) · The Association for Computational Linguistics · Cited by 245 · see citing works

Proceedings of the 6th International Conference on Spoken Language Processing

Koumpis, K., & Renals, S. J. (2000) · Cited by 225 · see citing works

Incremental dialogue processing in a micro-domain

Skantze, G., & Schlangen, D. (2009) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1609067.1609150 · Cited by 160 · see citing works

Keeping the Floor in Multiparty Conversations: Intonation, Syntax, and Pause

Wennerstrom, A. K., & Siegel, A. F. (2003) · Discourse Processes · doi:10.1207/s15326950dp3602_1 · Cited by 125 · see citing works

Coordinating turn-taking with gaze

Novick, D., Hansen, B., & Ward, K. M. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.608001 · Cited by 106 · see citing works

Proceedings of the 21st Annual Conference of the Cognitive Science Society

Feleki, E., & Branigan, H. P. (1999) · Cited by 103 · see citing works

Keeping an eye on gestures: Visual perception of gestures in face-to-face communication

Gullberg, M., & Holmqvist, K. (1999) · Pragmatics & Cognition · doi:10.1075/pc.7.1.04gul · Cited by 93 · see citing works

From reaction to prediction: experiments with computational models of turn-taking

Schlangen, D. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-550 · Cited by 82 · see citing works

Recognizing gaze aversion gestures in embodied conversational discourse

Morency, L., Christoudias, C. M., & Darrell, T. (2006) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1180995.1181051 · Cited by 82 · see citing works

Utterance units in spoken dialogue

Traum, D. R., & Heeman, P. A. (1997) · Lecture notes in computer science · doi:10.1007/3-540-63175-5_42 · Cited by 76 · see citing works

Computational Models of Grounding in Collaborative Systems

Traum, D. R. (1999) · Cited by 75 · see citing works

Proceedings of the SIGDIAL 2011 Conference

Moore, J. D., Traum, D. R., Chai, J. Y., & Passonneau, R. J. (2011) · Cited by 73 · see citing works

The Rickel Gaze Model: A Window on the Mind of a Virtual Human

Lee, J., Marsella, S., Traum, D. R., Gratch, J. S., & Lance, B. J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74997-4_27 · Cited by 72 · see citing works

Interacting with Embodied Conversational Agents

André, E., & Pélachaud, C. (2010) · Springer eBooks · doi:10.1007/978-0-387-73819-2_8 · Cited by 70 · see citing works

What's in a gaze?

Prasov, Z., & Chai, J. Y. (2008) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1378773.1378777 · Cited by 69 · see citing works

Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL)

(2014) · doi:10.3115/v1/w14-43 · Cited by 66 · see citing works

Learning decision trees to determine turn-taking by spoken dialogue systems

Sato, R., Higashinaka, R., Tamoto, M., Nakano, M., & Aikawa, K. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-293 · Cited by 50 · see citing works

Prosody-based detection of the context of backchannel responses

Noguchi, H., & Den, Y. (1998) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1998-71 · Cited by 49 · see citing works

Eye-gaze experiments for conversation monitoring

Jokinen, K., Nishida, M., & Yamamoto, S. (2009) · International Universal Communication Symposium · doi:10.1145/1667780.1667843 · Cited by 46 · see citing works

On eye-gaze and turn-taking

Jokinen, K., Nishida, M., & Yamamoto, S. (2010) · doi:10.1145/2002333.2002352 · Cited by 46 · see citing works

Real-time Handling of Fragmented Utterances

Bell, L., Boye, J., & Gustafson, J. (2001) · Cited by 44 · see citing works

Constructive Dialogue Modelling

Jokinen, K. (2009) · Wiley eBooks · doi:10.1002/9780470511275 · Cited by 42 · see citing works

Constructive Dialogue Modelling: Speech Interaction and Rational Agents

Jokinen, K. (2009) · Cited by 40 · see citing works

Turn-alignment using eye-gaze and speech in conversational interaction

Jokinen, K., Harada, K., Nishida, M., & Yamamoto, S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-571 · Cited by 36 · see citing works

Proceedings of the 7th European Conference on Speech Communication and Technology

Matthew Aylett, P. (2001) · Cited by 35 · see citing works

Multimodal floor control shift detection

Chen, L., & Harper, M. P. (2009) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/1647314.1647320 · Cited by 31 · see citing works

Importance-Driven Turn-Bidding for Spoken Dialogue Systems

Selfridge, E. O., & Heeman, P. A. (2010) · Cited by 29 · see citing works

Gaze and Gesture Activity in Communication

Jokinen, K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02710-9_60 · Cited by 29 · see citing works

Utterance segmentation and turn-taking in spoken dialogue systems

Edlund, J., Heldner, M., & Gustafson, J. (2005) · Cited by 29 · see citing works

Estimating User’s Conversational Engagement Based on Gaze Behaviors

Ishii, R., & Nakano, Y. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8_20 · Cited by 28 · see citing works

Nonverbal behaviours improving a simulation of small group discussion

Padilha, E., & Carletta, J. (2003) · Cited by 28 · see citing works

Culture-specific communication management for virtual agents

Endraß, B., Rehm, M., & André, E. (2009) · Adaptive Agents and Multi-Agents Systems · doi:10.65109/gotp4904 · Cited by 27 · see citing works

Investigation of the relationship between turn-taking and prosodic features in spontaneous dialogue

Ohsuga, T., Nishida, M., Horiuchi, Y., & Ichikawa, A. (2005) · Interspeech (USB) · doi:10.21437/interspeech.2005-32 · Cited by 22 · see citing works

Higgins - a spoken dialogue system for investigating error handling techniques

Edlund, J., Skantze, G., & Carlson, R. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-125 · Cited by 22 · see citing works

The interactional geometry of a three-way conversation

Healey, P. G. T., & Battersby, S. A. (2009) · eScholarship (California Digital Library) · Cited by 18 · see citing works

Attentional Behaviors as Nonverbal Communicative Signals in Situated Interactions with Conversational Agents

Nakano, Y., & Nishida, T. (2007) · doi:10.1002/9780470512470.ch5 · Cited by 17 · see citing works

Moving together : the organisation of non-verbal cues during multiparty conversation

Battersby, S. A. (2011) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 12 · see citing works

Appreciating Face-to-face Dialogue

Bavelas, J. B. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190913366.003.0001 · Cited by 10 · see citing works

Collecting and Annotating Conversational Eye-Gaze Data

Jokinen, K., Nishida, M., & Yamamoto, S. (2010) · Cited by 10 · see citing works

The role of interactivity in human-machine conversation for automatic word acquisition

Qu, S., & Chai, J. Y. (2009) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.3115/1708376.1708404 · Cited by 9 · see citing works

The vocal intensity of turn-initial cue phrases in dialogue

Hjalmarsson, A. (2010) · Cited by 2 · see citing works

Turn-taking in conversational systems and human-robot interaction: a review

Skantze, G. (2021) · Computer Speech & Language · doi:10.1016/j.csl.2020.101178 · Cited by 298 · see citing works

The Role of Eye Gaze in Regulating Turn Taking in Conversations: A Systematized Review of Methods and Findings

Degutyte, Z., & Astell, A. J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.616471 · Cited by 107 · see citing works

Robust eye contact detection in natural multi-person interactions using gaze and speaking behaviour

Müller, P., Huang, M. X., Zhang, X., & Bulling, A. (2018) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3204493.3204549 · Cited by 54 · see citing works

Integration of gestures and speech in human-robot interaction

Meena, R., Jokinen, K., & Wilcock, G. (2012) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2012.6421936 · Cited by 53 · see citing works

I Say, You Say, We Say

Stewart, A., Vrzáková, H., Sun, C., Yonehiro, J., Stone, C., Duran, N. D., Shute, V. J., & D’Mello, S. K. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359296 · Cited by 51 · see citing works

Prediction of Who Will Be the Next Speaker and When Using Gaze Behavior in Multiparty Meetings

Ishii, R., Otsuka, K., Kumano, S., & Yamato, J. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2757284 · Cited by 49 · see citing works

The Effects of Interpersonal Attitude of a Group of Agents on User’s Presence and Proxemics Behavior

Cafaro, A., Ravenet, B., Ochs, M., Vilhjálmsson, H. H., & Pélachaud, C. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2914796 · Cited by 44 · see citing works

Analysis of Respiration for Prediction of "Who Will Be Next Speaker and When?" in Multi-Party Meetings

Ishii, R., Otsuka, K., Kumano, S., & Yamato, J. (2014) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2663204.2663271 · Cited by 44 · see citing works

Smooth Turn-taking by a Robot Using an Online Continuous Model to Generate Turn-taking Cues

Lala, D., Inoue, K., & Kawahara, T. (2019) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3340555.3353727 · Cited by 44 · see citing works

Comparing a humanoid tutor to a human tutor delivering an instructional task to children

Serholt, S., Basedow, C. A., Barendregt, W., & Obaid, M. (2014) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids.2014.7041511 · Cited by 43 · see citing works

The lexicon of the Conductor's gaze

Poggi, I., & Ansani, A. (2018) · International Conference on Movement and Computing (MOCO) · doi:10.1145/3212721.3212811 · Cited by 41 · see citing works

Automatic Visual Attention Detection for Mobile Eye Tracking Using Pre-Trained Computer Vision Models and Human Gaze

Barz, M., & Sonntag, D. (2021) · Sensors · doi:10.3390/s21124143 · Cited by 34 · see citing works

Modeling Feedback in Interaction With Conversational Agents—A Review

Axelsson, A., Buschmeier, H., & Skantze, G. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.744574 · Cited by 33 · see citing works

Predicting next speaker based on head movement in multi-party meetings

Ishii, R., Kumano, S., & Otsuka, K. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178385 · Cited by 32 · see citing works

Using Respiration to Predict Who Will Speak Next and When in Multiparty Meetings

Ishii, R., Otsuka, K., Kumano, S., & Yamato, J. (2016) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2946838 · Cited by 31 · see citing works

Multimodal modeling of collaborative problem-solving facets in triads

Stewart, A. E. B., Keirn, Z., & D’Mello, S. K. (2021) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-021-09290-y · Cited by 30 · see citing works

MultiMediate

Müller, P., Dietz, M., Schiller, D., Thomas, D., Zhang, G., Gebhard, P., André, E., & Bulling, A. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3479219 · Cited by 28 · see citing works

Multimodal Fusion using Respiration and Gaze for Predicting Next Speaker in Multi-Party Meetings

Ishii, R., Kumano, S., & Otsuka, K. (2015) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2818346.2820755 · Cited by 27 · see citing works

Analyzing Gaze Behavior and Dialogue Act during Turn-taking for Estimating Empathy Skill Level

Ishii, R., Otsuka, K., Kumano, S., Higashinaka, R., & Tomita, J. (2018) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3242969.3242978 · Cited by 25 · see citing works

The Multimodal Performance of Conversational Humor

Gironzetti, E. (2022) · Figurative thought and language · doi:10.1075/ftl.13 · Cited by 21 · see citing works

Who's next?

Ehret, J., Bönsch, A., Nossol, P., Ermert, C. A., Mohanathasan, C., Schlittmeier, S. J., Fels, J., & Kuhlen, T. (2023) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3570945.3607312 · Cited by 21 · see citing works

Spiking Neural Networks for early prediction in human–robot collaboration

Zhou, T., & Wachs, J. P. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919872252 · Cited by 20 · see citing works

Evaluating the Disruptiveness of Mobile Interactions

Mayer, S., Lischke, L., Woźniak, P. W., & Henze, N. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173980 · Cited by 18 · see citing works

Prediction of Who Will Be Next Speaker and When Using Mouth-Opening Pattern in Multi-Party Conversation

Ishii, R., Otsuka, K., Kumano, S., Higashinaka, R., & Tomita, J. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3040070 · Cited by 18 · see citing works

Social Signals of Cohesion in Multi-party Interactions

Kantharaju, R. B., & Pélachaud, C. (2021) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3472306.3478362 · Cited by 18 · see citing works

Integrating Gaze and Speech for Enabling Implicit Interactions

Khan, A. A., Newn, J., Bailey, J., & Velloso, E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502134 · Cited by 17 · see citing works

Knowing Where to Look: A Planning-based Architecture to Automate the Gaze Behavior of Social Robots

Mishra, C., & Skantze, G. (2022) · IEEE RO-MAN · doi:10.1109/ro-man53752.2022.9900740 · Cited by 17 · see citing works

Multimodal and Multitask Approach to Listener's Backchannel Prediction

Ishii, R., Ren, X., Muszyński, M., & Morency, L. (2021) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3472306.3478360 · Cited by 16 · see citing works

Empathosphere: Promoting Constructive Communication in Ad-hoc Virtual Teams through Perspective-taking Spaces

Khadpe, P., Kulkarni, C. E., & Kaufman, G. F. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512902 · Cited by 16 · see citing works

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Paul, S. K., Nicolescu, M., & Nicolescu, M. N. (2023) · Sensors · doi:10.3390/s23135798 · Cited by 15 · see citing works

Influence of autistic traits and communication role on eye contact behavior during face-to-face interaction

Thorsson, M., Galazka, M. A., Johnels, J. Å., & Hadjikhani, N. K. (2024) · Scientific Reports · doi:10.1038/s41598-024-58701-8 · Cited by 15 · see citing works

Designing and Evaluating a Wearable Device for Accessing Gaze Signals from the Sighted

Qiu, S., Matthias Rauterberg, A., & Hu, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-40250-5_43 · Cited by 15 · see citing works

Analyzing mouth-opening transition pattern for predicting next speaker in multi-party meetings

Ishii, R., Kumano, S., & Otsuka, K. (2016) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/2993148.2993189 · Cited by 15 · see citing works

Dyadic Gaze Patterns During Child-Robot Collaborative Gameplay in a Tutoring Interaction

Mwangi, E. N., Barakova, E. I., Boladeras, M. D., Catalá, A., & Matthias Rauterberg, A. (2018) · IEEE RO-MAN · doi:10.1109/roman.2018.8525799 · Cited by 15 · see citing works

Improving Collaborative Problem-Solving Skills via Automated Feedback and Scaffolding: A Quasi-Experimental Study with CPSCoach 2.0

D’Mello, S. K., Duran, N., Michaels, A., & Stewart, A. E. B. (2024) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-023-09387-6 · Cited by 14 · see citing works

Using Motion Histories for Eye Contact Detection in Multiperson Group Conversations

Fu, E. Y., & Ngai, M. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3479230 · Cited by 14 · see citing works

Predicting and Understanding Turn-Taking Behavior in Open-Ended Group Activities in Virtual Reality

Wang, P., Han, E., Queiroz, A. C. M., DeVeaux, C., & Bailenson, J. N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757498 · Cited by 13 · see citing works

Multimodal corpus of multiparty conversations in L1 and L2 languages and findings obtained from it

Yamamoto, S., Taguchi, K., Ijuin, K., Umata, I., & Nishida, M. (2015) · Language Resources and Evaluation · doi:10.1007/s10579-015-9299-2 · Cited by 14 · see citing works

Multimodal Turn Analysis and Prediction for Multi-party Conversations

Lee, M.-C., Trinh, M., & Deng, Z. (2023) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3577190.3614139 · Cited by 12 · see citing works

Difference in Eye Gaze for Floor Apportionment in Native- and Second-Language Conversations

Ijuin, K., Umata, I., Kato, T., & Yamamoto, S. (2017) · Journal of Nonverbal Behavior · doi:10.1007/s10919-017-0262-3 · Cited by 12 · see citing works

Online Multimodal End-of-Turn Prediction for Three-party Conversations

Lee, M.-C., & Deng, Z. (2024) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3678957.3685742 · Cited by 10 · see citing works

Effect of Robot Head Movement and its Timing on Human-Robot Interaction

Lee, H. C., & Hahn, S. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01196-0 · Cited by 10 · see citing works

Non-Verbal Behavior Generation for Virtual Characters in Group Conversations

de Coninck, F., Yumak, Z., Guntur Sandino, C., & Veltkamp, R. C. (2019) · IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) · doi:10.1109/aivr46125.2019.00016 · Cited by 10 · see citing works

Can Prediction of Turn-management Willingness Improve Turn-changing Modeling?

Ishii, R., Ren, X., Muszyński, M., & Morency, L. (2020) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3383652.3423907 · Cited by 10 · see citing works

Sensing the Intentions to Speak in VR Group Discussions

Chen, J., Gu, C., Zhang, J., Liu, Z., & Konomi, S. (2024) · Sensors · doi:10.3390/s24020362 · Cited by 9 · see citing works

Analyzing gaze behavior during turn-taking for estimating empathy skill level

Ishii, R., Kumano, S., & Otsuka, K. (2017) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3136755.3136786 · Cited by 9 · see citing works

The Power of Gaze in Music. Leonard Bernstein’s Conducting Eyes

Poggi, I., Ranieri, L., Leone, Y., & Ansani, A. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4020020 · Cited by 9 · see citing works

Exploring Gaze Behaviour and Perceived Personality Traits

Ijuin, K., & Jokinen, K. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49570-1_35 · Cited by 9 · see citing works

Connecting the Brains via Virtual Eyes : Eye-Gaze Directions and Inter-brain Synchrony in VR

Gumilar, I., Barde, A., Hayati, A. F., Billinghurst, M., Lee, G., Momin, A., Averill, C., & Dey, A. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451583 · Cited by 8 · see citing works

Trimodal prediction of speaking and listening willingness to help improve turn-changing modeling

Ishii, R., Ren, X., Muszyński, M., & Morency, L. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.774547 · Cited by 8 · see citing works

SealMates: Improving Communication in Video Conferencing using a Collective Behavior-Driven Avatar

Armstrong, M., Yang, C.-L., Skierś, K., Mengzhen, L., Gunasekaran, T. S., Wang, Z., Narumi, T., Minamizawa, K., & Pai, Y. S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637395 · Cited by 7 · see citing works

"Put Your Hands Up": How Joint Attention Is Initiated Between Blind Children And Their Sighted Peers

Jones, K. M., Grayson, M., Morrison, C. P., Leonards, U., & Metatla, O. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714005 · Cited by 6 · see citing works

On the possibility of predicting gaze aversion to improve video-chat efficiency

Ward, N., Jurado, C. N., Garcia, R. A., & Ramos, F. A. (2016) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/2857491.2857497 · Cited by 6 · see citing works

Multimodal Analysis of Cohesion in Multi-party InteractionsPreprint

Kantharaju, R. B., Langlet, C., Barange, M., Clavel, C., & Pélachaud, C. (2020) · Cited by 6 · see citing works

Autonomous AI Agents for Multi-Platform Social Media Marketing: A Simultaneous Deployment Study

Ahn, J., & Kim, M. (2025) · Electronics · doi:10.3390/electronics14214161 · Cited by 7 · see citing works

Unraveling the thread: understanding and addressing sequential failures in human-robot interaction

Tisserand, L., Stephenson, B., Baldauf-Quilliatre, H., Lefort, M., & Armetta, F. (2024) · Frontiers in Robotics and AI · doi:10.3389/frobt.2024.1359782 · Cited by 7 · see citing works

Next-Speaker Prediction Based on Non-Verbal Information in Multi-Party Video Conversation

Mizuno, S., Hojo, N., Kobashikawa, S., & Masumura, R. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10094679 · Cited by 5 · see citing works

Using Transition Duration to Improve Turn-taking in Conversational Agents

Threlkeld, C., Umair, M., & Ruiter, J. P. D. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.20 · Cited by 5 · see citing works

To laugh or not to laugh? The use of laughter to mark discourse structure

Ludusan, B., & Schuppler, B. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.8 · Cited by 5 · see citing works

Quantifying Social Connection With Verbal and Non-Verbal Behaviors in Virtual Reality Conversations

Kim, H., & Lee, J. (2025) · International Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713674 · Cited by 6 · see citing works

Mobile eye-tracking and mixed-methods approaches to interaction analysis

Oben, B., de Vries, C., & Brône, G. (2025) · Pragmatics & beyond. New series · doi:10.1075/pbns.351.04obe · Cited by 4 · see citing works

Modeling Japanese Praising Behavior by Analyzing Audio and Visual Behaviors

Onishi, T., Yamauchi, A., Ogushi, A., Ishii, R., Fukayama, A., Nakamura, T., & Miyata, A. (2022) · Frontiers in Computer Science · doi:10.3389/fcomp.2022.815128 · Cited by 4 · see citing works

Examining the Impact of Digital Human Gaze Expressions on Engagement Induction

Mok, S., Park, S., & Whang, M. (2023) · Biomimetics · doi:10.3390/biomimetics8080610 · Cited by 4 · see citing works

A Computational Study on Sentence-based Next Speaker Prediction in Multiparty Conversations

Lee, M.-C., Li, W. A., & Deng, Z. (2024) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3652988.3673915 · Cited by 4 · see citing works

Tracking Discourse Topics in Co-speech Gesture

Laparle, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77817-0_18 · Cited by 3 · see citing works

Human Event Recognition in Smart Classrooms Using Computer Vision: A Systematic Literature Review

Córdoba-Tlaxcalteco, M., & Benítez-Guerrero, E. (2023) · Programming and computer software · doi:10.1134/s0361768823080066 · Cited by 3 · see citing works

A Robot Commenting Texts in an Emotional Way

Volkova, L., Kotov, A. A., Klyshinsky, E. S., & Arinkin, N. A. (2017) · Communications in computer and information science · doi:10.1007/978-3-319-65551-2_19 · Cited by 3 · see citing works

Turn-taking intention recognition using multimodal cues in social human-robot interaction

Park, C., Kim, J., & Kang, J.-H. (2017) · International Conference on Control, Automation and Systems (ICCAS) · doi:10.23919/iccas.2017.8204407 · Cited by 3 · see citing works

Data-Driven Control of Eye and Head Movements for Triadic Human-Robot Interactions

Haefflinger, L., Elisei, F., & Bailly, G. (2025) · International Journal of Social Robotics · doi:10.1007/s12369-025-01245-2 · Cited by 2 · see citing works

Gaze behaviour and vocal feedback in task-based dyadic conversations with and without eye contact

Sbranna, S., Savino, M., Baills, F., & Grice, M. (2025) · Frontiers in Communication · doi:10.3389/fcomm.2025.1524453 · Cited by 2 · see citing works

TMAN: A temporal multimodal attention network for backchannel detection

Wang, K., Zhai, X., Cheung, M. M., Fu, E. Y., Chen, P. Q., Ngai, G., & Leong, H. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131605 · Cited by 2 · see citing works

Gaze from and Toward the Silent Third Participant in a Triadic Conversation

Umata, I., Ijuin, K., Kato, T., & Yamamoto, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-21905-5_6 · Cited by 2 · see citing works

G-DAIC: A Gaze Initialized Framework for Description and Aesthetic-Based Image Cropping

Horányi, N., Hou, Y., Leonardis, A., & Chang, H. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3591132 · Cited by 2 · see citing works

Conversación y mirada en aulas urbanas y rurales de primer grado

Páucar, M. A. V., Budnik, C. A., Lebeer, J., & Segovia, A. (2022) · Estudios pedagógicos · doi:10.4067/s0718-07052022000400137 · Cited by 2 · see citing works

A Systematic Literature Review on Vision-Based Human Event Recognition in Smart Classrooms: Identifying Significant Events and Their Applications

Córdoba-Tlaxcalteco, M., & Benítez-Guerrero, E. (2024) · Proceedings of the Institute for System Programming of RAS · doi:10.15514/ispras-2024-36(1)-11 · Cited by 1 · see citing works

Utterances in Social Robot Interactions -- Correlation Analyses between Robot's Fluency and Participant's Impression

Ijuin, K., & Jokinen, K. (2019) · International Conference on Human-Agent Interaction (HAI) · doi:10.1145/3349537.3352792 · Cited by 2 · see citing works

Analysis of Timing Structure of Eye Contact in Turn-changing

Ishii, R., Otsuka, K., Kumano, S., & Yamato, J. (2014) · doi:10.1145/2666642.2666648 · Cited by 2 · see citing works

Eye Gaze Analyses in L1 and L2 Conversations

Ijuin, K., Taguchi, K., Umata, I., & Yamamoto, S. (2014) · doi:10.1145/2666242.2666244 · Cited by 2 · see citing works

Proposing Remote Video Conversation System "PARAPPA": Delivering the Gesture and Body Posture with Rotary Screen

Ijuin, K., Ogata, K., Watanabe, K., Miwa, H., & Yamamoto, Y. (2021) · IEEE RO-MAN · doi:10.1109/ro-man50785.2021.9515454 · Cited by 2 · see citing works

Floor Apportionment Function of Speaker's Gaze in Grounding Acts

Umata, I., Ijuin, K., Kato, T., & Yamamoto, S. (2019) · doi:10.1145/3351529.3360660 · Cited by 2 · see citing works

An Annotation Approach for Social and Referential Gaze in Dialogue.

Somashekarappa, V., Howes, C., & Sayeed, A. (2020) · Language Resources and Evaluation · Cited by 2 · see citing works

Coordination of Speaking Opportunities in Virtual Reality: Analyzing Interaction Dynamics and Context-Aware Strategies

Chen, J., Gu, C., Zhang, J., Liu, Z., Ma, B., & Konomi, S. (2024) · Applied Sciences · doi:10.3390/app142412071 · Cited by 1 · see citing works

On the relationship between gaze and the German recipient token hm_hm

Masuch, J. (2025) · Pragmatics & beyond. New series · doi:10.1075/pbns.351.05mas · Cited by 1 · see citing works

Two Sides to Every Story: Exploring Hybrid Design Teams' Perceptions of Psychological Safety on Slack

Naghshbandi, M., Ferguson, S. A., & Olechowski, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757685 · Cited by 2 · see citing works

Strange Familiars: Exploring the Design of Avatars and Virtual Environments for Reconnecting Dormant Ties in Virtual Reality

Yen, Y.-T., Liao, F.-Y., Yang, C.-L., Chang, R.-C., Cherng, F., & Chen, B. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3614445 · Cited by 1 · see citing works

Learning Multimodal Motion Cues for Online End-of-Turn Prediction in Multi-Party Dialogue

Lee, M.-C., & Deng, Z. (2025) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3716553.3750756 · Cited by 1 · see citing works

Cardiac synchrony, peer relationships, and affective experiences in children during group interactions

Denk, B., Pruessner, J. C., Farah, S., Barth, C., Putra, P. U., Lenggenhager, B., & Grütter, J. (2026) · Scientific Reports · doi:10.1038/s41598-026-41275-y · Cited by 1 · see citing works

Reframing rapport across communicational domains

Wunsche, M., Kaspar, K., & Vogeley, K. T. (2026) · Frontiers in Communication · doi:10.3389/fcomm.2026.1746483 · Cited by 1 · see citing works

Multimodal Feedback in First Encounter Interactions

Jokinen, K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39330-3_28 · Cited by 1 · see citing works

Eye Gaze Analyses in L1 and L2 Conversations: Difference in Interaction Structures

Ijuin, K., Horiuchi, Y., Umata, I., & Yamamoto, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24033-6_13 · Cited by 1 · see citing works

Quantitative analyses of Gaze Activity during Silence: Comparison between Native-Language and Second-Language Conversation.

Umata, I., Tanizoe, T., Ijuin, K., & Yamamoto, S. (2015) · Cited by 1 · see citing works

“Cosmopolitan Canopy” in Hong Kong’s hidden city: Urban design and social life in underground transit hub

Lee, J. M. (2024) · Tunnelling and Underground Space Technology · doi:10.1016/j.tust.2024.106105 · Cited by 1 · see citing works

The GaMMA corpus of Danish polyadic conversations with gaze speech and motion data in quiet and noise

Dourado, M., Hassager, H. G., Udesen, J., & Serafin, S. (2026) · Scientific Data · doi:10.1038/s41597-026-06851-x · Cited by 1 · see citing works

Implicit Nonverbal Behaviors Expressing Closeness by 3D Agents

Kamide, H., Niitsuma, M., & Arai, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25554-5_31

Effects of Linguistic Proficiency and Conversation Topic on Listener’s Gaze in Triadic Conversation

Umata, I., Ijuin, K., Kato, T., & Yamamoto, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-49570-1_47

Interactive Creativity Activities in Remote Learning

Novick, D. (2024) · ASEE Gulf Southwest Section Conference · doi:10.18260/1-2--36387

Estimation of Empathy Skill Level and Personal Traits Using Gaze Behavior and Dialogue Act During Turn-Changing

Ishii, R., Kumano, S., Higashinaka, R., Ozawa, S., & Kinebuchi, T. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90963-5_4

Towards multimodal expression of information reliability in HRI

Jokinen, K., & Wilcock, G. (2022) · International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) · doi:10.1109/aciiw57231.2022.10085997

Index

(2022) · Figurative thought and language · doi:10.1075/ftl.13.index

Appendix A. Research protocol

(2022) · Figurative thought and language · doi:10.1075/ftl.13.app1

Turn-alignment using eye-gaze and speech in conversational interaction

Jokinen, K., Harada, K., Nishida, M., & Yamamoto, S. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-571 · Cited by 36 · see citing works

On eye-gaze and turn-taking

Jokinen, K., Nishida, M., & Yamamoto, S. (2010) · doi:10.1145/2002333.2002352 · Cited by 46 · see citing works

Predicting Turn-Taking Outcomes in Multi-Party Conversation: Interpretable Modelling of Speech and Gaze Dynamics with Interpersonal ClosenessPreprint

Dourado, M., Haddad, K., Hassager, H. G., & Serafin, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.27988

Predicting Turn-Taking by Compact Gazing Transition Patterns in Multiparty Conversation

Tian, L., Jia, Q., & Zhu, Z. C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-75786-5_35 · Cited by 1 · see citing works

Improved Gazing Transition Patterns for Predicting Turn-Taking in Multiparty Conversation

Tian, L. (2021) · International Conference on Video and Image Processing (ICVIP) · doi:10.1145/3511176.3511208