CoChat
Sign Up
Cited by 3Sound Studies and AuralityRadio, Podcasts, and Digital MediaHearing Loss and Rehabilitation

Listening heads

Open access
Kok, de, Iwan·2013
DOI 10.3990/1.9789036506489
Open this paper in CoChat — free accountOpen PDF

Abstract

Vier jaar onderzoek samengevat.Dat ligt nu voor je.Een persoonlijke mijlpaal, maar zeker geen mijlpaal die ik alleen heb bereikt.Vele mensen hebben mij direct of indirect gesteund de afgelopen vier jaar en die verdienen een bedankje.Als eerste wil ik mijn ouders bedanken.Jullie hebben me altijd gesteund in alles wat ik wilde doen en daar ben ik jullie erg dankbaar voor.Zonder jullie steun en de gegeven vrijheid zou ik nooit zo ver gekomen zijn.Ik laat het te weinig merken, maar ik hou van jullie.Ik wil ook mijn flatgenoten bedanken.Ook na elf jaar is Flat Lodewijck nog altijd een fijne plek om naar terug te keren na een werkdag.Er is altijd wel iemand met een luisterend oor beschikbaar.Door de jaren heen hebben veel mensen deel uit gemaakt van onze flat, maar de ongedwongen, relaxte Lodewijck-sfeer is altijd gebleven, één van de redenen dat ik er ook tijdens mijn promotie-traject ben blijven wonen.Vooral wil ik Dirk bedanken voor het geloof in mij en de vrijheid die ik van je kreeg om mijn eigen route te kiezen.De gesprekken, niet alleen over het onderzoek, maar ook over de alledaagse dingen waren erg prettig.Ik herinner me vooral nog het weekend in Parijs, waar je Ronald, Dennis, Khiet en mij uitgenodigd had om je appartement te bezoeken en ons langs allerlei winkeltjes met lekkernijen leidde.Ook wil ik alle andere collegas van HMI bedanken voor de leuke, leerzame en gezellige tijd die ik er gehad heb.Een aantal collegas wil ik nog specifiek noemen.Ronald; voor zijn altijd aanwezige enthousiasme, die leven in de brouwerij brengt.De vele conferenties/summerschools die we samen bezochten en de vakantiedagen die we er in IJsland en Californi aan vast plakten waren ook altijd erg gezellig.De samenwerkingen aan een aantal papers en discussies over onderzoek in het algemeen waren ook erg leerzaam.Khiet, voor het delen van ons kantoor op de vakgroep, Lynn, voor het doorlezen en verbeteren van mijn thesis, Hendri voor alle hulp met het creëren van het MultiLis corpus, Charlotte en Alice voor de administratieve hulp bij de dagelijkse gang van zaken.Ook alle bachelor-referaat studenten die meegeholpen hebben met onderdelen van het onderzoek en alle deelnemers aan de onderzoeken wil ik bedanken.Furthermore, I would like to thank Louis-Philippe Morency.In 2008 I went off to the USC Institute of Creative Technologies for an internship, thinking I would be working with Jonathan Gratch on "something" with virtual humans -the subject was not determined beforehand.Instead I was working with a crazy, enthusiastic French Canadian guy who introduced me to listener behavior prediction, the topic I would be working on ever since.This first research experience also convinced me to pursue vi | Acknowledgements a career in research.Since then we continued to work together from time to time, which I really enjoy.Your push for perfection is inspiring.I'm glad you could be part of my graduation committee.I would also like to thank the other committee members for participating in my defense.De mensen van A.D.S.K.V. Slagvaardig wil ook bedanken voor het geven van een heerlijke uitlaatklep elke week op het knotsbal veld en de gezellige activiteiten er om heen.Ook naar de pokermiddagen met mijn vrienden van de middelbare school, de D&D weekenden met vrienden van de universiteit en barbecues met mijn ouddoegroepgenoten kijk ik altijd weer uit en ik ben blij dat we deze tradities nog steeds in stand weten te houden.Bavelas et al. [7] make the distinction between generic and specific listener responses.In this distinction the generic listener responses are not specifically connected to what the speaker is saying.One could easily interchange one generic listener response with another and both would be equally appropriate.The main function of these generic listener responses is to signal attendence and a general notion of understanding to let the speaker know he/she can continue.Typical generic listener responses include nods and minimal verbal utterance such as "mm-hmm" or "yeah".The focus of the thesis is on this generic type of listener responses, as the head nods and vocalizations in the corpus recorded for this thesis are all of the this type.The specific listener responses in this distinction are tightly connected to what the speaker is saying.These listener responses give an assessment of what has been

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3990/1.9789036506489

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Analyses showed that there are places in the speech where only one or two listeners respond with a backchannel but also places where all three listeners responded.

    “Analyses showed that there are places in the speech where only one or two listeners respond with a backchannel but that there are also places where all three listeners responded (de Kok, 2013).”

    From Modeling Feedback in Interaction With Conversational Agents—A Review (2022) · cites this paper as de Kok, 2013

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 154

  1. Iwan de Kok, Derya Ozkan, Dirk Heylen and Louis-Philippe Morency. Learning and Evaluating Response Prediction Models using Parallel Listener Consensus. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, pages 3-10, 2010.
  2. Iwan de Kok and Dirk Heylen. The MultiLis Corpus -Dealing with Individual Differences in Nonverbal Listening Behavior, in Proceedings of the Third COST 2102 International Training School, pages 362-375, 2011.
  3. Iwan de Kok and Dirk Heylen. Observations on Listener Responses from Multiple Perspectives, in Proceedings of the 3rd Nordic Symposium on Multimodal Communication, pages 48-55, 2011.
  4. Iwan de Kok and Dirk Heylen. Appropriate and Inappropriate Timing of Listener Responses from Multiple Perspectives, in Intelligent Virtual Agents, pages 248-254, 2011.
  5. Iwan de Kok and Dirk Heylen. Analyzing Nonverbal Listener Responses using Parallel Record- ings of Multiple Listeners. Cognitive Processing, 13(2):499-506, 2012.
  6. Iwan de Kok and Dirk Heylen. A survey on evaluation metrics for backchannel prediction models, in Proceedings of the Interdisciplinary Workshop on Feedback Behaviors in Dialog, pages 15-18, 2012.
  7. Iwan de Kok and Dirk Heylen. Integrating Backchannel Prediction Models into Embodied Conversational Agents. In Proceedings of the 11th International Conference on Intelligent Virtual Agents (IVA 2012), pages 268-274, 2012.
  8. Iwan de Kok and Dirk Heylen. Controlling the Listener Response Rate of Virtual Agents. Accepted for publication at the 12th International Conference on Intelligent Virtual Agents (IVA 2013), 2013.
  9. Iwan de Kok, Dirk Heylen and Louis-Philippe Morency. Speaker-Adaptive Multimodal Predic- tion Model for Listener Responses. Submitted to the 15th ACM International Conference on Multimodal Interaction (ICMI 2013), under review.
  10. Iwan de Kok and Dirk Heylen. Generating Generic Listener Responses for Virtual Agents. under review.
  11. Iwan de Kok, Ronald Poppe and Dirk Heylen. Iterative Perceptual Learning for Social Behavior Synthesis, under review. Additional Publications
  12. Louis-Philippe Morency, Iwan de Kok and Jonathan Gratch. Context-based Recognition during Human Interactions: Automatic Feature Selection and Encoding Dictionary. In Proceedings of the 10th international conference on Multimodal interfaces, pages 181-188, 2008.
  13. Louis-Philippe Morency, Iwan de Kok and Jonathan Gratch. Predicting Listener Backchannels: A Probabilistic Multimodal Approach. In Intelligent Virtual Agents, pages 176-190, 2008.
  14. Iwan de Kok and Dirk Heylen. Multimodal End-of-Turn Prediction in Multi-Party Meetings. In Proceedings of the International Conference on Multimodal Interfaces, pages 91-98, 2009.
  15. Louis-Philippe Morency, Iwan de Kok and Jonathan Gratch. A Probabilistic Multimodal Ap- proach for Predicting Listener Backchannels, Journal of Autonomous Agents and Multi-Agent Systems, 20(1):70-85, 2010.
  16. Iwan de Kok and Dirk Heylen. Differences in Listener Responses between Procedural and Narrative Tasks, in Proceedings of the 2nd International Workshop on Social Signal Processing, pages 5-10, 2010.
  17. Rieks op den Akker, Mariet Theune, Khiet Truong and Iwan de Kok. The Organisation of Floor in Meetings and the Relation with Speaker Addressee Patterns, in Proceedings of the 2nd International Workshop on Social Signal Processing, pages 35-40, 2010.
  18. Dennis Reidsma, Iwan de Kok, Daniel Neiberg, Satish Pammi, Bart van Straalen, Khiet Truong and Herwin van Welbergen. Continuous Interaction with a Virtual Human. Journal on Multi- modal User Interfaces, 4(2):97-118, 2011.
  19. Iwan de Kok and Dirk Heylen. When Do We Smile? Analysis and Modeling of the Nonver- bal Context of Listener Smiles in Conversation. In Proceedings of the 4th 4th International Conference on Affective Computing and Intelligent Interaction, pages 477-486, 2011. Bibliography
  20. Jens Allwood and Loredana Cerrato. A study of gestural feedback expressions. In Proc. of the First Nordic Symposium on Multi-modal Communication, pages 7-20, 2003.
  21. Jens Allwood, Joakim Nivre, and Elisabeth Ahlsén. On the Semantics and Pragmatics of Linguistic Feedback. Journal of Semantics, 9(1):1-26, 1992.
  22. Michael Argyle and Mark Cook. Gaze and mutual gaze. Cambridge University Press, London, United Kingdom, 1976.
  23. Michael Argyle, Roger Ingham, Florisse Alkema, and Margaret McCallin. The different functions of gaze. Semiotica, 7(1):19-32, 1973.
  24. Janet Beavin Bavelas, Linda Coates, and Trudy Johnson. Listener responses as a col- laborative process: The role of gaze. Journal of Communication, 52(3):566-580, 2002.
  25. Janet Beavin Bavelas and Jennifer Gerwing. The Listener as Addressee in Face-to-Face Dialogue. International Journal of Listening, 25(3):178-198, 2011.
  26. Stefan Benus, Agustín Gravano, and Julia Hirschberg. The prosody of backchannels in american english. In In Proceedings of ICPhS, pages 1065-1068, 2007.
  27. Roxane Bertrand, Morgane Ader, Philippe Blache, Gaëlle Ferré, Robert Espesser, and Stéphane Rauzy. Représentation, édition et exploitation de données multimodales : le cas des backchannels du corpus CID. Cahiers de l'Institut de Linguistique de Louvain, 33(2):1-18, 2009.
  28. Roxane Bertrand, Philippe Blache, and Gaëlle Ferré. Le CID-Corpus of Interactional Data-Annotation et exploitation multimodale de parole conversationnelle. Traitement Automatique des Languages, 49(3), 2008.
  29. Roxane Bertrand, Gaëlle Ferré, Philippe Blache, Robert Espesser, and Stéphane Rauzy. Backchannels revisited from a multimodal perspective. In Proceedings of Auditory-visual Speech Processing, pages 1-5, 2007.
  30. Camiel J Beukeboom. When words feel right : How affective expressions of listeners change a speaker's language use. European Journal of Social Psychology, 756:747-756, 2009.
  31. Elisabetta Bevacqua, Dirk Heylen, Catherine Pelachaud, and Marion Tellier. Facial feedback signals for ecas. In Proceedings of AISB, 2007.
  32. Elisabetta Bevacqua, Sathish Pammi, Sylwia Julia Hyniewska, Marc Schröder, and Catherine Pelachaud. Multimodal Backchannels for Embodied Conversational Agents. In Intelligent Virtual Agents, pages 194-200, 2010.
  33. Susan E. Brennan and Michael F. Schrober. How Listeners Compensate for Disfluencies in Spontaneous Speech. Journal of Memory and Language, 44(2):274-296, 2001.
  34. Hennie Brugman and Albert Russel. Annotating multimedia/multi-modal resources with ELAN. In Proceedings of the Fourth International Conference on Language Resources and Evaluation, pages 2065-2068, 2004.
  35. Lawrence J. Brunner. Smiles can be back channels. Journal of Personality and Social Psychology, 37(5):728-734, 1979.
  36. Hendrik Buschmeier and Stefan Kopp. Towards conversational agents that attend to and adapt to communicative user feedback. In Intelligent Virtual Agents, pages 169- 182, 2011.
  37. Hendrik Buschmeier and Stefan Kopp. Understanding how well you understoodcontext-sensitive interpretation of multimodal user feedback. In In- telligent Virtual Agents, pages 517-519, 2012.
  38. Johanneke Caspers. Melodic characteristics of backchannels in Dutch Map Task dia- logues. In Sixth International Conference on Spoken Language Processing, 2000.
  39. Justine Cassell, Timothy W. Bickmore, Mark Billinghurst, L. Campbell, K. Chang, H. Vilhjálmsson, and H. Yan. Embodiment in conversational interfaces: Rea. Pro- ceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, pages 520-527, 1999.
  40. Justine Cassell, Alastair J Gill, and Paul A Tepper. Coordination in conversation and rapport. In Proceedings of the Workshop on Embodied Natural Language, pages 24-29, 2007.
  41. Nicola Cathcart, Jean Carletta, and Ewan Klein. A shallow model of backchannel continuers in spoken dialogue. European ACL, pages 51-58, 2003.
  42. Loredana Cerrato. Some characteristics of feedback expressions in Swedish. In Proc. of Fonetik, volume 44, pages 41-44, 2002.
  43. Loredana Cerrato and Mustapha Skhiri. Analysis and measurement of head movements signalling feedback in face-to-face human dialogues. In Proceedings of the First Nordic Symposium on Multimodal Communication, pages 43-52, 2003.
  44. Ching-Chung Chang and Chih-Jen Lin. LIBSVM: a library for support vector machines. Bibliography | 131 ACM Transactions on Intelligent System and Technology, 2(3):1-27, 2011.
  45. Tanya L. Chartrand and John A. Bargh. The chameleon effect: the perception-behavior link and social interaction. Journal of personality and social psychology, 76(6):893-910, 1999.
  46. Patricia M. Clancy, Sandra A. Thompson, Ryoko Suzuki, and Hongyin Tao. The conver- sational use of reactive tokens English, Japanese, and Mandarin. Journal of Pragmatics, 26(3):355-387, 1996.
  47. Herbert H. Clark. Using Language. Cambridge University Press, 1996.
  48. Herbert H. Clark and Thomas B. Carlson. Hearers and speech acts. Language, 58(2):332-373, 1982.
  49. Herbert H. Clark and Meredyth A. Krych. Speaking while monitoring addressees for understanding. Journal of Memory and Language, 50(1):62-81, 2004.
  50. Herbert H. Clark and Edward F. Schaefer. Contributing to discourse. Cognitive Science: A Multidisciplinary Journal, 13(2):259-294, 1989.
  51. Etienne de Sevin, Sylwia Julia Hyniewska, and Catherine Pelachaud. Influence of personality traits on backchannel selection. Intelligent Virtual Agents, pages 187-193, 2010.
  52. David DeVault, Kenji Sagae, and David Traum. Can I finish?: Learning when to re- spond to incremental interpretation results in interactive dialogue. In Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 11-20. Association for Computational Linguistics, 2009.
  53. Allen T. Dittmann and Lynn G. Llewellyn. Relationship between vocalizations and head nods as listener responses. Journal of Personality and Social Psychology, 9(1):79-84, 1968.
  54. J.A. Dixon and D.H. Foster. Gender, Social Context and Backchannel Responses. The Journal of social psychology, 138(1):134-136, 1998.
  55. Thomas Drugman and Abeer Alwan. Joint robust voicing detection and pitch estima- tion based on residual harmonics. In Interspeech, pages 1973-1976, 2011.
  56. Kent Drummond and Robert Hopper. Back Channels Revisited: Acknowledgment Tokens and Speakership Incipiency. Research on Language and Social Interaction, 26(2):157-77, 1993.
  57. Starkey Duncan Jr. On the structure of speaker-auditor interaction during speaking turns. Language in society, 3(2):161-180, 1974.
  58. Jens Edlund, Mattias Heldner, and Antoine Pelcé. Prosodic Features of Very Short Utterances in Dialogue. In Nordic Prosody, pages 95-106, 2009.
  59. Marylin S. Feke. Effects of Native Language and Sex on Back Channel Behavior. In Selected Proceedings from the First Workshop on Spanish Sociolinguistics. Somerville, MA: Cascadilla Proceedings Project, number 1997, pages 96-106, 2003.
  60. Anna M. Fellegy. Patterns and Functions of Minimal Response. American Speech, 70(2):186, 1995.
  61. Jean E. Fox Tree. Listening in on Monologues and Dialogues. Discourse Processes, 27(1):35-53, 1999.
  62. Jean E. Fox Tree. Listeners' uses of um and uh in speech comprehension. Memory & cognition, 29(2):320-6, March 2001.
  63. Shinya Fujie, Kenta Fukushima, and Tetsunori Kobayashi. A conversation robot with back-channel feedback function based on linguistic and nonlinguistic information. In Proc. Int. Conference on Autonomous Robots and Agents, pages 379-384, 2004.
  64. Rod Gardner. Between speaking and listening: the vocalisation of understandings. Applied Linguistics, 19(2):204-224, 1998.
  65. Erving Goffman. Forms of Talk. University of Pennsylvania Press, Philadelphia, 1981.
  66. Charles Goodwin. The interactive construction of a sentence in natural conversation. Everyday language: Studies in ethnomethodology, pages 97-121, 1979.
  67. Charles Goodwin. Conversational Organization: interaction between speakers and hear- ers. Academic Press, 1981.
  68. Marjorie Harness Goodwin and Charles Goodwin. Concurrent Operations on Talk: Notes on the Interactive Organization of Assessments. IPRA Papers in Pragmatics, 1(1):1-54, 1987.
  69. Björn Granström, David House, and Marc Swerts. Multimodal feedback cues in human- machine interactions. In Speech Prosody, pages 11-14, 2002.
  70. Jonathan Gratch, Anna Okhmatovskaia, Francois Lamothe, Stacy Marsella, Mathieu Morales, R J Van Der Werf, and Louis-Philippe Morency. Virtual rapport. In Intelligent Virtual Agents, pages 14-27, 2006.
  71. Jonathan Gratch, Ning Wang, Jillian Gerten, Edward Fast, and Robin Duffy. Creating rapport with virtual agents. In Intelligent Virtual Agents, pages 125-138, 2007.
  72. Agustín Gravano and Julia Hirschberg. Backchannel-Inviting Cues in Task-Oriented Dialogue. In Interspeech 2009, pages 1019-1022, 2009.
  73. Stanford W. Gregory Jr. and Brian R. Hoyt. Conversation partner mutual adaptation as demonstrated by Fourier series analysis. Journal of Psycholinguistic Research, 11(1):35- 46, January 1982.
  74. Anna M. Guthrie. On the systematic deployment of okay and mmhmm in academic advising sessions. Journal of Pragmatics, 7(3):397-415, 1993.
  75. Uri Hadar, Timothy J. Steiner, and F. Clifford Rose. Head movement during listening turns in conversation. Journal of Nonverbal Behavior, 9(4):214-228, 1985.
  76. Reiko Hayashi. Floor structure of English and Japanese conversation. Journal of Prag- matics, 16(1):1-30, July 1991.
  77. Bettina Heinz. Backchannel responses as strategic responses in bilingual speakers' Bibliography | 133 conversations. Journal of Pragmatics, 35(7):1113-1142, 2003.
  78. Mattias Heldner, Anna Hjalmarsson, and Jens Edlund. Backchannel relevance spaces. In Proceedings of Nordic Prosody XI, 2013.
  79. John Heritage. A change-of-state token and aspects of its sequential placement. Struc- tures of social action: Studies in conversation analysis, pages 299-345, 1984.
  80. Dirk Heylen. Listening Heads. In Modeling Communication with robots and virtual agents, volume 4930 of Lecture Notes in Artificial Intelligence, pages 241-259. 2008.
  81. Dirk Heylen and Rieks op den Akker. Computing backchannel distributions in multi- party conversations. In Proceedings of the Workshop on Embodied Language Processing, pages 17-24, 2007.
  82. Beth Ann Hockey. Prosody and the role of okay and uh-huh in discourse. Methods, pages 128-136, 1993.
  83. Lixing Huang, Louis-Philippe Morency, and Jonathan Gratch. Learning Backchannel Prediction Model from Parasocial Consensus Sampling : A Subjective Evaluation. In Proceedings of the International Conference on Autonomous Agents and Multiagent Sys- tems (AAMAS), pages 159-172, 2010.
  84. Lixing Huang, Louis-Philippe Morency, and Jonathan Gratch. Parasocial Consensus Sampling: Combining Multiple Perspectives to Learn Virtual Human Behavior. In Pro- ceedings of Autonomous Agents and Multi-Agent Systems, pages 1265-1272, 2010.
  85. Lixing Huang, Louis-Philippe Morency, and Jonathan Gratch. Virtual Rapport 2.0. In Intelligent Virtual Agents, pages 68-79, 2011.
  86. Marijn Huijbregts. Segmentation , Diarization and Speech Transcription : Surprise Data Unraveled. Phd thesis, University of Twente, 2008.
  87. Yuri Iwano, Shioya Kageyama, Emi Morikawa, Shu Nakazato, and Katsuhiko Shirai. Analysis of head movements and its role in spoken dialogue. In Spoken Language Processing, number Figure 1, pages 2167-2170, 1996.
  88. Gail Jefferson. Is no an acknowledgment token? Comparing American and British uses of (+)/(-) tokens. Journal of pragmatics, 34(10-11):1345-1383, 2002.
  89. Oliver P. John, Richard W. Robins, and Lawrence A. Pervin, editors, Handbook of per- sonality: Theory and research, chapter 4, pages 114-158. Guilford Press, New York, New York, USA, 3 edition, 2008.
  90. Sotaro Kita and Sachiko Ide. Nodding, aizuchi , and final particles in Japanese conver- sation: How conversation reflects the ideology of communication and social relation- ships. Journal of Pragmatics, 39(7):1242-1254, 2007.
  91. Norihide Kitaoka, Masashi Takeuchi, Ryota Nishimura, and Seiichi Nakagawa. Re- sponse Timing Detection Using Prosodic and Linguistic Information for Human-friendly Spoken Dialog Systems. Transactions of the Japanese Society for Artificial Intelligence, 20:220-228, 2005.
  92. Hanae Koiso, Yasuo Horiuchi, Syun Tutiya, Akira Ichikawa, and Yasuharu Den. An Analysis of Turn-Taking and Backchannels Based on Prosodic and Syntactic Features in Japanese Map Task Dialogs. Language and Speech, 41(3-4):295-321, 1998.
  93. Robert M. Krauss, Connie M. Garlock, Peter D. Bricker, and Lee E. McMahon. The role of audible and visible back-channel responses in interpersonal communication. Journal of Personality and Social Psychology, 35(7):523-529, 1977.
  94. Robert M. Krauss and Sidney Weinheimer. Concurrent feedback, confirmation, and the encoding of referents in verbal communication. Journal of personality and social psychology, 4(3):343-6, 1966.
  95. Robert E. Kraut, Steven H. Lewis, and Lawrence W. Swezey. Listener responsiveness and the coordination of conversation. Journal of Personality and Social Psychology, 43(4):718-731, 1982.
  96. Klaus Krippendorff. Estimating the Reliability, Systematic Error and Random Error of Interval Data. Educational and Psychological Measurement, 30(1):61-70, 1970.
  97. John Lafferty, Andrew McCallum, and Fernando Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of International Conference on Machine Learning, pages 282-289, 2001.
  98. Campbell Leaper, Mary Carson, Carilyn Baker, Heithre Holliday, and Sharon Myers. Self-disclosure and listener verbal support in same-gender and cross-gender friends' conversations. Sex Roles, 33(5-6):387-404, 1995.
  99. Stephen C. Levinson. Pragmatics. Cambridge University Press, Cambridge, 1983.
  100. Gina-Anne Levow, Susan Duncan, and Edward T. King. Cross-cultural Investigation of Prosody in Verbal Feedback in Interactional Rapport. In nterspeech 2010, pages 286-289, 2010.
  101. Gina-Anne Levow and Siwei Wang. Employing boosting to compare cues to verbal feedback in multi-lingual dialog. Workshop on Spoken Language Technology, pages 67- 72, 2012.
  102. Kristina Lundholm Fors. The temporal relationship between feedback and pauses: a pilot study. In Feedback Behaviors in Dialog, pages 43-45, 2012.
  103. R. M. Maatman, Jonathan Gratch, and Stacy Marsella. Natural behavior of a listening agent. In Intelligent Virtual Agents, pages 25-36, 2005.
  104. Tammy A. Marche and Carole Peterson. On the gender differential use of listener responsiveness. Sex Roles, 29(11-12):795-816, 1993. Bibliography | 135
  105. Senko K. Maynard. Conversation management in contrast: Listener response in Japanese and American English. Journal of Pragmatics, 14(3):397-412, June 1990.
  106. Daniel N. McIntosh. Facial feedback hypotheses: Evidence, implications, and direc- tions. Motivation and Emotion, 20(2):121-147, 1996.
  107. Louis-Philippe Morency, Iwan de Kok, and Jonathan Gratch. Context-based Recogni- tion during Human Interactions: Automatic Feature Selection and Encoding Dictio- nary. In 10th International Conference on Multimodal Interfaces, pages 181-188, Cha- nia, Crete, Greece, 2008. ACM.
  108. Louis-Philippe Morency, Iwan de Kok, and Jonathan Gratch. Predicting Listener Backchannels: A Probabilistic Multimodal Approach. In Intelligent Virtual Agents, pages 176-190, 2008.
  109. Louis-Philippe Morency, Iwan de Kok, and Jonathan Gratch. A probabilistic multimodal approach for predicting listener backchannels. Autonomous Agents and Multi-Agent Systems, 20(1):70-84, 2011.
  110. Anthony Mulac, Karen T. Erlandson, W. Jeffrey Farrar, Jennifer S. Hallett, Jennifer L. Molloy, and Margaret E. Prescott. "Uh-huh. What's That All About?": Differing Inter- pretations of Conversational Backchannels and Questions as Sources of Miscommuni- cation Across Gender Boundaries. Communication Research, 25(6):641-668, 1998.
  111. Daniel Neiberg and Joakim Gustafson. Predicting speaker changes and listener re- sponses with and without eye-contact. Interspeech, pages 1565-1568, 2011.
  112. Daniel Neiberg, Giampiero Salvi, and Joakim Gustafson. Semi-supervised methods for exploring the acoustics of simple productive feedback. Speech Communication, 55(3):451-469, 2013.
  113. Daniel Neiberg and Khiet P. Truong. Online detection of vocal listener responses with maximum latency constraints. In Acoustics, Speech and Signal Processing, pages 7-10, 2011.
  114. Ryota Nishimura, Norihide Kitaoka, and Seiichi Nakagawa. A spoken dialog system for chat-like conversations considering response timing. In Text, Speech and Dialogue, pages 599-606. Springer, 2007.
  115. Y. Okato, K. Kato, M. Kamamoto, and S. Itahashi. Insertion of interjectory response based on prosodic information. Proceedings of IVTTA '96. Workshop on Interactive Voice Technology for Telecommunications Applications, pages 85-88, 1996.
  116. Derya Ozkan and Louis-Philippe Morency. Latent Mixture of Discriminative Experts. IEEE Transaction on Multimedia, 15(2):326-338, 2013.
  117. Derya Ozkan, Kenji Sagae, and Louis-Philippe Morency. Latent Mixture of Discrimina- tive Experts for Multimodal Prediction Modeling. In Computational Linguistics, pages 860-868, 2010.
  118. Patrizia Paggio and Costanza Navarretta. Head movements, facial expressions and feedback in conversations: empirical evidence from Danish multimodal data. Journal on Multimodal User Interfaces, 7(1-2):29-37, 2012.
  119. Sathish Pammi and Marc Schröder. Evaluating the meaning of synthesized listener vocalizations. In Interspeech, 2011.
  120. Ronald Poppe, Mark ter Maat, and Dirk Heylen. Online Backchannel Synthesis Evalu- ation with the Switching Wizard of Oz. In Workshop on Real-Time Conversations with Virtual Agents, number 1, pages 1-8, 2012.
  121. Ronald Poppe, Khiet Truong, and Dirk Heylen. Backchannels: Quantity, Type and Timing Matters. In Intelligent Virtual Agents, pages 228-239, 2011.
  122. Ronald Poppe, Khiet P Truong, Dennis Reidsma, and Dirk Heylen. Backchannel Strate- gies for Artificial Listeners. In Intelligent Virtual Agents, pages 146-158, 2010.
  123. Ken Prepin, Magalie Ochs, and Catherine Pelachaud. Beyond backchannels: co- construction of dyadic stance by reciprocal reinforcement of smiles between virtual agents. In Proceedings of COGSCI 2013 The Annual Meeting of the Cognitive Science Society, pages 37-39, 2013.
  124. Julie Reid. A study of gender differences in minimal responses. Journal of Pragmatics, 24(5):489-512, 1995.
  125. Jennifer Robison, Scott McQuiggan, and James Lester. Evaluating the Consequences of Affective Feedback in Intelligent Tutoring Systems. In Affective Computing and Intel- ligent Interaction, pages 1-6, 2009.
  126. Howard M. Rosenfeld. Instrumental affiliative functions of facial and gestural expres- sions. Journal of Personality and Social Psychology, 4(1):65-72, 1966.
  127. Harvey Sacks, Emanuel A. Schegloff, and Gail Jefferson. A Simplest Systematics for the Organization of Turn-Taking for Conversation. Language, 50(4):696-735, 1974.
  128. Marc Schröder, Dirk Heylen, and Isabella Poggi. Perception of non-verbal emotional listener feedback. Speech prosody, pages 1-4, 2006.
  129. Candace L. Sidner and Christopher Lee. Attentional gestures in dialogues between people and robots. In Toyoaki Nishida, editor, Engineering Approaches to Conversational Informatics., chapter 6, pages 1-15. 2007.
  130. Gabriel Skantze. A Testbed for Examining the Timing of Feedback using a Map Task. In Feedback Behaviors in Dialog, pages 69-72, 2012.
  131. Gabriel Skantze, David House, and Jens Edlund. User Responses to Prosodic Variation in Fragmentary Grounding Utterances in Dialog. In Ninth International Conference on Spoken Language Processing, 2006.
  132. Maria Stubbe. Are you listening? Cultural influences on the use of supportive verbal feedback in conversation. Journal of Pragmatics, 29(3):257-289, 1998.
  133. Masashi Takeuchi, Norihide Kitaoka, and Seiichi Nakagawa. Timing detection for real- time dialog systems using prosodic and linguistic information. International Conference on Speech Prosody, pages 529-532, 2004.
  134. Kristinn R. Thórisson. Communicative humanoids: a computational model of psychoso- Bibliography | 137 cial dialogue skills. PhD thesis, Massachusetts Institute of Technology, 1996.
  135. Sue E. Tranter and Douglas A. Reynolds. An overview of automatic speaker diarization systems. Audio, Speech, and Language Processing, 14(5):1557-1565, 2006.
  136. David Traum, David DeVault, Jina Lee, Zhiyang Wang, and Stacy Marsella. Incremental Dialogue Understanding and Feedback for Multiparty, Multimodal Conversation. In Intelligent Virtual Agents, pages 275-288, 2012.
  137. Khiet Truong, Ronald Poppe, Iwan de Kok, and Dirk Heylen. A multimodal analysis of vocal and visual backchannels in spontaneous dialogs. In interspeech, pages 2973- 2976, 2011.
  138. Herwin van Welbergen, Dennis Reidsma, Zsófia M. Ruttkay, and Job Zwiers. Elckerlyc - A BML Realizer for continuous, multimodal interaction with a Virtual Human. Journal on Multimodal User Interfaces, 3(4):271-284, 2010.
  139. Astrid von der Pütten, Christian Reipen, Antje Wiedmann, Stefan Kopp, and Nicole C. Krämer. Comparing Emotional vs. Envelope Feedback for Embodied Conversational Agents. In Intelligent Virtual Agents, pages 550-551, 2008.
  140. Astrid von der Pütten, Christian Reipen, Antje Wiedmann, Stefan Kopp, and Nicole C. Krämer. The Impact of Different Embodied Agent-Feedback on Users Behavior. In Intelligent Virtual Agents, pages 549-551, 2009.
  141. Å sa Wallers, Jens Edlund, and Gabriel Skantze. The effect of prosodic features on the interpretation of synthesised backchannels. In International Tutorial and Research Workshop, volume 4021, page 183, Kloster Irsee, Germany, 2006. Springer.
  142. Ning Wang and Jonathan Gratch. Don't Just Stare at Me! In Proceedings of the 28th international conference on Human factors in computing systems -CHI '10, pages 1241- 1249, 2010.
  143. Zhiyang Wang, Jina Lee, and Stacy Marsella. Towards More Comprehensive Listen- ing Behavior: Beyond the Bobble Head. In Intelligent Virtual Agents, pages 216-227. Springer, 2011.
  144. Nigel Ward and Yaffa Al Bayyari. A case study in the identification of prosodic cues to turn-taking: Back-channeling in Arabic. In Interspeech 2006 Proceedings, 2006.
  145. Nigel Ward and Joshua L. McCartney. Visualizations Supporting the Discovery of Prosodic Contours Related to Turn-Taking. In Feedback Behaviors in Dialog, pages 85- 89, 2012.
  146. Nigel Ward and Wataru Tsukahara. Prosodic features which cue back-channel re- sponses in English and Japanese. Journal of Pragmatics, 32(8):1177-1207, 2000.
  147. Tmio Watanabe and Naohiko Yuuki. A Voice Reaction System with a Visualized Re- sponse Equivalent to Nodding. In Proceedings of the third international conference on human-computer interaction, Vol.1 on Work with computers: organizational, manage- ment, stress and health aspects, pages 396-403, 1989.
  148. Ron White. Back channelling, repair, pausing, and private speech. Applied Linguistics, 18(3):314, 1997.
  149. Sheida White. Backchannels across cultures: A study of Americans and Japanese. Language in Society, 18(1):59-76, 1989.
  150. James P. Wolf. The effects of backchannels on fluency in L2 oral task production. System, 36(2):279-294, 2008.
  151. Deng Xudong. The Use of Listener Responses in Mandarin Chinese and Australian English Conversations. Pragmatics, 18(2):303-328, 2010.
  152. Victor H. Yngve. On getting a word in edgewise. In Sixth Regional Meeting of the Chicago Linguistic Society, volume 6, pages 657-677, 1970.
  153. Don H. Zimmerman. Acknowledgment Tokens and Speakership Incipiency Revisited. Research on Language and Social Interaction, 26(2):179-94, 1993. SIKS Dissertations 2013-28
  154. Benedikt Kratz (UvT), A Model and Language for Business-aware Transactions 2012-44

Cited by

Sorted by citations

Authors
Kok, D.
Affiliations
Tilburg University (NL)
Corresponding author
Kok, de, Iwan
Publisher
University Library/University of Twente
Published
2013-08-15
DOI
10.3990/1.9789036506489
OpenAlex
W4256580614
Cited by
3
References
10
Citations by year
2026: 1 · 2024: 1 · 2018: 1
Type
dissertation
Language
en
Open access
Locations
University of Twente Research Information (submittedVersion, other-oa)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Sound Studies and Aurality
  • Social Sciences › Communication › Radio, Podcasts, and Digital Media
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Hearing Loss and Rehabilitation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review