Multimodal Language Processing in Human Communication

Holler, Judith, Levinson, Stephen C.·2019·Trends in Cognitive Sciences
DOI 10.1016/j.tics.2019.05.006

Cited by (433)

Items 301–400 of 433

  1. Social attention in the real world
    Gijs A. Holleman · 2021
  2. Great ape communication as contextual social inference: a computational modeling perspective
    Manuel Bohn, Katja Liebal, Michael Henry Tessler · 2021
  3. Supplementary VLR Data and Code in R
    2020 · John Benjamins Publishing Company eBooks
  4. Gestures and pauses to help thought: hands, voice, and silence in the tourist guide’s speech
    Alessandra Chiera, Alessandro Ansani, Isora Sessa, Violetta Cataldo, Loredana Schettino, Isabella Poggi · 2022 · Cognitive Processing
  5. Introduction to the 2nd Edition of “Semantic, Artificial and Computational Interaction Studies”
    Cornelia Ebert, Andy Lücking, Alexander Mehler · 2022 · Lecture notes in computer science
  6. Dynamic neural stages of proportional gesture-speech integration characterized by cross-modal fragment priming
    Wanying Zhao, Jieyi Liu, Xintong Jiang, Xiaoqian Zhou, Yi Du · 2023 · Research Square
  7. Emotion dysregulation and social communication problems may predict severity of obsessive compulsive disorder symptoms among Turkish adolescents: A single-center, case-control study
    Yusuf Öztürk, Gonca Özyurt, Serkan Turan, Ali Evren Tufan, Aynur Pekcanlar Akay · 2023 · Research Square
  8. Gesture Analysis in Second Language Acquisition
    Marianne Gullberg · 2023 · The Encyclopedia of Applied Linguistics
  9. Un protocolo para el análisis de los problemas de lenguaje en las enfermedades raras
    Antonio Benítez‐Burraco, Ma Salud Jiménez-Romero, Maite Fernández-Urquiza · 2023
  10. beszélőváltások jellemzői a társalgási struktúrában: univerzális vonások és dinamikus változások
    Valéria Krepsz, Anna Huszár, Viktória Horváth, Dorottya Gyarmathy, Ágnes Hámori · 2023 · Magyar Nyelv
  11. Spontaneous gestures encoded by hand positions improve language models: An Information-Theoretic motivated study
    Xu Yang, Cheng Hong Yang · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  12. Virtual Reality: A tool to study language evolution
    Jonas Nölle, David Peeters · 2023
  13. Does Listener Gaze in Face-to-Face Interaction Follow the Entropy Rate Constancy Principle: An Empirical Study
    Yu Wang, Hendrik Buschmeier · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  14. Irony in Expressive, Nonlinguistic Media
    Raymond W. Gibbs, Jr, Herbert L. Colston · 2023 · Cambridge University Press eBooks
  15. Beat gestures and prosodic stress interactively influence language comprehension
    Ambra Ferrari, Peter Hagoort A · 2024
  16. Co-speech Gesture Production in Spoken Discourse Among Speakers with Acquired Language Disorders
    Isobel Chick, Peter Garrard, Laurel J. Buxbaum, Gabriella Vigliocco · 2023 · Springer eBooks
  17. La voz cantada como performance expresiva
    Daniel Ricardo Machuca Téllez · 2023
  18. Gesturing for the Addressee
    Janet Beavin Bavelas · 2024 · Cambridge University Press eBooks
  19. AME: The Autonomous Multimodal Experiment System
    Jiahao Yang, Sotaro Kita · 2024
  20. WITHDRAWN: Progressive neural engagement within the IFG-pMTG circuit as gesture and speech entropy and MI advances
    Wanying Zhao, Zhuoyi Li, Xiang Li, Yi Du · 2024 · bioRxiv (Cold Spring Harbor Laboratory)
  21. Multimodality in Distance Education during Covid-19: Teachers’ Perspectives and Practices
    Halil İbrahim Şahin, Mehmet Altay · 2024 · Journal of Learning and Teaching in Digital Age
  22. Multimodal Communication in Nonhuman Primates
    Marlen Fröhlich · 2024 · Elsevier eBooks
  23. 7 • Conclusión: el para qué de estudiar la causalidad
    Andrea Ariño Bizarro · 2024
  24. Function index
    2020 · John Benjamins Publishing Company eBooks
  25. Location plots
    2020 · John Benjamins Publishing Company eBooks
  26. Data management in R
    2020 · John Benjamins Publishing Company eBooks
  27. Association plots and mosaic plots
    2020 · John Benjamins Publishing Company eBooks
  28. Table of contents
    2020 · John Benjamins Publishing Company eBooks
  29. Scatter plots
    2020 · John Benjamins Publishing Company eBooks
  30. Strip charts and violin plots
    2020 · John Benjamins Publishing Company eBooks
  31. Dotcharts
    2020 · John Benjamins Publishing Company eBooks
  32. Prelim pages
    2020 · John Benjamins Publishing Company eBooks
  33. Box plots
    2020 · John Benjamins Publishing Company eBooks
  34. Heatmaps and dendrograms
    2020 · John Benjamins Publishing Company eBooks
  35. References
    2020 · John Benjamins Publishing Company eBooks
  36. Introduction
    2020 · John Benjamins Publishing Company eBooks
  37. Conceptual index
    2020 · John Benjamins Publishing Company eBooks
  38. Concluding remarks
    2020 · John Benjamins Publishing Company eBooks
  39. Graphical parameters
    2020 · John Benjamins Publishing Company eBooks
  40. Barplots
    2020 · John Benjamins Publishing Company eBooks
  41. Acknowledgements
    2020 · John Benjamins Publishing Company eBooks
  42. Progressive neural engagement within the IFG-pMTG circuit as gesture and speech entropy and MI advances
    Wanying Zhao, Zhuoyi Li, Xiang Li, Yi Du · 2024 · eLife
  43. Progressive neural engagement within the IFG-pMTG circuit as gesture and speech entropy and MI advances
    Wanying Zhao, Zhuoyi Li, Xiang Li, Yi Du · 2024 · eLife
  44. A percepção de fonoaudiólogos sobre a compreensão oral e o papel da expressividade
    Daniel De Martino Ucedo, Karoline Pimentel dos Santos, Ana Carolina de Assis Moura Ghirardi, Ana Paula Santana · 2024 · Audiology - Communication Research
  45. The perception of speech therapists regarding listening comprehension and the role of expressiveness
    Daniel De Martino Ucedo, Karoline Pimentel dos Santos, Ana Carolina de Assis Moura Ghirardi, Ana Paula Santana · 2024 · Audiology - Communication Research
  46. Artificial intelligence in precision space health
    Erik Antonsen, Barbara K. Burian, Sylvain V. Costes, Robert J. Reynolds, Lauren Sanders, Aenor Sawyer, Lauren A. Schrader, Ryan T. Scott, Michael P. Snyder, Corey A. Theriot · 2025 · Elsevier eBooks
  47. Multimodal human–computer interaction: A panoptic view
    B. Thushara, V. Adithya, N. S. Sreekanth · 2026 · Engineering Applications of Artificial Intelligence
  48. Does early gesture usage contribute alongside oral language to later theory of mind performance and metaphor comprehension? Indications from a longitudinal study with children aged 1–9 years
    Camilla E. Crawshaw, Carina Lüke, Ute Ritterfeld · 2025 · Language Acquisition
  49. Discourse Context and Co-Speech Gestures Jointly Shape Hierarchical Prediction During the Processing of a Multimodal Narrative
    James P. Trujillo, Benjamin Straube, Yifei He · 2026 · Neurobiology of Language
  50. Artificial Intelligence and Writing: Trends and Future Directions in the Social Sciences
    Verenice Sánchez Castillo, Rolando Eslava Zapata, Alfredo Javier Pérez Gamboa · 2025 · Lecture notes in networks and systems
  51. Dissecting the Hierarchy of Gesture Comprehension: Evidence from a Multilevel Priming Paradigm and Drift-Diffusion Model
    Junqing Huang, Benjamin Straube, Yifei He · 2025
  52. Function index
    2020 · John Benjamins Publishing Company eBooks
  53. Emotional Mediation in the Construction of Political Personae: Between Political Branding and Semiotic Construct
    Nicolae-Sorin Drăgan · 2025 · Theory and history in the human and social sciences
  54. Prediction efficiency and incremental processing strategy during spoken language comprehension in autistic children: an eye-tracking study
    Zihui Hua, Tianbi Li, Ruoxi Shi, Ran Wei, Li Yi · 2025 · Molecular Autism
  55. The Relationship between Self-Reported Gesture Use and Neuropsychological Functioning in a Transdiagnostic Sample of Patients with Mental Disorders
    Katrin Leinweber, Yifei He, Kati Büchsenschütz, Stefan G. Hofmann, Tilo T. J. Kircher, Benjamín Straube · 2025 · SSRN Electronic Journal
  56. The Shared Book Reading Corpus: An audiovisual collection of 44 multimodal caregiver-infant interactions
    Teruni Malaika Ahamat, Jiahao Yang, Sotaro Kita, Suzanne Aussems · 2025 · Scientific Data
  57. Multimodal Dynamic Cost Matrix Adaptation under data imbalance for multimodal sentiment analysis
    Weiyang Wang, Haoyue Liu, Juan Huang, Bin Xu · 2025 · Pattern Recognition Letters
  58. Filling a gap in constructing common ground through the rhythmical repetition of gestures
    Hiroki Hanamoto · 2025 · SSRN Electronic Journal
  59. Phonemic composition influences words’ aesthetic appeal and memorability
    Theresa Matzinger, David Košić · 2025 · PLoS ONE
  60. Language prediction in multimodal contexts: The contribution of iconic gestures to anticipatory sentence comprehension
    Florian Hintz, Alexandra K. Emmendorfer, Antje Strauß, Yung Han Khoe, Lydia Moonen, Judith Holler · 2026 · Cortex
  61. Do frequency and frequency-related measures signal turn completion? An exploratory corpus study
    Christoph Rühlemann · 2025 · Frontiers in Psychology
  62. Act-it-Out Method for Developing Robot Arm Actions and Semantic Commands
    Luke Sanchez, Chirag Jain, Shrirang Patil, Bessie He, Heather Knight · 2025 · Lecture notes in computer science
  63. Multimodal imitation reveals differences in typically developing children and children with neurodevelopmental disorders
    Júlia Florit‐Pons, Mariia Pronina, Sara Coego, Pilar Prieto · 2025 · Cognitive Development
  64. Analysis on Social Media Communication and Interaction of Chinese Excellent Traditional Cultural Symbols—Taking the Platform of Xiaohongshu as an Example
    晓璐 秦 · 2025 · Journalism and Communications
  65. The 'Co-learning' Atmosphere: How Multi-Layered Social Interactions and Meme Culture Shape Value Endorsement in Online Knowledge Learning
    Jinyan Duan, Siyu Qi, Chong Wu · 2026 · SSRN Electronic Journal
  66. Data in the Context of Misinformation: A Scoping Review
    Julia Sophie Blaß · 2026 · Journalism & Mass Communication Quarterly
  67. Chronic acoustic degradation via cochlear implants alters predictive processing of audiovisual speech
    Simone Gastaldon, Flavia Gheller, Noemi Bonfiglio, Davide Brotto, Davide Bottari, Patrizia Trevisi, Alessandro Martini, Francesco Vespignani, Francesca Peressotti · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
  68. Instantaneous emotion sharing: Early brain signatures of understanding expressive communicative actions
    Isabella Paola Boux, Milena R. Osterloh, Rosario Tomasello, Luigi Grisoni, Friedemann Pulvermüller A · 2026 · Neuropsychologia
  69. Watching Yourself Talk: Motor Experience Sharpens Sensitivity to Gesture-Speech Asynchrony
    Tiziana Vercillo, Judith Holler, Uta Noppeney · 2026 · bioRxiv (Cold Spring Harbor Laboratory)
  70. Adults mark the communicative relevance of their gestures more for children than for other adults
    Anita Slonimska, Aslı Özyürek, Emanuela Campisi · 2026 · Discourse Processes
  71. Oral Poetics and Multimodal Language Models
    Cristóbal Pagán Cánovas · 2025 · De Gruyter eBooks
  72. Embodied and situated language processing: Learning
    Claudia Repetto, Elisa Scerrati · 2026 · The Psychology of learning and motivation/The psychology of learning and motivation
  73. Characteristics of Nonverbal Behavior
    Stefan Lazarov, Igor Tchappi, Angela Grimminger · 2026 · Springer eBooks
  74. Theoretical Aspects of Multimodal Processing
    Angela Grimminger, Hendrik Buschmeier · 2026 · Springer eBooks
  75. Multi-interaction: a new open-access approach for studying multimodal communication and interactions across species
    Lise Habib-Dassetto, Paul Best, Jules Cauzinille, A. Marques, Mathilde Adet, Cristel Portès, Alban Lemasson, Marie Montant · 2026 · Animal Behaviour
  76. Incremental Communication
    Britta Wrede, Hendrik Buschmeier, Katharina J. Rohlfing, Meisam Booshehri, Angela Grimminger · 2026 · Springer eBooks
  77. Multimodality in Explanatory Interactions
    Friederike Kern · 2026 · Springer eBooks
  78. Multimodal Lexical Item
    Po-Ya Angela Wang, Shu‐Kai Hsieh · 2026 · Elsevier eBooks
  79. The Effect of Text-Emoji Valence Congruency on Cognitive Processing and Emotional Perception Across Ages
    Wanyue Geng, Shufei Yin, Wanyu Song, Yuhao LIU, Xiaoyang Jiang, Xianmin Gong · 2026 · SSRN Electronic Journal
  80. Wearable sound : integrative design for hearing and feeling vibrations
    Claire Richards · 2023
  81. Neural Conversion of Social Attitudes in Speech Signals
    Clément Le Moine Veillon · 2023
  82. Aux prémices de nos conversations : une étude comparative chez les nourrissons humains et les primates non-humains
    Bastien Meunier · 2023
  83. Modelling interruptions in human-agent interaction
    Liu Yang · 2023
  84. Illocutionary Complexity: An Approach to the Nature and Origins of Dependent Illocutionary Acts
    Jorge Bonet Gómez · 2026 · SSRN Electronic Journal
  85. A multimodal perspective on adaptive communication: Extending the hyper- and hypo-articulation theory
    Delphine Charuau, Naomi Harte · 2026 · Computer Speech & Language
  86. The Physiology of Rhythm
    Lars Meyer, Lars Meyer, Lars Meyer · 2026 · Cambridge University Press eBooks
  87. Where do we predict communicative function? New arguments for the relevance of sensorimotor brain areas in language understanding
    Salomé Antoine, Friedemann Pulvermüller A, Luigi Grisoni · 2026 · Neuropsychologia
  88. Contextual Semantic Relevance Predicting Human Visual Attention
    Kun Sun, Rong Wang · 2026 · IEEE Transactions on Cognitive and Developmental Systems
  89. The multimodal turn in corpus building
    Anastasia Bauer, Sonja Gipper, Tobias-Alexander Herrmann, Jana Hosemann, Simona Sbranna · 2026 · Studies in language companion series
  90. Can gesture help? Investigating the potential for transfer in the L2M2 acquisition of a sign language
    Door Spruijt, Petra B. Schumacher, Pamela Perniss · 2026 · Open Linguistics
  91. Mobile eye tracking: new avenues for the study of gaze in social interaction
    Ying Liu, Zi Yang · 2026 · Social Semiotics
  92. A Bridge from Biomedical Engineering to Education: An Event-Related Potential Study Based on Speech Attention in Autism
    Oana Geman, Sara Sharghilavan, Matti Karppa, Hadi Abbasi, Diana Sînziana Duca, Lucia Moroșan-Dănilă, Cristina Lemni, Tiberiu Ciortan · 2026 · World Congress on Medical Physics and Biomedical Engineering, September 7 - 12, 2009, Munich, Germany
  93. Gesture Use Across Different Concepts: Focusing on Cross‐Linguistic Diversity
    Tilbe Göksun, Demet Özer, Burcu Arslan, Gyulten Hyusein, Emir Akbuğa · 2026 · Topics in Cognitive Science
  94. Beyond static scoring: an interactional case study on the assessment of social-pragmatic inferencing skills of an autistic girl
    Katja Dindar, Leena Mäkinen, Ilaria Gabbatore, Aija Kotila, Eeva Leinonen, Soile Loukusa · 2026 · Disability and Rehabilitation
  95. The interplay between gestures and analytical questioning in mathematics group discussion: a case study of a blended learning context
    Agung Putra Wijaya, M. Iqbal Parabi, Muhammad Noor Kholid · 2026 · Cogent Education
  96. Parental speech and gesture scaffolding moderate the neural dynamics of parent-child synchrony
    Ying Li, Ö. Ece Demir‐Lira · 2026 · Developmental Cognitive Neuroscience
  97. Human Multimodal Communication
    Keiko Tsuchiya · 2026 · Springer eBooks
  98. Language and Multimodality in Social Interaction
    Keiko Tsuchiya · 2026 · Springer eBooks
  99. Multimodal Interaction Research: Quo Vadis?
    Keiko Tsuchiya · 2026 · Springer eBooks
  100. Sound iconicity in the transition from protosign to protospeech
    Peter Gärdenfors, Axel G. Ekström · 2026 · Frontiers in Language Sciences