Multimodal Language Processing in Human Communication
Open accessAbstract
The natural ecology of human language is face-to-face interaction comprising the exchange of a plethora of multimodal signals. Trying to understand the psycholinguistic processing of language in its natural niche raises new issues, first and foremost the binding of multiple, temporally offset signals under tight time constraints posed by a turn-taking system. This might be expected to overload and slow our cognitive system, but the reverse is in fact the case. We propose cognitive mechanisms that may explain this phenomenon and call for a multimodal, situated psycholinguistic framework to unravel the full complexities of human language processing.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent evidence has highlighted the importance of visual information for turn-taking.
“However, recent evidence has highlighted the importance of visual information for turn-taking (e.g., Holler & Levinson 2019; Holler, Kendrick & Levinson, 2018).”
From Timing in Conversation (2023) · cites this paper as Holler & Levinson, 2019
Cites
A simplest systematics for the organization of turn-taking for conversation
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350 · see citing works
The free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · see citing works
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183 · see citing works
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,090 · see citing works
Principles Of Gestalt Psychology
Koffka, K. (2013) · Routledge eBooks · doi:10.4324/9781315009292 · Cited by 4,281 · see citing works
Gesture Visible Action as Utterance
Kendon, A. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807572 · Cited by 3,987 · see citing works
The problem of serial order in behavior
Lashley, K. S. (1951) · MPG.PuRe (Max Planck Society) · Cited by 2,734 · see citing works
Toward a mechanistic psychology of dialogue.
Pickering, M. J., & Garrod, S. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000056 · Cited by 2,678 · see citing works
Conversational Organization: Interaction Between Speakers and Hearers
Goodwin, C. (1981) · Cited by 2,333 · see citing works
The lexical nature of syntactic ambiguity resolution
MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.676 · Cited by 2,259 · see citing works
Untersuchungen zur Lehre von der Gestalt. II
Wertheimer, M. (1923) · Psychological Research · doi:10.1007/bf00410640 · Cited by 2,190 · see citing works
Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage
Ekman, P. (1985) · Cited by 1,736 · see citing works
The Handbook of Conversation Analysis
Buchholz, M. B. (2013) · Language and Psychoanalysis · doi:10.7565/landp.2013.003 · Cited by 1,614 · see citing works
Bar, M. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1476 · Cited by 1,613 · see citing works
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569 · see citing works
Universals and cultural variation in turn-taking in conversation
Stivers, T., Enfield, N. J., Brown, P., Englert, C., Hayashi, M., Heinemann, T., Hoymann, G., Rossano, F., de Ruiter, J. P., Yoon, K.-E., et al. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0903616106 · Cited by 1,533 · see citing works
Self-citationThe Emergence of Symbols: Cognition and Communication in Infancy
Bates, E. A., & Benigni, L. (2015) · Cited by 1,472 · see citing works
The emergence of symbols: cognition and communication in infancy
Gillis, S. A. (1983) · Journal of Pragmatics · doi:10.1016/0378-2166(83)90154-6 · Cited by 1,445 · see citing works
Eye contact detection in humans from birth
Farroni, T., Csibra, G., Simion, F., & Johnson, M. H. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.152159999 · Cited by 1,442 · see citing works
DeLong, K. A., Urbach, T. P., & Marta Kutas, A. (2005) · Nature Neuroscience · doi:10.1038/nn1504 · Cited by 1,236 · see citing works
Predictive coding: an account of the mirror neuron system
Kilner, J. M., Friston, K. J., & Frith, C. D. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0170-2 · Cited by 1,134 · see citing works
Mondada, L. (2018) · Research on Language and Social Interaction · doi:10.1080/08351813.2018.1413878 · Cited by 1,098 · see citing works
What do we mean by prediction in language comprehension?
Kuperberg, G. R., & Jaeger, T. F. (2016) · Language, Cognition and Neuroscience · doi:10.1080/23273798.2015.1102299 · Cited by 1,087 · see citing works
Molholm, S., Ritter, W., Murray, M. M., Javitt, D., Schroeder, C., & Foxe, J. J. (2002) · Brain research. Cognitive brain research · doi:10.1016/s0926-6410(02)00066-6 · Cited by 980 · see citing works
How Do Expectations Shape Perception?
de Lange, F. P., Heilbron, M., & Kok, P. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.06.002 · Cited by 975 · see citing works
Kita, S., & Özyürek, A. (2003) · Journal of Memory and Language · doi:10.1016/s0749-596x(02)00505-3 · Cited by 959 · see citing works
Anticipating Upcoming Words in Discourse: Evidence From ERPs and Reading Times.
Berkum, J. J. A. V., Brown, C. M., Zwitserlood, P., Kooijman, V., & Peter Hagoort, A. (2005) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.31.3.443 · Cited by 932 · see citing works
A Rose by Any Other Name: Long-Term Memory Structure and Sentence Processing
Federmeier, K. D., & Marta Kutas, A. (1999) · Journal of Memory and Language · doi:10.1006/jmla.1999.2660 · Cited by 910 · see citing works
Visible embodiment: Gestures as simulated action
Hostetter, A. B., & Alibali, M. W. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.3.495 · Cited by 875 · see citing works
Gesture and coparticipation in the activity of searching for a word
Goodwin, M. H., & Goodwin, C. (1986) · Semiotica · doi:10.1515/semi.1986.62.1-2.51 · Cited by 796 · see citing works
Gesture: visible action as utterance
(2005) · Choice Reviews Online · doi:10.5860/choice.42-5687 · Cited by 791 · see citing works
Turn-taking in Human Communication – Origins and Implications for Language Processing
Levinson, S. C. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.10.010 · Cited by 760 · see citing works
Self-citationThe Now-or-Never bottleneck: A fundamental constraint on language
Christiansen, M. H., & Nick Chater, A. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1500031x · Cited by 750 · see citing works
Timing in turn-taking and its implications for processing models of language
Levinson, S. C., & Torreira, F. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00731 · Cited by 686 · see citing works
Self-citationKelly, S. D., Özyürek, A., & Maris, E. (2009) · Psychological Science · doi:10.1177/0956797609357327 · Cited by 674 · see citing works
Cerebral Mechanisms in Behavior: The Hixon Symposium
(1952) · JAMA · doi:10.1001/jama.1952.02930120090037 · Cited by 652 · see citing works
Temporal window of integration in auditory-visual speech perception
van Wassenhove, V., Grant, K. W., & Poeppel, D. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.01.001 · Cited by 622 · see citing works
The Natural Statistics of Audiovisual Speech
Chandrasekaran, C., Wieckowski, A. T., Stillittano, S., Caplier, A., & Ghazanfar, A. A. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000436 · Cited by 614 · see citing works
Modeling the auditory scene: predictive regularity representations and perceptual objects
Winkler, I., Denham, S. L., & Nelken, I. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.09.003 · Cited by 562 · see citing works
Unique morphology of the human eye
Kobayashi, H., & Kohshima, S. (1997) · Nature · doi:10.1038/42842 · Cited by 534 · see citing works
Action Formation and Ascription
Levinson, S. C. (2012) · doi:10.1002/9781118325001.ch6 · Cited by 508 · see citing works
Self-citationMultisensory contributions to low-level, ‘unisensory’ processing
Schroeder, C. E., & Foxe, J. J. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.06.008 · Cited by 506 · see citing works
Principles of Gestalt Psychology.
Reiser, O. L., & Koffka, K. (1936) · The Philosophical Review · doi:10.2307/2180493 · Cited by 497 · see citing works
On some gestures' relation to talk
Schegloff, E. A. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511665868.018 · Cited by 495 · see citing works
The production of gesture and speech
de Ruiter, J. P. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620850.018 · Cited by 489 · see citing works
Neuronal oscillations and visual amplification of speech
Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S. R., & Puce, A. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.002 · Cited by 487 · see citing works
Gesture and speech in interaction: An overview
Wagner, P., Malisz, Z., & Kopp, S. (2013) · Speech Communication · doi:10.1016/j.specom.2013.09.008 · Cited by 459 · see citing works
Ape gestures and language evolution
Pollick, A. S., & de Waal, F. Β. Μ. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0702624104 · Cited by 458 · see citing works
The Human Fetus Preferentially Engages with Face-like Visual Stimuli
Reid, V. M., Dunn, K., Young, R. J., Amu, J., Donovan, T., & Reissland, N. (2017) · Current Biology · doi:10.1016/j.cub.2017.05.044 · Cited by 421 · see citing works
Talsma, D., & Woldorff, M. G. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929054475172 · Cited by 417 · see citing works
Body – Language – Communication: An International Handbook on Multimodality in Human Interaction
Müller, C., Cienki, A. J., Fricke, E., Ladewig, S. H., McNeill, D., & Teßendorf, S. (2013) · Cited by 398 · see citing works
The origin of human multi-modal communication
Levinson, S. C., & Holler, J. (2014) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2013.0302 · Cited by 391 · see citing works
Self-citationNonmanuals: their grammatical and prosodic roles
Pfau, R., & Quer, J. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511712203.018 · Cited by 382 · see citing works
Multisensory Visual-Auditory Object Recognition in Humans: a High-density Electrical Mapping Study
Molholm, S. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh007 · Cited by 374 · see citing works
Depicting as a method of communication.
Clark, H. H. (2016) · Psychological Review · doi:10.1037/rev0000026 · Cited by 367 · see citing works
The capacity for music: What is it, and what’s special about it?
Jackendoff, R. S., & Lerdahl, F. (2005) · Cognition · doi:10.1016/j.cognition.2005.11.005 · Cited by 361 · see citing works
Coupled neural systems underlie the production and comprehension of naturalistic narrative speech
Silbert, L. J., Honey, C. J., Simony, E., Poeppel, D., & Hasson, U. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1323812111 · Cited by 352 · see citing works
Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992) · Discourse Processes · doi:10.1080/01638539209544823 · Cited by 349 · see citing works
Peter Hagoort, A., & Berkum, J. J. A. V. (2007) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2007.2089 · Cited by 342 · see citing works
How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis.
Kita, S., Alibali, M. W., & Chu, M. (2017) · Psychological Review · doi:10.1037/rev0000059 · Cited by 342 · see citing works
Leader emergence through interpersonal neural synchronization.
Jiang, J., Chen, C., Dai, B., Shi, G., Ding, G., Liu, L., & Lu, C. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1422930112 · Cited by 341 · see citing works
Tanenhaus, M. K., & Trueswell, J. C. (1995) · Elsevier eBooks · doi:10.1016/b978-012497770-9.50009-1 · Cited by 336 · see citing works
Teder-Sälejärvi, W. A., McDonald, J. J., Russo, F. D., & Hillyard, S. A. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00065-4 · Cited by 328 · see citing works
Interrogative Constructions in Signed Languages: Crosslinguistic Perspectives
Zeshan, U. (2004) · Language · doi:10.1353/lan.2004.0050 · Cited by 307 · see citing works
Wired to Be Social: The Ontogeny of Human Interaction
Castiello, U., Becchio, C., Zoia, S., Nelini, C., Sartori, L., Blason, L., D’Ottavio, G., Bulgheroni, M., & D, V. G. M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013199 · Cited by 296 · see citing works
Modelling the N400 brain potential as change in a probabilistic representation of meaning
Rabovsky, M., Hansen, S. S., & McClelland, J. L. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0406-4 · Cited by 290 · see citing works
Gestures specialized for dialogue
Bavelas, J. B., Chovil, N., Coates, L., & Roe, L. (1995) · Personality and Social Psychology Bulletin · doi:10.1177/0146167295214010 · Cited by 272 · see citing works
Conversational Repair and Human Understanding
(2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511757464 · Cited by 259 · see citing works
Discourse‐oriented facial displays in conversation
Chovil, N. (1991) · Research on Language and Social Interaction · doi:10.1080/08351819109389361 · Cited by 255 · see citing works
Early Anticipation Lies behind the Speed of Response in Conversation
Magyari, L., Bastiaansen, M. C. M., de Ruiter, J. P., & Levinson, S. C. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00673 · Cited by 247 · see citing works
Self-citationWord familiarity predicts temporal asynchrony of hand gestures and speech.
Morrel‐Samuels, P., & Krauss, R. M. (1992) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.18.3.615 · Cited by 245 · see citing works
Menenti (2011) · doi:10.1177/0956797611418347 · Cited by 238 · see citing works
Neural correlates of bimodal speech and gesture comprehension
Kelly, S. D., Kravitz, C., & Hopkins, M. (2003) · Brain and Language · doi:10.1016/s0093-934x(03)00335-3 · Cited by 237 · see citing works
Neural correlates of the processing of co-speech gestures
Holle, H., Gunter, T. C., Rüschemeyer, S., Hennenlotter, A., & Iacoboni, M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.055 · Cited by 205 · see citing works
Neural signatures of response planning occur midway through an incoming question in conversation
Bögels, S., Magyari, L., & Levinson, S. C. (2015) · Scientific Reports · doi:10.1038/srep12881 · Cited by 193 · see citing works
Self-citationMeaningful gestures: Electrophysiological indices of iconic gesture comprehension
Wu, Y. C., & Coulson, S. (2005) · Psychophysiology · doi:10.1111/j.1469-8986.2005.00356.x · Cited by 187 · see citing works
Interactions of auditory and visual stimuli in space and time
Recanzone, G. H. (2009) · Hearing Research · doi:10.1016/j.heares.2009.04.009 · Cited by 182 · see citing works
The Effect of Prior Visual Information on Recognition of Speech and Sounds
Noppeney, U., Josephs, O., Hocking, J., Price, C. J., & Friston, K. J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm091 · Cited by 170 · see citing works
Social and paralinguistic cues to sarcasm
Caucci, G. M., & Kreuz, R. J. (2012) · Humor - International Journal of Humor Research · doi:10.1515/humor-2012-0001 · Cited by 169 · see citing works
Processing language in face-to-face conversation: Questions with gestures get faster responses
Holler, J., Kendrick, K. H., & Levinson, S. C. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-017-1363-z · Cited by 167 · see citing works
Self-citationRomei, V., Murray, M. M., Merabet, L. B., & Thut, G. (2007) · Journal of Neuroscience · doi:10.1523/jneurosci.2827-07.2007 · Cited by 166 · see citing works
Pointing and voicing in deictic expressions
Levelt, W. J. M., Richardson, G., & Heij, W. L. (1985) · Journal of Memory and Language · doi:10.1016/0749-596x(85)90021-x · Cited by 166 · see citing works
Murray, M. M., Foxe, J. J., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2001) · Neuropsychologia · doi:10.1016/s0028-3932(01)00004-5 · Cited by 158 · see citing works
Hasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157 · see citing works
The Role of Synchrony and Ambiguity in Speech–Gesture Integration during Comprehension
Habets, B., Kita, S., Shao, Z., Özyürek, A., & Peter Hagoort, A. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21462 · Cited by 155 · see citing works
Chu, M., Meyer, A. S., Foulkes, L., & Kita, S. (2013) · Journal of Experimental Psychology General · doi:10.1037/a0033861 · Cited by 155 · see citing works
Consequences of complex signaling: predator detection of multimodal cues
Roberts, J. A., Taylor, P. W., & Uetz, G. W. (2006) · Behavioral Ecology · doi:10.1093/beheco/arl079 · Cited by 153 · see citing works
Uetz, G. W., Roberts, J. A., & Taylor, P. W. (2009) · Animal Behaviour · doi:10.1016/j.anbehav.2009.04.023 · Cited by 143 · see citing works
119. A repertoire of German recurrent gestures with pragmatic functions
Bressem, J., & Müller, F. M. (2014) · De Gruyter eBooks · doi:10.1515/9783110302028.1575 · Cited by 143 · see citing works
The Relationship Between Infant Holdout and Gives, and Pointing
Cameron‐Faulkner, T., Theakston, A., Lieven, E., & Tomasello, M. (2015) · Infancy · doi:10.1111/infa.12085 · Cited by 142 · see citing works
Cognitive Neuroscience of Natural Language Use
Kristensen, L. B., & Wallentin, M. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107323667 · Cited by 142 · see citing works
Senkowski, D. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj091 · Cited by 131 · see citing works
The Development of Cortical Multisensory Integration
Wallace, M. T., Carriere, B. N., Perrault, T. J., Vaughan, J. W., & Stein, B. E. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.3295-06.2006 · Cited by 130 · see citing works
The effects of processing and sequence organization on the timing of turn taking: a corpus study
Roberts, S. G., Torreira, F., & Levinson, S. C. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00509 · Cited by 128 · see citing works
Self-citationMetacognition in Multisensory Perception
Deroy, O. D., Spence, C. J., & Noppeney, U. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.08.006 · Cited by 127 · see citing works
The Palm-Up Puzzle: Meanings and Origins of a Widespread Form in Gesture and Sign
Cooperrider, K., Abner, N., & Susan Goldin-meadow, A. (2018) · Frontiers in Communication · doi:10.3389/fcomm.2018.00023 · Cited by 123 · see citing works
The not face: A grammaticalization of facial expressions of emotion
Benitez-Quiroz, C. F., Wilbur, R. Β., & Martı́nez, A. M. (2016) · Cognition · doi:10.1016/j.cognition.2016.02.004 · Cited by 119 · see citing works
Perceiving incredulity: The role of intonation and facial gestures
Sendra, V. C., Kaland, C., Swerts, M. G. J., & Prieto, P. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2012.08.008 · Cited by 114 · see citing works
Some pragmatic functions of conversational facial gestures1
Bavelas, J. B., & Chovil, N. (2018) · Gesture · doi:10.1075/gest.00012.bav · Cited by 111 · see citing works
The use of content and timing to predict turn transitions
Garrod, S., & Pickering, M. J. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00751 · Cited by 108 · see citing works
Conversation Electrified: ERP Correlates of Speech Act Recognition in Underspecified Utterances
Gisladottir, R. S., Chwilla, D. J., & Levinson, S. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0120068 · Cited by 108 · see citing works
Self-citationMultistability in auditory stream segregation: a predictive coding view
Winkler, I., Denham, S. L., Mill, R. W., Bõhm, T. M., & Bendixen, A. (2012) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2011.0359 · Cited by 107 · see citing works
Müller, F. M. (2017) · Gesture · doi:10.1075/gest.16.2.05mul · Cited by 107 · see citing works
The Differing Impact of Multisensory and Unisensory Integration on Behavior
Gingras, G., Rowland, B. A., & Stein, B. E. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4120-08.2009 · Cited by 103 · see citing works
Speech, language, and communication
(1996) · Choice Reviews Online · doi:10.5860/choice.33-3606 · Cited by 101 · see citing works
Eye blinks are perceived as communicative signals in human face-to-face interaction
Hömke, P., Holler, J., & Levinson, S. C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0208030 · Cited by 97 · see citing works
Self-citationDetection thresholds for gaps, overlaps, and no-gap-no-overlaps
Heldner, M. (2011) · The Journal of the Acoustical Society of America · doi:10.1121/1.3598457 · Cited by 91 · see citing works
Variation in dual-task performance reveals late initiation of speech planning in turn-taking
Sjerps, M. J., & Meyer, A. S. (2015) · Cognition · doi:10.1016/j.cognition.2014.10.008 · Cited by 85 · cited 1× · see citing works
“In a turntaking context, there comes a point when the comprehender must commit to one of those activations to begin planning a matching response that can be issued on time, and this point appears to occur surprisingly early in the incoming turn [22,90] (but see [23]).”
BackgroundLanguage as skill: Intertwining comprehension and production
Nick Chater, A., McCauley, S. M., & Christiansen, M. H. (2015) · Journal of Memory and Language · doi:10.1016/j.jml.2015.11.004 · Cited by 80 · see citing works
Leaning and recipient intervening questions in Mandarin conversation
Li, X. (2014) · Journal of Pragmatics · doi:10.1016/j.pragma.2014.03.011 · Cited by 71 · see citing works
Iconic gestures prime related concepts: An ERP study
Wu, Y. C., & Coulson, S. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194028 · Cited by 69 · see citing works
The NOLB model: a model of the natural organization of language and the brain
Skipper, J. I. (2015) · Cambridge University Press eBooks · doi:10.1017/cbo9781107323667.006 · Cited by 69 · see citing works
Interference between conversation and a concurrent visuomotor task.
Boiteau, T. W., Malone, P. S., Peters, S. A., & Almor, A. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0031858 · Cited by 69 · see citing works
Gestural codas pave the way to the understanding of verbal irony
González, S., Escandell‐Vidal, V., & Prieto, P. (2015) · Journal of Pragmatics · doi:10.1016/j.pragma.2015.10.002 · Cited by 68 · see citing works
Exploring early communicative behaviours: A fine-grained analysis of infant shows and gives
Boundy, L., Cameron‐Faulkner, T., & Theakston, A. (2016) · Infant Behavior and Development · doi:10.1016/j.infbeh.2016.06.005 · Cited by 66 · see citing works
Staudte, M., Crocker, M. W., Héloir, A., & Kipp, M. (2014) · Cognition · doi:10.1016/j.cognition.2014.06.003 · Cited by 64 · see citing works
Never Say No … How the Brain Interprets the Pregnant Pause in Conversation
Bögels, S., Kendrick, K. H., & Levinson, S. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0145474 · Cited by 62 · see citing works
Self-citationSynchronization of speech and gesture: Evidence for interaction in action.
Chu, M., & Peter Hagoort, A. (2014) · Journal of Experimental Psychology General · doi:10.1037/a0036281 · Cited by 61 · see citing works
Temporal Preparation for Speaking in Question-Answer Sequences
Magyari, L., De Ruiter, J. P., & Levinson, S. C. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00211 · Cited by 61 · see citing works
Self-citationHuh? What? – a first survey in twenty-one languages
Enfield, N. J., Dingemanse, M., Baranova, J., Blythe, J., Brown, P., Dirksmeyer, T., Drew, P., Floyd, S., Gipper, S., Gísladóttir, R. S., et al. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511757464.012 · Cited by 60 · see citing works
Self-citationBernardis, P., Salillas, E., & Caramelli, N. (2008) · Cognitive Neuropsychology · doi:10.1080/02643290801921707 · Cited by 58 · see citing works
The “Negative-Assessment-Construction” – A multimodal pattern based on a recurrent gesture?
Bressem, J., & Müller, F. M. (2017) · Linguistics Vanguard · doi:10.1515/lingvan-2016-0053 · Cited by 58 · see citing works
Feeling addressed! The role of body orientation and co‐speech gesture in social communication
Nagels, A., Kircher, T. T. J., Steines, M., & Straube, B. (2015) · Human Brain Mapping · doi:10.1002/hbm.22746 · Cited by 56 · see citing works
Bögels, S., Casillas, M., & Levinson, S. C. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.12.028 · Cited by 55 · see citing works
Self-citationYap, D., So, W., Yap, M. J.-M., Tan, Y., & Teoh, R. S. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01141.x · Cited by 55 · see citing works
“Requests” and “offers” in orangutans and human infants
Rossano, F., & Liebal, K. (2014) · Studies in language and social interaction · doi:10.1075/slsi.26.13ros · Cited by 54 · see citing works
Bavelas, J. B., Gerwing, J., & Healing, S. (2014) · Discourse Processes · doi:10.1080/0163853x.2014.883730 · Cited by 53 · see citing works
Obermeier, C., Holle, H., & Gunter, T. C. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21498 · Cited by 50 · see citing works
The Relation of Speech and Gestures: Temporal Synchrony Follows Semantic Synchrony
von Bergmann, K., Aksu, V., & Kopp, S. (2011) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 47 · see citing works
New insights into the medium hand: Discovering recurrent structures in gestures
Ladewig, S. H., & Bressem, J. (2013) · Semiotica · doi:10.1515/sem-2013-0088 · Cited by 39 · see citing works
Holler, J., Kokal, I., Toni, I., Peter Hagoort, A., Kelly, S. D., & Özyürek, A. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu047 · Cited by 37 · see citing works
Self-citation‘Seeing tunes.’ The role of visual gestures in tune interpretation
Borràs-Comes, J., & Prieto, P. (2011) · Laboratory Phonology Journal of the Association for Laboratory Phonology · doi:10.1515/labphon.2011.013 · Cited by 35 · see citing works
Audiovisual Correlates of Interrogativity: A Comparative Analysis of Catalan and Dutch
Borràs-Comes, J., Kaland, C., Prieto, P., & Swerts, M. G. J. (2013) · Journal of Nonverbal Behavior · doi:10.1007/s10919-013-0162-0 · Cited by 35 · see citing works
Moran, R., Molholm, S., Reilly, R. B., & Foxe, J. J. (2008) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2008.06187.x · Cited by 31 · see citing works
Timing in audiovisual speech perception: A mini review and new psychophysical data
Venezia, J. H., Thurman, S. M., Matchin, W., George, S. E., & Hickok, G. S. (2015) · Attention Perception & Psychophysics · doi:10.3758/s13414-015-1026-y · Cited by 30 · see citing works
Recognizing the gist of a visual scene: possible perceptual and neural mechanisms
Rasche, C., & Christof Koch, A. (2002) · Neurocomputing · doi:10.1016/s0925-2312(02)00500-3 · Cited by 23 · see citing works
Multimodal coordination enhances the responses to an avian duet
Ręk, P. (2017) · Behavioral Ecology · doi:10.1093/beheco/arx174 · Cited by 21 · see citing works
Multimodal language use in Savosavo
Bressem, J., Stein, N., & Wegener, C. (2017) · Pragmatics Quarterly Publication of the International Pragmatics Association (IPrA) · doi:10.1075/prag.27.2.01bre · Cited by 20 · see citing works
Auditory-Visual Object Recognition Time Suggests Specific Processing for Animal Sounds
Suied, C., & Viaud‐Delmon, I. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005256 · Cited by 18 · see citing works
Wu, Y. C., & Seana Coulson, A. (2015) · Psychological Science · doi:10.1177/0956797615597671 · Cited by 18 · see citing works
Functional and temporal relations between spoken and gestured components of language
Kok, K. I. (2017) · International Journal of Corpus Linguistics · doi:10.1075/ijcl.22.1.01kok · Cited by 11 · see citing works
“Process and perish” or multiple buffers with push-down stacks?
Levinson, S. C. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15000862 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
2 of the 144 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Over-reliance on English hinders cognitive science
Blasi, D. E., Henrich, J., Adamou, E., Kemmerer, D., & Majid, A. (2022) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2022.09.015 · Cited by 396 · see citing works
Yang, K., Xu, H., & Gao, K. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413690 · Cited by 132 · see citing works
Fast response times signal social connection in conversation
Templeton, E. M., Chang, L. J., Reynolds, E. A., Cone LeBeaumont, M. D., & Wheatley, T. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2116915119 · Cited by 128 · see citing works
Felice, S. D., Hamilton, A. F. D. C., Ponari, M., & Vigliocco, G. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0357 · Cited by 115 · see citing works
Kendrick, K. H., Holler, J., & Levinson, S. C. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0473 · Cited by 101 · see citing works
Self-citationBeat gestures influence which speech sounds you hear
Bosker, H. R., & Peeters, D. (2021) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2020.2419 · Cited by 95 · see citing works
Origins of vocal-entangled gesture
Pouw, W. T. J. L., & Fuchs, S. I. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104836 · Cited by 73 · see citing works
Bias and Fairness in Multimodal Machine Learning: A Case Study of Automated Video Interviews
Booth, B. M., Hickman, L., Subburaj, S. K., Tay, L., Woo, S. E., & D’Mello, S. K. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479897 · Cited by 67 · see citing works
Multimodal Machine Learning Guides Low Carbon Aeration Strategies in Urban Wastewater Treatment
Wang, H., Wang, Y., Wang, X., Yin, W.-X., Yu, T., Xue, C.-H., & Wang, A. (2024) · Engineering · doi:10.1016/j.eng.2023.11.020 · Cited by 68 · see citing works
Acoustic information about upper limb movement in voicing
Pouw, W. T. J. L., Paxton, A., Harrison, S. J., & Dixon, J. A. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2004163117 · Cited by 65 · see citing works
Situating Language in the Real-World: The Role of Multimodal Iconicity and Indexicality
Murgiano, M., Motamedi, Y., & Vigliocco, G. (2020) · Journal of Cognition · doi:10.5334/joc.113 · Cited by 63 · see citing works
Facial Signals and Social Actions in Multimodal Face-to-Face Interaction
Nota, N., Trujillo, J. P., & Holler, J. (2021) · Brain Sciences · doi:10.3390/brainsci11081017 · Cited by 59 · see citing works
Self-citationQuantifying the interplay of conversational devices in building mutual understanding.
Dideriksen, C., Christiansen, M. H., Tylén, K., Dingemanse, M., & Fusaroli, R. (2022) · Journal of Experimental Psychology General · doi:10.1037/xge0001301 · Cited by 72 · see citing works
The Emergence and Evolution of Consumer Language Research
Packard, G. M., & Berger, J. A. (2022) · Journal of Consumer Research · doi:10.1093/jcr/ucad013 · Cited by 59 · see citing works
Zhang, Y., Frassinelli, D., Tuomainen, J., Skipper, J. I., & Vigliocco, G. (2021) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2021.0500 · Cited by 65 · see citing works
Visual bodily signals as core devices for coordinating minds in interaction
Holler, J. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0094 · Cited by 57 · see citing works
Self-citationThe role of artificial intelligence in generating original scientific research
Elbadawi, M., Li, H., Basit, A. W., & Gaisford, S. (2024) · International Journal of Pharmaceutics · doi:10.1016/j.ijpharm.2023.123741 · Cited by 57 · see citing works
Levshina, N. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.648200 · Cited by 53 · see citing works
Multimodality and the origin of a novel communication system in face-to-face interaction
Silva, V. M., Holler, J., Özyürek, A., & Roberts, S. G. (2020) · Royal Society Open Science · doi:10.1098/rsos.182056 · Cited by 52 · see citing works
Self-citationGesture–speech physics in fluent speech and rhythmic upper limb movements
Pouw, W. T. J. L., de Jonge‐Hoekstra, L., Harrison, S. J., Paxton, A., & Dixon, J. A. (2020) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14532 · Cited by 49 · see citing works
Interactionally Embedded Gestalt Principles of Multimodal Human Communication
Trujillo, J. P., & Holler, J. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221141422 · Cited by 49 · see citing works
Self-citationter Bekke, M., Drijvers, L., & Holler, J. (2020) · doi:10.31234/osf.io/b5zq7 · Cited by 49 · see citing works
Self-citationThe language void 10 years on: multimodal primate communication research is still uncommon
Liebal, K., Slocombe, K. E., & Waller, B. M. (2022) · Ethology Ecology & Evolution · doi:10.1080/03949370.2021.2015453 · Cited by 48 · see citing works
Multilevel rhythms in multimodal communication
Pouw, W. T. J. L., Proksch, S., Drijvers, L., Gamba, M., Holler, J., Kello, C. T., Schaefer, R. S., & Wiggins, G. A. (2021) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2020.0334 · Cited by 48 · see citing works
Self-citationRossi, S., Rossi, A., & Dautenhahn, K. (2020) · International Journal of Social Robotics · doi:10.1007/s12369-020-00650-z · Cited by 47 · see citing works
ter Bekke, M., Drijvers, L., & Holler, J. (2024) · Cognitive Science · doi:10.1111/cogs.13407 · Cited by 45 · see citing works
Self-citationLinguistic signs in action: The neuropragmatics of speech acts
Tomasello, R. (2022) · Brain and Language · doi:10.1016/j.bandl.2022.105203 · Cited by 43 · see citing works
Corps, R. E., Knudsen, B., & Meyer, A. S. (2022) · Cognition · doi:10.1016/j.cognition.2022.105037 · Cited by 42 · see citing works
Face2face: advancing the science of social interaction
Hamilton, A. F. D. C., & Holler, J. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0470 · Cited by 42 · see citing works
Self-citationFacial expressions elicit multiplexed perceptions of emotion categories and dimensions
Liu, M., Duan, Y., Ince, R. A. A., Chen, C., Garrod, O., Schyns, P. G., & Jack, R. E. (2021) · Current Biology · doi:10.1016/j.cub.2021.10.035 · Cited by 40 · see citing works
Factorized Multimodal Transformer for Multimodal Sequential LearningPreprint
Zadeh, A., Mao, C., Shi, K., Zhang, Y., Liang, P. P., Poria, S., & Morency, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09826 · Cited by 45 · see citing works
Interactive rhythms across species: the evolutionary biology of animal chorusing and turn‐taking
Ravignani, A., Verga, L., & Greenfield, M. D. (2019) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14230 · Cited by 39 · see citing works
Great ape interaction: Ladyginian but not Gricean
Scott‐Phillips, T., & Heintz, C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2300243120 · Cited by 38 · see citing works
The face is central to primate multicomponent signals
Waller, B. M., Kavanagh, E., Micheletta, J., Clark, P. R., & Whitehouse, J. (2022) · International Journal of Primatology · doi:10.1007/s10764-021-00260-0 · Cited by 37 · see citing works
Fusaroli, R., Weed, E., Rocca, R., FEIN, D. A., & Naigles, L. (2021) · Cognition · doi:10.1016/j.cognition.2023.105422 · Cited by 54 · see citing works
Dorta-González, P., López-Puig, A. J., Dorta-González, M. I., & González-Betancor, S. M. (2024) · Telematics and Informatics · doi:10.1016/j.tele.2024.102187 · Cited by 36 · see citing works
Trujillo, J. P., & Holler, J. (2021) · Brain Sciences · doi:10.3390/brainsci11080996 · Cited by 33 · see citing works
Self-citationHadley, L. V., Whitmer, W. M., Brimijoin, W. O., & Naylor, G. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01821-9 · Cited by 35 · see citing works
Kosie, J. E., & Lew‐Williams, C. (2024) · Developmental Science · doi:10.1111/desc.13515 · Cited by 34 · see citing works
Tracking minds in communication
Rubio‐Fernández, P., Berke, M., & Jara‐Ettinger, J. (2024) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2024.11.005 · Cited by 33 · see citing works
Knudsen, B., Creemers, A., & Meyer, A. S. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.593671 · Cited by 38 · see citing works
Meyer, A. S. (2023) · Journal of Cognition · doi:10.5334/joc.268 · Cited by 34 · see citing works
Your Face and Moves Seem Happier When I Smile
Marmolejo‐Ramos, F., Murata, A., Sasaki, K., Yamada, Y., Ikeda, A., Hinojosa, J. A., Watanabe, K., Parzuchowski, M., Tirado, C., & Ospina, R. (2020) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000470 · Cited by 33 · see citing works
Gesture's body orientation modulates the N400 for visual sentences primed by gestures
He, Y., Luell, S., Muralikrishnan, R., Straube, B., & Nagels, A. (2020) · Human Brain Mapping · doi:10.1002/hbm.25166 · Cited by 31 · see citing works
Cánovas, C. P., Valenzuela, J., Carrión, D. A., Olza, I., & Ramscar, M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233892 · Cited by 32 · see citing works
Karadöller, D. Z., Sümer, B., & Özyürek, A. (2024) · First Language · doi:10.1177/01427237241290678 · Cited by 31 · see citing works
Zhao, W., Li, Y., & Du, Y. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.1355-21.2021 · Cited by 31 · see citing works
Exploring the Emotional Functions of Co‐Speech Hand Gesture in Language and Communication
Kelly, S. D., & Tran, Q. N. (2023) · Topics in Cognitive Science · doi:10.1111/tops.12657 · Cited by 31 · see citing works
Eyebrow movements as signals of communicative problems in human face-to-face interaction
Hömke, P., Levinson, S. C., Emmendorfer, A. K., & Holler, J. (2025) · Royal Society Open Science · doi:10.1098/rsos.241632 · Cited by 30 · see citing works
Self-citationThe multimodal facilitation effect in human communication
Drijvers, L., & Holler, J. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02178-x · Cited by 30 · see citing works
Self-citationThe interaction engine: cuteness selection and the evolution of the interactional base for language
Levinson, S. C. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0108 · Cited by 29 · see citing works
Self-citationRoger, É., de Almeida, L. R., Lœvenbruck, H., Perrone‐Bertolotti, M., Cousin, É., Schwartz, J., Perrier, P., Dohen, M., Vilain, A., Baraduc, P., et al. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119672 · Cited by 29 · see citing works
Levinson, S. C. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009489584 · Cited by 31 · see citing works
Self-citationRedundancy can benefit learning: Evidence from word order and case marking
Tal, S., & Arnon, I. (2022) · Cognition · doi:10.1016/j.cognition.2022.105055 · Cited by 28 · see citing works
Extending the Architecture of Language From a Multimodal Perspective
Peter Hagoort, A., & Özyürek, A. (2024) · Topics in Cognitive Science · doi:10.1111/tops.12728 · Cited by 27 · see citing works
Li, Z., Li, J., Hong, B., Nolte, G., Engel, A. K., & Zhang, D. (2021) · Cerebral Cortex · doi:10.1093/cercor/bhab118 · Cited by 27 · see citing works
How Social Robots Influence People’s Trust in Critical Situations
Rossi, A., Dautenhahn, K., Koay, K. L., & Walters, M. L. (2020) · IEEE RO-MAN · doi:10.1109/ro-man47096.2020.9223471 · Cited by 25 · see citing works
Multicomponent and multisensory communicative acts in orang-utans may serve different functions
Fröhlich, M., Bartolotta, N., Fryns, C., Wagner, C., Momon, L., Jaffrezic, M., Setia, T. M., van Noordwijk, M. A., & van Schaik, C. P. (2021) · Communications Biology · doi:10.1038/s42003-021-02429-y · Cited by 23 · see citing works
Trujillo, J. P., & Holler, J. (2024) · Scientific Reports · doi:10.1038/s41598-024-52589-0 · Cited by 23 · see citing works
Self-citationUnderstanding Design Features of Music and Language: The Choric/Dialogic Distinction
Haiduk, F., & Fitch, W. T. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.786899 · Cited by 23 · see citing works
Beyond play: a comparative study of multi-sensory and traditional toys in child education
Fan, Y., Chong, D. K., & Li, Y. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1182660 · Cited by 23 · see citing works
A new perspective on models and theories of simultaneous interpreting
Amos, R. M., & Pickering, M. J. (2025) · Target · doi:10.1075/target.00031.amo · Cited by 3 · see citing works
Differences in the production and perception of communicative kinematics in autism
Trujillo, J. P., Özyürek, A., Kan, C. C., Simanova, I., & Harold Bekkering, A. (2021) · Autism Research · doi:10.1002/aur.2611 · Cited by 21 · see citing works
Pragmatics Always Matters: An Expanded Vision of Experimental Pragmatics
Gibbs, R. W., & Colston, H. L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01619 · Cited by 22 · see citing works
Time Is Ripe to Make Interactional Moves: Bringing Evidence From Four Languages Across Modalities
Lepeut, A., & Shaw, E. (2022) · Frontiers in Communication · doi:10.3389/fcomm.2022.780124 · Cited by 21 · see citing works
Motamedi, Y., Murgiano, M., Grzyb, B. J., Gu, Y., Kewenig, V. N., Brieke, R., Donnellan, E., Marshall, C. R., Wonnacott, E., Perniss, P., et al. (2024) · Child Development · doi:10.1111/cdev.14099 · Cited by 21 · see citing works
Reaching beneath the tip of the iceberg: A guide to the Freiburg Multimodal Interaction Corpus
Rühlemann, C., & Ptak, A. (2023) · Open Linguistics · doi:10.1515/opli-2022-0245 · Cited by 20 · see citing works
Nicoras, R., Gotowiec, S., Hadley, L. V., Smeds, K., & Naylor, G. (2022) · International Journal of Audiology · doi:10.1080/14992027.2022.2095538 · Cited by 19 · see citing works
Fröhlich, M., Müller, G., Zeiträg, C., Wittig, R. M., & Pika, S. (2019) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2019.11.002 · Cited by 19 · see citing works
Embodiment in Dissent: The Eye Roll as an Interactional Practice
Clift, R. (2021) · Research on Language and Social Interaction · doi:10.1080/08351813.2021.1936858 · Cited by 19 · see citing works
Benetti, S., Ferrari, A., & Pavani, F. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1108354 · Cited by 20 · see citing works
Speakers advance-project turn completion by slowing down: A multifactorial corpus analysis
Rühlemann, C., & Gries, S. T. (2020) · Journal of Phonetics · doi:10.1016/j.wocn.2020.100976 · Cited by 17 · see citing works
Great ape communication as contextual social inference: a computational modelling perspective
Bohn, M., Liebal, K., Oña, L. S., & Tessler, M. H. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0096 · Cited by 17 · see citing works
Language‐Specific Constraints on Conversation: Evidence from Danish and Norwegian
Dideriksen, C., Christiansen, M. H., Dingemanse, M., Højmark‐Bertelsen, M., Johansson, C., Tylén, K., & Fusaroli, R. (2023) · Cognitive Science · doi:10.1111/cogs.13387 · Cited by 17 · see citing works
Quantifying the interplay of conversational devices in building mutual understandingPreprint
Dideriksen, C., Christiansen, M. H., Tylén, K., Dingemanse, M., & Fusaroli, R. (2020) · doi:10.31234/osf.io/a5r74 · Cited by 17 · see citing works
Kaya, K., Erdoğan, O., Yeşil, Y., & Sezgin, F. (2024) · SAGE Open · doi:10.1177/21582440241271136 · Cited by 23 · see citing works
The construction of emotional meaning in language
Hoemann, K., Lee, Y., Dussault, È., Devylder, S., Ungar, L., Geeraerts, D., & Mesquita, B. (2025) · Communications Psychology · doi:10.1038/s44271-025-00255-0 · Cited by 27 · see citing works
Social tolerance and interactional opportunities as drivers of gestural redoings in orang-utans
Fröhlich, M., & van Schaik, C. P. (2022) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0106 · Cited by 17 · see citing works
Multi-scale fusion visual attention network for facial micro-expression recognition
Pan, H., Yang, H., Xie, L., & Wang, Z. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1216181 · Cited by 16 · see citing works
Rohrer, P. L., Delais-Roussarie, É., & Prieto, P. (2023) · Lingua · doi:10.1016/j.lingua.2023.103583 · Cited by 16 · see citing works
Left-Hemisphere Cortical Language Regions Respond Equally to Observed Dialogue and Monologue
Olson, H. A., Chen, E. M., Lydic, K. O., & Saxe, R. R. (2023) · Neurobiology of Language · doi:10.1162/nol_a_00123 · Cited by 16 · see citing works
EEG theta responses induced by emoji semantic violations
Tang, M., Zhao, X., Chen, B., & Zhao, L. (2021) · Scientific Reports · doi:10.1038/s41598-021-89528-2 · Cited by 16 · see citing works
Specific facial signals associate with categories of social actions conveyed through questions
Nota, N., Trujillo, J. P., & Holler, J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0288104 · Cited by 17 · see citing works
Self-citationHartmann, S., & Pleyer, M. (2021) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2020.0200 · Cited by 15 · see citing works
Considering the Nature of Multimodal Language from a Crosslinguistic Perspective
Özyürek, A. (2021) · Journal of Cognition · doi:10.5334/joc.165 · Cited by 15 · see citing works
Face-to-face spatial orientation fine-tunes the brain for neurocognitive processing in conversation
Drijvers, L., & Holler, J. (2022) · iScience · doi:10.1016/j.isci.2022.105413 · Cited by 15 · see citing works
Self-citationThe Dynamic Interplay of Kinetic and Linguistic Coordination in Danish and Norwegian Conversation
Trujillo, J. P., Dideriksen, C., Tylén, K., Christiansen, M. H., & Fusaroli, R. (2023) · Cognitive Science · doi:10.1111/cogs.13298 · Cited by 15 · see citing works
Multimodal encoding of motion events in speech, gesture and cognition
Ünal, E., Mamus, E., & Özyürek, A. (2023) · Language and Cognition · doi:10.1017/langcog.2023.61 · Cited by 15 · see citing works
Morett, L. M., Landi, N., IRWIN, J. R., & McPartland, J. C. (2020) · Brain Research · doi:10.1016/j.brainres.2020.147059 · Cited by 15 · see citing works
Riedl, L., Nagels, A., Sammer, G., Choudhury, M., Nonnenmann, A., Sütterlin, A., Feise, C., Haslach, M., Bitsch, F., & Straube, B. (2022) · Schizophrenia Research · doi:10.1016/j.schres.2022.06.009 · Cited by 13 · see citing works
Riedl, L., Nagels, A., Sammer, G., & Straube, B. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00110 · Cited by 15 · see citing works
Turn-taking skills in mammals: A systematic review into development and acquisition
Abreu, F., & Pika, S. (2022) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2022.987253 · Cited by 15 · see citing works
A Roadmap for Technological Innovation in Multimodal Communication Research
Gregori, A., Amici, F., Brilmayer, I., Ćwiek, A., Fritzsche, L., Fuchs, S. I., Henlein, A., Herbort, O., Kügler, F., Lemanski, J., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35748-0_30 · Cited by 16 · see citing works
Symbolic play as a zone of proximal development: An analysis of informational exchange
Creaghe, N., & Kidd, E. (2022) · Social Development · doi:10.1111/sode.12592 · Cited by 13 · see citing works
Beyond speaking: neurocognitive perspectives on language production in social interaction
Kuhlen, A. K., & Rahman, R. A. (2023) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2021.0483 · Cited by 15 · see citing works
Inbar, A., & Maschler, Y. (2023) · Research on Language and Social Interaction · doi:10.1080/08351813.2023.2205302 · Cited by 13 · see citing works
The role of multimodal cues in second language comprehension
Zhang, Y., Ding, R., Frassinelli, D., Tuomainen, J., Klavinskis-Whiting, S., & Vigliocco, G. (2023) · Scientific Reports · doi:10.1038/s41598-023-47643-2 · Cited by 13 · see citing works
Nota, N., Trujillo, J. P., & Holler, J. (2023) · Cognitive Science · doi:10.1111/cogs.13392 · Cited by 13 · see citing works
Self-citationGestures speed up responses to questions
ter Bekke, M., Drijvers, L., & Holler, J. (2024) · Language Cognition and Neuroscience · doi:10.1080/23273798.2024.2314021 · Cited by 13 · see citing works
Self-citationGaze and speech behavior in parent–child interactions: The role of conflict and cooperation
Holleman, G. A., Hooge, I. T. C., Huijding, J., Deković, M., Kemner, C., & Hessels, R. S. (2021) · Current Psychology · doi:10.1007/s12144-021-02532-7 · Cited by 13 · see citing works
- Authors
- Holler, J., & Levinson, S. C.
- Affiliations
- Radboud University Nijmegen (NL)
- Corresponding author
- Holler, Judith
- Venue
- Trends in Cognitive Sciences
- Publisher
- Elsevier BV
- Published
- 2019-08
- Volume
- 23
- Issue
- 8
- Pages
- 639-652
- ISSN
- 1364-6613 (ISSN-L)
- OpenAlex
- W2951431783
- Cited by
- 441
- References
- 144
- Citations by year
- 2026: 82 · 2025: 78 · 2024: 66 · 2023: 75 · 2022: 49 · 2021: 40 · 2020: 47 · 2019: 4
- FWCI
- 4.45
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Trends in Cognitive Sciences (publishedVersion)
- PubMed (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion)
- Funders
- Max-Planck-Gesellschaft
- European Research Council
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Social Sciences › Psychology › Social Psychology › Action Observation and Synchronization
- Keywords
- multimodal language processing, face-to-face interaction, turn-taking, psycholinguistics, situated cognition
- MeSH terms
- Communication, Humans, Models, Theoretical, Perception, Comprehension
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
