Brains in dialogue: decoding neural preparation of speaking to a conversational partner
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
In dialogue, language processing is adapted to the conversational partner. We hypothesize that the brain facilitates partner-adapted language processing through preparatory neural configurations (task sets) that are tailored to the conversational partner. In this experiment, we measured neural activity with functional magnetic resonance imaging (fMRI) while healthy participants in the scanner (a) engaged in a verbal communication task with a conversational partner outside of the scanner, or (b) spoke outside of a conversational context (to test the microphone). Using multivariate searchlight analysis, we identify cortical regions that represent information on whether speakers plan to speak to a conversational partner or without having a partner. Most notably a region that has been associated with processing social-affective information and perspective taking, the ventromedial prefrontal cortex, as well as regions that have been associated with prospective task representation, the bilateral ventral prefrontal cortex, are involved in encoding the speaking condition. Our results suggest that speakers prepare, in advance of speaking, for the social context in which they will speak.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Toward a mechanistic psychology of dialogue.
Pickering, M. J., & Garrod, S. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000056 · Cited by 2,678
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
The Neural Basis of Mentalizing
Frith, C. D., & Frith, U. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.001 · Cited by 1,855
Decoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 3×
“This GLM was based on unsmoothed data to maximize the sensitivity for information encoded in fine-grained spatial voxel patterns (Kamitani and Tong 2005; Haynes and Rees 2005; Kriegeskorte et al. 2006; Haynes and Rees 2006), for a discussion see (Swisher et al.”
MethodA Core System for the Implementation of Task Sets
Dosenbach, N. U. F., Visscher, K. M., Palmer, E. D., Miezin, F. M., Wenger, K. K., Kang, H. C., Burgund, E. D., Grimes, A. L., Schlaggar, B. L., & Petersen, S. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.04.031 · Cited by 1,772 · cited 2×
“…or arithmetic tasks have shown that the brain supports rapid adaptation to the environmental context by pre-activating cortical structures that will be used in the upcoming task (Brass and von Cramon 2002; Forstmann et al. 2005; Sakai and Passingham 2006; Dosenbach et al. 2006; Haynes et al. 2007).”
BackgroundUnconscious determinants of free decisions in the human brain
Soon, C. S., Brass, M., Heinze, H.-J., & Haynes, J.-D. (2008) · Nature Neuroscience · doi:10.1038/nn.2112 · Cited by 1,741 · cited 2×
“In order to estimate the information encoded in spatially distributed response patterns at each brain location, we employed a ‘searchlight’ approach (Kriegeskorte et al. 2006; Haynes et al. 2007; Soon et al. 2008; Bode and Haynes 2009) that allowed the unbiased search for informative voxels across the whole brain.”
MethodSelf-citationAn integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Toward a second-person neuroscience
Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., & Vogeley, K. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000660 · Cited by 1,510
Understanding others' actions and goals by mirror and mentalizing systems: a meta-analysis
Van Overwalle, F., & Baetens, K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.009 · Cited by 1,329 · cited 1×
“These studies suggest that brain areas associated with the so-called ‘mentalizing network’ (Van Overwalle and Baetens 2009), most notably the medial prefrontal cortex, are implicated when speech is produced for the purpose of communicating (Sassa et al. 2007; Willems et al. 2010).”
BackgroundCognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes
Badre, D. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.02.004 · Cited by 980
Orbitofrontal Cortex as a Cognitive Map of Task Space
Wilson, R. C., Takahashi, Y. K., Schoenbaum, G., & Niv, Y. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.005 · Cited by 885
Frith, C. D., & Frith, U. (2007) · Current Biology · doi:10.1016/j.cub.2007.05.068 · Cited by 759
Moll, J., de Oliveira-Souza, R., Eslinger, P. J., Bramati, I. E., Mourão-Miranda, J., Andreiuolo, P. A., & Pessoa, L. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02730.2002 · Cited by 721 · cited 1×
“Lesions to the ventromedial part of the mPFC are said to impair a person’s social interaction skills (Bechara et al. 2000; Moll et al. 2002).”
BackgroundWhat the orbitofrontal cortex does not do
Stalnaker, T. A., Cooch, N. K., & Schoenbaum, G. (2015) · Nature Neuroscience · doi:10.1038/nn.3982 · Cited by 531 · cited 2×
“cortex) in goal-directed behavior and in mapping representations of a given task state (Wilson et al. 2014; Stalnaker et al. 2015).”
BackgroundNeubert, F.-X., Mars, R. B., Thomas, A. G., Sallet, J., & Rushworth, M. F. S. (2014) · Neuron · doi:10.1016/j.neuron.2013.11.012 · Cited by 416 · cited 2×
“The areas identified in our study most closely correspond to a subdivision that has been labeled the ventrolateral frontal poles (Neubert et al. 2014).”
BackgroundA Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives
Haynes, J.-D. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.025 · Cited by 402
Self-citationDecomposing components of task preparation with functional magnetic resonance imaging.
Brass, M., & Cramon, D. Y. V. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904323057335 · Cited by 302
Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses?
Op de Beeck, H. P. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.02.047 · Cited by 275
Segregation of the human medial prefrontal cortex in social cognition
Bzdok, D., Langner, R., Schilbach, L., Engemann, D. A., Laird, A. R., Fox, P. T., & Eickhoff, S. B. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00232 · Cited by 229 · cited 1×
“A recent meta-analysis aimed at distinguishing the respective contributions of the dorsomedial and ventromedial prefrontal cortex to social cognition (Bzdok et al. 2013).”
BackgroundAttenuating information in spoken communication: for the speaker, or for the addressee?
Galati, A., & Brennan, S. E. (2010) · Journal of Memory and Language · doi:10.1016/j.jml.2009.09.002 · Cited by 200 · cited 2×
“cific, situational information about their conversational partner, for example, whether the partner is familiar with the topic (Galati and Brennan 2010), can see the object under discussion (Nadig and Sedivy 2002; Lockridge and Brennan 2002), or has a different spatial perspective (Schober 1993; Duran et al.”
BackgroundSelf-citationNeural signatures of response planning occur midway through an incoming question in conversation
Bögels, S., Magyari, L., & Levinson, S. C. (2015) · Scientific Reports · doi:10.1038/srep12881 · Cited by 193
Spatial smoothing hurts localization but not information: Pitfalls for brain mappers
Kamitani, Y., & Sawahata, Y. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.040 · Cited by 122
Decoding the Content of Delayed Intentions
Gilbert, S. J. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.5336-10.2011 · Cited by 95 · cited 1×
“Previous studies have successfully employed multivariate analyses to decode the content of specific mental states and have pointed towards an increased sensitivity of this approach (Kamitani and Tong 2005; Haynes and Rees 2006; Haynes et al. 2007; Bode and Haynes 2009; Gilbert 2011).”
Research works printed but not linked: 70
- Amodio, 2006, Meeting of minds: the medial frontal cortex and social cognition, Nature Reviews Neuroscience,, 7, 268, 10.1038/nrn1884 · DOI · Paper page
- Badre, 2007, Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex, Journal of Cognitive Neuroscience,, 19, 2082, 10.1162/jocn.2007.19.12.2082 · DOI · Paper page
- Bar, 2009, The proactive brain: memory for predictions, Philosophical Transactions of The Royal Society B Biological Sciences,, 364, 1235, 10.1098/rstb.2008.0310 · DOI · Paper page
- Barr, 2005, Other Minds: How Humans Bridge the Divide between Self and Others, 271
- Barr, 2006, Handbook of Psycholinguistics, 901, 10.1016/B978-012369374-7/50024-9 · DOI
- Bašnáková, 2015, A job interview in the MRI scanner: how does indirectness affect addressees and overhearers?, Neuropsychologia,, 76, 79, 10.1016/j.neuropsychologia.2015.03.030 · DOI
- Bechara, 2000, Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions, Brain,, 123, 2189, 10.1093/brain/123.11.2189 · DOI · Paper page
- Bell, 1984, Language style as audience design, Language in Society,, 13, 145, 10.1017/S004740450001037X · DOI · Paper page
- Berkum, 2008, Understanding sentences in context what brain waves can tell us, Current Directions in Psychological Science,, 17, 376, 10.1111/j.1467-8721.2008.00609.x · DOI · Paper page
- Bode, 2009, Decoding sequential stages of task preparation in the human brain, NeuroImage,, 45, 606, 10.1016/j.neuroimage.2008.11.031 · DOI · Paper page
- Boersma, 2001, Praat, a system for doing phonetics by computer, Glot International,, 5, 341
- Bögels, 2015, Conversational interaction in the scanner: mentalizing during language processing as revealed by MEG, Cerebral Cortex,, 25, 3219, 10.1093/cercor/bhu116 · DOI · Paper page
- Boorman, 2011, Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex, PLOS Biology,, 9, e1001093, 10.1371/journal.pbio.1001093 · DOI · Paper page
- Brass, 2002, The role of the frontal cortex in task preparation, Cerebral Cortex (New York, N.Y. : 1991),, 12, 908, 10.1093/cercor/12.9.908 · DOI · Paper page
- Brennan, 1991, Conversation with and through computers, User Modeling and User-Adapted Interaction,, 1, 67, 10.1007/BF00158952 · DOI
- Brennan, 2010, Psychology of Learning and Motivation, 301
- Brennan, 2009, Partner-specific adaptation in dialog, Topics in Cognitive Science,, 1, 274, 10.1111/j.1756-8765.2009.01019.x · DOI · Paper page
- Brown-Schmidt, 2009, Partner-specific interpretation of maintained referential precedents during interactive dialog, Journal of Memory and Language,, 61, 171, 10.1016/j.jml.2009.04.003 · DOI · Paper page
- Bunge, 2007, Neuroscience of Rule-Guided Behavior, 10.1093/acprof:oso/9780195314274.001.0001 · DOI · Paper page
- Clark, 1996, Using Language, 10.1017/CBO9780511620539 · DOI · Paper page
- Clark, 1982, Categorization and Cognition, 313
- Clark, 1982, Advances in Psychology, 287
- Crone, 2006, Neural evidence for dissociable components of task-switching, Cerebral Cortex (New York, N.Y. : 1991),, 16, 475, 10.1093/cercor/bhi127 · DOI · Paper page
- Crosby, 2008, Where do we look during potentially offensive behavior?, Psychological Science,, 19, 226, 10.1111/j.1467-9280.2008.02072.x · DOI
- Duran, 2011, Listeners invest in an assumed other’s perspective despite cognitive cost, Cognition,, 121, 22, 10.1016/j.cognition.2011.06.009 · DOI
- Ferreira, 2000, Effect of ambiguity and lexical availability on syntactic and lexical production, Cognitive Psychology,, 40, 296, 10.1006/cogp.1999.0730 · DOI · Paper page
- Forstmann, 2005, Internally generated and directly cued task sets: an investigation with fMRI, Neuropsychologia,, 43, 943, 10.1016/j.neuropsychologia.2004.08.008 · DOI
- Gehrig, 2012, Setting up the speech production network: how oscillations contribute to lateralized information routing, Frontiers in Psychology,, 3, 10.3389/fpsyg.2012.00169 · DOI
- Hanna, 2007, Speakers’ eye gaze disambiguates referring expressions early during face-to-face conversation, Journal of Memory and Language,, 57, 596, 10.1016/j.jml.2007.01.008 · DOI · Paper page
- Hanna, 2004, Pragmatic effects on reference resolution in a collaborative task: evidence from eye movements, Cognitive Science,, 28, 105, 10.1207/s15516709cog2801_5 · DOI · Paper page
- Hanna, 2003, The effects of common ground and perspective on domains of referential interpretation, Journal of Memory and Language,, 49, 43, 10.1016/S0749-596X(03)00022-6 · DOI · Paper page
- Haynes, 2005, Predicting the stream of consciousness from activity in human visual cortex, Current Biology,, 15, 1301, 10.1016/j.cub.2005.06.026 · DOI · Paper page
- Haynes, 2006, Decoding mental states from brain activity in humans, Nature Reviews Neuroscience,, 7, 523, 10.1038/nrn1931 · DOI · Paper page
- Haynes, 2007, Reading hidden intentions in the human brain, Current Biology,, 17, 323, 10.1016/j.cub.2006.11.072 · DOI · Paper page
- Horton, 1996, When do speakers take into account common ground?, Cognition,, 59, 91, 10.1016/0010-0277(96)81418-1 · DOI · Paper page
- Hwang, 2015, Phonetic adaptation in non-native spoken dialogue: effects of priming and audience design, Journal of Memory and Language,, 81, 72, 10.1016/j.jml.2015.01.001 · DOI
- Hynes, 2006, Differential role of the orbital frontal lobe in emotional versus cognitive perspective-taking, Neuropsychologia,, 44, 374, 10.1016/j.neuropsychologia.2005.06.011 · DOI · Paper page
- Kell, 2011, Lateralization of speech production starts in sensory cortices: a possible sensory origin of cerebral left dominance for speech, Cerebral Cortex (New York, N.Y. : 1991),, 21, 932, 10.1093/cercor/bhq167 · DOI
- Keysar, 1998, The egocentric basis of language use insights from a processing approach, Current Directions in Psychological Science,, 7, 46, 10.1111/1467-8721.ep13175613 · DOI · Paper page
- Koechlin, 2003, The architecture of cognitive control in the human prefrontal cortex, Science,, 302, 1181, 10.1126/science.1088545 · DOI · Paper page
- Kourtis, 2010, Favouritism in the motor system: social interaction modulates action simulation, Biology Letters,, 6, 758, 10.1098/rsbl.2010.0478 · DOI · Paper page
- Kourtis, 2013, Predictive representation of other people’s actions in joint action planning: an EEG study, Society Neuroscience,, 8, 31, 10.1080/17470919.2012.694823 · DOI · Paper page
- Kraljic, 2005, Prosodic disambiguation of syntactic structure: for the speaker or for the addressee?, Cognitive Psychology,, 50, 194, 10.1016/j.cogpsych.2004.08.002 · DOI · Paper page
- Krauss, 1987, The role of the listener: addressee influences on message formulation, Journal of Language and Social Psychology,, 6, 81, 10.1177/0261927X8700600201 · DOI
- Kriegeskorte, 2006, Information-based functional brain mapping, Proceedings of the National Academy of Sciences USA,, 103, 3863, 10.1073/pnas.0600244103 · DOI · Paper page
- Kronmüller, 2007, Perspective-free pragmatics: broken precedents and the recovery-from-preemption hypothesis, Journal of Memory and Language,, 56, 436, 10.1016/j.jml.2006.05.002 · DOI
- Kuhlen, 2013, Language in dialogue: when confederates might be hazardous to your data, Psychonomic and Bulletin Review,, 20, 54, 10.3758/s13423-012-0341-8 · DOI
- Lockridge, 2002, Addressees’ needs influence speakers’ early syntactic choices, Psychonomic and Bulletin Review,, 9, 550, 10.3758/BF03196312 · DOI · Paper page
- Mackey, 2014, Architecture and morphology of the human ventromedial prefrontal cortex, European Journal of Neuroscience,, 40, 2777, 10.1111/ejn.12654 · DOI · Paper page
- Metzing, 2003, When conceptual pacts are broken: partner-specific effects on the comprehension of referring expressions, Journal of Memory and Language,, 49, 201, 10.1016/S0749-596X(03)00028-7 · DOI · Paper page
- Momennejad, 2012, Human anterior prefrontal cortex encodes the “what” and “when” of future intentions, NeuroImage,, 61, 139, 10.1016/j.neuroimage.2012.02.079 · DOI
- Muller, 2001, An introduction to kernel-based learning algorithms, IEEE Transactions on Neural Networks,, 12, 181, 10.1109/72.914517 · DOI · Paper page
- Nadig, 2002, Evidence of perspective-taking constraints in children’s on-line reference resolution, Psychological Science,, 13, 329, 10.1111/j.0956-7976.2002.00460.x · doi:10.1111/j.0956-7976.2002.00460.x · Paper page
- Newman-Norlund, 2009, Recipient design in tacit communication, Cognition,, 111, 46, 10.1016/j.cognition.2008.12.004 · DOI
- Nieuwland, 2006, Individual differences and contextual bias in pronoun resolution: evidence from ERPs, Brain Research,, 1118, 155, 10.1016/j.brainres.2006.08.022 · DOI · Paper page
- Noordzij, 2009, Brain mechanisms underlying human communication, Frontiers in Human Neuroscience,, 3, 14, 10.3389/neuro.09.014.2009 · DOI · Paper page
- Reverberi, 2012, Compositionality of rule representations in human prefrontal cortex, Cerebral cortex (New York, N.Y. : 1991),, 22, 1237, 10.1093/cercor/bhr200 · DOI · Paper page
- Sakai, 2008, Task set and prefrontal cortex, The Annual Review of Neuroscience,, 31, 219, 10.1146/annurev.neuro.31.060407.125642 · DOI · Paper page
- Sakai, 2003, Prefrontal interactions reflect future task operations, Nature Neuroscience,, 6, 75, 10.1038/nn987 · DOI · Paper page
- Sakai, 2006, Prefrontal set activity predicts rule-specific neural processing during subsequent cognitive performance, The Journal of Neuroscience: The Official Journal of the Society for Neuroscience,, 26, 1211, 10.1523/JNEUROSCI.3887-05.2006 · DOI · Paper page
- Sassa, 2007, Cortical mechanism of communicative speech production, NeuroImage,, 37, 985, 10.1016/j.neuroimage.2007.05.059 · DOI
- Schilbach, 2006, Being with virtual others: neural correlates of social interaction, Neuropsychologia,, 44, 718, 10.1016/j.neuropsychologia.2005.07.017 · DOI · Paper page
- Schober, 1993, Spatial perspective-taking in conversation, Cognition,, 47, 1, 10.1016/0010-0277(93)90060-9 · DOI · Paper page
- Stolk, 2015, Altered communicative decisions following ventromedial prefrontal lesions, Current Biology,, 25, 1469, 10.1016/j.cub.2015.03.057 · DOI
- Swisher, 2010, Multiscale pattern analysis of orientation-selective activity in the primary visual cortex, Journal of Neuroscience,, 30, 325, 10.1523/JNEUROSCI.4811-09.2010 · DOI · Paper page
- Tanenhaus, 2008, Language processing in the natural world, Philosophical Transactions of The Royal Society B Biological Sciences,, 363, 1105, 10.1098/rstb.2007.2162 · DOI · Paper page
- Van Berkum, 2010, The brain is a prediction machine that cares about good and bad: any implications for neuropragmatics?, Italian Journal of Linguistics,, 22, 181
- Welborn, 2015, Person-specific theory of mind in medial pFC, Journal of Cognitive Neuroscience,, 27, 1, 10.1162/jocn_a_00700 · DOI · Paper page
- Willems, 2010, A dissociation between linguistic and communicative abilities in the human brain, Psychological Science,, 21, 8, 10.1177/0956797609355563 · DOI · Paper page
- Wisniewski, 2016, Similar coding of freely chosen and externally cued intentions in a fronto-parietal network, Neuroimage,, 134, 450, 10.1016/j.neuroimage.2016.04.044 · DOI
Cited by
Using second-person neuroscience to elucidate the mechanisms of social interaction
Redcay, E., & Schilbach, L. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0179-4 · Cited by 738
Hasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157
Meyer, A. S. (2023) · Journal of Cognition · doi:10.5334/joc.268 · Cited by 34
Tan, S. H. J., Leuk, S. P. J., & Teo, W.-P. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.121906 · Cited by 1
Metadata
- Authors
- Kuhlen, A. K., Bogler, C., Brennan, S. E., & Haynes, J.-D.
- Venue
- Social Cognitive and Affective Neuroscience
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-17
- Volume
- 12
- Issue
- 6
- Pages
- 871-880
- ISSN
- 1749-5016 (ISSN-L)
- 1749-5024
- OpenAlex
- W2589243079
- Cited by
- 39
- References
- 25
- FWCI
- 1.86
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- German Federal Ministry of Education and Research
- Deutsche Forschungsgemeinschaft
- European Regional Development Funds
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin
- National Science Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.