The Brain’s Tendency to Bind Audiovisual Signals Is Stable but Not General
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Previous studies have shown a surprising amount of between-subjects variability in the strength of interactions between sensory modalities. For the same set of stimuli, some subjects exhibit strong interactions, whereas others exhibit weak interactions. To date, little is known about what underlies this variability. Sensory integration in the brain could be governed by a global mechanism or by task-specific mechanisms that could be either stable or variable across time. We used a rigorous quantitative tool (Bayesian causal inference) to investigate whether integration (i.e., binding) tendencies generalize across tasks and are stable across time. We report for the first time that individuals’ binding tendencies are stable across time but are task-specific. These results provide evidence against the hypothesis that sensory integration is governed by a single, global parameter in the brain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
The Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936 · cited 1×
“The fact that differences in unisensory processing influence integration is already well established (Alais & Burr, 2004; Ernst & Banks, 2002; Rohe & Noppeney, 2015b); on the other hand, the binding tendency, which provides a true One possible source of between-subjects variability in cross-modal…”
Is neocortex essentially multisensory?
GHAZANFAR, A., & SCHROEDER, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.04.008 · Cited by 1,463 · cited 2×
“Recent research has revealed that cross-modal interactions start at early stages of sensory processing, including primary cortical areas that were traditionally believed to be strictly unisensory (e.g., Foxe & Schroeder, 2005; Ghazanfar & Schroeder, 2006).”
Shams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262 · cited 2×
“…variability has been shown in several domains, including speech perception (Mallick, Magnotti, & Beauchamp, 2015), temporal-numerosity perception (Shams, Kamitani, & Shimojo, 2000; Stevenson, Zemtsov, & Wallace, 2012), and spatial perception (Hairston et al., 2003; Wozny, Beierholm, & Shams,…”
Self-citationCausal Inference in Multisensory Perception
Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000943 · Cited by 1,069 · cited 4×
“On a given day, each subject participated in two tasks: a temporal-numerosity judgment task (Shams et al., 2000, 2005) and a spatial localization task (Körding et al., 2007; Wozny et al., 2010).”
InfluentialSelf-citationMultisensory temporal integration in autism spectrum disorders
Stevenson, R. A., Siemann, J. K., Schneider, B. C., Eberly, H. E., Woynaroski, T. G., Camarata, S. M., & Wallace, M. T. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3615-13.2014 · Cited by 482 · cited 2×
“…multisensory integration is associated with several disorders, such as autism (e.g., Foxe et al., 2015; Stevenson, Siemann, Schneider, et al., 2014; Stevenson, Siemann, Woynaroski, et al., 2014; Wallace & Stevenson, 2014), dyslexia (e.g., Hahn, Foxe, & Molholm, 2014; Harrar et al., 2014), and…”
Causal inference in perception
Shams, L., & Beierholm, U. R. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.07.001 · Cited by 403 · cited 1×
“As we experience the surrounding world, our brains effortlessly process sights and sounds, inferring which visual sources produced which auditory signals (Parise, Spence, & Ernst, 2012; Shams & Beierholm, 2010; Shams, Ma, & Beierholm, 2005; Stein, 2012).”
BackgroundSelf-citationCortical Hierarchies Perform Bayesian Causal Inference in Multisensory Perception
Rohe, T., & Noppeney, U. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002073 · Cited by 344 · cited 2×
“…make explicit predictions about the locations of unisensory and multisensory processing areas in the brain, one recent study using functional MRI and a spatial localization task made progress in this area by mapping estimates from this model onto different cortical areas (Rohe & Noppeney, 2015a).”
Parise, C. V., & Spence, C. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005664 · Cited by 272 · cited 1×
“…tendency observed in the present study is consistent with the stability and task specificity reported else-where for synesthesia, which could be interpreted as an extreme, unique manifestation of the binding tendency (Ghazanfar & Schroeder, 2006; Newell & Mitchell, 2015; Parise & Spence, 2009).”
Stevenson, R. A., Zemtsov, R. K., & Wallace, M. T. (2012) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0027339 · Cited by 269 · cited 2×
“…interactions vary across individuals in any given task, such interactions can correlate strongly across audiovisual tasks within individuals (Stevenson et al., 2012; Stevenson & Wallace, 2013); however, no previous study has used analytic methods capable of teasing apart these two possible…”
Cited by
The neural dynamics of hierarchical Bayesian causal inference in multisensory perception
Rohe, T., Ehlis, A.-C., & Noppeney, U. (2019) · Nature Communications · doi:10.1038/s41467-019-09664-2 · Cited by 187
Acerbi, L., Dokka, K., Angelaki, D. E., & Ma, W. J. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006110 · Cited by 111
“While pc should typically stem from the statistics of the task, it is general practice to keep it as a free parameter of any Bayesian model, since subjects tend to exhibit a wide spectrum of beliefs about the probability of a common cause (see Fig 2 in [15]).”
BackgroundTemporal synchrony and audiovisual integration of speech and object stimuli in autism
Smith, E., Zhang, S., & Bennetto, L. (2017) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2017.04.001 · Cited by 33
Metadata
- Authors
- Odegaard, B., & Shams, L.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2016-03-04
- Volume
- 27
- Issue
- 4
- Pages
- 583-591
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2292361545
- Cited by
- 75
- References
- 12
- FWCI
- 14.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.