Binding of sights and sounds: Age-related changes in multisensory temporal processing
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
We live in a multisensory world and one of the challenges the brain is faced with is deciding what information belongs together. Our ability to make assumptions about the relatedness of multisensory stimuli is partly based on their temporal and spatial relationships. Stimuli that are proximal in time and space are likely to be bound together by the brain and ascribed to a common external event. Using this framework we can describe multisensory processes in the context of spatial and temporal filters or windows that compute the probability of the relatedness of stimuli. Whereas numerous studies have examined the characteristics of these multisensory filters in adults and discrepancies in window size have been reported between infants and adults, virtually nothing is known about multisensory temporal processing in childhood. To examine this, we compared the ability of 10 and 11 year olds and adults to detect audiovisual temporal asynchrony. Findings revealed striking and asymmetric age-related differences. Whereas children were able to identify asynchrony as readily as adults when visual stimuli preceded auditory cues, significant group differences were identified at moderately long stimulus onset asynchronies (150–350 ms) where the auditory stimulus was first. Results suggest that changes in audiovisual temporal perception extend beyond the first decade of life. In addition to furthering our understanding of basic multisensory developmental processes, these findings have implications on disorders (e.g., autism, dyslexia) in which emerging evidence suggests alterations in multisensory temporal function.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Dynamic mapping of human cortical development during childhood through early adulthood
Gogtay, N., Giedd, J. N., Lusk, L., Hayashi, K. M., Greenstein, D., Vaituzis, A. C., Nugent, T. F., Herman, D. H., Clasen, L. S., Toga, A. W., et al. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0402680101 · Cited by 5,604 · cited 1×
“, prefrontal cortex, superior temporal cortex) maturing up to and potentially beyond 20 years of age (Giedd et al., 1999; Gogtay et al., 2004; Pfefferbaum et al., 1994).”
BackgroundBrain development during childhood and adolescence: a longitudinal MRI study
Giedd, J. N., Blumenthal, J., Jeffries, N. O., Castellanos, F. X., Liu, H., Zijdenbos, A., Paus, T., Evans, A. C., & Rapoport, J. L. (1999) · Nature Neuroscience · doi:10.1038/13158 · Cited by 5,552
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583 · cited 1×
“…studies, and include enhancements in signal detection, speeded motor responses, and improved speech in noise performance (Frens, Van Opstal, & Van der Willigen, 1995; Grant & Seitz, 2000; Hughes, Reuter-Lorenz, Nozawa, & Fendrich, 1994; Lovelace, Stein, & Wallace, 2003; Sumby & Pollack, 1954).”
BackgroundThe Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Pfefferbaum, A., Mathalon, D. H., Sullivan, E. V., Rawles, J. M., Zipursky, R. B., & Lim, K. O. (1994) · Archives of Neurology · doi:10.1001/archneur.1994.00540210046012 · Cited by 1,363 · cited 1×
“, prefrontal cortex, superior temporal cortex) maturing up to and potentially beyond 20 years of age (Giedd et al., 1999; Gogtay et al., 2004; Pfefferbaum et al., 1994).”
BackgroundShams, L., Kamitani, Y., & Shimojo, S. (2000) · Nature · doi:10.1038/35048669 · Cited by 1,262
Calvert, G. A., Campbell, R., & Brammer, M. J. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00513-3 · Cited by 954
Young Children Do Not Integrate Visual and Haptic Form Information
Gori, M., Del Viva, M., Sandini, G., & Burr, D. C. (2008) · Current Biology · doi:10.1016/j.cub.2008.04.036 · Cited by 547
Research works printed but not linked: 38
- Bahrick, 1983, Infants’ perception of substance and temporal synchrony in multimodal events, Infant Behavior & Development, 6, 429, 10.1016/S0163-6383(83)90241-2 · DOI
- Bahrick, 1987, Infants’ intermodal perception of two levels of temporal structure in natural events, Infant Behavior & Development, 10, 387, 10.1016/0163-6383(87)90039-7 · DOI
- Bahrick, 1988, Intermodal learning in infancy: Learning on the basis of two kinds of invariant relations in audible and visible events, Child Development, 59, 197, 10.2307/1130402 · DOI · Paper page
- Barutchu, 2010, Audiovisual integration in noise by children and adults, Journal of Experimental Child Psychology, 105, 38, 10.1016/j.jecp.2009.08.005 · DOI · Paper page
- Colonius, 2004, Multisensory interaction in saccadic reaction time: A time-window-of-integration model, Journal of Cognitive Neuroscience, 16, 1000, 10.1162/0898929041502733 · DOI · Paper page
- Dhamala, 2007, Multisensory integration for timing engages different brain networks, Neuroimage, 34, 764, 10.1016/j.neuroimage.2006.07.044 · DOI
- Dixon, 1980, The detection of auditory visual desynchrony, Perception, 9, 719, 10.1068/p090719 · DOI · Paper page
- Ernst, 2008, Multisensory integration: A late bloomer, Current Biology, 18, R519, 10.1016/j.cub.2008.05.002 · DOI
- Frens, 1995, Spatial and temporal factors determine auditory–visual interactions in human saccadic eye movements, Perception and Psychophysics, 57, 802, 10.3758/BF03206796 · DOI · Paper page
- Fujisaki, 2004, Recalibration of audiovisual simultaneity, Nature Neuroscience, 7, 773, 10.1038/nn1268 · DOI · Paper page
- Grant, 2000, The use of visible speech cues for improving auditory detection of spoken sentences, The Journal of the Acoustical Society of America, 108, 1197, 10.1121/1.1288668 · DOI · Paper page
- Hairston, 2005, Altered temporal profile of visual–auditory multisensory interactions in dyslexia, Experimental Brain Research, 166, 474, 10.1007/s00221-005-2387-6 · DOI · Paper page
- Helbig, 2007, Optimal integration of shape information from vision and touch, Experimental Brain Research, 179, 595, 10.1007/s00221-006-0814-y · DOI · Paper page
- Hughes, 1994, Visual–auditory interactions in sensorimotor processing: Saccades versus manual responses, Journal of Experimental Psychology: Human Perception and Performance, 20, 131
- Koppen, 2007, Audiovisual asynchrony modulates the Colavita visual dominance effect, Brain Research, 1186, 224, 10.1016/j.brainres.2007.09.076 · DOI
- Laasonen, 2001, Temporal order and processing acuity of visual, auditory, and tactile perception in developmentally dyslexic young adults, Cognitive, Affective & Behavioral Neuroscience, 1, 394, 10.3758/CABN.1.4.394 · DOI
- Laasonen, 2002, Crossmodal temporal order and processing acuity in developmentally dyslexic young adults, Brain and Language, 80, 340, 10.1006/brln.2001.2593 · DOI
- Laasonen, 2000, Rate of information segregation in developmentally dyslexic children, Brain and Language, 75, 66, 10.1006/brln.2000.2326 · DOI
- Lewkowicz, 1986, Developmental changes in infants’ bisensory response to synchronous durations, Infant Behavior & Development, 9, 335, 10.1016/0163-6383(86)90008-1 · DOI
- Lewkowicz, 1992, Infants’ response to temporally based intersensory equivalence: The effect of synchronous sounds on visual preferences for moving stimuli, Infant Behavior & Development, 15, 297, 10.1016/0163-6383(92)80002-C · DOI
- Lewkowicz, 1996, Perception of auditory–visual temporal synchrony in human infants, Journal of Experimental Psychology: Human Perception & Performance, 22, 1094
- Lewkowicz, 2000, Infants’ perception of the audible, visible and bimodal attributes of multimodal syllables, Child Development, 71, 1241, 10.1111/1467-8624.00226 · DOI
- Lovaas, 1971, Selective responding by autistic children to multiple sensory input, Journal of Abnormal Psychology, 77, 211, 10.1037/h0031015 · DOI · Paper page
- Lovelace, 2003, An irrelevant light enhances auditory detection in humans: A psychophysical analysis of multisensory integration in stimulus detection, Brain Research. Cognitive Brain Research, 17, 447, 10.1016/S0926-6410(03)00160-5 · DOI · Paper page
- Noesselt, 2007, Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices, The Journal of Neuroscience, 27, 11431, 10.1523/JNEUROSCI.2252-07.2007 · DOI · Paper page
- Powers, 2009, Perceptual training narrows the temporal window of multisensory binding, The Journal of Neuroscience, 29, 12265, 10.1523/JNEUROSCI.3501-09.2009 · DOI · Paper page
- Schneider, 2008, Enhanced EEG gamma-band activity reflects multisensory semantic matching in visual-to-auditory object priming, Neuroimage, 42, 1244, 10.1016/j.neuroimage.2008.05.033 · DOI
- Senkowski, 2009, Gamma-band activity reflects multisensory matching in working memory, Experimental Brain Research, 198, 363, 10.1007/s00221-009-1835-0 · DOI
- Senkowski, 2007, Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations, Neuropsychologia, 45, 561, 10.1016/j.neuropsychologia.2006.01.013 · DOI · Paper page
- Shams, 2002, Visual illusion induced by sound, Brain Research. Cognitive Brain Research, 14, 147, 10.1016/S0926-6410(02)00069-1 · DOI · Paper page
- Smith, 2007, Audiovisual speech integration and lipreading in autism, Journal of Child Psychology and Psychiatry and Allied Disciplines, 48, 813, 10.1111/j.1469-7610.2007.01766.x · DOI · Paper page
- Spelke, 1979, Perceiving bimodally specified events in infancy, Developmental Psychology, 15, 626, 10.1037/0012-1649.15.6.626 · doi:10.1037/0012-1649.15.6.626 · Paper page
- Tremblay, 2007, Speech and non-speech audio-visual illusions: A developmental study, PLoS One, 2, e742, 10.1371/journal.pone.0000742 · DOI · Paper page
- van Wassenhove, 2005, Visual speech speeds up the neural processing of auditory speech, Proceedings of the National Academy of Sciences of the United States of America, 102, 1181, 10.1073/pnas.0408949102 · DOI · Paper page
- van Wassenhove, 2007, Temporal window of integration in auditory–visual speech perception, Neuropsychologia, 45, 598, 10.1016/j.neuropsychologia.2006.01.001 · DOI · Paper page
- Virsu, 2003, Crossmodal temporal processing acuity impairment aggravates with age in developmental dyslexia, Neuroscience Letters, 336, 151, 10.1016/S0304-3940(02)01253-3 · DOI
- Williams, 2004, Visual–auditory integration during speech imitation in autism, Research in Developmental Disabilities, 25, 559, 10.1016/j.ridd.2004.01.008 · DOI
- Wozny, 2008, Human trimodal perception follows optimal statistical inference, Journal of Vision, 8, 10.1167/8.3.24 · DOI · Paper page
Cited by
Multisensory temporal integration in autism spectrum disorders
Stevenson, R. A., Siemann, J. K., Schneider, B. C., Eberly, H. E., Woynaroski, T. G., Camarata, S. M., & Wallace, M. T. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3615-13.2014 · Cited by 482
“A wider TBW with speech-related stimuli fits with previous lines of work evidencing differential narrowing in the development of the TBW dependent upon the nature of the stimuli used (Hillock et al., 2011), as well as with previous evidence that the synchrony-detection impairments seen in ASD are specific to speech (B…”
BackgroundMethodSelf-citationWallace, M. T., & Stevenson, R. A. (2014) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2014.08.005 · Cited by 315
Self-citationStevenson, R. A., Zemtsov, R. K., & Wallace, M. T. (2012) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0027339 · Cited by 269
Foxe, J. J., Molholm, S., Del Bene, V. A., Frey, H.-P., Russo, N. N., Blanco, D., Saint-Amour, D., & Ross, L. A. (2015) · Cerebral Cortex · doi:10.1093/cercor/bht213 · Cited by 263
Brandwein, A. B., Foxe, J. J., Butler, J. S., Russo, N. N., Altschuler, T. S., Gomes, H., & Molholm, S. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs109 · Cited by 236
“…(Lewkowicz 2003; Neil et al. 2006; Bair et al. 2007; Flom and Bahrick 2007; Gori et al. 2008; Lewkowicz and Ghazanfar 2009; Brandwein et al. 2011; Hillock et al. 2011; Ross et al. 2011; Stein and Rowland 2011), we additionally considered the developmental course of these processes in ASD by…”
Background
Metadata
- Authors
- Hillock, A. R., Powers, A. R., & Wallace, M. T.
- Venue
- Neuropsychologia
- Publisher
- Elsevier BV
- Published
- 2011-02
- Volume
- 49
- Issue
- 3
- Pages
- 461-467
- ISSN
- 0028-3932 (ISSN-L)
- OpenAlex
- W2054690259
- Cited by
- 170
- References
- 17
- FWCI
- 6.79
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Binding of sights and sounds: Age-related changes in multisensory temporal processing. https://app.cochat.ai/papers/10.1016/j.neuropsychologia.2010.11.041
- The paper
- Hillock, A. R., Powers, A. R., & Wallace, M. T. (2011). Binding of sights and sounds: Age-related changes in multisensory temporal processing. Neuropsychologia. https://doi.org/10.1016/j.neuropsychologia.2010.11.041
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.