The DOI matches its Crossref record.
Intermodal timing relations and audio-visual speech recognition by normal-hearing adults
Abstract
Audio-visual identification of sentences was measured as a function of audio delay in untrained observers with normal hearing; the soundtrack was replaced by rectangular pulses originally synchronized to the closing of the talker’s vocal folds and then subjected to delay. When the soundtrack was delayed by 160 ms, identification scores were no better than when no acoustical information at all was provided. Delays of up to 80 ms had little effect on group-mean performance, but a separate analysis of a subgroup of better lipreaders showed a significant trend of reduced scores with increased delay in the range from 0–80 ms. A second experiment tested the interpretation that, although the main disruptive effect of the delay occurred on a syllabic time scale, better lipreaders might be attempting to use intermodal timing cues at a phonemic level. Normal-hearing observers determined whether a 120-Hz complex tone started before or after the opening of a pair of liplike Lissajou figures. Group-mean difference limens (70.7% correct DLs) were −79 ms (sound leading) and +138 ms (sound lagging), with no significant correlation between DLs and sentence lipreading scores. It was concluded that most observers, whether good lipreaders or not, possess insufficient sensitivity to intermodal timing cues in audio-visual speech for them to be used analogously to voice onset time in auditory speech perception. The results of both experiments imply that delays of up to about 40 ms introduced by signal-processing algorithms in aids to lipreading should not materially affect audio-visual speech understanding.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The onset lag time for dubbing for all tokens was found to be no greater than 9.4 msec, well below the 80-msec range required for observers to detect an audiovisual asynchrony”
From The McGurk effect in infants (1997) · cites this paper as McGrath & Summerfield, 1985
Citations
Cited by
Sorted by citations
Items 101–200 of 201
Discrimination of auditory-visual synchrony.
Grant, K. W., van Wassenhove, V., & Poeppel, D. (2003) · AVSP · Cited by 27
Effects of Spectro-Temporal Asynchrony in Auditory and Auditory-Visual Speech Processing
Grant, K. W., Greenberg, S., Poeppel, D., & van Wassenhove, V. (2004) · Seminars in Hearing · doi:10.1055/s-2004-832858 · Cited by 24
Toward a Model of Auditory-Visual Speech Intelligibility
Grant, K. W., & Bernstein, J. G. W. (2019) · Springer handbook of auditory research · doi:10.1007/978-3-030-10461-0_3 · Cited by 26
Human perception of haptic-to-video and haptic-to-audio skew in multimedia applications
Silva, J. M., Orozco, M., Cha, J., Saddik, A. E., & Petriu, E. M. (2013) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2457450.2457451 · Cited by 24
The influence of synchronous audiovisual distractors on audiovisual temporal order judgments
Vatakis, A., Bayliss, L., Zampini, M., & Spence, C. J. (2007) · Perception & Psychophysics · doi:10.3758/bf03193751 · Cited by 24
“…69 (2), 298-309 A. Vatakis, argiro.vatakis@psy.ox.ac.uk or argiro.vatakis@gmail.com ward the use of more ecologically valid and complex stimuli such as, for example, speech, music, or object actions (see de Gelder & Bertelson, 2003; McGrath & Summerfield, 1985; Vatakis & Spence, 2006a, 2006b).”
BackgroundIntegration and Segregation in Speech Perception
Repp, B. H. (1988) · Language and Speech · doi:10.1177/002383098803100302 · Cited by 23
“Since this auditory component by itself provides virtually no information about phonetic structure, it must be the temporal relationships between the auditory and visual channels that contribute to intelligibility (McGrath and Summerfield, 1985).”
BackgroundLexical Mediation between Sight and Sound in Speechreading
Repp, B. H., Frost, R., & Zsiga, E. C. (1992) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749208401313 · Cited by 22
Development of sensitivity to audiovisual temporal asynchrony during midchildhood.
Kaganovich, N. (2015) · Developmental Psychology · doi:10.1037/dev0000073 · Cited by 25
“This finding dovetails with a well-documented fact in adult literature showing that, overall, adults are more sensitive to AV asynchronies than to VA ones (Bushara et al., 2001; Dixon & Spitz, 1980; Grant et al., 2004; Lewkowicz, 1996; McGrath & Summerfield, 1985; van Wassenhove et al., 2007).”
ResultVisual speech differentially modulates beta, theta, and high gamma bands in auditory cortex
Ganesan, K., Plass, J., Beltz, A. M., Liu, Z., Grabowecky, M., Suzuki, S., Stacey, W. C., Wasade, V. S., Towle, V. L., Tao, J. X., et al. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15482 · Cited by 21
van Eijk, R. L. J., Kohlrausch, A., Juola, J. F., & van de Par, S. (2009) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0014254 · Cited by 19
Can you McGurk yourself? Self-face and self-voice in audiovisual speech
Aruffo, C., & Shore, D. I. (2011) · Psychonomic Bulletin & Review · doi:10.3758/s13423-011-0176-8 · Cited by 20
Audio-visual speech experience with age influences perceived audio-visual asynchrony in speech.
Alm, M., & Behne, D. M. (2013) · Journal of the Acoustical Society of America · doi:10.1121/1.4820798 · Cited by 20
Chapter 16 The development of temporal and spatial intermodal perception
Lewkowicz, D. J. (1999) · Advances in psychology · doi:10.1016/s0166-4115(99)80038-7 · Cited by 17
“Consistent with prior findings (Dixon & Spitz, 1980; McGrath & Summerfield, 1985 ) our results showed that adults needed minimum temporal asynchronies that were considerably lower than those needed by infants for detection (65 ms when the sound preceded the bounce and 112 ms when the sound followed the bounce).”
BackgroundResultAudio-Visual Speech Processing
Chen, B. (2009) · Encyclopedia of Biometrics · doi:10.1007/978-0-387-73003-5_483 · Cited by 16
Laasonen, M. R. (2002) · Työväentutkimus Vuosikirja · Cited by 16
Audio-visual Speech Processing
Campbell, R. (2006) · Elsevier eBooks · doi:10.1016/b0-08-044854-2/00803-8 · Cited by 16
Compensating for low frame rates
Knoche, H., de Meer, H., & Kirsh, D. (2005) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1056808.1056964 · Cited by 15
Automated lip-sync: direct translation of speech-sound to mouth-shape
Koster, B., Rodman, R. D., & Bitzer, D. L. (2002) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.1994.471519 · Cited by 15
Matching heard and seen speech: An ERP study of audiovisual word recognition
Kaganovich, N., Schumaker, J., & Rowland, C. (2016) · Brain and Language · doi:10.1016/j.bandl.2016.04.010 · Cited by 15
“Because facial speech gestures typically precede the onset of sound (e.g., Conrey & Pisoni, 2006; Grant, van Wassenhove, & Poeppel, 2004; McGrath & Summerfield, 1985; but see also Schwartz & Savariaux, 2014; van Wassenhove, Grant, & Poeppel, 2007), they allow listeners to make predictions about the…”
Crossmodal Interaction in Humans
Watanabe, K. (2010) · CaltechTHESIS (California Institute of Technology) · doi:10.7907/66cn-aq26 · Cited by 15
Kaganovich, N., Schumaker, J., & Rowland, C. (2016) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-016-9168-3 · Cited by 14
“In most cases, articulatory movements precede the onset of sound in continuous speech ([17, 35, 61]; but see also [90, 107]).”
Wang, H.-L. S., Chen, I.-C., Chiang, C.-H., Lai, Y.-H., & Tsao, Y. (2016) · Perceptual and Motor Skills · doi:10.1177/0031512516663164 · Cited by 15
“…the link between stress perception and speech recognition in children (Jusczyk, Cutler, & Redanz, 1993; Werker & Yeung, 2005; Wood, 2006) and adults (Fernald & Mazzie, 1991; McGrath & Summerfield, 1985); yet, very few studies have examined similar relationship in children speaking Chinese Mandarin.”
BackgroundCross-Modal Effects in Speech Perception
Keough, M., Derrick, D., & Gick, B. (2018) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-011718-012353 · Cited by 16
“Behavioral studies have shown evidence of superadditivity in audiovisual speech (e.g., McGrath & Summerfield 1985) showing that when perceivers experience audiovisual speech, their responses are more accurate than expected based on the sum of their responses to visual cues and auditory cues in…”
BackgroundAudiovisual Perception of Congruent and Incongruent Dutch Front Vowels
Valkenier, B., Duyne, J. Y., Andringa, T., et al. (2012) · Journal of Speech Language and Hearing Research · doi:10.1044/1092-4388(2012/11-0227 · Cited by 14
Audiovisual robustness: exploring perceptual tolerance to asynchrony and quality distortion
Eg, R., Griwodz, C., Halvorsen, P., & Behne, D. M. (2014) · Multimedia Tools and Applications · doi:10.1007/s11042-014-2136-6 · Cited by 14
“Like previous works have shown [21, 26, 42], asynchrony can be detected at very short thresholds, likely depending on the nature of the audiovisual event.”
BackgroundVatakis, A. (2013) · Wiley eBooks · doi:10.1002/9781118329016.ch10 · Cited by 14
Vatakis, A., & Spence, C. J. (2008) · Perception · doi:10.1068/p5648 · Cited by 13
“…of the change in the PSS was below the lower limit where speech intelligibility starts to decline when normal upright speech is desynchronised (eg McGrath and Summerfield 1985), thus presumably accounting for the fact that speech intelligibility remains high even in the case of face inversion.”
BackgroundAuditory cortex encodes lipreading information through spatially distributed activity
Karthik, G., Cao, C. Z., Demidenko, M. I., Jahn, A., Stacey, W. C., Wasade, V. S., & Brang, D. (2024) · Current Biology · doi:10.1016/j.cub.2024.07.073 · Cited by 13
Detection of Auditory-Visual Asynchrony in Speech and Nonspeech Signals 1
Conrey, B. L., & Pisoni, D. B. (2004) · Cited by 12
Tanaka, A., Asakawa, K., & Imai, H. (2011) · Neuroreport · doi:10.1097/wnr.0b013e32834a2724 · Cited by 12
Spatial and Temporal Features of Multisensory Processes: Bridging Animal and Human Studies
Sarko, D. K., Nidiffer, A. R., Powers, A. R., Ghose, D., Hillock‐Dunn, A., Fister, M. C., Krueger, J., & Wallace, M. T. (2012) · Europe PMC (PubMed Central) · Cited by 14
Future Directions for Hearing Aid Development
Popelka, G. R., & Moore, B. C. J. (2016) · Springer handbook of auditory research · doi:10.1007/978-3-319-33036-5_11 · Cited by 12
Perceived Temporal Order and Simultaneity: Beyond Psychometric Functions
García-Pérez, M. Á., & Alcalá‐Quintana, R. (2018) · BRILL eBooks · doi:10.1163/9789004280205_013 · Cited by 12
“…(i.e., a sample SOA) followed by two other pairs (two more SOAs) and the observer reports in which of the latter two pairs the (a)synchrony was more similar to (or more different from) that of the sample (Hillenbrand, 1984; Liberman et al., 1961; McGrath & Summerfield, 1985; van Eijk et al., 2009).”
ResultContribution of display size to speech intelligibility in videophone systems
Östberg, O., Lindström, B., & Renhäll, P. (1989) · International Journal of Human-Computer Interaction · doi:10.1080/10447318909525963 · Cited by 12
Barthelmess, P., & Oviatt, S. L. (2008) · Elsevier eBooks · doi:10.1016/b978-0-12-374017-5.00012-2 · Cited by 11
The development of audio–visual temporal precision precedes its rapid recalibration
Han, S., Chen, Y., Maurer, D. M., Shore, D. I., Lewis, T. L., Stanley, B. M., & Alais, D. (2022) · Scientific Reports · doi:10.1038/s41598-022-25392-y · Cited by 11
Conveying conversational cues through video
Hanrahan, P., Winograd, T., & Chen, M. R. (2003) · Cited by 9
Spatial and Temporal Features of Multisensory Processes
Sarko, D. K., Nidiffer, A. R., Albert, I. I. I., Ghose, D., Hillock‐Dunn, A., Fister, M. C., Krueger, J., & Wallace, M. T. (2011) · Frontiers in neuroscience · doi:10.1201/9781439812174-15 · Cited by 9
Multimodal input in second-language speech processing
Hardison, D. M. (2020) · Language Teaching · doi:10.1017/s0261444820000592 · Cited by 9
“…(e.g., Benoît, Mohamadi, & Kandel, 1994 for French; MacLeod & Summerfield, 1990 for English), listeners of speech presented in the clear (e.g., McGrath & Summerfield, 1985), infants in their first language (L1) development (e.g., Meltzoff & Moore, 1993), and individuals responding to the…”
BackgroundAudiovisual asynchrony detection for speech and nonspeech signals.
Conrey, B. L., & Pisoni, D. B. (2003) · AVSP · Cited by 9
Optimality and Limitations of Audio-Visual Integration for Cognitive Systems
Boyce, W. P., Lindsay, A., Zgonnikov, A., Rañó, I., & Wong‐Lin, K. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00094 · Cited by 11
“Delays are particularly relevant for feedback control in the motor system and processes like audio-visual speech because different sensory systems are affected by different temporal delays (McGrath and Summerfield, 1985; Jain et al., 2015; Crevecoeur et al., 2016).”
BackgroundAnchoring effects in audiovisual speech perception
Shigeno, S. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1474446 · Cited by 8
Bosman, A. J., & Smoorenburg, G. F. (1997) · International Journal of Audiology · doi:10.3109/00206099709071959 · Cited by 8
Judgments of synchrony between auditory and moving or still visual stimuli.
Fouriezos, G., Capstick, G., Monette, F., Bellemare, C., Parkinson, M., & Dumoulin, A. (2007) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cjep2007028 · Cited by 8
Perception of incongruent audiovisual English consonants
Lalonde, K., & Werner, L. A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0213588 · Cited by 10
Lipreading across multiple views
Lucey, P. (2007) · Faculty of Built Environment and Engineering · Cited by 8
Multisensory Role of Human Auditory Cortex
van Wassenhove, V., & Schroeder, C. E. (2012) · Springer handbook of auditory research · doi:10.1007/978-1-4614-2314-0_11 · Cited by 7
Benard, M. R., & Başkent, D. (2015) · Hearing Research · doi:10.1016/j.heares.2015.06.013 · Cited by 7
Speechreading enhancement using a sinusoidal substitute for voice fundamental frequency
Waldstein, R. S., & Boothroyd, A. (1994) · Speech Communication · doi:10.1016/0167-6393(94)90024-8 · Cited by 7
“It is worth noting that audiovisual asynchronies less than 40 ms do not significantly affect speechreading performance (McGrath and Summerfield, 1985).”
BackgroundPhilip, S. P., Palaniswami, S., & Sivakumar, H. (2020) · Informacije MIDEM - Journal of Microelectronics Electronic Components and Materials · doi:10.33180/infmidem2020.301 · Cited by 5
“Based on the analysis performed on the past research on VLSI signal processing [3-20] and audiology [21-37], the parameters that need to be considered for Filter Bank Design in Digital HA are summarized in Table 1.”
BackgroundMethodThe McGurk effect from single and mixed speaker stimuli
Rosenblum, L. D., & Yakel, D. A. (2001) · Acoustics Research Letters Online · doi:10.1121/1.1366356 · Cited by 5
Prior Pronunciation Knowledge Bootstraps Word Learning
Johnson, K. A., Mellesmoen, G., Lo, R. Y.-H., & Gick, B. (2018) · Frontiers in Communication · doi:10.3389/fcomm.2018.00001 · Cited by 6
“Superadditivity has been evoked in the multimodal sensory literature to account for how information from different senses, such as auditory and visual, combine and lead to greater intelligibility than the sum of their individual inputs (e.g., McGrath and Summerfield, 1985; Iverson et al., 1998).”
BackgroundAudio-visual synchrony perception
Eijk, V. R. R. (2008) · TU/e Research Portal · doi:10.6100/ir634898 · Cited by 5
ADAPTIVE BIMODAL SENSOR FUSION FOR AUTOI/IATIC SPEECHREADING
Meiel, U. (2004) · Cited by 5
Automatic blind source separation of speech sources in an auditory scene
Faller, K. J., Riddley, J., & Grubbs, E. (2017) · 2018 52nd Asilomar Conference on Signals, Systems, and Computers · doi:10.1109/acssc.2017.8335176 · Cited by 4
“It has been shown in [12], [13] that demanding signal processing algorithms may involve significant delays (greater than 20ms) and would cause the audio and visual stimuli to be unsynchronized.”
BackgroundRadeau, M. (1997) · Presses Universitaires de France eBooks · doi:10.3917/puf.prous.1997.01.0223 · Cited by 4
Auer, E. T., & Bernstein, L. E. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.607037 · Cited by 3
“Experiment 2 was conducted to compare modeled LA and L+V with empirically obtained results from McGrath and Summerfield’s [2] Experiment 1.”
BackgroundMethodInfluentialSakamoto, S., Tanaka, A., Tsumura, K., & Suzuki, Y. (2008) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-009-0018-4 · Cited by 2
“temporal window is around 200 ms when an auditory signal lags a visual signal [5–13].”
BackgroundChanges in the McGurk Effect Across Phonetic Contexts
Hampson, M., Guenther, F. H., Cohen, M. A., & Nieto-Castañón, A. (2003) · Cited by 2
Robust visual speech recognition using optical flow analysis and rotation invariant features
Shaikh, A. A. (2012) · RMIT Research Repository (RMIT University Library) · doi:10.25439/rmt.27340062 · Cited by 2
Extremely economical: how key frames affect consonant perception under different audio-visual skews
Knoche, H., de Meer, H., & Kirsh, D. (2006) · VBN Forskningsportal (Aalborg Universitet) · Cited by 2
Philip, S. P., Palaniswami, S., Elango, S., et al. (2024) · Informacije MIDEM - Journal of Microelectronics Electronic Components and Materials · doi:10.33180/infmidem2024.101 · Cited by 1
Recalibration of audiovisual simultaneity in speech.
Tanaka, A., Asakawa, K., & Imai, H. (2009) · AVSP · Cited by 1
Combining Voice and Face Content in the Primate Temporal Lobe
Perrodin, C., & Petkov, C. I. (2019) · Springer handbook of auditory research · doi:10.1007/978-3-030-10461-0_9 · Cited by 1
Unterschiedliche Stimulationszeitpunkte bei bimodaler Versorgung mit Hörgerät und Cochleaimplantat
Zirn, S., Hemmert, W., Roth, S., et al. (2023) · HNO · doi:10.1007/s00106-023-01308-8 · Cited by 1
“bei bimodal Versorgten mit diesen CI-Systemen ist ein ähnlich positiver Effekt durch eine Reduktion des Latenzoffsets ohne negative Begleiterscheinungen zu erwarten, insbesondere da die audiovisuelle Konfusionsschwelle für Alltagssignale deutlich höher als 20ms liegt [21].”
BackgroundStone, M. A., Lough, M., Wilbraham, K., et al. (2023) · Trends in Hearing · doi:10.1177/23312165231182518 · Cited by 1
“Perceptual measures of the effects of audio-visual asynchrony only showed differences over much larger timescales (McGrath & Summerfield, 1985).”
BackgroundInfluentialCharacterising perceptual latency
O'Boyle, D. J. (1999) · Advances in psychology · doi:10.1016/s0166-4115(99)80028-4 · Cited by 1
Spectro-temporal interactions in auditory and auditory-visual speech processing
Grant, K. W., & Greenberg, S. (2003) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.2003-706 · Cited by 1
Tomaskovic, S. (2006) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 1
Zuberbühler, H.-J., Ruegg, S., Krueger, H., et al. (2002) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-004607036 · Cited by 1
“Other studies (Dixon & Spitz, 1980), (McGrath & Summerfield, 1985), (Lewkowicz, 1996) suggest that synchronisation errors are detected easier, the more artificial the presented situation is.”
BackgroundRealising the head-shadow benefit to cochlear implant users
Grange, J. A. (2015) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 1
Johnson, J. A., Rosenblum, L. D., & Schmuckler, M. A. (1995) · The Journal of the Acoustical Society of America · doi:10.1121/1.411551 · Cited by 1
“The onset lag time for dubbing for all tokens was found to be no greater than 9.4 ms, well below the 80 ms range required for observers to detect an audio-visual asynchrony (McGrath and Summerfield, 1985).”
BackgroundInfluentialChatAmp: Talking with Music and Text
Graham, M., & Karahalios, K. G. (2005) · Lecture notes in computer science · doi:10.1007/11555261_84 · Cited by 1
“It is easier for a user to detect the effects of his activity if feedback is received through both visual and auditory information, and if these two are in concert then the outcome should be further improved [4].”
BackgroundAdmission control for independently-authored realtime applications
Kroeger, R. (2005) · Cited by 1
Audiovisual spatial congruence, and applications to 3D sound and stereoscopic video
André, C. (2014) · ORBi (University of Liège) · Cited by 1
Infants' perception of the audible, visible and bimodal attributes of talking and singing faces.
Lewkowicz, D. J. (1999) · AVSP · Cited by 1
Quality aspects of multimodal communication: user perception and acceptance thresholds
Zuberbühler, H.-J. (2003) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-004583162 · Cited by 1
Crossmodal displays : coordinated crossmodal cues for information provision in public spaces
Cao, H. (2013) · Cited by 1
Speech perception in virtual environments
Verwey, J. (2005) · Open University of Cape Town (University of Cape Town)
The impact of spectrally asynchronous delay on the intelligibility of conversational speech
Ortmann, A. J. (2012) · D-Scholarship@Pitt (University of Pittsburgh)
El sistema perceptivo: esa pequeña máquina del tiempo
Velasco, I., Spence, C. J., & Navarra, J. (2011) · Digitum: Institutional Repository of the University of Murcia (University of Murcia)
Curtindale, L. M. (2013) · KU ScholarWorks (University of Kansas)
Interactions of Attention, Stimulus Conflict, and Multisensory Processing
Donohue, S. E. (2012) · DukeSpace (Duke University)
Jaime, M. (2007) · doi:10.25148/etd.fi08081526
“…a bouncing audio-visual event as temporally synchronous with an ITCW of approximately 65-80 milliseconds, provided the sound comes before the visible bounce and 112-140 milliseconds if the sound follows the visible bounce (see Lewkowicz, 1996; McGrath & Summerfield, 1985; Summerfield, 1979).”
BackgroundMasking Effect of Out-of-sync News Content with Different Distractors
Buchinger, S. (2011) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2011.86
“Some experiments focus on speech recognition where the subjects were asked to write down entire sentences they have listened to [11], [12].”
BackgroundHirayama, T., Shoji, H., & Ozaki, H. (2012) · ICME International Conference on Complex Medical Engineering (CME) · doi:10.1109/iccme.2012.6275699
Auditory processing in the brainstem and audiovisual integration in humans studied with fMRI
Slabu, L. (2008) · University of Groningen research database (University of Groningen / Centre for Information Technology)
Watching music : the effects of contrast, context and familiarity on the visual perception of music
Gurr, P. (1996) · Summit (Simon Fraser University)
Attributes of Multimodal Syllables
Lewkowicz, J. (2000)
Temporal factors in the electrophysiological markers of audiovisual speech integration.
Pilling, M., & Thomas, S. M. (2007)
Narrowing the Window: Multisensory Perceptual Learning and its Neural Correlates
Powers, A. R. (2010)
(2018) · BRILL eBooks · doi:10.1163/9789004280205_001
Watanabe, T., & Shibata, K. (2012) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.13435956.14810054
(2004) · Kluwer Academic Publishers eBooks · doi:10.1007/b116723
Auer, E. T., & Bernstein, L. E. (1996) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1996-22
Munro, M. J. (2020) · Wiley eBooks · doi:10.1002/9781394259786.oth2
Primitive audiovisual integration of speech
Remez, R. E., Dubowski, K. R., Ferro, D. F., & Thomas, E. F. (2025) · Attention Perception & Psychophysics · doi:10.3758/s13414-025-03038-1
“…used sampled video and synthesized audio in which the unimodal properties had been calibrated to be poorly intelligible, ensuring that the intelligibility of audiovisual combination was a consequence of sensory integration (cf. Rosen et al., 1981; McGrath & Summerfield, 1985; Summerfield 1992).”
Functional specialisation of multisensory temporal integration in the mouse superior colliculus
Bianchini, G., Razafindrahaba, I., Moglie, M. J., Konstantinou, G., Cano-Ferrer, X., Imbert, A., & Iacaruso, M. F. (2025) · Nature Communications · doi:10.1038/s41467-025-64600-x · Cited by 1
Wen, Z. (2004) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Explaining and Deflating the Perceived Unity of Time
Pedersen, R. (2026) · Review of Philosophy and Psychology · doi:10.1007/s13164-026-00830-2
“…ignore lags between auditory and visual cues and temporally bind them into an audiovisual perception (on average, lags are not detected even when the soundtrack lags lip movement by ~ 140 ms or leads it by ~ 80 ms) (Dixon & Spitz, 1980; Hashimoto & Kumashiro, 2004 ; McGrath & Summerfield, 1985).”
Metadata
- Authors
- McGrath, M., & Summerfield, Q.
- Affiliations
- University of Nottingham (GB)
- MRC Institute of Hearing Research, University of Nottingham, Nottingham NG7 2RD, England
- Venue
- The Journal of the Acoustical Society of America
- Publisher
- Acoustical Society of America (ASA)
- Published
- 1985-02-01
- Volume
- 77
- Issue
- 2
- Pages
- 678-685
- ISSN
- 0001-4966 (ISSN-L)
- 1520-8524
- OpenAlex
- W1996803179
- Cited by
- 201
- References
- 0
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 2 · 2023: 2 · 2022: 1 · 2021: 1 · 2020: 4 · 2019: 3 · 2018: 8 · 2017: 3 · 2016: 5 · 2015: 7 · 2014: 7 · 2013: 6 · 2012: 12
- FWCI
- 1.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of the Acoustical Society of America (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Multisensory perception and integration
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Keywords
- audio-visual speech recognition, lip reading, audio delay, voice onset time, just noticeable difference, sentence identification, normal hearing adults
- MeSH terms
- Adult, Auditory Perception, Humans, Lipreading, Middle Aged, Time Factors, Visual Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
