Uncoupling Between Multisensory Temporal Function and Nonverbal Turn-Taking in Autism Spectrum Disorder
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
The integration of information across distinct modalities enhances perceptual abilities. An ecologically important role of multisensory integration is in scaffolding verbal communication, which relies upon the precise temporal integration of auditory and visual cues. However, the role of (multi)sensory function in supporting another important aspect of communication, namely, nonverbal communication, is unknown. Here, individuals with autism spectrum disorder (ASD) and a group of typically developing (TD) participants performed a simultaneity judgment task to index their audiovisual temporal acuity for speech stimuli. Further, under a naturalistic scenario, nonverbal synchrony between the participant and a naïve experimenter was measured. Automated motion analysis was performed to quantify movements of different body-parts. Results demonstrate a wider window of audiovisual temporal integration for ASD participants in comparison to their TD counterparts. Moreover, ASD individuals performed less complex movements and demonstrated less nonverbal synchrony during the interactive exchange. Lastly, multisensory temporal acuity significantly predicted the synchrony in hand and head movements between TD participants and the experimenter, but not between the ASD participants and the experimenter. Taken together, the results suggest an important role for multisensory perceptual abilities in shaping nonverbal communication between dyads and highlight the important role of perceptual systems in supporting social interactive skills.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The cultural nature of human development
(2003) · Choice Reviews Online · doi:10.5860/choice.41-1244 · Cited by 5,250
Humans integrate visual and haptic information in a statistically optimal fashion
Ernst, M. O., & Banks, M. S. (2002) · Nature · doi:10.1038/415429a · Cited by 4,844
Collective action and the evolution of social norms.
Ostrom, E. (2000) · Journal of Economic Perspectives · doi:10.1257/jep.14.3.137 · Cited by 4,195
Baron-Cohen, S., & Wheelwright, S. (2004) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000022607.19833.00 · Cited by 4,093
Effective leadership and decision-making in animal groups on the move
Couzin, I. D., Krause, J., Franks, N. R., & Levin, S. A. (2005) · Nature · doi:10.1038/nature03236 · Cited by 2,753 · cited 1×
“Although we implicitly assume that higherlevel cognitive abilities (such as social communication) are scaffolded upon sensory systems [22], [23], we are missing”
A Meta-Analysis of Factors Affecting Trust in Human-Robot Interaction
Hancock, P. A., Billings, D. R., Schaefer, K. E., Chen, J. Y. C., de Visser, E. J., & Parasuraman, R. (2011) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811417254 · Cited by 2,051 · cited 1×
“While the automation accompanying the widespread introduction of robots into our daily lives certainly holds great promise, this occurrence will pose a number of significant challenges [6], [7].”
BackgroundThe Ventriloquist Effect Results from Near-Optimal Bimodal Integration
Alais, D., & Burr, D. (2004) · Current Biology · doi:10.1016/j.cub.2004.01.029 · Cited by 1,936
Socially intelligent robots: Dimensions of human-robot interaction
Dautenhahn, K. (2007) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2006.2004 · Cited by 1,210 · cited 1×
“Further, these devices, which are becoming increasingly human-like [3], are expected to become an integral part of our social landscape as they permeate our homes and offices [4], [5].”
BackgroundWhen the world becomes ‘too real’: a Bayesian explanation of autistic perception
Pellicano, E., & Burr, D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.08.009 · Cited by 1,156 · cited 2×
“These results are in line with recent “hypo-prior” accounts of ASD [76], [77], which suggest that ASD may be rooted in a fundamental inability to use sensory evidence to build a strong representation of prior”
ResultSensory Processing in Autism: A Review of Neurophysiologic Findings
MARCO, E. J., HINKLEY, L. B. N., HILL, S. S., & NAGARAJAN, S. S. (2011) · Pediatric Research · doi:10.1203/pdr.0b013e3182130c54 · Cited by 1,112 · cited 1×
“presence of sensory and multisensory abnormalities in these patients is increasingly recognized [29], as highlighted by the inclusion of sensory features as a core diagnostic element”
BackgroundDefining the social deficits of autism: the contribution of non-verbal communication measures
Mundy, P., Sigman, M., Ungerer, J., & Sherman, T. (1986) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1986.tb00190.x · Cited by 956
Two-year-olds with autism orient to non-social contingencies rather than biological motion
Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., & Jones, W. (2009) · Nature · doi:10.1038/nature07868 · Cited by 921
Precise minds in uncertain worlds: Predictive coding in autism.
Van de Cruys, S., Evers, K., Van der Hallen, R., Van Eylen, L., Boets, B., de-Wit, L., & Wagemans, J. (2014) · Psychological Review · doi:10.1037/a0037665 · Cited by 885 · cited 2×
“These results are in line with recent “hypo-prior” accounts of ASD [76], [77], which suggest that ASD may be rooted in a fundamental inability to use sensory evidence to build a strong representation of prior”
ResultRamseyer, F., & Tschacher, W. (2011) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0023419 · Cited by 754 · cited 1×
“including sociocommunicative gains [61], [62].”
Involvement or isolation? The social networks of children with autism in regular classrooms
Chamberlain, B., Kasari, C., & Rotheram-Fuller, E. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0164-4 · Cited by 550
Multisensory temporal integration in autism spectrum disorders
Stevenson, R. A., Siemann, J. K., Schneider, B. C., Eberly, H. E., Woynaroski, T. G., Camarata, S. M., & Wallace, M. T. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.3615-13.2014 · Cited by 482 · cited 5×
“A critical feature of multisensory integration is the appropriate segregation and binding of sensory information in the temporal domain [39], [40], and it is in this domain that abnormalities in ASD are typically observed [41]–[43].”
BackgroundInfluentialSelf-citationAn extended multisensory temporal binding window in autism spectrum disorders
Foss-Feig, J. H., Kwakye, L. D., Cascio, C. J., Burnette, C. P., Kadivar, H., Stone, W. L., & Wallace, M. T. (2010) · Experimental Brain Research · doi:10.1007/s00221-010-2240-4 · Cited by 411
A two-month field trial in an elementary school for long-term human–robot interaction
Kanda, T., Sato, R., Saiwaki, N., & Ishiguro, H. (2007) · IEEE Transactions on Robotics · doi:10.1109/tro.2007.904904 · Cited by 397
Baum, S. H., Stevenson, R. A., & Wallace, M. T. (2015) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2015.09.007 · Cited by 370 · cited 4×
“ASD [31], [32], [41], [51], here, we found a lack of relationship between multisensory temporal acuity and nonverbal synchrony in our ASD participants (a relationship that was”
BackgroundInfluentialSelf-citationRedcay, E. (2008) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2007.06.004 · Cited by 349
Robots at home: Understanding long-term human-robot interaction
Kidd, C. D., & Breazeal, C. (2008) · 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2008.4651113 · Cited by 332
Altered auditory and multisensory temporal processing in autism spectrum disorders
Kwakye, L. D., Foss-Feig, J. H., Cascio, C. J., Stone, W. L., & Wallace, M. T. (2011) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2010.00129 · Cited by 311
Self-citationReliability and validity of the Wisconsin Card Sorting Test in studies of autism.
Ozonoff, S. (1995) · Neuropsychology · doi:10.1037/0894-4105.9.4.491 · Cited by 293
Klin, A., Lang, J., Cicchetti, D. V., & Volkmar, F. R. (2000) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005415823867 · Cited by 225
Ramseyer, F., & Tschacher, W. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00979 · Cited by 210 · cited 1×
“That is, [87] indicated that while dyadic synchronization of distal body parts (in particular the head) predict long-term and permanent outcomes of”
BackgroundAbnormal adaptive face-coding mechanisms in children with autism spectrum disorder
Pellicano, E., Jeffery, L., Burr, D., & Rhodes, G. (2007) · Current Biology · doi:10.1016/j.cub.2007.07.065 · Cited by 184 · cited 1×
“history about the sensory world (see [42], [43], [78], [79] for recent empirical evidence in this regard).”
BackgroundPrediction of Turn-Ends Based on Anticipation of Upcoming Words
Magyari, L., & de Ruiter, J. P. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00376 · Cited by 154 · cited 1×
“exquisitely precise in time [54], [55], and reflects a social cooperative coupling, that is, central to efficient information transfer [56]—particularly in human communication [57].”
BackgroundMultisensory speech perception in children with autism spectrum disorders
Woynaroski, T. G., Kwakye, L. D., Foss-Feig, J. H., Stevenson, R. A., Stone, W. L., & Wallace, M. T. (2013) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-013-1836-5 · Cited by 148
Self-citationThe spatial self in schizophrenia and autism spectrum disorder
Noel, J.-P., Cascio, C. J., Wallace, M. T., & Park, S. (2017) · Schizophrenia Research · doi:10.1016/j.schres.2016.09.021 · Cited by 120 · cited 4×
“, enlarged TBW; replicating prior work, [32], [35]), and most strikingly,”
BackgroundResultInfluentialSelf-citationAtypical rapid audio‐visual temporal recalibration in autism spectrum disorders
Noel, J., De Niear, M. A., Stevenson, R., Alais, D., & Wallace, M. T. (2017) · Autism Research · doi:10.1002/aur.1633 · Cited by 113 · cited 3×
“history about the sensory world (see [42], [43], [78], [79] for recent empirical evidence in this regard).”
BackgroundSelf-citationNo rapid audiovisual recalibration in adults on the autism spectrum
Turi, M., Karaminis, T., Pellicano, E., & Burr, D. (2016) · Scientific Reports · doi:10.1038/srep21756 · Cited by 84 · cited 1×
“history about the sensory world (see [42], [43], [78], [79] for recent empirical evidence in this regard).”
Background
Cited by
Gonçalves, A. M., & Monteiro, P. (2023) · Journal of Neural Transmission · doi:10.1007/s00702-023-02595-9 · Cited by 88
Audio-visual sensory deprivation degrades visuo-tactile peri-personal space
Noel, J.-P., Park, H.-D., Pasqualini, I., Lissek, H., Wallace, M., Blanke, O., & Serino, A. (2018) · Consciousness and Cognition · doi:10.1016/j.concog.2018.04.001 · Cited by 42
Self-citationTemporal binding of social events less pronounced in individuals with Autism Spectrum Disorder
Vogel, D. H. V., Jording, M., Esser, C., Conrad, A., Weiss, P. H., & Vogeley, K. (2022) · Scientific Reports · doi:10.1038/s41598-022-19309-y · Cited by 15
Metadata
- Authors
- Noel, J.-P., De Niear, M. A., Lazzara, N. S., & Wallace, M. T.
- Venue
- IEEE Transactions on Cognitive and Developmental Systems
- Published
- 2018-12
- Volume
- 10
- Issue
- 4
- Pages
- 973-982
- ISSN
- 2379-8920 (ISSN-L)
- 2379-8939
- OpenAlex
- W2779247516
- Cited by
- 68
- References
- 31
- FWCI
- 7.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.