Temporal modulations in speech and music
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
Speech and music have structured rhythms. Here we discuss a major acoustic correlate of spoken and musical rhythms, the slow (0.25-32Hz) temporal modulations in sound intensity and compare the modulation properties of speech and music. We analyze these modulations using over 25h of speech and over 39h of recordings of Western music. We show that the speech modulation spectrum is highly consistent across 9 languages (including languages with typologically different rhythmic characteristics). A different, but similarly consistent modulation spectrum is observed for music, including classical music played by single instruments of different types, symphonic, jazz, and rock. The temporal modulations of speech and music show broad but well-separated peaks around 5 and 2Hz, respectively. These acoustically dominant time scales may be intrinsic features of speech and music, a possibility which should be investigated using more culturally diverse samples in each domain. Distinct modulation timescales for speech and music could facilitate their perceptual analysis and its neural processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speech Recognition with Primarily Temporal Cues
Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J., & Ekelid, M. (1995) · Science · doi:10.1126/science.270.5234.303 · Cited by 3,024
SWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134
Music, Language, and the Brain
Patel, A. D. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195123753.001.0001 · Cited by 1,945
Self-citationCortical oscillations and speech processing: emerging computational principles and operations
Giraud, A.-L., & Poeppel, D. (2012) · Nature Neuroscience · doi:10.1038/nn.3063 · Cited by 1,917
Self-citationCortical tracking of hierarchical linguistic structures in connected speech
Ding, N., Melloni, L., Zhang, H., Tian, X., & Poeppel, D. (2016) · Nature Neuroscience · doi:10.1038/nn.4186 · Cited by 1,059 · cited 2×
“, 2012) during speech production and in widely distributed cortical areas including auditory cortex during speech perception (Ding et al., 2016; Zion Golumbic et al., 2013).”
Self-citationPhase Patterns of Neuronal Responses Reliably Discriminate Speech in Human Auditory Cortex
Luo, H., & Poeppel, D. (2007) · Neuron · doi:10.1016/j.neuron.2007.06.004 · Cited by 995
Self-citationNeural Processing of Amplitude-Modulated Sounds
JORIS, P. X., SCHREINER, C. E., & REES, A. (2004) · Physiological Reviews · doi:10.1152/physrev.00029.2003 · Cited by 938
Mechanisms underlying selective neuronal tracking of attended speech at a “cocktail party”
Zion Golumbic, E. M., Ding, N., Bickel, S., Lakatos, P., Schevon, C. A., McKhann, G. M., Goodman, R. R., Emerson, R., Mehta, A. D., Simon, J. Z., et al. (2013) · Neuron · doi:10.1016/j.neuron.2012.12.037 · Cited by 909 · cited 3×
“The 2-10 Hz rhythm is prevalent in other aspects of the speech communication chain, observed for example in motor cortex (Ruspantini et al., 2012) and articulator movements (Chandrasekaran et al., 2009; Ghazanfar et al., 2012) during speech production and in widely distributed cortical areas including auditory cortex…”
Self-citationMultiresolution spectrotemporal analysis of complex sounds
Chi, T., Ru, P., & Shamma, S. A. (2005) · The Journal of the Acoustical Society of America · doi:10.1121/1.1945807 · Cited by 673
Houtgast, T., & Steeneken, H. J. M. (1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392224 · Cited by 671
Cited by
A New Unifying Account of the Roles of Neuronal Entrainment
Lakatos, P., Gross, J., & Thut, G. (2019) · Current Biology · doi:10.1016/j.cub.2019.07.075 · Cited by 508
Speech rhythms and their neural foundations
Poeppel, D., & Assaneo, M. F. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0304-4 · Cited by 476
Self-citationKeitel, A., Gross, J., & Kayser, C. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2004473 · Cited by 312
Distinct sensitivity to spectrotemporal modulation supports brain asymmetry for speech and melody
Albouy, P., Benjamin, L., Morillon, B., & Zatorre, R. J. (2020) · Science · doi:10.1126/science.aaz3468 · Cited by 298
Proactive Sensing of Periodic and Aperiodic Auditory Patterns
Rimmele, J. M., Morillon, B., Poeppel, D., & Arnal, L. H. (2018) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2018.08.003 · Cited by 267
Self-citationElectrophysiological Brain Connectivity: Theory and Implementation
He, B., Astolfi, L., Valdes-Sosa, P. A., Marinazzo, D., Palva, S. O., Benar, C.-G., Michel, C. M., & Koenig, T. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2913928 · Cited by 235
Assaneo, M. F., & Poeppel, D. (2018) · Science Advances · doi:10.1126/sciadv.aao3842 · Cited by 164
Self-citationBiological principles for music and mental health
Bowling, D. L. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02671-4 · Cited by 64
“…by music, its primary utility appears to be in processing spoken language, which, despite being less temporally regular than music, is still suf fi ciently regular (between 2 – 8 Hz [120 – 480 bpm] [102]) for entrained oscillations to aid in parsing phonemes, syllables, and phrases [117, 118].”
BackgroundTemporally resolved neural dynamics underlying handwriting
Pei, L., Longcamp, M., Leung, F. K.-S., & Ouyang, G. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118578 · Cited by 23
Language and music phrase boundary processing in Autism Spectrum Disorder: An ERP study
DePriest, J., Glushko, A., Steinhauer, K., & Koelsch, S. (2017) · Scientific Reports · doi:10.1038/s41598-017-14538-y · Cited by 23
Zhu, Y., Powar, S., & Falk, T. H. (2024) · 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW) · doi:10.1109/icasspw62465.2024.10626010 · Cited by 11
“To characterize the long-term dynamics, we propose a method similar to the speech modulation spectrum, widely used in speech applications (e.g., [15, 16]), where we take a short-time Fourier transform (STFT) across the time dimension of the raw feature × time representation.”
MethodHow do listeners time response articulation when answering questions? The role of speech rate.
Corps, R. E., Gambi, C., & Pickering, M. J. (2020) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000759 · Cited by 10
Metadata
- Authors
- Ding, N., Patel, A. D., Chen, L., Butler, H., Luo, C., & Poeppel, D.
- Venue
- Neuroscience & Biobehavioral Reviews
- Publisher
- Elsevier BV
- Published
- 2017-10
- Volume
- 81
- Issue
- Pt B
- Pages
- 181-187
- ISSN
- 0149-7634 (ISSN-L)
- OpenAlex
- W2588767398
- Cited by
- 502
- References
- 62
- FWCI
- 19.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.