Cortical Representation of Natural Complex Sounds: Effects of Acoustic Features and Auditory Object Category
Open accessThe DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Abstract
How the brain processes complex sounds, like voices or musical instrument sounds, is currently not well understood. The features comprising the acoustic profiles of such sounds are thought to be represented by neurons responding to increasing degrees of complexity throughout auditory cortex, with complete auditory “objects” encoded by neurons (or small networks of neurons) in anterior superior temporal regions. Although specialized voice and speech–sound regions have been proposed, it is unclear how other types of complex natural sounds are processed within this object-processing pathway. Using functional magnetic resonance imaging, we sought to demonstrate spatially distinct patterns of category-selective activity in human auditory cortex, independent of semantic content and low-level acoustic features. Category-selective responses were identified in anterior superior temporal regions, consisting of clusters selective for musical instrument sounds and for human speech. An additional subregion was identified that was particularly selective for the acoustic–phonetic content of speech. In contrast, regions along the superior temporal plane closer to primary auditory cortex were not selective for stimulus category, responding instead to specific acoustic features embedded in natural sounds, such as spectral structure and temporal modulation. Our results support a hierarchical organization of the anteroventral auditory-processing stream, with the most anterior regions representing the complete acoustic signature of auditory objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The cortical organization of speech processing
Hickok, G., & Poeppel, D. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2113 · Cited by 5,495 · cited 2×
“, 2005), and this temporal fidelity is argued to be the basis of LAC preference for language (Zatorre et al., 2002; Tallal and Gaab, 2006; Hickok and Poeppel, 2007).”
BackgroundForman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910330508 · Cited by 3,202 · cited 2×
“05 using Monte Carlo simulations (a means of estimating the rate of false-positive voxels) (Forman et al., 1995).”
MethodInfluentialAnalysis of fMRI Time-Series Revisited
Friston, K. J., Holmes, A. P., Poline, J.-B., Grasby, P. J., Williams, S. C. R., Frackowiak, R. S. J., & Turner, R. (1995) · NeuroImage · doi:10.1006/nimg.1995.1007 · Cited by 2,502
Repetition and the brain: neural models of stimulus-specific effects
Grill-Spector, K., Henson, R., & Martin, A. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.11.006 · Cited by 2,256 · cited 3×
“To do this, we used the fMRI repetition adaptation phenomenon (Belin and Zatorre, 2003; Grill-Spector et al., 2006; Sawamura et al., 2006).”
BackgroundMethodVoice-selective areas in human auditory cortex
Belin, P., Zatorre, R. J., Lafaille, P., Ahad, P., & Pike, B. (2000) · Nature · doi:10.1038/35002078 · Cited by 1,771
Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing
Rauschecker, J. P., & Scott, S. K. (2009) · Nature Neuroscience · doi:10.1038/nn.2331 · Cited by 1,766
Self-citationObject-related activity revealed by functional magnetic resonance imaging in human occipital cortex.
Malach, R., Reppas, J. B., Benson, R. R., Kwong, K. K., Jiang, H., Kennedy, W. A., Ledden, P. J., Brady, T. J., Rosen, B. R., & Tootell, R. B. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.18.8135 · Cited by 1,761
Structure and function of auditory cortex: music and speech
Zatorre, R. J., Belin, P., & Penhune, V. B. (2002) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01816-7 · Cited by 1,586
The lateral occipital complex and its role in object recognition
Grill-Spector, K., Kourtzi, Z., & Kanwisher, N. (2001) · Vision Research · doi:10.1016/s0042-6989(01)00073-6 · Cited by 1,406
Mechanisms and streams for processing of “what” and “where” in auditory cortex
Rauschecker, J. P., & Tian, B. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.22.11800 · Cited by 1,397
Self-citationHuman temporal lobe activation by speech and nonspeech sounds
Binder, J. R. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.5.512 · Cited by 1,345 · cited 4×
“Furthermore, vocalization-selective activation (Binder et al., 2000; Thierry et al., 2003; Altmann et al., 2007; Doehrmann et al., 2008; Engel et al., 2009) may not be indicative of semantic category representations per se, but instead of a dominant acoustic profile common to vocalizations (e.”
BackgroundInfluentialSpectral and Temporal Processing in Human Auditory Cortex
Zatorre, R. J. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.10.946 · Cited by 1,278
Identification of a pathway for intelligible speech in the left temporal lobe
Scott, S. K. (2000) · Brain · doi:10.1093/brain/123.12.2400 · Cited by 1,160
Boersma, P. (1993) · Cited by 1,046
Representation of Perceived Object Shape by the Human Lateral Occipital Complex
Kourtzi, Z., & Kanwisher, N. (2001) · Science · doi:10.1126/science.1061133 · Cited by 896
Hierarchical Processing in Spoken Language Comprehension
Davis, M. H., & Johnsrude, I. S. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-08-03423.2003 · Cited by 772
Functional Specialization in Rhesus Monkey Auditory Cortex
Tian, B., Reser, D., Durham, A., Kustov, A., & Rauschecker, J. P. (2001) · Science · doi:10.1126/science.1058911 · Cited by 728
Self-citationMultidimensional perceptual scaling of musical timbres
Grey, J. M. (1977) · The Journal of the Acoustical Society of America · doi:10.1121/1.381428 · Cited by 726
The Processing of Temporal Pitch and Melody Information in Auditory Cortex
Patterson, R. D., Uppenkamp, S., Johnsrude, I. S., & Griffiths, T. D. (2002) · Neuron · doi:10.1016/s0896-6273(02)01060-7 · Cited by 720
The planum temporale as a computational hub
Griffiths, T. D., & Warren, J. D. (2002) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)02191-4 · Cited by 640
Distinct functional substrates along the right superior temporal sulcus for the processing of voices
Kriegstein, K. V., & Giraud, A.-L. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.02.020 · Cited by 630
The neuronal representation of pitch in primate auditory cortex
Bendor, D., & Wang, X. (2005) · Nature · doi:10.1038/nature03867 · Cited by 626
Who “Is Saying What”? Brain-based decoding of human voice and speech
Formisano, E., De Martino, F., Bonte, M., & Goebel, R. (2008) · Science · doi:10.1126/science.1164318 · Cited by 599 · cited 1×
“Moreover, there is a relative lack of category-specific differentiation within this anteroventral pathway, which has led others to stress the importance of distributed representations of auditory objects (Formisano et al., 2008; Staeren et al., 2009).”
BackgroundHierarchical and asymmetric temporal sensitivity in human auditory cortices
Boemio, A., Fromm, S., Braun, A., & Poeppel, D. (2005) · Nature Neuroscience · doi:10.1038/nn1409 · Cited by 582
Separate Face and Body Selectivity on the Fusiform Gyrus
Schwarzlose, R. F., Baker, C. I., & Kanwisher, N. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2621-05.2005 · Cited by 512
Domain Specificity in Visual Cortex
Downing, P. E., Chan, A. W.-Y., Peelen, M. V., Dodds, C. M., & Kanwisher, N. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj086 · Cited by 509
Griffiths, T. D., & Warren, J. D. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1538 · Cited by 508
Probabilistic Mapping and Volume Measurement of Human Primary Auditory Cortex
Rademacher, J., Morosan, P., Schormann, T., Schleicher, A., Werner, C., Freund, H.-J., & Zilles, K. (2001) · NeuroImage · doi:10.1006/nimg.2000.0714 · Cited by 503
Wessinger, C. M., VanMeter, J., Tian, B., Van Lare, J., Pekar, J., & Rauschecker, J. P. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/089892901564108 · Cited by 453
Self-citationNeural Substrates of Phonemic Perception
Liebenthal, E., Binder, J. R., Spitzer, S. M., Possing, E. T., & Medler, D. A. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi040 · Cited by 440
Adaptation to speaker’s voice in right anterior temporal lobe
Belin, P., & Zatorre, R. J. (2003) · NeuroReport · doi:10.1097/00001756-200311140-00019 · Cited by 414
A voice region in the monkey brain
Petkov, C. I., Kayser, C., Steudel, T., Whittingstall, K., Augath, M., & Logothetis, N. K. (2008) · Nature Neuroscience · doi:10.1038/nn2043 · Cited by 403
Task-modulated “what” and “where” pathways in human auditory cortex
Ahveninen, J., Jääskeläinen, I. P., Raij, T., Bonmassar, G., Devore, S., Hämäläinen, M., Levänen, S., Lin, F.-H., Sams, M., Shinn-Cunningham, B. G., et al. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0510480103 · Cited by 362
Species-specific calls evoke asymmetric activity in the monkey's temporal poles
Poremba, A., Malloy, M., Saunders, R. C., Carson, R. E., Herscovitch, P., & Mishkin, M. (2004) · Nature · doi:10.1038/nature02268 · Cited by 355
Structural and functional asymmetry of lateral Heschl's gyrus reflects pitch perception preference
Schneider, P., Sluming, V., Roberts, N., Scherg, M., Goebel, R., Specht, H. J., Dosch, H. G., Bleeck, S., Stippich, C., & Rupp, A. (2005) · Nature Neuroscience · doi:10.1038/nn1530 · Cited by 353
Dynamic auditory processing, musical experience and language development
Tallal, P., & Gaab, N. (2006) · Trends in Neurosciences · doi:10.1016/j.tins.2006.06.003 · Cited by 348
Sawamura, H., Orban, G. A., & Vogels, R. (2006) · Neuron · doi:10.1016/j.neuron.2005.11.028 · Cited by 336
Distinct Cortical Pathways for Processing Tool versus Animal Sounds
Lewis, J. W., Brefczynski, J. A., Phinney, R. E., Janik, J. J., & DeYoe, E. A. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0419-05.2005 · Cited by 327
Analysis of temporal structure in sound by the human brain
Griffiths, T. D., Büchel, C., Frackowiak, R. S. J., & Patterson, R. D. (1998) · Nature Neuroscience · doi:10.1038/1637 · Cited by 314
Helmholtz, H. L. F. (1998) · Cited by 312
Behavioral and neural correlates of perceived and imagined musical timbre
Halpern, A. R., Zatorre, R. J., Bouffard, M., & Johnson, J. A. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2003.12.017 · Cited by 282
Penagos, H., Melcher, J. R., & Oxenham, A. J. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.0383-04.2004 · Cited by 266
Distinct unimodal and multimodal regions for word processing in the left temporal cortex
Cohen, L., Jobert, A., Le Bihan, D., & Dehaene, S. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.07.052 · Cited by 264
Schönwiesner, M., & Zatorre, R. J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0907682106 · Cited by 251
Bilateral Speech Comprehension Reflects Differential Sensitivity to Spectral and Temporal Features
Obleser, J., Eisner, F., & Kotz, S. A. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.1290-08.2008 · Cited by 249
Tonotopic Organization of the Auditory Cortex: Pitch Versus Frequency Representation
Pantev, C., Hoke, M., Lütkenhöner, B., & Lehnertz, K. (1989) · Science · doi:10.1126/science.2814476 · Cited by 247
Defining a left-lateralized response specific to intelligible speech using fMRI
Narain, C. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg083 · Cited by 246 · cited 2×
“Previous studies have implicated the STS in speech processing (Binder et al., 2000; Scott et al., 2000, 2006; Davis and Johnsrude, 2003; Narain et al., 2003; Thierry et al., 2003), with adaptation to whole words occurring 12–25 mm more anterior to the region we report here (Cohen et al., 2004;…”
BackgroundRelating Structure to Function: Heschl's Gyrus and Acoustic Processing
Warrier, C., Wong, P., Penhune, V., Zatorre, R., Parrish, T., Abrams, D., & Kraus, N. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.3489-08.2009 · Cited by 244
Schönwiesner, M., Rübsamen, R., & Von Cramon, D. Y. (2005) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2005.04315.x · Cited by 244
Processing of Band-Passed Noise in the Lateral Auditory Belt Cortex of the Rhesus Monkey
Rauschecker, J. P., & Tian, B. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00834.2003 · Cited by 199
Self-citationLangner, G., Sams, M., Heil, P., & Schulze, H. (1997) · Journal of Comparative Physiology A: Sensory, Neural, and Behavioral Physiology · doi:10.1007/s003590050148 · Cited by 196
Sound Categories Are Represented as Distributed Patterns in the Human Auditory Cortex
Staeren, N., Renvall, H., De Martino, F., Goebel, R., & Formisano, E. (2009) · Current Biology · doi:10.1016/j.cub.2009.01.066 · Cited by 188
Bendor, D., & Wang, X. (2008) · Journal of Neurophysiology · doi:10.1152/jn.00884.2007 · Cited by 186
Is voice processing species-specific in human auditory cortex? An fMRI study
Fecteau, S., Armony, J. L., Joanette, Y., & Belin, P. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.09.019 · Cited by 182
Speech-specific auditory processing: where is it?
Price, C. J., Thierry, G., & Griffiths, T. D. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.03.009 · Cited by 178
Sensitivity to Auditory Object Features in Human Temporal Neocortex
Zatorre, R. J., Bouffard, M., & Belin, P. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.5458-03.2004 · Cited by 176
Processing of Frequency-Modulated Sounds in the Lateral Auditory Belt Cortex of the Rhesus Monkey
Tian, B., & Rauschecker, J. P. (2004) · Journal of Neurophysiology · doi:10.1152/jn.00472.2003 · Cited by 168
Self-citationMultiple Stages of Auditory Speech Perception Reflected in Event-Related fMRI
Obleser, J., Zimmermann, J., Van Meter, J., & Rauschecker, J. P. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl133 · Cited by 168
Self-citationUnraveling the principles of auditory cortical processing: can we learn from the visual system?
King, A. J., & Nelken, I. (2009) · Nature Neuroscience · doi:10.1038/nn.2308 · Cited by 164
Pitch Processing Sites in the Human Auditory Brain
Hall, D. A., & Plack, C. J. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhn108 · Cited by 163
Coding of visual objects in the ventral stream
Reddy, L., & Kanwisher, N. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.06.004 · Cited by 162
Cortical representations of pitch in monkeys and humans
Bendor, D., & Wang, X. (2006) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2006.07.001 · Cited by 160
Analysis of the spectral envelope of sounds by the human brain
Warren, J. D., Jennings, A. R., & Griffiths, T. D. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.031 · Cited by 160
Scott, S. K., Rosen, S., Lang, H., & Wise, R. J. S. (2006) · The Journal of the Acoustical Society of America · doi:10.1121/1.2216725 · Cited by 152
Auditory processing — speech, space and auditory objects
Scott, S. K. (2005) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2005.03.009 · Cited by 149
Hemispheric Dissociation in Access to the Human Semantic System
Thierry, G., Giraud, A., & Price, C. J. (2003) · Neuron · doi:10.1016/s0896-6273(03)00199-5 · Cited by 143
Petersson, K. M., Nichols, T. E., Poline, J.-B., & Holmes, A. P. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0477 · Cited by 129
Different categories of living and non-living sound-sources activate distinct cortical networks
Engel, L. R., Frum, C., Puce, A., Walker, N. A., & Lewis, J. W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.041 · Cited by 119
Architectonic analysis of the auditory‐related areas of the superior temporal region in human brain
Fullerton, B. C., & Pandya, D. Ν. (2007) · The Journal of Comparative Neurology · doi:10.1002/cne.21432 · Cited by 116
Lewis, J. W., Talkington, W. J., Walker, N. A., Spirou, G. A., Jajosky, A. N., Frum, C., & Brefczynski‐Lewis, J. A. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.4145-08.2009 · Cited by 110
Encoding of Spectral Correlation over Time in Auditory Cortex
Overath, T., Kumar, S., von Kriegstein, K., & Griffiths, T. D. (2008) · Journal of Neuroscience · doi:10.1523/jneurosci.4596-08.2008 · Cited by 102
Serial and parallel processing in the primate auditory cortex revisited
Recanzone, G. H., & Cohen, Y. E. (2010) · Behavioural Brain Research · doi:10.1016/j.bbr.2009.08.015 · Cited by 97
Auditory stream segregation relying on timbre involves left auditory cortex
Deike, S., Gaschler‐Markefski, B., Brechmann, A., & Scheich, H. (2004) · Neuroreport · doi:10.1097/01.wnr.0000132919.12990.34 · Cited by 82
Probing category selectivity for environmental sounds in the human auditory brain
Doehrmann, O., Naumer, M. J., Volz, S., Kaiser, J., & Altmann, C. F. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.05.011 · Cited by 70
Selectivity for Animal Vocalizations in the Human Auditory Cortex
Altmann, C. F., Doehrmann, O., & Kaiser, J. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl167 · Cited by 69
Repetition Suppression and Reactivation in Auditory–Verbal Short-Term Recognition Memory
Buchsbaum, B. R., & D'Esposito, M. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn186 · Cited by 65
Vowel-specific mismatch responses in the anterior superior temporal gyrus: An fMRI study
Leff, A. P., Iverson, P., Schofield, T. M., Kilner, J. M., Crinion, J. T., Friston, K. J., & Price, C. J. (2009) · Cortex · doi:10.1016/j.cortex.2007.10.008 · Cited by 42
Cited by
Price, C. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.062 · Cited by 2,159
The cortical language circuit: from auditory perception to sentence comprehension
Friederici, A. D. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2012.04.001 · Cited by 748
Kell, A. J. E., Yamins, D. L. K., Shook, E. N., Norman-Haignere, S. V., & McDermott, J. H. (2018) · Neuron · doi:10.1016/j.neuron.2018.03.044 · Cited by 544
“…our evidence for hierarchical cortical organization is simply a reflection of the music and speech selectivity previously reported in non-primary auditory cortex (Angulo-Perkins et al., 2014; Leaver and Rauschecker, 2010; Norman-Haignere et al., 2015; Overath et al., 2015; Tierney et al., 2013).”
InfluentialPhoneme and word recognition in the auditory ventral stream
DeWitt, I., & Rauschecker, J. P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1113427109 · Cited by 465
Self-citationDistinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel Decomposition
Norman-Haignere, S., Kanwisher, N. G., & McDermott, J. H. (2015) · Neuron · doi:10.1016/j.neuron.2015.11.035 · Cited by 465
Metadata
- Authors
- Leaver, A. M., & Rauschecker, J. P.
- Venue
- The Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2010-06-02
- Volume
- 30
- Issue
- 22
- Pages
- 7604-7612
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W2076923487
- Cited by
- 376
- References
- 77
- FWCI
- 12.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.