The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Multiresolution spectrotemporal analysis of complex sounds
Abstract
A computational model of auditory analysis is described that is inspired by psychoacoustical and neurophysiological findings in early and central stages of the auditory system. The model provides a unified multiresolution representation of the spectral and temporal features likely critical in the perception of sound. Simplified, more specifically tailored versions of this model have already been validated by successful application in the assessment of speech intelligibility [Elhilali et al., Speech Commun. 41(2-3), 331–348 (2003); Chi et al., J. Acoust. Soc. Am. 106, 2719–2732 (1999)] and in explaining the perception of monaural phase sensitivity [R. Carlyon and S. Shamma, J. Acoust. Soc. Am. 114, 333–348 (2003)]. Here we provide a more complete mathematical formulation of the model, illustrating how complex signals are transformed through various stages of the model, and relating it to comparable existing models of auditory processing. Furthermore, we outline several reconstruction algorithms to resynthesize the sound from the model output so as to evaluate the fidelity of the representation and contribution of different features and cues to the sound percept.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Discrete-Time Signal Processing
Oppenheim, A. V., & Schafer, R. W. (1989) · Cited by 12,572
Numerical Methods for Unconstrained Optimization and Nonlinear Equations
Dennis, J. E., & Schnabel, R. B. (1996) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611971200 · Cited by 7,615
Phase retrieval algorithms: a comparison
Fienup, J. R. (1982) · Applied Optics · doi:10.1364/ao.21.002758 · Cited by 5,596
A practical algorithm for the determination of phase from image and diffraction plane pictures
Gerchberg, R. W. (1972) · Optik · Cited by 4,519
Perception of the speech code.
Liberman, A. M., Cooper, F. S., Shankweiler, D. P., & Studdert-Kennedy, M. (1967) · Psychological Review · doi:10.1037/h0020279 · Cited by 3,722
Speech Recognition with Primarily Temporal Cues
Shannon, R. V., Zeng, F.-G., Kamath, V., Wygonski, J., & Ekelid, M. (1995) · Science · doi:10.1126/science.270.5234.303 · Cited by 3,024
Hermansky, H., & Morgan, N. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.326616 · Cited by 1,808
Synaptic depression and cortical gain control
Abbott, L. F., Varela, J. A., Sen, K., & Nelson, S. B. (1997) · Science · doi:10.1126/science.275.5297.221 · Cited by 1,690
Jones, J. P., & Palmer, L. A. (1987) · Journal of Neurophysiology · doi:10.1152/jn.1987.58.6.1233 · Cited by 1,658
Model of human visual-motion sensing
Watson, A. B., & Ahumada, A. J. (1985) · Journal of the Optical Society of America A · doi:10.1364/josaa.2.000322 · Cited by 1,170
Temporal information in speech: acoustic, auditory and linguistic aspects
Rosen, S. (1992) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1992.0070 · Cited by 1,130
A new algorithm in spectral analysis and band-limited extrapolation
Papoulis, A. (1975) · IEEE Transactions on Circuits and Systems · doi:10.1109/tcs.1975.1084118 · Cited by 1,063
Processing of low-probability sounds by cortical neurons
Ulanovsky, N., Las, L., & Nelken, I. (2003) · Nature Neuroscience · doi:10.1038/nn1032 · Cited by 1,049
Atal, B. S. (1974) · The Journal of the Acoustical Society of America · doi:10.1121/1.1914702 · Cited by 915
Segev, I., & Bradford, A. (1988) · Cited by 911
Chimaeric sounds reveal dichotomies in auditory perception
Smith, Z. M., Delgutte, B., & Oxenham, A. J. (2002) · Nature · doi:10.1038/416087a · Cited by 873
Effect of temporal envelope smearing on speech reception
Drullman, R., Festen, J. M., & Plomp, R. (1994) · The Journal of the Acoustical Society of America · doi:10.1121/1.408467 · Cited by 801
Temporal modulation transfer functions based upon modulation thresholds
Viemeister, N. F. (1979) · The Journal of the Acoustical Society of America · doi:10.1121/1.383531 · Cited by 736
Dau, T., Kollmeier, B., & Kohlrausch, A. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.420344 · Cited by 594
Phase-retrieval stagnation problems and solutions
Fienup, J. R., & Wackerman, C. C. (1986) · Journal of the Optical Society of America A · doi:10.1364/josaa.3.001897 · Cited by 538
Periodicity coding in the inferior colliculus of the cat. I. Neuronal mechanisms
Langner, G., & Schreiner, C. E. (1988) · Journal of Neurophysiology · doi:10.1152/jn.1988.60.6.1799 · Cited by 508
Dau, T., Püschel, D., & Kohlrausch, A. (1996) · The Journal of the Acoustical Society of America · doi:10.1121/1.414959 · Cited by 462
Temporal and rate representations of time-varying signals in the auditory cortex of awake primates
Lu, T., Liang, L., & Wang, X. (2001) · Nature Neuroscience · doi:10.1038/nn737 · Cited by 461
Periodicity coding in the auditory system
Langner, G. (1992) · Hearing Research · doi:10.1016/0378-5955(92)90015-f · Cited by 453
Responses to amplitude-modulated tones in the auditory nerve of the cat
Joris, P. X., & Yin, T. C. T. (1992) · The Journal of the Acoustical Society of America · doi:10.1121/1.402757 · Cited by 444
Hayes, M. (1982) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1982.1163863 · Cited by 431
Depireux, D. A., Simon, J. Z., Klein, D. J., & Shamma, S. A. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.3.1220 · Cited by 428
Self-citationOptimizing Sound Features for Cortical Neurons
deCharms, R. C., Blake, D. T., & Merzenich, M. M. (1998) · Science · doi:10.1126/science.280.5368.1439 · Cited by 426
Auditory representations of acoustic signals
Yang, X., Wang, K., & Shamma, S. A. (1992) · IEEE Transactions on Information Theory · doi:10.1109/18.119739 · Cited by 382
Self-citationMethods for the Calculation and Use of the Articulation Index
Kryter, K. D. (1962) · The Journal of the Acoustical Society of America · doi:10.1121/1.1909094 · Cited by 369
Spectrotemporal Receptive Fields in the Lemniscal Auditory Thalamus and Cortex
Miller, L. M., Escabí, M. A., Read, H. L., & Schreiner, C. E. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00395.2001 · Cited by 350
Spectro-temporal modulation transfer functions and speech intelligibility
Chi, T., Gao, Y., Guyton, M. C., Ru, P., & Shamma, S. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.428100 · Cited by 336
Self-citationA tutorial on MPEG/audio compression
Pan, D. (1995) · IEEE Multimedia · doi:10.1109/93.388209 · Cited by 336
Schreiner, C. E., & Urbas, J. V. (1988) · Hearing Research · doi:10.1016/0378-5955(88)90146-3 · Cited by 326
Modeling auditory processing of amplitude modulation. II. Spectral and temporal integration
Dau, T., Kollmeier, B., & Kohlrausch, A. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.420345 · Cited by 324
Schreiner, C. E., & Urbas, J. V. (1986) · Hearing Research · doi:10.1016/0378-5955(86)90221-2 · Cited by 290
Kowalski, N., Depireux, D. A., & Shamma, S. A. (1996) · Journal of Neurophysiology · doi:10.1152/jn.1996.76.5.3503 · Cited by 269
Self-citationCharacterizing frequency selectivity for envelope fluctuations
Ewert, S. D., & Dau, T. (2000) · The Journal of the Acoustical Society of America · doi:10.1121/1.1288665 · Cited by 266
Temporal envelope and fine structure cues for speech intelligibility
Drullman, R. (1995) · The Journal of the Acoustical Society of America · doi:10.1121/1.413112 · Cited by 255
Organization of response areas in ferret primary auditory cortex
Shamma, S. A., Fleshman, J. W., Wiser, P. R., & Versnel, H. (1993) · Journal of Neurophysiology · doi:10.1152/jn.1993.69.2.367 · Cited by 248
Self-citationA model for the responses of low-frequency auditory-nerve fibers in cat
Carney, L. H. (1993) · The Journal of the Acoustical Society of America · doi:10.1121/1.405620 · Cited by 236
Robust Spectrotemporal Reverse Correlation for the Auditory System: Optimizing Stimulus Design
Klein, D. J., Depireux, D. A., Simon, J. Z., & Shamma, S. A. (2000) · Journal of Computational Neuroscience · doi:10.1023/a:1008990412183 · Cited by 232
Self-citationDiscrimination of speech from nonspeech based on multiscale spectro-temporal Modulations
Mesgarani, N., Slaney, M., & Shamma, S. A. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.858055 · Cited by 224
Self-citationTemporal envelope and fine structure cues for speech intelligibility
Drullman, R. (1994) · The Journal of the Acoustical Society of America · doi:10.1121/1.408825 · Cited by 213
Shamma, S. A. (1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392800 · Cited by 205
Self-citationModulation masking: Effects of modulation frequency, depth, and phase
Bacon, S. P., & Grantham, D. W. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397751 · Cited by 204
Frequency selectivity in amplitude-modulation detection
Houtgast, T. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397956 · Cited by 200
The modulation spectrogram: in pursuit of an invariant representation of speech
Greenberg, S., & Kingsbury, B. E. D. (2002) · 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1997.598826 · Cited by 198
Shamma, S. A. (1985) · The Journal of the Acoustical Society of America · doi:10.1121/1.392799 · Cited by 159
Self-citationJoint Acoustic and Modulation Frequency
Atlas, L., & Shamma, S. (2003) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865703305013 · Cited by 158
Self-citationDynamics of Precise Spike Timing in Primary Auditory Cortex
Elhilali, M., Fritz, J. B., Klein, D. J., Simon, J. Z., & Shamma, S. A. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.3825-03.2004 · Cited by 158
Self-citationAuditory stream segregation on the basis of amplitude-modulation rate
Grimault, N., Bacon, S. P., & Micheyl, C. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1452740 · Cited by 152
Roberts, B., Glasberg, B. R., & Moore, B. C. J. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1508784 · Cited by 143
Spectral shape analysis in the central auditory system
Wang, K., & Shamma, S. (1995) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.466657 · Cited by 130
Self-citationResponses to linear and logarithmic frequency‐modulated sweeps in ferret primary auditory cortex
Nelken, I., & Versnel, H. (2000) · European Journal of Neuroscience · doi:10.1046/j.1460-9568.2000.00935.x · Cited by 126
Thomson, A. M., & Alain Destexhe, A. (1999) · Neuroscience · doi:10.1016/s0306-4522(99)00021-4 · Cited by 123
Self-normalization and noise-robustness in early auditory representations
Wang, K., & Shamma, S. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.294356 · Cited by 117
Self-citationEggermont, J. J. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00490.2001 · Cited by 113
A model of auditory perception as front end for automatic speech recognition
Tchorz, J., & Kollmeier, B. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.427950 · Cited by 111
Application of an auditory model to speech recognition
Cohen, J. R. (1989) · The Journal of the Acoustical Society of America · doi:10.1121/1.397756 · Cited by 100
Cochlear nerve fiber responses: Distribution along the cochlear partition
Pfeiffer, R. R., & Kim, D. O. (1975) · The Journal of the Acoustical Society of America · doi:10.1121/1.380735 · Cited by 98
Shamma, S., Versnel, H., & Kowalski, N. (1994) · doi:10.21236/ada452778 · Cited by 83
Self-citationTime-frequency analysis and auditory modeling for automatic recognition of speech
Pitton, J. W., Wang, K., & Juang, B.-H. F. (1996) · Proceedings of the IEEE · doi:10.1109/5.535241 · Cited by 65
Auditory Representations of Timbre and Pitch
Lyon, R. F., & Shamma, S. (1996) · Springer handbook of auditory research · doi:10.1007/978-1-4612-4070-9_6 · Cited by 64
Self-citationThalamocortical NMDA conductances and intracortical inhibition can explain cortical temporal tuning
Krukowski, A. E., & Miller, K. D. (2001) · Nature Neuroscience · doi:10.1038/86084 · Cited by 62
Continuous assessment of time-varying speech quality
Hansen, M., & Kollmeier, B. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.428136 · Cited by 34
Amagai, S., Dooling, R. J., Shamma, S., Kidd, T. L., & Lohr, B. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.426736 · Cited by 28
Self-citationRepresentation of musical timbre in the auditory cortex*
Ru, P., & Shamma, S. (1997) · Journal of New Music Research · doi:10.1080/09298219708570723 · Cited by 20
Self-citationPhysiological foundations of temporal integration in the perception of speech
Shamma, S. (2003) · Journal of Phonetics · doi:10.1016/j.wocn.2003.09.001 · Cited by 16
Self-citation
Cited by
Cortical oscillations and speech processing: emerging computational principles and operations
Giraud, A.-L., & Poeppel, D. (2012) · Nature Neuroscience · doi:10.1038/nn.3063 · Cited by 1,917
Anden, J., & Mallat, S. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2326991 · Cited by 666
Reconstructing Speech from Human Auditory Cortex
Pasley, B. N., David, S. V., Mesgarani, N., Flinker, A., Shamma, S. A., Crone, N. E., Knight, R. T., & Chang, E. F. (2012) · PLoS Biology · doi:10.1371/journal.pbio.1001251 · Cited by 604
Self-citationPhase recovery, MaxCut and complex semidefinite programming
Waldspurger, I., d’Aspremont, A., & Mallat, S. (2015) · Mathematical Programming · doi:10.1007/s10107-013-0738-9 · Cited by 573
A complementary systems account of word learning: neural and behavioural evidence
Davis, M. H., & Gaskell, M. G. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2009.0111 · Cited by 572
Metadata
- Authors
- Chi, T., Ru, P., & Shamma, S. A.
- Venue
- The Journal of the Acoustical Society of America
- Publisher
- Acoustical Society of America (ASA)
- Published
- 2005-08-01
- Volume
- 118
- Issue
- 2
- Pages
- 887-906
- ISSN
- 0001-4966 (ISSN-L)
- 1520-8524
- OpenAlex
- W2054139811
- Cited by
- 673
- References
- 70
- FWCI
- 6.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.