Environmental Sound Recognition With Time–Frequency Audio Features
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
The paper considers the task of recognizing environmental sounds for the understanding of a scene or context surrounding an audio sensor. A variety of features have been proposed for audio recognition, including the popular Mel-frequency cepstral coefficients (MFCCs) which describe the audio spectral shape. Environmental sounds, such as chirpings of insects and sounds of rain which are typically noise-like with a broad flat spectrum, may include strong temporal domain signatures. However, only few temporal-domain features have been developed to characterize such diverse audio signals previously. Here, we perform an empirical feature analysis for audio environment characterization and propose to use the matching pursuit (MP) algorithm to obtain effective time-frequency features. The MP-based method utilizes a dictionary of atoms for feature selection, resulting in a flexible, intuitive and physically interpretable set of features. The MP-based feature is adopted to supplement the MFCC features to yield higher recognition accuracy for environmental sounds. Extensive experiments are conducted to demonstrate the effectiveness of these joint features for unstructured environmental sound classification, including listening tests to study human recognition capabilities. Our recognition system has shown to produce comparable performance as human listeners.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Matching pursuits with time-frequency dictionaries
Mallat, S. G., & Zhang, Z. (1993) · IEEE Transactions on Signal Processing · doi:10.1109/78.258082 · Cited by 9,112
Fundamentals of speech recognition
Rabiner, L. R., & Juang, B.-H. F. (1993) · Cited by 7,680
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Pati, Y. C., Rezaiifar, R., & Krishnaprasad, P. S. (2002) · Proceedings of 27th Asilomar Conference on Signals, Systems and Computers · doi:10.1109/acssc.1993.342465 · Cited by 4,323
Vetterli, M., & Kovačević, J. (1995) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 3,198
Musical genre classification of audio signals
Tzanetakis, G., & Cook, P. (2002) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.2002.800560 · Cited by 2,798
Markel, J. D., & Gray, A. H. (1976) · Communication and Cybernetics · doi:10.1007/978-3-642-66286-7 · Cited by 1,402
MINERVA: a second-generation museum tour-guide robot
Thrun, S., Bennewitz, M., Burgard, W., Cremers, A. B., Dellaert, F., Fox, D., Hahnel, D., Rosenberg, C., Roy, N., Schulte, J., et al. (2003) · Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C) · doi:10.1109/robot.1999.770401 · Cited by 701
Towards robotic assistants in nursing homes: Challenges and results
Pineau, J., Montemerlo, M., Pollack, M., Roy, N., & Thrun, S. (2003) · Robotics and Autonomous Systems · doi:10.1016/s0921-8890(02)00381-0 · Cited by 640 · cited 1×
“When employed to understand unstructured environments [1], [2] (e.”
BackgroundAudio content analysis for online audiovisual data segmentation and classification
Zhang, T., & Kuo, C.-C. J. (2001) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.917689 · Cited by 416
Self-citationAudio-based context recognition
Eronen, A. J., Peltonen, V. T., Tuomi, J. T., Klapuri, A. P., Fagerlund, S., Sorsa, T., Lorho, G., & Huopaniemi, J. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tsa.2005.854103 · Cited by 407
Neural Networks for Pattern Recognition
Kothari, S. C., & Oh, H. (1993) · Advances in Computers · doi:10.1016/s0065-2458(08)60404-0 · Cited by 316
Prediction-driven computational auditory scene analysis
Ellis, D. P. W. (1996) · DSpace@MIT (Massachusetts Institute of Technology) · doi:10.7916/d84j0n13 · Cited by 305
Harmonic decomposition of audio signals with matching pursuit
Gribonval, R., & Bacry, E. (2003) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2002.806592 · Cited by 239
Aucouturier, J.-J., Defreville, B., & Pachet, F. (2007) · The Journal of the Acoustical Society of America · doi:10.1121/1.2750160 · Cited by 229
Wheelesley: A robotic wheelchair system: Indoor navigation and user interface
Yanco, H. A. (2006) · Lecture Notes in Computer Science · doi:10.1007/bfb0055983 · Cited by 225
Computational auditory scene recognition
Peltonen, V., Tuomi, J., Klapuri, A., Huopaniemi, J., & Sorsa, T. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2002.5745009 · Cited by 215
A comparison of features for speech, music discrimination
Carey, M. J., Parris, E. S., & Lloyd-Thomas, H. (1999) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1999.758084 · Cited by 184
Fast matching pursuit with a multiscale dictionary of Gaussian chirps
Gribonval, R. (2001) · IEEE Transactions on Signal Processing · doi:10.1109/78.917803 · Cited by 181
Musical Instrument Timbres Classification with Spectral Features
Agostini, G., Longari, M., & Pollastri, E. (2003) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/s1110865703210118 · Cited by 171
Fod, A., Howard, A. B., & Matari, M. J. (2002) · Cited by 158
Where am I? Scene Recognition for Mobile Robots using Audio Features
Chu, S., Narayanan, S. S., Kuo, C. ‐. J., & Matarić, M. J. (2006) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2006.262661 · Cited by 157
Self-citationA flexible framework for key audio effects detection and auditory context inference
Cai, R., Lu, L., Hanjalić, A., Zhang, H.-J., & Cai, L. (2006) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tsa.2005.857575 · Cited by 149
Auditory Context Awareness via Wearable Computing
Clarkson, B., Sawhney, N., & Pentland, A. (1998) · Cited by 109
CHIL - Computers in the Human Interaction Loop
Waibel, A., Steusloff, H., Stiefelhagen, R., & CHIL Project Consortium (2004) · KITopen · doi:10.5445/ir/1000002562 · Cited by 103
Musical instrument timbres classification with spectral features
Agostini, G., Longari, M., & Pollastri, E. (2002) · IEEE International Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2001.962718 · Cited by 61
Cited by
Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
Salamon, J., & Bello, J. P. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2657381 · Cited by 1,364
A Dataset and Taxonomy for Urban Sound Research
Salamon, J., Jacoby, C., & Bello, J. P. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2655045 · Cited by 1,309
Detection and Classification of Acoustic Scenes and Events
Stowell, D., Giannoulis, D., Benetos, E., Lagrange, M., & Plumbley, M. D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2428998 · Cited by 600
Metrics for Polyphonic Sound Event Detection
Mesaros, A., Heittola, T., & Virtanen, T. (2016) · Applied Sciences · doi:10.3390/app6060162 · Cited by 579
Adavanne, S., Politis, A., Nikunen, J., & Virtanen, T. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2018.2885636 · Cited by 534
Metadata
- Authors
- Chu, S., Narayanan, S., & Kuo, C.-C. J.
- Venue
- IEEE Transactions on Audio, Speech, and Language Processing
- Published
- 2009-08
- Volume
- 17
- Issue
- 6
- Pages
- 1142-1158
- ISSN
- 1558-7916 (ISSN-L)
- OpenAlex
- W2130640900
- Cited by
- 639
- References
- 27
- FWCI
- 42.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.