The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
Open accessAbstract
The ability of deep convolutional neural networks (CNNs) to learn discriminative spectro-temporal patterns makes them well suited to environmental sound classification. However, the relative scarcity of labeled data has impeded the exploitation of this family of high-capacity models. This study has two primary contributions: first, we propose a deep CNN architecture for environmental sound classification. Second, we propose the use of audio data augmentation for overcoming the problem of data scarcity and explore the influence of different augmentations on the performance of the proposed CNN architecture. Combined with data augmentation, the proposed model produces state-of-the-art results for environmental sound classification. We show that the improved performance stems from the combination of a deep, high-capacity model and an augmented training set: this combination outperforms both the proposed CNN without augmentation and a “shallow” dictionary learning model with augmentation. Finally, we examine the influence of each augmentation on the model's classification accuracy for each class, and observe that the accuracy for each class is influenced differently by each augmentation, suggesting that the performance of the model could be improved further by applying class-conditional data augmentation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2014) · Cited by 33,419
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795
Best practices for convolutional neural networks applied to visual document analysis
Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. · doi:10.1109/icdar.2003.1227801 · Cited by 2,741
ESC: Dataset for Environmental Sound Classification
Piczak, K. J. (2015) · Proceedings of the 23rd ACM international conference on Multimedia · doi:10.1145/2733373.2806390 · Cited by 1,397
A Dataset and Taxonomy for Urban Sound Research
Salamon, J., Jacoby, C., & Bello, J. P. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2655045 · Cited by 1,309
Self-citationEnvironmental sound classification with convolutional neural networks
Piczak, K. J. (2015) · 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP) · doi:10.1109/mlsp.2015.7324337 · Cited by 931
Environmental Sound Recognition With Time–Frequency Audio Features
Chu, S., Narayanan, S., & Kuo, C.-C. J. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2009.2017438 · Cited by 639
Detection and Classification of Acoustic Scenes and Events
Stowell, D., Giannoulis, D., Benetos, E., Lagrange, M., & Plumbley, M. D. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2428998 · Cited by 600
Research works printed but not linked: 6
- humphrey, 2014, JAMS: A JSON annotated music specification for reproducible MIR research, Proc 11th Int Soc for Music Inf Retrieval Conf, 591
- 10.1109/WASPAA.2013.6701819 · doi:10.1109/waspaa.2013.6701819
- 10.1109/ICASSP.2015.7177950 · doi:10.1109/icassp.2015.7177950
- 10.1016/j.apacoust.2016.06.010 · doi:10.1016/j.apacoust.2016.06.010
- 10.1109/ASPAA.2005.1540194 · doi:10.1109/aspaa.2005.1540194
- mcfee, 2015, A software framework for musical data augmentation, Proc Int Soc for Music Inf Retrieval Conf, 248
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Recent advances in convolutional neural networks
Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576
BirdNET: A deep learning solution for avian diversity monitoring
Kahl, S., Wood, C. M., Eibl, M., & Klinck, H. (2021) · Ecological Informatics · doi:10.1016/j.ecoinf.2021.101236 · Cited by 903
Reinforcement Learning in Healthcare: A Survey
Yu, C., Liu, J., Nemati, S., & Yin, G. (2023) · ACM Computing Surveys · doi:10.1145/3477600 · Cited by 628
A systematic review on overfitting control in shallow and deep neural networks
Bejani, M. M., & Ghatee, M. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09975-1 · Cited by 573
A scoping review of transfer learning research on medical image analysis using ImageNet
Morid, M. A., Borjali, A., & Del Fiol, G. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.104115 · Cited by 508
FSD50K: An Open Dataset of Human-Labeled Sound Events
Fonseca, E., Favory, X., Pons, J., Font, F., & Serra, X. (2020) · arXiv · doi:10.48550/arxiv.2010.00475 · Cited by 462
“Mitigating this potential issue could be a research problem involving, for example, data augmentation [82] or domain adaptation [83] techniques.”
BackgroundFSD50K: An Open Dataset of Human-Labeled Sound Events
Fonseca, E., Favory, X., Pons, J., Font, F., & Serra, X. (2022) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3133208 · Cited by 449
Stowell, D., Wood, M. D., Pamuła, H., Stylianou, Y., & Glotin, H. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13103 · Cited by 414
Baek, Y., & Kim, H. Y. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.07.019 · Cited by 372
End-to-end environmental sound classification using a 1D convolutional neural network
Abdoli, S., Cardinal, P., & Lameiras Koerich, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.06.040 · Cited by 352
A survey of sound source localization with deep learning methods
Grumiaux, P.-A., Kitić, S., Girin, L., & Guérin, A. (2022) · The Journal of the Acoustical Society of America · doi:10.1121/10.0011809 · Cited by 347
Flood susceptibility mapping using convolutional neural network frameworks
Wang, Y., Fang, Z., Hong, H., & Peng, L. (2020) · Journal of Hydrology · doi:10.1016/j.jhydrol.2019.124482 · Cited by 339
Wang, H., Li, S., Song, L., & Cui, L. (2019) · Computers in Industry · doi:10.1016/j.compind.2018.12.013 · Cited by 338
Audioclip: Extending Clip to Image, Text and Audio
Guzhov, A., Raue, F., Hees, J., & Dengel, A. (2022) · ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp43922.2022.9747631 · Cited by 330
Reinforcement learning for intelligent healthcare applications: A survey
Coronato, A., Naeem, M., De Pietro, G., & Paragliola, G. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101964 · Cited by 320
Dilated convolution neural network with LeakyReLU for environmental sound classification
Zhang, X., Zou, Y., & Shi, W. (2017) · 2017 22nd International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2017.8096153 · Cited by 283
Look, Listen, and Learn More: Design Choices for Deep Audio Embeddings
Cramer, A. L., Wu, H.-H., Salamon, J., & Bello, J. P. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8682475 · Cited by 281
Self-citationAugmenting Image Classifiers Using Data Augmentation Generative Adversarial Networks
Antoniou, A., Storkey, A., & Edwards, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_58 · Cited by 278
Steven Eyobu, O., & Han, D. S. (2018) · Sensors · doi:10.3390/s18092892 · Cited by 259
“Nevertheless, data augmentation has been successfully applied in wearable sensor data in studies such as [13,14] showing positive state-of-the-art results, and sound recognition [15].”
BackgroundA Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
Integrating Machine Learning with Human Knowledge
Deng, C., Ji, X., Rainey, C., Zhang, J., & Lu, W. (2020) · iScience · doi:10.1016/j.isci.2020.101656 · Cited by 243
Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100568 · Cited by 197
Spectral images based environmental sound classification using CNN with meaningful data augmentation
Mushtaq, Z., Su, S.-F., & Tran, Q.-V. (2021) · Applied Acoustics · doi:10.1016/j.apacoust.2020.107581 · Cited by 188
Panwar, M., Biswas, D., Bajaj, H., Jobges, M., Turk, R., Maharatna, K., & Acharyya, A. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2899927 · Cited by 158
“Data augmentation is a preferred technique to build a powerful classifier with very less amount of data in deep learning [52].”
MethodData augmentation for motor imagery signal classification based on a hybrid neural network.
Zhang, K., Xu, G., Han, Z., Ma, K., Zheng, X., Chen, L., Duan, N., & Zhang, S. (2020) · Sensors · doi:10.3390/s20164485 · Cited by 130
Workflow and convolutional neural network for automated identification of animal sounds
Ruff, Z. J., Lesmeister, D. B., Appel, C. L., & Sullivan, C. M. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2021.107419 · Cited by 123
“…a variety of automated recognizer algorithms (e.g., Sebasti ´ an-Gonz ´ alez et al., 2015; Knight et al., 2017; Venier et al., 2017; Ovaskai-nen et al., 2018; Stowell et al., 2019), including CNNs specifically (Salamon et al., 2016; Salamon and Bello, 2017; Ruff et al., 2020; LeBien et al., 2020).”
MethodLekha, S., & M, S. (2021) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2020.2993591 · Cited by 105
A multimodal convolutional neuro-fuzzy network for emotion understanding of movie clips
Nguyen, T.-L., Kavuri, S., & Lee, M. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.06.010 · Cited by 84
A survey on artificial intelligence in Chinese sign language recognition
Jiang, X., Satapathy, S. C., Yang, L., Wang, S.-H., & Zhang, Y.-D. (2020) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-020-04758-2 · Cited by 71
Knight, E. C., Poo Hernandez, S., Bayne, E. M., Bulitko, V., & Tucker, B. V. (2020) · Bioacoustics · doi:10.1080/09524622.2019.1606734 · Cited by 57
“One of the reasons CNNs have been proposed for bioacoustic classi fi cation is that the convolutional layers can render the network location invariant (Cakir et al. 2017; Salamon and Bello 2017).”
BackgroundMethodIndividual identification in acoustic recordings
Knight, E., Rhinehart, T., de Zwaan, D. R., Weldy, M. J., Cartwright, M., Hawley, S. H., Larkin, J. L., Lesmeister, D., Bayne, E., & Kitzes, J. (2024) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2024.05.007 · Cited by 54
Sensor-data augmentation for human activity recognition with time-warping and data masking
Jeong, C. Y., Shin, H. C., & Kim, M. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-10600-0 · Cited by 38
Label-preserving data augmentation for mobile sensor data
Kim, M., & Jeong, C. Y. (2021) · Multidimensional Systems and Signal Processing · doi:10.1007/s11045-020-00731-2 · Cited by 32
Convolutional Neural Networks for the Identification of African Lions from Individual Vocalizations
Trapanotto, M., Nanni, L., Brahnam, S., & Guo, X. (2022) · Journal of Imaging · doi:10.3390/jimaging8040096 · Cited by 24
COALA: Co-Aligned Autoencoders for Learning Semantically Enriched Audio Representations
Favory, X., Drossos, K., Virtanen, T., & Serra, X. (2020) · arXiv · doi:10.48550/arxiv.2006.08386 · Cited by 20
Large-Scale Whale Call Classification Using Deep Convolutional Neural Network Architectures
Wang, D., Zhang, L., Lu, Z., & Xu, K. (2018) · 2018 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC) · doi:10.1109/icspcc.2018.8567758 · Cited by 19
Zhao, H., Yu, S., Prinable, J., McEwan, A., & Karlsson, P. (2020) · IFMBE Proceedings · doi:10.1007/978-3-030-31635-8_226 · Cited by 9
Haresamudram, H., Tang, C. I., Suh, S., Lukowicz, P., & Ploetz, T. (2024) · arXiv · Cited by 31
“Signal-processing methods (e.g., time-stretching, pitch-shifting, and dynamic-range compression) are applied to augment audio signals in sound classification tasks [35, 131, 159].”
Metadata
- Authors
- Salamon, J., & Bello, J. P.
- Venue
- IEEE Signal Processing Letters
- Published
- 2017-03
- Volume
- 24
- Issue
- 3
- Pages
- 279-283
- ISSN
- 1070-9908 (ISSN-L)
- 1558-2361
- OpenAlex
- W2509065397
- Cited by
- 1,364
- References
- 20
- FWCI
- 100.40
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- Funders
- NSF (1544753)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.