CoChat
Sign Up
PreprintCited by 4

The DOI matches its DataCite record; 3 of the 3 references it cites were found in a registry or an index.

Automatic tagging using deep convolutional neural networks

Choi, Keunwoo, Fazekas, George, Sandler, Mark·2016·arXiv
DOI 10.48550/arxiv.1606.00298arXiv 1606.00298
Open this paper in CoChat — free account

Abstract

We present a content-based automatic music tagging algorithm using fully convolutional neural networks (FCNs). We evaluate different architectures consisting of 2D convolutional layers and subsampling layers only. In the experiments, we measure the AUC-ROC scores of the architectures with different complexities and input types using the MagnaTagATune dataset, where a 4-layer architecture shows state-of-the-art performance with mel-spectrogram input. Furthermore, we evaluated the performances of the architectures with varying the number of layers on a larger dataset (Million Song Dataset), and found that deeper models outperformed the 4-layer architecture. The experiments show that mel-spectrogram is an effective time-frequency representation for automatic tagging and that more complex models benefit from more training data.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1606.00298

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 A block diagram of the proposed 4-layer architecture, FCN-4 . The numbers indicate the number of feature maps (i.e. channels) in each layer. The subsampling layers decrease the size of feature maps to 1 × 1 while the convolutional layers increase the depth to 2048 .
Figure 1 A block diagram of the proposed 4-layer architecture, FCN-4 . The numbers indicate the number of feature maps (i.e. channels) in each layer. The subsampling layers decrease the size of feature maps to 1 × 1 while the convolutional layers increase the depth to 2048 .CC-BY · From the PDF
Figure 2 The numbers of bins per 1kHz bandwidth in mel-spectrograms and STFTs .
Figure 2 The numbers of bins per 1kHz bandwidth in mel-spectrograms and STFTs .CC-BY · From the PDF
Figure 3 The learning curves of the AUC scores measured on the validation set (on the Million Song Dataset)
Figure 3 The learning curves of the AUC scores measured on the validation set (on the Million Song Dataset)CC-BY · From the PDF

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 24

  1. Frédéric Bastien, Pascal Lamblin, Razvan Pascanu, James Bergstra, Ian Goodfellow, Arnaud Bergeron, Nicolas Bouchard, David Warde-Farley, and Yoshua Bengio. Theano: new features and speed improve- ments. arXiv preprint arXiv:1211.5590, 2012. · arXiv
  2. Keunwoo Choi, George Fazekas, Mark Sandler, and Jeonghee Kim. Auralisation of deep convolutional neu- ral networks: Listening to learned features. In Proceed- ings of the 16th International Society for Music In- formation Retrieval Conference, ISMIR 2015, Málaga, Spain, October 26-30, 2015, 2015.
  3. Sander Dieleman and Benjamin Schrauwen. Multi- scale approaches to music audio feature learning. In Proceedings of the 14th International Society for Mu- sic Information Retrieval Conference, ISMIR 2013, Curitiba, Brazil, November 4-8, 2013, 2013.
  4. Sander Dieleman and Benjamin Schrauwen. End-to- end learning for music audio. In Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on, pages 6964-6968. IEEE, 2014.
  5. Thomas Grill and Jan Schlüter. Music boundary detec- tion using neural networks on spectrograms and self- similarity lag matrices. In Proceedings of the 23rd European Signal Processing Conference (EUSPICO 2015), Nice, France, 2015.
  6. Philippe Hamel, Simon Lemieux, Yoshua Bengio, and Douglas Eck. Temporal pooling and multiscale learn- ing for automatic annotation and ranking of music au- dio. In Proceedings of the 12th International Soci- ety for Music Information Retrieval Conference, IS- MIR 2011, Miami, Florida, USA, October 24-28, 2011, pages 729-734, 2011.
  7. Eric J Humphrey and Juan P Bello. Rethinking auto- matic chord recognition with convolutional neural net- works. In Machine Learning and Applications, 11th In- ternational Conference on, volume 2, pages 357-362. IEEE, 2012.
  8. Sergey Ioffe and Christian Szegedy. Batch nor- malization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167, 2015. · arXiv
  9. Edith Law, Kris West, Michael I Mandel, Mert Bay, and J Stephen Downie. Evaluation of algorithms using games: The case of music tagging. In Proceedings of the 10th International Society for Music Information Retrieval Conference, ISMIR 2009, Kobe, Japan, Oc- tober 26-30, 2009, pages 387-392. ISMIR, 2009.
  10. Yann LeCun and Yoshua Bengio. Convolutional net- works for images, speech, and time series. The hand- book of brain theory and neural networks, 3361(10), 1995.
  11. Dawen Liang, Minshu Zhan, and Daniel PW Ellis. Content-aware collaborative music recommendation using pre-trained neural networks. In Proceedings of the 16th International Society for Music Information Retrieval Conference, ISMIR 2015, Málaga, Spain, October 26-30, 2015, 2015.
  12. Min Lin, Qiang Chen, and Shuicheng Yan. Network in network. CoRR, abs/1312.4400, 2013. · arXiv
  13. Juhan Nam, Jorge Herrera, and Kyogu Lee. A deep bag-of-features model for music auto-tagging. arXiv preprint arXiv:1508.04999, 2015. · arXiv
  14. Tara N Sainath, Abdel-rahman Mohamed, Brian Kingsbury, and Bhuvana Ramabhadran. Deep convo- lutional neural networks for lvcsr. In Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE Interna- tional Conference on, pages 8614-8618. IEEE, 2013.
  15. Tara N Sainath, Ron J Weiss, Andrew Senior, Kevin W Wilson, and Oriol Vinyals. Learning the speech front- end with raw waveform cldnns. In Proc. Interspeech, 2015.
  16. Jan Schluter and Sebastian Bock. Improved musical onset detection with convolutional neural networks. In Acoustics, Speech and Signal Processing (ICASSP), IEEE International Conference on. IEEE, 2014.
  17. Siddharth Sigtia, Emmanouil Benetos, and Simon Dixon. An end-to-end neural network for polyphonic music transcription. arXiv preprint arXiv:1508.01774, 2015. · arXiv
  18. Andrew JR Simpson, Gerard Roma, and Mark D Plumbley. Deep karaoke: Extracting vocals from mu- sical mixtures using a convolutional deep neural net- work. arXiv preprint arXiv:1504.04658, 2015. · arXiv
  19. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: A simple way to prevent neural networks from over- fitting. The Journal of Machine Learning Research, 15(1):1929-1958, 2014.
  20. George Tzanetakis and Perry Cook. Musical genre classification of audio signals. Speech and Audio Pro- cessing, IEEE transactions on, 10(5):293-302, 2002.
  21. Karen Ullrich, Jan Schlüter, and Thomas Grill. Bound- ary detection in music structure analysis using convo- lutional neural networks. In Proceedings of the 15th International Society for Music Information Retrieval Conference, ISMIR 2014, Taipei, Taiwan, 2014.
  22. Aaron Van den Oord, Sander Dieleman, and Benjamin Schrauwen. Deep content-based music recommenda- tion. In Advances in Neural Information Processing Systems, pages 2643-2651, 2013.
  23. Aäron Van Den Oord, Sander Dieleman, and Ben- jamin Schrauwen. Transfer learning by supervised pre- training for audio-based music classification. In Pro- ceedings of the 15th International Society for Music Information Retrieval Conference, ISMIR 2014, Taipei, Taiwan, October 27-31, 2014, 2014.
  24. Yusuf Yaslan and Zehra Cataltepe. Audio music genre classification using different classifiers and feature se- lection methods. In 18th ICPR 2006, volume 2, pages 573-576. IEEE, 2006.

Cited by

Sorted by citations

See all 4

Metadata

Authors
Choi, K., Fazekas, G., & Sandler, M.
Venue
arXiv
Publisher
arXiv
Published
2016
DOI
10.48550/arxiv.1606.00298
arXiv
1606.00298
References
3
Type
Preprint
Licence
creativecommons.org/licenses/by/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Automatic tagging using deep convolutional neural networks. https://app.cochat.ai/papers/10.48550/arxiv.1606.00298
The paper
Choi, K., Fazekas, G., & Sandler, M. (2016). Automatic tagging using deep convolutional neural networks. arXiv. https://doi.org/10.48550/arxiv.1606.00298