Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 1,403

The DOI matches its Crossref record; 176 of the 176 references it cites were found in a registry or an index.

A Survey on Deep Learning: Algorithms, Techniques, and Applications

Pouyanfar, Samira, Sadiq, Saad, Yan, Yilin, Tian, Haiman, Tao, Yudong, Reyes, Maria Presa, Shyu, Mei-Ling, Chen, Shu-Ching, Iyengar, S. S.·2019·ACM Computing Surveys

Abstract

The field of machine learning is witnessing its golden era as deep learning slowly becomes the leader in this domain. Deep learning uses multiple layers to represent the abstractions of data to build computational models. Some key enabler deep learning algorithms such as generative adversarial networks, convolutional neural networks, and model transfers have completely changed our perception of information processing. However, there exists an aperture of understanding behind this tremendously fast-paced domain, because it was never previously represented from a multiscope perspective. The lack of core understanding renders these powerful methods as black-box machines that inhibit development at a fundamental level. Moreover, deep learning has repeatedly been perceived as a silver bullet to all stumbling blocks in machine learning, which is far from the truth. This article presents a comprehensive review of historical and recent state-of-the-art approaches in visual, audio, and text processing; social network analysis; and natural language processing, followed by the in-depth analysis on pivoting and groundbreaking advances in deep learning applications. It was also undertaken to review the issues faced in deep learning such as unsupervised learning, black-box models, and online learning and to illustrate how these challenges can be transformed into prolific future research avenues.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3234150

Cites

176 of 176 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 32

  1. 10.1109/WASPAA.2017.8170027 · doi:10.1109/waspaa.2017.8170027
  2. Sami Abu-El-Haija, Nisarg Kothari, Joonseok Lee, Paul Natsev, George Toderici, Balakrishnan Varadarajan, and Sudheendra Vijayanarasimhan. 2016. YouTube-8M: A large-scale video classification benchmark. CoRR abs/1609.08675 (2016). Retrieved from http://arxiv.org/abs/1609.08675. · arXiv
  3. Rami Al-Rfou Guillaume Alain Amjad Almahairi Christof Angermueller Dzmitry Bahdanau Nicolas Ballas Frédéric Bastien Justin Bayer Anatoly Belikov Alexander Belopolsky Yoshua Bengio Arnaud Bergeron James Bergstra Valentin Bisson Josh Bleecher Snyder Nicolas Bouchard Nicolas Boulanger-Lewandowski Xavier Bouthillier Alexandre de Brébisson Olivier Breuleux Pierre-Luc Carrier Kyunghyun Cho Jan Chorowski Paul Christiano Tim Cooijmans Marc-Alexandre Côté Myriam Côté Aaron Courville Yann N. Dauphin Olivier Delalleau Julien Demouth Guillaume Desjardins Sander Dieleman Laurent Dinh Mélanie Ducoffe Vincent Dumoulin Samira Ebrahimi Kahou Dumitru Erhan Ziye Fan Orhan Firat Mathieu Germain Xavier Glorot Ian Goodfellow Matt Graham Caglar Gulcehre Philippe Hamel Iban Harlouchet Jean-Philippe Heng Balázs Hidasi Sina Honari Arjun Jain Sébastien Jean Kai Jia Mikhail Korobov Vivek Kulkarni Alex Lamb Pascal Lamblin Eric Larsen César Laurent Sean Lee Simon Lefrancois Simon Lemieux Nicholas Léonard Zhouhan Lin Jesse A. Livezey Cory Lorenz Jeremiah Lowin Qianli Ma Pierre-Antoine Manzagol Olivier Mastropietro Robert T. McGibbon Roland Memisevic Bart van Merriënboer Vincent Michalski Mehdi Mirza Alberto Orlandi Christopher Pal Razvan Pascanu Mohammad Pezeshki Colin Raffel Daniel Renshaw Matthew Rocklin Adriana Romero Markus Roth Peter Sadowski John Salvatier François Savard Jan Schlüter John Schulman Gabriel Schwartz Iulian Vlad Serban Dmitriy Serdyuk Samira Shabanian Étienne Simon Sigurd Spieckermann S. Ramana Subramanyam Jakub Sygnowski Jérémie Tanguay Gijs van Tulder Joseph Turian Sebastian Urban Pascal Vincent Francesco Visin Harm de Vries David Warde-Farley Dustin J. Webb Matthew Willson Kelvin Xu Lijun Xue Li Yao Saizheng Zhang and Ying Zhang. 2016. Theano: A Python framework for fast computation of mathematical expressions. CoRR abs/1605.02688 (2016). Retrieved from http://arxiv.org/abs/1605.02688. · arXiv
  4. 10.5555/3045390.3045410 · doi:10.5555/3045390.3045410
  5. Erfan Azarkhish, Davide Rossi, Igor Loi, and Luca Benini. 2017. Neurostream: Scalable and energy efficient deep learning with smart memory cubes. CoRR abs/1701.06420 (2017). Retrieved from http://arxiv.org/abs/1701.06420. · arXiv
  6. 10.5555/3044805.3044918 · doi:10.5555/3044805.3044918
  7. 10.5555/3042817.3043086 · doi:10.5555/3042817.3043086
  8. 10.5555/2999134.2999271 · doi:10.5555/2999134.2999271
  9. John C. Duchi, Elad Hazan, and Yoram Singer. 2010. Adaptive subgradient methods for online learning and stochastic optimization. In Conference on Learning Theory. Omnipress, 257--269.
  10. Rasool Fakoor, Faisal Ladhak, Azade Nazi, and Manfred Huber. 2013. Using deep learning to enhance cancer diagnosis and classification. In International Conference on Machine Learning. Omnipress.
  11. 10.5555/1873781.1873820 · doi:10.5555/1873781.1873820
  12. 10.5555/3086952 · doi:10.5555/3086952
  13. Ian Goodfellow Jean Pouget-Abadie Mehdi Mirza Bing Xu David Warde-Farley Sherjil Ozair Aaron Courville and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems. Curran Associates 2672--2680. · doi:10.5555/2969033.2969125
  14. Google. 2016. Alphago. Retrieved from https://deepmind.com/research/alphago. Accessed April 18, 2017.
  15. 10.5555/3104322.3104374 · doi:10.5555/3104322.3104374
  16. Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask R-CNN. In IEEE International Conference on Computer Vision. IEEE, 2980--2988.
  17. Intel Nervana Systems. 2017. Neon deep learning framework. Retrieved from https://www.nervanasys.com/technology/neon. Accessed April 4, 2017.
  18. 10.5555/2999134.2999257 · doi:10.5555/2999134.2999257
  19. 10.5555/850924.851523 · doi:10.5555/850924.851523
  20. 10.1145/2911451.2926732 · doi:10.1145/2911451.2926732
  21. H. Brendan McMahan, Eider Moore, Daniel Ramage, and Blaise Agüera y Arcas. 2016. Federated learning of deep networks using model averaging. CoRR abs/1602.05629 (2016). Retrieved from http://arxiv.org/abs/1602.05629. · arXiv
  22. MNIST. 2017. The MNIST database of handwritten digits. Retrieved from http://yann.lecun.com/exdb/mnist/. Accessed April 18, 2017.
  23. Michael Neumann and Ngoc Thang Vu. 2017. Attentive convolutional neural network based speech emotion recognition: A study on the impact of input features, signal length, and acted speech. CoRR abs/1706.00612 (2017). arxiv:1706.00612. Retrieved from http://arxiv.org/abs/1706.00612. · arXiv
  24. 10.5555/2969239.2969250 · doi:10.5555/2969239.2969250
  25. 10.5555/1886436.1886447 · doi:10.5555/1886436.1886447
  26. Skymind. 2017. Deeplearning4j deep learning framework. Retrieved from https://deeplearning4j.org. Accessed April 18, 2017.
  27. 10.5555/2986459.2986549 · doi:10.5555/2986459.2986549
  28. 10.5555/3104482.3104499 · doi:10.5555/3104482.3104499
  29. 10.5555/3042817.3043064 · doi:10.5555/3042817.3043064
  30. 10.2352/ISSN.2470-1173.2017.16.CVAS-344 · doi:10.2352/issn.2470-1173.2017.16.cvas-344
  31. Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. 2016. Google’s neural machine translation system: Bridging the gap between human and machine translation. CoRR abs/1609.08144 (2016). arxiv:1609.08144. Retrieved from http://arxiv.org/abs/1609.08144. · arXiv
  32. Omry Yadan, Keith Adams, Yaniv Taigman, and Marc’Aurelio Ranzato. 2013. Multi-GPU training of ConvNets. CoRR abs/1312.5853 (2013). · arXiv

Cited by

See all 1,403

Metadata

Authors
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S.
Venue
ACM Computing Surveys
Published
2018-09-18
Volume
51
Issue
5
Pages
1-36
ISSN
  • 0360-0300 (ISSN-L)
  • 1557-7341
OpenAlex
W2892341857
Cited by
1,403
References
176
FWCI
62.66
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.