Deep, Big, Simple Neural Nets for Handwritten Digit Recognition

Long Short-Term Memory

Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318

Gradient-based learning applied to document recognition

Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805

Greedy layer-wise training of deep networks

Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841

Deep learning in neural networks: an overview

Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570

Representation Learning: A Review and New Perspectives

Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001

Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups

Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260

Improving neural networks by preventing co-adaptation of feature detectors

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382

Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review

Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503

A survey of the recent architectures of deep convolutional neural networks

Khan, A., Sohail, A., Zahoora, U., & Qureshi, A. S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09825-6 · Cited by 3,137

The Effectiveness of Data Augmentation in Image Classification using Deep Learning

Perez, L., & Wang, J. (2017) · arXiv · doi:10.48550/arxiv.1712.04621 · Cited by 2,499

Building high-level features using large scale unsupervised learning

Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695

Deep learning for cellular image analysis

Moen, E., Bannon, D., Kudo, T., Graf, W., Covert, M., & Van Valen, D. (2019) · Nature Methods · doi:10.1038/s41592-019-0403-1 · Cited by 1,225

Untitled work

(2012) · neural information processing systems · Cited by 1,291

Big data deep learning: Challenges and perspectives

Chen, X.-W., & Lin, X. (2014) · IEEE Access · doi:10.1109/access.2014.2325029 · Cited by 1,255

Untitled work

(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229

Multi-column deep neural network for traffic sign classification

Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057

Understanding Data Augmentation for Classification: When to Warp?

Wong, S. C., Gatt, A., Stamatescu, V., & McDonnell, M. D. (2016) · 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2016.7797091 · Cited by 1,007

A generic intelligent bearing fault diagnosis system using compact adaptive 1D CNN classifier

Eren, L., Ince, T., & Kiranyaz, S. (2019) · Journal of Signal Processing Systems · doi:10.1007/s11265-018-1378-3 · Cited by 723

Minerva: enabling low-power, highly-accurate deep neural network accelerators

Reagen, B., Whatmough, P., Adolf, R., Rama, S., Lee, H., Lee, S. K., Hernández-Lobato, J. M., Wei, G.-Y., & Brooks, D. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001165 · Cited by 446

Predicting Parameters in Deep Learning

Shakibi, B. (2014) · University of British Columbia · doi:10.14288/1.0165555 · Cited by 462

PUMA: A Programmable Ultra-efficient Memristor-based Accelerator for Machine Learning Inference

Ankit, A., Hajj, I. E., Chalamalasetti, S. R., Ndu, G., Foltin, M., Williams, R. S., Faraboschi, P., Hwu, W.-M. W., Strachan, J. P., Roy, K., et al. (2019) · Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3297858.3304049 · Cited by 424

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding

Lepikhin, D., Lee, H., Xu, Y., Chen, D., Firat, O., Huang, Y., Krikun, M., Shazeer, N., & Chen, Z. (2020) · arXiv · doi:10.48550/arxiv.2006.16668 · Cited by 412

What is AI? Applications of artificial intelligence to dermatology

Du‐Harpur, X., Watt, F. M., Luscombe, N. M., & Lynch, M. D. (2020) · British Journal of Dermatology · doi:10.1111/bjd.18880 · Cited by 355

Compute Trends Across Three Eras of Machine Learning

Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363

A survey on data‐efficient algorithms in big data era

Adadi, A. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00419-9 · Cited by 331

A Machine Learning Approach for Non-blind Image Deconvolution

Schuler, C. J., Burger, H. C., Harmeling, S., & Scholkopf, B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.142 · Cited by 319

Deep-learning: investigating deep neural networks hyper-parameters and comparison of performance to shallow methods for modeling bioactivity data

Koutsoukas, A., Monaghan, K. J., Li, X., & Huan, J. (2017) · Journal of Cheminformatics · doi:10.1186/s13321-017-0226-y · Cited by 315

Results of the 2020 fastMRI challenge for machine learning MR image reconstruction

Muckley, M. J., Riemenschneider, B., Radmanesh, A., Kim, S., Jeong, G., Ko, J., Jun, Y., Shin, H., Hwang, D., Mostapha, M., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3075856 · Cited by 313

Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity

Nessler, B., Pfeiffer, M., Buesing, L., & Maass, W. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003037 · Cited by 281

Convolutional Neural Networks for patient-specific ECG classification

Kiranyaz, S., Ince, T., Hamila, R., & Gabbouj, M. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318926 · Cited by 309

A Survey of Handwritten Character Recognition with MNIST and EMNIST

Baldominos, A., Saez, Y., & Isasi, P. (2019) · Applied Sciences · doi:10.3390/app9153169 · Cited by 279

Artificial intelligence in drug discovery: what is realistic, what are illusions? Part 2: a discussion of chemical and biological data

Bender, A., & Cortes-Ciriano, I. (2021) · Drug Discovery Today · doi:10.1016/j.drudis.2020.11.037 · Cited by 232

SAR target recognition based on deep learning

Chen, S., & Wang, H. (2014) · 2014 International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2014.7058124 · Cited by 224

The state of the art of deep learning models in medical science and their challenges

Bhatt, C., Kumar, I., Vijayakumar, V., Singh, K. U., & Kumar, A. (2021) · Multimedia Systems · doi:10.1007/s00530-020-00694-1 · Cited by 222

The hardware lottery

Hooker, S. (2021) · Communications of the ACM · doi:10.1145/3467017 · Cited by 211

From neural PCA to deep unsupervised learning

Valpola, H. (2015) · Advances in Independent Component Analysis and Learning Machines · doi:10.1016/b978-0-12-802806-3.00008-7 · Cited by 181

Fully Connected Cascade Artificial Neural Network Architecture for Attention Deficit Hyperactivity Disorder Classification From Functional Magnetic Resonance Imaging Data

Deshpande, G., Wang, P., Rangaprakash, D., & Wilamowski, B. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2379621 · Cited by 161

Multi-column Deep Neural Networks for Image Classification

Cireşan, D., Meier, U., & Schmidhuber, J. (2012) · arXiv · doi:10.48550/arxiv.1202.2745 · Cited by 53

CNN architecture comparison for radio galaxy classification

Becker, B., Vaccari, M., Prescott, M., & Grobler, T. (2021) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stab325 · Cited by 50

Deep Big Multilayer Perceptrons for Digit Recognition

Cireşan, D. C., Meier, U., Gambardella, L. M., & Schmidhuber, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_31 · Cited by 48

Decomposition Methods for Machine Learning with Small, Incomplete or Noisy Datasets

Caiafa, C. F., Solé-Casals, J., Marti-Puig, P., Zhe, S., & Tanaka, T. (2020) · Applied Sciences · doi:10.3390/app10238481 · Cited by 33

Deep Predictive Learning: A Comprehensive Model of Three Visual Streams

O'Reilly, R. C., Wyatte, D. R., & Rohrlich, J. (2017) · arXiv · doi:10.48550/arxiv.1709.04654 · Cited by 26