Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review

Deep Residual Learning for Image Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474

Very Deep Convolutional Networks for Large-Scale Image Recognition

Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148

Long Short-Term Memory

Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946

Deep learning

LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126

Gradient-based learning applied to document recognition

Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805

Densely Connected Convolutional Networks

Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566

Going deeper with convolutions

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562

ImageNet Large Scale Visual Recognition Challenge

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380

The Nature of Statistical Learning Theory

Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138

Untitled work

(2014) · Cited by 33,419

Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation

Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684

Rethinking the Inception Architecture for Computer Vision

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138

Learning representations by back-propagating errors

Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892

Learning Multiple Layers of Features from Tiny Images

Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889

Reducing the dimensionality of data with neural networks

Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928

Xception: Deep Learning with Depthwise Separable Convolutions

Chollet, F. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.195 · Cited by 20,380

Auto-Encoding Variational Bayes

Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067

Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification

He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741

Deep learning in neural networks: an overview

Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570

Proceedings of IEEE Conference on Computer Vision and Pattern Recognition

(1993) · doi:10.1109/cvpr.1993 · Cited by 17,989

A fast learning algorithm for deep belief nets

Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336

A new optimizer using particle swarm theory

Eberhart, R., & Kennedy, J. (2002) · MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science · doi:10.1109/mhs.1995.494215 · Cited by 16,067

Advances in Neural Information Processing Systems 19

(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 16,043

Visualizing and understanding convolutional networks

Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint

Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273

FaceNet: A unified embedding for face recognition and clustering

Schroff, F., Kalenichenko, D., & Philbin, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298682 · Cited by 15,267

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204

Untitled work

(2010) · Cited by 14,134

Untitled work

(2010) · International Conference on Machine Learning · Cited by 13,995

Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex

Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680

Representation Learning: A Review and New Perspectives

Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001

Advances in Neural Information Processing Systems 25

Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653

Aggregated Residual Transformations for Deep Neural Networks

Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465

Backpropagation Applied to Handwritten Zip Code Recognition

LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891

Proceedings of the 24th international conference on Machine learning

(2007) · doi:10.1145/1273496 · Cited by 11,869

Caffe: Convolutional Architecture for Fast Feature Embedding

Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077

Identity mappings in deep residual networks

He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741

Learning long-term dependencies with gradient descent is difficult

Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542

Domain-Adversarial Training of Neural Networks

Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, V. (2017) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-3-319-58347-1_10 · Cited by 8,318

Untitled work

(2010) · Cited by 8,261

Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories

Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916

Multi-scale context aggregation by dilated convolutions

Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738

Learning Deep Architectures for AI

Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 7,330

Wide Residual Networks

Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244

Untitled work

(2011) · Cited by 6,993

Recent advances in convolutional neural networks

Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576

DeepFace: Closing the Gap to Human-Level Performance in Face Verification

Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542

Improving neural networks by preventing co-adaptation of feature detectors

Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382

Show and tell: A neural image caption generator

Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318

SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size

Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201

Large-Scale Machine Learning with Stochastic Gradient Descent

Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795

Proceedings of the 19th International Joint Conference on Artificial Intelligence

Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771

Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position

Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759

Dimensionality Reduction by Learning an Invariant Mapping

Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336

ADADELTA: An Adaptive Learning Rate Method

Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322

Learning Deep Architectures for AI

Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,050

WaveNet: a generative model for raw audio

Oord, A. V. D., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1609.03499 · Cited by 4,911

Deep visual-semantic alignments for generating image descriptions

Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902

Training Products of Experts by Minimizing Contrastive Divergence

Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 2×

Receptive fields of single neurones in the cat's striate cortex

Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653

Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning

Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636

Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)

Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513

CNN Features Off-the-Shelf: An Astounding Baseline for Recognition

Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451

XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks

Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408

Reading digits in natural images with unsupervised feature learning

Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261

Learning a Similarity Metric Discriminatively, with Application to Face Verification

Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036

Multi-column deep neural networks for image classification

Ciresan, D. C., Meier, U., & Schmidhuber, J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248110 · Cited by 3,880

Untitled work

(2013) · Cited by 3,740

Untitled work

(2006) · Cited by 3,624

Some Mathematical Notes on Three-Mode Factor Analysis

Tucker, L. R. (1966) · Psychometrika · doi:10.1007/bf02289464 · Cited by 3,492

Deep Learning: Methods and Applications

Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480

Striving for Simplicity: The All Convolutional Net

Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447

Return of the Devil in the Details: Delving Deep into Convolutional Nets

Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335

Deep neural networks are easily fooled: High confidence predictions for unrecognizable images

Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258

Distillation as a Defense to Adversarial Perturbations Against Deep Neural Networks

Papernot, N., McDaniel, P. D., Wu, X., Jha, S., & Swami, A. (2016) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2016.41 · Cited by 3,251

On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities

Vapnik, V. N., & Chervonenkis, A. Y. (2015) · Springer eBooks · doi:10.1007/978-3-319-21852-6_3 · Cited by 3,176

Face recognition: a convolutional neural-network approach

Lawrence, S., Giles, C. L., Tsoi, A. C., & Back, A. D. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.554195 · Cited by 3,092

Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition

He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034

One-shot learning of object categories

Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029

Linear spatial pyramid matching using sparse coding for image classification

Yang, J., Yu, K., Gong, Y., & Huang, T. S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206757 · Cited by 2,895

Advances in Neural Information Processing Systems 37

Touretzky, D. S. (2024) · doi:10.52202/079017 · Cited by 2,874

Best practices for convolutional neural networks applied to visual document analysis

Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2003.1227801 · Cited by 2,862

Tensor-Train Decomposition

Oseledets, I. V. (2011) · SIAM Journal on Scientific Computing · doi:10.1137/090752286 · Cited by 2,860

FitNets: Hints for Thin Deep Nets

Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859

Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences

Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789

Proceedings of the International Joint Conference on Artificial Intelligence 2007

Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761

An analysis of single-layer networks in unsupervised feature learning

Coates, A., Ng, A. Y., & Lee, H. (2011) · Cited by 2,760

Advances in Neural Information Processing Systems 20

Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,701

Proceedings of the 23rd international conference on Machine learning

Cohen, W. W., & Moore, A. (2006) · Cited by 2,647

End-to-End Training of Deep Visuomotor PoliciesPreprint

Levine, S., Finn, C., Darrell, T., & Abbeel, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00702 · Cited by 2,641

Improving the Fisher Kernel for Large-Scale Image Classification

Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588

Deep learning for visual understanding: A review

Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.116 · Cited by 2,504

On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities

Vapnik, V. N., & Chervonenkis, A. Y. (1971) · Theory of Probability & Its Applications · doi:10.1137/1116025 · Cited by 2,448

Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations

Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412

On the momentum term in gradient descent learning algorithms

Ning Qian, A. (1999) · Neural Networks · doi:10.1016/s0893-6080(98)00116-6 · Cited by 2,318

Untitled work

(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274

Empirical Evaluation of Rectified Activations in Convolutional Network

Xu, B., Wang, N., Chen, T., & Li, M. (2015) · arXiv · doi:10.48550/arxiv.1505.00853 · Cited by 2,264

Convolutional networks and applications in vision

LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213

Why Does Unsupervised Pre-training Help Deep Learning?

Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Cited by 2,180

What is the best multi-stage architecture for object recognition?

Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153

Neural Networks: Tricks of the Trade: Second Edition

(2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8 · Cited by 2,116 · cited 1×

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics 2016

Murray, I., & Graham, M. M. (2016) · Cited by 2,115

Deep Networks with Stochastic Depth

Huang, G., Sun, Y., Liu, Z., Sedra, D., & Weinberger, K. Q. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_39 · Cited by 2,104

Signature Verification Using A "Siamese" Time Delay Neural Network

BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000339 · Cited by 2,077

Untitled work

(2013) · Cited by 2,056

Deep Learning Face Representation from Predicting 10,000 Classes

Sun, Y. J., Wang, X., & Tang, X. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.244 · Cited by 2,023

Proceedings of The 32nd International Conference on Machine Learning

Germain, M., Gregor, K., Murray, I., & Larochelle, H. (2015) · Cited by 2,020

EIE: efficient inference engine on compressed deep neural network

Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001163 · Cited by 1,937

Advances in Neural Information Processing Systems 18

Murray, I., Mackay, D., Zoubin Ghahramani, A., & Skilling, J. (2006) · Cited by 1,927

Advances in Neural Information Processing Systems 21

Griffiths, T. L., Lucas, C. G., Williams, J. J., & Kalish, M. L. (2009) · neural information processing systems · Cited by 1,854

Proceedings for the 5th International Conference on Learning Representations

Srivastava, A., & Sutton, C. A. (2017) · Cited by 1,829

Deep Learning: Methods and Applications

Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,789

Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition

Scherer, D., Müller, A., & Behnke, S. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15825-4_10 · Cited by 1,603

Convolutional neural networks at constrained time cost

He, K., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299173 · Cited by 1,558

Connectionist learning procedures

Hinton, G. E. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90049-0 · Cited by 1,505

Aggregating Local Image Descriptors into Compact Codes

Jegou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., & Schmid, C. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.235 · Cited by 1,503

The pyramid match kernel: discriminative classification with sets of image features

Grauman, K. L., & Darrell, T. (2005) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2005.239 · Cited by 1,500

Face recognition in unconstrained videos with matched background similarity

Wolf, L., Hassner, T., & Maoz, I. (2011) · doi:10.1109/cvpr.2011.5995566 · Cited by 1,426

Attribute and simile classifiers for face verification

Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459250 · Cited by 1,403

One weird trick for parallelizing convolutional neural networksPreprint

Krizhevsky, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.5997 · Cited by 1,372

Efficient object localization using Convolutional Networks

Tompson, J., Goroshin, R., Jain, A., LeCun, Y., & Bregler, C. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298664 · Cited by 1,365

CNN-RNN: A Unified Framework for Multi-label Image Classification

Wang, J., Yang, Y., Mao, J., Huang, Z., Huang, C., & Xu, W. H. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.251 · Cited by 1,345

Learning methods for generic object recognition with invariance to pose and lighting

LeCun, Y., Huang, F. J., & Bottou, L. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315150 · Cited by 1,324

Adaptive deconvolutional networks for mid and high level feature learning

Zeiler, M. D., Taylor, G. W., & Fergus, R. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126474 · Cited by 1,293

Large-Margin Softmax Loss for Convolutional Neural NetworksPreprint

Liu, W., Wen, Y., Yu, Z., & Yang, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.02295 · Cited by 1,287

The German Traffic Sign Recognition Benchmark: A multi-class classification competition

Stallkamp, J., Schlipsing, M., Salmen, J., & Igel, C. (2011) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2011.6033395 · Cited by 1,242

Untitled work

(2011) · doi:10.5591/978-1-57735-516-8/ijcai11-210 · Cited by 1,229

A guide to convolution arithmetic for deep learningPreprint

Dumoulin, V., & Visin, F. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.07285 · Cited by 1,223

The neocortical circuit: themes and variations

Harris, K. D., & Shepherd, G. M. G. (2015) · Nature Neuroscience · doi:10.1038/nn.3917 · Cited by 1,215

A Theoretical Analysis of Feature Pooling in Visual Recognition

Boureau, Y.-L., Ponce, J., & LeCun, Y. (2010) · Cited by 1,196

Speeding up Convolutional Neural Networks with Low Rank Expansions

Jaderberg, M., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.88 · Cited by 1,164

Deep, Big, Simple Neural Nets for Handwritten Digit Recognition

Ciresan, D. C., Meier, U., Gambardella, L. M., & Schmidhuber, J. (2010) · Neural Computation · doi:10.1162/neco_a_00052 · Cited by 1,143

A sparse texture representation using local affine regions

Lazebnik, S., Schmid, C., & Ponce, J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.151 · Cited by 1,138

SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition

Zhang, H., Berg, A. C., Maire, M., & Malik, J. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.301 · Cited by 1,138

Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition

Ranzato, M., Huang, F. J., Boureau, Y.-L., & LeCun, Y. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383157 · Cited by 1,130

Group Invariant Scattering

Mallat, S. (2012) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.21413 · Cited by 1,127

Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours

Pinto, L., & Gupta, A. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487517 · Cited by 1,099

Multi-scale Orderless Pooling of Deep Convolutional Activation Features

Gong, Y., Wang, L., Guo, R., & Lazebnik, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_26 · Cited by 1,057

The Art of Data Augmentation

van Dyk, D. A., & Meng, X.-L. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/10618600152418584 · Cited by 1,052

Compressing Deep Convolutional Networks using Vector QuantizationPreprint

Gong, Y., Liu, L., Yang, M., & Bourdev, L. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6115 · Cited by 1,047

Recurrent convolutional neural network for object recognition

Liang, M., & Hu, X. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298958 · Cited by 1,028

An empirical evaluation of deep architectures on problems with many factors of variation

Larochelle, H., Erhan, D., Courville, A. C., Bergstra, J., & Bengio, Y. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273556 · Cited by 1,024

Stochastic Pooling for Regularization of Deep Convolutional Neural NetworksPreprint

Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 1,010

Exact solutions to the nonlinear dynamics of learning in deep linear neural networksPreprint

Saxe, A., McClelland, J. L., & Ganguli, S. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6120 · Cited by 1,010

Compressing Neural Networks with the Hashing Trick

Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv · doi:10.48550/arxiv.1504.04788 · Cited by 974

Deeply learned face representations are sparse, selective, and robust

Sun, Y. J., Wang, X., & Tang, X. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298907 · Cited by 958

Fast Algorithms for Convolutional Neural Networks

Lavin, A., & Gray, S. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.435 · Cited by 953

A model of neuronal responses in visual area MT

Simoncelli, E. P., & Heeger, D. J. (1998) · Vision Research · doi:10.1016/s0042-6989(97)00183-1 · Cited by 941

Deep Learning using Linear Support Vector MachinesPreprint

Tang, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0239 · Cited by 891

Generalization and network design strategies

LeCun, Y. (1989) · Cited by 885

Deeplysupervised netsPreprint

Lee, C., Xie, S., Gallagher, P., Zhang, Z., & Tu, Z. (2015) · Cited by 850

DeepID3: Face Recognition with Very Deep Neural NetworksPreprint

Sun, Y. J., Liang, D., Wang, X., & Tang, X. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.00873 · Cited by 842

Multiple Object Recognition with Visual Attention

Ba, J., Mnih, V., & Kavukcuoglu, K. (2014) · arXiv · doi:10.48550/arxiv.1412.7755 · Cited by 808

Deep Relative Distance Learning: Tell the Difference between Similar Vehicles

Liu, H., Tian, Y., Wang, Y., Pang, L., & Huang, T. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.238 · Cited by 806

Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position

Fukushima, K., & Miyake, S. (1982) · Pattern Recognition · doi:10.1016/0031-3203(82)90024-3 · Cited by 768

A tutorial survey of architectures, algorithms, and applications for deep learning

Deng, L. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2013.9 · Cited by 747

Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile ApplicationsPreprint

Kim, Y., Park, E., Yoo, S., Choi, T., Lu, Y., & Shin, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06530 · Cited by 736

Discriminative learned dictionaries for local image analysis

Mairal, J., Bach, F., Ponce, J., Sapiro, G., & Zisserman, A. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587652 · Cited by 735

The Loss Surfaces of Multilayer Networks

Choromanska, A., Henaff, M., Mathieu, M., Arous, G. B., & LeCun, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.0233 · Cited by 733

Max-pooling convolutional neural networks for vision-based hand gesture recognition

Nagi, J., Ducatelle, F., Di, G. A., Ciresan, D. C., Meier, U., Giusti, A., Nagi, F., Schmidhuber, J., & Gambardella, L. M. (2011) · IEEE International Conference on Signal and Image Processing Applications (ICSIPA) · doi:10.1109/icsipa.2011.6144164 · Cited by 691

Towards Deep Neural Network Architectures Robust to Adversarial ExamplesPreprint

Gu, S., & Rigazio, L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5068 · Cited by 658

Regularizing Neural Networks by Penalizing Confident Output Distributions

Pereyra, G., Tucker, G., Chorowski, J., Kaiser, Ł., & Hinton, G. (2017) · arXiv · doi:10.48550/arxiv.1701.06548 · Cited by 655

Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification

Chen, D., Cao, X., Wen, F., & Sun, J. Z. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.389 · Cited by 624

Training Invariant Support Vector Machines

DeCoste, D., & Schölkopf, B. (2002) · Machine Learning · doi:10.1023/a:1012454411458 · Cited by 599

Simplifying Neural Networks by Soft Weight-Sharing

Nowlan, S. J., & Hinton, G. E. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.473 · Cited by 595

Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets

Sainath, T. N., Kingsbury, B., Sindhwani, V., Arisoy, E., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638949 · Cited by 593

On-line Learning and Stochastic Approximations

Bottou, L. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511569920.003 · Cited by 585

Deep Learning of Representations: Looking Forward

Bengio, Y. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39593-2_1 · Cited by 568

Arithmetic Complexity of Computations

Winograd, S. (1980) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611970364 · Cited by 547

Learning Activation Functions to Improve Deep Neural NetworksPreprint

Agostinelli, F., Hoffman, M. D., Sadowski, P., & Baldi, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6830 · Cited by 539

Encoding Time Series as Images for Visual Inspection and Classification Using Tiled Convolutional Neural Networks

Wang, Z., & Oates, T. (2015) · National Conference on Artificial Intelligence · Cited by 500

Bio-inspired artificial intelligence: theories, methods, and technologies

(2009) · Choice Reviews Online · doi:10.5860/choice.46-4490 · Cited by 497

Untitled work

(2006) · Cited by 490

Deep spatial autoencoders for visuomotor learning

Finn, C., Tan, X., Duan, Y., Darrell, T., Levine, S., & Abbeel, P. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487173 · Cited by 488

Labeled Faces in the Wild: A Survey

Miller, E. G., Huang, G. B., RoyChowdhury, A., Li, H., & Hua, G. (2016) · Springer eBooks · doi:10.1007/978-3-319-25958-1_8 · Cited by 471

Mixed Pooling for Convolutional Neural Networks

Yu, D., Wang, H., Chen, P., & Wei, Z. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11740-9_34 · Cited by 469

Large Scale Transductive SVMs

Collobert, R., Sinz, F. H., Weston, J., & Bottou, L. (2006) · Cited by 463

Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure

Salakhutdinov, R., & Hinton, G. E. (2007) · Cited by 437

A Mathematical Theory of Deep Convolutional Neural Networks for Feature Extraction

Wiatowski, T., & Bölcskei, H. (2017) · IEEE Transactions on Information Theory · doi:10.1109/tit.2017.2776228 · Cited by 427

GPU implementation of neural networks

Oh, K., & Jung, K. (2004) · Pattern Recognition · doi:10.1016/j.patcog.2004.01.013 · Cited by 424

Distributional Smoothing with Virtual Adversarial TrainingPreprint

Miyato, T., Maeda, S., Koyama, M., Nakae, K., & Ishii, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.00677 · Cited by 418

Deep multiple instance learning for image classification and auto-annotation

Wu, J., Yu, Y., Huang, C., & Yu, K. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298968 · Cited by 414

Neural Machine Translation in Linear Time

Kalchbrenner, N., Espeholt, L., Simonyan, K., Oord, A. V. D., Graves, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1610.10099 · Cited by 414 · cited 2×

Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized ModelsPreprint

Ioffe, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03275 · Cited by 413

Learning visual similarity for product design with convolutional neural networks

Bell, S., & Bala, K. (2015) · ACM Transactions on Graphics · doi:10.1145/2766959 · Cited by 408

Large-scale image classification: Fast feature extraction and SVM training

Lin, Y., Lv, F., Shenghuo Zhu, B., Yan, S., Cour, T., Yu, K., Cao, L., & Huang, T. S. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995477 · Cited by 399

Deep learning via semi-supervised embedding

Weston, J., Ratle, F., & Collobert, R. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390303 · Cited by 393

Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and TreePreprint

Lee, C., Gallagher, P. W., & Zhuowen Tu, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.08985 · Cited by 386

Grid Long Short-Term MemoryPreprint

Kalchbrenner, N., Danihelka, I., & Graves, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.01526 · Cited by 382

Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation

Turaga, S. C., Murray, J. F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., & Seung, H. S. (2010) · Neural Computation · doi:10.1162/neco.2009.10-08-881 · Cited by 376

Fast Training of Convolutional Networks through FFTs

Mathieu, M., Henaff, M., & LeCun, Y. (2014) · International Conference on Learning Representations · Cited by 347

Analysis of classifiers’ robustness to adversarial perturbations

Fawzi, A., Fawzi, O., & Frossard, P. (2017) · Machine Learning · doi:10.1007/s10994-017-5663-3 · Cited by 340

The dropout learning algorithm

Baldi, P., & Sadowski, P. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.02.004 · Cited by 340

Fractional Max-Pooling

Graham, B. (2014) · arXiv · doi:10.48550/arxiv.1412.6071 · Cited by 337

Convolutional Neural Networks Applied to House Numbers Digit ClassificationPreprint

Sermanet, P., Chintala, S., & LeCun, Y. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1204.3968 · Cited by 336

Learning with a Strong AdversaryPreprint

Huang, R., Xu, B. H., Schuurmans, D., & Szepesvári, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03034 · Cited by 335

Large-scale Learning with SVM and Convolutional for Generic Object Categorization

Huang, F. J., & LeCun, Y. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.164 · Cited by 326

Untitled work

(2013) · Cited by 326

An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections

Cheng, Y., Yu, F. X., Feris, R., Kumar, S., Choudhary, A., & Chang, S.-F. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.327 · Cited by 316

A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures

Yu, Y., Si, X., Hu, C., & Zhang, J. (2019) · Neural Computation · doi:10.1162/neco_a_01199 · Cited by 5,870

A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects

Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273

ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data

Diakogiannis, F. I., Waldner, F., Caccetta, P. A., & Wu, C. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.01.013 · Cited by 2,295

A State-of-the-Art Survey on Deep Learning Theory and Architectures

Alom, M. Z., Taha, T. M., Yakopcic, C., Westberg, S. K. E., Sidike, P., Nasrin, M. S., Hasan, M., Essen, B. C. V., Awwal, A. A. S., & Asari, V. K. (2019) · Electronics · doi:10.3390/electronics8030292 · Cited by 1,722

Deep learning in spiking neural networks

Tavanaei, A., Ghodrati, M., Kheradpisheh, S. R., Masquelier, T., & Maida, A. S. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.12.002 · Cited by 1,522

Major Convolutional Neural Networks in Image Classification: A Survey

Kumar, N., Kaur, N., & Gupta, D. (2020) · Lecture notes in networks and systems · doi:10.1007/978-981-15-3020-3_23 · Cited by 17

Development of convolutional neural network and its application in image classification: a survey

Wang, W., Yang, Y., Wang, X., Wang, W., & Li, J. (2019) · Optical Engineering · doi:10.1117/1.oe.58.4.040901 · Cited by 252

Advancements in Convolutional Neural Networks for Image Classification and Detection

Vasudha Joshi Gupta, V. P. D. (2023) · PhilPapers (PhilPapers Foundation)

A Review of Convolutional Neural Networks: Evolution, Applications, and Future Directions

Wang, A. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2025.tj24492 · Cited by 1

Application of Deep Convolution Neural Network for Image Classification: A Review

(2022) · International Journal of Advanced Trends in Computer Science and Engineering · doi:10.30534/ijatcse/2022/011122022 · Cited by 1