The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Multi-column deep neural networks for image classification
Abstract
Traditional methods of computer vision and machine learning cannot match human performance on tasks such as the recognition of handwritten digits or traffic signs. Our biologically plausible, wide and deep artificial neural network architectures can. Small (often minimal) receptive fields of convolutional winner-take-all neurons yield large network depth, resulting in roughly as many sparsely connected neural layers as found in mammals between retina and visual cortex. Only winner neurons are trained. Several deep neural columns become experts on inputs preprocessed in different ways; their predictions are averaged. Graphics cards allow for fast training. On the very competitive MNIST handwriting benchmark, our method is the first to achieve near-human performance. On a traffic sign recognition benchmark it outperforms humans by a factor of two. We also improve the state-of-the-art on a plethora of common image classification benchmarks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Self-Organization and Associative Memory
Kohonen, T. (1989) · Springer Series in Information Sciences · doi:10.1007/978-3-642-88163-3 · Cited by 8,740
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
Receptive fields of single neurones in the cat's striate cortex
Hubel, D. H., & Wiesel, T. N. (1959) · The Journal of Physiology · doi:10.1113/jphysiol.1959.sp006308 · Cited by 4,653
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309
Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences
Werbos, P. J. (1974) · Medical Entomology and Zoology · Cited by 2,789
Cited by
Items 201–224 of 224
Learning for Personalized Medicine: A Comprehensive Review From a Deep Learning Perspective
Zhang, S., Bamakan, S. M. H., Qu, Q., & Li, S. (2019) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2018.2864254 · Cited by 125
Deep learning in biomedical data science
Baldi, P. (2018) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-080917-013343 · Cited by 119
Morpheus: A Deep Learning Framework for the Pixel-level Analysis of Astronomical Image Data
Hausen, R., & Robertson, B. E. (2020) · The Astrophysical Journal Supplement Series · doi:10.3847/1538-4365/ab8868 · Cited by 110
“The first half of the model is a contraction phase, where each block is followed by a max pooling operation (Cireşan et al. 2012, and Appendix A.4.1).”
MethodInfluentialNeural networks for computer-aided diagnosis in medicine: A review
lin, D., Vasilakos, A. V., Tang, Y., & Yao, Y. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.08.039 · Cited by 105
Multicolumn bidirectional long short-term memory for mobile devices-based human activity recognition
Tao, D., Wen, Y., & Hong, R. (2016) · IEEE Internet of Things Journal · doi:10.1109/jiot.2016.2561962 · Cited by 83
Vision-Language Navigation with Random Environmental Mixup
Liu, C., Zhu, F., Chang, X., Liang, X., Ge, Z., & Shen, Y.-D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00167 · Cited by 80
Qin, C., Liu, E., Feng, G., & Zhang, X. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3047142 · Cited by 78
Deep Feature Learning with Discrimination Mechanism for Brain Tumor Segmentation and Diagnosis
Zhao, L., & Jia, K. (2015) · 2015 International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) · doi:10.1109/iih-msp.2015.41 · Cited by 67
Real-Time Reservoir Computing Network-Based Systems for Detection Tasks on Visual Contents
Jalalvand, A., Van Wallendael, G., & Van De Walle, R. (2015) · 2015 7th International Conference on Computational Intelligence, Communication Systems and Networks · doi:10.1109/cicsyn.2015.35 · Cited by 63
Counterexample-Guided Data Augmentation
Dreossi, T., Ghosh, S., Yue, X., Keutzer, K., Sangiovanni-Vincentelli, A., & Seshia, S. A. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/286 · Cited by 60
Deep Big Multilayer Perceptrons for Digit Recognition
Cireşan, D. C., Meier, U., Gambardella, L. M., & Schmidhuber, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_31 · Cited by 48
Self-citationLee, K., Famiglietti, M. L., McMahon, A., Wei, C.-H., MacArthur, J. A. L., Poux, S., Breuza, L., Bridge, A., Cunningham, F., Xenarios, I., et al. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006390 · Cited by 47
Qin, Y., Luo, H., Zhao, F., Wang, C., Wang, J., & Zhang, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2944686 · Cited by 46
Multi-clue fusion for emotion recognition in the wild
Yan, J., Zheng, W., Cui, Z., Tang, C., Zhang, T., Zong, Y., & Sun, N. (2016) · Proceedings of the 18th ACM International Conference on Multimodal Interaction · doi:10.1145/2993148.2997630 · Cited by 42
Liu, Y., Zhang, S., & Gowda, M. (2021) · Proceedings of the International Conference on Internet-of-Things Design and Implementation · doi:10.1145/3450268.3453537 · Cited by 39
Nnabuife, S. G., Kuang, B., Whidborne, J. F., & Rana, Z. A. (2023) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2021.3084860 · Cited by 32
Research on fault diagnosis of hydraulic pump using convolutional neural network
Yan, J., Zhu, H., Yang, X., Cao, Y., & Shao, L. (2016) · Journal of Vibroengineering · doi:10.21595/jve.2016.16956 · Cited by 30
Using deep learning and electronic health records to detect Noonan syndrome in pediatric patients
Yang, Z., Shikany, A., Ni, Y., Zhang, G., Weaver, K. N., & Chen, J. (2022) · Genetics in Medicine · doi:10.1016/j.gim.2022.08.002 · Cited by 20
Detecting clinical medication errors with AI enabled wearable cameras
Chan, J., Nsumba, S., Wortsman, M., Dave, A., Schmidt, L., Gollakota, S., & Michaelsen, K. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01295-2 · Cited by 18
Human in the AI Loop via xAI and Active Learning for Visual Inspection
Rožanec, J. M., Montini, E., Cutrona, V., Papamartzivanos, D., Klemenčič, T., Fortuna, B., Mladenić, D., Veliou, E., Giannetsos, T., & Emmanouilidis, C. (2024) · Artificial Intelligence in Manufacturing · doi:10.1007/978-3-031-46452-2_22 · Cited by 17
Accelerating the characterization of dynamic DNA origami devices with deep neural networks
Wang, Y., Jin, X., & Castro, C. (2023) · Scientific Reports · doi:10.1038/s41598-023-41459-w · Cited by 16
Hailat, Z., Komarichev, A., & Chen, X.-W. (2018) · 2018 24th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2018.8546327 · Cited by 13
aSGD: Stochastic Gradient Descent with Adaptive Batch Size for Every Parameter
Shi, H., Yang, N., Tang, H., & Yang, X. (2022) · Mathematics · doi:10.3390/math10060863 · Cited by 11
Cyberbullying Detection using Recursive Neural Network through Offline Repository
Chandra, N., Khatri, S. K., & Som, S. (2018) · 2018 7th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) · doi:10.1109/icrito.2018.8748570 · Cited by 9
Metadata
- Authors
- Ciresan, D., Meier, U., & Schmidhuber, J.
- Venue
- 2012 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 3642-3649
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2141125852
- Cited by
- 3,720
- References
- 37
- FWCI
- 101.42
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.