Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position
The DOI matches its Crossref record; 12 of the 13 references it cites were found in a registry or an index.
Abstract
A neural network model for a mechanism of visual pattern recognition is proposed in this paper. The network is self-organized by "learning without a teacher", and acquires an ability to recognize stimulus patterns based on the geometrical similarity (Gestalt) of their shapes without affected by their positions. This network is given a nickname "neocognitron". After completion of self-organization, the network has a structure similar to the hierarchy model of the visual nervous system proposed by Hubel and Wiesel. The network consists of an input layer (photoreceptor array) followed by a cascade connection of a number of modular structures, each of which is composed of two layers of cells connected in a cascade. The first layer of each module consists of "S-cells", which show characteristics similar to simple cells or lower order hypercomplex cells, and the second layer consists of "C-cells" similar to complex cells or higher order hypercomplex cells. The afferent synapses to each S-cell have plasticity and are modifiable. The network has an ability of unsupervised learning: We do not need any "teacher" during the process of self-organization, and it is only needed to present a set of stimulus patterns repeatedly to the input layer of the network. The network has been simulated on a digital computer. After repetitive presentation of a set of stimulus patterns, each stimulus pattern has become to elicit an output only from one of the C-cells of the last layer, and conversely, t…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Beyond the single-unit design discussed here, artificial neural networks were inspired by another seemingly universal design principle associated with cortical architecture [255]: the presence of multiple processing layers (such as those found in the visual cortex).”
From Fundamental constraints to the logic of living systems (2024) · cites this paper as [255]
In the citing paper
“Convolutional neural networks (CNNs) constitute one such class of models.9,15,17,19,21,26,32”
From ImageNet classification with deep convolutional neural networks (2017) · cites this paper as [9]
In the citing paper
“In the early 1980s, three new classes of NNs emerged, namely Convolutional Neural Network (CNN) [157], Self-Organizing Map (SOM) [249], and Hopfield network [195].”
From A comprehensive survey on machine learning for networking: Evolution, applications and research opportunities (2018) · cites this paper as [157]
Citations
Cites
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680
Ferrier lecture. Functional architecture of macaque monkey visual cortex
Hubel, D. H., & Wiesel, T. N. (1977) · Proceedings of the Royal Society of London. Series B. Biological Sciences · doi:10.1098/rspb.1977.0085 · Cited by 2,608
RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT
Hubel, D. H., & Wiesel, T. N. (1965) · Journal of Neurophysiology · doi:10.1152/jn.1965.28.2.229 · Cited by 2,603
Mullin, A. A., & Rosenblatt, F. (1963) · The American Mathematical Monthly · doi:10.2307/2312103 · Cited by 2,209
Visual properties of neurons in inferotemporal cortex of the Macaque.
Gross, C. G., Rocha-Miranda, C. E., & Bender, D. B. (1972) · Journal of Neurophysiology · doi:10.1152/jn.1972.35.1.96 · Cited by 1,483 · cited 1×
“), and their responses are scarcely affected by the position or the size of the stimuli (Gross et al., 1972; Sato et al., 1978).”
BackgroundCognitron: A self-organizing multilayered neural network
Fukushima, K. (1975) · Biological Cybernetics · doi:10.1007/bf00342633 · Cited by 757
Self-citationde la Tour, E. B., Bolle, A., & Kellenberger, E. (2008) · Pathologia et Microbiologia · doi:10.1159/000161635 · Cited by 147
A Proposed Model for Visual Information Processing in the Human Brain
Snider, R. S. (1967) · Neurology · doi:10.1212/wnl.17.6.625 · Cited by 52
A Proposed Model for Visual Information Processing in the Human Brain
Kabrisky, M. (1966) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 44
Feature Extraction and Recognition of Handwritten Characters by Homogeneous Layers
Giebel, H. (1971) · Springer eBooks · doi:10.1007/978-3-642-65175-5_15 · Cited by 13
Research works printed but not linked: 4
- Fukushima, K.: Improvement in pattern-selectivity of a cognitron (in Japanese). Pap. Tech. Group MBE78-27, IECE Japan (1978)
- Fukushima, K.: Self-organization of a neural network which gives position-invariant response. In: Proceedings of the Sixth International Joint Conference on Artificial Intelligence. Tokyo, August 20?23, 1979, pp. 291?293 (1979b)
- Fukushima, K.: Improvement in pattern-selectivity of a cognitron (in Japanese). Trans. IECE Japan (A), J 62-A, 650?657 (1979c)
- Meyer, R.L., Sperry, R.W.: Explanatory models for neuroplasticity in retinotectral connections. In: Plasticity and function in the central nervous system. Stein, D.G., Rosen, J.J., Butters, N. (eds.), pp. 45?63. New York, San Francisco, London: Academic Press 1974
Cited by
Items 201–300 of 1,028
From generic to specific deep representations for visual recognition
Azizpour, H., Razavian, A. S., Sullivan, J., Maki, A., & Carlsson, S. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301270 · Cited by 394
Liu, H., Agam, Y., Madsen, J. R., & Kreiman, G. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.025 · Cited by 385
“Theories of visual recognition can be largely divided into two main groups: (1) theories advocating top-down influences and long recurrent feedback connections (e.g., Bullier, 2001; Garrido et al., 2007; Hochstein and Ahissar, 2002) and (2) theories relying on a bottom-up approach and largely dependent on feedforward…”
BackgroundPulmonary Image Classification Based on Inception-v3 Transfer Learning Model
Wang, C., Chen, D., Hao, L., Liu, X., Zeng, Y., Chen, J., & Zhang, G. (2019) · IEEE Access · doi:10.1109/access.2019.2946000 · Cited by 381
“In 1980, Fukushima [14] proposed a neurocognitive machine based on visual pattern recognition mechanism which is widely regarded as the first version of the convolutional neural network.”
BackgroundA summary statistic representation in peripheral vision explains visual search
Rosenholtz, R., Huang, J., Raj, A., Balas, B. J., & Ilie, L. (2012) · Journal of Vision · doi:10.1167/12.4.14 · Cited by 389
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · Proceedings of the Fourteenth Workshop on Semantic Evaluation · doi:10.18653/v1/2020.semeval-1.188 · Cited by 378
Capabilities and Limitations of Peripheral Vision
Rosenholtz, R. (2016) · Annual Review of Vision Science · doi:10.1146/annurev-vision-082114-035733 · Cited by 378
State-of-the-Art Deep Learning in Cardiovascular Image Analysis
Litjens, G., Ciompi, F., Wolterink, J. M., de Vos, B. D., Leiner, T., Teuwen, J., & Išgum, I. (2019) · JACC: Cardiovascular Imaging · doi:10.1016/j.jcmg.2019.06.009 · Cited by 388
Four frames suffice: A provisional model of vision and space
Feldman, J. A. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00020707 · Cited by 395
Rust, N. C., & DiCarlo, J. J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0179-10.2010 · Cited by 387
“…but instead that increasing RF phenomenology is likely a reflection of more sophisticated computations designed for the discrimination of objects invariant of identity-preserving image transformations (Fukushima, 1980; Riesenhuber and Poggio, 1999; DiCarlo and Cox, 2007; Serre et al., 2007).”
BackgroundVisual Saliency Detection Based on Multiscale Deep CNN Features
Li, G., & Yu, Y. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2602079 · Cited by 394
Gearbox Fault Identification and Classification with Convolutional Neural Networks
Chen, Z., Li, C., & Sanchez, R.-V. (2015) · Shock and Vibration · doi:10.1155/2015/390134 · Cited by 391
“The first computational models are based on local connectivity between neurons and on hierarchically organized transformations of the image in Fukushima’s neocogni-tron [37].”
BackgroundDeep Crossing: Web-Scale Modeling without Manually Crafted Combinatorial Features
Shan, Y., Hoens, T. R., Jiao, J., Wang, H., Yu, D., & Mao, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939704 · Cited by 396
“In early 80s, Fukushima [6] reported a seven-layer Neocognitron network that recognized digits from raw pixels of images.”
BackgroundCatalyzing next-generation Artificial Intelligence through NeuroAI
Zador, A., Escola, S., Richards, B., Ölveczky, B., Bengio, Y., Boahen, K., Botvinick, M., Chklovskii, D., Churchland, A., Clopath, C., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37180-x · Cited by 300
Pest identification via deep residual learning in complex background
Cheng, X., Zhang, Y., Chen, Y., Wu, Y., & Yue, Y. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.08.005 · Cited by 383
How to build the virtual cell with artificial intelligence: Priorities and opportunities
Bunne, C., Roohani, Y., Rosen, Y., Gupta, A., Zhang, X., Roed, M., Alexandrov, T., AlQuraishi, M., Brennan, P., Burkhardt, D. B., et al. (2024) · Cell · doi:10.1016/j.cell.2024.11.015 · Cited by 393
“73,74 It consists of multiple layers that automatically and adaptively learn spatial hierarchies of features through backpropagation.”
Xu, Y., Quan, R., Xu, W., Huang, Y., Chen, X., & Liu, F. (2024) · Bioengineering · doi:10.3390/bioengineering11101034 · Cited by 310
Alpaydın, E. (2021) · The MIT Press eBooks · doi:10.7551/mitpress/13811.001.0001 · Cited by 374
Biometrics recognition using deep learning: a survey
Minaee, S., Abdolrashidi, A., Su, H., Bennamoun, M., & Zhang, D. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10237-x · Cited by 245
“CNNs were initially proposed by Fukushima in a seminal paper, called “Neocognitron” Fukushima (1980) (based on the model of the visual system proposed by Nobel laureates Hubel and Wiesel).”
MethodKim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 263
A committee of neural networks for traffic sign classification
Ciresan, D., Meier, U., Masci, J., & Schmidhuber, J. (2011) · The 2011 International Joint Conference on Neural Networks · doi:10.1109/ijcnn.2011.6033458 · Cited by 378
“The Neocognitron [1] inspired many of the more recent variants.”
BackgroundKhened, M., Kollerathu, V. A., & Krishnamurthi, G. (2019) · Medical Image Analysis · doi:10.1016/j.media.2018.10.004 · Cited by 373
Convolutional neural network for video fire and smoke detection
Frizzi, S., Kaabi, R., Bouchouicha, M., Ginoux, J.-M., Moreau, E., & Fnaiech, F. (2016) · IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society · doi:10.1109/iecon.2016.7793196 · Cited by 347
“CNN were first introduced by Fukushima [8], he derived a hierarchical neural network architecture inspired by Hubel’s research work [9].”
MethodDeep Learning Based Text Classification: A Comprehensive Review
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Asgari-Chenaghlu, M., & Gao, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.03705 · Cited by 381
Object Class Recognition and Localization Using Sparse Features with Limited Receptive Fields
Mutch, J., & Lowe, D. G. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0118-0 · Cited by 373
Neural mechanisms of object recognition
Riesenhuber, M., & Poggio, T. (2002) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(02)00304-5 · Cited by 377
Text feature extraction based on deep learning: a review
Liang, H., Sun, X., Sun, Y., & Gao, Y. (2017) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-017-0993-1 · Cited by 373
“Inspired, Fukushima made neurocognitive suggestions in the first implementation of CNN network and also felt that wild concept is firstly applied in the field of artificial neural network [89].”
MethodThe Role of Neural Mechanisms of Attention in Solving the Binding Problem
Reynolds, J. H., & Desimone, R. (1999) · Neuron · doi:10.1016/s0896-6273(00)80819-3 · Cited by 366
Unsupervised neural network models of the ventral visual stream
Zhuang, C., Yan, S., Nayebi, A., Schrimpf, M., Frank, M. C., DiCarlo, J. J., & Yamins, D. L. K. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2014196118 · Cited by 337
Classification of CT brain images based on deep learning networks
Gao, X. W., Hui, R., & Tian, Z. (2017) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2016.10.007 · Cited by 351
“2 Convolutional Neural Network (CNN) Deep learning models refer to a class of computing machines that can learn a hierarchy of features by building high-level attributes from low-level ones [5, 6], thereby automating the process of feature construction.”
Training Deep Convolutional Neural Networks for Land–Cover Classification of High-Resolution Imagery
Scott, G. J., England, M. R., Starms, W. A., Marcum, R. A., & Davis, C. H. (2017) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2657778 · Cited by 353
“However, convolutional neural networks (CNNs) and deep learning have experienced a resurgence within the last few years, finally realizing the promise from their conceptual development in the 1980s starting with [7].”
BackgroundCompute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363
Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey
Sultana, F., Sufian, A., & Dutta, P. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106062 · Cited by 339
Tulsiani, S., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298758 · Cited by 346
“Viewpoint Prediction: Recently, CNNs [9, 24] have been shown to outperform Deformable Part Model (DPM) [8] based methods for recognition tasks [11, 6, 23].”
BackgroundImprovement of learning for CNN with ReLU activation by sparse regularization
Ide, H., & Kurita, T. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966185 · Cited by 317
Learning Aerial Image Segmentation From Online Maps
Kaiser, P., Wegner, J. D., Lucchi, A., Jaggi, M., Hofmann, T., & Schindler, K. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2719738 · Cited by 290
“They go back to [37] and [38], but at the time were”
BackgroundCompressive spatial summation in human visual cortex
Kay, K. N., Winawer, J., Mezer, A., & Wandell, B. A. (2013) · Journal of Neurophysiology · doi:10.1152/jn.00105.2013 · Cited by 329
Deep vs. shallow networks: An approximation theory perspective
Mhaskar, H. N., & Poggio, T. (2016) · Analysis and Applications · doi:10.1142/s0219530516400042 · Cited by 322
Medical image analysis based on deep learning approach
Puttagunta, M., & Ravi, S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-10707-4 · Cited by 321
“In 1979, Fukushima [38] designed artificial neural networks called Neocognitron, with multiple pooling and convolution layers.”
MethodPalmeri, T. J., & Gauthier, I. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1364 · Cited by 328
50 Years of object recognition: Directions forward
Andreopoulos, A., & Tsotsos, J. K. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.04.005 · Cited by 347
“A number of feedforward hierarchical recognition algorithms have been proposed over the years [216, 217, 104, 218, 105, 106, 183, 184, 219, 220, 221].”
BackgroundRoskies, A. L. (1999) · Neuron · doi:10.1016/s0896-6273(00)80817-x · Cited by 327
Remote Sensing Image Fusion With Deep Convolutional Neural Network
Shao, Z., & Cai, J. (2018) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2018.2805923 · Cited by 331
“CNN [28], [30], [41] is one of the most popular networks developed in recent years because of its excellent performance in image classification [29], [30], [49], target detection [31], [32], face recognition [33], and pedestrian detection [34].”
BackgroundSteel defect classification with Max-Pooling Convolutional Neural Networks
Masci, J., Meier, U., Ciresan, D., Schmidhuber, J., & Fricout, G. (2012) · The 2012 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252468 · Cited by 345
Towards on-farm pig face recognition using convolutional neural networks
Hansen, M. F., Smith, M. L., Smith, L. N., Salter, M. G., Baxter, E. M., Farish, M., & Grieve, B. (2018) · Computers in Industry · doi:10.1016/j.compind.2018.02.016 · Cited by 329
“As far back as 1980, Fukushima [21] proposed an architecture based on the human visual receptive fields that he named the Neocognitron.”
BackgroundZhang, Z., Wen, G., & Chen, S. (2019) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2019.06.023 · Cited by 334
Research on data augmentation for image classification based on convolution neural networks
Shijie, J., Ping, W., Peiyi, J., & Siping, H. (2017) · 2017 Chinese Automation Congress (CAC) · doi:10.1109/cac.2017.8243510 · Cited by 320
“Inspired by this work, Kunihiko Fukushima made the predecessor of CNN in 1980-Neocognitron [11].”
MethodBenefits of Depth in Neural Networks
Telgarsky, M. (2016) · arXiv · doi:10.48550/arxiv.1602.04485 · Cited by 341
“…vary the number of nodes per layer; for instance, convolutional networks typically have an increase between layer 0 and layer 1, followed by exponential decrease for a few layers, and finally a few layers with the same number of nodes (Fukushima, 1980; LeCun et al., 1998; Krizhevsky et al., 2012).”
BackgroundPan, D., Zeng, A., Jia, L., Huang, Y., Frizzell, T., & Song, X. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00259 · Cited by 322
“Kunihiko Fukushima proposed a neural network model nicknamed “Neocognitron” (Fukushima, 1980) that is structurally similar to the hierarchy model of the visual nervous system proposed by Hubel and Wiesel.”
MethodLeast mean square error reconstruction principle for self-organizing neural-nets
Xu, L. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80107-8 · Cited by 341
Clustering: A neural network approach
Du, K.-L. (2010) · Neural Networks · doi:10.1016/j.neunet.2009.08.007 · Cited by 325
“Unlike the SOM (Kohonen, 1982), the Hopfield network (Hopfield, 1982), and the neocognitron (Fukushima, 1980), the ART 1 can deal with arbitrary combinations of binary input patterns.”
Scalable, High-Quality Object Detection
Szegedy, C., Reed, S., Erhan, D., Anguelov, D., & Ioffe, S. (2014) · arXiv · doi:10.48550/arxiv.1412.1441 · Cited by 333
Hao, X., Zhang, G., & Ma, S. (2016) · International Journal of Semantic Computing · doi:10.1142/s1793351x16500045 · Cited by 317
Roberts, D. A., Yaida, S., & Hanin, B. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009023405 · Cited by 231
Fundamental Concepts of Convolutional Neural Network
Ghosh, A., Sufian, A., Sultana, F., Chakrabarti, A., & De, D. (2020) · Intelligent Systems Reference Library · doi:10.1007/978-3-030-32644-9_36 · Cited by 263
A Review of Object Detection Models Based on Convolutional Neural Network
Sultana, F., Sufian, A., & Dutta, P. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-981-15-4288-6_1 · Cited by 277
Image-based object recognition in man, monkey and machine
Tarr, M. J., & Bülthoff, H. H. (1998) · Cognition · doi:10.1016/s0010-0277(98)00026-2 · Cited by 325
Artificial convolution neural network for medical image pattern recognition
Lo, S.-C. B., Chan, H.-P., Lin, J.-S., Li, H., Freedman, M. T., & Mun, S. K. (1995) · Neural Networks · doi:10.1016/0893-6080(95)00061-5 · Cited by 321
Residual networks behave like ensembles of relatively shallow networks
Veit, A., Wilber, M. J., & Belongie, S. (2016) · neural information processing systems · Cited by 851
Phung, V. H., & Rhee, E. J. (2019) · Applied Sciences · doi:10.3390/app9214500 · Cited by 283
“CNNs were inspired by the human visual system proposed by Fukushima [28] and LeCun et al.”
MethodSolutions to the Binding Problem
Treisman, A. (1999) · Neuron · doi:10.1016/s0896-6273(00)80826-0 · Cited by 313
Improved Handwritten Digit Recognition Using Convolutional Neural Networks (CNN)
Ahlawat, S., Choudhary, A., Nayyar, A., Singh, S., & Yoon, B. (2020) · Sensors · doi:10.3390/s20123344 · Cited by 303
“A convolutional neural network (CNN) is basically a variation of a multi-layer perceptron (MLP) network and was used for the first time in 1980 [7].”
MethodA Gaussian potential function network with hierarchically self-organizing learning
Lee, S., & Kil, R. M. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90005-p · Cited by 325
A neuronal model of classical conditioning
Harry Klopf, A. (1988) · Psychobiology · doi:10.3758/bf03333113 · Cited by 318
Fast image scanning with deep max-pooling convolutional neural networks
Giusti, A., Cireşan, D. C., Masci, J., Gambardella, L. M., & Schmidhuber, J. (2013) · 2013 IEEE International Conference on Image Processing · doi:10.1109/icip.2013.6738831 · Cited by 294
Deep Roots: Improving CNN Efficiency with Hierarchical Filter Groups
Ioannou, Y., Robertson, D., Cipolla, R., & Criminisi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.633 · Cited by 321
“Convolutional Neural Networks (CNNs) [6], [7] embody this idea, using a sparse convolutional connection structure to exploit the locality of natural image structure.”
BackgroundA Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem
Jiang, Z., Xu, D., & Liang, J. (2017) · arXiv · doi:10.48550/arxiv.1706.10059 · Cited by 321
“Three different species of IIEs are tested in this work, a Convolutional Neural Network (CNN) (Fukushima, 1980; Krizhevsky et al., 2012; Sermanet et al., 2012), a basic Recurrent Neural Network (RNN) (Werbos, 1988), and a Long Short Term Memory (LSTM) (Hochreiter and Schmidhuber, 1997).”
MethodInfluentialSketch-a-Net: A Deep Neural Network that Beats Humans
Yu, Q., Yang, Y., Liu, F., Song, Y.-Z., Xiang, T., & Hospedales, T. M. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0932-3 · Cited by 322
“These two types of cells correspond to convolution and pooling operators respectively in neural network models, and these two essential blocks have been commonly used by almost every model in this area since Neocognitron (Fukushima, 1980) was introduced.”
BackgroundSpectral-Spatial Unified Networks for Hyperspectral Image Classification
Xu, Y., Zhang, L., Du, B., & Zhang, F. (2018) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2018.2827407 · Cited by 316
“…for more information. include stacked autoencoders (SAEs) [40], deep belief networks (DBNs) [41], and convolutional neural networks (CNNs) [42] based on which a series of methods have been proposed, aiming at the HSI classification task [43]–[53].”
BackgroundDeep neural networks to enable real-time multimessenger astrophysics
George, D., & Huerta, E. A. (2018) · Physical Review D · doi:10.1103/physrevd.97.044039 · Cited by 281
Reminder of the First Paper on Transfer Learning in Neural Networks, 1976
Bozinovski, S. (2020) · Informatica · doi:10.31449/inf.v44i3.2828 · Cited by 286
“Although during 1970's and 1980's there were works on multilayered neural networks (e.g. Fukushima, 1975, 1980), the interest in multilayered neural networks significantly increased after 1986, due to appearance of the book by the Parallel Distributed Processing (PDP) Group (Rumelhart et al. 1986).”
BackgroundInfluentialTraffic Sign Recognition With Hinge Loss Trained Convolutional Neural Networks
Jin, J., Fu, K., & Zhang, C. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2308281 · Cited by 310
“According to cats’ visual system, many models have been proposed [11], [12].”
BackgroundResults of the 2020 fastMRI challenge for machine learning MR image reconstruction
Muckley, M. J., Riemenschneider, B., Radmanesh, A., Kim, S., Jeong, G., Ko, J., Jun, Y., Shin, H., Hwang, D., Mostapha, M., et al. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3075856 · Cited by 313
“In the field of computer vision, the basic principles of convolutional neural networks (CNNs) were proposed as early as 1980 [15] and became well-established for character recognition by 1998 [16].”
BackgroundDeepSat: a learning framework for satellite imagery
Basu, S., Ganguly, S., Mukhopadhyay, S., DiBiano, R., Karki, M., & Nemani, R. (2015) · Proceedings of the 23rd SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/2820783.2820816 · Cited by 303
“Convolutional Neural Network (CNN) first introduced in [13] is a hierarchical model inspired by the human visual cortical system [16].”
BackgroundSEMANTIC SEGMENTATION OF AERIAL IMAGES WITH AN ENSEMBLE OF CNNS
Marmanis, D., Wegner, J. D., Galliani, S., Schindler, K., Datcu, M., & Stilla, U. (2016) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprs-annals-iii-3-473-2016 · Cited by 268
“Since the ground breaking paper [Krizhevsky et al., 2012] (re-viving earlier work of [Fukushima, 1980, LeCun et al., 1989]), deep learning has quickly become the state of the art for a whole range of learning-based image analysis tasks.”
BackgroundFacial expression recognition using radial encoding of local Gabor features and classifier synthesis
Gu, W., Xiang, C., Venkatesh, Y. V., Huang, D., & Lin, H. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.05.006 · Cited by 311
High-Performance Neural Networks for Visual Object Classification
Ciresan, D. C., Meier, U., Masci, J., Gambardella, L. M., & Schmidhuber, J. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1102.0183 · Cited by 218
“One of the first hierarchical neural systems was the Neocognitron (Fukushima, 1980) which inspired many of the more recent variants.”
BackgroundMachine learning-based imaging system for surface defect inspection
Park, J.-K., Kwon, B.-K., Park, J.-H., & Kang, D.-J. (2016) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-016-0039-x · Cited by 311
How Convolutional Neural Networks Diagnose Plant Disease
Toda, Y., & Okura, F. (2019) · Plant Phenomics · doi:10.34133/2019/9237136 · Cited by 274
Object Selectivity of Local Field Potentials and Spikes in the Macaque Inferior Temporal Cortex
Kreiman, G., Hung, C. P., Kraskov, A., Quiroga, R. Q., Poggio, T., & DiCarlo, J. J. (2006) · Neuron · doi:10.1016/j.neuron.2005.12.019 · Cited by 310
“…the selectivity of IT *Correspondence: kreiman@mit.edu 7 These authors contributed equally to this work. neurons arises from nonlinear transformations iterated along the cortical ventral visual hierarchy (Felleman and Van Essen, 1991; Fukushima, 1980; Gross, 1994; Riesenhuber and Poggio, 1999).”
BackgroundA deep feature based framework for breast masses classification
Jiao, Z., Gao, X., Wang, Y., & Li, J. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.02.060 · Cited by 304
“The powerful structures were introduced by Fukushima [29].”
BackgroundReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation
Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 281
“eSeg can perform successfully on the object segmentation task, and may have further applications in structured prediction at large. 1 INTRODUCTION In recent years, convolutional neural networks (CNN, Fukushima, 1980; LeCun et al., 1989) have become de facto standard in many computer vision tasks. Object classification…”
MethodMalware identification using visualization images and deep learning
Ni, S., Qian, Q., & Zhang, R. (2018) · Computers & Security · doi:10.1016/j.cose.2018.04.005 · Cited by 299
Rolls, E. T. (2000) · Neuron · doi:10.1016/s0896-6273(00)00030-1 · Cited by 302
Convolutional Neural Networks for Steel Surface Defect Detection from Photometric Stereo Images
Soukup, D., & Huber-Mörk, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-14249-4_64 · Cited by 286
“CNNs are usually trained in supervised fashion, although the Neocognitron [13], which could be regarded as a predecessor of the CNN, was suggested to be trained in self-organized fashion.”
BackgroundFactors of Transferability for a Generic ConvNet Representation
Azizpour, H., Razavian, A. S., Sullivan, J., Maki, A., & Carlsson, S. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2500224 · Cited by 301
Transfer of coded information from sensory to motor networks
Salinas, E., & Abbott, L. (1995) · The Journal of Neuroscience · doi:10.1523/jneurosci.15-10-06461.1995 · Cited by 295
Klasifikasi Citra Menggunakan Convolutional Neural Network (CNN) pada Caltech 101
Eka Putra, W. S. (2016) · Jurnal Teknik ITS · doi:10.12962/j23373539.v5i1.15696 · Cited by 262
“dari NHK Broadcasting Science Research Laboratories, Kinuta, Setagaya, Tokyo, Jepang [4].”
BackgroundInfluentialConvolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis
Sun, W., Zhao, R., Yan, R., Shao, S., & Chen, X. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2672988 · Cited by 295
“CNN is a biologically inspired variant of neural network [12], which has been proven to be successful in many vision recognition tasks [13]–[15].”
BackgroundDeepFake Detection for Human Face Images and Videos: A Survey
Malik, A., Kuribayashi, M., Abdullahi, S. M., & Khan, A. N. (2022) · IEEE Access · doi:10.1109/access.2022.3151186 · Cited by 297
“The initial idea of CNN, called neocognitron , was presented in 1979 by Kunihiko Fukushima [10], which later became known as the predecessor of CNN.”
BackgroundNeural networks in business: techniques and applications for the operations researcher
Smith, K. A., & Gupta, J. N. D. (2000) · Computers & Operations Research · doi:10.1016/s0305-0548(99)00141-0 · Cited by 291
Khanam, R., Hussain, M., Hill, R., & Allen, P. (2024) · IEEE Access · doi:10.1109/access.2024.3425166 · Cited by 237
“This led to the emergence of the Neocognitron, a model of visual perception introduced by Fukushima in 1980 [119].”
BackgroundOn the Origin of Deep Learning
Wang, H., & Raj, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.07800 · Cited by 83
“The solution was also introduced by Fukushima (1980), which was introduced with the name “inhibitory cell”.”
A survey on U-shaped networks in medical image segmentations
Liu, L., Cheng, J., Quan, Q., Wu, F.-X., Wang, Y.-P., & Wang, J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.070 · Cited by 286
Hybrid quantum-classical convolutional neural networks
Liu, J., Lim, K. H., Wood, K. L., Huang, W., Guo, C., & Huang, H.-L. (2021) · Science China Physics, Mechanics & Astronomy · doi:10.1007/s11433-021-1734-3 · Cited by 289
A CATALOG OF VISUAL-LIKE MORPHOLOGIES IN THE 5 CANDELS FIELDS USING DEEP LEARNING
Huertas-Company, M., Gravet, R., Cabrera-Vives, G., Pérez-González, P. G., Kartaltepe, J. S., Barro, G., Bernardi, M., Mei, S., Shankar, F., Dimauro, P., et al. (2015) · The Astrophysical Journal Supplement Series · doi:10.1088/0067-0049/221/1/8 · Cited by 285
“Though deep learning architectures have existed since the early 80s (Fukushima 1980), they involve complex technological problems that only allowed their use in massive datasets in the last decade.”
BackgroundUsing filter banks in Convolutional Neural Networks for texture classification
Andrearczyk, V., & Whelan, P. F. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.08.016 · Cited by 273
“Pioneered, among others, by Fukushima [7], Lecun [15] and Hinton [12], Convolutional Neural Networks (CNNs) have been generalized since the breakthrough in the 2012 ImageNet Large Scale Visual Recognition Challenge [19] of Krizhevsky [12], and improved the state of the art of many machine vision tasks.”
BackgroundBrain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning
Sun, L., Zhang, S., Chen, H., & Luo, L. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00810 · Cited by 274
“Inspired by the biological structure of visual cortex (Fukushima, 1980), CNNs are artificial neural networks with multiple hidden convolutional layers between the input and output layers.”
MethodReNet: A Recurrent Neural Network Based Alternative to Convolutional Networks
Visin, F., Kastner, K., Cho, K., Matteucci, M., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00393 · Cited by 218
“Convolutional neural networks [CNN, Fukushima, 1980, LeCun et al., 1989] have become the method of choice for object recognition [see, e.g., Krizhevsky et al., 2012].”
MethodSparse coding based visual tracking: Review and experimental comparison
Zhang, S., Yao, H., Sun, X., & Lu, X. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.10.006 · Cited by 284
“Motivated by object recognition models in cortex [28,29], Riesenhuber and Poggio proposed an biologically inspired representation model called HMAX [20] which starts with a grayscale image layer and alternates between ‘‘S’’ and ‘‘C’’ layers.”
MethodTextual Analysis in Accounting: What's Next?*
Bochkay, K., Brown, S. V., Leone, A. J., & Tucker, J. W. (2023) · Contemporary Accounting Research · doi:10.1111/1911-3846.12825 · Cited by 242
“ANNs in their basic form have existed since at least 1980 (and arti fi cial neurons since the mid-1900s) when they were fi rst used for pattern recognition in images (Fukushima 1980).”
Metadata
- Authors
- Fukushima, K.
- Affiliations
- Japan Broadcasting Corporation (Japan) (JP)
- Corresponding author
- Fukushima, Kunihiko
- ORCID
- Fukushima, Kunihiko
- Venue
- Biological Cybernetics
- Published
- 1980-04
- Volume
- 36
- Issue
- 4
- Pages
- 193-202
- ISSN
- 0340-1200 (ISSN-L)
- 1432-0770
- OpenAlex
- W613766092
- Semantic Scholar
- 69e68bfaadf2dccff800158749f5a50fe82d173b
- Cited by
- 5,759
- References
- 13
- Citations by year
- 2026: 219 · 2025: 454 · 2024: 494 · 2023: 455 · 2022: 452 · 2021: 544 · 2020: 545 · 2019: 433 · 2018: 301 · 2017: 319 · 2016: 287 · 2015: 176 · 2014: 140 · 2013: 78 · 2012: 71
- FWCI
- 4.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Biological Cybernetics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Keywords
- neocognitron, visual pattern recognition, unsupervised learning, self-organization, position invariance, S cells, C cells, simple cells, complex cells, hypercomplex cells, visual cortex model, synaptic plasticity, shape recognition
- MeSH terms
- Cognition, Computers, Form Perception, Learning, Models, Neurological, Nerve Net, Nervous System Physiological Phenomena, Pattern Recognition, Visual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.