The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Dendritic Neuron Model With Effective Learning Algorithms for Classification, Approximation, and Prediction
Abstract
An artificial neural network (ANN) that mimics the information processing mechanisms and procedures of neurons in human brains has achieved a great success in many fields, e.g., classification, prediction, and control. However, traditional ANNs suffer from many problems, such as the hard understanding problem, the slow and difficult training problems, and the difficulty to scale them up. These problems motivate us to develop a new dendritic neuron model (DNM) by considering the nonlinearity of synapses, not only for a better understanding of a biological neuronal system, but also for providing a more useful method for solving practical problems. To achieve its better performance for solving problems, six learning algorithms including biogeography-based optimization, particle swarm optimization, genetic algorithm, ant colony optimization, evolutionary strategy, and population-based incremental learning are for the first time used to train it. The best combination of its user-defined parameters has been systemically investigated by using the Taguchi's experimental design method. The experiments on 14 different problems involving classification, approximation, and prediction are conducted by using a multilayer perceptron and the proposed DNM. The results suggest that the proposed learning algorithms are effective and promising for training DNM and thus make DNM more powerful in solving classification, approximation, and prediction problems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural Networks: A Comprehensive Foundation
Haykin, S. (1998) · Cited by 30,070
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Time Series Analysis: Forecasting and Control
Geurts, M., Box, G. E. P., & Jenkins, G. M. (1977) · Journal of Marketing Research · doi:10.2307/3150485 · Cited by 19,186
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
A new optimizer using particle swarm theory
Eberhart, R., & Kennedy, J. (2002) · MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science · doi:10.1109/mhs.1995.494215 · Cited by 16,067 · cited 1×
“[64] is to mimic the search behavior of a bird swarm.”
BackgroundNo free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., & WhiteH. (1989) · Neural Networks · doi:10.5555/70405.70408 · Cited by 9,081
Neural Networks And Learning Machines
Haykin, S. (2010) · Cited by 7,534
Neural networks: A comprehensive foundation
Tadeusiewicz, R. (1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)90080-2 · Cited by 7,218
(2007) · Handbook of Approximation Algorithms and Metaheuristics · doi:10.1201/9781420010749-33 · Cited by 6,607
An overview of gradient descent optimization algorithms
Ruder, S. (2016) · arXiv · doi:10.48550/arxiv.1609.04747 · Cited by 4,962
Biogeography-Based Optimization
Simon, D. (2008) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2008.919004 · Cited by 4,305
A direct adaptive method for faster backpropagation learning: the RPROP algorithm
Riedmiller, M., & Braun, H. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298623 · Cited by 3,917
30 years of adaptive neural networks: perceptron, Madaline, and backpropagation
Widrow, B., & Lehr, M. A. (1990) · Proceedings of the IEEE · doi:10.1109/5.58323 · Cited by 2,242
Computational Intelligence: An Introduction
(2006) · Advances in Industrial Control · doi:10.1007/1-84628-184-9_1 · Cited by 2,027
Dorigo, M., Birattari, M., & Stutzle, T. (2006) · IEEE Computational Intelligence Magazine · doi:10.1109/ci-m.2006.248054 · Cited by 1,880
García, S., Molina, D., Lozano, M., & Herrera, F. (2009) · Journal of Heuristics · doi:10.1007/s10732-008-9080-4 · Cited by 1,719
Abbott, L. F., & Regehr, W. G. (2004) · Nature · doi:10.1038/nature03010 · Cited by 1,684
Computational Intelligence: An Introduction
Engelbrecht, A. P. (2007) · Wiley eBooks · doi:10.1002/9780470512517 · Cited by 1,462
Extreme Learning Machine for Multilayer Perceptron
Tang, J., Deng, C., & Huang, G.-B. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2424995 · Cited by 1,451
Ant colony optimization for continuous domains
Socha, K., & Dorigo, M. (2008) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.06.046 · Cited by 1,414
An evolutionary algorithm that constructs recurrent neural networks
Angeline, P. J., Saunders, G. M., & Pollack, J. B. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.265960 · Cited by 1,012
Time Series Analysis Forecasting and Control.
Chakravarti, I. M., Box, G. E. P., & Jenkins, G. M. (1973) · Journal of the American Statistical Association · doi:10.2307/2284112 · Cited by 972
A Hybrid of Genetic Algorithm and Particle Swarm Optimization for Recurrent Network Design
Juang, C.-F. (2004) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2003.818557 · Cited by 964
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
Dauphin, Y., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2572 · Cited by 827
Zhang, J.-R., Zhang, J., Lok, T.-M., & Lyu, M. R. (2007) · Applied Mathematics and Computation · doi:10.1016/j.amc.2006.07.025 · Cited by 706
Branching out: mechanisms of dendritic arborization
Jan, Y.-N., & Jan, L. Y. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2836 · Cited by 693 · cited 1×
“Besides, a slightly morphological difference can lead to the notable functional discrepancy, playing a role in filters to determine the types of signals that single neurons receive and the way used to integrate the signals [27].”
BackgroundThe role of single neurons in information processing
Koch, C., & Segev, I. (2000) · Nature Neuroscience · doi:10.1038/81444 · Cited by 526
Nonlinear interactions in a dendritic tree: localization, timing, and role in information processing
Koch, C., Poggio, T., & Torre, V (1983) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.80.9.2799 · Cited by 496 · cited 1×
“Recently, several theoretical studies [22]–[24] have inferred that a single neuron retreated as a calculative unit could perform more effectively by taking into account the synaptic nonlinearities in a dendritic tree, which is significantly different from the McCulloch–Pitts neuron-based models.”
BackgroundEmpirical evaluation of the improved Rprop learning algorithms
Igel, C., & Hüsken, M. (2003) · Neurocomputing · doi:10.1016/s0925-2312(01)00700-7 · Cited by 433
Gudise, V. G., & Venayagamoorthy, G. K. (2004) · Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706) · doi:10.1109/sis.2003.1202255 · Cited by 425
Multiplicative computation in a visual neuron sensitive to looming
Gabbiani, F., Krapp, H. G., Koch, C., & Laurent, G. (2002) · Nature · doi:10.1038/nature01190 · Cited by 394
A survey of randomized algorithms for training neural networks
Zhang, L., & Suganthan, P. N. (2016) · Information Sciences · doi:10.1016/j.ins.2016.01.039 · Cited by 352
Let a biogeography-based optimizer train your Multi-Layer Perceptron
Mirjalili, S., Mirjalili, S. M., & Lewis, A. (2014) · Information Sciences · doi:10.1016/j.ins.2014.01.038 · Cited by 329
Simon, D. (2013) · Cited by 310
Meissner, M., Schmuker, M., & Schneider, G. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-125 · Cited by 298
Plasticity in single neuron and circuit computations
Destexhe, A., & Marder, E. (2004) · Nature · doi:10.1038/nature03011 · Cited by 274
Sexton, R. S., Dorsey, R. E., & Johnson, J. D. (1998) · Decision Support Systems · doi:10.1016/s0167-9236(97)00040-7 · Cited by 263
Luo, X., Zhou, M., Xia, Y., Zhu, Q., Ammari, A. C., & Alabdulwahab, A. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2412037 · Cited by 260
Self-citationEvolutionary artificial neural networks by multi-dimensional particle swarm optimization
Kiranyaz, S., Ince, T., Yildirim, A., & Gabbouj, M. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.05.013 · Cited by 257
TTSA: An Effective Scheduling Approach for Delay Bounded Tasks in Hybrid Clouds
Yuan, H., Bi, J., Tan, W., Zhou, M., Li, B. H., & Li, J. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2574766 · Cited by 207
Self-citationZhang, Z., Zheng, L., Yu, J., Li, Y., & Yu, Z. (2017) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2017.2683561 · Cited by 192
Financial time series prediction using a dendritic neuron model
Zhou, T., Gao, S., Wang, J., Chu, C., Todo, Y., & Tang, Z. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.05.031 · Cited by 183
Self-citationBranch-Specific Plasticity Enables Self-Organization of Nonlinear Computation in Single Neurons
Legenstein, R., & Maass, W. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5684-10.2011 · Cited by 166
Speeding Up Backpropagation Using Multiobjective Evolutionary Algorithms
Abbass, H. A. (2003) · Neural Computation · doi:10.1162/089976603322385126 · Cited by 153
Comparative evaluation of genetic algorithm and backpropagation for training neural networks
Sexton, R. S., & Gupta, J. N. D. (2000) · Information Sciences · doi:10.1016/s0020-0255(00)00068-2 · Cited by 151
Sun, K., Huang, S.-H., Wong, D. S., & Jang, S. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2542866 · Cited by 137
SVM-DT-based adaptive and collaborative intrusion detection
Teng, S., Wu, N., Zhu, H., Teng, L., & Zhang, W. (2017) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2017.7510730 · Cited by 137
Unsupervised learnable neuron model with nonlinear interaction on dendrites
Todo, Y., Tamura, H., Yamashita, K., & Tang, Z. (2014) · Neural Networks · doi:10.1016/j.neunet.2014.07.011 · Cited by 134
An approximate logic neuron model with a dendritic structure
Ji, J., Gao, S., Cheng, J., Tang, Z., & Todo, Y. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.09.052 · Cited by 111
Self-citationGaussian Classifier-Based Evolutionary Strategy for Multimodal Optimization
Dong, W., & Zhou, M. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2298402 · Cited by 106
Self-citationA review on probabilistic graphical models in evolutionary computation
Larrañaga, P., Karshenas, H., Bielza, C., & Santana, R. (2012) · Journal of Heuristics · doi:10.1007/s10732-012-9208-4 · Cited by 103
Jadi, M. P., Behabadi, B. F., Poleg-Polsky, A., Schiller, J., & Mel, B. W. (2014) · Proceedings of the IEEE · doi:10.1109/jproc.2014.2312671 · Cited by 103
A Review on Estimation of Distribution Algorithms
Larrañaga, P. (2002) · Genetic Algorithms and Evolutionary Computation · doi:10.1007/978-1-4615-1539-5_3 · Cited by 100
Differential Evolution algorithms applied to Neural Network training suffer from stagnation
Piotrowski, A. (2014) · Applied Soft Computing · doi:10.1016/j.asoc.2014.03.039 · Cited by 100
Feature Selection Using a Neural Framework With Controlled Redundancy
Chakraborty, R., & Pal, N. R. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2308902 · Cited by 86
Single neuron dynamics and computation
Brunel, N., Hakim, V., & Richardson, M. J. E. (2014) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2014.01.005 · Cited by 85
Somato-dendritic synaptic plasticity and error-backpropagation in active dendrites
Schiess, M., Urbanczik, R., & Senn, W. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004638 · Cited by 75 · cited 1×
“Yet some attentions have been attracted on single neuron models, such as a single multiplicative neuron model [7]–[9], branchspecific plastic neuron [10]–[12], and sigma–pi unit [13]–[19].”
BackgroundSigma-Pi Learning: On Radial Basis Functions and Cortical Associative Learning
Mel, B. W., & Koch, C. (1989) · neural information processing systems · Cited by 75
Jafrasteh, B., & Fathianpour, N. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.01.016 · Cited by 69
Evolutionary Fuzzy ARTMAP Neural Networks for Classification of Semiconductor Defects
Tan, S. C., Watada, J., Ibrahim, Z., & Khalid, M. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2329097 · Cited by 67
Using a Single Dendritic Neuron to Forecast Tourist Arrivals to Japan
Chen, W., Jian, S. U. N., Gao, S., Cheng, J., Wang, J., & Todo, Y. (2016) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2016edp7152 · Cited by 65
Self-citationDynamic Behavior of Artificial Hodgkin–Huxley Neuron Model Subject to Additive Noise
Kang, Q., Huang, B., & Zhou, M. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2464106 · Cited by 62
Self-citationA Breast Cancer Classifier Using a Neuron Model with Dendritic Nonlinearity
Zijun, S. H. A., Hu, L., Todo, Y., Ji, J., Gao, S., & Tang, Z. (2015) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2014edp7418 · Cited by 61
Self-citationA neuron model with synaptic nonlinearities in a dendritic tree for liver disorders
Jiang, T., Gao, S., Wang, D., Ji, J., Todo, Y., & Tang, Z. (2016) · IEEJ Transactions on Electrical and Electronic Engineering · doi:10.1002/tee.22350 · Cited by 59
Self-citationTraining nets of hardware realizable sigma-pi units
GURNEY, K. N. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80027-9 · Cited by 52
Decomposition Techniques for Multilayer Perceptron Training
Grippo, L., Manno, A., & Sciandrone, M. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2475621 · Cited by 40
Modelling plasticity in dendrites: from single cells to networks
Bono, J., Wilmes, K. A., & Clopath, C. (2017) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2017.08.013 · Cited by 39
Transformations of sigma–pi nets: obtaining reflected functions by reflecting weight matrices
Neville, R. S., & Eldridge, S. E. (2002) · Neural Networks · doi:10.1016/s0893-6080(02)00023-0 · Cited by 31
One cell to rule them all, and in the dendrites bind them
Costa, R. P., & Sjöström, P. J. (2011) · Frontiers in Synaptic Neuroscience · doi:10.3389/fnsyn.2011.00005 · Cited by 25
How to make sigma-pi neural networks perform perfectly on regular training sets
Lenze, B. (1994) · Neural Networks · doi:10.1016/0893-6080(94)90009-4 · Cited by 17
Dendrites Enable a Robust Mechanism for Neuronal Stimulus Selectivity
Cazé, R. D., Jarvis, S., Foust, A. J., & Schultz, S. R. (2017) · Neural Computation · doi:10.1162/neco_a_00989 · Cited by 17
Cited by
Bi, J., Yuan, H., Duanmu, S., Zhou, M., & Abusorrah, A. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3024223 · Cited by 365
Self-citationA stochastic configuration network based on chaotic sparrow search algorithm
Zhang, C., & Ding, S. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106924 · Cited by 342
AI-based modeling and data-driven evaluation for smart manufacturing processes
Ghahramani, M., Qiao, Y., Zhou, M. C., O'Hagan, A., & Sweeney, J. (2020) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003114 · Cited by 334
Self-citationDeep learning and time series-to-image encoding for financial forecasting
Barra, S., Carta, S. M., Corriga, A., Podda, A. S., & Recupero, D. R. (2020) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003132 · Cited by 267
Automatic detection of COVID-19 infection using chest X-ray images through transfer learning
Ohata, E. F., Bezerra, G. M., Chagas, J. V. S. D., Lira Neto, A. V., Albuquerque, A. B., Albuquerque, V. H. C. D., & Reboucas Filho, P. P. (2021) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2020.1003393 · Cited by 265
Metadata
- Authors
- Gao, S., Zhou, M., Wang, Y., Cheng, J., Yachi, H., & Wang, J.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2019-02
- Volume
- 30
- Issue
- 2
- Pages
- 601-614
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2829536470
- Cited by
- 698
- References
- 73
- FWCI
- 50.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.