The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
A dynamic ensemble learning algorithm for neural networks
Open accessAbstract
This paper presents a novel dynamic ensemble learning (DEL) algorithm for designing ensemble of neural networks (NNs). DEL algorithm determines the size of ensemble, the number of individual NNs employing a constructive strategy, the number of hidden nodes of individual NNs employing a constructive–pruning strategy, and different training samples for individual NN’s learning. For diversity, negative correlation learning has been introduced and also variation of training samples has been made for individual NNs that provide better learning from the whole training samples. The major benefits of the proposed DEL compared to existing ensemble algorithms are (1) automatic design of ensemble; (2) maintaining accuracy and diversity of NNs at the same time; and (3) minimum number of parameters to be defined by user. DEL algorithm is applied to a set of real-world classification problems such as the cancer, diabetes, heart disease, thyroid, credit card, glass, gene, horse, letter recognition, mushroom, and soybean datasets. It has been confirmed by experimental results that DEL produces dynamic NN ensembles of appropriate architecture and diversity that demonstrate good generalization ability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
Overcoming catastrophic forgetting in neural networks
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A. A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611835114 · Cited by 7,899
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem
McCloskey, M., & Cohen, N. J. (1989) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60536-8 · Cited by 3,770
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953
Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy
Kuncheva, L. I., & Whitaker, C. J. (2003) · Machine Learning · doi:10.1023/a:1022859003006 · Cited by 2,335
Catastrophic forgetting in connectionist networks
French, R. (1999) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(99)01294-2 · Cited by 2,311
Reed, R. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.248452 · Cited by 1,708
Automatic early stopping using cross validation: quantifying the criteria
Prechelt, L. (1998) · Neural Networks · doi:10.1016/s0893-6080(98)00010-0 · Cited by 990
Catastrophic forgetting, rehearsal and pseudorehearsal
ROBINS, A. (1995) · Connection Science · doi:10.1080/09540099550039318 · Cited by 833
Ensemble learning via negative correlation
Liu, Y., & Yao, X. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00073-8 · Cited by 712
Ren, Y., Zhang, L., & Suganthan, P. N. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471235 · Cited by 675
Measuring Catastrophic Forgetting in Neural Networks
Kemker, R., McClure, M., Abitino, A., Hayes, T., & Kanan, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11651 · Cited by 672
On Combining Artificial Neural Nets
SHARKEY, A. J. C. (1996) · Connection Science · doi:10.1080/095400996116785 · Cited by 513
A New Neural Dynamic Classification Algorithm
Rafiei, M. H., & Adeli, H. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2682102 · Cited by 501
Self-citationOptimal Linear Combinations of Neural Networks
Hashem, S. (1997) · Neural Networks · doi:10.1016/s0893-6080(96)00098-6 · Cited by 499
Kwok, T.-Y., & Yeung, D.-Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572102 · Cited by 493
Evolutionary ensembles with negative correlation learning
Higuchi, T., Yao, X., & Liu, Y. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.887237 · Cited by 445
Dynamic classifier selection: Recent advances and perspectives
Cruz, R. M. O., Sabourin, R., & Cavalcanti, G. D. C. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.09.010 · Cited by 440
Dynamic node creation in backpropagation networks
ASH, T. (1989) · Connection Science · doi:10.1080/09540098908915647 · Cited by 415
Design of effective neural network ensembles for image classification purposes
Giacinto, G., & Roli, F. (2001) · Image and Vision Computing · doi:10.1016/s0262-8856(01)00045-2 · Cited by 409
An analysis of diversity measures
Tang, E. K., Suganthan, P. N., & Yao, X. (2006) · Machine Learning · doi:10.1007/s10994-006-9449-2 · Cited by 404
Managing Diversity in Regression Ensembles
Brown, G., Wyatt, J., & Peter Tiňo, B. (2005) · Research Explorer (The University of Manchester) · doi:10.5555/1046920.1194899 · Cited by 336
Dynamic selection of classifiers—A comprehensive review
Britto, A. S., Sabourin, R., & Oliveira, L. E. S. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.05.003 · Cited by 331
A constructive algorithm for training cooperative neural network ensembles
Islam, M. M., Yao, X., & Murase, K. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.813832 · Cited by 294
NEURAL NETWORK MODELS FOR EARTHQUAKE MAGNITUDE PREDICTION USING MULTIPLE SEISMICITY INDICATORS
PANAKKAT, A., & ADELI, H. (2007) · International Journal of Neural Systems · doi:10.1142/s0129065707000890 · Cited by 272
Self-citationSimultaneous training of negatively correlated neural networks in an ensemble
Liu, Y., & Yao, X. (1999) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.809027 · Cited by 267
META-DES: A dynamic ensemble selection framework using meta-learning
Cruz, R. M. O., Sabourin, R., Cavalcanti, G. D. C., & Ing Ren, T. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.12.003 · Cited by 250
Ensemble Learning Using Decorrelated Neural Networks
ROSEN, B. E. (1996) · Connection Science · doi:10.1080/095400996116820 · Cited by 248
A Bio-Inspired Incremental Learning Architecture for Applied Perceptual Problems
Gepperth, A., & Karaoguz, C. (2016) · Cognitive Computation · doi:10.1007/s12559-016-9389-5 · Cited by 170
Neural network ensembles: evaluation of aggregation algorithms
Granitto, P. M., Verdes, P. F., & Ceccatto, H. A. (2005) · Artificial Intelligence · doi:10.1016/j.artint.2004.09.006 · Cited by 167
Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
Chen, H., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.26 · Cited by 162
SHARKEY, A. J. C., & SHARKEY, N. E. (1997) · The Knowledge Engineering Review · doi:10.1017/s0269888997003123 · Cited by 159
Regularized Negative Correlation Learning for Neural Network Ensembles
Chen, H., & Yao, X. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2034144 · Cited by 155
Semi-Supervised Learning via Regularized Boosting Working on Multiple Semi-Supervised Assumptions
Chen, K., & Wang, S. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.92 · Cited by 140
Training neural networks: backpropagation vs. genetic algorithms
Siddique, M. N. H., & Tokhi, M. O. (2002) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2001.938792 · Cited by 101
Optimum design of cold-formed steel space structures using neural dynamics model
Tashakori, A., & Adeli, H. (2002) · Journal of Constructional Steel Research · doi:10.1016/s0143-974x(01)00105-5 · Cited by 87
Self-citationBagging and Boosting Negatively Correlated Neural Networks
Islam, M. M., Yao, X., Nirjon, S., Islam, M. A., & Murase, K. (2008) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2008.922055 · Cited by 85
Bias/Variance Analyses of Mixtures-of-Experts Architectures
Jacobs, R. A. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.369 · Cited by 82
Backpropagation Discrimination Geometric Analysis Interference Memory Modelling Neural Nets
SHARKEY, N. E., & SHARKEY, A. J. C. (1995) · Connection Science · doi:10.1080/09540099550039264 · Cited by 71
Mousavi, R., & Eftekhari, M. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.09.009 · Cited by 70
Ensemble Learning in Fixed Expansion Layer Networks for Mitigating Catastrophic Forgetting
Coop, R., Mishtal, A., & Arel, I. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2264952 · Cited by 64
Exploiting unlabeled data to enhance ensemble diversity
Zhang, M.-L., & Zhou, Z. (2011) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-011-0243-9 · Cited by 64
Improved learning algorithm for two-layer neural networks for identification of nonlinear systems
Vargas, J. A. R., Witold Pedrycz, C., & Hemerly, E. M. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.10.008 · Cited by 48
Life-long learning based on dynamic combination model
Ren, B., Wang, H., Li, J., & Gao, H. (2017) · Applied Soft Computing · doi:10.1016/j.asoc.2017.03.005 · Cited by 45
DE2: Dynamic ensemble of ensembles for learning nonstationary data
Yin, X.-C., Huang, K., & Hao, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2014.06.092 · Cited by 39
Effectiveness of error correcting output coding methods in ensemble and monolithic learning machines
Masulli, F., & Valentini, G. (2003) · Pattern Analysis and Applications · doi:10.1007/s10044-003-0195-9 · Cited by 37
Incorporating knowledge into neural network for text representation
Li, Y., Wei, B., Liu, Y., Yao, L., Chen, H., Yu, J., & Zhu, W. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.11.037 · Cited by 36
A Cluster-Based Semisupervised Ensemble for Multiclass Classification
Soares, R. G. F., Chen, H., & Yao, X. (2017) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2017.2743219 · Cited by 29
Neural network systems for multi-dimensional temporal pattern classification
Srinivasan, R., Wang, C., Ho, W. K., & Lim, K. W. (2004) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2004.09.026 · Cited by 25
Boosted Network Classifiers for Local Feature Selection
Hancock, T., & Mamitsuka, H. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2214057 · Cited by 18
Reproducibility of importance extraction methods in neural network based fMRI classification
Gotsopoulos, A., Saarimäki, H., Glerean, E., Jääskeläinen, I. P., Sams, M. E., Nummenmaa, L., & Lampinen, J. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.06.076 · Cited by 17
A Pruning Algorithm for Training Cooperative Neural Network Ensembles
Shahjahan, M. (2006) · IEICE Transactions on Information and Systems · doi:10.1093/ietisy/e89-d.3.1257 · Cited by 12
Cited by
An Experimental Review on Deep Learning Architectures for Time Series Forecasting
Lara-Benítez, P., Carranza-García, M., & Riquelme, J. C. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721300011 · Cited by 532
A Review of Ensemble Learning Algorithms Used in Remote Sensing Applications
Zhang, Y., Liu, J., & Shen, W. (2022) · Applied Sciences · doi:10.3390/app12178654 · Cited by 385
Self-Supervised Learning for Electroencephalography
Rafiei, M. H., Gauthier, L. V., Adeli, H., & Takabi, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3190448 · Cited by 317
Self-citationChen, S., Dong, J., Ha, P. (. J., Li, Y., & Labi, S. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12702 · Cited by 261
Gao, Y., Zhai, P., & Mosalam, K. M. (2021) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12741 · Cited by 105
“…powerful classification algorithms modified under the BSS-GAN framework, for example, neural dynamic classification (Rafiei & Adeli, 2017a), dynamic ensemble learning (Alam et al., 2020), and finite element machine for fast learning (Pereira et al., 2020), will be considered in future studies.”
Method
Metadata
- Authors
- Alam, K. M. R., Siddique, N., & Adeli, H.
- Venue
- Neural Computing and Applications
- Published
- 2019-07-29
- Volume
- 32
- Issue
- 12
- Pages
- 8675-8690
- ISSN
- 0941-0643 (ISSN-L)
- 1433-3058
- OpenAlex
- W2966126335
- Cited by
- 536
- References
- 55
- FWCI
- 22.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.