The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
A constructive algorithm for training cooperative neural network ensembles
Abstract
Presents a constructive algorithm for training cooperative neural-network ensembles (CNNEs). CNNE combines ensemble architecture design with cooperative training for individual neural networks (NNs) in ensembles. Unlike most previous studies on training ensembles, CNNE puts emphasis on both accuracy and diversity among individual NNs in an ensemble. In order to maintain accuracy among individual NNs, the number of hidden nodes in individual NNs are also determined by a constructive approach. Incremental training based on negative correlation is used in CNNE to train individual NNs for different numbers of training epochs. The use of negative correlation learning and different training epochs for training individual NNs reflect CNNEs emphasis on diversity among individual NNs in an ensemble. CNNE has been tested extensively on a number of benchmark problems in machine learning and neural networks, including Australian credit card assessment, breast cancer, diabetes, glass, heart disease, letter recognition, soybean, and Mackey-Glass time series prediction problems. The experimental results show that CNNE can produce NN ensembles with good generalization ability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Adaptive Mixtures of Local Experts
Jacobs, R. A., Jordan, M. I., Nowlan, S. J., & Hinton, G. E. (1991) · Neural Computation · doi:10.1162/neco.1991.3.1.79 · Cited by 5,384
Hansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Oscillation and Chaos in Physiological Control Systems
Mackey, M. C., & Glass, L. (1977) · Science · doi:10.1126/science.267326 · Cited by 4,135
Popular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953
Dietterich, T. G. (2000) · Machine Learning · doi:10.1023/a:1007607513941 · Cited by 2,941
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants
Bauer, E., & Kohavi, R. (1999) · Machine Learning · doi:10.1023/a:1007515423169 · Cited by 2,638
The Cascade-Correlation learning architecture
Fahlman, S. E., & Lebiere, C. J. (2018) · doi:10.1184/r1/6610403 · Cited by 2,372
Predicting chaotic time series
Farmer, J. D., & Sidorowich, J. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.845 · Cited by 1,929
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00117832 · Cited by 1,912
Neural Network Ensembles, Cross Validation, and Active Learning
Krogh, A., & Vedelsby, J. (1994) · Cited by 1,838
Quinlan, J. R. (1996) · National Conference on Artificial Intelligence · Cited by 1,586
'Neural-gas' network for vector quantization and its application to time-series prediction
Martinetz, T. M., Berkovich, S. G., & Schulten, K. J. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.238311 · Cited by 1,431
A new evolutionary system for evolving artificial neural networks
Yao, X., & Liu, Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572107 · Cited by 874
Self-citationEnsemble learning via negative correlation
Liu, Y., & Yao, X. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00073-8 · Cited by 712
Self-citationError Correlation and Error Reduction in Ensemble Classifiers
TUMER, K., & GHOSH, J. (1996) · Connection Science · doi:10.1080/095400996116839 · Cited by 597
On Combining Artificial Neural Nets
SHARKEY, A. J. C. (1996) · Connection Science · doi:10.1080/095400996116785 · Cited by 513
Back-propagation algorithm which varies the number of hidden units
Hirose, Y., Yamashita, K., & Hijiya, S. (1991) · Neural Networks · doi:10.1016/0893-6080(91)90032-z · Cited by 503
Optimal Linear Combinations of Neural Networks
Hashem, S. (1997) · Neural Networks · doi:10.1016/s0893-6080(96)00098-6 · Cited by 499
Kwok, T.-Y., & Yeung, D.-Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572102 · Cited by 493
Evolutionary ensembles with negative correlation learning
Higuchi, T., Yao, X., & Liu, Y. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.887237 · Cited by 445
Self-citationDynamic node creation in backpropagation networks
ASH, T. (1989) · Connection Science · doi:10.1080/09540098908915647 · Cited by 415
Boosting and Other Ensemble Methods
Drucker, H., Cortes, C., Jackel, L. D., LeCun, Y., & Vapnik, V. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1289 · Cited by 357
Actively Searching for an Effective Neural Network Ensemble
Opitz, D. W., & Shavlik, J. W. (1996) · Connection Science · doi:10.1080/095400996116802 · Cited by 331
Simultaneous training of negatively correlated neural networks in an ensemble
Liu, Y., & Yao, X. (1999) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.809027 · Cited by 267
Self-citationMaking use of population information in evolutionary artificial neural networks
Yao, X., & Liu, Y. (1998) · IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.678637 · Cited by 257
Self-citationEnsemble Learning Using Decorrelated Neural Networks
ROSEN, B. E. (1996) · Connection Science · doi:10.1080/095400996116820 · Cited by 248
Objective functions for training new hidden units in constructive neural networks
Kwok, T.-Y., & Yeung, D.-Y. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623214 · Cited by 238
PROBEN 1 - a set of benchmarks and benchmarking rules for neural network training algorithms
Prechelt, L. (1994) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/39794 · Cited by 230
Improving model selection by nonconvergent methods
Finnoff, W., Hergert, F., & Zimmermann, H. G. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80122-4 · Cited by 219
Use of a quasi-Newton method in a feedforward neural network construction algorithm
Setiono, R., & Hui, L. C. K. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.363426 · Cited by 199
Improving model accuracy using optimal linear combinations of trained neural networks
Hashem, S., & Schmeiser, B. (1995) · IEEE Transactions on Neural Networks · doi:10.1109/72.377990 · Cited by 177
Error reduction through learning multiple descriptions
Ali, K. M., & Pazzani, M. J. (1996) · Machine Learning · doi:10.1007/bf00058611 · Cited by 163
SHARKEY, A. J. C., & SHARKEY, N. E. (1997) · The Knowledge Engineering Review · doi:10.1017/s0269888997003123 · Cited by 159
Statistical mechanics of ensemble learning
Krogh, A., & Sollich, P. (1997) · Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · doi:10.1103/physreve.55.811 · Cited by 146
Genetic algorithm based selective neural network ensemble
Zhou, Z., Wu, J., Jiang, Y., & Chen, S. (2001) · Cited by 127
Modelling with constructive backpropagation
Lehtokangas, M. I. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00018-0 · Cited by 117
A new algorithm to design compact two-hidden-layer artificial neural networks
Islam, M. M., & Murase, K. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00075-2 · Cited by 110
Self-citationPrechelt, L. (1996) · Neural Networks · doi:10.1016/0893-6080(95)00123-9 · Cited by 107
Linear and Order Statistics Combiners for Pattern Classification
SHARKEY, A. J. C. (1999) · Perspectives in neural computing · doi:10.1007/978-1-4471-0793-4_6 · Cited by 94
Oscillation and chaos in physiological control systems
Glass, L. (2001) · Nature · Cited by 79
Exploring constructive cascade networks
Treadgold, N. K., & Gedeon, T. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.809079 · Cited by 63
Evolutional development of a multilevel neural network
Odri, S., Petrovački, D., & Krstonosic, G. A. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80061-9 · Cited by 55
Mutual information of sparsely coded associative memory with self-control and ternary neurons
Bollé, D., Domínguez, D., & Амари, Ш.-И. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00027-7 · Cited by 22
Classification using Bayesian neural nets
Bioch, J. C., van der Meer, O., & Potharst, R. (2002) · doi:10.1109/icnn.1996.549120 · Cited by 19
Islam, M. M., Shahjahan, M., & Murase, K. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2001.973500 · Cited by 8
Self-citation(1996)
Cited by
Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657
Diversity creation methods: a survey and categorisation
Brown, G., Wyatt, J., Harris, R., & Yao, X. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.004 · Cited by 985
Self-citationGroup Search Optimizer: An Optimization Algorithm Inspired by Animal Searching Behavior
He, S., Wu, Q. H., & Saunders, J. R. (2009) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2009.2011992 · Cited by 724
Comprehensive Review of Neural Network-Based Prediction Intervals and New Advances
Khosravi, A., Nahavandi, S., Creighton, D., & Atiya, A. F. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2162110 · Cited by 694
Ensemble approaches for regression: A survey
Mendes-Moreira, J., Soares, C., Jorge, A. M., & Sousa, J. F. D. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379786 · Cited by 667
Metadata
- Authors
- Islam, M. M., Yao, X., & Murase, K.
- Venue
- IEEE Transactions on Neural Networks
- Published
- 2003-07
- Volume
- 14
- Issue
- 4
- Pages
- 820-834
- ISSN
- 1045-9227 (ISSN-L)
- OpenAlex
- W2106390255
- Cited by
- 294
- References
- 50
- FWCI
- 17.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.