The DOI matches its Crossref record; 143 of the 143 references it cites were found in a registry or an index.
Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article]
Abstract
Ensemble methods use multiple models to get better performance. Ensemble methods have been used in multiple research fields such as computational intelligence, statistics and machine learning. This paper reviews traditional as well as state-of-the-art ensemble methods and thus can serve as an extensive summary for practitioners and beginners. The ensemble methods are categorized into conventional ensemble methods such as bagging, boosting and random forest, decomposition methods, negative correlation learning methods, multi-objective optimization based ensemble methods, fuzzy ensemble methods, multiple kernel learning ensemble methods and deep learning based ensemble methods. Variations, improvements and typical applications are discussed. Finally this paper gives some recommendations for future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Huang, N. E., Shen, Z., Long, S. R., Wu, M. C., Shih, H. H., Zheng, Q., Yen, N.-C., Tung, C. C., & Liu, H. H. (1998) · Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rspa.1998.0193 · Cited by 23,564
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Multi-Objective Optimization Using Evolutionary Algorithms
Deb, K., & Kalyanmoy, D. (2001) · Andalas University Repository (Andalas University) · Cited by 17,324
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Wolpert, D. H. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80023-1 · Cited by 7,951 · cited 1×
“Stacking, or stacked generalization [80] is a generalized method to bagging, random subspace or boosting because the aggregation stage is different yet more generalized.”
MethodFriedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Multi-column deep neural networks for image classification
Ciresan, D., Meier, U., & Schmidhuber, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248110 · Cited by 3,720
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578 · cited 1×
“There are learning algorithms which are unstable [13], [25], [179], especially randomized learning approaches such as random vector functional link (RVFL) neural network.”
BackgroundPopular Ensemble Methods: An Empirical Study
Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953 · cited 1×
“For example, in meteorology, ensemble forecasting [33] alters the initial conditions of the differential equations to model the meteorology.”
BackgroundImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657 · cited 1×
“Some surveys focus on classification only [6], [7].”
BackgroundAn Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants
Bauer, E., & Kohavi, R. (1999) · Machine Learning · doi:10.1023/a:1007515423169 · Cited by 2,638
Improved boosting algorithms using confidence-rated predictions
Schapire, R. E., & Singer, Y. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279960 · Cited by 2,547
Boosting the margin: a new explanation for the effectiveness of voting methods
Bartlett, P., Freund, Y., Lee, W. S., & Schapire, R. E. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691352 · Cited by 2,306
Multiple Kernel Learning Algorithms
Gönen, M., & Alpaydın, E. (2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021071 · Cited by 2,173
(2013) · Cited by 2,056
Improved Boosting Algorithms Using Confidence-rated Predictions
Schapire, R. E., & Singer, Y. (1999) · Machine Learning · doi:10.1023/a:1007614523901 · Cited by 1,971
Rotation Forest: A New Classifier Ensemble Method
Rodriguez, J. J., Kuncheva, L. I., & Alonso, C. J. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.211 · Cited by 1,893
Neural Network Ensembles, Cross Validation, and Active Learning
Krogh, A., & Vedelsby, J. (1994) · Cited by 1,838
Graph-based approach for airborne light detection and ranging segmentation
Vilariño, D. L., Cabaleiro, J. C., Martínez, J., Rivera, F. F., & Pena, T. F. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.015020 · Cited by 1,721
Surrogate-assisted evolutionary computation: Recent advances and future challenges
Jin, Y. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.05.001 · Cited by 1,514
Multiple kernel learning, conic duality, and the SMO algorithm
Bach, F. R., Lanckriet, G. R. G., & Jordan, M. I. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015424 · Cited by 1,453
Differential evolution algorithm with ensemble of parameters and mutation strategies
Mallipeddi, R., Suganthan, P. N., Pan, Q. K., & Tasgetiren, M. F. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2010.04.024 · Cited by 1,362 · cited 1×
“We can also investigate the applicability of ensemble methods for evolutionary algorithms [181], [182].”
MethodSelf-citationRätsch, G., Onoda, T., & Müller, K.-R. (2001) · Machine Learning · doi:10.1023/a:1007618119488 · Cited by 1,299
Arcing classifier (with discussion and a rejoinder by the author)
Breiman, L. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691079 · Cited by 1,105
Multi-column deep neural network for traffic sign classification
Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057 · cited 2×
“In [160], [161], ‘Multi-column Deep Neural Networks’ were proposed where each ‘column’ is actually a CNN.”
BackgroundMethodOn Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality
Friedman, J. H. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009778005914 · Cited by 1,040
Diversity creation methods: a survey and categorisation
Brown, G., Wyatt, J., Harris, R., & Yao, X. (2005) · Information Fusion · doi:10.1016/j.inffus.2004.04.004 · Cited by 985
Cristianini, N., Kandola, J., Elisseeff, A., & Shawe-Taylor, J. (2006) · Studies in Fuzziness and Soft Computing · doi:10.1007/3-540-33486-6_8 · Cited by 837
Multisurface proximal support vector machine classification via generalized eigenvalues
Mangasarian, O. L., & Wild, E. W. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.17 · Cited by 793
Ensemble learning via negative correlation
Liu, Y., & Yao, X. (1999) · Neural Networks · doi:10.1016/s0893-6080(99)00073-8 · Cited by 712
Ensemble approaches for regression: A survey
Mendes-Moreira, J., Soares, C., Jorge, A. M., & Sousa, J. F. D. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379786 · Cited by 667
Bias plus variance decomposition for zero-one loss functions
Kohavi, R., & Wolpert, D. H. (1996) · Cited by 652
A survey on nature inspired metaheuristic algorithms for partitional clustering
Nanda, S. J., & Panda, G. (2014) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2013.11.003 · Cited by 574
Oza, N. C. (2006) · 2005 IEEE International Conference on Systems, Man and Cybernetics · doi:10.1109/icsmc.2005.1571498 · Cited by 569
PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems
Abbass, H. A., Sarker, R., & Newton, C. (2002) · Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546) · doi:10.1109/cec.2001.934295 · Cited by 524
Kuncheva, L. I. (2000) · Studies in fuzziness and soft computing · doi:10.1007/978-3-7908-1850-5 · Cited by 511
Random Forests and Adaptive Nearest Neighbors
Lin, Y., & Jeon, Y. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001230 · Cited by 507
A Review of Ensemble Methods in Bioinformatics
Yang, P., Hwa Yang, Y., B. Zhou, B., & Y. Zomaya, A. (2010) · Current Bioinformatics · doi:10.2174/157489310794072508 · Cited by 503
Cristianini, N., Shawe-Taylor, J., Elisseeff, A., & Kandola, J. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0052 · Cited by 474
Ensemble methods for wind and solar power forecasting—A state-of-the-art review
Ren, Y., Suganthan, P. N., & Srikanth, N. (2015) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.04.081 · Cited by 435
Self-citationAdaptive dropout for training deep neural networks
Ba, J. L., & Frey, B. J. (2013) · neural information processing systems · Cited by 419
lp-Norm Multiple Kernel Learning
Kloft, M. (2011) · DepositOnce · doi:10.14279/depositonce-2978 · Cited by 412
An analysis of diversity measures
Tang, E. K., Suganthan, P. N., & Yao, X. (2006) · Machine Learning · doi:10.1007/s10994-006-9449-2 · Cited by 404
Self-citationEnsemble deep learning for regression and time series forecasting
Qiu, X., Zhang, L., Ren, Y., Suganthan, P., & Amaratunga, G. (2014) · 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL) · doi:10.1109/ciel.2014.7015739 · Cited by 368
Self-citationError-Correcting Output Coding Corrects Bias and Variance
Kong, E. B., & Dietterich, T. G. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50046-3 · Cited by 365
Chou, J.-S., & Pham, A.-D. (2013) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2013.08.078 · Cited by 360
Prediction of hourly solar radiation using a novel hybrid model of ARMA and TDNN
Ji, W., & Chee, K. C. (2011) · Solar Energy · doi:10.1016/j.solener.2011.01.013 · Cited by 338
A Comparative Study of Empirical Mode Decomposition-Based Short-Term Wind Speed Forecasting Methods
Ren, Y., Suganthan, P. N., & Srikanth, N. (2015) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2014.2365580 · Cited by 337
Self-citationManaging Diversity in Regression Ensembles
Brown, G., Wyatt, J., & Peter Tiňo, B. (2005) · Research Explorer (The University of Manchester) · doi:10.5555/1046920.1194899 · Cited by 336
Pasting Small Votes for Classification in Large Databases and On-Line
Breiman, L. (1999) · Machine Learning · doi:10.1023/a:1007563306331 · Cited by 317
Jiang, H., Deng, Y., Chen, H.-S., Tao, L., Sha, Q., Chen, J., Tsai, C.-J., & Zhang, S. (2004) · BMC Bioinformatics · doi:10.1186/1471-2105-5-81 · Cited by 290
Evaluation of hybrid forecasting approaches for wind speed and power generation time series
Shi, J., Guo, J., & Zheng, S. (2012) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2012.02.044 · Cited by 283
Generating Accurate and Diverse Members of a Neural-Network Ensemble
Opitz, D. W., & SHAVLIK, J. W. (1995) · Cited by 279
Randomizing Outputs to Increase Prediction Accuracy
Breiman, L. (2000) · Machine Learning · doi:10.1023/a:1007682208299 · Cited by 276
Zhou, Z.-H., Chawla, N. V., Jin, Y., & Williams, G. J. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2350953 · Cited by 275
Multiclass multiple kernel learning
Zien, A., & Ong, C. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273646 · Cited by 266
A hybrid statistical method to predict wind speed and wind power
Liu, H., Tian, H.-Q., Chen, C., & Li, Y.-F. (2010) · Renewable Energy · doi:10.1016/j.renene.2009.12.011 · Cited by 262
Adaptive Multi-Column Deep Neural Networks with Application to Robust Image Denoising
Agostinelli, F., Anderson, M. R., & Lee, H. (2013) · neural information processing systems · Cited by 249
Alam, S., Dobbie, G., Koh, Y. S., Riddle, P., & Ur Rehman, S. (2014) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2014.02.001 · Cited by 243
Hybrid Wavelet-PSO-ANFIS Approach for Short-Term Wind Power Forecasting in Portugal
Catalao, J. P. S., Pousinho, H. M. I., & Mendes, V. M. F. (2010) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2010.2076359 · Cited by 239
Experiments with AdaBoost.RT, an Improved Boosting Scheme for Regression
Shrestha, D. L., & Solomatine, D. P. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1678 · Cited by 233
A Novel Empirical Mode Decomposition With Support Vector Regression for Wind Speed Forecasting
Ren, Y., Suganthan, P. N., & Srikanth, N. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2351391 · Cited by 221
Self-citationMenze, B. H., Kelm, B. M., Splitthoff, D. N., Koethe, U., & Hamprecht, F. A. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23783-6_29 · Cited by 212
Fast decorrelated neural network ensembles with random weights
Alhamdoosh, M., & Wang, D. (2014) · Information Sciences · doi:10.1016/j.ins.2013.12.016 · Cited by 195
Ensembles of Multi-Objective Decision Trees
Kocev, D., Vens, C., Struyf, J., & Džeroski, S. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74958-5_61 · Cited by 194
Stratified sampling for feature subspace selection in random forests for high dimensional data
Ye, Y., Wu, Q., Zhexue Huang, J., Ng, M. K., & Li, X. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2012.09.005 · Cited by 186
Ensemble Learning Using Multi-Objective Evolutionary Algorithms
Chandra, A., & Yao, X. (2006) · Journal of Mathematical Modelling and Algorithms · doi:10.1007/s10852-005-9020-3 · Cited by 179
MadaBoost: A Modification of AdaBoost
Domingo, C., & Watanabe, O. (2000) · Cited by 173
Bias, Variance, and Arcing Classifiers
Breiman, L. (1996) · Cited by 171
Two-Stage Learning Kernel Algorithms
Cortes, C., Mohri, M., & Rostamizadeh, A. (2010) · Cited by 170
A Unifeid Bias-Variance Decomposition and its Applications
Domingos, P. (2000) · International Conference on Machine Learning · Cited by 167
A Feature Selection Method for Multilevel Mental Fatigue EEG Classification
Shen, K., Ong, C., Li, X., Hui, Z., & Wilder-Smith, E. P. (2007) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2007.890733 · Cited by 167
Neural network regularization and ensembling using multi-objective evolutionary algorithms
Jin, Y., Okabe, T., & Sendhoff, B. (2004) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2004.1330830 · Cited by 165
RotBoost: A technique for combining Rotation Forest and AdaBoost
Zhang, C.-X., & Zhang, J.-S. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.03.006 · Cited by 165
Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning
Chen, H., & Yao, X. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.26 · Cited by 162
Variance and Bias for General Loss Functions
James, G. M. (2003) · Machine Learning · doi:10.1023/a:1022899518027 · Cited by 160
Bonissone, P., Cadenas, J. M., Carmen Garrido, M., & Andrés Díaz-Valladares, R. (2010) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2010.02.003 · Cited by 159
Double-bagging: combining classifiers by bootstrap aggregation
Hothorn, T., & Lausen, B. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00169-3 · Cited by 158
Random Forests with ensemble of feature spaces
Zhang, L., & Suganthan, P. N. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.04.001 · Cited by 156
Self-citationMultiple Kernel Learning and the SMO Algorithm
Sun, Z., Theera-Ampornpunt, N., Varma, M., et al. (2010) · neural information processing systems · Cited by 154
"Fuzzy" versus "nonfuzzy" in combining classifiers designed by boosting
Kuncheva, L. I. (2003) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2003.819842 · Cited by 150
Xia, J., Han, K., & Huang, D.-S. (2009) · Protein and Peptide Letters · doi:10.2174/092986610789909403 · Cited by 149
Soft Margin Multiple Kernel Learning
Xu, X., Tsang, I. W.-H., & Xu, D. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2237183 · Cited by 146
A general and efficient multiple kernel learning algorithm
Sonnenburg, S., Rätsch, G., & Schäfer, C. (2005) · Max Planck Institute for Plasma Physics · Cited by 146
Oblique Decision Tree Ensemble via Multisurface Proximal Support Vector Machine
Zhang, L., & Suganthan, P. N. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2366468 · Cited by 145
Self-citationEvolving hybrid ensembles of learning machines for better generalisation
Chandra, A., & Yao, X. (2006) · Neurocomputing · doi:10.1016/j.neucom.2005.12.014 · Cited by 144
Kleinberg, E. M. (1990) · Annals of Mathematics and Artificial Intelligence · doi:10.1007/bf01531079 · Cited by 143
Wang, S., Yu, L., Tang, L., & Wang, S. (2011) · Energy · doi:10.1016/j.energy.2011.09.010 · Cited by 135
Efficient constraint handling for optimal reactive power dispatch problems
Mallipeddi, R., Jeyadevi, S., Suganthan, P. N., & Baskar, S. S. (2012) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2012.03.001 · Cited by 131
Self-citationForecast of solar irradiance using recurrent neural networks combined with wavelet analysis
Cao, S., & Cao, J. (2004) · Applied Thermal Engineering · doi:10.1016/j.applthermaleng.2004.06.017 · Cited by 126
Smith, C., & Jin, Y. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.05.062 · Cited by 125
Crammer, K., Keshet, J., & Singer, Y. (2002) · Cited by 122
Pareto neuro-evolution: constructing ensemble of neural networks using multi-objective optimization
Abbass, H. A. (2004) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2003.1299928 · Cited by 121
Özçift, A. (2011) · Journal of Medical Systems · doi:10.1007/s10916-011-9678-1 · Cited by 119
GEFCom2012 hierarchical load forecasting: Gradient boosting machines and Gaussian processes
Lloyd, J. R. (2013) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2013.07.002 · Cited by 105
Kankanala, P., Das, S., & Pahwa, A. (2013) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2013.2281137 · Cited by 104
Learning Kernels Using Local Rademacher Complexity
Cortes, C., Kloft, M., & Mohri, M. (2013) · neural information processing systems · Cited by 100
DIVACE: Diverse and Accurate Ensemble Learning Algorithm
Chandra, A., & Yao, X. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28651-6_91 · Cited by 95
Ensemble Multiple Kernel Active Learning For Classification of Multisource Remote Sensing Data
Zhang, Y., Yang, H. L., Prasad, S., Pasolli, E., Jung, J., & Crawford, M. M. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2359136 · Cited by 93
Target Localization Using Ensemble Support Vector Regression in Wireless Sensor Networks
Kim, W., Park, J., Yoo, J., Kim, H. J., & Park, C. G. (2012) · IEEE Transactions on Cybernetics · doi:10.1109/tsmcb.2012.2226151 · Cited by 89
Two-layer multiple kernel learning
Zhuang, J., Tsang, I. W.-H., & Hoi, S. C. H. (2011) · Cited by 89
Tan, C. J., Lim, C. P., & Cheah, Y. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.12.057 · Cited by 88
SpatialBoost: Adding Spatial Reasoning to AdaBoost
Avidan, S. (2006) · Lecture notes in computer science · doi:10.1007/11744085_30 · Cited by 64
SpicyMKL: a fast algorithm for Multiple Kernel Learning with thousands of kernels
Suzuki, T., & Tomioka, R. (2011) · Machine Learning · doi:10.1007/s10994-011-5252-9 · Cited by 57
Comparison Between Product and Mean Classifier Combination Rules
Tax, D., Duin, R., & van Breukelen, M. (1997) · Cited by 53
Multi kernel learning with online-batch optimization
Orabona, F., Luo, J., & Barbara Caputo, B. (2012) · IRIS Research product catalog (Sapienza University of Rome) · doi:10.5555/2503308.2188393 · Cited by 53
Du, W., Leung, S. Y. S., & Kwong, C. K. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.06.041 · Cited by 46
Minku, L. L., & Yao, X. (2013) · doi:10.1145/2499393.2499396 · Cited by 46
An Ensemble of Deep Support Vector Machines for Image Categorization
Abdullah, A., Veltkamp, R. C., & Wiering, M. (2009) · International Conference of Soft Computing and Pattern Recognition (SoCPaR) · doi:10.1109/socpar.2009.67 · Cited by 44
A survey of neural network ensembles
Zhao, Y., Gao, J., & Yang, X. (2006) · International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614650 · Cited by 44
A unified evolutionary training scheme for single and ensemble of feedforward neural network
Chen, W.-C., Tseng, L., & Wu, C.-S. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.05.057 · Cited by 43
Generating diverse and accurate classifier ensembles using multi-objective optimization
Gu, S., & Jin, Y. (2014) · IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM) · doi:10.1109/mcdm.2014.7007182 · Cited by 39
Negative Correlation Ensemble Learning for Ordinal Regression
Fernández‐Navarro, F., Gutiérrez, P. A., Hervás‐Martínez, C., & Yao, X. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2268279 · Cited by 36
Towards generating random forests via extremely randomized trees
Zhang, L., Ren, Y., & Suganthan, P. N. (2014) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2014.6889537 · Cited by 34
Self-citationAbdullah, A., Veltkamp, R. C., & Wiering, M. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178743 · Cited by 32
One-Month Ahead Prediction of Wind Speed and Output Power Based on EMD and LSSVM
Xiao-lan, W., & Li, H. (2009) · International Conference on Energy and Environment Technology · doi:10.1109/iceet.2009.571 · Cited by 30
Niu, D., Wang, F., Zhang, L., He, D., & Jia, M. (2010) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2010.11.007 · Cited by 29
Self-citationEmpirical Mode Decomposition-k Nearest Neighbor Models for Wind Speed Forecasting
Ren, Y., & Suganthan, P. N. (2014) · Journal of Power and Energy Engineering · doi:10.4236/jpee.2014.24025 · Cited by 28
Self-citationHierarchical age estimation with dissimilarity-based classification
Kohli, S., Prakash, S., & Gupta, P. (2013) · Neurocomputing · doi:10.1016/j.neucom.2012.08.069 · Cited by 26
Multi-objective evolutionary optimization for generating ensembles of classifiers in the ROC space
Lévesque, J.-C., Durand, A., Gagné, C., & Sabourin, R. (2012) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2330163.2330285 · Cited by 26
Bagged Averaging of Regression Models
Kotsiantis, S. B., Kanellopoulos, D. N., & Zaharakis, I. D. (2006) · Springer eBooks · doi:10.1007/0-387-34224-9_7 · Cited by 24
Deep Support Vector Machines for Regression Problems
Wiering, M., Schutten, M., Millea, A., et al. (2013) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 22
Haque, A. U., Mandal, P., Meng, J., Srivastava, A. K., Tseng, T.-L., & Senjyu, T. S. (2012) · IEEE Industry Applications Society Annual Meeting (IAS) · doi:10.1109/ias.2012.6373989 · Cited by 15
Ensemble of Multiple Kernel SVM Classifiers
Wang, X., Liu, X., Japkowicz, N., & Matwin, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-06483-3_21 · Cited by 10
Learning with Ensembles of Randomized Trees : New Insights
Pisetta, V., Jouve, P.-E., & Zighed, A. D. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15939-8_5 · Cited by 9
How can surrogates influence the convergence of evolutionary algorithms?
Chen, Y., Xie, W., & Zou, X. (2013) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2013.04.005 · Cited by 8
Gonzalez, D. L., Chen, Z., Tetteh, I. K., Pansombut, T., Semazzi, F. H. M., Kumar, V., Melechko, A. V., & Samatova, N. F. (2012) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2012.133 · Cited by 5
(1996)
(2014) · doi:10.5555/2627435.2697065
Research works printed but not linked: 50
- busseti, 2012, Deep learning for time series modeling, Tech Rep CS 229
- berg, 2010, Large Scale Visual Recognition Challenge 2010
- qiu, 0, Ensemble deep learning for regression and timeseries forecasting, Proc IEEE Symp Comput Intell Ensemble Learn, 1
- 10.3844/jcssp.2011.387.393 · DOI
- 10.4249/scholarpedia.2925 · doi:10.4249/scholarpedia.2925
- 10.2116/analsci.24.647 · doi:10.2116/analsci.24.647
- chandra, 0, Multi-objective ensemble construction, learning and evolution, Proc PPSN Workshop Multi-objective Problem Solving from Nature (Part 9th Int Conf Parallel Problem Solving from Nature PPSN-IX), 9
- 10.1109/MCI.2012.2228598 · doi:10.1109/mci.2012.2228598
- 10.1016/j.neucom.2006.04.009 · doi:10.1016/j.neucom.2006.04.009
- 10.1109/FUZZ-IEEE.2013.6622503 · doi:10.1109/fuzz-ieee.2013.6622503
- 10.1007/978-3-642-03040-6_111 · DOI
- rakotomamonjy, 2008, SimpleMKL, J Mach Learn Res, 9, 2491
- vezhnevets, 2005, Modest Adaboost-teaching Adaboost to generalize better, Graphicon, 12, 987
- 10.1109/FUZZY.1996.551810 · doi:10.1109/fuzzy.1996.551810
- gopika, 2014, An analysis on ensemble methods in classification tasks, Int J Adv Res Comput Commun Eng, 3, 7423
- 10.1007/s10462-009-9124-7 · DOI · Paper page
- 10.1016/S0165-0114(98)00223-1 · doi:10.1016/s0165-0114(98)00223-1
- 10.1109/FUZZY.2008.4630606 · doi:10.1109/fuzzy.2008.4630606
- 10.1145/2330784.2331010 · doi:10.1145/2330784.2331010
- kondo, 2008, RBF networks ensemble construction based on evolutionary multi-objective optimization, J Adv Comput Intell Inform, 12, 297, 10.20965/jaciii.2008.p0297 · doi:10.20965/jaciii.2008.p0297
- kocev, 2007, Ensembles of Multiobjective Decision Trees
- 10.1016/j.compbiomed.2008.02.007 · DOI
- 10.1109/CEC.2014.6900552 · doi:10.1109/cec.2014.6900552
- 10.1007/978-3-540-72523-7_46 · DOI
- scherer, 2014, Multiple Fuzzy Classification Systems
- 10.1007/11881599_97 · doi:10.1007/11881599_97
- 10.1109/CBMS.2007.43 · DOI
- fu, 2013, Ensemble learning algorithm in classification of fuzzy-classes*, J Comput Inform Syst, 9, 8929
- 10.1109/GEFS.2008.4484560 · doi:10.1109/gefs.2008.4484560
- 10.1007/3-540-45105-6_117 · doi:10.1007/3-540-45105-6_117
- 10.1109/HIS.2006.264942 · doi:10.1109/his.2006.264942
- feely, 2000, Predicting stock market volatility using neural networks
- 10.1109/ICSMC.2011.6083928 · doi:10.1109/icsmc.2011.6083928
- freund, 0, Experiments with a new boosting algorithm, Proc Int Conf Machine Learning, 96, 148
- lanckriet, 2004, Learning the kernel matrix with semidefinite programming, J Mach Learn Res, 5, 27
- 10.1109/CIEL.2013.6613137 · DOI
- 10.1109/TKDE.2007.190671 · doi:10.1109/tkde.2007.190671
- 10.1109/ICNC.2010.5583605 · doi:10.1109/icnc.2010.5583605
- zhang, 2012, Wind power short-term forecasting based on empirical mode decomposition and chaotic phase space reconstruction, Automation of Electronic Power Systems, 36, 24
- 10.1109/TSMCC.2007.905847 · DOI
- 10.1109/CIEL.2014.7015741 · doi:10.1109/ciel.2014.7015741
- brown, 2005, Managing diversity in regression ensembles, J Mach Learn Res, 6, 1621
- 10.1109/CSO.2011.50 · DOI
- 10.1016/S1004-4132(06)60093-5 · doi:10.1016/s1004-4132(06)60093-5
- pisetta, 2012, New insights into decision tree ensembles
- chen, 0, Evolutionary multiobjective ensemble learning based on Bayesian feature selection, Proc IEEE Congr Evolutionary Computation, 267
- 10.1109/CSO.2012.195 · DOI
- 10.1007/978-3-540-24581-0_47 · doi:10.1007/978-3-540-24581-0_47
- 10.1007/978-3-642-25832-9_20 · doi:10.1007/978-3-642-25832-9_20
- 10.1109/CSO.2009.307 · doi:10.1109/cso.2009.307
Cited by
Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103
Ensemble deep learning: A review
Ganaie, M. A., Hu, M., Malik, A. K., Tanveer, M., & Suganthan, P. N. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105151 · Cited by 2,143
Self-citationA Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects
Mienye, I. D., & Sun, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3207287 · Cited by 1,298
Global monitoring of antimicrobial resistance based on metagenomics analyses of urban sewage
Hendriksen, R. S., Munk, P., Njage, P., van Bunnik, B., McNally, L., Lukjancenko, O., Röder, T., Nieuwenhuijse, D., Pedersen, S. K., Kjeldgaard, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-08853-3 · Cited by 1,199
González, S., García, S., Del Ser, J., Rokach, L., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.007 · Cited by 582
Metadata
- Authors
- Ren, Y., Zhang, L., & Suganthan, P. N.
- Venue
- IEEE Computational Intelligence Magazine
- Published
- 2016-02
- Volume
- 11
- Issue
- 1
- Pages
- 41-53
- ISSN
- 1556-603X (ISSN-L)
- OpenAlex
- W2244486986
- Cited by
- 675
- References
- 143
- FWCI
- 51.18
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.