The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Rotation Forest: A New Classifier Ensemble Method
Abstract
We propose a method for generating classifier ensembles based on feature extraction. To create the training data for a base classifier, the feature set is randomly split into K subsets (K is a parameter of the algorithm) and Principal Component Analysis (PCA) is applied to each subset. All principal components are retained in order to preserve the variability information in the data. Thus, K axis rotations take place to form the new features for a base classifier. The idea of the rotation approach is to encourage simultaneously individual accuracy and diversity within the ensemble. Diversity is promoted through the feature extraction for each base classifier. Decision trees were chosen here because they are sensitive to rotation of the feature axes, hence the name "forest." Accuracy is sought by keeping all principal components and also using the whole data set to train each base classifier. Using WEKA, we examined the Rotation Forest ensemble on a random selection of 33 benchmark data sets from the UCI repository and compared it with Bagging, AdaBoost, and Random Forest. The results were favorable to Rotation Forest and prompted an investigation into diversity-accuracy landscape of the ensemble models. Diversity-error diagrams revealed that Rotation Forest ensembles construct individual classifiers which are more accurate than these in AdaBoost and Random Forest, and more diverse than these in Bagging, sometimes more accurate as well.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Witten, I. H. (2008) · Cited by 9,143
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Cited by
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103
Saal, J. E., Kirklin, S., Aykol, M., Meredig, B., & Wolverton, C. (2013) · JOM · doi:10.1007/s11837-013-0755-4 · Cited by 2,584
Dong, X., Yu, Z., Cao, W., Shi, Y., & Ma, Q. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-019-8208-z · Cited by 1,928
A general-purpose machine learning framework for predicting properties of inorganic materials
Ward, L., Agrawal, A., Choudhary, A., & Wolverton, C. (2016) · npj Computational Materials · doi:10.1038/npjcompumats.2016.28 · Cited by 1,831
KEEL: a software tool to assess evolutionary algorithms for data mining problems
Alcalá-Fdez, J., Sánchez, L., García, S., del Jesus, M. J., Ventura, S., Garrell, J. M., Otero, J., Romero, C., Bacardit, J., Rivas, V. M., et al. (2009) · Soft Computing · doi:10.1007/s00500-008-0323-y · Cited by 1,505
Agrawal, A., & Choudhary, A. (2016) · APL Materials · doi:10.1063/1.4946894 · Cited by 1,385
Benchmarking state-of-the-art classification algorithms for credit scoring: an update of research
Lessmann, S., Baesens, B., Seow, H.-V., & Thomas, L. C. (2015) · European Journal of Operational Research · doi:10.1016/j.ejor.2015.05.030 · Cited by 1,284
Tyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
Mining data with random forests: A survey and results of new tests
Verikas, A., Gelzinis, A., & Bacauskiene, M. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.08.011 · Cited by 719
Ren, Y., Zhang, L., & Suganthan, P. N. (2016) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2015.2471235 · Cited by 675
Ensemble approaches for regression: A survey
Mendes-Moreira, J., Soares, C., Jorge, A. M., & Sousa, J. F. D. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379786 · Cited by 667
Ensemble machine learning paradigms in hydrology: A review
Zounemat-Kermani, M., Batelaan, O., Fadaee, M., & Hinkelmann, R. (2021) · Journal of Hydrology · doi:10.1016/j.jhydrol.2021.126266 · Cited by 649
Approximating XGBoost with an interpretable decision tree
Sagi, O., & Rokach, L. (2021) · Information Sciences · doi:10.1016/j.ins.2021.05.055 · Cited by 554
Classification of time series by shapelet transformation
Hills, J., Lines, J., Baranauskas, E., Mapp, J., & Bagnall, A. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-013-0322-1 · Cited by 538
A Survey on ensemble learning under the era of deep learning
Yang, Y., Lv, H., & Chen, N. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10283-5 · Cited by 369
Revisiting the Impact of Classification Techniques on the Performance of Defect Prediction Models
Ghotra, B., McIntosh, S., & Hassan, A. E. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.91 · Cited by 364
Lines, J., Taylor, S., & Bagnall, A. (2018) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3182382 · Cited by 333
Ensemble sparse classification of Alzheimer's disease
Liu, M., Zhang, D., & Shen, D. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.055 · Cited by 313
Nested cross-validation when selecting classifiers is overzealous for most practical applications
Wainer, J., & Cawley, G. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115222 · Cited by 309
Software Defect Prediction Using Ensemble Learning: A Systematic Literature Review
Matloob, F., Ghazal, T. M., Taleb, N., Aftab, S., Ahmad, M., Khan, M. A., Abbas, S., & Soomro, T. R. (2021) · IEEE Access · doi:10.1109/access.2021.3095559 · Cited by 293
Crowd Counting with Deep Negative Correlation Learning
Shi, Z., Zhang, L., Liu, Y., Cao, X., Ye, Y., Cheng, M.-M., & Zheng, G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00564 · Cited by 283
Computational Health Informatics in the Big Data Age: A Survey
Fang, R., Pouyanfar, S., Yang, Y., Chen, S.-C., & Iyengar, S. S. (2017) · ACM Computing Surveys · doi:10.1145/2932707 · Cited by 210
An improved boosting based on feature selection for corporate bankruptcy prediction
Wang, G., Ma, J., & Yang, S. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.09.033 · Cited by 187
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
Allen-Zhu, Z., & Li, Y. (2020) · arXiv · doi:10.48550/arxiv.2012.09816 · Cited by 178
Dynamics of firm financial evolution and bankruptcy prediction
du Jardin, P. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.01.016 · Cited by 103
Son, H., Kim, C., Hwang, N., Kim, C., & Kang, Y. (2014) · Advanced Engineering Informatics · doi:10.1016/j.aei.2013.10.001 · Cited by 74
Improving random forests by neighborhood projection for effective text classification
Salles, T., Gonçalves, M., Rodrigues, V., & Rocha, L. (2018) · Information Systems · doi:10.1016/j.is.2018.05.006 · Cited by 66
Ensemble Deep Learning for Biomedical Time Series Classification
Jin, L.-P., & Dong, J. (2016) · Computational Intelligence and Neuroscience · doi:10.1155/2016/6212684 · Cited by 60
Rajendran, S., Chamundeswari, S., & Sinha, A. A. (2022) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2022.100357 · Cited by 56
Artificial intelligence approaches to human-microbiome protein–protein interactions
Lim, H., Cankara, F., Tsai, C.-J., Keskin, O., Nussinov, R., & Gursoy, A. (2022) · Current Opinion in Structural Biology · doi:10.1016/j.sbi.2022.102328 · Cited by 39
Morris, J. S., Luthra, R., Liu, Y., Duose, D. Y., Lee, W., Reddy, N. G., Windham, J., Chen, H., Tong, Z., Zhang, B., et al. (2021) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-20-2403 · Cited by 36
Metadata
- Authors
- Rodriguez, J. J., Kuncheva, L. I., & Alonso, C. J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2006-10
- Volume
- 28
- Issue
- 10
- Pages
- 1619-1630
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2150757437
- Cited by
- 1,893
- References
- 48
- FWCI
- 32.53
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
