The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A Correlation-Based Feature Weighting Filter for Naive Bayes
Abstract
Due to its simplicity, efficiency, and efficacy, naive Bayes (NB) has continued to be one of the top 10 algorithms in the data mining and machine learning community. Of numerous approaches to alleviating its conditional independence assumption, feature weighting has placed more emphasis on highly predictive features than those that are less predictive. In this paper, we argue that for NB highly predictive features should be highly correlated with the class (maximum mutual relevance), yet uncorrelated with other features (minimum mutual redundancy). Based on this premise, we propose a correlation-based feature weighting (CFW) filter for NB. In CFW, the weight for a feature is a sigmoid transformation of the difference between the feature-class correlation (mutual relevance) and the average feature-feature intercorrelation (average mutual redundancy). Experimental results show that NB with CFW significantly outperforms NB and all the other existing state-of-the-art feature weighting filters used to compare. Compared to feature weighting wrappers for improving NB, the main advantages of CFW are its low computational complexity (no search involved) and the fact that it maintains the simplicity of the final model. Besides, we apply CFW to text classification and have achieved remarkable improvements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Peng, H., Long, F., & Ding, C. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.159 · Cited by 10,544
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
(1998) · Cited by 3,476
Probabilistic Reasoning in Intelligent Systems
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27609-4 · Cited by 3,321
A comparison of event models for naive bayes text classification
McCallum, A., & Nigam, K. (1998) · Cited by 3,289
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss
Domingos, P., & Pazzani, M. (1997) · Machine Learning · doi:10.1023/a:1007413511361 · Cited by 3,101
Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning
Fayyad, U. M., & Irani, K. B. (1993) · International Joint Conference on Artificial Intelligence · Cited by 2,870
Alcalá‐Fdez, J., Fernández, A., Luengo, J., Derrac, J., García, S., Sánchez, L., & Herrera, F. (2011) · Consultation of the Doctoral Thesis Database (TESEO) (Ministerio de Educación, Cultura y Deporte) · Cited by 2,328
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
Hall, M. A. (2000) · Cited by 1,715
García, S., & Herrera, F. (2008) · Institutional Repository of the University of Granada (University of Granada) · Cited by 1,283
An analysis of Bayesian classifiers
Langley, P., Iba, W., & Thompson, K. (1992) · Cited by 1,214
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Inference for the Generalization Error
Nadeau, C., & Bengio, Y. (2003) · Machine Learning · doi:10.1023/a:1024068626366 · Cited by 1,026
Tackling the poor assumptions of naive bayes text classifiers
Rennie, J. D. M., Shih, L., Teevan, J. B., & Karger, D. R. (2003) · Cited by 977
Beyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier.
Domingos, P., & Pazzani, M. J. (1996) · Cited by 690
Induction of Selective Bayesian Classifiers
LANGLEY, P., & SAGE, S. (1994) · Uncertainty Proceedings 1994 · doi:10.1016/b978-1-55860-332-5.50055-9 · Cited by 657
AUC: a statistically consistent and more discriminating measure than accuracy
Ling, C. X., Huang, J., & Zhang, H. (2003) · Cited by 518
The MONK's problems: A Performance Comparison of Different Learning Algorithms
Thrun, S., Bala, J. W., Bloedorn, E., Bratko, I., Cestnik, B., Cheng, J. Q., Jong, K. A. D., Džeroski, S., Fisher, D., Fahlman, S. E., et al. (1991) · doi:10.13021/mars/3370 · Cited by 445
A Novel Bayes Model: Hidden Naive Bayes
Jiang, L., Zhang, H., & Cai, Z. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.234 · Cited by 358
Self-citationDeep feature weighting for naive Bayes and its application to text classification
Jiang, L., Li, C., Wang, S., & Zhang, L. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.02.002 · Cited by 327
Self-citationLearning Bayesian network classifiers by maximizing conditional likelihood
Grossman, D., & Domingos, P. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015339 · Cited by 299
Frank, E., Hall, M., & Pfahringer, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2487 · Cited by 273
Toward Optimal Feature Selection in Naive Bayes for Text Categorization
Tang, B., Kay, S., & He, H. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2563436 · Cited by 253
Keogh, E., & Pazzani, M. J. (1999) · Cited by 204
A decision tree-based attribute weighting filter for naive Bayes
Hall, M. (2007) · Knowledge-Based Systems · doi:10.1016/j.knosys.2006.11.008 · Cited by 169
Alleviating naive Bayes attribute independence assumption by attribute weighting
Zaidi, N. A., Cerquides, J., Carman, M., & Webb, G. I. (2013) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · doi:10.13039/501100000923 · Cited by 167
Learning weighted naive Bayes with accurate ranking
Zhang, H., & Sheng, S. (2004) · Fourth IEEE International Conference on Data Mining (ICDM'04) · doi:10.1109/icdm.2004.10030 · Cited by 164
Improving Tree augmented Naive Bayes for class probability estimation
Jiang, L., Cai, Z., Wang, D., & Zhang, H. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.08.010 · Cited by 153
Self-citationFeature selection for the naive bayesian classifier using decision trees
Ratanamahatana, C. A., & Gunopulos, D. (2003) · Applied Artificial Intelligence · doi:10.1080/713827175 · Cited by 148
Adapting naive Bayes tree for text classification
Wang, S., Jiang, L., & Li, C. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-014-0746-y · Cited by 128
Self-citationCalculating Feature Weights in Naive Bayes with Kullback-Leibler Measure
Lee, C.-H., Gutierrez, F., & Dou, D. (2011) · Proceedings · doi:10.1109/icdm.2011.29 · Cited by 116
Naive Bayes text classifiers: a locally weighted learning approach
Jiang, L., Cai, Z., Zhang, H., & Wang, D. (2012) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/0952813x.2012.721010 · Cited by 107
Self-citationDiab, D. M., & Hindi, K. M. E. (2016) · Applied Soft Computing · doi:10.1016/j.asoc.2016.12.043 · Cited by 102
SNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning
Xie, Z., Hsu, W., Liu, Z., & Lee, M. L. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47887-6_10 · Cited by 79
Attribute Weighting via Differential Evolution Algorithm for Attribute Weighted Naive Bayes (WNB)
Wu, J. X., & Cai, Z. (2011) · UTS ePRESS (University of Technology Sydney) · Cited by 70
Self-citationDISCRIMINATIVELY WEIGHTED NAIVE BAYES AND ITS APPLICATION IN TEXT CLASSIFICATION
Jiang, L., Wang, D., & Cai, Z. (2011) · International Journal of Artificial Intelligence Tools · doi:10.1142/s0218213011004770 · Cited by 59
Self-citationNot so greedy: Randomly Selected Naive Bayes
Jiang, L., Cai, Z., Zhang, H., & Wang, D. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.03.022 · Cited by 54
Self-citationSODE: Self-Adaptive One-Dependence Estimators for classification
Wu, J. X., Pan, S., Xingquan Zhu, A., Zhang, P., & Chengqi Zhang, B. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.08.023 · Cited by 51
Self-citationFine tuning the Naïve Bayesian learning algorithm
Hindi, K. M. E. (2014) · AI Communications · doi:10.3233/aic-130588 · Cited by 43
Not always simple classification: Learning SuperParent for class probability estimation
Chen, Q., Jiang, L., & Li, C. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.02.049 · Cited by 38
Self-citationDiscriminative Model Selection for Belief Net Structures
Greiner, R., & Guo, Y. (2004) · doi:10.7939/r3610vr65 · Cited by 32
Random one-dependence estimators
Jiang, L. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.11.016 · Cited by 23
Self-citation
Cited by
Ali, F., El-Sappagh, S., Islam, S. M. R., Kwak, D., Ali, A., Imran, M., & Kwak, K.-S. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.008 · Cited by 818
A novel selective naïve Bayes algorithm
Chen, S., Webb, G. I., Liu, L., & Ma, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.105361 · Cited by 407
BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image
Cai, Y., Liu, X., & Cai, Z. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2951433 · Cited by 278
Metadata
- Authors
- Jiang, L., Zhang, L., Li, C., & Wu, J.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2019-02-01
- Volume
- 31
- Issue
- 2
- Pages
- 201-213
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W2803413127
- Cited by
- 268
- References
- 46
- FWCI
- 13.01
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.