A novel selective naïve Bayes algorithm
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Abstract Naive Bayes is one of the most popular data mining algorithms. Its efficiency comes from the assumption of attribute independence, although this might be violated in many real-world data sets. Many efforts have been done to mitigate the assumption, among which attribute selection is an important approach. However, conventional efforts to perform attribute selection in naive Bayes suffer from heavy computational overhead. This paper proposes an efficient selective naive Bayes algorithm, which adopts only some of the attributes to construct selective naive Bayes models. These models are built in such a way that each one is a trivial extension of another. The most predictive selective naive Bayes model can be selected by the measures of incremental leave-one-out cross validation. As a result, attributes can be selected by efficient model selection. Empirical results demonstrate that the selective naive Bayes shows superior classification accuracy, yet at the same time maintains the simplicity and efficiency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
(2009) · Cited by 6,153
Top 10 algorithms in data mining
Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667
Information Theory, Inference, and Learning Algorithms
(2004) · Kybernetes · doi:10.1108/03684920410534506 · Cited by 4,937
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
An empirical study of the naive Bayes classifier
Rish, I. (2001) · Cited by 3,202
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
Feature selection for high-dimensional data: a fast correlation-based filter solution
Yu, L., & Liu, H. (2003) · Cited by 2,305
Approximating discrete probability distributions with dependence trees
Chow, C., & Liu, C. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054142 · Cited by 1,720
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
Hall, M. A. (2000) · Cited by 1,715
García, S., & Herrera, F. (2008) · Institutional Repository of the University of Granada (University of Granada) · Cited by 1,619
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Pattern Classification and Scene Analysis.
Grenander, U., Duda, R. O., & Hart, P. E. (1974) · Journal of the American Statistical Association · doi:10.2307/2286028 · Cited by 1,006
Kohavi, R. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59286-5_57 · Cited by 712
Not So Naive Bayes: Aggregating One-Dependence Estimators
Webb, G. I., Boughton, J. R., & Wang, Z. (2005) · Machine Learning · doi:10.1007/s10994-005-4258-6 · Cited by 708
Self-citationInduction of Selective Bayesian Classifiers
LANGLEY, P., & SAGE, S. (1994) · Uncertainty Proceedings 1994 · doi:10.1016/b978-1-55860-332-5.50055-9 · Cited by 657
2015 IEEE International Conference on Data Mining
(2015) · doi:10.1109/icdm36327.2015 · Cited by 521
Estimating probabilities: a crucial task in machine learning
Cestnik, B. (1990) · European Conference on Artificial Intelligence · Cited by 459
Learning limited dependence Bayesian classifiers
Sahami, M. (1996) · Cited by 363
A Novel Bayes Model: Hidden Naive Bayes
Jiang, L., Zhang, H., & Cai, Z. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.234 · Cited by 358
A Correlation-Based Feature Weighting Filter for Naive Bayes
Jiang, L., Zhang, L., Li, C., & Wu, J. (2019) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2836440 · Cited by 268
Keogh, E., & Pazzani, M. J. (1999) · Cited by 204
AI 2004: Advances in Artificial Intelligence
Bourke, P. D., Cornforth, D. J., Iorio, A. W., Jelinek, H. F., Landini, G., & Roberts, A. J. (2005) · Lecture notes in computer science · doi:10.1007/b104336 · Cited by 189
A decision tree-based attribute weighting filter for naive Bayes
Hall, M. (2007) · Knowledge-Based Systems · doi:10.1016/j.knosys.2006.11.008 · Cited by 169
Alleviating naive Bayes attribute independence assumption by attribute weighting
Zaidi, N. A., Cerquides, J., Carman, M., & Webb, G. I. (2013) · DIGITAL.CSIC (Spanish National Research Council (CSIC)) · doi:10.13039/501100000923 · Cited by 167
Self-citationLearning weighted naive Bayes with accurate ranking
Zhang, H., & Sheng, S. (2004) · Fourth IEEE International Conference on Data Mining (ICDM'04) · doi:10.1109/icdm.2004.10030 · Cited by 164
A ‘non-parametric’ version of the naive Bayes classifier
Soria, D., Garibaldi, J. M., Ambrogi, F., Biganzoli, E. M., & Ellis, I. O. (2011) · Knowledge-Based Systems · doi:10.1016/j.knosys.2011.02.014 · Cited by 164
Speeding up incremental wrapper feature subset selection with Naive Bayes classifier
Bermejo, P., Gámez, J. A., & Puerta, J. M. (2014) · Knowledge-Based Systems · doi:10.1016/j.knosys.2013.10.016 · Cited by 162
Advances in Knowledge Discovery and Data Mining
Zaki, M. J., Pudi, V., Ravindran, B., & Yu, J. X. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13672-6 · Cited by 146
Zhang, H., Jiang, L., & Jiang, S. (2005) · National Conference on Artificial Intelligence · Cited by 130
Calculating Feature Weights in Naive Bayes with Kullback-Leibler Measure
Lee, C.-H., Gutierrez, F., & Dou, D. (2011) · Proceedings · doi:10.1109/icdm.2011.29 · Cited by 116
Non-Naive Bayesian Classifiers for Classification Problems With Continuous Attributes
Wang, X., He, Y., & Wang, D. D. (2013) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2013.2245891 · Cited by 97
Webb, G. I., Boughton, J. R., Zheng, F., Ting, K. M., & Salem, H. (2011) · Machine Learning · doi:10.1007/s10994-011-5263-6 · Cited by 92
Self-citationClassification using Hierarchical Naïve Bayes models
Helge Langseth, A., & Nielsen, T. D. (2006) · Machine Learning · doi:10.1007/s10994-006-6136-2 · Cited by 92
Mixture of latent multinomial naive Bayes classifier
Harzevili, N. S., & Alizadeh, S. H. (2018) · Applied Soft Computing · doi:10.1016/j.asoc.2018.04.020 · Cited by 74
Naive Bayes Classifiers That Perform Well with Continuous Variables
Bouckaert, R. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30549-1_106 · Cited by 72
Not so greedy: Randomly Selected Naive Bayes
Jiang, L., Cai, Z., Zhang, H., & Wang, D. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.03.022 · Cited by 54
A gradient approach for value weighted classification learning in naive Bayes
Lee, C. (2015) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.04.020 · Cited by 45
An information-theoretic filter approach for value weighted classification learning in naive Bayes
Lee, C. (2017) · Data & Knowledge Engineering · doi:10.1016/j.datak.2017.11.002 · Cited by 39
Not always simple classification: Learning SuperParent for class probability estimation
Chen, Q., Jiang, L., & Li, C. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.02.049 · Cited by 38
Attribute Value Weighted Average of One-Dependence Estimators
Yu, L., Jiang, L., Wang, D., & Zhang, L. (2017) · Entropy · doi:10.3390/e19090501 · Cited by 32
Proceedings - Fourth IEEE International Conference on Data Mining, ICDM 2004
Wang, J., & Karypis, G. (2004) · Cited by 29
Random one-dependence estimators
Jiang, L. (2010) · Pattern Recognition Letters · doi:10.1016/j.patrec.2010.11.016 · Cited by 24
Liu, B., Yang, Y., Webb, G. I., & Boughton, J. R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01307-2_29 · Cited by 21
Self-citationSelective AnDE for large data learning: a low-bias memory constrained approach
Chen, S., Martínez, A. M., Webb, G. I., & Wang, L. (2016) · Knowledge and Information Systems · doi:10.1007/s10115-016-0937-9 · Cited by 19
Self-citation
Cited by
Machine Learning Methods in Smart Lighting Toward Achieving User Comfort: A Survey
Putrada, A. G., Abdurohman, M., Perdana, D., & Nuha, H. H. (2022) · IEEE Access · doi:10.1109/access.2022.3169765 · Cited by 101
“It is efficient because it takes the assumption that attributes are independent [189].”
Background
Metadata
- Authors
- Chen, S., Webb, G. I., Liu, L., & Ma, X.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 192
- Pages
- 105361
- ISSN
- 0950-7051 (ISSN-L)
- OpenAlex
- W2996283780
- Cited by
- 407
- References
- 47
- FWCI
- 34.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.