The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
A Novel Bayes Model: Hidden Naive Bayes
Abstract
Because learning an optimal Bayesian network classifier is an NP-hard problem, learning-improved naive Bayes has attracted much attention from researchers. In this paper, we summarize the existing improved algorithms and propose a novel Bayes model: hidden naive Bayes (HNB). In HNB, a hidden parent is created for each attribute which combines the influences from all other attributes. We experimentally test HNB in terms of classification accuracy, using the 36 UCI data sets selected by Weka, and compare it to naive Bayes (NB), selective Bayesian classifiers (SBC), naive Bayes tree (NBTree), tree-augmented naive Bayes (TAN), and averaged one-dependence estimators (AODE). The experimental results show that HNB significantly outperforms NB, SBC, NBTree, TAN, and AODE. In many data mining applications, an accurate class probability estimation and ranking are also desirable. We study the class probability estimation and ranking performance, measured by conditional log likelihood (CLL) and the area under the ROC curve (AUC), respectively, of naive Bayes and its improved models, such as SBC, NBTree, TAN, and AODE, and then compare HNB to them in terms of CLL and AUC. Our experiments show that HNB also significantly outperforms all of them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
(1988) · Cited by 16,582
Witten, I. H. (2008) · Cited by 9,143
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
UCI Repository of Machine Learning Databases
Merz, C. J. (1996) · Medical Entomology and Zoology · Cited by 2,363
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276
Scaling Up the Accuracy of Naive-Bayes Classifiers : a Decision-Tree Hybrid
Kohavi, R. (1996) · Knowledge Discovery and Data Mining · Cited by 1,414
MetaCost: a general method for making classifiers cost-sensitive
Domingos, P. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312220 · Cited by 1,303
Inference for the Generalization Error
Nadeau, C., & Bengio, Y. (2003) · Machine Learning · doi:10.1023/a:1024068626366 · Cited by 1,026
Learning Bayesian networks is NP-complete
Chickering, D. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2404-4_12 · Cited by 1,001
Not So Naive Bayes: Aggregating One-Dependence Estimators
Webb, G. I., Boughton, J. R., & Wang, Z. (2005) · Machine Learning · doi:10.1007/s10994-005-4258-6 · Cited by 708
Induction of Selective Bayesian Classifiers
LANGLEY, P., & SAGE, S. (1994) · Uncertainty Proceedings 1994 · doi:10.1016/b978-1-55860-332-5.50055-9 · Cited by 657
AUC: a statistically consistent and more discriminating measure than accuracy
Ling, C. X., Huang, J., & Zhang, H. (2003) · Cited by 518
Self-citationInference for the Generalization ErrorPreprint
Bengio, Y., & Nadeau, C. (1999) · RePEc: Research Papers in Economics · Cited by 485
Learning Bayesian network classifiers by maximizing conditional likelihood
Grossman, D., & Domingos, P. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015339 · Cited by 299
Frank, E., Hall, M., & Pfahringer, B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2487 · Cited by 273
Lazy Learning of Bayesian Rules
Zheng, Z., & Webb, G. I. (2000) · Machine Learning · doi:10.1023/a:1007613203719 · Cited by 247
Keogh, E., & Pazzani, M. J. (1999) · Cited by 204
A decision tree-based attribute weighting filter for naive Bayes
Hall, M. (2007) · Knowledge-Based Systems · doi:10.1016/j.knosys.2006.11.008 · Cited by 169
Learning weighted naive Bayes with accurate ranking
Zhang, H., & Sheng, S. (2004) · Fourth IEEE International Conference on Data Mining (ICDM'04) · doi:10.1109/icdm.2004.10030 · Cited by 164
Self-citationSNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning
Xie, Z., Hsu, W., Liu, Z., & Lee, M. L. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47887-6_10 · Cited by 79
Toward Bayesian Classifiers with Accurate Probabilities
Ling, C. X., & Zhang, H. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47887-6_12 · Cited by 32
Self-citationUSING INSTANCE CLONING TO IMPROVE NAIVE BAYES FOR RANKING
Jiang, L., Wang, D., Zhang, H., Cai, Z., & Huang, B. (2008) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001408006703 · Cited by 17
Self-citation
Cited by
Learning from positive and unlabeled data: a survey
Bekker, J., & Davis, J. (2020) · Machine Learning · doi:10.1007/s10994-020-05877-5 · Cited by 651
A Survey on Machine Learning Techniques for Cyber Security in the Last Decade
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I. A., & Xu, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041951 · Cited by 530
Kumari, S., Kumar, D., & Mittal, M. (2021) · International Journal of Cognitive Computing in Engineering · doi:10.1016/j.ijcce.2021.01.001 · Cited by 446
Generative Adversarial Networks: A Survey Toward Private and Secure Applications
Cai, Z., Xiong, Z., Xu, H., Wang, P., Li, W., & Pan, Y. (2022) · ACM Computing Surveys · doi:10.1145/3459992 · Cited by 376
Self-citationA network intrusion detection system based on a Hidden Naïve Bayes multiclass classifier
Koc, L., Mazzuchi, T. A., & Sarkani, S. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.07.009 · Cited by 310
Metadata
- Authors
- Jiang, L., Zhang, H., & Cai, Z.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2009-10
- Volume
- 21
- Issue
- 10
- Pages
- 1361-1371
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2172238468
- Cited by
- 358
- References
- 26
- FWCI
- 11.13
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.