The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Machine learning for email spam filtering: review, approaches and open research problems
Open accessAbstract
The upsurge in the volume of unwanted emails called spam has created an intense need for the development of more dependable and robust antispam filters. Machine learning methods of recent are being used to successfully detect and filter spam emails. We present a systematic review of some of the popular machine learning based email spam filtering approaches. Our review covers survey of the important concepts, attempts, efficiency, and the research trend in spam filtering. The preliminary discussion in the study background examines the applications of machine learning techniques to the email spam filtering process of the leading internet service providers (ISPs) like Gmail, Yahoo and Outlook emails spam filters. Discussion on general email spam filtering process, and the various efforts by different researchers in combating spam through the use machine learning techniques was done. Our review compares the strengths and drawbacks of existing machine learning approaches and the open research problems in spam filtering. We recommended deep leaning and deep adversarial learning as the future techniques that can effectively handle the menace of spam emails.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Ensemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
Rough Sets: Theoretical Aspects of Reasoning about Data
Pawlak, Z. (1991) · Our Digital Library (Warsaw University of Technology) · Cited by 8,343
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096 · cited 1×
“The technique is beneficial when the size of the message is large and a condensed feature representation is needed to make the task of text or image matching snappy [31].”
Background(2008) · Data Mining and Market Intelligence for Optimal Marketing Returns · doi:10.4324/9780080878096-12 · Cited by 6,954
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884 · cited 2×
“A learner is trained in every phase of the classi fi cation process, and the result of each phase is used to add credence to data for the upcoming phases [87].”
MethodResultThe Nature of Statistical Learning Theory
Sain, S. R. (1996) · Technometrics · doi:10.1080/00401706.1996.10484565 · Cited by 5,434
Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Williams, C. K. I. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s269 · Cited by 4,281
Firefly Algorithms for Multimodal Optimization
Yang, X.-S. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04944-6_14 · Cited by 4,075
Deep Learning: Methods and Applications
Deng, L., & Yu, D. (2014) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000039 · Cited by 3,480
Improved boosting algorithms using confidence-rated predictions
Schapire, R. E., & Singer, Y. (1998) · Proceedings of the eleventh annual conference on Computational learning theory · doi:10.1145/279943.279960 · Cited by 2,547
Improved Boosting Algorithms Using Confidence-rated Predictions
Schapire, R. E., & Singer, Y. (1999) · Machine Learning · doi:10.1023/a:1007614523901 · Cited by 1,971
Deep Learning: Methods and Applications
Deng, L. (2014) · now publishers, Inc. eBooks · doi:10.1561/9781601988157 · Cited by 1,759
Adversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P., Zhu, Q., & Li, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886017 · Cited by 1,733
Comparison among five evolutionary-based optimization algorithms
Elbeltagi, E., Hegazy, T., & Grierson, D. (2005) · Advanced Engineering Informatics · doi:10.1016/j.aei.2005.01.004 · Cited by 1,284
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008
(2007) · Foundations of SQL Server 2005 Business Intelligence · doi:10.1007/978-1-4302-0248-6_11 · Cited by 941
Can machine learning be secure?
Barreno, M., Nelson, B., Sears, R., Joseph, A. D., & Tygar, J. D. (2006) · Proceedings of the 2006 ACM Symposium on Information, computer and communications security · doi:10.1145/1128817.1128824 · Cited by 836
Learning to detect phishing emails
Fette, I., Sadeh, N., & Tomasic, A. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242660 · Cited by 604
Combinations of genetic algorithms and neural networks: a survey of the state of the art
Schaffer, J. D., Whitley, D., & Eshelman, L. J. (2003) · [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks · doi:10.1109/cogann.1992.273950 · Cited by 570
A review of machine learning approaches to Spam filtering
Guzella, T. S., & Caminhas, W. M. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.02.037 · Cited by 542
An evaluation of Naive Bayesian anti-spam filtering
Androutsopoulos, I., Koutsias, J., Chandrinos, K. V., Paliouras, G., & Spyropoulos, C. D. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0006013 · Cited by 523
A comparison of machine learning techniques for phishing detection
Abu-Nimeh, S., Nappa, D., Wang, X., & Nair, S. (2007) · Proceedings of the anti-phishing working groups 2nd annual eCrime researchers summit · doi:10.1145/1299015.1299021 · Cited by 502
Exploiting machine learning to subvert your spam filter
Nelson, B. A., Barreno, M., Chi, F. J., Joseph, A. D., Rubinstein, B. I. P., Saini, U., Sutton, C. A., Tygar, J. D., & Xia, K. (2008) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 481
Large-Scale Automatic Classification of Phishing Pages
Whittaker, C., Ryner, B., & Nazif, M. (2010) · Network and Distributed System Security Symposium · Cited by 468
Androutsopoulos, I., Koutsias, J., Chandrinos, K. V., & Spyropoulos, C. D. (2000) · Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/345508.345569 · Cited by 465
An evaluation of statistical spam filtering techniques
Zhang, L., Zhu, J., & Yao, T. (2004) · ACM Transactions on Asian Language Information Processing · doi:10.1145/1039621.1039625 · Cited by 315
Learning to Filter Spam E-Mail: A Comparison of a Naive Bayesian and a Memory-Based Approach
Androutsopoulos, I., Παλιούρας, Γ., Karkaletsis, V., Sakkis, G., Spyropoulos, C. D., & Stamatopoulos, P. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0009009 · Cited by 281
A Framework for Designing the Architectures of Deep Convolutional Neural Networks
Albelwi, S., & Mahmood, A. (2017) · Entropy · doi:10.3390/e19060242 · Cited by 278
Email Spam Filtering: A Systematic Review
Cormack, G. V. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000006 · Cited by 262
Relaxed online SVMs for spam filtering
Sculley, D., & Wachman, G. M. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277813 · Cited by 221
Adversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P. L., Zhu, Q., & Li, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07107 · Cited by 213
Learning Fast Classifiers for Image Spam.
Dredze, M. H., Gevaryahu, R., & Elias-Bachrach, A. (2007) · Conference on Email and Anti-Spam · Cited by 201
Multiclass Alternating Decision Trees
Holmes, G., Pfahringer, B., Kirkby, R., Frank, E., & Hall, M. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-36755-1_14 · Cited by 192
Stacking classifiers for anti-spam filtering of e-mailPreprint
Sakkis, G., Androutsopoulos, I., Παλιούρας, Γ., Karkaletsis, V., Spyropoulos, C. D., & Stamatopoulos, P. (2001) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0106040 · Cited by 181
Email Spam Filtering: A Systematic Review
Cormack, G. V. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981479 · Cited by 178
Empirical Methods in Natural Language Processing
Rodríguez, K. J., Bryant, M., Blanke, T., & Luszczynska, M. (2012) · Cited by 178
Koprinska, I., Poon, J., Clark, J., & Chan, J. (2007) · Information Sciences · doi:10.1016/j.ins.2006.12.005 · Cited by 171
Yu, B., & Xu, Z. (2008) · Knowledge-Based Systems · doi:10.1016/j.knosys.2008.01.001 · Cited by 123
Online supervised spam filter evaluation
Cormack, G. V., & Lynam, T. R. (2007) · ACM Transactions on Information Systems · doi:10.1145/1247715.1247717 · Cited by 115
Bagging Classifiers for Fighting Poisoning Attacks in Adversarial Classification Tasks
Biggio, B., Corona, I., Fumera, G., Giacinto, G., & Roli, F. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21557-5_37 · Cited by 114
Karim, M., & Rahman, R. M. (2013) · Journal of Software Engineering and Applications · doi:10.4236/jsea.2013.64025 · Cited by 106
Filtering Image Spam with Near-Duplicate Detection.
Wang, Z., Josephson, W. K., Lv, Q., Charikar, M., & Li, K. (2007) · Cited by 101
SpamHunting: An instance-based reasoning system for spam labelling and filtering
Fdez‐Riverola, F., Iglesias, E. L., Díaz, F., Méndez, J. R., & Corchado, J. M. (2007) · Decision Support Systems · doi:10.1016/j.dss.2006.11.012 · Cited by 89
Kim, M. S., Cho, K. T., Kwag, H. K., & Kim, J. H. (2004) · Lecture notes in computer science · doi:10.1007/b100557 · Cited by 83
Machine Learning for E-mail Spam Filtering: Review,Techniques and TrendsPreprint
Bhowmick, A., & Hazarika, S. M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.01042 · Cited by 77
Gao, Y., Yang, M., Zhao, X., Pardo, B., Wu, Y. N., Pappas, T. N., & Choudhary, A. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4517972 · Cited by 66
Chapter 3 Email Spam Filtering
Puertas, E., Hidalgo, J. M. G., & Pérez, J. C. C. (2008) · Advances in computers · doi:10.1016/s0065-2458(08)00603-7 · Cited by 61
Almeida, T. A., & Yamakami, A. (2010) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2010.5596569 · Cited by 54
Study on the effectiveness of anomaly detection for spam filtering
Laorden, C., Ugarte-Pedrero, X., Santos, I., Sanz, B., Nieves, J., & Bringas, P. G. (2014) · Information Sciences · doi:10.1016/j.ins.2014.02.114 · Cited by 53
Learning to classify email: a survey
Wang, X., & Cloete (2005) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2005.1527956 · Cited by 52
Pelletier, L., Almhana, J., & Choulakian, V. (2004) · Conference on Communication Networks and Services Research · doi:10.1109/dnsr.2004.1344731 · Cited by 51
Workload models of spam and legitimate e-mails
Gomes, L. H., Cazita, C., Almeida, J. M., Almeida, V. A. F., & Meira, W. (2006) · Performance Evaluation · doi:10.1016/j.peva.2006.11.001 · Cited by 49
An email classification model based on rough set theory
Zhao, W., & Zhang, Z. (2005) · doi:10.1109/amt.2005.1505383 · Cited by 45
A study on e-mail image spam filtering techniques
Dhanaraj, S., & Karthikeyani, V. (2013) · International Conference on Pattern Recognition, Informatics and Mobile Engineering (PRIME) · doi:10.1109/icprime.2013.6496446 · Cited by 38
Fast statistical spam filter by approximate classifications
Li, K., & Zhong, Z. (2006) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1140103.1140317 · Cited by 38
Zavvar, M. H., Rezaei, M., & Garavand, S. (2016) · International Journal of Modern Education and Computer Science · doi:10.5815/ijmecs.2016.07.08 · Cited by 38
A Neural Network Classifier for Junk E-Mail
Stuart, I., Cha, S.-H., & Tappert, C. C. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28640-0_42 · Cited by 33
Targeting spam control on middleboxes: Spam detection based on layer-3 e-mail content classification
Marsono, M. N., El-Kharashi, M. W., & Gebali, F. (2008) · Computer Networks · doi:10.1016/j.comnet.2008.11.012 · Cited by 29
Evaluating the security of machine learning algorithms
Tygar, J. D., & Barreno, M. (2008) · UC Berkeley · Cited by 25
TENCON 2010 - 2010 IEEE Region 10 Conference
(2010) · doi:10.1109/tencon15797.2010 · Cited by 25
Improving E-Mail Spam Classification using Ant Colony Optimization Algorithm
Renuka, D. K., Visalakshi, P., & Sankar, T. J. (2015) · Cited by 23
Quality, Reliability, Security and Robustness in Heterogeneous Networks
Efatmaneshnik, M., Kealy, A., Lim, S., & Dempster, A. (2012) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-29222-4 · Cited by 22
Adaptive binary flower pollination algorithm for feature selection in review spam detection
Rajamohana, S. P., Umamaheswari, K., & Abirami, B. (2017) · International Conference on Innovations in Green Energy and Healthcare Technologies (IGEHT) · doi:10.1109/igeht.2017.8094094 · Cited by 22
Email Mining: Emerging Techniques for Email Management
Katakis, I., Vlahavas, I. P., & Tsoumakas, G. (2006) · Cited by 17
Towards Accurate Deceptive Opinion Spam Detection based on Word Order-preserving CNNPreprint
Zhao, S., Xu, Z., Liu, L., & Guo, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09181 · Cited by 16
Design and Development of Naive Bayes Classifier
Garg, B. (2013) · NDSU Repository (North Dakota State University) · Cited by 12
Efficient data management for incoherent ray tracing
Yang, X. S., Xu, D., & Zhao, L. (2012) · Applied Soft Computing · doi:10.1016/j.asoc.2012.07.002 · Cited by 12
Spam Filtering and Email-Mediated Applications
Li, W., Zhong, N., Yao, Y. Y., Liu, J., & Liu, C. (2007) · Springer eBooks · doi:10.1007/978-3-540-77028-2_23 · Cited by 9
Spam Classification Using Machine Learning Techniques - Sinespam
Sosa, J. N. (2010) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 3
Evaluation of Firefly Algorithm Using Benchmark Functions
Kundur, A. (2013) · NDSU Repository (North Dakota State University) · Cited by 1
Cited by
Using machine learning approaches for multi-omics data analysis: A review
Reel, P. S., Reel, S., Pearson, E., Trucco, E., & Jefferson, E. (2021) · Biotechnology Advances · doi:10.1016/j.biotechadv.2021.107739 · Cited by 903
Machine learning and natural language processing in mental health: systematic review
Le Glaz, A., Haralambous, Y., Kim-Dufor, D.-H., Lenca, P., Billot, R., Ryan, T. C., Marsh, J., DeVylder, J., Walter, M., Berrouiguet, S., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/15708 · Cited by 576
A Survey on Machine Learning Techniques for Cyber Security in the Last Decade
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I. A., & Xu, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041951 · Cited by 530
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
Zhang, Z., Hamadi, H. A., Damiani, E., Yeun, C. Y., & Taher, F. (2022) · IEEE Access · doi:10.1109/access.2022.3204051 · Cited by 450
Text Mining in Big Data Analytics
Hassani, H., Beneki, C., Unger, S., Mazinani, M. T., & Yeganegi, M. R. (2020) · Big Data and Cognitive Computing · doi:10.3390/bdcc4010001 · Cited by 317
Metadata
- Authors
- Dada, E. G., Bassi, J. S., Chiroma, H., Abdulhamid, S. M., Adetunmbi, A. O., & Ajibuwa, O. E.
- Venue
- Heliyon
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 5
- Issue
- 6
- Pages
- e01802
- ISSN
- 2405-8440 (ISSN-L)
- OpenAlex
- W2949836779
- Cited by
- 536
- References
- 77
- FWCI
- 74.35
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.