A Survey of Predictive Modeling on Imbalanced Domains
Open accessThe DOI matches its Crossref record; 261 of the 266 references it cites were found in a registry or an index.
Abstract
Many real-world data-mining applications involve obtaining predictive models using datasets with strongly imbalanced distributions of the target variable. Frequently, the least-common values of this target variable are associated with events that are highly relevant for end users (e.g., fraud detection, unusual returns on stock markets, anticipation of catastrophes, etc.). Moreover, the events may have different costs and benefits, which, when associated with the rarity of some of them on the available training data, creates serious problems to predictive modeling techniques. This article presents a survey of existing techniques for handling these important applications of predictive analytics. Although most of the existing work addresses classification tasks (nominal target variables), we also describe methods designed to handle similar problems within regression tasks (numeric target variables). In this survey, we discuss the main challenges raised by imbalanced domains, propose a definition of the problem, describe the main approaches to these tasks, propose a taxonomy of the methods, summarize the conclusions of existing comparative studies as well as some theoretical analyses of some methods, and refer to some related problems within predictive modeling.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Here, techniques such as under-sampling and synthetic data have been found to enhance model performance [16].”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
In the citing paper
“Earlier trends of opportunistic data collection and post hoc justifications of large datasets are gradually moving towards a requirement for more deliberative data collection methods [35,36], sampling techniques [16] and minimal data architectures [57] to deliver better performance without reducing model accuracy.”
From A Survey of Data Quality Requirements That Matter in ML Development Pipelines (2023) · cites this paper as [16]
Citations
Cites
Items 201–261 of 261
Granular SVM with Repetitive Undersampling for Highly Imbalanced Protein Homology Prediction
Tang, Y., & Zhang, Y. (2006) · IEEE International Conference on Granular Computing (GrC) · doi:10.1109/grc.2006.1635839 · Cited by 45
Imbalanced Classification Based on Active Learning SMOTE
Mi, Y. (2013) · Research Journal of Applied Sciences Engineering and Technology · doi:10.19026/rjaset.5.5044 · Cited by 45
Alejo, R., García, V., & Pacheco-Sánchez, J. H. (2014) · Neural Processing Letters · doi:10.1007/s11063-014-9376-3 · Cited by 44
Combination approach of SMOTE and biased-SVM for imbalanced datasets
Wang, H. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4633794 · Cited by 44
Yang, Y. (2012) · Energy Procedia · doi:10.1016/j.egypro.2012.02.078 · Cited by 43
Intelligent control and automation
(2016) · IEEE International Conference on Compatibility, Power Electronics and Power Engineering · doi:10.1109/cpe.2016.7544232 · Cited by 43
Real estate price prediction under asymmetric loss
Cain, M., & Janssen, C. (1995) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00773391 · Cited by 42
Improving the Performance of the RBF Neural Networks Trained with Imbalanced Samples
Alejo, R., García, V., Sotoca, J. M., Mollineda, R. A., & Sánchez, J. S. (2007) · Springer eBooks · doi:10.1007/978-3-540-73007-1_20 · Cited by 40
Crone, S. F., Lessmann, S., & Stahlbock, R. (2005) · doi:10.1145/1089827.1089835 · Cited by 40
Challenges in Computational Statistics and Data Mining
Matwin, S., & Mielniczuk, J. (2015) · Studies in computational intelligence · doi:10.1007/978-3-319-18781-5 · Cited by 38
Advances in Artificial Intelligence
Antoniou, G., Spyropoulos, C., Potamias, G., & Plexousakis, D. (2006) · Lecture notes in computer science · doi:10.1007/11752912 · Cited by 38
Verbiest, N., Ramentol, E., Cornelis, C., & Herrera, F. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34654-5_18 · Cited by 37
Rough Sets and Current Trends in Computing
(2010) · Lecture notes in computer science · doi:10.1007/978-3-642-13529-3 · Cited by 37
Parameter Estimation of One-Class SVM on Imbalance Text Classification
Zhuang, L., & Dai, H. (2006) · Lecture notes in computer science · doi:10.1007/11766247_46 · Cited by 35
Guiding Scientific Discovery with Explanations Using DEMUD
Wagstaff, K. L., Lanza, N., Thompson, D. R., Dietterich, T. G., & Gilmore, M. S. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8561 · Cited by 35
Modifying ROC Curves to Incorporate Predicted Probabilities
Ferri, C., Flach, P. A., & Hernández‐Orallo, J. (2005) · Cited by 34
A PSO-Based Cost-Sensitive Neural Network for Imbalanced Data Classification
Cao, P., Zhao, D., & Zai͏̈ane, O. R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40319-4_39 · Cited by 34
Learning when training data are costly
WeissGary, M., & ProvostFoster (2003) · doi:10.5555/1622434.1622445 · Cited by 34
Wrapper-based computation and evaluation of sampling methods for imbalanced datasets
Chawla, N. V., Hall, L., & Joshi, A. (2005) · doi:10.1145/1089827.1089830 · Cited by 33
Regression error characteristic surfaces
Torgo, L. (2005) · doi:10.1145/1081870.1081959 · Cited by 32
Self-citationAn Improved Model Selection Heuristic for AUC
Wu, S., Flach, P. A., & Ferri, C. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_44 · Cited by 32
Vasu, M., & Ravi, V. (2011) · International Journal of Data Mining Modelling and Management · doi:10.1504/ijdmmm.2011.038812 · Cited by 31
An Improved AdaBoost Algorithm for Unbalanced Classification Data
Song, J., Lu, X., & Wu, X. (2009) · International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2009.608 · Cited by 31
Active Learning for One-Class Classification
Barnabé-Lortie, V., Bellinger, C., & Japkowicz, N. (2015) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2015.167 · Cited by 31
Regularization in skewed binary classification
Lee, S. S. (1999) · Computational Statistics · doi:10.1007/s001800050018 · Cited by 29
Weiss, G. M. (2009) · Springer eBooks · doi:10.1007/978-0-387-09823-4_38 · Cited by 28
A new evaluation measure for learning from imbalanced data
Thai-Nghe, N., Gantner, Z., & Schmidt-Thieme, L. (2011) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2011.6033267 · Cited by 28
Synthetic Oversampling for Advanced Radioactive Threat Detection
Bellinger, C., Japkowicz, N., & Drummond, C. (2015) · IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2015.58 · Cited by 28
Exploring of clustering algorithm on class-imbalanced data
Xuan, L., Zhigang, C., & Yang, F. (2013) · International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse.2013.6553890 · Cited by 27
Active Learning from Positive and Unlabeled Data
Ghasemi, A., Rabiee, H. R., Fadaee, M., Manzuri, M. T., & Rohban, M. H. (2011) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2011.20 · Cited by 26
Probabilistic Reframing for Cost-Sensitive Regression
Hernández‐Orallo, J. (2014) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/2641758 · Cited by 26
An Experimental Design to Evaluate Class Imbalance Treatment Methods
Batista, G., Silva, D. F., & Prati, R. C. (2012) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2012.162 · Cited by 26
A New approach for Classification of Highly Imbalanced Datasets using Evolutionary Algorithms
Maheshwari, S., Agrawal, J., & Sharma, S. (2011) · Cited by 24
Cost-Sensitive Boosting Algorithms for Imbalanced Multi-instance Datasets
Wang, X., Matwin, S., Japkowicz, N., & Liu, X. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38457-8_15 · Cited by 23
An Active Under-Sampling Approach for Imbalanced Data Classification
Yang, Z., & Gao, D. (2012) · International Symposium on Computational Intelligence and Design · doi:10.1109/iscid.2012.219 · Cited by 23
Assessments Metrics for Multi-class Imbalance Learning: A Preliminary Study
Alejo, R., Antonio, J. A., Rosas, R. M. V., & Pacheco-Sánchez, J. H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38989-4_34 · Cited by 22
A Hybrid Re-sampling Method for SVM Learning from Imbalanced Data Sets
Li, P., Qiao, P., & Liu, Y. (2008) · International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2008.407 · Cited by 22
Safe level graph for synthetic minority over-sampling techniques
Bunkhumpornpat, C., & Subpaiboonkit, S. (2013) · International Symposium on Communications and Information Technologies · doi:10.1109/iscit.2013.6645923 · Cited by 21
A Proposal of Evolutionary Prototype Selection for Class Imbalance Problems
García, S., Cano, J.-R., Fernández, A., & Herrera, F. (2006) · Lecture notes in computer science · doi:10.1007/11875581_168 · Cited by 20
Resampling and Cost-Sensitive Methods for Imbalanced Multi-instance Learning
Wang, X., Liu, X., Japkowicz, N., & Matwin, S. (2013) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2013.85 · Cited by 18
Progress in Artificial Intelligence
Silva, S., Fayolle, P., Vincent, J., Pauron, G., Rosenberger, C., & Toinard, C. (2005) · Lecture notes in computer science · doi:10.1007/11595014 · Cited by 17
Sánchez-Crisostomo, J. P., Alejo, R., López-González, E., Rosas, R. M. V., & Pacheco-Sánchez, J. H. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11897-0_3 · Cited by 15
Evolutionary Ordinal Extreme Learning Machine
Sánchez‐Monedero, J., Gutiérrez, P. A., & Hervás‐Martínez, C. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40846-5_50 · Cited by 14
Sharma, S., Bellinger, C., & Japkowicz, N. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-30353-1_16 · Cited by 14
SMOUTE:Synthetics Minority Over-sampling and Under-sampling TEchniques for class imbalanced problem
Songwattanasiri, P., & Sinapiromsaran, K. (2010) · doi:10.5176/978-981-08-7466-7_kd-21 · Cited by 13
A New Performance Evaluation Method for Two-Class Imbalanced Problems
García, V., Mollineda, R. A., & Sánchez, J. S. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89689-0_95 · Cited by 12
A novel framework for class imbalance learning using intelligent under-sampling
Naganjaneyulu, S., & Kuppa, M. R. (2012) · Progress in Artificial Intelligence · doi:10.1007/s13748-012-0038-2 · Cited by 11
Cost-Sensitive Support Vector Machine Based on Weighted Attribute
Yuanhong, D., Hongchang, C., & Peng, T. (2009) · International Forum on Information Technology and Applications · doi:10.1109/ifita.2009.125 · Cited by 11
New Frontiers in Mining Complex Patterns
Appice, A., Ceci, M., Loglisci, C. A. A. M. D., Manco, G., Masciari, E., & Raś, Z. W. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37382-4 · Cited by 11
Alejo, R., Sotoca, J. M., García, V., & Rosas, R. M. V. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21501-8_25 · Cited by 10
Soft (Gaussian CDE) regression models and loss functionsPreprint
Hernández‐Orallo, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1211.1043 · Cited by 10
A new feature weighting method based on probability distribution in imbalanced text classification
Chu, L., Gao, H., & Chang, W. (2010) · International Conference on Fuzzy Systems and Knowledge Discovery (FSKD) · doi:10.1109/fskd.2010.5569830 · Cited by 9
Active one-class learning by kernel density estimation
Ghasemi, A., Manzuri, M. T., Rabiee, H. R., Rohban, M. H., & Haghiri, S. (2011) · Machine learning for signal processing ... · doi:10.1109/mlsp.2011.6064627 · Cited by 9
Active learning for imbalance problem using L-GEM of RBFNN
Hu, J. (2012) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2012.6358972 · Cited by 8
Martínez-García, J. M., Suárez-Araujo, C. P., & Báez, P. G. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-34478-7_71 · Cited by 7
Predicting Harmful Algae Blooms
Ribeiro, R. P., & Torgo, L. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-24580-3_36 · Cited by 7
Self-citationMulti-class Boosting for Imbalanced Data
Fernández-Baldera, A., Buenaposada, J. M., & Baumela, L. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19390-8_7 · Cited by 7
An improved P-SVM method used to deal with imbalanced data sets
Chen, L., Chen, J., & Gao, X. (2009) · doi:10.1109/icicisys.2009.5357925 · Cited by 6
Intelligent Rule Mining Algorithm for Classification over Imbalanced Data
Mangat, V., & Vig, R. (2014) · Journal of Emerging Technologies in Web Intelligence · doi:10.4304/jetwi.6.3.373-379 · Cited by 3
Disturbing Neighbors Ensembles of Trees for Imbalanced Data
Rodríguez, J. J., Díez-Pastor, J.-F., Maudes, J., & García‐Osorio, C. (2012) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2012.181 · Cited by 3
An Improved SVM-KM Model for Imbalanced Datasets
Weiguo, D., Li, W., Yiyang, W., & Zhong, Q. (2012) · International Conference on Industrial Control and Electronics Engineering · doi:10.1109/icicee.2012.35 · Cited by 3
Research works printed but not linked: 52
- Akbani Rehan, 2004, Machine Learning: ECML
- Alejo Roberto, 2013, Rosa Maria Valdovinos, and J. Horacio Pacheco-Sánchez
- Alejo Roberto, 2007, Ramón Alberto Mollineda, and José Salvador Sánchez.
- Eleuterio Roberto Alejo, 2011, Vicente García Jiménez, and Rosa María Valdovinos Rosas.
- Attenberg Josh, Imbalanced Learning: Foundations
- Bi Jinbo, Proc. of the 20th Int. Conf. on Machine Learning. 43--50
- Branco Paula, Re-sampling Approaches for Regression Tasks under Imbalanced Domains. Master's thesis. Dept. Computer Science
- Breiman Leo, 1984, Stone
- Chawla Nitesh V., 2003, Bowyer
- Chen Chao, 2004, Using random forest to learn imbalanced data
- Chyi Yu-Meei, 2003, Department of Information Management
- Cieslak David A., 2008, Chawla
- Doucette John, 2008, Heywood
- Drummond Chris, Workshop on Learning from Imbalanced Datasets II, 11
- Elkan Charles, 2001, IJCAI'01: Proc. of 17th Int. Joint Conf. of Artificial Intelligence, 1
- Ferri César, 2005, Proceedings of the Second Workshop on ROC Analysis in Machine Learning. 33--40
- Ferri César, Proceedings of the 28th International Conference on Machine Learning (ICML-11)
- Forman George, 2004, Knowledge Discovery in Databases: PKDD
- He Haibo, 2008, IEEE International Joint Conference on Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence). IEEE, 1322--1328
- Holte Robert C., IJCAI, 89
- 10.5555/1681514.1682710 · doi:10.5555/1681514.1682710
- Japkowicz Nathalie, 2000, AAAI Workshop on Learning from Imbalanced Data Sets, 68
- Japkowicz Nathalie, 2003, Workshop on Learning from Imbalanced Data Sets II, 1723
- Japkowicz Natalie, Imbalanced Learning: Foundations
- Jeatrakul Piyasak, 2010, Kok Wai Wong, and Chun Che Fung
- Joshi Mahesh V., Proceedings IEEE International Conference on Data Mining, 2001. ICDM 2001. IEEE, 257--264
- Kubat Miroslav, 1997, Proc. of the 14th Int. Conf. on Machine Learning. Morgan Kaufmann, 179--186
- Liu Alexander, 2007, Martin
- Liu Wei, 2010, Chawla
- Maloof Marcus A., 2003, ICML-2003 Workshop on Learning from Imbalanced Data Sets II, 2
- Mani Inderjeet, 2003, Proceedings of Workshop on Learning from Imbalanced Datasets.
- 10.5555/1314498.1314514 · doi:10.5555/1314498.1314514
- Pearson Ronald, 2003, Proceedings of the ICML, 3
- Provost Foster J, 1998, ICML'98: Proc. of the 15th Int. Conf. on Machine Learning. Morgan Kaufmann Publishers, 445--453
- Raeder Troy, 2012, Chawla
- Rita, 2003, Ribeiro and Luís Torgo
- Rijsbergen Cornelis V., 1979, Information Retrieval. Dept. of Computer Science
- Sánchez-Crisostomo Juan Pablo, 2014, Rosa María Valdovinos, and J. Horacio Pacheco-Sánchez
- Sánchez-Monedero Javier, 2013, Pedro Antonio Gutiérrez, and Cesar Hervás-Martínez
- Songwattanasiri Panote, 2010, Proceedings of the Annual International Conference on Computer Science Education: Innovation and Technology
- Torgo Luís, 2003, Ribeiro
- Torgo Luís, 2007, Ribeiro
- Wagstaff Kiri L., 2013, Gilmore
- Wallace Byron C., 2011 IEEE 11th International Conference on Data Mining (ICDM). IEEE, 754--763
- Wang Heng, 2015, Concept drift detection for imbalanced stream data. arXiv Preprint arXiv:1504.01044 · arXiv
- Wang Xiaoguang, Advances in Artificial Intelligence
- Weiss Gary M., Data Mining
- Weiss Gary M., Imbalanced Learning: Foundations
- Cheng, Proceedings of the 7th Australasian Data Mining Conference-Volume 87
- Wu Gang, ICML 2003 Workshop on Learning from Imbalanced Data Sets II
- 10.5555/951949.952181 · doi:10.5555/951949.952181
- Zhang Dongmei, 2011, A novel improved SMOTE resampling algorithm based on fractal, J. Comput. Inform. Syst., 7, 2204
Cited by
Chicco, D., & Jurman, G. (2020) · BMC Genomics · doi:10.1186/s12864-019-6413-7 · Cited by 6,143
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Ensemble learning for data stream analysis: A survey
Krawczyk, B., Minku, L. L., Gama, J., Stefanowski, J., & Woźniak, M. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.004 · Cited by 1,050
Multiple instance learning: A survey of problem characteristics and applications
Carbonneau, M.-A., Cheplygina, V., Granger, E., & Gagnon, G. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.009 · Cited by 740
“There exist many methods to deal with imbalanced data [155].”
MethodTruong, N. D., Nguyen, A. D., Kuhlmann, L., Bonyadi, M. R., Yang, J., Ippolito, S., & Kavehei, O. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.04.018 · Cited by 635
Metadata
- Authors
- Branco, P., Torgo, L., & Ribeiro, R. P.
- Affiliations
- Universidade do Porto (PT)
- LIAAD-INESC TEC, DCC-Faculty of Sciences, University of Porto, Porto, Portugal
- Venue
- ACM Computing Surveys
- Published
- 2016-08-13
- Volume
- 49
- Issue
- 2
- Pages
- 1-50
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2490420619
- Semantic Scholar
- 736018160f8e6f6bd9b2a9101cd13ee67e573097
- Cited by
- 1,129
- References
- 266
- Citations by year
- 2026: 101 · 2025: 113 · 2024: 167 · 2023: 167 · 2022: 176 · 2021: 137 · 2020: 96 · 2019: 72 · 2018: 60 · 2017: 37 · 2016: 3
- FWCI
- 47.12
- Type
- journal article
- Language
- en
- Open access
- Locations
- ACM Computing Surveys (publishedVersion)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- North Portugal Regional Operational Programme (Project NORTE-07-0124-FEDER-000059)
- European Regional Development Fund (POCI-01-0145-FEDER-006961)
- Fundação para a Ciência e a Tecnologia (PD/BD/105788/2014, SFRH/BSAB/113896/2015)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Social Sciences › Business, Management and Accounting › Marketing › Customer churn and segmentation
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- class imbalance, predictive modeling, rare event prediction, cost-sensitive learning, classification, regression analysis, fraud detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.