The DOI matches its DataCite record; 38 of the 38 references it cites were found in a registry or an index.
Delving into Deep Imbalanced Regression
Open accessAbstract
Real-world data often exhibit imbalanced distributions, where certain target values have significantly fewer observations. Existing techniques for dealing with imbalanced data focus on targets with categorical indices, i.e., different classes. However, many tasks involve continuous targets, where hard boundaries between classes do not exist. We define Deep Imbalanced Regression (DIR) as learning from such imbalanced data with continuous targets, dealing with potential missing data for certain target values, and generalizing to the entire target range. Motivated by the intrinsic difference between categorical and continuous label space, we propose distribution smoothing for both labels and features, which explicitly acknowledges the effects of nearby targets, and calibrates both label and learned feature distributions. We curate and benchmark large-scale DIR datasets from common real-world tasks in computer vision, natural language processing, and healthcare domains. Extensive experiments verify the superior performance of our strategies. Our work fills the gap in benchmarks and techniques for practical imbalanced regression problems. Code and data are available at https://github.com/YyzHarry/imbalanced-regression.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“and “focal loss” outperformed “mse”.”
From Machine learning-based prediction models to guide the selection of Cas9 variants for efficient gene editing (2024) · cites this paper as [64]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(1992) · PubMed · Cited by 33,716
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,831
Indoor segmentation and support inference from rgbd images
Silberman, N., Hoiem, D., Kohli, P., & Fergus, R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33715-4_54 · Cited by 5,760
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
He, H., Bai, Y., Garcia, E. A., & Shutao Li, A. (2008) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2008.4633969 · Cited by 5,271
Research works printed but not linked: 5
- Branco, P., Torgo, L., and Ribeiro, R. P. Smogn: a preprocessing approach for imbalanced regression. In First international workshop on learning with imbalanced domains: Theory and applications , pp. 36-50. PMLR, 2017.
- Cao, K., Wei, C., Gaidon, A., Arechiga, N., and Ma, T. Learning imbalanced datasets with label-distributionaware margin loss. In NeurIPS , 2019.
- Cui, Y., Jia, M., Lin, T.-Y ., Song, Y ., and Belongie, S. Classbalanced loss based on effective number of samples. In CVPR , 2019.
- Loper, E. and Bird, S. Nltk: The natural language toolkit. arXiv preprint cs/0205028 , 2002. · arXiv
- Yin, X., Yu, X., Sohn, K., Liu, X., and Chandraker, M. Feature transfer learning for face recognition with underrepresented data. In In Proceeding of IEEE Computer Vision and Pattern Recognition , Long Beach, CA, June 2019.
Cited by
Sorted by citations
Items 201–243 of 243
Ye, L., Cao, Y. H., Kang, Y., Xu, Z., & Xia, X. (2022) · Chinese Control Conference (CCC) · doi:10.23919/ccc55666.2022.9901722
Re-weighting and Hierarchical Pre-training Boost 3D Medical Self-Supervised Representation
Chen, S., Wang, Y., Sun, K., & Sun, X. (2022) · IEEE International Conference on Cloud Computing and Intelligence Systems (CCIS) · doi:10.1109/ccis57298.2022.10016411
Toward a Balanced Feature Space for the Deep Imbalanced Regression
Lee, J. W. (2023) · IEEE Access · doi:10.1109/access.2023.3308998
Multi Domain Imbalanced RegressionPreprint
Qin, K., Huang, W., & Zhang, T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4585861
Addressing the Scale Shrinkage Problem in Learning-based Binocular Depth Estimation
Guo, G., Song, Y., & Sun, F. (2023) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros55552.2023.10341579
(2024) · Earth system science data · doi:10.5194/essd-2024-34-rc1
Hewavitharana, J., Jihan, N., Jayasinghe, M., Gunawardana, K., & Fernando, D. (2023) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00076
The Misalignment between R2 and Sharpe Ratio: An Imbalanced Data PerspectivePreprint
Wang, X., & Zhao, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4769748
Estimating the Individual Treatment Effect with Different Treatment Group Sizes
Song, L., & Zhang, X. (2024) · Mathematics · doi:10.3390/math12081224
(2024) · Earth system science data · doi:10.5194/essd-2024-34-rc2
Bai, Y. F., Lin, X., Zhong, W., Luo, Z., & Zhang, N. (2023) · IEEE Conference on Energy Internet and Energy System Integration (EI2) · doi:10.1109/ei259745.2023.10513337
Zhang, H. (2024) · Earth system science data · doi:10.5194/essd-2024-34-ac1
Zhang, H. (2024) · Earth system science data · doi:10.5194/essd-2024-34-ac2
Byler, N., Forland, B. M., & McKay, M. (2024) · Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery · doi:10.1117/12.3012800
Ruan, S.-J., & Lin, Y. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4891451
Balanced Training for the End-to-End Autonomous Driving Model Based on Kernel Density Estimation
Yao, T., Yuan, W., Zhang, S., & Wang, C. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588649
Use of Deep Neural Networks for Uncertain Stress Functions with Extensions to Impact Mechanics
Blum, G., Doris, R., Klabjan, D., Espinosa, H. D., & Szalkowski, R. (2024) · IEEE International Conference on Big Data Analytics (ICBDA) · doi:10.1109/icbda61153.2024.10607187
Dynamic Weight Distribution Method of Loss Function Based on Category Theory
Chen, J. H., & Zhao, H. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-5666-7_34
From bias to balance: Leverage representation learning for bias-free MoCap solving
Albanis, G., Zioulis, N., Thermos, S., Chatzitofis, A., & Kolomvatsos, K. (2024) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2024.104241
Optimizing balanced accuracy in medical data threshold models
Dribus, B. F., Hill, J., Goldsmith, N., & Martingano, D. (2025) · Discover Data · doi:10.1007/s44248-025-00028-4
ACCon: Angle-Compensated Contrastive Regularizer for Deep Regression
Zhao, B., Qu, X., Kang, Z., Peng, J., Xiao, J., & Wang, J. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i21.34435
Imbalanced Learning: Semi-Supervised Graph Imbalanced Regression
Liu, G., Inae, E., & Jiang, M. (2025) · Synthesis lectures on data mining and knowledge discovery · doi:10.1007/978-3-031-84732-5_5
A Study on Correlation Between WAT and CP Yields Based on Deep Learning Methods
Mu, J., Shao, Y., Shi, G., & Shi, Z. (2025) · China Semiconductor Technology International Conference (CSTIC) · doi:10.1109/cstic64481.2025.11018052
Huang, Z., Tian, P., Zhu, H., Guo, P., & Li, X. (2025) · Remote Sensing · doi:10.3390/rs17121998
Zhou, Y., Zhou, R., Xia, W., Guo, Y., Huang, Z., & Gan, H. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-9794-6_41
AWSSS: Adaptive Weighted Statistical Space Smoothing for Regression with Imbalance Data
Yi, X., Wang, H., Zhu, Z., Liu, W., Xu, W., & Li, R. (2024) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc64274.2024.00050
Self-citationRobust Myoelectric during Long‐Time Use by Transfer Learning
Xu, M., & Liu, Z. (2025) · IEEJ Transactions on Electrical and Electronic Engineering · doi:10.1002/tee.70113
MiVOLO: Multi-input Transformer for Age and Gender EstimationPreprint
Kuprashevich, M., & Tolstykh, I. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5381366
Pan, M., Lin, X., Xiao, Z., Wang, F., Guo, L., Wang, C., Xie, J., & Fang, J. (2025) · International Journal of Remote Sensing · doi:10.1080/01431161.2025.2550675
Maxwell, A. E., Ramezan, C. A., & He, Y. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-29306-1.00009-0
Zhu, Q., Zeng, X., Wang, Z., Zhu, H., Liang, Y., Ahmed, A., Yang, B., & Qiu, J. (2025) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.70286
Sequence-based undersampling: an algorithm for managing imbalanced datasets
Troncoso, B. A., Mateo-Cortés, J. A., Flores, M. J., & Tapiador, F. J. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3078
Sampling balanced high-quality data to train an automatic mesh generator
Pan, J., Huang, J., Cheng, G., & Zeng, Y. (2025) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s089006042510019x
A deep learning approach for predicting sensory-motor integration in postural stability
Chae, S., Park, J. M., Choi, A., & Mun, J. H. (2026) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-026-03567-3
Per‐tree citrus count regression from single‐view images via lightweight deep learning
Qu, H., & Zhang, Z. (2026) · Agronomy Journal · doi:10.1002/agj2.70400
Pereira, S., & Vanneschi, L. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-23005-8_19
Muhammad, M., Radi, N. F. A., Noor, N. M., & Ul–Saufie, A. Z. (2026) · International Journal of Conservation Science · doi:10.36868/ijcs.2026.02.22
Predicting Enzyme pH Optima from Structure Using Equivariant Graph Neural Networks
SinhaRoy, R., Clauss, C., Ivanikov, I., & Kuenze, G. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c01482
Liu, C., Luo, J., Zhang, X., Hu, Y., Tao, K., Li, K., & Ma, H. (2026) · Macromolecules · doi:10.1021/acs.macromol.6c00853
François, J., Moor, B. D., & van Noort, V. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c02109
Metadata
- Authors
- Yang, Y., Zha, K., Chen, Y.-C., Wang, H., & Katabi, D.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2021
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2102.09554
- OpenAlex
- W3132250316
- Cited by
- 229
- References
- 38
- Citations by year
- 2026: 4 · 2025: 52 · 2024: 81 · 2023: 56 · 2022: 34 · 2021: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- imbalanced regression, benchmark dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review