CoChat
Sign Up
PreprintCited by 243Imbalanced Data Classification TechniquesMachine Learning and Data ClassificationAdvanced Neural Network Applications

Delving into deep imbalanced regression

Open access
Yang, Yuzhe, Zha, Kaiwen, Chen, Ying-Cong, Wang, Hao, Katabi, Dina·2021·arXiv
DOI 10.48550/arxiv.2102.09554arXiv 2102.09554
Open this paper in CoChat — free accountOpen PDF

Abstract

Real-world data often exhibit imbalanced distributions, where certain target values have significantly fewer observations. Existing techniques for dealing with imbalanced data focus on targets with categorical indices, i.e., different classes. However, many tasks involve continuous targets, where hard boundaries between classes do not exist. We define Deep Imbalanced Regression (DIR) as learning from such imbalanced data with continuous targets, dealing with potential missing data for certain target values, and generalizing to the entire target range. Motivated by the intrinsic difference between categorical and continuous label space, we propose distribution smoothing for both labels and features, which explicitly acknowledges the effects of nearby targets, and calibrates both label and learned feature distributions. We curate and benchmark large-scale DIR datasets from common real-world tasks in computer vision, natural language processing, and healthcare domains. Extensive experiments verify the superior performance of our strategies. Our work fills the gap in benchmarks and techniques for practical imbalanced regression problems. Code and data are available at https://github.com/YyzHarry/imbalanced-regression.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2102.09554

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Focal loss outperformed mse for the deep-learning models.

    “and “focal loss” outperformed “mse”.”

    From Machine learning-based prediction models to guide the selection of Cas9 variants for efficient gene editing (2024) · cites this paper as [64]

    The STS-B-DIR results (D.3, p. 17) show FOCAL-R outperforming the vanilla model on overall MSE (345.44 versus 369.18), and E.2 (p. 18) says MSE was the training loss used for that dataset. But FOCAL-R did not outperform vanilla on every reported measure or subgroup, so the unqualified claim is broader than the results support. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 5

  1. Branco, P., Torgo, L., and Ribeiro, R. P. Smogn: a preprocessing approach for imbalanced regression. In First international workshop on learning with imbalanced domains: Theory and applications , pp. 36-50. PMLR, 2017.
  2. Cao, K., Wei, C., Gaidon, A., Arechiga, N., and Ma, T. Learning imbalanced datasets with label-distributionaware margin loss. In NeurIPS , 2019.
  3. Cui, Y., Jia, M., Lin, T.-Y ., Song, Y ., and Belongie, S. Classbalanced loss based on effective number of samples. In CVPR , 2019.
  4. Loper, E. and Bird, S. Nltk: The natural language toolkit. arXiv preprint cs/0205028 , 2002. · arXiv
  5. Yin, X., Yu, X., Sohn, K., Liu, X., and Chandraker, M. Feature transfer learning for face recognition with underrepresented data. In In Proceeding of IEEE Computer Vision and Pattern Recognition , Long Beach, CA, June 2019.

Cited by

Sorted by citations

Related

Authors
Yang, Y., Zha, K., Chen, Y.-C., Wang, H., & Katabi, D.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2102.09554
arXiv
2102.09554
OpenAlex
W3132250316
Cited by
229
References
38
Citations by year
2026: 4 · 2025: 52 · 2024: 81 · 2023: 56 · 2022: 34 · 2021: 2
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
Keywords
imbalanced regression, benchmark dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review