CoChat
Sign Up
PreprintCited by 505Domain Adaptation and Few-Shot LearningMachine Learning and AlgorithmsStochastic Gradient Optimization Techniques

The DOI matches its DataCite record; 31 of the 32 references it cites were found in a registry or an index.

Domain Adaptation: Learning Bounds and Algorithms

Open access
Mansour, Yishay, Mohri, Mehryar, Rostamizadeh, Afshin·2009·arXiv
DOI 10.48550/arxiv.0902.3430arXiv 0902.3430
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper addresses the general problem of domain adaptation which arises in a variety of applications where the distribution of the labeled sample available somewhat differs from that of the test data. Building on previous work by Ben-David et al. (2007), we introduce a novel distance between distributions, discrepancy distance, that is tailored to adaptation problems with arbitrary loss functions. We give Rademacher complexity bounds for estimating the discrepancy distance from finite samples for different loss functions. Using this distance, we derive novel generalization bounds for domain adaptation for a wide family of loss functions. We also present a series of novel adaptation bounds for large classes of regularization-based algorithms, including support vector machines and kernel ridge regression based on the empirical discrepancy. This motivates our analysis of the problem of minimizing the empirical discrepancy for various loss functions for which we also give novel algorithms. We report the results of preliminary experiments that demonstrate the benefits of our discrepancy minimization algorithms for domain adaptation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.0902.3430

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

1 of the 32 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. Bousquet, O., & Elisseeff, A. (2002). Stability and generalization. JMLR , 2 , 499-526.
  2. Devroye, L., Gy¨ orfi, L., & Lugosi, G. (1996). Aprobabilistic theory of pattern recognition . Springer.

Cited by

Sorted by citations

See all 505

Related

See all

Metadata

Authors
Mansour, Y., Mohri, M., & Rostamizadeh, A.
Affiliations
  • Tel Aviv University (IL)
  • New York University (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2009
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.0902.3430
arXiv
0902.3430
OpenAlex
W1617650991
Cited by
504
References
32
Citations by year
2025: 14 · 2024: 36 · 2023: 39 · 2022: 36 · 2021: 61 · 2020: 99 · 2019: 57 · 2018: 24 · 2017: 21 · 2016: 18 · 2015: 23 · 2014: 16 · 2013: 20 · 2012: 12
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
  • Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Keywords
domain adaptation, Rademacher complexity, generalization bounds, discrepancy minimization, support vector machine, kernel ridge regression, loss functions, distribution shift

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review