Timezone: »

Domain Adaptation with Multiple Sources
Yishay Mansour · Mehryar Mohri · Afshin Rostamizadeh

Wed Dec 10 03:27 PM -- 03:28 PM (PST) @

This paper presents a theoretical analysis of the problem of adaptation with multiple sources. For each source domain, the distribution over the input points as well as a hypothesis with error at most \epsilon are given. The problem consists of combining these hypotheses to derive a hypothesis with small error with respect to the target domain. We present several theoretical results relating to this problem. In particular, we prove that standard convex combinations of the source hypotheses may in fact perform very poorly and that, instead, combinations weighted by the source distributions benefit from favorable theoretical guarantees. Our main result shows that, remarkably, for any fixed target function, there exists a distribution weighted combining rule that has a loss of at most \epsilon with respect to any target mixture of the source distributions. We further generalize the setting from a single target function to multiple consistent target functions and show the existence of a combining rule with error at most 3\epsilon. Finally, we report empirical results for a multiple source adaptation problem with a real-world dataset.

Author Information

Yishay Mansour (Tel-Aviv University)
Mehryar Mohri (Google Research & Courant Institute of Mathematical Sciences)
Afshin Rostamizadeh (Google Research)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors