Timezone: »
As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this work, we describe a minimax framework for statistical learning with ambiguity sets given by balls in Wasserstein space. In particular, we prove generalization bounds that involve the covering number properties of the original ERM problem. As an illustrative example, we provide generalization guarantees for transport-based domain adaptation problems where the Wasserstein distance between the source and target domain distributions can be reliably estimated from unlabeled samples.
Author Information
Jaeho Lee (University of Illinois at Urbana-Champaign)
Maxim Raginsky (University of Illinois at Urbana-Champaign)
Related Events (a corresponding poster, oral, or spotlight)
-
2018 Poster: Minimax Statistical Learning with Wasserstein distances »
Wed. Dec 5th 03:45 -- 05:45 PM Room Room 210 #86
More from the Same Authors
-
2021 Poster: Information-theoretic generalization bounds for black-box learning algorithms »
Hrayr Harutyunyan · Maxim Raginsky · Greg Ver Steeg · Aram Galstyan -
2019 Poster: Universal Approximation of Input-Output Maps by Temporal Convolutional Nets »
Joshua Hanson · Maxim Raginsky -
2017 Poster: Information-theoretic analysis of generalization capability of learning algorithms »
Aolin Xu · Maxim Raginsky -
2017 Spotlight: Information-theoretic analysis of generalization capability of learning algorithms »
Aolin Xu · Maxim Raginsky -
2011 Poster: Lower Bounds for Passive and Active Learning »
Maxim Raginsky · Sasha Rakhlin -
2011 Spotlight: Lower Bounds for Passive and Active Learning »
Maxim Raginsky · Sasha Rakhlin -
2009 Poster: Locality-sensitive binary codes from shift-invariant kernels »
Maxim Raginsky · Svetlana Lazebnik -
2009 Oral: Locality-Sensitive Binary Codes from Shift-Invariant Kernels »
Maxim Raginsky · Svetlana Lazebnik -
2008 Poster: Near-minimax recursive density estimation on the binary hypercube »
Maxim Raginsky · Svetlana Lazebnik · Rebecca Willett · Jorge G Silva -
2008 Spotlight: Near-minimax recursive density estimation on the binary hypercube »
Maxim Raginsky · Svetlana Lazebnik · Rebecca Willett · Jorge G Silva