Timezone: »
In this paper we consider the problem of minimizing a submodular function from training data. Submodular functions can be efficiently minimized and are conse- quently heavily applied in machine learning. There are many cases, however, in which we do not know the function we aim to optimize, but rather have access to training data that is used to learn the function. In this paper we consider the question of whether submodular functions can be minimized in such cases. We show that even learnable submodular functions cannot be minimized within any non-trivial approximation when given access to polynomially-many samples. Specifically, we show that there is a class of submodular functions with range in [0, 1] such that, despite being PAC-learnable and minimizable in polynomial-time, no algorithm can obtain an approximation strictly better than 1/2 − o(1) using polynomially-many samples drawn from any distribution. Furthermore, we show that this bound is tight using a trivial algorithm that obtains an approximation of 1/2.
Author Information
Eric Balkanski (Harvard University)
Yaron Singer (Harvard University)
More from the Same Authors
-
2020 Poster: The Adaptive Complexity of Maximizing a Gross Substitutes Valuation »
Ron Kupfer · Sharon Qian · Eric Balkanski · Yaron Singer -
2020 Poster: An Optimal Elimination Algorithm for Learning a Best Arm »
Avinatan Hassidim · Ron Kupfer · Yaron Singer -
2020 Spotlight: An Optimal Elimination Algorithm for Learning a Best Arm »
Avinatan Hassidim · Ron Kupfer · Yaron Singer -
2020 Spotlight: The Adaptive Complexity of Maximizing a Gross Substitutes Valuation »
Ron Kupfer · Sharon Qian · Eric Balkanski · Yaron Singer -
2020 Poster: Investigating Gender Bias in Language Models Using Causal Mediation Analysis »
Jesse Vig · Sebastian Gehrmann · Yonatan Belinkov · Sharon Qian · Daniel Nevo · Yaron Singer · Stuart Shieber -
2020 Spotlight: Investigating Gender Bias in Language Models Using Causal Mediation Analysis »
Jesse Vig · Sebastian Gehrmann · Yonatan Belinkov · Sharon Qian · Daniel Nevo · Yaron Singer · Stuart Shieber -
2019 Poster: Secretary Ranking with Minimal Inversions »
Sepehr Assadi · Eric Balkanski · Renato Leme -
2019 Poster: Fast Parallel Algorithms for Statistical Subset Selection Problems »
Sharon Qian · Yaron Singer -
2018 Poster: Optimization for Approximate Submodularity »
Yaron Singer · Avinatan Hassidim -
2018 Poster: Non-monotone Submodular Maximization in Exponentially Fewer Iterations »
Eric Balkanski · Adam Breuer · Yaron Singer -
2017 Workshop: Discrete Structures in Machine Learning »
Yaron Singer · Jeff A Bilmes · Andreas Krause · Stefanie Jegelka · Amin Karbasi -
2017 Poster: Robust Optimization for Non-Convex Objectives »
Robert S Chen · Brendan Lucier · Yaron Singer · Vasilis Syrgkanis -
2017 Poster: Statistical Cost Sharing »
Eric Balkanski · Umar Syed · Sergei Vassilvitskii -
2017 Oral: Robust Optimization for Non-Convex Objectives »
Robert S Chen · Brendan Lucier · Yaron Singer · Vasilis Syrgkanis -
2017 Poster: The Importance of Communities for Learning to Influence »
Eric Balkanski · Nicole Immorlica · Yaron Singer -
2016 Poster: Maximization of Approximately Submodular Functions »
Thibaut Horel · Yaron Singer -
2016 Poster: The Power of Optimization from Samples »
Eric Balkanski · Aviad Rubinstein · Yaron Singer -
2015 Poster: Learnability of Influence in Networks »
Harikrishna Narasimhan · David Parkes · Yaron Singer -
2015 Poster: Information-theoretic lower bounds for convex optimization with erroneous oracles »
Yaron Singer · Jan Vondrak -
2015 Spotlight: Information-theoretic lower bounds for convex optimization with erroneous oracles »
Yaron Singer · Jan Vondrak -
2014 Workshop: Discrete Optimization in Machine Learning »
Jeffrey A Bilmes · Andreas Krause · Stefanie Jegelka · S Thomas McCormick · Sebastian Nowozin · Yaron Singer · Dhruv Batra · Volkan Cevher