Timezone: »
Poster
A theory on the absence of spurious solutions for nonconvex and nonsmooth optimization
Cedric Josz · Yi Ouyang · Richard Zhang · Javad Lavaei · Somayeh Sojoudi
We study the set of continuous functions that admit no spurious local optima (i.e. local minima that are not global minima) which we term global functions. They satisfy various powerful properties for analyzing nonconvex and nonsmooth optimization problems. For instance, they satisfy a theorem akin to the fundamental uniform limit theorem in the analysis regarding continuous functions. Global functions are also endowed with useful properties regarding the composition of functions and change of variables. Using these new results, we show that a class of non-differentiable nonconvex optimization problems arising in tensor decomposition applications are global functions. This is the first result concerning nonconvex methods for nonsmooth objective functions. Our result provides a theoretical guarantee for the widely-used $\ell_1$ norm to avoid outliers in nonconvex optimization.
Author Information
Cedric Josz (UC Berkeley)
Yi Ouyang (Preferred Networks)
Richard Zhang (University of California, Berkeley)
Javad Lavaei (University of California, Berkeley)
Somayeh Sojoudi (University of California, Berkeley)
More from the Same Authors
-
2023 Poster: Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing »
Ziye Ma · Javad Lavaei · Somayeh Sojoudi -
2023 Poster: Asymmetric Certified Robustness via Feature-Convex Neural Networks »
Samuel Pfrommer · Brendon Anderson · Julien Piet · Somayeh Sojoudi -
2023 Poster: Scalable Primal-Dual Actor-Critic Method for Safe Multi-Agent RL with General Utilities »
Donghao Ying · Yunkai Zhang · Yuhao Ding · Alec Koppel · Javad Lavaei -
2023 Poster: Geometric Analysis of Matrix Sensing over Graphs »
Haixiang Zhang · Ying Chen · Javad Lavaei -
2023 Poster: Adapt to Adapt: A Tempo-control Framework for Non-stationary Reinforcement Learning »
Hyunin Lee · Yuhao Ding · Jongmin Lee · Ming Jin · Javad Lavaei · Somayeh Sojoudi -
2023 Poster: No-Regret Learning in Dynamic Competition with Reference Effects Under Logit Demand »
Mengzi Amy Guo · Donghao Ying · Javad Lavaei · Zuo-Jun Shen -
2021 Poster: Stochastic $L^\natural$-convex Function Minimization »
Haixiang Zhang · Zeyu Zheng · Javad Lavaei -
2021 Poster: General Low-rank Matrix Optimization: Geometric Analysis and Sharper Bounds »
Haixiang Zhang · Yingjie Bi · Javad Lavaei -
2020 Poster: Implicit Graph Neural Networks »
Fangda Gu · Heng Chang · Wenwu Zhu · Somayeh Sojoudi · Laurent El Ghaoui -
2018 Poster: How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? »
Richard Zhang · Cedric Josz · Somayeh Sojoudi · Javad Lavaei -
2018 Spotlight: How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? »
Richard Zhang · Cedric Josz · Somayeh Sojoudi · Javad Lavaei