Timezone: »
Poster
Geometric Analysis of Matrix Sensing over Graphs
Haixiang Zhang · Ying Chen · Javad Lavaei
In this work, we consider the problem of matrix sensing over graphs (MSoG). As a general case of matrix completion and matrix sensing problems, the MSoG problem has not been analyzed in the literature and the existing results cannot be directly applied to the MSoG problem. This work provides the first theoretical results on the optimization landscape of the MSoG problem. More specifically, we propose a new condition, named the $\Omega$-RIP condition, to characterize the optimization complexity of the problem. In addition, with an improved regularizer of the incoherence, we prove that the strict saddle property holds for the MSoG problem with high probability under the incoherence condition and the $\Omega$-RIP condition, which guarantees the polynomial-time global convergence of saddle-avoiding methods. Compared with state-of-the-art results, the bounds in this work are tight up to a constant. Besides the theoretical guarantees, we numerically illustrate the close relation between the $\Omega$-RIP condition and the optimization complexity.
Author Information
Haixiang Zhang (University of California, Berkeley)
Ying Chen (University of California, Berkeley)
Javad Lavaei (University of California, Berkeley)
More from the Same Authors
-
2023 Poster: Algorithmic Regularization in Tensor Optimization: Towards a Lifted Approach in Matrix Sensing »
Ziye Ma · Javad Lavaei · Somayeh Sojoudi -
2023 Poster: Scalable Primal-Dual Actor-Critic Method for Safe Multi-Agent RL with General Utilities »
Donghao Ying · Yunkai Zhang · Yuhao Ding · Alec Koppel · Javad Lavaei -
2023 Poster: Tempo Adaptation in Non-stationary Reinforcement Learning »
Hyunin Lee · Yuhao Ding · Jongmin Lee · Ming Jin · Javad Lavaei · Somayeh Sojoudi -
2023 Poster: No-Regret Learning in Dynamic Competition with Reference Effects Under Logit Demand »
Mengzi Amy Guo · Donghao Ying · Javad Lavaei · Zuo-Jun Shen -
2021 Poster: Stochastic $L^\natural$-convex Function Minimization »
Haixiang Zhang · Zeyu Zheng · Javad Lavaei -
2021 Poster: General Low-rank Matrix Optimization: Geometric Analysis and Sharper Bounds »
Haixiang Zhang · Yingjie Bi · Javad Lavaei -
2018 Poster: How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? »
Richard Zhang · Cedric Josz · Somayeh Sojoudi · Javad Lavaei -
2018 Spotlight: How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? »
Richard Zhang · Cedric Josz · Somayeh Sojoudi · Javad Lavaei -
2018 Poster: A theory on the absence of spurious solutions for nonconvex and nonsmooth optimization »
Cedric Josz · Yi Ouyang · Richard Zhang · Javad Lavaei · Somayeh Sojoudi