Timezone: »
The group Lasso is an extension of the Lasso for feature selection on (predefined) non-overlapping groups of features. The non-overlapping group structure limits its applicability in practice. There have been several recent attempts to study a more general formulation, where groups of features are given, potentially with overlaps between the groups. The resulting optimization is, however, much more challenging to solve due to the group overlaps. In this paper, we consider the efficient optimization of the overlapping group Lasso penalized problem. We reveal several key properties of the proximal operator associated with the overlapping group Lasso, and compute the proximal operator by solving the smooth and convex dual problem, which allows the use of the gradient descent type of algorithms for the optimization. We have performed empirical evaluations using both synthetic and the breast cancer gene expression data set, which consists of 8,141 genes organized into (overlapping) gene sets. Experimental results show that the proposed algorithm is more efficient than existing state-of-the-art algorithms.
Author Information
Lei Yuan (Arizona State University)
Jun Liu (Siemens Corporate Research)
Jieping Ye (Arizona State University)
More from the Same Authors
-
2014 Poster: Two-Layer Feature Reduction for Sparse-Group Lasso via Decomposition of Convex Sets »
Jie Wang · Jieping Ye -
2014 Spotlight: Two-Layer Feature Reduction for Sparse-Group Lasso via Decomposition of Convex Sets »
Jie Wang · Jieping Ye -
2014 Poster: A Safe Screening Rule for Sparse Logistic Regression »
Jie Wang · Jiayu Zhou · Jun Liu · Peter Wonka · Jieping Ye -
2013 Poster: Lasso Screening Rules via Dual Polytope Projection »
Jie Wang · Jiayu Zhou · Peter Wonka · Jieping Ye -
2013 Spotlight: Lasso Screening Rules via Dual Polytope Projection »
Jie Wang · Jiayu Zhou · Peter Wonka · Jieping Ye -
2012 Poster: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2012 Poster: Multi-task Vector Field Learning »
Binbin Lin · Sen Yang · Chiyuan Zhang · Jieping Ye · Xiaofei He -
2012 Spotlight: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2012 Poster: Generalization Bounds for Domain Adaptation »
Chao Zhang · Jieping Ye · Lei Zhang -
2011 Poster: Clustered Multi-Task Learning Via Alternating Structure Optimization »
Jiayu Zhou · Jianhui Chen · Jieping Ye -
2011 Poster: Projection onto A Nonnegative Max-Heap »
Jun Liu · Liang Sun · Jieping Ye -
2011 Spotlight: Projection onto A Nonnegative Max-Heap »
Jun Liu · Liang Sun · Jieping Ye -
2011 Poster: A Two-Stage Weighting Framework for Multi-Source Domain Adaptation »
Qian Sun · Rita Chattopadhyay · Sethuraman Panchanathan · Jieping Ye -
2011 Poster: Identifying Alzheimer's Disease-Related Brain Regions from Multi-Modality Neuroimaging Data using Sparse Composite Linear Discrimination Analysis »
Shuai Huang · Jing Li · Jieping Ye · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman -
2011 Spotlight: Identifying Alzheimer's Disease-Related Brain Regions from Multi-Modality Neuroimaging Data using Sparse Composite Linear Discrimination Analysis »
Shuai Huang · Jing Li · Jieping Ye · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman -
2010 Poster: Moreau-Yosida Regularization for Grouped Tree Structure Learning »
Jun Liu · Jieping Ye -
2010 Poster: Multi-Stage Dantzig Selector »
Ji Liu · Peter Wonka · Jieping Ye -
2009 Poster: Learning Brain Connectivity of Alzheimer's Disease from Neuroimaging Data »
Shuai Huang · Jing Li · Liang Sun · Jun Liu · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman · Jieping Ye -
2009 Spotlight: Learning Brain Connectivity of Alzheimer's Disease from Neuroimaging Data »
Shuai Huang · Jing Li · Liang Sun · Jun Liu · Teresa Wu · Kewei Chen · Adam Fleisher · Eric Reiman · Jieping Ye -
2009 Poster: Efficient Recovery of Jointly Sparse Vectors »
Liang Sun · Jun Liu · Jianhui Chen · Jieping Ye -
2008 Poster: Multi-label Multiple Kernel Learning »
Shuiwang Ji · Liang Sun · Rong Jin · Jieping Ye -
2008 Spotlight: Multi-label Multiple Kernel Learning »
Shuiwang Ji · Liang Sun · Rong Jin · Jieping Ye -
2007 Poster: Discriminative K-means for Clustering »
Jieping Ye · Zheng Zhao · Mingrui Wu