Timezone: »
Selecting the optimal subset from a large set of variables is a fundamental problem in various learning tasks such as feature selection, sparse regression, dictionary learning, etc. In this paper, we propose the POSS approach which employs evolutionary Pareto optimization to find a small-sized subset with good performance. We prove that for sparse regression, POSS is able to achieve the best-so-far theoretically guaranteed approximation performance efficiently. Particularly, for the \emph{Exponential Decay} subclass, POSS is proven to achieve an optimal solution. Empirical study verifies the theoretical results, and exhibits the superior performance of POSS to greedy and convex relaxation methods.
Author Information
Chao Qian (Nanjing University)
Yang Yu (Nanjing University)
Zhi-Hua Zhou (Nanjing University)
More from the Same Authors
-
2023 Poster: Complex-valued Neurons Can Learn More but Slower than Real-valued Neurons via Gradient Descent »
Jin-Hui Wu · Shao-Qun Zhang · Yuan Jiang · Zhi-Hua Zhou -
2023 Poster: On the Gini-impurity Preservation For Privacy Random Forests »
XinRan Xie · Man-Jie Yuan · Xuetong Bai · Wei Gao · Zhi-Hua Zhou -
2023 Poster: Rehearsal Learning for Avoiding Undesired Future »
Tian Qin · Tian-Zuo Wang · Zhi-Hua Zhou -
2023 Poster: Stochastic Approximation Approaches to Group Distributionally Robust Optimization »
Lijun Zhang · Peng Zhao · Tianbao Yang · Zhi-Hua Zhou -
2023 Poster: Universal Online Learning with Gradual Variations: A Multi-layer Online Ensemble Approach »
Yuhu Yan · Peng Zhao · Zhi-Hua Zhou -
2023 Poster: Dynamic Regret of Adversarial Linear Mixture MDPs »
Long-Fei Li · Peng Zhao · Zhi-Hua Zhou -
2022 Spotlight: Real-Valued Backpropagation is Unsuitable for Complex-Valued Neural Networks »
Zhi-Hao Tan · Yi Xie · Yuan Jiang · Zhi-Hua Zhou -
2022 Spotlight: Lightning Talks 3A-2 »
shuwen yang · Xu Zhang · Delvin Ce Zhang · Lan-Zhe Guo · Renzhe Xu · Zhuoer Xu · Yao-Xiang Ding · Weihan Li · Xingxuan Zhang · Xi-Zhu Wu · Zhenyuan Yuan · Hady Lauw · Yu Qi · Yi-Ge Zhang · Zhihao Yang · Guanghui Zhu · Dong Li · Changhua Meng · Kun Zhou · Gang Pan · Zhi-Fan Wu · Bo Li · Minghui Zhu · Zhi-Hua Zhou · Yafeng Zhang · Yingxueff Zhang · shiwen cui · Jie-Jing Shao · Zhanguang Zhang · Zhenzhe Ying · Xiaolong Chen · Yu-Feng Li · Guojie Song · Peng Cui · Weiqiang Wang · Ming GU · Jianye Hao · Yihua Huang -
2022 Spotlight: Pre-Trained Model Reusability Evaluation for Small-Data Transfer Learning »
Yao-Xiang Ding · Xi-Zhu Wu · Kun Zhou · Zhi-Hua Zhou -
2022 Poster: Adapting to Online Label Shift with Provable Guarantees »
Yong Bai · Yu-Jie Zhang · Peng Zhao · Masashi Sugiyama · Zhi-Hua Zhou -
2022 Poster: Theoretically Provable Spiking Neural Networks »
Shao-Qun Zhang · Zhi-Hua Zhou -
2022 Poster: Pre-Trained Model Reusability Evaluation for Small-Data Transfer Learning »
Yao-Xiang Ding · Xi-Zhu Wu · Kun Zhou · Zhi-Hua Zhou -
2022 Poster: Sound and Complete Causal Identification with Latent Variables Given Local Background Knowledge »
Tian-Zuo Wang · Tian Qin · Zhi-Hua Zhou -
2022 Poster: Efficient Methods for Non-stationary Online Learning »
Peng Zhao · Yan-Feng Xie · Lijun Zhang · Zhi-Hua Zhou -
2022 Poster: Real-Valued Backpropagation is Unsuitable for Complex-Valued Neural Networks »
Zhi-Hao Tan · Yi Xie · Yuan Jiang · Zhi-Hua Zhou -
2022 Poster: Depth is More Powerful than Width with Prediction Concatenation in Deep Forest »
Shen-Huan Lyu · Yi-Xiao He · Zhi-Hua Zhou -
2021 Poster: Cross-modal Domain Adaptation for Cost-Efficient Visual Reinforcement Learning »
Xiong-Hui Chen · Shengyi Jiang · Feng Xu · Zongzhang Zhang · Yang Yu -
2021 Poster: Regret Minimization Experience Replay in Off-Policy Reinforcement Learning »
Xu-Hui Liu · Zhenghai Xue · Jingcheng Pang · Shengyi Jiang · Feng Xu · Yang Yu -
2021 Poster: Adaptive Online Packing-guided Search for POMDPs »
Chenyang Wu · Guoyu Yang · Zongzhang Zhang · Yang Yu · Dong Li · Wulong Liu · Jianye Hao -
2021 Poster: Offline Model-based Adaptable Policy Learning »
Xiong-Hui Chen · Yang Yu · Qingyang Li · Fan-Ming Luo · Zhiwei Qin · Wenjie Shang · Jieping Ye -
2018 Poster: Multi-Layered Gradient Boosting Decision Trees »
Ji Feng · Yang Yu · Zhi-Hua Zhou -
2017 Poster: Improved Dynamic Regret for Non-degenerate Functions »
Lijun Zhang · Tianbao Yang · Jinfeng Yi · Rong Jin · Zhi-Hua Zhou -
2017 Poster: Learning with Feature Evolvable Streams »
Bojian Hou · Lijun Zhang · Zhi-Hua Zhou -
2017 Poster: Subset Selection under Noise »
Chao Qian · Jing-Cheng Shi · Yang Yu · Ke Tang · Zhi-Hua Zhou