Timezone: »
Federated learning (FL) has gain growing interests for its capability of learning from distributed data sources collectively without the need of accessing the raw data samples across different sources. So far FL research has mostly focused on improving the performance, how the algorithmic disparity will be impacted for the model learned from FL and the impact of algorithmic disparity on the utility inconsistency are largely unexplored. In this paper, we propose an FL framework to jointly consider performance consistency and algorithmic fairness across different local clients (data sources). We derive our framework from a constrained multi-objective optimization perspective, in which we learn a model satisfying fairness constraints on all clients with consistent performance. Specifically, we treat the algorithm prediction loss at each local client as an objective and maximize the worst-performing client with fairness constraints through optimizing a surrogate maximum function with all objectives involved. A gradient-based procedure is employed to achieve the Pareto optimality of this optimization problem. Theoretical analysis is provided to prove that our method can converge to a Pareto solution that achieves the min-max performance with fairness constraints on all clients. Comprehensive experiments on synthetic and real-world datasets demonstrate the superiority that our approach over baselines and its effectiveness in achieving both fairness and consistency across all local clients.
Author Information
Sen Cui (Tsinghua University)
Weishen Pan (Tsinghua University, Tsinghua University)
Jian Liang (Alibaba Group)
Jian Liang received his Ph.D. degree from Tsinghua University, Beijing, China, in 2018. During 2018 and 2020 he was a senior researcher in the Wireless Security Products Department of the Cloud and Smart Industries Group at Tencent, Beijing. In 2020 he joined the AI for international Department, New Retail Intelligence Engine, Alibaba Group as a senior algorithm engineer. His paper received the Best Short Paper Award in 2016 IEEE International Conference on Healthcare Informatics (ICHI).
Changshui Zhang (Tsinghua University)
Fei Wang (Cornell University)
More from the Same Authors
-
2022 Spotlight: Lightning Talks 3B-3 »
Sitao Luan · Zhiyuan You · Ruofan Liu · Linhao Qu · Yuwei Fu · Jiaxi Wang · Chunyu Wei · Jian Liang · xiaoyuan luo · Di Wu · Yun Lin · Lei Cui · Ji Wu · Chenqing Hua · Yujun Shen · Qincheng Lu · XIANGLIN YANG · Benoit Boulet · Manning Wang · Di Liu · Lei Huang · Fei Wang · Kai Yang · Jiaqi Zhu · Jin Song Dong · Zhijian Song · Xin Lu · Mingde Zhao · Shuyuan Zhang · Yu Zheng · Xiao-Wen Chang · Xinyi Le · Doina Precup -
2022 Spotlight: Contrastive Graph Structure Learning via Information Bottleneck for Recommendation »
Chunyu Wei · Jian Liang · Di Liu · Fei Wang -
2022 Poster: Contrastive Graph Structure Learning via Information Bottleneck for Recommendation »
Chunyu Wei · Jian Liang · Di Liu · Fei Wang -
2022 Poster: Synergy-of-Experts: Collaborate to Improve Adversarial Robustness »
Sen Cui · Jingfeng ZHANG · Jian Liang · Bo Han · Masashi Sugiyama · Changshui Zhang -
2021 Poster: Pareto Domain Adaptation »
fangrui lv · Jian Liang · Kaixiong Gong · Shuang Li · Chi Harold Liu · Han Li · Di Liu · Guoren Wang -
2021 Poster: ReSSL: Relational Self-Supervised Learning with Weak Augmentation »
Mingkai Zheng · Shan You · Fei Wang · Chen Qian · Changshui Zhang · Xiaogang Wang · Chang Xu -
2020 Poster: Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space »
Shangchen Du · Shan You · Xiaojie Li · Jianlong Wu · Fei Wang · Chen Qian · Changshui Zhang -
2020 Poster: When Counterpoint Meets Chinese Folk Melodies »
Nan Jiang · Sheng Jin · Zhiyao Duan · Changshui Zhang -
2019 Poster: Subspace Attack: Exploiting Promising Subspaces for Query-Efficient Black-box Attacks »
Yiwen Guo · Ziang Yan · Changshui Zhang -
2018 Poster: Sparse DNNs with Improved Adversarial Robustness »
Yiwen Guo · Chao Zhang · Changshui Zhang · Yurong Chen -
2018 Poster: Boosted Sparse and Low-Rank Tensor Regression »
Jun Yu · Kun Chen · Wanwan Xu · Jiayu Zhou · Fei Wang -
2018 Poster: Connectionist Temporal Classification with Maximum Entropy Regularization »
Hu Liu · Sheng Jin · Changshui Zhang -
2018 Spotlight: Connectionist Temporal Classification with Maximum Entropy Regularization »
Hu Liu · Sheng Jin · Changshui Zhang -
2018 Poster: Deep Defense: Training DNNs with Improved Adversarial Robustness »
Ziang Yan · Yiwen Guo · Changshui Zhang -
2012 Poster: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2012 Spotlight: Multi-Stage Multi-Task Feature Learning »
Pinghua Gong · Jieping Ye · Changshui Zhang -
2010 Poster: Learning Kernels with Radiuses of Minimum Enclosing Balls »
Kun Gai · Guangyun Chen · Changshui Zhang