Workshop
Federated Learning: Recent Advances and New Challenges
Shiqiang Wang 路 Nathalie Baracaldo 路 Olivia Choudhury 路 Gauri Joshi 路 Peter Richtarik 路 Praneeth Vepakomma 路 Han Yu
Room 298 - 299
Fri 2 Dec, 6:30 a.m. PST
Training machine learning models in a centralized fashion often faces significant challenges due to regulatory and privacy concerns in real-world use cases. These include distributed training data, computational resources to create and maintain a central data repository, and regulatory guidelines (GDPR, HIPAA) that restrict sharing sensitive data. Federated learning (FL) is a new paradigm in machine learning that can mitigate these challenges by training a global model using distributed data, without the need for data sharing. The extensive application of machine learning to analyze and draw insight from real-world, distributed, and sensitive data necessitates familiarization with and adoption of this relevant and timely topic among the scientific community.
Despite the advantages of FL, and its successful application in certain industry-based cases, this field is still in its infancy due to new challenges that are imposed by limited visibility of the training data, potential lack of trust among participants training a single model, potential privacy inferences, and in some cases, limited or unreliable connectivity.
The goal of this workshop is to bring together researchers and practitioners interested in FL. This day-long event will facilitate interaction among students, scholars, and industry professionals from around the world to understand the topic, identify technical challenges, and discuss potential solutions. This will lead to an overall advancement of FL and its impact in the community, while noting that FL has become an increasingly popular topic in the machine learning community in recent years.
Schedule
Fri 6:30 a.m. - 6:35 a.m.
|
Opening Remarks
(
Opening Remarks
)
>
|
Shiqiang Wang 馃敆 |
Fri 6:35 a.m. - 6:53 a.m.
|
Trustworthy Federated Learning
(
Invited Talk
)
>
SlidesLive Video |
Bo Li 馃敆 |
Fri 6:53 a.m. - 6:57 a.m.
|
Trustworthy Federated Learning - Q&A
(
Q&A
)
>
|
馃敆 |
Fri 6:57 a.m. - 7:15 a.m.
|
Asynchronous Optimization: Delays, Stability, and the Impact of Data Heterogeneity
(
Invited Talk
)
>
SlidesLive Video |
Konstantin Mishchenko 馃敆 |
Fri 7:15 a.m. - 7:19 a.m.
|
Asynchronous Optimization: Delays, Stability, and the Impact of Data Heterogeneity - Q&A
(
Q&A
)
>
|
馃敆 |
Fri 7:20 a.m. - 7:27 a.m.
|
Conditional Moment Alignment for Improved Generalization in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Jayanth Reddy Regatti 路 Songtao Lu 路 Abhishek Gupta 路 Ness Shroff 馃敆 |
Fri 7:30 a.m. - 7:37 a.m.
|
Mechanisms that Incentivize Data Sharing in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Sai Praneeth Karimireddy 路 Wenshuo Guo 路 Michael Jordan 馃敆 |
Fri 7:40 a.m. - 7:47 a.m.
|
Federated Learning with Online Adaptive Heterogeneous Local Models
(
Oral
)
>
link
SlidesLive Video |
Hanhan Zhou 路 Tian Lan 路 Guru Prasadh Venkataramani 路 Wenbo Ding 馃敆 |
Fri 7:50 a.m. - 7:57 a.m.
|
LightVeriFL: Lightweight and Verifiable Secure Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Baturalp Buyukates 路 Jinhyun So 路 Hessam Mahdavifar 路 Salman Avestimehr 馃敆 |
Fri 8:00 a.m. - 8:30 a.m.
|
Break
|
馃敆 |
Fri 8:30 a.m. - 8:37 a.m.
|
Efficient Federated Random Subnetwork Training
(
Oral
)
>
link
SlidesLive Video |
Francesco Pase 路 Berivan Isik 路 Deniz Gunduz 路 Tsachy Weissman 路 Michele Zorzi 馃敆 |
Fri 8:40 a.m. - 8:47 a.m.
|
Group privacy for personalized federated learning
(
Oral
)
>
link
SlidesLive Video |
Filippo Galli 路 Sayan Biswas 路 Gangsoo Zeong 路 Tommaso Cucinotta 路 Catuscia Palamidessi 馃敆 |
Fri 8:50 a.m. - 8:57 a.m.
|
To Federate or Not To Federate: Incentivizing Client Participation in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Yae Jee Cho 路 Divyansh Jhunjhunwala 路 Tian Li 路 Virginia Smith 路 Gauri Joshi 馃敆 |
Fri 9:00 a.m. - 9:07 a.m.
|
SWIFT: Rapid Decentralized Federated Learning via Wait-Free Model Communication
(
Oral
)
>
link
SlidesLive Video |
Marco Bornstein 路 Tahseen Rabbani 路 Evan Wang 路 Amrit Bedi 路 Furong Huang 馃敆 |
Fri 9:10 a.m. - 9:15 a.m.
|
Best Paper Announcement
(
Other
)
>
SlidesLive Video |
馃敆 |
Fri 9:15 a.m. - 10:00 a.m.
|
Poster Session 1
(
Poster Session
)
>
|
馃敆 |
Fri 10:00 a.m. - 11:30 a.m.
|
Lunch Break
|
馃敆 |
Fri 11:30 a.m. - 11:37 a.m.
|
FL Games: A Federated Learning Framework for Distribution Shifts
(
Oral
)
>
link
SlidesLive Video |
Sharut Gupta 路 Kartik Ahuja 路 Mohammad Havaei 路 Niladri Chatterjee 路 Yoshua Bengio 馃敆 |
Fri 11:40 a.m. - 11:47 a.m.
|
Verifiable Federated Machine Learning
(
Oral
)
>
link
SlidesLive Video |
Simone Bottoni 路 Giulio Zizzo 路 Stefano Braghin 路 Alberto Trombetta 馃敆 |
Fri 11:50 a.m. - 11:57 a.m.
|
Accelerated Federated Optimization with Quantization
(
Oral
)
>
link
SlidesLive Video |
Yeojoon Youn 路 Bhuvesh Kumar 路 Jacob Abernethy 馃敆 |
Fri 12:00 p.m. - 12:07 p.m.
|
Tackling Personalized Federated Learning with Label Concept Drift via Hierarchical Bayesian Modeling
(
Oral
)
>
link
SlidesLive Video |
Xingchen Ma 路 Junyi Zhu 路 Matthew Blaschko 馃敆 |
Fri 12:10 p.m. - 1:00 p.m.
|
Panel
(
Panel
)
>
SlidesLive Video |
馃敆 |
Fri 1:00 p.m. - 1:30 p.m.
|
Break
|
馃敆 |
Fri 1:30 p.m. - 1:48 p.m.
|
On the Unreasonable Effectiveness of Federated Averaging with Heterogenous Data
(
Invited Talk
)
>
SlidesLive Video |
Jianyu Wang 馃敆 |
Fri 1:48 p.m. - 1:52 p.m.
|
On the Unreasonable Effectiveness of Federated Averaging with Heterogenous Data - Q&A
(
Q&A
)
>
|
馃敆 |
Fri 1:52 p.m. - 2:10 p.m.
|
Scalable and Communication-Efficient Vertical Federated Learning
(
Invited Talk
)
>
SlidesLive Video |
Stacy Patterson 馃敆 |
Fri 2:10 p.m. - 2:14 p.m.
|
Scalable and Communication-Efficient Vertical Federated Learning - Q&A
(
Q&A
)
>
|
馃敆 |
Fri 2:15 p.m. - 3:00 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
馃敆 |
-
|
FedTH : Tree-based Hierarchical Image Classification in Federated Learning ( Poster ) > link | Jaeheon Kim 路 Bong Jun Choi 馃敆 |
-
|
Unbounded Gradients in Federated Leaning with Buffered Asynchronous Aggregation ( Poster ) > link | M. Taha Toghani 路 Cesar Uribe 馃敆 |
-
|
Early Detection of Sexual Predators with Federated Learning ( Poster ) > link | Khaoula Chehbouni 路 Gilles Caporossi 路 Reihaneh Rabbany 路 Martine De Cock 路 Golnoosh Farnadi 馃敆 |
-
|
Self-Supervised Vertical Federated Learning ( Poster ) > link | Timothy Castiglia 路 Shiqiang Wang 路 Stacy Patterson 馃敆 |
-
|
On the Vulnerability of Backdoor Defenses for Federated Learning ( Poster ) > link | Pei Fang 路 Jinghui Chen 馃敆 |
-
|
Towards Provably Personalized Federated Learning via Threshold-Clustering of Similar Clients ( Poster ) > link | Mariel A Werner 路 Lie He 路 Sai Praneeth Karimireddy 路 Michael Jordan 路 Martin Jaggi 馃敆 |
-
|
Building Large Machine Learning Models from Small Distributed Models: A Layer Matching Approach ( Poster ) > link | xinwei zhang 路 Bingqing Song 路 Mehrdad Honarkhah 路 Jie Ding 路 Mingyi Hong 馃敆 |
-
|
VOTING-BASED APPROACHES FOR DIFFERENTIALLY PRIVATE FEDERATED LEARNING ( Poster ) > link | Yuqing Zhu 路 Xiang Yu 路 Yi-Hsuan Tsai 路 Francesco Pittaluga 路 Masoud Faraki 路 Manmohan Chandraker 路 Yu-Xiang Wang 馃敆 |
-
|
DASH: Decentralized CASH for Federated Learning ( Poster ) > link | Md Ibrahim Ibne Alam 路 Koushik Kar 路 Theodoros Salonidis 路 Horst Samulowitz 馃敆 |
-
|
Accelerating Adaptive Federated Optimization with Local Gossip Communications ( Poster ) > link | Yujia Wang 路 Pei Fang 路 Jinghui Chen 馃敆 |
-
|
Federated Progressive Sparsification (Purge-Merge-Tune)+ ( Poster ) > link | Dimitris Stripelis 路 Umang Gupta 路 Greg Ver Steeg 路 Jose-Luis Ambite 馃敆 |
-
|
A Multi-Token Coordinate Descent Method for Vertical Federated Learning ( Poster ) > link | Pedro Valdeira 路 Yuejie Chi 路 Claudia Soares 路 Joao Xavier 馃敆 |
-
|
ColRel: Collaborative Relaying for Federated Learning over Intermittently Connected Networks ( Poster ) > link | Rajarshi Saha 路 Michal Yemini 路 Emre Ozfatura 路 Deniz Gunduz 路 Andrea Goldsmith 馃敆 |
-
|
Understanding Federated Learning through Loss Landscape Visualizations: A Pilot Study ( Poster ) > link | Ziwei Li 路 Hong-You Chen 路 Han Wei Shen 路 Wei-Lun Chao 馃敆 |
-
|
Differentially Private Federated Quantiles with the Distributed Discrete Gaussian Mechanism ( Poster ) > link | Krishna Pillutla 路 Yassine Laguel 路 J茅r么me Malick 路 Zaid Harchaoui 馃敆 |
-
|
Efficient and Light-Weight Federated Learning via Asynchronous Distributed Dropout ( Poster ) > link | Chen Dun 路 Mirian Hipolito Garcia 路 Dimitrios Dimitriadis 路 Christopher Jermaine 路 Anastasios Kyrillidis 馃敆 |
-
|
FedGRec: Federated Graph Recommender System with Lazy Update of Latent Embeddings ( Poster ) > link | Junyi Li 路 Heng Huang 馃敆 |
-
|
Privacy-Preserving Data Filtering in Federated Learning Using Influence Approximation ( Poster ) > link | Ljubomir Rokvic 路 Panayiotis Danassis 路 Boi Faltings 馃敆 |
-
|
Where to Begin? On the Impact of Pre-Training and Initialization in Federated Learning ( Poster ) > link | John Nguyen 路 Jianyu Wang 路 Kshitiz Malik 路 Maziar Sanjabi 路 Mike Rabbat 馃敆 |
-
|
Trusted Aggregation (TAG): Model Filtering Backdoor Defense In Federated Learning ( Poster ) > link | Joseph Lavond 路 Minhao Cheng 路 Yao Li 馃敆 |
-
|
Cross-device Federated Architecture Search ( Poster ) > link | Stefanos Laskaridis 路 Javier Fernandez-Marques 路 艁ukasz Dudziak 馃敆 |
-
|
Client-Private Secure Aggregation for Privacy-Preserving Federated Learning ( Poster ) > link | Parker Newton 路 Olivia Choudhury 路 Bill Horne 路 Vidya Ravipati 路 Divya Bhargavi 路 Ujjwal Ratan 馃敆 |
-
|
Motley: Benchmarking Heterogeneity and Personalization in Federated Learning ( Poster ) > link | Shanshan Wu 路 Tian Li 路 Zachary Charles 路 Yu Xiao 路 Ken Liu 路 Zheng Xu 路 Virginia Smith 馃敆 |
-
|
Federated Learning for Predicting the Next Node in Action Flows ( Poster ) > link | Daniel Lopes 路 Jo茫o Nadkarni 路 Filipe Assun莽茫o 路 Miguel Lopes 路 Lu铆s Rodrigues 馃敆 |
-
|
The Interpolated MVU Mechanism For Communication-efficient Private Federated Learning ( Poster ) > link | Chuan Guo 路 Kamalika Chaudhuri 路 Pierre STOCK 路 Mike Rabbat 馃敆 |
-
|
Find Your Friends: Personalized Federated Learning with the Right Collaborators ( Poster ) > link | Yi Sui 路 Junfeng Wen 路 Yenson Lau 路 Brendan Ross 路 Jesse Cresswell 馃敆 |
-
|
Rethinking Data Heterogeneity in Federated Learning: Introducing a New Notion and Standard Benchmarks ( Poster ) > link | Saeed Vahidian 路 Mahdi Morafah 路 Chen Chen 路 Mubarak Shah 路 Bill Lin 馃敆 |
-
|
Federated Fairness without Access to Demographics ( Poster ) > link | Afroditi Papadaki 路 Natalia Martinez 路 Martin Bertran 路 Guillermo Sapiro 路 Miguel Rodrigues 馃敆 |
-
|
FLUTE: A Scalable, Extensible Framework for High-Performance Federated Learning Simulations ( Poster ) > link | Mirian Hipolito Garcia 路 Andre Manoel 路 Daniel Madrigal 路 Robert Sim 路 Dimitrios Dimitriadis 馃敆 |
-
|
Decentralized Learning with Random Walks and Communication-Efficient Adaptive Optimization ( Poster ) > link | Aleksei Triastcyn 路 Matthias Reisser 路 Christos Louizos 馃敆 |
-
|
Accelerating Federated Learning Through Attention on Local Model Updates ( Poster ) > link | Parsa Assadi 路 Byung Hoon Ahn 路 Hadi Esmaeilzadeh 馃敆 |
-
|
Federated Frank-Wolfe Algorithm ( Poster ) > link | Ali Dadras 路 Karthik Prakhya 路 Alp Yurtsever 馃敆 |
-
|
How to Combine Variational Bayesian Networks in Federated Learning ( Poster ) > link | Atahan 脰zer 路 Kadir Burak Buldu 路 Abdullah Akg眉l 路 Gozde Unal 馃敆 |
-
|
Stochastic Gradient Methods with Compressed Communication for Decentralized Saddle Point Problems ( Poster ) > link | Chhavi Sharma 路 Vishnu Narayanan 路 Balamurugan Palaniappan 馃敆 |
-
|
Refined Convergence and Topology Learning for Decentralized Optimization with Heterogeneous Data ( Poster ) > link | Batiste Le bars 路 Aur茅lien Bellet 路 Marc Tommasi 路 Erick Lavoie 路 Anne-marie Kermarrec 馃敆 |
-
|
AIMHI: Protecting Sensitive Data through Federated Co-Training ( Poster ) > link | Amr Abourayya 路 Michael Kamp 路 Erman Ayday 路 Jens Kleesiek 路 Kanishka Rao 路 Geoffrey Webb 路 Bharat Rao 馃敆 |
-
|
A Novel Model-Based Attribute Inference Attack in Federated Learning ( Poster ) > link | ilias driouich 路 CHUAN XU 路 Giovanni Neglia 路 Frederic Giroire 路 Eoin Thomas 馃敆 |
-
|
FedSHIBU: Federated Similarity-based Head Independent Body Update ( Poster ) > link | Athul Sreemathy Raj 路 Irene Tenison 路 Kacem Khaled 路 Felipe de Magalh茫es 路 Athul Sreemathy Raj 馃敆 |
-
|
Revisiting the Activation Function for Federated Image Classification ( Poster ) > link | Jaewoo Shin 路 Taehyeon Kim 路 Se-Young Yun 馃敆 |
-
|
Adaptive Sparse Federated Learning in Large Output Spaces via Hashing ( Poster ) > link | Zhaozhuo Xu 路 Luyang Liu 路 Zheng Xu 路 Anshumali Shrivastava 馃敆 |
-
|
FLARE: Federated Learning from Simulation to Real-World ( Poster ) > link |
23 presentersHolger Roth 路 Yan Cheng 路 Yuhong Wen 路 Te-Chung (Isaac) Yang 路 Ziyue Xu 路 Yuan-Ting Hsieh 路 Kristopher Kersten 路 Ahmed Harouni 路 Can Zhao 路 Kevin Lu 路 Zhihong Zhang 路 Wenqi Li 路 Andriy Myronenko 路 Dong Yang 路 Sean Yang 路 Nicola Rieke 路 Abood Quraini 路 Chester Chen 路 Daguang Xu 路 Nic Ma 路 Prerna Dogra 路 Mona Flores 路 Andrew Feng |
-
|
PerFedSI: A Framework for Personalized Federated Learning with Side Information ( Poster ) > link | Liam Collins 路 Enmao Diao 路 Tanya Roosta 路 Jie Ding 路 Tao Zhang 馃敆 |
-
|
FedSynth: Gradient Compression via Synthetic Data in Federated Learning ( Poster ) > link | Shengyuan Hu 路 Jack Goetz 路 Kshitiz Malik 路 Hongyuan Zhan 路 Zhe Liu 路 Yue Liu 馃敆 |
-
|
Personalized Multi-tier Federated Learning ( Poster ) > link | Sourasekhar Banerjee 路 Alp Yurtsever 路 Monowar Bhuyan 馃敆 |
-
|
FLIS: Clustered Federated Learning via Inference Similarity for Non-IID Data Distribution ( Poster ) > link | Saeed Vahidian 路 Mahdi Morafah 路 Weijia Wang 路 Bill Lin 馃敆 |
-
|
Private and Robust Federated Learning using Private Information Retrieval and Norm Bounding ( Poster ) > link | Hamid Mozaffari 路 Virendra Marathe 路 Dave Dice 馃敆 |
-
|
Reconciling Security and Communication Efficiency in Federated Learning ( Poster ) > link | Karthik Prasad 路 Sayan Ghosh 路 Graham Cormode 路 Ilya Mironov 路 Ashkan Yousefpour 路 Pierre STOCK 馃敆 |
-
|
FedToken: Tokenized Incentives for Data Contribution in Federated Learning ( Poster ) > link | Shashi Raj Pandey 路 Lam Nguyen 路 Petar Popovski 馃敆 |
-
|
Federated Continual Learning with Differentially Private Data Sharing ( Poster ) > link | Giulio Zizzo 路 Ambrish Rawat 路 Naoise Holohan 路 Seshu Tirupathi 馃敆 |
-
|
-SignFedAvg: A unified sign-based stochastic compression for federated learning ( Poster ) > link | Zhiwei Tang 路 Yanmeng Wang 路 Tsung-Hui Chang 馃敆 |
-
|
Measuring and Controlling Split Layer Privacy Leakage Using Fisher Information ( Poster ) > link | Kiwan Maeng 路 Chuan Guo 路 Sanjay Kariyappa 路 G. Edward Suh 馃敆 |
-
|
FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning ( Poster ) > link | Yuanhao Xiong 路 Ruochen Wang 路 Minhao Cheng 路 Felix Yu 路 Cho-Jui Hsieh 馃敆 |
-
|
With a Little Help from My Friend: Server-Aided Federated Learning with Partial Client Participation ( Poster ) > link | Haibo Yang 路 Peiwen Qiu 路 Prashant Khanduri 路 Jia Liu 馃敆 |
-
|
Federated Learning of Large Models at the Edge via Principal Sub-Model Training ( Poster ) > link | Yue Niu 路 Saurav Prakash 路 Souvik Kundu 路 Sunwoo Lee 路 Salman Avestimehr 馃敆 |
-
|
FedRule: Federated Rule Recommendation System with Graph Neural Networks ( Poster ) > link | Yuhang Yao 路 Mohammad Mahdi Kamani 路 Zhongwei Cheng 路 Lin Chen 路 Carlee Joe-Wong 路 Tianqiang Liu 馃敆 |
-
|
Improving Vertical Federated Learning by Efficient Communication with ADMM ( Poster ) > link | Chulin Xie 路 Pin-Yu Chen 路 Ce Zhang 路 Bo Li 馃敆 |
-
|
Subject Level Differential Privacy with Hierarchical Gradient Averaging ( Poster ) > link | Virendra Marathe 路 Pallika Kanani 路 Daniel Peterson 馃敆 |
-
|
MocoSFL: enabling cross-client collaborative self-supervised learning ( Poster ) > link | Jingtao Li 路 Lingjuan Lyu 路 Daisuke Iso 路 Chaitali Chakrabarti 路 Michael Spranger 馃敆 |
-
|
Federated Continual Learning to Detect Accounting Anomalies in Financial Auditing ( Poster ) > link | Marco Schreyer 路 Hamed Hemati 路 Damian Borth 路 Miklos Vasarhelyi 馃敆 |
-
|
Certified Robustness in Federated Learning ( Poster ) > link | Motasem Alfarra 路 Juan Perez 路 Egor Shulgin 路 Peter Richtarik 路 Bernard Ghanem 馃敆 |
-
|
Federated Sparse Training: Lottery Aware Model Compression for Resource Constrained Edge ( Poster ) > link | Sara Babakniya 路 Souvik Kundu 路 Saurav Prakash 路 Yue Niu 路 Salman Avestimehr 馃敆 |
-
|
Asynchronous speedup in decentralized optimization ( Poster ) > link | Mathieu Even 路 Hadrien Hendrikx 路 Laurent Massouli茅 馃敆 |