Workshop
Workshop on Federated Learning in the Age of Foundation Models in Conjunction with NeurIPS 2023 (FL@FM-NeurIPS'23)
Jinghui Chen 路 Lixin Fan 路 Gauri Joshi 路 Sai Praneeth Karimireddy 路 Stacy Patterson 路 Shiqiang Wang 路 Han Yu
Hall D2 (level 1)
Sat 16 Dec, 6:25 a.m. PST
An exciting forum for researchers to exchange the recent developments in federated learning in the modern age of foundation models.
Please visit our workshop webpage for full details: https://federated-learning.org/fl@fm-neurips-2023/
Chat is not available.
Timezone: America/Los_Angeles
Schedule
|
Sat 6:25 a.m. - 6:30 a.m.
|
Opening remarks
(
Presentation
)
>
|
馃敆 |
|
Sat 6:30 a.m. - 6:40 a.m.
|
Text-driven Prompt Generation for Vision-Language Models in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Chen Qiu 路 Xingyu Li 路 Chaithanya Kumar Mummadi 路 Madan Ganesh 路 Zhenzhen Li 路 Lu Peng 路 Wan-Yi Lin 馃敆 |
|
Sat 6:40 a.m. - 6:50 a.m.
|
HePCo: Data-Free Heterogeneous Prompt Consolidation for Continual Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Shaunak Halbe 路 James S Smith 路 Junjiao Tian 路 Zsolt Kira 馃敆 |
|
Sat 6:50 a.m. - 7:00 a.m.
|
Beyond Gradient and Priors in Privacy Attacks: Leveraging Pooler Layer Inputs of Language Models in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Jianwei Li 路 Sheng Liu 路 Qi Lei 馃敆 |
|
Sat 7:00 a.m. - 7:10 a.m.
|
FOCUS: Fairness via Agent-Awareness for Federated Learning on Heterogeneous Data
(
Poster
)
>
link
SlidesLive Video |
Wenda Chu 路 Chulin Xie 路 Boxin Wang 路 Linyi Li 路 Lang Yin 路 Arash Nourian 路 Han Zhao 路 Bo Li 馃敆 |
|
Sat 7:10 a.m. - 7:35 a.m.
|
Invited talk: Federated Learning by Dataset Distillation
(
Oral
)
>
SlidesLive Video |
Cho-Jui Hsieh 馃敆 |
|
Sat 7:35 a.m. - 8:00 a.m.
|
Invited talk: Federated Learning with Public and Private Data: From Small Models to Large, and Back
(
Oral
)
>
SlidesLive Video |
Zheng Xu 馃敆 |
|
Sat 8:00 a.m. - 8:30 a.m.
|
Break
|
馃敆 |
|
Sat 8:30 a.m. - 8:55 a.m.
|
Invited talk: When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions
(
Oral
)
>
SlidesLive Video |
Lingjuan Lyu 馃敆 |
|
Sat 8:55 a.m. - 9:05 a.m.
|
FedSoL: Bridging Global Alignment and Local Generality in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Gihun Lee 路 Minchan Jeong 路 SangMook Kim 路 Jaehoon Oh 路 Se-Young Yun 馃敆 |
|
Sat 9:05 a.m. - 9:15 a.m.
|
One-shot Empirical Privacy Estimation for Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Galen Andrew 路 Peter Kairouz 路 Sewoong Oh 路 Alina Oprea 路 H. Brendan McMahan 路 Vinith Suriyakumar 馃敆 |
|
Sat 9:15 a.m. - 10:00 a.m.
|
Panel Discussion
(
Panel
)
>
SlidesLive Video |
Sai Praneeth Karimireddy 馃敆 |
|
Sat 10:00 a.m. - 11:30 a.m.
|
Lunch
|
馃敆 |
|
Sat 11:30 a.m. - 11:55 a.m.
|
Invited talk: Federated Learning in Medical Imaging
(
Oral
)
>
SlidesLive Video |
Jayashree Kalpathy-Cramer 馃敆 |
|
Sat 11:55 a.m. - 12:20 p.m.
|
Invited talk: Decentralized LLM Agent Cloud Platform
(
Oral
)
>
SlidesLive Video |
Chaoyang He 馃敆 |
|
Sat 12:20 p.m. - 12:30 p.m.
|
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning
(
Oral
)
>
link
SlidesLive Video |
Liam Collins 路 Shanshan Wu 路 Sewoong Oh 路 Khe Sim 馃敆 |
|
Sat 12:30 p.m. - 12:40 p.m.
|
SLoRA: Federated Parameter Efficient Fine-Tuning of Language Models
(
Oral
)
>
link
SlidesLive Video |
Sara Babakniya 路 Ahmed Elkordy 路 Yahya Ezzeldin 路 Qingfeng Liu 路 Kee-Bong Song 路 Mostafa El-Khamy 路 Salman Avestimehr 馃敆 |
|
Sat 12:40 p.m. - 12:50 p.m.
|
The Fair Value of Data Under Heterogeneous Privacy Constraints in Federated Learning
(
Oral
)
>
link
SlidesLive Video |
Justin Kang 路 Kannan Ramchandran 路 Ramtin Pedarsani 馃敆 |
|
Sat 12:50 p.m. - 1:00 p.m.
|
Towards Building the FederatedGPT: Federated Instruction Tuning
(
Oral
)
>
link
SlidesLive Video |
Jianyi Zhang 路 Saeed Vahidian 路 Martin Kuo 路 Chunyuan Li 路 Ruiyi Zhang 路 Tong Yu 路 Guoyin Wang 路 Yiran Chen 馃敆 |
|
Sat 1:00 p.m. - 1:30 p.m.
|
Break
|
馃敆 |
|
Sat 1:30 p.m. - 1:55 p.m.
|
Invited talk: On the 5th Generation of Local Training Methods in Federated Learning
(
Oral
)
>
SlidesLive Video |
Peter Richtarik 馃敆 |
|
Sat 1:55 p.m. - 2:05 p.m.
|
Federated Learning for Speech Recognition: Revisiting Current Trends Towards Large-Scale ASR
(
Oral
)
>
link
SlidesLive Video |
Shams Azam 路 Martin Pelikan 路 Vitaly Feldman 路 Kunal Talwar 路 Jan Silovsky 路 Tatiana Likhomanenko 馃敆 |
|
Sat 2:05 p.m. - 2:15 p.m.
|
LASER: Linear Compression in Wireless Distributed Optimization
(
Oral
)
>
link
SlidesLive Video |
Ashok Vardhan Makkuva 路 Marco Bondaschi 路 Thijs Vogels 路 Martin Jaggi 路 Hyeji Kim 路 Michael Gastpar 馃敆 |
|
Sat 2:15 p.m. - 2:20 p.m.
|
Best Paper Award Ceremony
(
Announcement
)
>
SlidesLive Video |
Shiqiang Wang 馃敆 |
|
Sat 2:20 p.m. - 3:30 p.m.
|
Poster Session
(
Poster
)
>
|
馃敆 |
|
-
|
Beyond Parameter Averaging in Model Aggregation ( Poster ) > link | Pol Garcia Recasens 路 Jordi Torres 路 Josep Llu铆s Berral 路 S酶ren Hauberg 路 Pablo Moreno-Mu帽oz 馃敆 |
|
-
|
DPZero: Dimension-Independent and Differentially Private Zeroth-Order Optimization ( Poster ) > link | Liang Zhang 路 Kiran Thekumparampil 路 Sewoong Oh 路 Niao He 馃敆 |
|
-
|
An Empirical Evaluation of Federated Contextual Bandit Algorithms ( Poster ) > link | Alekh Agarwal 路 H. Brendan McMahan 路 Zheng Xu 馃敆 |
|
-
|
parameter averaging laws for multitask language models ( Poster ) > link | Woojin Chung 路 Hyowon Cho 路 James Thorne 路 Se-Young Yun 馃敆 |
|
-
|
Consensus Optimization at Representation: Improving Personalized Federated Learning via Data-Centric Regularization ( Poster ) > link | Heng Zhu 路 Arya Mazumdar 馃敆 |
|
-
|
Augmenting Federated Learning with Pretrained Transformers ( Poster ) > link | Xuechen Zhang 路 Mingchen Li 路 Xiangyu Chang 路 Jiasi Chen 路 Amit Roy-Chowdhury 路 Ananda Theertha Suresh 路 Samet Oymak 馃敆 |
|
-
|
Exploring User-level Gradient Inversion with a Diffusion Prior ( Poster ) > link | Zhuohang Li 路 Andrew Lowy 路 Jing Liu 路 Toshiaki Koike-Akino 路 Bradley Malin 路 Kieran Parsons 路 Ye Wang 馃敆 |
|
-
|
Making Batch Normalization Great in Federated Deep Learning ( Poster ) > link | Jike Zhong 路 Hong-You Chen 路 Wei-Lun (Harry) Chao 馃敆 |
|
-
|
Leveraging Foundation Models to Improve Lightweight Clients in Federated Learning ( Poster ) > link | Xidong Wu 路 Wan-Yi Lin 路 Devin Willmott 路 Filipe Condessa 路 Yufei Huang 路 Zhenzhen Li 路 Madan Ganesh 馃敆 |
|
-
|
MARINA Meets Matrix Stepsizes: Variance Reduced Distributed Non-Convex Optimization ( Poster ) > link | Hanmin Li 路 Avetik Karagulyan 路 Peter Richtarik 馃敆 |
|
-
|
Private and Personalized Histogram Estimation in a Federated Setting ( Poster ) > link | Amrith Setlur 路 Vitaly Feldman 路 Kunal Talwar 馃敆 |
|
-
|
TAMUNA: Doubly Accelerated Federated Learning with Local Training, Compression, and Partial Participation ( Poster ) > link | Laurent Condat 路 Ivan Agarsk媒 路 Grigory Malinovsky 路 Peter Richtarik 馃敆 |
|
-
|
FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System ( Poster ) > link | Weizhao Jin 路 Yuhang Yao 路 Shanshan Han 路 Carlee Joe-Wong 路 Srivatsan Ravi 路 Salman Avestimehr 路 Chaoyang He 馃敆 |
|
-
|
MOFL/D: A Federated Multi-objective Learning Framework with Decomposition ( Poster ) > link | Maria Hartmann 路 Gr茅goire Danoy 路 Mohammed Alswaitti 路 Pascal Bouvry 馃敆 |
|
-
|
Absolute Variation Distance: an Inversion Attack Evaluation Metric for Federated Learning ( Poster ) > link | Georgios Papadopoulos 路 Yash Satsangi 路 Shaltiel Eloul 路 Marco Pistoia 馃敆 |
|
-
|
Fed3R: Recursive Ridge Regression for Federated Learning with strong pre-trained models ( Poster ) > link | Eros Fan矛 路 Raffaello Camoriano 路 Barbara Caputo 路 Marco Ciccone 馃敆 |
|
-
|
Breaking Physical and Linguistic Borders: Multilingual Federated Prompt Tuning for Low-Resource Languages ( Poster ) > link | Wanru Zhao 路 Yihong Chen 路 Royson Lee 路 Xinchi Qiu 路 Yan Gao 路 Hongxiang Fan 路 Nicholas Lane 馃敆 |
|
-
|
Learning Optimizers for Local SGD ( Poster ) > link | Charles-脡tienne Joseph 路 Benjamin Th茅rien 路 Abhinav Moudgil 路 Boris Knyazev 路 Eugene Belilovsky 馃敆 |
|
-
|
RealFM: A Realistic Mechanism to Incentivize Data Contribution and Device Participation ( Poster ) > link | Marco Bornstein 路 Amrit Bedi 路 Anit Kumar Sahu 路 Furqan Khan 路 Furong Huang 馃敆 |
|
-
|
Heterogeneous LoRA for Federated Fine-tuning of On-device Foundation Models ( Poster ) > link | Yae Jee Cho 路 Luyang Liu 路 Zheng Xu 路 Aldi Fahrezi 路 Matt Barnes 路 Gauri Joshi 馃敆 |
|
-
|
FDAPT: Federated Domain-adaptive Pre-training for Language Models ( Poster ) > link | Lekang Jiang 路 Filip Svoboda 路 Nicholas Lane 馃敆 |
|
-
|
Backdoor Threats from Compromised Foundation Models to Federated Learning ( Poster ) > link | Xi Li 路 Songhe Wang 路 Chen Wu 路 Hao Zhou 路 Jiaqi Wang 馃敆 |
|
-
|
Correlated Noise Provably Beats Independent Noise for Differentially Private Learning ( Poster ) > link | Christopher A. Choquette-Choo 路 Krishnamurthy Dvijotham 路 Krishna Pillutla 路 Arun Ganesh 路 Thomas Steinke 路 Abhradeep Guha Thakurta 馃敆 |
|
-
|
User Inference Attacks on Large Language Models ( Poster ) > link | Nikhil Kandpal 路 Krishna Pillutla 路 Alina Oprea 路 Peter Kairouz 路 Christopher A. Choquette-Choo 路 Zheng Xu 馃敆 |
|
-
|
FedFN: Feature Normalization for Alleviating Data Heterogeneity Problem in Federated Learning ( Poster ) > link | SeongYoon Kim 路 Gihun Lee 路 Jaehoon Oh 路 Se-Young Yun 馃敆 |
|
-
|
FedLDA: Personalized Federated Learning Through Collaborative Linear Discriminant Analysis ( Poster ) > link | Connor Mclaughlin 路 Lili Su 馃敆 |