Workshop
Adaptive Foundation Models: Evolving AI for Personalized and Efficient Learning
Mengye Ren 路 Paul Vicol 路 Naila Murray 路 Renjie Liao 路 Beidi Chen 路 Wei-Chiu Ma
West Exhibition Hall A
Sat 14 Dec, 8:30 a.m. PST
In the rapidly evolving landscape of AI, the development of adaptive foundation models represents a ground-breaking shift towards AI systems that can continually learn, adapt, and evolve in response to new information, changing environments, and user preferences. This workshop aims to explore cutting-edge advancements in adaptive foundation models, focusing on methodologies that enable continual weight updates, memory-efficient fine-tuning, and personalized adaptation to diverse tasks and domains. We feature invited talks by experts in LLMs, diffusion models, multimodal learning, continual learning, and efficient ML to explore this interdisciplinary topic. We host workshop paper submissions and invite oral papers for contributed talks. In addition, there is a panel discussion with the invited speakers.
Schedule
Sat 8:30 a.m. - 9:00 a.m.
|
Keynote: Tree Search for Language Model Agents
(
Talk
)
>
SlidesLive Video |
Ruslan Salakhutdinov 馃敆 |
Sat 9:00 a.m. - 9:30 a.m.
|
Multimodal Iterative Refinement
(
Invited Talk
)
>
SlidesLive Video |
Sander Dieleman 馃敆 |
Sat 9:30 a.m. - 9:45 a.m.
|
Coffee Break
|
馃敆 |
Sat 9:45 a.m. - 10:15 a.m.
|
Is pre-training the key to successful domain generalization?
(
Invited Talk
)
>
SlidesLive Video |
Kate Saenko 馃敆 |
Sat 10:15 a.m. - 10:45 a.m.
|
Workshop Oral Papers 1
(
Contributed Talks
)
>
|
馃敆 |
Sat 10:15 a.m. - 10:25 a.m.
|
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
(
Oral
)
>
SlidesLive Video |
Fabian Paischer 路 Lukas Hauzenberger 路 Thomas Schmied 路 Benedikt Alkin 路 Marc Deisenroth 路 Sepp Hochreiter 馃敆 |
Sat 10:25 a.m. - 10:35 a.m.
|
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
(
Oral
)
>
SlidesLive Video |
Joel Jang 路 Seungone Kim 路 Bill Yuchen Lin 路 Yizhong Wang 路 Jack Hessel 路 Luke Zettlemoyer 路 Hannaneh Hajishirzi 路 Yejin Choi 路 Prithviraj Ammanabrolu 馃敆 |
Sat 10:35 a.m. - 10:45 a.m.
|
RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems
(
Oral
)
>
SlidesLive Video |
Jennifer Hsia 路 Afreen Shaikh 路 Zhiruo Wang 路 Graham Neubig 馃敆 |
Sat 10:45 a.m. - 11:45 a.m.
|
Morning Poster Session, Paper IDs 1-75
(
Poster Session
)
>
|
馃敆 |
Sat 11:45 a.m. - 1:00 p.m.
|
Lunch Break
|
馃敆 |
Sat 1:00 p.m. - 1:30 p.m.
|
Continual Foundation Model Learning
(
Invited Talk
)
>
SlidesLive Video |
Matthias Bethge 路 Matthias Bethge 路 Vishaal Udandarao 馃敆 |
Sat 1:30 p.m. - 2:00 p.m.
|
On the Knowledge Adaptability of Language Models
(
Invited Talk
)
>
SlidesLive Video |
Minjoon Seo 馃敆 |
Sat 2:00 p.m. - 3:00 p.m.
|
Workshop Oral Papers 2
(
Contributed Talks
)
>
|
馃敆 |
Sat 2:00 p.m. - 2:10 p.m.
|
Self-Play Preference Optimization for Language Model Alignment
(
Oral
)
>
SlidesLive Video |
Yue Wu 路 Zhiqing Sun 路 Huizhuo Yuan 路 Kaixuan Ji 路 Yiming Yang 路 Quanquan Gu 馃敆 |
Sat 2:10 p.m. - 2:20 p.m.
|
Fast and Accurate Language Model Decoding via Parallel Token Processing
(
Oral
)
>
SlidesLive Video |
Zhepei Wei 路 Wei-Lin Chen 路 Xinyu Zhu 路 Yu Meng 馃敆 |
Sat 2:20 p.m. - 2:30 p.m.
|
Fine-tuning LLM Agents with Retrospective In-Context Online Learning
(
Oral
)
>
SlidesLive Video |
Wen-Tse Chen 路 Jiayu Chen 路 Fahim Tajwar 路 Hao Zhu 路 Xintong Duan 路 Ruslan Salakhutdinov 路 Jeff Schneider 馃敆 |
Sat 2:30 p.m. - 2:40 p.m.
|
Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle
(
Oral
)
>
SlidesLive Video |
Amelia Hui Dai 路 Ryan Teehan 路 Mengye Ren 馃敆 |
Sat 2:40 p.m. - 2:50 p.m.
|
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
(
Oral
)
>
SlidesLive Video |
Tong Chen 路 Hao Fang 路 Patrick Xia 路 Xiaodong Liu 路 Ben Van Durme 路 Luke Zettlemoyer 路 Jianfeng Gao 路 Hao Cheng 馃敆 |
Sat 2:50 p.m. - 3:00 p.m.
|
Coffee Break
|
馃敆 |
Sat 3:00 p.m. - 3:30 p.m.
|
Continual Learning with Large Language Models
(
Invited Talk
)
>
SlidesLive Video |
Bing Liu 馃敆 |
Sat 3:30 p.m. - 4:00 p.m.
|
Enable Large Language Model Deployment Across Cloud and Edge with ML Compilation
(
Invited Talk
)
>
SlidesLive Video |
Tianqi Chen 馃敆 |
Sat 4:00 p.m. - 4:30 p.m.
|
Panel Discussion
(
Panel
)
>
SlidesLive Video |
Ruslan Salakhutdinov 路 Sander Dieleman 路 Kate Saenko 路 Matthias Bethge 路 Minjoon Seo 路 Bing Liu 馃敆 |
Sat 4:30 p.m. - 5:30 p.m.
|
Afternoon Poster Session, Paper IDs 76-157
(
Poster Session
)
>
|
馃敆 |
-
|
Towards Personalized Language Models via Inference-time Human Preference Optimization ( Poster ) > link | Nikki Lijing Kuang 路 Wei Sun 路 Scott McFaddin 路 Yian Ma 路 Markus Ettl 馃敆 |
-
|
XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning ( Poster ) > link | Alexander Nikulin 路 Ilya Zisman 路 Alexey Zemtsov 路 Vladislav Kurenkov 馃敆 |
-
|
SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents ( Poster ) > link |
11 presentersZhuoshi Pan 路 Qianhui Wu 路 Huiqiang Jiang 路 Xufang Luo 路 Hao Cheng 路 Dongsheng Li 路 Yuqing Yang 路 Chin-Yew Lin 路 H. Vicky Zhao 路 Lili Qiu 路 Jianfeng Gao |
-
|
metaTextGrad: Learning to learn with language models as optimizers ( Poster ) > link | Guowei Xu 路 Mert Yuksekgonul 路 Carlos Guestrin 路 James Zou 馃敆 |
-
|
Adapting Foundation Models via Training-free Dynamic Weight Interpolation ( Poster ) > link | Changdae Oh 路 Sharon Li 路 Kyungwoo Song 路 Sangdoo Yun 路 Dongyoon Han 馃敆 |
-
|
Personalized Language Modeling from Personalized Human Feedback ( Poster ) > link | Xinyu Li 路 Ruiyang Zhou 路 Zachary Lipton 路 Liu Leqi 馃敆 |
-
|
AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations ( Poster ) > link | Gaurav Verma 路 Rachneet Kaur 路 Nishan Srishankar 路 Zhen Zeng 路 Tucker Balch 路 Manuela Veloso 馃敆 |
-
|
Automatically Generating Custom Context-Driven SFT Data for LLMs with Multi-Granularity ( Poster ) > link | Shanghaoran Quan 馃敆 |
-
|
ZO-Offloading: Fine-Tuning LLMs with 100 Billion Parameters on a Single GPU ( Poster ) > link | Liangyu Wang 路 Jie Ren 路 Hang Xu 路 Junxiao Wang 路 David Keyes 路 Di Wang 馃敆 |
-
|
LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ( Poster ) > link | Di Wu 路 Hongwei Wang 路 Wenhao Yu 路 Yuwei Zhang 路 Kai-Wei Chang 路 Dong Yu 馃敆 |
-
|
InvestAlign: Align LLMs with Investor Decision-Making under Herd Behavior ( Poster ) > link | Huisheng Wang 路 Zhuoshi Pan 路 Hangjing Zhang 路 Mingxiao Liu 路 Yiqing Lin 路 H. Vicky Zhao 馃敆 |
-
|
Improving Model Merging with Natural Niches ( Poster ) > link | Jo茫o Abrantes 路 Robert Lange 路 Yujin Tang 馃敆 |
-
|
Improving In-Context Learning with Small Language Model Ensembles ( Poster ) > link | Mehdi Mojarradi 路 Lingyi Yang 路 Robert McCraith 路 Adam Mahdi 馃敆 |
-
|
Adaptive LoRA Merging for Efficient Domain Incremental Learning ( Poster ) > link | Eric Nuertey Coleman 路 Luigi Quarantiello 路 Julio Hurtado 路 Vincenzo Lomonaco 馃敆 |
-
|
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation ( Oral ) > link | Fabian Paischer 路 Lukas Hauzenberger 路 Thomas Schmied 路 Benedikt Alkin 路 Marc Deisenroth 路 Sepp Hochreiter 馃敆 |
-
|
Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generation ( Poster ) > link | Quanting Xie 路 So Yeon Min 路 Tianyi Zhang 路 Kedi Xu 路 Aarav Bajaj 路 Ruslan Salakhutdinov 路 Matthew Johnson-Roberson 路 Yonatan Bisk 馃敆 |
-
|
Slaying the HyDRA: Parameter-Efficient Hyper Networks with Low-Displacement Rank Adaptation ( Poster ) > link | Xiangyu Chen 路 Ye Wang 路 Matthew Brand 路 Perry Wang 路 Jing Liu 路 Toshiaki Koike-Akino 馃敆 |
-
|
Generating Diverse Negations from Affirmative Sentences ( Poster ) > link | Darian Vasquez 路 Afroditi Papadaki 馃敆 |
-
|
P3O: Pessimistic Preference-based Policy Optimization for Robust Alignment from Preferences ( Poster ) > link | Dhawal Gupta 路 Christoph Dann 路 Alekh Agarwal 馃敆 |
-
|
MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models ( Poster ) > link | Peng Xia 路 Kangyu Zhu 路 Haoran Li 路 Tianze Wang 路 Weijia Shi 路 Linjun Zhang 路 James Zou 路 Huaxiu Yao 馃敆 |
-
|
IFCap: Image-like Retrieval and Frequency-based Entity Filtering for Zero-shot Captioning ( Poster ) > link | Soeun Lee 路 Si-Woo Kim 路 taewhan Kim 路 Dong-Jin Kim 馃敆 |
-
|
Retrieval-Augmented Data Augmentation for Low-Resource Domain Tasks ( Poster ) > link | Minju Seo 路 Jinheon Baek 路 James Thorne 路 Sung Ju Hwang 馃敆 |
-
|
Transformer2: Self-adaptive LLMs ( Poster ) > link | Qi Sun 路 Edoardo Cetin 路 Yujin Tang 馃敆 |
-
|
Data-Efficient Training by Evolved Sampling ( Poster ) > link | Ziheng Cheng 路 Zhong Li 路 Jiang Bian 馃敆 |
-
|
Make-An-Agent: A Generalizable Policy Network Generator with Behavior-Prompted Diffusion ( Oral ) > link | Yongyuan Liang 路 Tingqiang Xu 路 Kaizhe Hu 路 Guangqi Jiang 路 Furong Huang 路 Huazhe Xu 馃敆 |
-
|
Agent Skill Acquisition for LLMs via CycleQD ( Poster ) > link | So Kuroki 路 Taishi Nakamura 路 Takuya Akiba 路 Yujin Tang 馃敆 |
-
|
Enhancing Low-Light Imagery: A Fusion of Deep Learning and Diffusion Models for Superior Visibility ( Poster ) > link | Yangfan He 路 Jianhui Wang 路 Sida Li 路 Haoyuan Li 路 TIANYU SHI 馃敆 |
-
|
AgentMerge: Enhancing Generalization in Fine-Tuned LLM Agents ( Poster ) > link | Megh Thakkar 路 L茅o Boisvert 路 Thibault de Chezelles 路 Alexandre Piche 路 Maxime Gasse 路 Massimo Caccia 路 Alexandre Lacoste 馃敆 |
-
|
Device-Directed Speech Detection for Follow-up Conversations Using Large Language Models ( Poster ) > link | Ognjen Rudovic 路 Pranay Dighe 路 Yi Su 路 Vineet Garg 路 Sameer Dharur 路 Xiaochuan Niu 路 Ahmed Abdelaziz 路 Saurabh Adya 路 Ahmed Tewfik 馃敆 |
-
|
AoP-SAM: Automation of Prompts for Efficient Segmentation ( Poster ) > link | Yi Chen 路 Muyoung Son 路 Chuanbo Hua 路 Joo-Young Kim 馃敆 |
-
|
Model Developmental Safety: A Safety-Centric Method and Applications in Vision-Language Models ( Poster ) > link | Gang Li 路 Wendi Yu 路 Yao Yao 路 Wei Tong 路 Yingbin Liang 路 Qihang Lin 路 Tianbao Yang 馃敆 |
-
|
Enhancing Fine-Tuning Efficiency of LLMs Through Gradient Subspace Tracking ( Poster ) > link | Sahar Rajabi 路 Sirisha Rambhatla 馃敆 |
-
|
Memory Efficient Continual Learning with CLIP Models ( Poster ) > link | Ryan King 路 Gang Li 路 Bobak J Mortazavi 路 Tianbao Yang 馃敆 |
-
|
Empowering LLM Agents with Zero-Shot Optimal Decision-Making through Q-learning ( Poster ) > link | Jiajun Chai 路 Sicheng Li 路 Yuqian Fu 路 Dongbin Zhao 路 Yuanheng Zhu 馃敆 |
-
|
Leveraging Self Weak-supervision for Improved VLM Performance ( Poster ) > link | Shuvendu Roy 路 Ali Etemad 馃敆 |
-
|
Mitigating Hallucination in Large Vision-Language Models via Modular Attribution and Intervention ( Poster ) > link | Tianyun Yang 路 Ziniu Li 路 Juan Cao 路 Chang Xu 馃敆 |
-
|
Deliberate Practice with Synthetic Data ( Poster ) > link | Reyhane Askari Hemmat 路 Mohammad Pezeshki 路 Pietro Astolfi 路 Melissa Hall 路 Florian Bordes 路 Jakob Verbeek 路 Michal Drozdzal 路 Adriana Romero 馃敆 |
-
|
LangDA: Adapting Visual Features with Instruction Tuning for Semantic Segmentation ( Poster ) > link | Chang Liu 路 Saad Hossain 路 C Thomas 路 Kwei-Herng Lai 路 Raviteja Vemulapalli 路 Sirisha Rambhatla 路 Alexander Wong 馃敆 |
-
|
Fine-Grained Visual Recognition in the Age of Multimodal LLMs ( Poster ) > link | Hari Chandana Kuchibhotla 路 Abbavaram Gowtham Reddy 路 Sai Srinivas Kancheti 路 Vineeth N Balasubramanian 馃敆 |
-
|
APE: Faster and Longer Context-Augmented Generation via Adaptive Parallel Encoding ( Poster ) > link | Xinyu Yang 路 Tianqi Chen 路 Beidi Chen 馃敆 |
-
|
Imbalance-Regularized LoRA: A Plug-and-Play Method for Improving Fine-Tuning of Foundation Models ( Poster ) > link | Zhenyu Zhu 路 Yongtao Wu 路 Quanquan Gu 路 Volkan Cevher 馃敆 |
-
|
Transfer Learning for Finetuning Large Language Models ( Poster ) > link | Tobias Strangmann 路 Lennart Purucker 路 J枚rg Franke 路 Ivo Rapant 路 Fabio Ferreira 路 Frank Hutter 馃敆 |
-
|
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass ( Oral ) > link | Tong Chen 路 Hao Fang 路 Patrick Xia 路 Xiaodong Liu 路 Ben Van Durme 路 Luke Zettlemoyer 路 Jianfeng Gao 路 Hao Cheng 馃敆 |
-
|
Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism ( Poster ) > link | Yimin Tang 路 Yurong Xu 路 Ning Yan 路 Masood Seyed Mortazavi 馃敆 |
-
|
Synergistic Weak-Strong Collaboration by Aligning Preferences ( Poster ) > link | Yizhu Jiao 路 Xuchao Zhang 路 Zhaoyang Wang 路 Yubo Ma 路 Zhun Deng 路 Rujia Wang 路 Chetan Bansal 路 Saravan Rajmohan 路 Jiawei Han 路 Huaxiu Yao 馃敆 |
-
|
ViPCap: Retrieval Text-based Visual Prompts for Lightweight Image Captioning ( Poster ) > link | taewhan Kim 路 Soeun Lee 路 Si-Woo Kim 路 Dong-Jin Kim 馃敆 |
-
|
Enhancing Cross-Language Code Translation via Task-Specific Embedding Alignment in Retrieval-Augmented Generation ( Poster ) > link | Manish Bhattarai 路 Minh Vu 路 Javier E. Santos 路 Ismael Boureima 路 Daniel O'Malley 馃敆 |
-
|
Fine-tuning LLM Agents with Retrospective In-Context Online Learning ( Oral ) > link | Wen-Tse Chen 路 Jiayu Chen 路 Fahim Tajwar 路 Hao Zhu 路 Xintong Duan 路 Ruslan Salakhutdinov 路 Jeff Schneider 馃敆 |
-
|
REGENT: A Retrieval-Augmented Generalist Agent That Can Act in-Context In New Environments ( Poster ) > link | Kaustubh Sridhar 路 Souradeep Dutta 路 Dinesh Jayaraman 路 Insup Lee 馃敆 |
-
|
Pixelated Instructions: Can Multimodal Large Language Models Follow Printed Instructions in Images? ( Poster ) > link | Xiujun Li 路 Yujie Lu 路 William Yang Wang 路 Yejin Choi 馃敆 |
-
|
Can Vision Language Models Learn from Visual Demonstrations of Ambiguous Spatial Reasoning? ( Poster ) > link | Bowen Zhao 路 Leo Dirac 路 Paulina Varshavskaya 馃敆 |
-
|
Fast and Accurate Language Model Decoding via Parallel Token Processing ( Oral ) > link | Zhepei Wei 路 Wei-Lin Chen 路 Xinyu Zhu 路 Yu Meng 馃敆 |
-
|
Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle ( Oral ) > link | Amelia Hui Dai 路 Ryan S Teehan 路 Mengye Ren 馃敆 |
-
|
CAT Pruning: Cluster-Aware Token Pruning For Text-to-Image Diffusion Models ( Poster ) > link | Xinle Cheng 路 Zhuoming Chen 路 Zhihao Jia 馃敆 |
-
|
Personalized Adaptation via In-Context Preference Learning ( Poster ) > link | Allison Lau 路 Younwoo Choi 路 Vahid Balazadeh 路 Keertana Chidambaram 路 Vasilis Syrgkanis 路 Rahul Krishnan 馃敆 |
-
|
OmniPredict: GPT-4o Enhanced Multi-modal Pedestrian Crossing Intention Prediction ( Poster ) > link | Je-Seok Ham 路 Jia Huang 路 Peng Jiang 路 Jinyoung Moon 路 Yongjin Kwon 路 Srikanth Saripalli 路 Changick Kim 馃敆 |
-
|
Common Pitfalls of Margin-based Preference Optimization in Language Model Alignment ( Poster ) > link | Hui Yuan 路 Yifan Zeng 路 Yue Wu 路 Huazheng Wang 路 Mengdi Wang 路 Liu Leqi 馃敆 |
-
|
Self-Play Preference Optimization for Language Model Alignment ( Oral ) > link | Yue Wu 路 Zhiqing Sun 路 Huizhuo Yuan 路 Kaixuan Ji 路 Yiming Yang 路 Quanquan Gu 馃敆 |
-
|
Towards Full Delegation: Designing Ideal Agentic Behaviors for Travel Planning ( Poster ) > link | Song Jiang 路 Da JU 路 Andrew Cohen 路 Sasha Mitts 路 Aaron Foss 路 Justine Kao 路 Xian Li 路 Yuandong Tian 馃敆 |
-
|
Optimizing Multi-Round Enhanced Training in Diffusion Models for Improved Preference Understanding ( Poster ) > link | Yangfan He 路 Jianhui Wang 路 Haoyuan Li 路 Sida Li 路 Li Sun 路 TIANYU SHI 馃敆 |
-
|
Towards Federated Low-Rank Adaptation with Rank Heterogeneity ( Poster ) > link | Yuji Byun 路 Jaeho Lee 馃敆 |
-
|
UniTMGE: Uniform Text-Motion Generation and Editing via Diffusion Model ( Poster ) > link | Ruoyu Wang 路 Xiang Li 路 Tengjiao Sun 路 Yangfan He 路 TIANYU SHI 路 yitingxie 馃敆 |
-
|
Assisted Few-Shot Learning for Vision-Language Models in Agricultural Stress Phenotype Identification ( Poster ) > link | Muhammad Arbab Arshad 路 Talukder "Zaki" Jubery 路 Asheesh Singh 路 ARTI SINGH 路 Chinmay Hegde 路 Baskar Ganapathysubramanian 路 Aditya Balu 路 Adarsh Krishnamurthy 路 Soumik Sarkar 馃敆 |
-
|
On Pre-training of Multimodal Language Models Customized for Chart Understanding ( Poster ) > link | Wan-Cyuan Fan 路 Yen-Chun Chen 路 Mengchen Liu 路 Lu Yuan 路 Leonid Sigal 馃敆 |
-
|
Personas within Parameters: Fine-Tuning Small Language Models with Low-Rank Adapters to Mimic User Behaviors ( Poster ) > link | Himanshu Thakur 路 Eshani Agrawal 路 Smruthi Mukund 馃敆 |
-
|
Controlling Multimodal LLMs via Reward-guided Decoding ( Poster ) > link | Oscar Ma帽as 路 Pierluca D'Oro 路 Koustuv Sinha 路 Adriana Romero 路 Michal Drozdzal 路 Aishwarya Agrawal 馃敆 |
-
|
Dream To Adapt: Learning Behaviors by Latent Imagination Under Non-Stationarity ( Poster ) > link | Emiliyan Gospodinov 路 Vaisakh Shaj Kumar 路 Philipp Becker 路 Stefan Geyer 路 Gerhard Neumann 馃敆 |
-
|
Sirius: Contextual Sparsity with Correction for Efficient LLM ( Poster ) > link | Yang Zhou 路 Zhuoming Chen 路 Zhaozhuo Xu 路 Victoria Lin 路 Beidi Chen 馃敆 |
-
|
Approximate Top-k for Increased Parallelism ( Poster ) > link | Oscar Key 路 Luka Ribar 路 Alberto Cattaneo 路 Luke Hudlass-Galley 路 Douglas Orr 馃敆 |
-
|
PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences ( Poster ) > link | Daiwei Chen 路 Yi Chen 路 Aniket Rege 路 Ramya Korlakai Vinayak 馃敆 |
-
|
Instant Transformer Adaption via HyperLoRA ( Poster ) > link | Rujikorn Charakorn 路 Edoardo Cetin 路 Yujin Tang 路 Robert Lange 馃敆 |
-
|
MMIE: Massive Multimodal Interleaved Comprehension Benchmark for Large Vision-Language Models ( Poster ) > link |
12 presentersPeng Xia 路 Siwei Han 路 Shi Qiu 路 Yiyang Zhou 路 Zhaoyang Wang 路 Wenhao Zheng 路 Zhaorun Chen 路 Chenhang Cui 路 Mingyu Ding 路 Linjie Li 路 Lijuan Wang 路 Huaxiu Yao |
-
|
RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems ( Oral ) > link | Jennifer Hsia 路 Afreen Shaikh 路 Zhiruo Wang 路 Graham Neubig 馃敆 |
-
|
MagicPIG: LSH Sampling for Efficient LLM Generation ( Poster ) > link |
11 presentersZhuoming Chen 路 Ranajoy Sadhukhan 路 Zihao Ye 路 Yang Zhou 路 Jianyu Zhang 路 Niklas S Nolte 路 Yuandong Tian 路 Matthijs Douze 路 Leon Bottou 路 Zhihao Jia 路 Beidi Chen |
-
|
Efficient Domain Adaptation of Robotic Foundation Models via Hypernetwork-Generated LoRA ( Poster ) > link | Zheng Xiong 路 Siddhant Sharma 路 Kang Li 路 Risto Vuorio 路 Shimon Whiteson 馃敆 |
-
|
NegMerge: Consensual Weight Negation for Strong Machine Unlearning ( Poster ) > link | Hyoseo Kim 路 Dongyoon Han 路 Junsuk Choe 馃敆 |
-
|
Controlling Forgetting with Test-Time Data in Continual Learning ( Poster ) > link | Vaibhav Singh 路 Rahaf Aljundi 路 Eugene Belilovsky 馃敆 |
-
|
Efficient Transfer Learning driven by Layer-wise Features Aggregation ( Poster ) > link | Chanwoo Kim 路 Jeyoon Yeom 路 JOOWANG KIM 路 Suho Kang 路 Kyungwoo Song 馃敆 |
-
|
Ensemble-based Offline Reinforcement Learning with Adaptive Behavior Cloning ( Poster ) > link | Danyang Wang 路 Lingsong Zhang 馃敆 |
-
|
Dynamic Subset Tuning: Expanding the Operational Range of Parameter-Efficient Training for Large Language Models ( Poster ) > link | Felix Stahlberg 路 Jared Lichtarge 路 Shankar Kumar 馃敆 |
-
|
MESS+: Energy-Optimal Inferencing in Language Model Zoos with Service Level Guarantees ( Poster ) > link | Ryan Zhang 路 Herbert Woisetschl盲ger 路 Shiqiang Wang 路 Hans Arno Jacobsen 馃敆 |
-
|
Uncertainty-Penalized Direct Preference Optimization ( Poster ) > link | Sam Houliston 路 Aliz茅e Pace 路 Alexander Immer 路 Gunnar R盲tsch 馃敆 |
-
|
Continuous Language Model Interpolation for Dynamic and Controllable Text Generation ( Poster ) > link | Sara Kangaslahti 路 David Alvarez-Melis 馃敆 |
-
|
Long Context RAG Performance of Large Language Models ( Poster ) > link | Quinn Leng 路 Jacob Portes 路 Samuel Havens 路 Matei A Zaharia 路 Michael Carbin 馃敆 |
-
|
Adapting Language Models via Token Alignment ( Poster ) > link | Zhili Feng 路 Tanya Marwah 路 Lester Mackey 路 David Alvarez-Melis 路 Nicolo Fusi 馃敆 |
-
|
Exploring Visual Prompt Tuning for Demographic Adaptation in Foundation Models for Medical Imaging ( Poster ) > link | Artur Parkhimchyk 路 Amirreza Naziri 路 Laleh Seyyed-Kalantari 馃敆 |
-
|
Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts ( Poster ) > link | Nikolas Gritsch 路 Qizhen (Irene) Zhang 路 Acyr Locatelli 路 Sara Hooker 路 Ahmet 脺st眉n 馃敆 |
-
|
Narrow Transformer: Mono-lingual Code SLM for Desktop ( Poster ) > link | Kamalkumar Rathinasamy 路 Balaji J 路 Ankush Kumar 路 Gagan Gayari 路 Harshini K 路 Rajab Mondal 路 Sreenivasa S 路 Swayam Singh 路 Mohammed Rafee Tarafdar 馃敆 |
-
|
Combining Domain and Alignment Vectors to Achieve Better Knowledge-Safety Trade-offs in LLMs ( Poster ) > link | Megh Thakkar 路 Yash More 路 Quentin Fournier 路 Matthew Riemer 路 Pin-Yu Chen 路 Amal Zouaq 路 Payel Das 路 Sarath Chandar 馃敆 |
-
|
N-Gram Induction Heads for In-Context RL: Improving Stability and Reducing Data Needs ( Poster ) > link | Ilya Zisman 路 Alexander Nikulin 路 Andrei Polubarov 路 Nikita Lyubaykin 路 Vladislav Kurenkov 馃敆 |
-
|
In-Context Learning behaves as a greedy layer-wise gradient descent algorithm ( Poster ) > link | Brian Chen 路 Tianyang Hu 路 Hui Jin 路 Hwee Lee 路 Kenji Kawaguchi 馃敆 |
-
|
Dynamically Managing a Prompt Pool via Self-Enhancement in Continual Learning ( Poster ) > link | Hayun Lee 路 Kiseong Hong 路 Hwanhee Lee 路 Sungho Suh 路 Eunwoo Kim 馃敆 |
-
|
DuoDiff: Accelerating Diffusion Models with a Dual-Backbone Approach ( Poster ) > link | Daniel Gallo Fern谩ndez 路 R膬zvan-Andrei Mati葯an 路 Alejandro Monroy 路 Ana Vasilcoiu 路 Janusz Partyka 路 Tin Had啪i Veljkovi膰 路 Metod Jazbec 馃敆 |
-
|
Is In-Context Learning Sufficient for Instruction Following in LLMs? ( Poster ) > link | Hao Zhao 路 Maksym Andriushchenko 路 Francesco Croce 路 Nicolas Flammarion 馃敆 |
-
|
Fully-inductive Node Classification on Arbitrary Graphs ( Poster ) > link | Jianan Zhao 路 Michael Galkin 路 Hesham Mostafa 路 Michael Bronstein 路 Zhaocheng Zhu 路 Jian Tang 馃敆 |
-
|
Visual Language Alignment Tuning ( Poster ) > link | LE ZHANG 路 Qian Yang 路 Aishwarya Agrawal 馃敆 |
-
|
Enhancing Multi-Agent Multi-Modal Collaboration with Fine-Grained Reward Modeling ( Poster ) > link | Qian Yang 路 Weixiang Yan 路 Aishwarya Agrawal 馃敆 |
-
|
Enhancing Reasoning to Adapt Large Language Models for Domain-Specific Applications ( Poster ) > link | Bo Wen 路 Xin Zhang 馃敆 |
-
|
InstructRAG: Instructing Retrieval Augmented Generation via Self-Synthesized Rationales ( Poster ) > link | Zhepei Wei 路 Wei-Lin Chen 路 Yu Meng 馃敆 |
-
|
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging ( Oral ) > link | Joel Jang 路 Seungone Kim 路 Bill Yuchen Lin 路 Yizhong Wang 路 Jack Hessel 路 Luke Zettlemoyer 路 Hannaneh Hajishirzi 路 Yejin Choi 路 Prithviraj Ammanabrolu 馃敆 |
-
|
Towards Conversational AI for Spina Bifida Care ( Poster ) > link | Asfandyar Azhar 路 Shaurjya Mandal 路 Nidhish Shah 馃敆 |
-
|
Informed Tree of Thought: Cost-efficient Problem Solving with Large Language Models ( Poster ) > link | Sajad Mousavi 路 Desik Rengarajan 路 Ashwin Ramesh Babu 路 Sahand Ghorbanpour 路 Vineet Gundecha 路 Avisek Naug 路 Soumyendu Sarkar 馃敆 |
-
|
Efficient Fine-Tuning of Image-Conditional Diffusion Models for Depth and Surface Normal Estimation ( Poster ) > link | Gonzalo Martin Garcia 路 Karim Abou Zeid 路 Christian Schmidt 路 Daan de Geus 路 Alexander Hermans 路 Bastian Leibe 馃敆 |
-
|
LinkGPT: Teaching Large Language Models To Predict Missing Links ( Poster ) > link | Zhongmou He 路 Jing Zhu 路 Shengyi Qian 路 Joyce Chai 路 Danai Koutra 馃敆 |
-
|
Extracting Parallelism from Large Language Model Queries ( Poster ) > link | Steven Kolawole 路 Keshav Santhanam 路 Pratiksha Thaker 路 Virginia Smith 馃敆 |
-
|
PM-Jewelry: Personalized Multimodal Adaptation for Virtual Jewelry Try-On with Latent Diffusion ( Poster ) > link | Yangfan He 路 Yinghui Xia 路 Jinfeng Wei 路 TIANYU SHI 路 Yang Jingsong 馃敆 |
-
|
CTRL-O: Language-Controllable Object-Centric Visual Representation Learning ( Poster ) > link | Aniket Didolkar 路 Andrii Zadaianchuk 路 Rabiul Awal 路 Maximilian Seitzer 路 Efstratios Gavves 路 Aishwarya Agrawal 馃敆 |
-
|
COrAL: Order-Agnostic Language Modeling for Efficient Iterative Refinement ( Poster ) > link | Yuxi Xie 路 Anirudh Goyal 路 Xiaobao Wu 路 Xunjian Yin 路 Xiao Xu 路 Min-Yen Kan 路 Liangming Pan 路 William Yang Wang 馃敆 |
-
|
Do Think Tags Really Help LLMs Plan? A Critical Evaluation of ReAct-Style Prompting ( Poster ) > link | Mudit Verma 路 Siddhant Bhambri 路 Subbarao Kambhampati 馃敆 |
-
|
SpikingVTG: Saliency Feedback Gating Enabled Spiking Video Temporal Grounding ( Poster ) > link | Malyaban Bal 路 Brian Matejek 路 Susmit Jha 路 Adam Cobb 馃敆 |
-
|
Domain Adaptation for Robust Model Routing ( Poster ) > link | Christoph Dann 路 Yishay Mansour 路 Teodor Vanislavov Marinov 路 Mehryar Mohri 馃敆 |
-
|
Automated Design of Agentic Systems ( Poster ) > link | Shengran Hu 路 Cong Lu 路 Jeff Clune 馃敆 |
-
|
Can the Spectrum of the Neural Tangent Kernel Anticipate Fine-Tuning Performance? ( Poster ) > link | Zahra Rahimi Afzal 路 Tara Esmaeilbeig 路 Mojtaba Soltanalian 路 Mesrob I Ohannessian 馃敆 |
-
|
Situated Instruction Following Under Ambiguous Human Intent ( Poster ) > link | So Yeon Min 路 Xavier Puig 路 Devendra Singh Chaplot 路 Tsung-Yen Yang 路 Akshara Rai 路 Priyam Parashar 路 Ruslan Salakhutdinov 路 Yonatan Bisk 路 Roozbeh Mottaghi 馃敆 |
-
|
Better Prompt Compression Without Multi-Layer Perceptrons ( Poster ) > link | Edouardo Honig 路 Andrew Lizarraga 路 Zijun Frank Zhang 路 Ying Nian Wu 馃敆 |
-
|
Effective Text-to-Image Alignment with Quality Aware Pair Ranking ( Poster ) > link | Kunal Singh 路 Mukund Khanna 路 Pradeep Moturi 馃敆 |
-
|
FlashDP: Memory-Efficient and High-Throughput DP-SGD Training for Large Language Models ( Poster ) > link | Liangyu Wang 路 Junxiao Wang 路 Jie Ren 路 Zihang Xiang 路 David Keyes 路 Di Wang 馃敆 |
-
|
GraphText: Graph Reasoning in Text Space ( Poster ) > link | Jianan Zhao 路 Le Zhuo 路 Yikang Shen 路 Meng Qu 路 Kai Liu 路 Michael Bronstein 路 Zhaocheng Zhu 路 Jian Tang 馃敆 |
-
|
Prompt Learning Based Adaptor for Enhanced Video Editing with Pretrained Text-to-Image Diffusion Models ( Poster ) > link | Yangfan He 路 Sida Li 路 Jianhui Wang 馃敆 |
-
|
Efficiently Learning at Test-Time: Active Fine-Tuning of LLMs ( Poster ) > link | Jonas H眉botter 路 Sascha Bongni 路 Ido Hakimi 路 Andreas Krause 馃敆 |
-
|
Understanding Visual Concepts Across Models ( Poster ) > link | Brandon Trabucco 路 Max Gurinas 路 Kyle Doherty 路 Ruslan Salakhutdinov 馃敆 |
-
|
From One to Zero: RAG-IM Adapts Language Models for Interpretable Zero-Shot Clinical Predictions ( Poster ) > link | Sazan Mahbub 路 Caleb Ellington 路 Sina Alinejad 路 Kevin Wen 路 Yingtao Luo 路 Ben Lengerich 路 Eric Xing 馃敆 |
-
|
Pick Your Influencer: Being Selective is Good for Personalization ( Poster ) > link | Ashutosh Ranjan 路 Vivek Srivastava 路 Shirish Karande 馃敆 |
-
|
Warmstarting for scaling language models ( Poster ) > link | Neeratyoy Mallik 路 Maciej Janowski 路 Johannes Hog 路 Herilalaina Rakotoarison 路 Aaron Klein 路 Josif Grabocka 路 Frank Hutter 馃敆 |
-
|
Evaluating RAG System Performance: The Impact of Knowledge Cut-off and Fine-Tuning ( Poster ) > link | Omkar Dige 路 John Willes 路 David B. Emerson 馃敆 |
-
|
Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers ( Poster ) > link | Yingyu Liang 路 Zhenmei Shi 路 Zhao Song 路 Yufa Zhou 馃敆 |
-
|
MD-DiT: Step-aware Mixture-of-Depths for Efficient Diffusion Transformers ( Poster ) > link | Mingzhu Shen 路 pengtao chen 路 Peng Ye 路 Guoxuan Xia 路 Tao Chen 路 Christos Bouganis 路 Yiren Zhao 馃敆 |
-
|
Accelerated Preference Optimization for Large Language Model Alignment ( Poster ) > link | Jiafan He 路 Huizhuo Yuan 路 Quanquan Gu 馃敆 |
-
|
Towards Robust and Cost-Efficient Knowledge Unlearning for Large Language Models ( Poster ) > link | Sungmin Cha 路 Sungjun Cho 路 Dasol Hwang 路 Moontae Lee 馃敆 |
-
|
CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing ( Poster ) > link | Wenhao Zheng 路 Yixiao Chen 路 Weitong Zhang 路 Souvik Kundu 路 Yun Li 路 Zhengzhong Liu 路 Eric Xing 路 Hongyi Wang 路 Huaxiu Yao 馃敆 |