Workshop

Fri 9:15

Carsten Binnig - Pre-trained Models for Learned DBMS Components
Carsten Binnig

Workshop

Deep Climate Change: A Dataset and Adaptive domain pre-trained Language Models for Climate Change Related Tasks
Saeid Vaghefi · Veruska Muccione · Christian Huggel · Hamed Khashehchi · Markus Leippold

Workshop

CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text
Babak Jalalzadeh Fard · Sadid A. Hasan · Jesse E. Bell

Workshop

Gradient Knowledge Distillation for Pre-trained Language Models
Lean Wang · Lei Li · Xu Sun

Workshop

Fri 12:59

Gradient Knowledge Distillation for Pre-trained Language Models
Lean Wang · Lei Li · Xu Sun

Poster

PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining
Yuting Gao · Jinfeng Liu · Zihan Xu · Jun Zhang · Ke Li · Rongrong Ji · Chunhua Shen

Workshop

Adaptive Pre-training of Language Models for Better Logical Reasoning
Soumya Sanyal · Yichong Xu · Shuohang Wang · Ziyi Yang · Reid Pryzant · Wenhao Yu · Chenguang Zhu · Xiang Ren

Affinity Workshop

Detecting gender bias in pre-trained language models for zero-shot text classification
Nile Dixon

Poster

Thu 9:00

Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Models
Zijian Zhang · Zhou Zhao · Zhijie Lin

Workshop

Efficient Speech Translation with Pre-trained models
Zhaolin Li · Jan Niehues

Poster

Wed 9:00

Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptively
Haojie Zhang · Ge Li · Jia Li · Zhongjin Zhang · YUQI ZHU · Zhi Jin

Workshop

Gaussian Process Thompson sampling for Bayesian optimization of dynamic masking-based language model pre-training
Iñigo Urteaga · Moulay Zaidane Draidia · Tomer Lancewicki · Shahram Khadivi