Skip to yearly menu bar Skip to main content


Workshop

Pluralistic Alignment Workshop

Mikhail Terekhov ⋅ Moksh Jain ⋅ Ruyuan Wan ⋅ Maarten Sap ⋅ Mitchell Gordon ⋅ Dongyeop Kang ⋅ Caglar Gulcehre ⋅ Amy Zhang ⋅ He He
Project Page [ OpenReview] 

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
9:00 AM
Opening Remarks
9:55 AM
Keynote Talk: Hannah Rose Kirk
Hannah Rose Kirk
10:40 AM
Poster Session
11:40 AM
Keynote Talk: Yejin Choi
Yejin Choi
12:25 PM
Lunch Break
1:30 PM
Keynote Talk: Seth Lazar
Seth Lazar
2:15 PM
Keynote Talk: Melanie Mitchell
Melanie Mitchell
3:00 PM
Coffee Break
4:45 PM
Keynote Talk: Michael Bernstein
Michael Bernstein
Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning
Sriyash Poddar ⋅ Yanming Wan ⋅ Hamish Ivison ⋅ Abhishek Gupta ⋅ Natasha Jaques
Virtual Personas for Language Models via an Anthology of Backstories
Suhong Moon ⋅ Marwa Abdulhai ⋅ Minwoo Kang ⋅ Joseph Suh ⋅ Widyadewi Soedarmadji ⋅ Eran Kohen Behar ⋅ David Chan
Pareto-Optimal Learning from Preferences with Hidden Context
Ryan Boldi ⋅ Li Ding ⋅ Lee Spector ⋅ Scott Niekum
Efficacy of the SAGE-RT Dataset for Model Safety Alignment: A Comparative Study
Tanay Baswa ⋅ Nitin Aravind Birur ⋅ Divyanshu Kumar ⋅ Jatan Loya ⋅ Anurakt Kumar ⋅ Prashanth Harshangi ⋅ Sahil Agarwal
Multilingual Trolley Problems for Language Models
Zhijing Jin ⋅ Sydney Levine ⋅ Max Kleiman-Weiner ⋅ Giorgio Piatti ⋅ Jiarui Liu ⋅ Fernando Gonzalez Adauto ⋅ Francesco Ortu ⋅ András Strausz ⋅ Mrinmaya Sachan ⋅ Rada Mihalcea ⋅ Yejin Choi ⋅ Bernhard Schölkopf
Conditioned Language Policy: A General Framework For Steerable Multi-Objective Finetuning
Kaiwen Wang ⋅ Rahul Kidambi ⋅ Ryan Sullivan ⋅ Alekh Agarwal ⋅ Christoph Dann ⋅ Andrea Michi ⋅ Marco Gelmi ⋅ Yunxuan Li ⋅ Raghav Gupta ⋅ Kumar Avinava Dubey ⋅ Alexandre Rame ⋅ Johan Ferret ⋅ Geoffrey Cideron ⋅ Le Hou ⋅ Hongkun Yu ⋅ Amr Ahmed ⋅ Aranyak Mehta ⋅ Leonard Hussenot ⋅ Olivier Bachem ⋅ Edouard Leurent
Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference under Ambiguities
Zheyuan Zhang ⋅ Fengyuan Hu ⋅ Jayjun Lee ⋅ Freda Shi ⋅ Parisa Kordjamshidi ⋅ Joyce Chai ⋅ Ziqiao Ma
Mallows-DPO: Fine-Tune Your LLM with Preference Dispersions
Haoxian Chen ⋅ HANYANG ZHAO ⋅ Henry Lam ⋅ David Yao ⋅ Wenpin Tang
MID-Space: Aligning Diverse Communities' Needs to Inclusive Public Spaces
Shravan Nayak ⋅ Rashid Mushkani ⋅ Hugo Berard ⋅ Allison Cohen ⋅ Shin Koseki ⋅ Hadrien Bertrand
Model Plurality: A Taxonomy for Pluralistic AI
Christina Lu ⋅ Max Van Kleek
Mechanism Design for LLM Fine-tuning with Multiple Reward Models
Haoran Sun ⋅ Yurong Chen ⋅ Siwei Wang ⋅ Wei Chen ⋅ Xiaotie Deng
Multi-objective Reinforcement Learning: A Tool for Pluralistic Alignment
Peter Vamplew ⋅ Conor Hayes ⋅ Cameron Foale ⋅ Richard Dazeley ⋅ Hadassah Harland
Value-Aligned Imitation via focused Satisficing
Rushit Shah ⋅ Nikolaos Agadakos ⋅ Synthia Sasulski ⋅ Ali Farajzadeh ⋅ Sanjiban Choudhury ⋅ Brian Ziebart
Democracy Levels for AI
Aviv Ovadya ⋅ Luke Thorburn ⋅ Kyle Redman ⋅ Manon Revel ⋅ Flynn Devine ⋅ Atoosa Kasirzadeh ⋅ Smitha Milli ⋅ Andrew Konya
Intuitions of Compromise: Utilitarianism vs. Contractualism
Jared Moore ⋅ Yejin Choi ⋅ Sydney Levine
Learning from Personal Preferences
Kelly Jiang ⋅ Berk Ustun ⋅ Jessica Hullman
AI, Pluralism, and (Social) Compensation
Nandhini Swaminathan ⋅ David Danks
PersonalLLM: Tailoring LLMs to Individual Preferences
Thomas Zollo ⋅ Andrew Siah ⋅ Naimeng Ye ⋅ Ang Li ⋅ Hongseok Namkoong
PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences
Daiwei Chen ⋅ Yi Chen ⋅ Aniket Rege ⋅ Ramya Korlakai Vinayak
A Case Study in Plural Governance Design
Joel Miller ⋅ Christopher Kanich ⋅ Glen Weyl
RLDF: Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs
Ruoxi Cheng ⋅ Haoxuan Ma ⋅ Shuirong Cao ⋅ Jiaqi Li ⋅ Aihua Pei ⋅ Zhiqiang wang ⋅ Pengliang Ji ⋅ Haoyu Wang ⋅ Jiaqi Huo
Plurals: A system for pluralistic AI via simulated social ensembles
Joshua Ashkinaze ⋅ Eric Gilbert ⋅ Ceren Budak
Bottom-Up and Top-Down Analysis of Values, Agendas, and Observations in Corpora and LLMs
Scott Friedman ⋅ Noam Benkler ⋅ Drisana Mosaphir ⋅ Jeffrey Rye ⋅ Sonja Schmer-Galunder ⋅ Micah Goldwater ⋅ Matthew McLure ⋅ Ruta Wheelock ⋅ Jeremy Gottlieb ⋅ Robert Goldman ⋅ Christopher Miller
Chain of Alignment
Andrew Konya ⋅ Aviv Ovadya ⋅ K. J. Kevin Feng ⋅ Quan Ze Chen ⋅ Lisa Schirch ⋅ Colin Irwin ⋅ Amy Zhang
Being Considerate as a Pathway to Pluralist Alignment
Parand A. Alamdari ⋅ Toryn Klassen ⋅ Rodrigo Toro Icarte ⋅ Sheila McIlraith
Adaptive Alignment: Dynamic Preference Adjustments via Multi-Objective Reinforcement Learning for Pluralistic AI
Hadassah Harland ⋅ Richard Dazeley ⋅ Peter Vamplew ⋅ Hashini Senaratne ⋅ Bahareh nakisa ⋅ Francisco Cruz
Group Robust Best-of-K Decoding of Language Models for Pluralistic Alignment
Anja Petrovic ⋅ Seongho Son ⋅ William Bankes ⋅ Xiaohang Tang ⋅ Shyam Sundhar Ramesh ⋅ Sangwoong Yoon ⋅ Ilija Bogunovic
"There are no solutions, only trade-offs.'' Taking A Closer Look At Safety Data Annotations.
Elle Michelle Yang ⋅ Matthias Gallé ⋅ Seraphina Goldfarb-Tarrant
Value Alignment from Unstructured Text
Inkit Padhi ⋅ Karthikeyan Natesan Ramamurthy ⋅ Prasanna Sattigeri ⋅ Manish Nagireddy ⋅ Pierre Dognin ⋅ Kush Varshney
Critique-out-Loud Reward Models
Zachary Ankner ⋅ Mansheej Paul ⋅ Brandon Cui ⋅ Jonathan Chang ⋅ Prithviraj Ammanabrolu
Controllable Safety Alignment: Adapting LLMs to Diverse Safety Requirements without Re-Training
Jingyu Zhang ⋅ Ahmed Elgohary Ghoneim ⋅ Ahmed Magooda ⋅ Daniel Khashabi ⋅ Ben Van Durme
Pluralistic Alignment Over Time
Toryn Klassen ⋅ Parand A. Alamdari ⋅ Sheila McIlraith
Bridging in Social Media Feeds Censors Controversial Topics
Smitha Milli ⋅ Luke Thorburn ⋅ Paul Bouchaud ⋅ Yixin Wang ⋅ Nikhil Garg ⋅ Emma Pierson
Are Large Language Models Consistent over Value-laden Questions?
Jared Moore ⋅ Tanvi Deshpande ⋅ Diyi Yang
Selective Preference Aggregation
Shreyas Kadekodi ⋅ Hayden McTavish ⋅ Berk Ustun
FairPlay: A Collaborative Approach to Mitigate Bias in Datasets for Improved AI Fairness
Tina Behzad ⋅ Mithilesh Kumar Singh ⋅ Anthony Ripa ⋅ Klaus Mueller
Policy Aggregation
Parand A. Alamdari ⋅ Soroush Ebadian ⋅ Ariel Procaccia
Evaluating the Prompt Steerability of Large Language Models
Erik Miehling ⋅ Michael Desmond ⋅ Karthikeyan Natesan Ramamurthy ⋅ Elizabeth Daly ⋅ Pierre Dognin ⋅ Jesus Rios ⋅ Djallel Bouneffouf ⋅ Miao Liu
AGR: Age Group fairness Reward for Bias Mitigation in LLMs
Shuirong Cao ⋅ Ruoxi Cheng ⋅ Zhiqiang wang
Diverging Preferences: Why do Annotators Sensibly Disagree?
Michael Zhang ⋅ Zhilin Wang ⋅ Jena Hwang ⋅ Yi Dong ⋅ Olivier Delalleau ⋅ Yejin Choi ⋅ Eunsol Choi ⋅ Xiang Ren ⋅ Valentina Pyatkin
Aligning to Thousands of Varying Preferences via System Message Generalization
Seongyun Lee ⋅ Sue Hyun Park ⋅ Seungone Kim ⋅ Minjoon Seo
Trustworthy Human-AI Interaction Through Agreement Protocols
Natalie Collina ⋅ Surbhi Goel ⋅ Varun Gupta ⋅ Aaron Roth