Skip to yearly menu bar Skip to main content


Workshop

Socially Responsible Language Modelling Research (SoLaR)

Usman Anwar ⋅ David Krueger ⋅ Samuel Bowman ⋅ Jakob Foerster ⋅ Su Lin Blodgett ⋅ Roberta Raileanu ⋅ Alan Chan ⋅ Laura Ruis ⋅ Robert Kirk ⋅ Yawen Duan ⋅ Xin Chen ⋅ Kawin Ethayarajh
Project Page

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
11:30 AM
Poster Session
2:00 PM
Universal Jailbreaks
Andy Zou
Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models
Thomas Zollo ⋅ Todd Morrill ⋅ Zhun Deng ⋅ Jake Snell ⋅ Toniann Pitassi ⋅ Richard Zemel
Weakly Supervised Detection of Hallucinations in LLM Activations
Miriam Rateike ⋅ Celia Cintas ⋅ John Wamburu ⋅ Tanya Akumu ⋅ Skyler D. Speakman
Do Personality Tests Generalize to Large Language Models?
Florian E. Dorner ⋅ Tom Sühr ⋅ Samira Samadi ⋅ Augustin Kelava
MoPe: Model Perturbation-based Privacy Attacks on Language Models
Jason Wang ⋅ Jeffrey Wang ⋅ Marvin Li ⋅ Seth Neel
Language Model Detectors Are Easily Optimized Against
Charlotte Nicks ⋅ Eric Mitchell ⋅ Rafael Rafailov ⋅ Archit Sharma ⋅ Christopher D Manning ⋅ Chelsea Finn ⋅ Stefano Ermon
Jailbreaking Language Models at Scale via Persona Modulation
Rusheb Shah ⋅ Quentin Feuillade Montixi ⋅ Soroush Pour ⋅ Arush Tagade ⋅ Javier Rando
FlexModel: A Framework for Interpretability of Distributed Large Language Models
Matthew Choi ⋅ Muhammad Adil Asif ⋅ John Willes ⋅ David B. Emerson
Large Language Model Unlearning
Yuanshun (Kevin) Yao ⋅ Xiaojun Xu ⋅ Yang Liu
FairSISA: Ensemble Post-Processing to Improve Fairness of Unlearning in LLMs
Swanand Kadhe ⋅ Anisa Halimi ⋅ Ambrish Rawat ⋅ Nathalie Baracaldo
Efficient Evaluation of Bias in Large Language Models through Prompt Tuning
Jacob-Junqi Tian ⋅ David B. Emerson ⋅ Deval Pandya ⋅ Laleh Seyyed-Kalantari ⋅ Faiza Khattak
Dissecting Large Language Models
Nicky Pochinkov ⋅ Nandi Schoots
Comparing Optimization Targets for Contrast-Consistent Search
Hugo Fry ⋅ Seamus Fallows ⋅ Jamie Wright ⋅ Ian Fan ⋅ Nandi Schoots
AutoDAN: Automatic and Interpretable Adversarial Attacks on Large Language Models
Sicheng Zhu ⋅ Ruiyi Zhang ⋅ Bang An ⋅ Gang Wu ⋅ Joe Barrow ⋅ Zichao Wang ⋅ Furong Huang ⋅ Ani Nenkova ⋅ Tong Sun
Low-Resource Languages Jailbreak GPT-4
Yong Zheng-Xin ⋅ Cristina Menghini ⋅ Stephen Bach
Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment
Yang Liu ⋅ Yuanshun (Kevin) Yao ⋅ Jean-Francois Ton ⋅ Xiaoying Zhang ⋅ Ruocheng Guo ⋅ Hao Cheng ⋅ Yegor Klochkov ⋅ Muhammad Faaiz Taufiq ⋅ Hang Li
Are Large Language Models Really Robust to Word-Level Perturbations?
Haoyu Wang ⋅ Guozheng Ma ⋅ Cong Yu ⋅ Gui Ning ⋅ Linrui Zhang ⋅ Zhiqi Huang ⋅ Suwei Ma ⋅ Yongzhe Chang ⋅ Sen Zhang ⋅ Li Shen ⋅ Xueqian Wang ⋅ Peilin Zhao ⋅ Dacheng Tao
Eliciting Language Model Behaviors using Reverse Language Models
Jacob Pfau ⋅ Alex Infanger ⋅ Abhay Sheshadri ⋅ Ayush Panda ⋅ Julian Michael ⋅ Curtis Huebner
Controlled Decoding from Language Models
Sidharth Mudgal ⋅ Jong Lee ⋅ Harish Ganapathy ⋅ YaGuang Li ⋅ Tao Wang ⋅ Yanping Huang ⋅ zhifeng Chen ⋅ Heng-Tze Cheng ⋅ Michael Collins ⋅ Jilin Chen ⋅ Alex Beutel ⋅ Ahmad Beirami
Learning Inner Monologue and Its Utilization in Vision-Language Challenges
Diji Yang ⋅ Kezhen Chen ⋅ Jinmeng Rao ⋅ Xiaoyuan Guo ⋅ Yawen Zhang ⋅ Jie Yang ⋅ Yi Zhang
Reinforcement Learning Fine-tuning of Language Models is Biased Towards More Extractable Features
Diogo Cruz ⋅ Edoardo Pona ⋅ Alex Holness-Tofts ⋅ Elias Schmied ⋅ Víctor Abia Alonso ⋅ Charlie J Griffin ⋅ Bogdan-Ionut Cirstea
Probing Explicit and Implicit Gender Bias through LLM Conditional Text Generation
Xiangjue Dong ⋅ Yibo Wang ⋅ Philip S Yu ⋅ James Caverlee
Towards Auditing Large Language Models: Improving Text-based Stereotype Detection
Zekun Wu ⋅ Sahan Bulathwela ⋅ Adriano Koshiyama
Welfare Diplomacy: Benchmarking Language Model Cooperation
Gabe Mukobi ⋅ Hannah Erlebach ⋅ Niklas Lauffer ⋅ Lewis Hammond ⋅ Alan Chan ⋅ Jesse Clifton
A Divide-Conquer-Reasoning Approach to Consistency Evaluation and Improvement in Blackbox Large Language Models
Wendi Cui ⋅ Jiaxin Zhang ⋅ Zhuohang Li ⋅ Damien Lopez ⋅ Kamalika Das ⋅ Bradley Malin ⋅ Sricharan Kumar
Compositional preference models for alignment with scalable oversight
Dongyoung Go ⋅ Tomasz Korbak ⋅ Germán Kruszewski ⋅ Jos Rozen ⋅ Marc Dymetman
Investigating the Fairness of Large Language Models for Predictions on Tabular Data
Yanchen Liu ⋅ Srishti Gautam ⋅ Jiaqi Ma ⋅ Himabindu Lakkaraju
User Inference Attacks on LLMs
Nikhil Kandpal ⋅ Krishna Pillutla ⋅ Alina Oprea ⋅ Peter Kairouz ⋅ Christopher A. Choquette-Choo ⋅ Zheng Xu
Interpretable Stereotype Identification through Reasoning
Jacob-Junqi Tian ⋅ Omkar Dige ⋅ David B. Emerson ⋅ Faiza Khattak
Hazards from Increasingly Accessible Fine-Tuning of Downloadable Foundation Models
Alan Chan ⋅ Benjamin Bucknall ⋅ Herbie Bradley ⋅ David Krueger
Developing A Conceptual Framework for Analyzing People in Unstructured Data
Mark Díaz ⋅ Sunipa Dev ⋅ Emily Reif ⋅ Remi Denton ⋅ Vinodkumar Prabhakaran
Measuring Feature Sparsity in Language Models
Mingyang Deng ⋅ Lucas Tao ⋅ Joe Benton
Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints
Chaoqi Wang ⋅ Yibo Jiang ⋅ Chenghao Yang ⋅ Han Liu ⋅ Yuxin Chen
Social Contract AI: Aligning AI Assistants with Implicit Group Norms
Jan-Philipp Fraenken ⋅ Samuel Kwok ⋅ Peixuan Ye ⋅ Kanishk Gandhi ⋅ Dilip Arumugam ⋅ Jared Moore ⋅ Alex Tamkin ⋅ Tobias Gerstenberg ⋅ Noah Goodman
Evaluating Superhuman Models with Consistency Checks
Lukas Fluri ⋅ Daniel Paleka ⋅ Florian Tramer
Testing Language Model Agents Safely in the Wild
Silen Naihin ⋅ David Atkinson ⋅ Marc Green ⋅ Merwane Hamadi ⋅ Craig Swift ⋅ Douglas Schonholtz ⋅ Adam Tauman Kalai ⋅ David Bau
KoMultiText: Large-Scale Korean Text Dataset for Classifying Biased Speech in Real-World Online Services
Dasol Choi ⋅ Jooyoung Song ⋅ Eunsun Lee ⋅ Seo Jin woo ⋅ HeeJune Park ⋅ Dongbin Na
An International Consortium for AI Risk Evaluations
Ross Gruetzemacher ⋅ Alan Chan ⋅ Štěpán Los ⋅ Kevin Frazier ⋅ Simeon Campos ⋅ Matija Franklin ⋅ José Hernández-Orallo ⋅ James Fox ⋅ Christin Manning ⋅ Philip M Tomei ⋅ Kyle Kilian
Towards Optimal Statistical Watermarking
Baihe Huang ⋅ Banghua Zhu ⋅ Hanlin Zhu ⋅ Jason Lee ⋅ Jiantao Jiao ⋅ Michael Jordan
SuperHF: Supervised Iterative Learning from Human Feedback
Gabe Mukobi ⋅ Peter Chatain ⋅ Su Fong ⋅ Robert Windesheim ⋅ Gitta Kutyniok ⋅ Kush Bhatia ⋅ Silas Alberti
Training Private and Efficient Language Models with Synthetic Data from LLMs
Da Yu ⋅ Arturs Backurs ⋅ Sivakanth Gopi ⋅ Huseyin A. Inan ⋅ Janardhan Kulkarni ⋅ Zinan Lin ⋅ Chulin Xie ⋅ Huishuai Zhang ⋅ Wanrong Zhang
Towards a Situational Awareness Benchmark for LLMs
Rudolf Laine ⋅ Alexander Meinke ⋅ Owain Evans
Risk Assessment and Statistical Significance in the Age of Foundation Models
Apoorva Nitsure ⋅ Youssef Mroueh ⋅ Mattia Rigotti ⋅ Kristjan Greenewald ⋅ Brian Belgodere ⋅ Mikhail Yurochkin ⋅ Jiri Navratil ⋅ Igor Melnyk ⋅ Jarret Ross
An Archival Perspective on Pretraining Data
Meera Desai ⋅ Abigail Jacobs ⋅ Dallas Card
Bayesian low-rank adaptation for large language models
Adam Yang ⋅ Maxime Robeyns ⋅ Xi Wang ⋅ Laurence Aitchison
A collection of principles for guiding and evaluating large language models
Konstantin Hebenstreit ⋅ Robert Praas ⋅ Matthias Samwald
Are Models Biased on Text without Gender-related Language?
Catarina Belém ⋅ Preethi Seshadri ⋅ Yasaman Razeghi ⋅ Sameer Singh
Understanding Hidden Context in Preference Learning: Consequences for RLHF
Anand Siththaranajn ⋅ Cassidy Laidlaw ⋅ Dylan Hadfield-Menell
Subtle Misogyny Detection and Mitigation: An Expert-Annotated Dataset
Anna Richter ⋅ Brooklyn Sheppard ⋅ Allison Cohen ⋅ Elizabeth Smith ⋅ Tamara Kneese ⋅ Carolyne Pelletier ⋅ Ioana Baldini ⋅ Yue Dong
Towards Publicly Accountable Frontier LLMs
Markus Anderljung ⋅ Everett Smith ⋅ Joe O'Brien ⋅ Lisa Soder ⋅ Benjamin Bucknall ⋅ Emma Bluemke ⋅ Jonas Schuett ⋅ Robert Trager ⋅ Lacey Strahm ⋅ Rumman Chowdhury
Successor Heads: Recurring, Interpretable Attention Heads In The Wild
Rhys Gould ⋅ Euan Ong ⋅ George Ogden ⋅ Arthur Conmy
Forbidden Facts: An Investigation of Competing Objectives in Llama 2
Tony Wang ⋅ Miles Wang ⋅ Kaivalya Hariharan ⋅ Nir Shavit