Workshop
Causality and Large Models
Felix Leeb 路 Ching Lam Choi 路 Luigi Gresele 路 Josef Valvoda 路 Andrei Nicolicioiu 路 Xiusi Li 路 Patrik Reizinger 路 Sophie Xhonneux 路 Haoxuan Li 路 Mengyue Yang 路 Bernhard Sch枚lkopf 路 Dhanya Sridhar
East Exhibition Hall C
Sat 14 Dec, 8:45 a.m. PST
Our workshop aims to explore the synergies between causality and large models, also known as foundation models,'' which have demonstrated remarkable capabilities across multiple modalities (text, images, audio, etc.). Despite their high performance, the opaque nature of these large models raises crucial questions regarding their trustworthiness, especially in safety-critical domains. A growing community of researchers is turning towards a more principled framework to address these concerns, better understand the behavior of large models, and improve their reliability: causality.Specifically, this workshop will focus on four directions: causality in large models, to assess their causal reasoning abilities, causality for improving large models, causality with large models to enhance causal inference and discovery methods, and causality of large models to understand and control their internal mechanisms. The invited speakers and panelists (almost all of which have already been confirmed to attend) represent a diverse set of perspectives and expertise, across both academia and industry.The workshop is organized by a team of 12 members from six different institutions across North America, Europe, and Asia, ensuring diversity across research interests, backgrounds, and demographics. Visit our website: https://calm-workshop-2024.github.io/
Schedule
Sat 8:45 a.m. - 9:00 a.m.
|
Opening Remarks
(
Intro
)
>
SlidesLive Video |
馃敆 |
Sat 9:00 a.m. - 9:30 a.m.
|
Teaching causal reasoning to language models
(
Invited Talk
)
>
SlidesLive Video |
Amit Sharma 馃敆 |
Sat 9:30 a.m. - 10:00 a.m.
|
Causal reasoning in foundation agents
(
Invited Talk
)
>
SlidesLive Video |
Jane Wang 馃敆 |
Sat 10:30 a.m. - 11:00 a.m.
|
Towards Causal Artificial Intelligence
(
Invited Talk
)
>
SlidesLive Video |
Elias Bareinboim 馃敆 |
Sat 11:00 a.m. - 11:15 a.m.
|
From Causal to Concept-Based Representation Learning
(
Oral
)
>
link
SlidesLive Video |
Goutham Rajendran 路 Simon Buchholz 路 Bryon Aragam 路 Bernhard Sch枚lkopf 路 Pradeep Ravikumar 馃敆 |
Sat 11:15 a.m. - 11:30 a.m.
|
Causal Order: The Key to Leveraging Imperfect Experts in Causal Inference
(
Oral
)
>
link
SlidesLive Video |
Aniket Vashishtha 路 Abbavaram Gowtham Reddy 路 Abhinav Kumar 路 Saketh Bachu 路 Vineeth N Balasubramanian 路 Amit Sharma 馃敆 |
Sat 11:30 a.m. - 12:00 p.m.
|
Poster Session 1
(
Poster Session
)
>
|
馃敆 |
Sat 1:30 p.m. - 2:00 p.m.
|
Musings on the Linear Representation Hypothesis
(
Invited Talk
)
>
SlidesLive Video |
Victor Veitch 馃敆 |
Sat 2:00 p.m. - 2:15 p.m.
|
Using Relational and Causality Context for Tasks with Specialized Vocabularies that are Challenging for LLMs
(
Oral
)
>
link
SlidesLive Video |
Ryosuke Nakanishi 路 Yan-Ying Chen 路 Francine Chen 路 Matt Klenk 路 Charlene C. Wu 馃敆 |
Sat 2:15 p.m. - 2:30 p.m.
|
Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias
(
Oral
)
>
link
SlidesLive Video |
Yuen Chen 路 Vethavikashini Chithrra Raghuram 路 Justus Mattern 路 Rada Mihalcea 路 Zhijing Jin 馃敆 |
Sat 2:30 p.m. - 3:00 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
馃敆 |
Sat 3:30 p.m. - 4:00 p.m.
|
Hypothesis testing the circuit hypothesis in LLMs
(
Invited Talk
)
>
SlidesLive Video |
Claudia shi 馃敆 |
Sat 4:00 p.m. - 4:30 p.m.
|
Causal thinking in humans and machines
(
Invited Talk
)
>
SlidesLive Video |
Tobias Gerstenberg 馃敆 |
Sat 4:30 p.m. - 5:30 p.m.
|
Panel Discussion
(
Panel Discussion
)
>
SlidesLive Video |
Atticus Geiger 路 Chelsea Finn 路 Zhijing Jin 路 Giambattista Parascandolo 路 Maria Antoniak 路 Elias Bareinboim 馃敆 |
-
|
Causal Reasoning in Large Language Models: A Knowledge Graph Approach ( Poster ) > link | Yejin Kim 路 Eojin Kang 路 Juae Kim 路 H. Howie Huang 馃敆 |
-
|
CausalGraph2LLM: Evaluating LLMs for Causal Queries ( Poster ) > link | Ivaxi Sheth 路 Bahare Fatemi 路 Mario Fritz 馃敆 |
-
|
Teaching Transformers Causal Reasoning through Axiomatic Training ( Poster ) > link | Aniket Vashishtha 路 Abhinav Kumar 路 Atharva Pandey 路 Abbavaram Gowtham Reddy 路 Vineeth N Balasubramanian 路 Amit Sharma 馃敆 |
-
|
Reasoning with a Few Good Cross-Questions Greatly Enhances Causal Event Attribution in LLMs ( Poster ) > link | Sanyam Saxena 路 Sunita Sarawagi 馃敆 |
-
|
From Correlation to Causation: Understanding Climate Change through ML and LLM Inquiries ( Poster ) > link | Shan Shan 馃敆 |
-
|
Using Relational and Causality Context for Tasks with Specialized Vocabularies that are Challenging for LLMs ( Poster ) > link | Ryosuke Nakanishi 路 Yan-Ying Chen 路 Francine Chen 路 Matt Klenk 路 Charlene C. Wu 馃敆 |
-
|
Evaluating Interventional Reasoning Capabilities of Large Language Models ( Poster ) > link | Tejas Kasetty 路 Divyat Mahajan 路 Gintare Karolina Dziugaite 路 Alexandre Drouin 路 Dhanya Sridhar 馃敆 |
-
|
Counterfactual Causal Inference in Natural Language with Large Language Models ( Poster ) > link | Ga毛l Gendron 路 Jo啪e Ro啪anec 路 Michael Witbrock 路 Gillian Dobbie 馃敆 |
-
|
On Incorporating Prior Knowledge Extracted from Pre-trained Language Models into Causal Discovery ( Poster ) > link |
14 presentersChanhui Lee 路 Juhyeon Kim 路 YongJun Jeong 路 Yoonseok Yeom 路 Juhyun Lyu 路 Jung-Hee Kim 路 Sangmin Lee 路 Sangjun Han 路 Hyeokjun Choe 路 Soyeon Park 路 Woohyung Lim 路 Kyunghoon Bae 路 Sungbin Lim 路 Sanghack Lee |
-
|
Hypothesizing Missing Causal Variables with LLMs ( Poster ) > link | Ivaxi Sheth 路 Sahar Abdelnabi 路 Mario Fritz 馃敆 |
-
|
CausalBench: A Comprehensive Benchmark for Evaluating Causal Reasoning Capabilities of Large Language Models ( Poster ) > link | ZEYU WANG 馃敆 |
-
|
Competence-Based Analysis of Language Models ( Poster ) > link | Adam Davies 路 Jize Jiang 路 Cheng Xiang Zhai 馃敆 |
-
|
On LLM Augmented AB Experimentation ( Poster ) > link | Shiv Shankar 路 Ritwik Sinha 路 Madalina Fiterau 馃敆 |
-
|
Can large language models reason about causal relationships in multimodal time series data? ( Poster ) > link | Elizabeth Healey 路 Isaac S Kohane 馃敆 |
-
|
Are UFOs Driving Innovation? The Illusion of Causality in Large Language Models ( Poster ) > link | Maria Vcitoria Carro 路 Francisca Selasco 路 Denise Alejandra Mester 路 Mario Leiva 馃敆 |
-
|
Interactive Semantic Interventions for VLMs: A Causality-Inspired Investigation of VLM Failures ( Poster ) > link | Lukas Klein 路 Kenza Amara 路 Carsten L眉th 路 Hendrik Strobelt 路 Mennatallah El-Assady 路 Paul Jaeger 馃敆 |
-
|
Estimating Effects of Tokens in Preference Learning ( Poster ) > link | Hsiao-Ru Pan 路 Maximilian Mordig 路 Bernhard Sch枚lkopf 馃敆 |
-
|
Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias ( Poster ) > link | Yuen Chen 路 Vethavikashini Chithrra Raghuram 路 Justus Mattern 路 Rada Mihalcea 路 Zhijing Jin 馃敆 |
-
|
Counterfactual Token Generation in Large Language Models ( Poster ) > link | Ivi Chatzi 路 Nina Corvelo Benz 路 Eleni Straitouri 路 Stratis Tsirtsis 路 Manuel Rodriguez 馃敆 |
-
|
Causal World Representation in the GPT Model ( Poster ) > link | Raanan Rohekar 路 Yaniv Gurwicz 路 Sungduk Yu 路 VASUDEV LAL 馃敆 |
-
|
CausalQuest: Collecting Natural Causal Questions for AI Agents ( Poster ) > link | Roberto Ceraolo 路 Dmitrii Kharlapenko 路 Am茅lie Reymond 路 Rada Mihalcea 路 Bernhard Sch枚lkopf 路 Mrinmaya Sachan 路 Zhijing Jin 馃敆 |
-
|
A Causal Perspective in Brainwave Foundation Models ( Poster ) > link | Konstantinos Barmpas 路 Yannis Panagakis 路 Dimitrios Adamos 路 N Laskaris 路 Stefanos Zafeiriou 馃敆 |
-
|
From Causal to Concept-Based Representation Learning ( Poster ) > link | Goutham Rajendran 路 Simon Buchholz 路 Bryon Aragam 路 Bernhard Sch枚lkopf 路 Pradeep Ravikumar 馃敆 |
-
|
Investigating Causal Reasoning in Large Language Models ( Poster ) > link | Atul Rawal 路 Raglin 路 Qianlong Wang 路 Ziying Tang 馃敆 |
-
|
Leveraging LLM-Generated Structural Prior for Causal Inference with Concurrent Causes ( Poster ) > link | Xingjian Zhang 路 Shixuan Liu 路 Yixin Wang 路 Qiaozhu Mei 馃敆 |
-
|
Causal Interventions on Causal Paths: Mapping GPT-2's Reasoning From Syntax to Semantics ( Poster ) > link | Isabelle Lee 路 Joshua Lum 路 Ziyi Liu 路 Dani Yogatama 馃敆 |
-
|
CodeSCM: Causal Analysis for Multi-Modal Code Generation ( Poster ) > link | Mukur Gupta 路 Noopur Bhatt 路 Suman Jana 馃敆 |
-
|
Are Police Biased? An NLP Approach ( Poster ) > link | Jonathan Choi 馃敆 |
-
|
Causal Order: The Key to Leveraging Imperfect Experts in Causal Inference ( Poster ) > link | Aniket Vashishtha 路 Abbavaram Gowtham Reddy 路 Abhinav Kumar 路 Saketh Bachu 路 Vineeth N Balasubramanian 路 Amit Sharma 馃敆 |
-
|
LLM-initialized Differentiable Causal Discovery ( Poster ) > link | Shiv Kampani 路 David Hidary 路 Constantijn van der Poel 路 Martin Ganahl 路 Brenda Miao 馃敆 |