Workshop
System-2 Reasoning at Scale
Shikhar Murty 路 Federico Bianchi 路 R贸bert Csord谩s 路 Nouha Dziri 路 Alex Gu 路 Shunyu Yao 路 Christopher D Manning 路 Yejin Choi
Sun 15 Dec, 8:55 a.m. PST
Our workshop focuses on improving reasoning in neural networks, particularly the challenges and strategies for achieving System-2 reasoning in transformer-like models. The workshop addresses issues like distinguishing memorization from rule-based learning, understanding, syntactic generalization, and compositionality. The workshop also covers the importance of understanding how systematic models are in their decisions for AI safety, integrating neural networks with symbolic reasoning, and developing new architectures for enhanced reasoning capabilities. We have (tentatively) confirmed a distinguished group of speakers and panelists who are some of the most influential figures in recent literature on reasoning. Considering how important these topics are today and our distinguished lineup of speakers, we expect \textbf{more than 500 participants to the workshop}.
Schedule
Sun 9:00 a.m. - 9:15 a.m.
|
Poster setup
|
馃敆 |
Sun 9:15 a.m. - 9:20 a.m.
|
Opening Remarks
SlidesLive Video |
Nouha Dziri 路 Alex Gu 路 R贸bert Csord谩s 馃敆 |
Sun 9:20 a.m. - 9:30 a.m.
|
Lightning Talk: softmax is not enough (for sharp out-of-distribution)
link
SlidesLive Video |
馃敆 |
Sun 9:30 a.m. - 9:40 a.m.
|
Lightning Talk: Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
link
SlidesLive Video |
馃敆 |
Sun 9:40 a.m. - 9:50 a.m.
|
Lightning Talk: System 1.5: Designing Metacognition in Artificial Intelligence
link
SlidesLive Video |
馃敆 |
Sun 9:50 a.m. - 10:00 a.m.
|
Lightning Talk: Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning
link
SlidesLive Video |
馃敆 |
Sun 10:00 a.m. - 10:35 a.m.
|
Keynote: Josh Tenenbaum
SlidesLive Video |
Josh Tenenbaum 馃敆 |
Sun 10:35 a.m. - 10:55 a.m.
|
Coffee Break and Poster Session
|
馃敆 |
Sun 10:55 a.m. - 11:30 a.m.
|
Keynote: Melanie Mitchell: On Understanding and Abstraction in Humans and AI Systems
SlidesLive Video |
Melanie Mitchell 馃敆 |
Sun 11:30 a.m. - 1:00 p.m.
|
Poster Session
|
馃敆 |
Sun 1:00 p.m. - 2:00 p.m.
|
Lunch Break
|
馃敆 |
Sun 2:00 p.m. - 2:35 p.m.
|
Keynote: Jason Weston: Self-Training Methods for System 2 Reasoning
SlidesLive Video |
Jason Weston 馃敆 |
Sun 2:35 p.m. - 2:45 p.m.
|
Invited Talk: Basis
SlidesLive Video |
Zenna Tavares 路 Kevin Ellis 馃敆 |
Sun 2:45 p.m. - 3:00 p.m.
|
Break and Poster Session
|
馃敆 |
Sun 3:00 p.m. - 3:35 p.m.
|
Keynote: Fran莽ois Chollet: ARC Prize 2024: What we learned
SlidesLive Video |
Francois Chollet 馃敆 |
Sun 3:35 p.m. - 5:00 p.m.
|
Panel DIscussion
SlidesLive Video |
Dzmitry Bahdanau 路 Jason Weston 路 Josh Tenenbaum 路 Francois Chollet 路 Melanie Mitchell 馃敆 |
Sun 5:00 p.m. - 5:30 p.m.
|
Poster Session and Social
|
馃敆 |
-
|
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations ( Poster ) > link | Paul Soulos 路 Henry Conklin 路 Mattia Opper 路 Paul Smolensky 路 Jianfeng Gao 路 Roland Fernandez 馃敆 |
-
|
Interpretable Concept Bottlenecks to Align Reinforcement Learning Agents ( Poster ) > link | Quentin Delfosse 路 Sebastian Sztwiertnia 路 Mark Rothermel 路 Wolfgang Stammer 路 Kristian Kersting 馃敆 |
-
|
From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMs ( Poster ) > link | Alireza Rezazadeh 路 Zichao Li 路 Wei Wei 路 Yujia Bao 馃敆 |
-
|
Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus ( Poster ) > link | Terufumi Morishita 路 Gaku Morio 路 Atsuki Yamaguchi 路 Yasuhiro Sogawa 馃敆 |
-
|
Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning ( Poster ) > link | Yuxi Xie 路 Anirudh Goyal 路 Wenyue Zheng 路 Min-Yen Kan 路 Timothy Lillicrap 路 Kenji Kawaguchi 路 Michael Qizhe Shieh 馃敆 |
-
|
ALTA: Compiler-Based Analysis of Transformers ( Poster ) > link | Peter Shaw 路 James Cohan 路 Jacob Eisenstein 路 Kenton Lee 路 Jonathan Berant 路 Kristina N Toutanova 馃敆 |
-
|
Improving LLM Generation with Inverse and Forward Alignment: Reward Modeling, Prompting, Fine-Tuning, and Inference-Time Optimization ( Poster ) > link | Hao Sun 路 Thomas Pouplin 路 Nicol谩s Astorga 路 Tennison Liu 路 Mihaela van der Schaar 馃敆 |
-
|
MovieCORE: COgnitive REasoning in Movies ( Poster ) > link | Gueter Josmy Faure 路 Min-Hung Chen 路 Jia-Fong Yeh 路 Ying Cheng 路 Hung-Ting Su 路 Shang-Hong Lai 路 Winston Hsu 馃敆 |
-
|
Thinking Fast and Laterally: Multi-Agentic Approach for Reasoning about Uncertain Emerging Events ( Poster ) > link | Stefan Dernbach 路 Alejandro Michel 路 Khushbu Agarwal 路 Christopher Brissette 路 geetika gupta 路 Sutanay Choudhury 馃敆 |
-
|
Equitable Access to Justice: Logical LLMs Show Promise ( Poster ) > link | Manuj Kant 路 Marzieh Nabi 路 Manav Kant 路 Preston Carlson 路 Megan Ma 馃敆 |
-
|
CryptoFormalEval: Integrating Large Language Models and Formal Verification for Automated Cryptographic Protocol Vulnerability Detection ( Poster ) > link | Cristian Curaba 路 D'Ambrosi Denis 路 Alessandro Minisini 馃敆 |
-
|
Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning ( Poster ) > link | Mingde Zhao 路 Safa Alver 路 Harm Seijen 路 Romain Laroche 路 Doina Precup 路 Yoshua Bengio 馃敆 |
-
|
Reasoning Abilities of Large Language Models through the Lens of Abstraction and Reasoning ( Poster ) > link | Seungpil Lee 路 Woochang Sim 路 Donghyeon Shin 路 Sejin Kim 路 Sundong Kim 馃敆 |
-
|
Proof Flow: Preliminary Study on Generative Flow Network Language Model Tuning for Formal Reasoning ( Poster ) > link | Matthew Ho 路 Vincent Zhu 路 Xiaoyin Chen 路 Moksh Jain 路 Nikolay Malkin 路 Edwin Zhang 馃敆 |
-
|
System-2 Reasoning via Generality and Adaptation ( Poster ) > link | Sejin Kim 路 Sundong Kim 馃敆 |
-
|
Can Language Models Perform Implicit Bayesian Inference Over User Preference States? ( Poster ) > link | Linlu Qiu 路 Fei Sha 路 Kelsey Allen 路 Yoon Kim 路 Tal Linzen 路 Sjoerd van Steenkiste 馃敆 |
-
|
Not All LLM Reasoners Are Created Equal ( Poster ) > link | Arian Hosseini 路 Alessandro Sordoni 路 Daniel Toyama 路 Aaron Courville 路 Rishabh Agarwal 馃敆 |
-
|
Generative Verifiers: Reward Modeling as Next-Token Prediction ( Poster ) > link | Lunjun Zhang 路 Arian Hosseini 路 Hritik Bansal 路 Mehran Kazemi 路 Aviral Kumar 路 Rishabh Agarwal 馃敆 |
-
|
System 2 Reasoning Capabilities Are Nigh ( Poster ) > link | Scott C. Lowe 馃敆 |
-
|
The Turing Game ( Poster ) > link | Michal Lewandowski 路 Simon Schmid 路 Patrick Mederitsch 路 Alexander Aufreiter 路 Gregor Aichinger 路 Felix Nessler 路 Severin Bergsmann 路 Viktor Szolga 路 Tobias Halmdienst 路 Bernhard Nessler 馃敆 |
-
|
Distilling System 2 into System 1 ( Poster ) > link | Ping Yu 路 Jing Xu 路 Jason Weston 路 Ilia Kulikov 馃敆 |
-
|
Algorithmic Language Models with Neurally Compiled Libraries ( Poster ) > link | Lucas Saldyt 路 Subbarao Kambhampati 馃敆 |
-
|
CausalBench: A Comprehensive Benchmark for Evaluating Causal Reasoning Capabilities of Large Language Models ( Poster ) > link | ZEYU WANG 馃敆 |
-
|
System 1.5: Designing Metacognition in Artificial Intelligence ( Poster ) > link | Nick Oh 路 Fernand Gobet 馃敆 |
-
|
LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraints ( Poster ) > link | Thomas Palmeira Ferraz 路 Kartik Mehta 路 Yu-Hsiang Lin 路 Haw-Shiuan Chang 路 Shereen Oraby 路 Sijia Liu 路 Vivek Subramanian 路 Tagyoung Chung 路 Mohit Bansal 路 Nanyun Peng 馃敆 |
-
|
PROOF OF THOUGHT : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning ( Poster ) > link | Debargha Ganguly 路 Srinivasan Iyengar 路 Vipin Chaudhary 路 Shivkumar Kalyanaraman 馃敆 |
-
|
Rational Metareasoning for Large Language Models ( Poster ) > link | Camillo Nicol貌 De Sabbata 路 Ted Sumers 路 Tom Griffiths 馃敆 |
-
|
Sampling Language from Latent System 2 Reasoning ( Poster ) > link | Celine Lee 路 Md Arafat Sultan 路 Tahira Naseem 路 Alexander Rush 路 Ram贸n Astudillo 馃敆 |
-
|
MemReasoner: A Memory-augmented LLM Architecture for Multi-hop Reasoning ( Poster ) > link | Ching-Yun Ko 路 Sihui Dai 路 Payel Das 路 Georgios Kollias 路 Subhajit Chaudhury 路 Aurelie Lozano 馃敆 |
-
|
World Models for Web Agents ( Poster ) > link | Hyungjoo Chae 路 Namyoung Kim 路 Minju Gwak 路 Gwanwoo Song 路 Jihoon Kim 路 Kai Ong 路 Seonghwan Kim 路 Dongha Lee 路 Jinyoung Yeo 馃敆 |
-
|
Recursive Decomposition with Dependencies for Generic Divide-and-Conquer Reasoning ( Poster ) > link | Sergio Hern谩ndez-Guti茅rrez 路 Minttu Alakuijala 路 Alexander Nikitin 路 Pekka Marttinen 馃敆 |
-
|
STaR: Benchmarking Spatio-Temporal Reasoning for Systematic Generalization ( Poster ) > link | Muhammad Irtaza Khalid 路 Steven Schockaert 馃敆 |
-
|
Horizon-Length Prediction: Advancing Fill-in-the-Middle Capabilities for Code Generation with Lookahead Planning ( Poster ) > link | Yifeng Ding 路 Hantian Ding 路 Shiqi Wang 路 Qing Sun 路 Varun Kumar 路 Zijian Wang 馃敆 |
-
|
Automated Design of Agentic Systems ( Poster ) > link | Shengran Hu 路 Cong Lu 路 Jeff Clune 馃敆 |
-
|
Logically Consistent Language Models via Neuro-Symbolic Integration ( Poster ) > link | Diego Calanzone 路 Stefano Teso 路 Antonio Vergari 馃敆 |
-
|
LLMs on interactive feature collections with implicit look-ahead strategies ( Poster ) > link | Juyeon Heo 路 Vihari Piratla 路 Kyunghyun Lee 路 Hyonkeun Joh 路 Adrian Weller 馃敆 |
-
|
softmax is not enough (for sharp out-of-distribution) ( Poster ) > link | Petar Veli膷kovi膰 路 Christos Perivolaropoulos 路 Federico Barbero 路 Razvan Pascanu 馃敆 |
-
|
Diverse capability and scaling of diffusion and auto-regressive models when learning abstract rules ( Poster ) > link | Binxu Wang 路 Jiaqi Shang 路 Haim Sompolinsky 馃敆 |
-
|
Can Stories Help LLMs Reason? Curating Information Space Through Narrative ( Poster ) > link | Vahid Sadiri Javadi 路 Johanne Trippas 路 Lucie Flek 馃敆 |
-
|
Your Context Is Not an Array: Unveiling Random Access Limitations in Transformers ( Poster ) > link | Reza Ebrahimi 路 Sunny Panchal 路 Roland Memisevic 馃敆 |
-
|
A Llama Sunk My Battleship! Asking Rational Questions with LLMs via Bayesian Inference ( Poster ) > link | Gabriel Grand 路 Valerio Pepe 路 Jacob Andreas 路 Josh Tenenbaum 馃敆 |
-
|
Implicit Reasoning in Deep Time Series Forecasting ( Poster ) > link | Willa Potosnak 路 Cristian Challu 路 Mononito Goswami 路 Michal Wilinski 路 Nina 呕ukowska 路 Artur Dubrawski 馃敆 |
-
|
Thought of Search: Planning with Language Models Through The Lens of Efficiency ( Poster ) > link | Michael Katz 路 Harsha Kokel 路 Kavitha Srinivas 路 Shirin Sohrabi Araghi 馃敆 |
-
|
Planning in Natural Language Improves LLM Search for Code Generation ( Poster ) > link | Evan Wang 路 Federico Cassano 路 Catherine Wu 路 Yunfeng Bai 路 William Song 路 Vaskar Nath 路 Ziwen Han 路 Sean Hendryx 路 Summer Yue 路 Hugh Zhang 馃敆 |
-
|
Doing Experiments and Revising Rules with Natural Language and Probabilistic Reasoning ( Poster ) > link | Top Piriyakulkij 路 Cassidy Langenfeld 路 Tuan Anh Le 路 Kevin Ellis 馃敆 |
-
|
Recurrent Transformers Trade-off Parallelism for Length Generalization on Regular Languages ( Poster ) > link | Paul Soulos 路 Aleksandar Terzic 路 Michael Hersche 路 Abbas Rahimi 馃敆 |
-
|
VCR: Visual Caption Restoration ( Poster ) > link | Tianyu Zhang 路 Suyuchen Wang 路 Lu Li 路 Ge Zhang 路 Perouz Taslakian 路 Sai Rajeswar Mudumba 路 Jie Fu 路 Bang Liu 路 Yoshua Bengio 馃敆 |
-
|
Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs ( Poster ) > link | Siyuan Wang 路 zhongyu wei 路 Yejin Choi 路 Xiang Ren 馃敆 |
-
|
Bongard in Wonderland: Visual Puzzles that Still Make AI Go Mad? ( Poster ) > link | Antonia W眉st 路 Tim Nelson Tobiasch 路 Lukas Helff 路 Devendra S Dhami 路 Constantin Rothkopf 路 Kristian Kersting 馃敆 |
-
|
Diffusion On Syntax Trees For Program Synthesis ( Poster ) > link | Shreyas Kapur 路 Erik Jenner 路 Stuart J Russell 馃敆 |