( events)   Timezone: »  
Tue Dec 14 05:20 AM -- 02:15 PM (PST)
Cooperative AI
Natasha Jaques · Edward Hughes · Jakob Foerster · Noam Brown · Kalesha Bullard · Charlotte Smith

The human ability to cooperate in a wide range of contexts is a key ingredient in the success of our species. Problems of cooperation—in which agents seek ways to jointly improve their welfare—are ubiquitous and important. They can be found at every scale, from the daily routines of highway driving, communicating in shared language and work collaborations, to the global challenges of climate change, pandemic preparedness and international trade. With AI agents playing an ever greater role in our lives, we must endow them with similar abilities. In particular they must understand the behaviors of others, find common ground by which to communicate with them, make credible commitments, and establish institutions which promote cooperative behavior. By construction, the goal of Cooperative AI is interdisciplinary in nature. Therefore, our workshop will bring together scholars from diverse backgrounds including reinforcement learning (and inverse RL), multi-agent systems, human-AI interaction, game theory, mechanism design, social choice, fairness, cognitive science, language learning, and interpretability. This year we will organize the workshop along two axes. First, we will discuss how to incentivize cooperation in AI systems, developing algorithms that can act effectively in general-sum settings, and which encourage others to cooperate. The second focus is on how to implement effective coordination, given that cooperation is already incentivized. For example, we may examine zero-shot coordination, in which AI agents need to coordinate with novel partners at test time. This setting is highly relevant to human-AI coordination, and provides a stepping stone for the community towards full Cooperative AI.

Welcome and Opening Remarks
Invited Talk: Bo An (Nanyang Technological University) on Learning to Coordinate in Complex Environments (Invited Talk)
Invited Talk: Michael Muthukrishna (London School of Economics) on Cultural Evolution and Human Cooperation (Invited Talk)
Invited Talk: Pablo Castro (Google Brain) on Estimating Policy Functions in Payment Systems using Reinforcement Learning (Invited Talk)
(Live) Q&A with Invited Speaker (Bo An) (Live Q&A)
(Live) Q&A with Invited Speaker (Michael Muthukrishna) (Live Q&A)
(Live) Q&A with Invited Speaker (Pablo Castro) (Live Q&A)
Invited Talk: Ariel Procaccia (Harvard University) on Democracy and the Pursuit of Randomness (Invited Talk)
Invited Talk: Dorsa Sadigh (Stanford University) on The Role of Conventions in Adaptive Human-AI Interaction (Invited Talk)
(Live) Invited Talk: Nika Haghtalab (UC Berkeley) on Collaborative Machine Learning: Training and Incentives ((Live) Invited Talk)
(Live) Q&A with Invited Speaker (Ariel Procaccia) (Live Q&A)
(Live) Q&A with Invited Speaker (Dorsa Sadigh) (Live Q&A)
(Live) Q&A with Invited Speaker (Nika Haghtalab) (Live Q&A)
Workshop Poster Session 1 (hosted in GatherTown) (Poster Sessions (GatherTown))
Workshop Poster Session 2 (hosted in GatherTown) (Poster Sessions (GatherTown))
(Live) Panel Discussion: Cooperative AI (Panel Discussion)
Spotlight Talk: Interactive Inverse Reinforcement Learning for Cooperative Games (Spotlight Talk)
Spotlight Talk: Learning to solve complex tasks by growing knowledge culturally across generations (Spotlight Talk)
Spotlight Talk: On the Approximation of Cooperative Heterogeneous Multi-Agent Reinforcement Learning (MARL) using Mean Field Control (MFC) (Spotlight Talk)
Spotlight Talk: Public Information Representation for Adversarial Team Games (Spotlight Talk)
Closing Remarks