Timezone: »

 
Shifts Challenge: Robustness and Uncertainty under Real-World Distributional Shift + Q&A
Andrey Malinin · Neil Band · German Chesnokov · Yarin Gal · Alexander Ganshin · Mark Gales · Alexey Noskov · Liudmila Prokhorenkova · Mariya Shmatova · Vyas Raina · Vatsal Raina · Panagiotis Tigas · Boris Yangel

Tue Dec 07 10:25 AM -- 10:45 AM (PST) @
in Competition Track Day 1: Overviews + Breakout Sessions »
Event URL: https://research.yandex.com/shifts »

Mismatch between training and deployment data, known as distributional shift, adversely impacts ML models and is ubiquitous in real, industrial applications. In this competition the contestants’ goal is to develop models which are both robust to distributional shift and can detect it via uncertainty estimation. The broad aim of this competition is to raise awareness of the issue and stimulate the community to work on tasks and modalities taken from large-scale industrial applications. Thus, we provide the "Shifts Dataset" - a new, large dataset of genuine `in the wild' examples of distributional shift from weather prediction, machine translation, and vehicle motion prediction. Each task represents a particular data-modality and is uniquely challenging. Each task will have an associated competition track with prizes for top contestants.

Author Information

Andrey Malinin (Yandex Research)
Neil Band (University of Oxford)
German Chesnokov (Yandex Self-Driving Group)
Yarin Gal (University of Oxford)
Alexander Ganshin (Yandex)
Mark Gales (University of Cambridge)
Alexey Noskov (Yandex)
Liudmila Prokhorenkova (Yandex)
Mariya Shmatova (Yandex)
Vyas Raina (University of Cambridge)
Vatsal Raina (University of Cambridge)
Panagiotis Tigas (University of Oxford)
Boris Yangel (Yandex)

More from the Same Authors