Timezone: »

 
Poster
On Contrastive Representations of Stochastic Processes
Emile Mathieu · Adam Foster · Yee Teh

Fri Dec 10 08:30 AM -- 10:00 AM (PST) @
in Poster Session 8 »

Learning representations of stochastic processes is an emerging problem in machine learning with applications from meta-learning to physical object models to time series. Typical methods rely on exact reconstruction of observations, but this approach breaks down as observations become high-dimensional or noise distributions become complex. To address this, we propose a unifying framework for learning contrastive representations of stochastic processes (CReSP) that does away with exact reconstruction. We dissect potential use cases for stochastic process representations, and propose methods that accommodate each. Empirically, we show that our methods are effective for learning representations of periodic functions, 3D objects and dynamical processes. Our methods tolerate noisy high-dimensional observations better than traditional approaches, and the learned representations transfer to a range of downstream tasks.

Keywords: Machine Learning · Meta Learning · Contrastive Learning · Representation Learning

Author Information

Emile Mathieu (University of Oxford)
Adam Foster (Microsoft Research Cambridge)
Yee Teh (DeepMind)

More from the Same Authors