Timezone: »

Recurrent Ladder Networks
Isabeau PrĂ©mont-Schwarz · Alexander Ilin · Tele Hao · Antti Rasmus · Rinu Boney · Harri Valpola

Tue Dec 05 06:30 PM -- 10:30 PM (PST) @ Pacific Ballroom #111 #None

We propose a recurrent extension of the Ladder networks whose structure is motivated by the inference required in hierarchical latent variable models. We demonstrate that the recurrent Ladder is able to handle a wide variety of complex learning tasks that benefit from iterative inference and temporal modeling. The architecture shows close-to-optimal results on temporal modeling of video data, competitive results on music modeling, and improved perceptual grouping based on higher order abstractions, such as stochastic textures and motion cues. We present results for fully supervised, semi-supervised, and unsupervised tasks. The results suggest that the proposed architecture and principles are powerful tools for learning a hierarchy of abstractions, learning iterative inference and handling temporal information.

Author Information

Isabeau Prémont-Schwarz (Element AI)
Alexander Ilin (Aalto University)
Hotloo Hao (The Curious AI Company)
Antti Rasmus
Rinu Boney
Harri Valpola (The Curious AI Company)

More from the Same Authors