Timezone: »
Poster
Semi-supervised Learning with Ladder Networks
Antti Rasmus · Mathias Berglund · Mikko Honkala · Harri Valpola · Tapani Raiko
We combine supervised learning with unsupervised learning in deep neural networks. The proposed model is trained to simultaneously minimize the sum of supervised and unsupervised cost functions by backpropagation, avoiding the need for layer-wise pre-training. Our work builds on top of the Ladder network proposed by Valpola (2015) which we extend by combining the model with supervision. We show that the resulting model reaches state-of-the-art performance in semi-supervised MNIST and CIFAR-10 classification in addition to permutation-invariant MNIST classification with all labels.
Author Information
Antti Rasmus (The Curious AI Company)
Mathias Berglund (Aalto University)
Mikko Honkala (Nokia Labs)
Harri Valpola (The Curious AI Company)
Tapani Raiko (Aalto University, The Curious AI Company)
More from the Same Authors
-
2019 Poster: Regularizing Trajectory Optimization with Denoising Autoencoders »
Rinu Boney · Norman Di Palo · Mathias Berglund · Alexander Ilin · Juho Kannala · Antti Rasmus · Harri Valpola -
2018 : TBC 5 »
Harri Valpola -
2017 Poster: Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results »
Antti Tarvainen · Harri Valpola -
2017 Poster: Recurrent Ladder Networks »
Isabeau Prémont-Schwarz · Alexander Ilin · Tele Hao · Antti Rasmus · Rinu Boney · Harri Valpola -
2017 Spotlight: Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results »
Antti Tarvainen · Harri Valpola -
2016 Poster: Tagger: Deep Unsupervised Perceptual Grouping »
Klaus Greff · Antti Rasmus · Mathias Berglund · Hotloo Xiranood · Harri Valpola · Jürgen Schmidhuber -
2015 Poster: Bidirectional Recurrent Neural Networks as Generative Models »
Mathias Berglund · Tapani Raiko · Mikko Honkala · Leo Kärkkäinen · Akos Vetek · Juha T Karhunen -
2014 Poster: Iterative Neural Autoregressive Distribution Estimator NADE-k »
Tapani Raiko · Yao Li · Kyunghyun Cho · Yoshua Bengio