Timezone: »
One-shot learning is usually tackled by using generative models or discriminative embeddings. Discriminative methods based on deep learning, which are very effective in other learning scenarios, are ill-suited for one-shot learning as they need large amounts of training data. In this paper, we propose a method to learn the parameters of a deep model in one shot. We construct the learner as a second deep network, called a learnet, which predicts the parameters of a pupil network from a single exemplar. In this manner we obtain an efficient feed-forward one-shot learner, trained end-to-end by minimizing a one-shot classification objective in a learning to learn formulation. In order to make the construction feasible, we propose a number of factorizations of the parameters of the pupil network. We demonstrate encouraging results by learning characters from single exemplars in Omniglot, and by tracking visual objects from a single initial exemplar in the Visual Object Tracking benchmark.
Author Information
Luca Bertinetto (University of Oxford)
Luca Bertinetto is a PhD candidate in the Torr Vision Group at the University of Oxford. The main focus of his doctorate is the problem of agnostic object tracking, which he likes to tackle using simple and effective approaches. Before getting lost among the spires of Oxford, he obtained a joint MSc in Computer Engineering between the Polytechnic University of Turin and Telecom Paris Tech. He has published at CVPR and NIPS and reviewed for PAMI.
João Henriques (University of Oxford)
Jack Valmadre (University of Oxford)
Philip Torr (Oxford University)
Andrea Vedaldi (Facebook AI Research and University of Oxford)
More from the Same Authors
-
2022 : Direct LiDAR-based object detector training from automated 2D detections »
Robert McCraith · Eldar Insafutdinov · Lukas Neumann · Andrea Vedaldi -
2022 Poster: Hierarchical classification at multiple operating points »
Jack Valmadre -
2022 Poster: Learn what matters: cross-domain imitation learning with task-relevant embeddings »
Tim Franzmeyer · Philip Torr · João Henriques -
2022 Poster: Unsupervised Multi-Object Segmentation by Predicting Probable Motion Patterns »
Laurynas Karazija · Subhabrata Choudhury · Iro Laina · Christian Rupprecht · Andrea Vedaldi -
2021 Workshop: The pre-registration workshop: an alternative publication model for machine learning research »
Samuel Albanie · João Henriques · Luca Bertinetto · Alex Hernandez-Garcia · Hazel Doughty · Gul Varol -
2021 Poster: Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers »
Mandela Patrick · Dylan Campbell · Yuki Asano · Ishan Misra · Florian Metze · Christoph Feichtenhofer · Andrea Vedaldi · João Henriques -
2021 Poster: Do Different Tracking Tasks Require Different Appearance Models? »
Zhongdao Wang · Hengshuang Zhao · Ya-Li Li · Shengjin Wang · Philip Torr · Luca Bertinetto -
2021 Oral: Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers »
Mandela Patrick · Dylan Campbell · Yuki Asano · Ishan Misra · Florian Metze · Christoph Feichtenhofer · Andrea Vedaldi · João Henriques -
2021 Poster: On Episodes, Prototypical Networks, and Few-Shot Learning »
Steinar Laenen · Luca Bertinetto -
2020 Workshop: The pre-registration experiment: an alternative publication model for machine learning research »
Luca Bertinetto · João Henriques · Samuel Albanie · Michela Paganini · Gul Varol -
2020 Poster: Quantifying Learnability and Describability of Visual Concepts Emerging in Representation Learning »
Iro Laina · Ruth Fong · Andrea Vedaldi -
2020 Poster: RELATE: Physically Plausible Multi-Object Scene Synthesis Using Structured Latent Spaces »
Sebastien Ehrhardt · Oliver Groth · Aron Monszpart · Martin Engelcke · Ingmar Posner · Niloy Mitra · Andrea Vedaldi -
2019 Poster: Fixing the train-test resolution discrepancy »
Hugo Touvron · Andrea Vedaldi · Matthijs Douze · Herve Jegou -
2018 Poster: Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks »
Jie Hu · Li Shen · Samuel Albanie · Gang Sun · Andrea Vedaldi -
2018 Poster: Modelling and unsupervised learning of symmetric deformable object categories »
James Thewlis · Hakan Bilen · Andrea Vedaldi -
2018 Poster: Unsupervised Learning of Object Landmarks through Conditional Image Generation »
Tomas Jakab · Ankush Gupta · Hakan Bilen · Andrea Vedaldi -
2017 Workshop: Interpreting, Explaining and Visualizing Deep Learning - Now what ? »
Klaus-Robert Müller · Andrea Vedaldi · Lars K Hansen · Wojciech Samek · Grégoire Montavon -
2017 Poster: Learning multiple visual domains with residual adapters »
Sylvestre-Alvise Rebuffi · Hakan Bilen · Andrea Vedaldi -
2017 Spotlight: Learning multiple visual domains with residual adapters »
Sylvestre-Alvise Rebuffi · Hakan Bilen · Andrea Vedaldi -
2017 Poster: Unsupervised learning of object frames by dense equivariant image labelling »
James Thewlis · Hakan Bilen · Andrea Vedaldi -
2017 Oral: Unsupervised learning of object frames by dense equivariant image labelling »
James Thewlis · Hakan Bilen · Andrea Vedaldi -
2016 Poster: Adaptive Neural Compilation »
Rudy Bunel · Alban Desmaison · Pawan K Mudigonda · Pushmeet Kohli · Philip Torr -
2016 Poster: Integrated perception with recurrent multi-task neural networks »
Hakan Bilen · Andrea Vedaldi -
2014 Poster: Fast Training of Pose Detectors in the Fourier Domain »
João Henriques · Pedro Martins · Rui F Caseiro · Jorge Batista -
2013 Poster: Deep Fisher Networks for Large-Scale Image Classification »
Karen Simonyan · Andrea Vedaldi · Andrew Zisserman -
2013 Spotlight: Deep Fisher Networks for Large-Scale Image Classification »
Karen Simonyan · Andrea Vedaldi · Andrew Zisserman -
2011 Poster: Learning Anchor Planes for Classification »
Ziming Zhang · Lubor Ladicky · Philip Torr · Amir Saffari -
2011 Demonstration: Online structured-output learning for real-time object tracking and detection »
Sam Hare · Amir Saffari · Philip Torr -
2011 Poster: Pylon Model for Semantic Segmentation »
Victor Lempitsky · Andrea Vedaldi · Andrew Zisserman -
2010 Poster: Simultaneous Object Detection and Ranking with Weak Supervision »
Matthew B Blaschko · Andrea Vedaldi · Andrew Zisserman -
2009 Poster: Structured output regression for detection with partial truncation »
Andrea Vedaldi · Andrew Zisserman -
2008 Poster: Improved Moves for Truncated Convex Models »
Pawan K Mudigonda · Philip Torr -
2008 Spotlight: Improved Moves for Truncated Convex Models »
Pawan K Mudigonda · Philip Torr -
2007 Oral: An Analysis of Convex Relaxations for MAP Estimation »
Pawan K Mudigonda · Vladimir Kolmogorov · Philip Torr -
2007 Poster: An Analysis of Convex Relaxations for MAP Estimation »
Pawan K Mudigonda · Vladimir Kolmogorov · Philip Torr -
2006 Poster: A Rate-Distortion Approach to Joint Pattern Alignment »
Andrea Vedaldi