Timezone: »
There is a growing interest in learning data representations that work well for many different types of problems and data. In this paper, we look in particular at the task of learning a single visual representation that can be successfully utilized in the analysis of very different types of images, from dog breeds to stop signs and digits. Inspired by recent work on learning networks that predict the parameters of another, we develop a tunable deep network architecture that, by means of adapter residual modules, can be steered on the fly to diverse visual domains. Our method achieves a high degree of parameter sharing while maintaining or even improving the accuracy of domain-specific representations. We also introduce the Visual Decathlon Challenge, a benchmark that evaluates the ability of representations to capture simultaneously ten very different visual domains and measures their ability to recognize well uniformly.
Author Information
Sylvestre-Alvise Rebuffi (University of Oxford)
Hakan Bilen (University of Edinburgh)
Andrea Vedaldi (Facebook AI Research and University of Oxford)
Related Events (a corresponding poster, oral, or spotlight)
-
2017 Spotlight: Learning multiple visual domains with residual adapters »
Thu. Dec 7th 01:20 -- 01:25 AM Room Hall A
More from the Same Authors
-
2021 : A fine-grained analysis of robustness to distribution shifts »
Olivia Wiles · Sven Gowal · Florian Stimberg · Sylvestre-Alvise Rebuffi · Ira Ktena · Krishnamurthy Dvijotham · Taylan Cemgil -
2022 : Direct LiDAR-based object detector training from automated 2D detections »
Robert McCraith · Eldar Insafutdinov · Lukas Neumann · Andrea Vedaldi -
2022 Spotlight: Lightning Talks 2A-3 »
David Buterez · Chengan He · Xuan Kan · Yutong Lin · Konstantin Schürholt · Yu Yang · Louis Annabi · Wei Dai · Xiaotian Cheng · Alexandre Pitti · Ze Liu · Jon Paul Janet · Jun Saito · Boris Knyazev · Mathias Quoy · Zheng Zhang · James Zachary · Steven J Kiddle · Xavier Giro-i-Nieto · Chang Liu · Hejie Cui · Zilong Zhang · Hakan Bilen · Damian Borth · Dino Oglic · Holly Rushmeier · Han Hu · Xiangyang Ji · Yi Zhou · Nanning Zheng · Ying Guo · Pietro Liò · Stephen Lin · Carl Yang · Yue Cao -
2022 Spotlight: Distilling Representations from GAN Generator via Squeeze and Span »
Yu Yang · Xiaotian Cheng · Chang Liu · Hakan Bilen · Xiangyang Ji -
2022 : Synthesizing Informative Training Samples with GAN »
Bo Zhao · Hakan Bilen -
2022 Poster: Unsupervised Multi-Object Segmentation by Predicting Probable Motion Patterns »
Laurynas Karazija · Subhabrata Choudhury · Iro Laina · Christian Rupprecht · Andrea Vedaldi -
2022 Poster: Distilling Representations from GAN Generator via Squeeze and Span »
Yu Yang · Xiaotian Cheng · Chang Liu · Hakan Bilen · Xiangyang Ji -
2021 Poster: Data Augmentation Can Improve Robustness »
Sylvestre-Alvise Rebuffi · Sven Gowal · Dan Andrei Calian · Florian Stimberg · Olivia Wiles · Timothy A Mann -
2021 Poster: Improving Robustness using Generated Data »
Sven Gowal · Sylvestre-Alvise Rebuffi · Olivia Wiles · Florian Stimberg · Dan Andrei Calian · Timothy A Mann -
2020 Poster: Quantifying Learnability and Describability of Visual Concepts Emerging in Representation Learning »
Iro Laina · Ruth Fong · Andrea Vedaldi -
2020 Poster: RELATE: Physically Plausible Multi-Object Scene Synthesis Using Structured Latent Spaces »
Sebastien Ehrhardt · Oliver Groth · Aron Monszpart · Martin Engelcke · Ingmar Posner · Niloy Mitra · Andrea Vedaldi -
2019 Poster: Fixing the train-test resolution discrepancy »
Hugo Touvron · Andrea Vedaldi · Matthijs Douze · Herve Jegou -
2018 Poster: Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks »
Jie Hu · Li Shen · Samuel Albanie · Gang Sun · Andrea Vedaldi -
2018 Poster: Modelling and unsupervised learning of symmetric deformable object categories »
James Thewlis · Hakan Bilen · Andrea Vedaldi -
2018 Poster: Unsupervised Learning of Object Landmarks through Conditional Image Generation »
Tomas Jakab · Ankush Gupta · Hakan Bilen · Andrea Vedaldi -
2017 Workshop: Interpreting, Explaining and Visualizing Deep Learning - Now what ? »
Klaus-Robert Müller · Andrea Vedaldi · Lars K Hansen · Wojciech Samek · Grégoire Montavon -
2017 Poster: Unsupervised learning of object frames by dense equivariant image labelling »
James Thewlis · Hakan Bilen · Andrea Vedaldi -
2017 Oral: Unsupervised learning of object frames by dense equivariant image labelling »
James Thewlis · Hakan Bilen · Andrea Vedaldi -
2016 Poster: Learning feed-forward one-shot learners »
Luca Bertinetto · João Henriques · Jack Valmadre · Philip Torr · Andrea Vedaldi -
2016 Poster: Integrated perception with recurrent multi-task neural networks »
Hakan Bilen · Andrea Vedaldi -
2013 Poster: Deep Fisher Networks for Large-Scale Image Classification »
Karen Simonyan · Andrea Vedaldi · Andrew Zisserman -
2013 Spotlight: Deep Fisher Networks for Large-Scale Image Classification »
Karen Simonyan · Andrea Vedaldi · Andrew Zisserman -
2011 Poster: Pylon Model for Semantic Segmentation »
Victor Lempitsky · Andrea Vedaldi · Andrew Zisserman -
2010 Poster: Simultaneous Object Detection and Ranking with Weak Supervision »
Matthew B Blaschko · Andrea Vedaldi · Andrew Zisserman -
2009 Poster: Structured output regression for detection with partial truncation »
Andrea Vedaldi · Andrew Zisserman -
2006 Poster: A Rate-Distortion Approach to Joint Pattern Alignment »
Andrea Vedaldi