Timezone: »
A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to pre-train a neural network with unlabeled data, followed by fine-tuning for a downstream task with limited annotations. Contrastive learning, a particular variant of SSL, is a powerful technique for learning image-level representations. In this work, we propose strategies for extending the contrastive learning framework for segmentation of volumetric medical images in the semi-supervised setting with limited annotations, by leveraging domain-specific and problem-specific cues. Specifically, we propose (1) novel contrasting strategies that leverage structural similarity across volumetric medical images (domain-specific cue) and (2) a local version of the contrastive loss to learn distinctive representations of local regions that are useful for per-pixel segmentation (problem-specific cue). We carry out an extensive evaluation on three Magnetic Resonance Imaging (MRI) datasets. In the limited annotation setting, the proposed method yields substantial improvements compared to other self-supervision and semi-supervised learning techniques. When combined with a simple data augmentation technique, the proposed method reaches within 8\% of benchmark performance using only two labeled MRI volumes for training. The code is made public at https://github.com/krishnabits001/domain_specific_cl.
Author Information
Krishna Chaitanya (ETH Zurich)
Ertunc Erdil (ETH Zurich)
Neerav Karani (ETH Zurich)
Ender Konukoglu (ETH Zurich)
Related Events (a corresponding poster, oral, or spotlight)
-
2020 Oral: Contrastive learning of global and local features for medical image segmentation with limited annotations »
Thu. Dec 10th 02:00 -- 02:15 PM Room Orals & Spotlights: Unsupervised/Probabilistic
More from the Same Authors
-
2021 Poster: Constrained Optimization to Train Neural Networks on Critical and Under-Represented Classes »
Sara Sangalli · Ertunc Erdil · Andeas Hötker · Olivio Donati · Ender Konukoglu -
2020 Workshop: Medical Imaging Meets NeurIPS »
Jonas Teuwen · Qi Dou · Ben Glocker · Ipek Oguz · Aasa Feragen · Hervé Lombaert · Ender Konukoglu · Marleen de Bruijne -
2019 Workshop: Medical Imaging meets NeurIPS »
Hervé Lombaert · Ben Glocker · Ender Konukoglu · Marleen de Bruijne · Aasa Feragen · Ipek Oguz · Jonas Teuwen -
2019 : Opening Remarks »
Hervé Lombaert · Ben Glocker · Ender Konukoglu · Marleen de Bruijne · Aasa Feragen · Ipek Oguz · Jonas Teuwen -
2018 : Closing remarks »
Ender Konukoglu · Ben Glocker · Hervé Lombaert · Marleen de Bruijne -
2018 : Welcome »
Ender Konukoglu · Ben Glocker · Hervé Lombaert · Marleen de Bruijne -
2018 Workshop: Medical Imaging meets NIPS »
Ender Konukoglu · Ben Glocker · Hervé Lombaert · Marleen de Bruijne -
2017 : Closing »
Ben Glocker · Ender Konukoglu · Hervé Lombaert · Kanwal Bhatia -
2017 : Poster session - Afternoon »
Yongchan Kwon · Young-geun Kim · Ender Konukoglu · Peter Li · John Guibas · Tejpal Virdi · Kuldeep Kumar · Morteza Mardani · Jelmer Wolterink · Enhao Gong · Natalia Antropova · Johannes Stelzer · Rene Bidart · Wei-Hung Weng · Martin Rajchl · Marc Górriz · Vineeta Singh · Christopher Sandino · Hiba Chougrad · Bob Hu · Isaac Godfried · Ke Xiao · Heliodoro Tejeda Lemus · Jordan Harrod · ILSANG WOO · Vincent Chen · Joseph Cheng · Vikash Gupta · Chuck-Hou Yee · Ben Glocker · Hervé Lombaert · Maximilian Ilse · Aneta Lisowska · Andrew Doyle · Milad Mckie -
2017 : Poster session - Morning »
Yongchan Kwon · Young-geun Kim · Ender Konukoglu · Peter Li · John Guibas · Tejpal Virdi · Kuldeep Kumar · Morteza Mardani · Jelmer Wolterink · Enhao Gong · Natalia Antropova · Johannes Stelzer · Rene Bidart · Wei-Hung Weng · Martin Rajchl · Marc Górriz · Vineeta Singh · Christopher Sandino · Hiba Chougrad · Bob Hu · Isaac Godfried · Ke Xiao · Heliodoro Tejeda Lemus · Jordan Harrod · ILSANG WOO · Vincent Chen · Joseph Cheng · Vikash Gupta · Chuck-Hou Yee · Ben Glocker · Hervé Lombaert · Maximilian Ilse · Aneta Lisowska · Andrew Doyle · Milad Mckie -
2017 : Opening »
Ben Glocker · Ender Konukoglu · Hervé Lombaert · Kanwal Bhatia -
2017 Workshop: Medical Imaging meets NIPS »
Ben Glocker · Ender Konukoglu · Hervé Lombaert · Kanwal Bhatia -
2017 : Poster Session »
Shunsuke Horii · Heejin Jeong · Tobias Schwedes · Qing He · Ben Calderhead · Ertunc Erdil · Jaan Altosaar · Patrick Muchmore · Rajiv Khanna · Ian Gemp · Pengfei Zhang · Yuan Zhou · Chris Cremer · Maria DeYoreo · Alexander Terenin · Brendan McVeigh · Rachit Singh · Yaodong Yang · Erik Bodin · Trefor Evans · Henry Chai · Shandian Zhe · Jeffrey Ling · Vincent ADAM · Lars Maaløe · Andrew Miller · Ari Pakman · Josip Djolonga · Hong Ge