Timezone: »

 
Poster
Contrastive learning of global and local features for medical image segmentation with limited annotations
Krishna Chaitanya · Ertunc Erdil · Neerav Karani · Ender Konukoglu

Thu Dec 10 09:00 AM -- 11:00 AM (PST) @ Poster Session 5 #1693

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to pre-train a neural network with unlabeled data, followed by fine-tuning for a downstream task with limited annotations. Contrastive learning, a particular variant of SSL, is a powerful technique for learning image-level representations. In this work, we propose strategies for extending the contrastive learning framework for segmentation of volumetric medical images in the semi-supervised setting with limited annotations, by leveraging domain-specific and problem-specific cues. Specifically, we propose (1) novel contrasting strategies that leverage structural similarity across volumetric medical images (domain-specific cue) and (2) a local version of the contrastive loss to learn distinctive representations of local regions that are useful for per-pixel segmentation (problem-specific cue). We carry out an extensive evaluation on three Magnetic Resonance Imaging (MRI) datasets. In the limited annotation setting, the proposed method yields substantial improvements compared to other self-supervision and semi-supervised learning techniques. When combined with a simple data augmentation technique, the proposed method reaches within 8\% of benchmark performance using only two labeled MRI volumes for training. The code is made public at https://github.com/krishnabits001/domain_specific_cl.

Author Information

Krishna Chaitanya (ETH Zurich)
Ertunc Erdil (ETH Zurich)
Neerav Karani (ETH Zurich)
Ender Konukoglu (ETH Zurich)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors

  • 2021 Poster: Constrained Optimization to Train Neural Networks on Critical and Under-Represented Classes »
    Sara Sangalli · Ertunc Erdil · Andeas Hötker · Olivio Donati · Ender Konukoglu
  • 2020 Workshop: Medical Imaging Meets NeurIPS »
    Jonas Teuwen · Qi Dou · Ben Glocker · Ipek Oguz · Aasa Feragen · Hervé Lombaert · Ender Konukoglu · Marleen de Bruijne
  • 2019 Workshop: Medical Imaging meets NeurIPS »
    Hervé Lombaert · Ben Glocker · Ender Konukoglu · Marleen de Bruijne · Aasa Feragen · Ipek Oguz · Jonas Teuwen
  • 2019 : Opening Remarks »
    Hervé Lombaert · Ben Glocker · Ender Konukoglu · Marleen de Bruijne · Aasa Feragen · Ipek Oguz · Jonas Teuwen
  • 2018 : Closing remarks »
    Ender Konukoglu · Ben Glocker · Hervé Lombaert · Marleen de Bruijne
  • 2018 : Welcome »
    Ender Konukoglu · Ben Glocker · Hervé Lombaert · Marleen de Bruijne
  • 2018 Workshop: Medical Imaging meets NIPS »
    Ender Konukoglu · Ben Glocker · Hervé Lombaert · Marleen de Bruijne
  • 2017 : Closing »
    Ben Glocker · Ender Konukoglu · Hervé Lombaert · Kanwal Bhatia
  • 2017 : Poster session - Afternoon »
    Yongchan Kwon · Young-geun Kim · Ender Konukoglu · Peter Li · John Guibas · Tejpal Virdi · Kuldeep Kumar · Morteza Mardani · Jelmer Wolterink · Enhao Gong · Natalia Antropova · Johannes Stelzer · Rene Bidart · Wei-Hung Weng · Martin Rajchl · Marc Górriz · Vineeta Singh · Christopher Sandino · Hiba Chougrad · Bob Hu · Isaac Godfried · Ke Xiao · Heliodoro Tejeda Lemus · Jordan Harrod · ILSANG WOO · Vincent Chen · Joseph Cheng · Vikash Gupta · Chuck-Hou Yee · Ben Glocker · Hervé Lombaert · Maximilian Ilse · Aneta Lisowska · Andrew Doyle · Milad Makkie
  • 2017 : Poster session - Morning »
    Yongchan Kwon · Young-geun Kim · Ender Konukoglu · Peter Li · John Guibas · Tejpal Virdi · Kuldeep Kumar · Morteza Mardani · Jelmer Wolterink · Enhao Gong · Natalia Antropova · Johannes Stelzer · Rene Bidart · Wei-Hung Weng · Martin Rajchl · Marc Górriz · Vineeta Singh · Christopher Sandino · Hiba Chougrad · Bob Hu · Isaac Godfried · Ke Xiao · Heliodoro Tejeda Lemus · Jordan Harrod · ILSANG WOO · Vincent Chen · Joseph Cheng · Vikash Gupta · Chuck-Hou Yee · Ben Glocker · Hervé Lombaert · Maximilian Ilse · Aneta Lisowska · Andrew Doyle · Milad Makkie
  • 2017 : Opening »
    Ben Glocker · Ender Konukoglu · Hervé Lombaert · Kanwal Bhatia
  • 2017 Workshop: Medical Imaging meets NIPS »
    Ben Glocker · Ender Konukoglu · Hervé Lombaert · Kanwal Bhatia
  • 2017 : Poster Session »
    Shunsuke Horii · Heejin Jeong · Tobias Schwedes · Qing He · Ben Calderhead · Ertunc Erdil · Jaan Altosaar · Patrick Muchmore · Rajiv Khanna · Ian Gemp · Pengfei Zhang · Yuan Zhou · Chris Cremer · Maria DeYoreo · Alexander Terenin · Brendan McVeigh · Rachit Singh · Yaodong Yang · Erik Bodin · Trefor Evans · Henry Chai · Shandian Zhe · Jeffrey Ling · Vincent ADAM · Lars Maaløe · Andrew Miller · Ari Pakman · Josip Djolonga · Hong Ge