Timezone: »
Deep learning models are effective for medical image analysis tasks such as segmentation. However, training these models requires substantial amounts of labeled data, most often annotated manually. Segmenting new medical images to create labeled training data is a tedious and time-consuming process for human annotators. Interactive segmentation tools seek to alleviate this problem, most often by predicting completed segmentations from limited user inputs. This works reasonably well for some domains and for well-defined tasks. But for a new domain or task, the segmentation task is ambiguous. We hypothesize than in such situations proposing multiple partial segmentations is more useful than proposing a single complete segmentation. We propose a probabilistic partial segmentation model, that takes an input image and partial segmentation, and predicts possible next steps for the segmentation. The proposed model can be used iteratively to help annotators accurately and efficiently segment new medical images. The user can choose among multiple predicted larger segmentations and perhaps make a small number of corrections before inputting the updated segmentation back into the system. By predicting multiple larger partial segmentations at each iteration rather than attempting to fully complete the segmentation in one step, the system can enable users to produce accurate segmentations for new medical image domains with fewer corrections. We use synthetic data to demonstrate the proposed model and show a proof-of-concept for the system.
Author Information
Hallee Wong (MIT)
John Guttag (Massachusetts Institute of Technology)
Adrian Dalca (MIT, HMS)
More from the Same Authors
-
2020 : Learning MRI contrast agnostic registration »
Malte Hoffmann · Adrian Dalca -
2021 : Sequential Decision Making with Limited Resources »
Hallee Wong · Maggie Makar · Aniruddh Raghu · John Guttag -
2022 : Probabilistic Interactive Segmentation for Medical Images »
Hallee Wong · John Guttag · Adrian Dalca -
2022 : Conditional Contrastive Networks »
Emily Mu · John Guttag -
2022 : UniverSeg: Universal Medical Image Segmentation »
Victor Butoi · Jose Javier Gonzalez Ortiz · Tianyu Ma · John Guttag · Mert Sabuncu · Adrian Dalca -
2022 : Contrast Invariant Feature Representations for Medical Image Analysis »
Yue Zhi, Russ Chua · Adrian Dalca -
2022 : Region-of-Interest Adaptive Acquisition for Accelerated MRI »
Zihui Wu · Tianwei Yin · Adrian Dalca · Katherine Bouman -
2022 : At the Intersection of Conceptual Art and Deep Learning: The End of Signature »
Kathleen Lewis · Divya Shanmugam · Jose Javier Gonzalez Ortiz · Agnieszka Kurant · John Guttag -
2022 : Contrastive Learning of Electrodermal Activity Representations for Stress Detection »
Katie Matton · Robert Lewis · John Guttag · Rosalind Picard -
2022 : Contrastive Pre-Training for Multimodal Medical Time Series »
Aniruddh Raghu · Payal Chandak · Ridwan Alam · John Guttag · Collin Stultz -
2022 : Contrastive Pre-Training for Multimodal Medical Time Series »
Aniruddh Raghu · Payal Chandak · Ridwan Alam · John Guttag · Collin Stultz -
2019 Workshop: Machine Learning for Health (ML4H): What makes machine learning in medicine different? »
Andrew Beam · Tristan Naumann · Brett Beaulieu-Jones · Irene Y Chen · Madalina Fiterau · Samuel Finlayson · Emily Alsentzer · Adrian Dalca · Matthew McDermott -
2019 Poster: Learning Conditional Deformable Templates with Convolutional Networks »
Adrian Dalca · Marianne Rakic · John Guttag · Mert Sabuncu -
2018 : Poster session »
David Zeng · Marzieh S. Tahaei · Shuai Chen · Felix Meister · Meet Shah · Anant Gupta · Ajil Jalal · Eirini Arvaniti · David Zimmerer · Konstantinos Kamnitsas · Pedro Ballester · Nathaniel Braman · Udaya Kumar · Sil C. van de Leemput · Junaid Qadir · Hoel Kervadec · Mohamed Akrout · Adrian Tousignant · Matthew Ng · Raghav Mehta · Miguel Monteiro · Sumana Basu · Jonas Adler · Adrian Dalca · Jizong Peng · Sungyeob Han · Xiaoxiao Li · Karthik Gopinath · Joseph Cheng · Bogdan Georgescu · Kha Gia Quach · Karthik Sarma · David Van Veen -
2018 : Oral session II »
Sil C. van de Leemput · Adrian Dalca · Karthik Gopinath -
2018 : Poster Session I »
Aniruddh Raghu · Daniel Jarrett · Kathleen Lewis · Elias Chaibub Neto · Nicholas Mastronarde · Shazia Akbar · Chun-Hung Chao · Henghui Zhu · Seth Stafford · Luna Zhang · Jen-Tang Lu · Changhee Lee · Adityanarayanan Radhakrishnan · Fabian Falck · Liyue Shen · Daniel Neil · Yusuf Roohani · Aparna Balagopalan · Brett Marinelli · Hagai Rossman · Sven Giesselbach · Jose Javier Gonzalez Ortiz · Edward De Brouwer · Byung-Hoon Kim · Rafid Mahmood · Tzu Ming Hsu · Antonio Ribeiro · Rumi Chunara · Agni Orfanoudaki · Kristen Severson · Mingjie Mai · Sonali Parbhoo · Albert Haque · Viraj Prabhu · Di Jin · Alena Harley · Geoffroy Dubourg-Felonneau · Xiaodan Hu · Maithra Raghu · Jonathan Warrell · Nelson Johansen · Wenyuan Li · Marko Järvenpää · Satya Narayan Shukla · Sarah Tan · Vincent Fortuin · Beau Norgeot · Yi-Te Hsu · Joel H Saltz · Veronica Tozzo · Andrew Miller · Guillaume Ausset · Azin Asgarian · Francesco Paolo Casale · Antoine Neuraz · Bhanu Pratap Singh Rawat · Turgay Ayer · Xinyu Li · Mehul Motani · Nathaniel Braman · Laetitia M Shao · Adrian Dalca · Hyunkwang Lee · Emma Pierson · Sandesh Ghimire · Yuji Kawai · Owen Lahav · Anna Goldenberg · Denny Wu · Pavitra Krishnaswamy · Colin Pawlowski · Arijit Ukil · Yuhui Zhang -
2018 Workshop: Machine Learning for Health (ML4H): Moving beyond supervised learning in healthcare »
Andrew Beam · Tristan Naumann · Marzyeh Ghassemi · Matthew McDermott · Madalina Fiterau · Irene Y Chen · Brett Beaulieu-Jones · Michael Hughes · Farah Shamout · Corey Chivers · Jaz Kandola · Alexandre Yahi · Samuel Finlayson · Bruno Jedynak · Peter Schulam · Natalia Antropova · Jason Fries · Adrian Dalca · Irene Chen -
2018 Poster: Gaussian Process Prior Variational Autoencoders »
Francesco Paolo Casale · Adrian Dalca · Luca Saglietti · Jennifer Listgarten · Nicolo Fusi -
2017 Workshop: Machine Learning for Health (ML4H) - What Parts of Healthcare are Ripe for Disruption by Machine Learning Right Now? »
Jason Fries · Alex Wiltschko · Andrew Beam · Isaac S Kohane · Jasper Snoek · Peter Schulam · Madalina Fiterau · David Kale · Rajesh Ranganath · Bruno Jedynak · Michael Hughes · Tristan Naumann · Natalia Antropova · Adrian Dalca · SHUBHI ASTHANA · Prateek Tandon · Jaz Kandola · Uri Shalit · Marzyeh Ghassemi · Tim Althoff · Alexander Ratner · Jumana Dakka