Timezone: »
Cryo-electron microscopy (cryo-EM) is unique among tools in structural biology in its ability to image large, dynamic protein complexes. Key to this ability are image processing algorithms for heterogeneous cryo-EM reconstruction, including recent deep learning-based approaches. The state-of-the-art method cryoDRGN uses a Variational Autoencoder (VAE) framework to learn a continuous distribution of protein structures from single particle cryo-EM imaging data. While cryoDRGN is able to model complex structural motions, in practice, the Gaussian prior distribution of the VAE fails to match the aggregate approximate posterior, especially for multi-modal distributions (e.g. compositional heterogeneity). Here, we train a diffusion model as an expressive, learnable prior for cryoDRGN. We show the ability to sample from the model on two synthetic and two real datasets, where samples accurately follow the data distribution unlike samples from the VAE prior distribution. Our approach learns a high-quality generative model over molecular configurations directly from cryo-EM imaging data. We also demonstrate how the diffusion model prior can be leveraged for fast latent space traversal and interpolation between states of interest. By learning an accurate model of the data distribution, our method unlocks tools in generative modeling, sampling, and distribution analysis for heterogeneous cryo-EM ensembles.
Author Information
Karsten Kreis (NVIDIA)
Tim Dockhorn (University of Waterloo)
Zihao Li (Princeton University)
Ellen Zhong (Princeton University)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 : Latent Space Diffusion Models of Cryo-EM Structures »
Dates n/a. Room
More from the Same Authors
-
2020 : Differentially Private Generative Models Through Optimal Transport »
Karsten Kreis -
2022 Workshop: Machine Learning in Structural Biology Workshop »
Roshan Rao · Jonas Adler · Namrata Anand · John Ingraham · Sergey Ovchinnikov · Ellen Zhong -
2022 : Invited talk: Karsten Kreis »
Karsten Kreis -
2022 Poster: Amortized Inference for Heterogeneous Reconstruction in Cryo-EM »
Axel Levy · Gordon Wetzstein · Julien N.P Martel · Frederic Poitevin · Ellen Zhong -
2022 Poster: GENIE: Higher-Order Denoising Diffusion Solvers »
Tim Dockhorn · Arash Vahdat · Karsten Kreis -
2021 Poster: EditGAN: High-Precision Semantic Image Editing »
Huan Ling · Karsten Kreis · Daiqing Li · Seung Wook Kim · Antonio Torralba · Sanja Fidler -
2021 Poster: Score-based Generative Modeling in Latent Space »
Arash Vahdat · Karsten Kreis · Jan Kautz -
2021 Poster: ATISS: Autoregressive Transformers for Indoor Scene Synthesis »
Despoina Paschalidou · Amlan Kar · Maria Shugrina · Karsten Kreis · Andreas Geiger · Sanja Fidler -
2021 Poster: Don’t Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence »
Tianshi Cao · Alex Bie · Arash Vahdat · Sanja Fidler · Karsten Kreis -
2021 Poster: Demystifying and Generalizing BinaryConnect »
Tim Dockhorn · Yaoliang Yu · Eyyüb Sari · Mahdi Zolnouri · Vahid Partovi Nia -
2020 Poster: Variational Amodal Object Completion »
Huan Ling · David Acuna · Karsten Kreis · Seung Wook Kim · Sanja Fidler