Timezone: »

Function-guided protein design by deep manifold sampling
Vladimir Gligorijevic · Stephen Ra · Dan Berenberg · Richard Bonneau · Kyunghyun Cho

Mon Dec 13 11:40 AM -- 11:50 AM (PST) @

Protein design is challenging because it requires searching through a vast combinatorial space that is only sparsely functional. Self-supervised learning approaches offer the potential to navigate through this space more effectively and thereby accelerate protein engineering. We introduce a sequence denoising autoencoder (DAE) that learns the manifold of protein sequences from a large amount of potentially unlabelled proteins. This DAE is combined with a function predictor that guides sampling towards sequences with higher levels of desired functions. We train the sequence DAE on more than 20M unlabeled protein sequences spanning many evolutionarily diverse protein families and train the function predictor on approximately 0.5M sequences with known function labels. At test time, we sample from the model by iteratively denoising a sequence while exploiting the gradients from the function predictor. We present a few preliminary case studies of protein design that demonstrate the effectiveness of this proposed approach, which we refer to as “deep manifold sampling”, including metal binding site addition, function-preserving diversification, and global fold change.

Author Information

Vladimir Gligorijevic (Prescient Design/Genentech)
Stephen Ra (Prescient Design | Genentech)
Dan Berenberg (New York University)
Richard Bonneau (Genentech)

Richard Bonneau is on leave from NYU and currently at Prescient Design.

Kyunghyun Cho (Genentech | New York University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors

  • 2021 : NaturalProofs: Mathematical Theorem Proving in Natural Language »
    Sean Welleck · Jiacheng Liu · Ronan Le Bras · Hanna Hajishirzi · Yejin Choi · Kyunghyun Cho
  • 2021 : KLUE: Korean Language Understanding Evaluation »
    Sungjoon Park · Jihyung Moon · Sungdong Kim · Won Ik Cho · Ji Yoon Han · Jangwon Park · Chisung Song · Junseong Kim · Youngsook Song · Taehwan Oh · Joohong Lee · Juhyun Oh · Sungwon Lyu · Younghoon Jeong · Inkwon Lee · Sangwoo Seo · Dongjun Lee · Hyunwoo Kim · Myeonghwa Lee · Seongbo Jang · Seungwon Do · Sunkyoung Kim · Kyungtae Lim · Jongwon Lee · Kyumin Park · Jamin Shin · Seonghyun Kim · Lucy Park · Alice Oh · Jung-Woo Ha · Kyunghyun Cho
  • 2021 Poster: True Few-Shot Learning with Language Models »
    Ethan Perez · Douwe Kiela · Kyunghyun Cho
  • 2019 : Cell »
    Anne Carpenter · Jian Zhou · Maria Chikina · Alexander Tong · Ben Lengerich · Aly Abdelkareem · Gokcen Eraslan · Stephen Ra · Daniel Burkhardt · Frederick A Matsen IV · Alan Moses · Zhenghao Chen · Marzieh Haghighi · Alex Lu · Geoffrey Schau · Jeff Nivala · Miriam Shiffman · Hannes Harbrecht · Levi Masengo Wa Umba · Joshua Weinstein