Timezone: »
Standardization of chemical compounds using language modeling
Miruna Cretu · Alessandra Toniato · Alain C. Vaucher · Amol Thakkar · Amin Debabeche · Teodoro Laino
Event URL: https://openreview.net/forum?id=4CFoS4q1QO »
With the growing amount of chemical data stored digitally, it has become crucial to represent chemical compounds consistently. Harmonized representations facilitate the extraction of insightful information from datasets, and are advantageous for machine learning applications. Compound standardization is typically accomplished using rule-based algorithms that modify undesirable descriptions of functional groups, resulting in a consistent representation throughout the dataset. Here, we present the first deep-learning model for molecular standardization. We enable custom standardization schemes based solely on data, as well as standardization options that are difficult to encode in rules. Our model achieves $>98\%$ accuracy in learning two popular rule-based protocols. When fine-tuned on a relatively small dataset of catalysts (for which there is currently no automated standardization practice), the model predicts the expected standardized molecular format with a test accuracy of $62\%$ on average. We show that our model learns not only the grammar and syntax of molecular representations, but also the details of atom ordering, types of bonds, and representations of charged species. In addition, we demonstrate the model's ability to reproduce a canonicalization algorithm with a $95.6\%$ success rate.
With the growing amount of chemical data stored digitally, it has become crucial to represent chemical compounds consistently. Harmonized representations facilitate the extraction of insightful information from datasets, and are advantageous for machine learning applications. Compound standardization is typically accomplished using rule-based algorithms that modify undesirable descriptions of functional groups, resulting in a consistent representation throughout the dataset. Here, we present the first deep-learning model for molecular standardization. We enable custom standardization schemes based solely on data, as well as standardization options that are difficult to encode in rules. Our model achieves $>98\%$ accuracy in learning two popular rule-based protocols. When fine-tuned on a relatively small dataset of catalysts (for which there is currently no automated standardization practice), the model predicts the expected standardized molecular format with a test accuracy of $62\%$ on average. We show that our model learns not only the grammar and syntax of molecular representations, but also the details of atom ordering, types of bonds, and representations of charged species. In addition, we demonstrate the model's ability to reproduce a canonicalization algorithm with a $95.6\%$ success rate.
Author Information
Miruna Cretu (IBM Research)
I graduated from Imperial College London with a Masters in Chemistry last year. I am now an intern in Teodoro Laino's group at IBM Research in Zurich, where my focus is using language models for chemistry.
Alessandra Toniato (International Business Machines)
Alain C. Vaucher (IBM Research Europe)
Amol Thakkar (IBM Research Europe - Zurich)
Amin Debabeche
Teodoro Laino (IBM Research Zurich)
More from the Same Authors
-
2021 : Identification of Enzymatic Active Sites with Unsupervised Language Modelling »
Loïc Kwate Dassi · Matteo Manica · Daniel Probst · Philippe Schwaller · Yves Gaetan Nana Teukam · Teodoro Laino -
2021 : Human-in-the-loop for a Disconnection Aware Retrosynthesis »
Andrea Byekwaso · Philippe Schwaller · Alain C. Vaucher · Teodoro Laino -
2020 : Spotlight Talk: Completion of partial reaction equations - Alain C. Vaucher, Philippe Schwaller and Teodoro Laino »
Alain Vaucher, -
2020 Poster: CogMol: Target-Specific and Selective Drug Design for COVID-19 Using Deep Generative Models »
Vijil Chenthamarakshan · Payel Das · Samuel Hoffman · Hendrik Strobelt · Inkit Padhi · Kar Wai Lim · Benjamin Hoover · Matteo Manica · Jannis Born · Teodoro Laino · Aleksandra Mojsilovic