Timezone: »

 
Poster
NS3: Neuro-symbolic Semantic Code Search
Shushan Arakelyan · Anna Hakhverdyan · Miltiadis Allamanis · Luis Garcia · Christophe Hauser · Xiang Ren

Thu Dec 01 09:00 AM -- 11:00 AM (PST) @ Hall J #108
in Poster Session 5 »
Semantic code search is the task of retrieving a code snippet given a textual description of its functionality. Recent work has been focused on using similarity metrics between neural embeddings of text and code. However, current language models are known to struggle with longer, compositional sentences, and multi-step reasoning. To overcome this limitation, we propose supplementing the query sentence with a layout of its semantic structure. The semantic layout is used to break down the final reasoning decision into a series of lower-level decisions. We use a Neural Module Network architecture to implement this idea. We compare our model - $NS^3$ (Neuro-Symbolic Semantic Search) - to a number of baselines, including state-of-the-art semantic code retrieval methods, such as CodeBERT, CuBERT and GraphCodeBERT, and evaluate on two datasets - Code Search Net (CSN) and Code Search and Question Answering (CoSQA). On these datasets, we demonstrate that our approach results in higher performance. We also perform additional studies to show the effectiveness of our modular design when handling compositional queries.
Keywords: Deep Learning · ml4code · semantic code search
[ Paper]  [ Poster]  [ OpenReview] 

Author Information

Shushan Arakelyan (University of Southern California)
Anna Hakhverdyan (Magical Labs)
Miltiadis Allamanis (Microsoft Research)
Luis Garcia (University of Southern California Information Sciences Institute)
Luis Garcia

Hi! I’m Dr. Luis Antonio Garcia. I just recently joined USC Information Sciences Institute as a Computer Research Scientist focusing on how we can provide any notions of safety and security for the learning-enabled Internet-of-Things (IoT)/Cyber-physical Systems (CPS). I previously held a postdoctoral appointment at the Networked & Embedded Systems Laboratory at the UCLA ECE Department, collaborating with Dr. Mani Srivastava. I have my PhD in Computer Engineering with a Cybersecurity focus from Rutgers University, where my research advisor was Dr. Saman Zonouz. My dissertation was titled “Physics for the Sake of Security, Security for the Sake of Physics.”

Christophe Hauser (USC/ISI)
Xiang Ren (University of Southern California)

More from the Same Authors