Timezone: »

 
Program Synthesis for Integer Sequence Generation
Natasha Butt · Auke Wiggers · Taco Cohen · Max Welling

@
in MATH-AI: Toward Human-Level Mathematical Reasoning »

Recent advances in program synthesis have shown success with methods that employ deep learning on synthetic data generated from domain specific languages (DSLs). In this work, we propose an algorithm for program synthesis that extends these methods. It uses transfer learning from pre-trained language models, and employs a policy improvement operator based on policy-guided search. This hybrid approach combats the challenges of searching a large language space with sparse rewards. We show its effectiveness on the task of integer sequence generation, a special case of programming-by-examples with fixed inputs. Our preliminary results demonstrate that the inclusion of policy-guided search leads to a 1.6% increase in the number of correct programs compared to supervised baselines.

[ Poster] 

Author Information

Natasha Butt (University of Amsterdam)
Auke Wiggers (Qualcomm AI Research)
Taco Cohen (Qualcomm)
Max Welling (Microsoft Research AI4Science / University of Amsterdam)

More from the Same Authors