Learning to Discover Interesting Mathematics
Abstract
Recently, Large Language Models (LLMs) have been increasingly able to solve advanced mathematical problems, including a few that have been open for decades, while automatically verifying their own proof. This opens the door to expansion of mathematical knowledge at unprecedented scale. Yet, while LLMs may be able to conjecture and prove more and more theorems, it remains open whether this new mathematical knowledge is interesting or useful. We identify the difficulty of a proof conditioned on a set of premises as a useful primitive for answering these questions, and train a 27B model that predicts proof difficulty more accurately than frontier general-purpose models. We define intrinsic interestingness as proof difficulty relative to statement description length and show that it correlates strongly with an extrinsic measure of the downstream utility of a theorem. Optimizing for our metric creates a model which is capable of producing more interesting theorems, while also reducing overlap with Mathlib, showcasing the creation of more out-of-distribution math. Our framework provides quantifiable metrics for self-expanding, machine-verified mathematical libraries that can choose worthwhile statements without relying on human-supplied targets.