Skip to yearly menu bar Skip to main content


Competition

HAC: The Hacker-Cup AI Competition

Mark Saroufim · Weiwei Yang · Joseph Isaacson · David Harmeyer · Driss Guessous · Supriya Rao · Margaret Li · Wesley May

West Meeting Room 210
[ ] [ Project Page ]
Sat 14 Dec 9 a.m. PST — noon PST

Abstract:

We are launching the first AI track for the popular Meta Hacker Cup programmingcompetition, designed to assess the capabilities of Generative AI in performingautonomous code generation tasks. We aim to test the limits of AI in complexcoding challenges and measure the performance gap between AI systems andhuman programmers. We will provide access to all Hacker Cup problems since 2011alongside their respective solutions in a multimodal (image and text) format, andutilize the existing Hacker Cup infrastructure for competitor evaluation. Featuringboth "open evaluation, open model" and "open evaluation, closed model" tracks,this competition invites diverse participation from research institutions of variedinterests and resource constraints, including academic labs, AI startups, largetechnology companies, and AI enthusiasts. Our goal is to develop and democratizemeaningful advancements in code automation with the very first open evaluationprocess for competitive AI programmers.

Live content is unavailable. Log in and register to view live content

Schedule