Strategist: Designing Agentic Reasoning at Scale
Abstract
In practice, the reasoning strategy often matters more than the model. Rather than calling a fixed large model once per input, a well-designed strategy breaks the problem into steps and uses the right model for each, achieving better accuracy at lower cost. Existing methods have tried to automate strategy design by searching over a fixed set of strategy templates, but the templates themselves limit what reasoning patterns can be discovered. We propose Strategist, a meta-agent that designs a high-performing inference strategy for a given task. Each strategy is a structured executable topology that defines how agents plan, interact, verify, and route across models. Given a task and a small development set, Strategist proposes candidate strategies, runs them on real samples, and revises them against measured accuracy and cost. Every strategy and its components are reusable, forming an evolving library that grows with each new task and compounds what future tasks can build from. On 30 benchmarks, Strategist matches or beats the strongest baselines with an average of 8.5 absolute percentage points higher accuracy at 48% lower inference cost.