Plan Shallow While You Learn: Reallocating Planning Compute During World-Model Adaptation
Abstract
A continual world model that adapts to a changed environment does not adapt instantly. Between the moment the physics shift and the moment the weights catch up, the deployed system plans inside a simulator that disagrees with reality, and its returns drop, often below what the stale frozen model would have delivered. We argue that the right response to this transient is not only to keep learning but to change how the planner spends its compute: move budget out of imagination depth, whose errors compound with every imagined step and therefore scale with how wrong the model currently is, and into optimization breadth. In a controlled deployment study over three drag shifts of a pursuit–evasion environment we find that (i) the profitable imagination horizon compresses with the severity of the shift; (ii) reallocating a fixed planning budget away from the healthy model's optimal depth wins on every shifted tier and loses on the unshifted control; and (iii) in live deployment streams reallocation beats the default allocation by +4.6 to +5.5 return with an adapting model and by +3.9 to +11.7 with the frozen model, so the gain does not depend on the learner; the standard residual learner we deploy in fact costs return on these shifts, dragging both allocations down by a similar amount, and reallocation wins in both cases. We propose that continual world-model systems treat planning-compute allocation as adaptive state, revised alongside the model's weights.