TEMPO: Temporal Enforcement via Mode-Separated Policy Optimization for Trustworthy LLM Backtesting
Zeyu Zhang ⋅ Bradly Stadie
Abstract
Backtesting large language models on historical events requires reasoning exclusively from information available before a specified cutoff date. Yet models routinely leak post-cutoff knowledge from pre-training into their reasoning, inflating apparent accuracy and undermining evaluation validity. Prompt-based constraints fail when suppressed content is causally related to the prediction, and knowledge unlearning cannot address this problem because temporal compliance is instance-specific: the same fact may be legitimate evidence for one cutoff date and a violation for another. Rather than erasing knowledge, the model must learn **temporal discipline**: selecting evidence conditioned on each instance's cutoff date. We propose **TEMPO** (**T**emporal **E**nforcement via **M**ode-separated **P**olicy **O**ptimization), which trains this discipline via two contributions: (1) a two-mode reward where a leakage mode drives post-cutoff claims to zero as a hard prerequisite before a performance mode optimizes task performance; and (2) a GRPO-based training pipeline that enables the model to discover temporally valid reasoning strategies. We prove that training monotonically decreases leakage, converges to the leak-free optimum, and improves task performance once compliance is achieved. On three prediction tasks and two models, TEMPO reduces leakage from 2$\sim$13\% to 0.6$\sim$3.7\% across all conditions, with task performance improving 6$\sim$13\% where strong pre-cutoff signals exist and maintained where the prediction task is inherently difficult from valid information alone.
Chat is not available.
Successful Page Load