BLANP: Memory-Efficient Backpropagation-Free Local Training via Antithetic Node Perturbation

Backpropagation imposes fundamental constraints on training neural networks. It requires the retention of all forward activations until the corresponding backward pass completes, thereby preventing pipelined execution across layers. This work introduces Backpropagation-Free Local Antithetic Node Perturbation (BLANP), a fully local training framework that eliminates gradient propagation across layer boundaries while requiring no negative samples. Each layer updates its parameters from locally available signals through a zeroth-order antithetic perturbation estimator. To stabilize learning, the estimator is evaluated against a frozen exponential moving average critic, decoupling backbone updates from the concurrently evolving local classifiers. The antithetic perturbation formulation cancels even-order bias terms in the gradient estimate, yielding a first-order accurate update from two forward passes alone. A companion variant, BLANP-Exact, replaces the perturbation estimator with exact yet local gradients under a strict stop-gradient constraint, preserving a memory footprint that does not grow with network depth while recovering gradient fidelity. Experiments on MNIST, Fashion-MNIST, and CIFAR-10 across MLP and convolutional architectures show that BLANP matches backpropagation on simple benchmarks. On the more challenging CIFAR-10, BLANP-Exact surpasses the best prior local learning method by 2.40% with a simpler architecture, and trails an identical backpropagation baseline by only 3.90%. The code is available at https://github.com/anonymous/BLANP.