Timezone: »

 
Poster
Channel Gating Neural Networks
Weizhe Hua · Yuan Zhou · Christopher De Sa · Zhiru Zhang · G. Edward Suh

Tue Dec 10 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #110
in Deep Learning -- Efficient Inference Methods »

This paper introduces channel gating, a dynamic, fine-grained, and hardware－efficient pruning scheme to reduce the computation cost for convolutional neural networks (CNNs). Channel gating identifies regions in the features that contribute less to the classification result, and skips the computation on a subset of the input channels for these ineffective regions. Unlike static network pruning, channel gating optimizes CNN inference at run-time by exploiting input-specific characteristics, which allows substantially reducing the compute cost with almost no accuracy loss. We experimentally show that applying channel gating in state-of-the-art networks achieves 2.7-8.0x reduction in floating-point operations (FLOPs) and 2.0-4.4x reduction in off-chip memory accesses with a minimal accuracy loss on CIFAR-10. Combining our method with knowledge distillation reduces the compute cost of ResNet-18 by 2.6x without accuracy drop on ImageNet. We further demonstrate that channel gating can be realized in hardware efficiently. Our approach exhibits sparsity patterns that are well-suited to dense systolic arrays with minimal additional hardware. We have designed an accelerator for channel gating networks, which can be implemented using either FPGAs or ASICs. Running a quantized ResNet-18 model for ImageNet, our accelerator achieves an encouraging speedup of 2.4x on average, with a theoretical FLOP reduction of 2.8x.

Keywords: Deep Learning · Efficient Inference Methods · Deep Learning
[ Paper]  [ Slides] 

Author Information

Weizhe Hua (Cornell University)
Yuan Zhou (Cornell)
Christopher De Sa (Cornell)
Zhiru Zhang (Cornell Univeristy)
G. Edward Suh (Cornell University)

More from the Same Authors