Timezone: »
Neural decoders were shown to outperform classical message passing techniques for short BCH codes. In this work, we extend these results to much larger families of algebraic block codes, by performing message passing with graph neural networks. The parameters of the sub-network at each variable-node in the Tanner graph are obtained from a hypernetwork that receives the absolute values of the current message as input. To add stability, we employ a simplified version of the arctanh activation that is based on a high order Taylor approximation of this activation function. Our results show that for a large number of algebraic block codes, from diverse families of codes (BCH, LDPC, Polar), the decoding obtained with our method outperforms the vanilla belief propagation method as well as other learning techniques from the literature.
Author Information
Eliya Nachmani (Tel Aviv University and Facebook AI Research)
Lior Wolf (Facebook AI Research)
More from the Same Authors
-
2021 Poster: Meta Internal Learning »
Raphael Bensadoun · Shir Gur · Tomer Galanti · Lior Wolf -
2020 Poster: Generating Correct Answers for Progressive Matrices Intelligence Tests »
Niv Pekar · Yaniv Benny · Lior Wolf -
2020 Poster: Hierarchical Patch VAE-GAN: Generating Diverse Videos from a Single Sample »
Shir Gur · Sagie Benaim · Lior Wolf -
2020 Poster: On the Modularity of Hypernetworks »
Tomer Galanti · Lior Wolf -
2020 Poster: On Infinite-Width Hypernetworks »
Etai Littwin · Tomer Galanti · Lior Wolf · Greg Yang -
2020 Oral: On the Modularity of Hypernetworks »
Tomer Galanti · Lior Wolf -
2018 Poster: Automatic Program Synthesis of Long Programs with a Learned Garbage Collector »
Amit Zohar · Lior Wolf -
2018 Poster: One-Shot Unsupervised Cross Domain Translation »
Sagie Benaim · Lior Wolf -
2018 Poster: Regularizing by the Variance of the Activations' Sample-Variances »
Etai Littwin · Lior Wolf -
2017 Poster: One-Sided Unsupervised Domain Mapping »
Sagie Benaim · Lior Wolf -
2017 Spotlight: One-Sided Unsupervised Domain Mapping »
Sagie Benaim · Lior Wolf