Timezone: »
Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms have allowed reliable learning and recall of an exponential number of patterns. Although these designs correct external errors in recall, they assume neurons that compute noiselessly, in contrast to the highly variable neurons in hippocampus and olfactory cortex. Here we consider associative memories with noisy internal computations and analytically characterize performance. As long as the internal noise level is below a specified threshold, the error probability in the recall phase can be made exceedingly small. More surprisingly, we show that internal noise actually improves the performance of the recall phase. Computational experiments lend additional support to our theoretical analysis. This work suggests a functional benefit to noisy neurons in biological neuronal networks.
Author Information
Amin Karbasi (Yale University)
Amir Hesam Salavati (EPFL)
Amin Shokrollahi (EPFL)
Lav R Varshney (IBM Watson Research Center)
Related Events (a corresponding poster, oral, or spotlight)
-
2013 Spotlight: Noise-Enhanced Associative Memories »
Fri. Dec 6th 11:38 -- 11:42 PM Room Harvey's Convention Center Floor, CC
More from the Same Authors
-
2021 Poster: An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks »
Shashank Rajput · Kartik Sreenivasan · Dimitris Papailiopoulos · Amin Karbasi -
2021 Poster: Multiple Descent: Design Your Own Generalization Curve »
Lin Chen · Yifei Min · Mikhail Belkin · Amin Karbasi -
2021 Poster: Parallelizing Thompson Sampling »
Amin Karbasi · Vahab Mirrokni · Mohammad Shadravan -
2021 Poster: Submodular + Concave »
Siddharth Mitra · Moran Feldman · Amin Karbasi -
2013 Poster: Distributed Submodular Maximization: Identifying Representative Elements in Massive Data »
Baharan Mirzasoleiman · Amin Karbasi · Rik Sarkar · Andreas Krause -
2011 Poster: Neural Reconstruction with Approximate Message Passing (NeuRAMP) »
Alyson Fletcher · Sundeep Rangan · Lav R Varshney · Aniruddha Bhargava