Workshop: Information-Theoretic Principles in Cognitive Systems

Successive Refinement and Coarsening of the Information Bottleneck

Hippolyte Charvin · Daniel Polani · Nicola Catenacci Volpi


We discuss two models for two central issues appearing inconjunction with cognitive processing. One is the ability toincorporate fresh information to already learnt models; the other oneis moving to a better understanding of what happens when information``trickles'' through many layers of a cognitive processing pipeline. We do so by investigating formal properties of the Information Bottleneck method: namely how it relates to successive refinement, and successive coarsening of information.

Chat is not available.