Timezone: »

Learning Sparse Representations of High Dimensional Data on Large Scale Dictionaries
Zhen James Xiang · Hao Xu · Peter J. Ramadge

Tue Dec 13 08:45 AM -- 02:59 PM (PST) @

Learning sparse representations on data adaptive dictionaries is a state-of-the-art method for modeling data. But when the dictionary is large and the data dimension is high, it is a computationally challenging problem. We explore three aspects of the problem. First, we derive new, greatly improved screening tests that quickly identify codewords that are guaranteed to have zero weights. Second, we study the properties of random projections in the context of learning sparse representations. Finally, we develop a hierarchical framework that uses incremental random projections and screening to learn, in small stages, a hierarchically structured dictionary for sparse representations. Empirical results show that our framework can learn informative hierarchical sparse representations more efficiently.

Author Information

Zhen James Xiang (Princeton University)
Hao Xu (Princeton University)
Peter J. Ramadge (Princeton)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors