Timezone: »
Learning sparse representations on data adaptive dictionaries is a state-of-the-art method for modeling data. But when the dictionary is large and the data dimension is high, it is a computationally challenging problem. We explore three aspects of the problem. First, we derive new, greatly improved screening tests that quickly identify codewords that are guaranteed to have zero weights. Second, we study the properties of random projections in the context of learning sparse representations. Finally, we develop a hierarchical framework that uses incremental random projections and screening to learn, in small stages, a hierarchically structured dictionary for sparse representations. Empirical results show that our framework can learn informative hierarchical sparse representations more efficiently.
Author Information
Zhen James Xiang (Princeton University)
Hao Xu (Princeton University)
Peter J. Ramadge (Princeton)
Related Events (a corresponding poster, oral, or spotlight)
-
2011 Poster: Learning Sparse Representations of High Dimensional Data on Large Scale Dictionaries »
Tue. Dec 13th 04:45 -- 10:59 PM Room
More from the Same Authors
-
2021 Spotlight: Safe Reinforcement Learning with Natural Language Constraints »
Tsung-Yen Yang · Michael Y Hu · Yinlam Chow · Peter J. Ramadge · Karthik Narasimhan -
2021 : ProBF: Probabilistic Safety Certificates with Barrier Functions »
Sulin Liu · Athindran Ramesh Kumar · Jaime Fisac · Ryan Adams · Peter J. Ramadge -
2022 Poster: KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation »
Ta-Chung Chi · Ting-Han Fan · Peter J. Ramadge · Alexander Rudnicky -
2022 Poster: Learning Physics Constrained Dynamics Using Autoencoders »
Tsung-Yen Yang · Justinian Rosca · Karthik Narasimhan · Peter J. Ramadge -
2021 Poster: Safe Reinforcement Learning with Natural Language Constraints »
Tsung-Yen Yang · Michael Y Hu · Yinlam Chow · Peter J. Ramadge · Karthik Narasimhan -
2020 Poster: Task-Agnostic Amortized Inference of Gaussian Process Hyperparameters »
Sulin Liu · Xingyuan Sun · Peter J. Ramadge · Ryan Adams -
2015 Poster: A Reduced-Dimension fMRI Shared Response Model »
Cameron Po-Hsuan Chen · Janice Chen · Yaara Yeshurun · Uri Hasson · James Haxby · Peter J. Ramadge -
2015 Oral: A Reduced-Dimension fMRI Shared Response Model »
Cameron Po-Hsuan Chen · Janice Chen · Yaara Yeshurun · Uri Hasson · James Haxby · Peter J. Ramadge -
2012 Poster: Kernel Hyperalignment »
Alexander Lorbert · Peter J. Ramadge -
2012 Spotlight: Kernel Hyperalignment »
Alexander Lorbert · Peter J. Ramadge -
2009 Poster: Boosting with Spatial Regularization »
Zhen James Xiang · Yongxin Xi · Uri Hasson · Peter J. Ramadge -
2009 Spotlight: Boosting with Spatial Regularization »
Zhen James Xiang · Yongxin Xi · Uri Hasson · Peter J. Ramadge -
2009 Poster: fMRI-Based Inter-Subject Cortical Alignment Using Functional Connectivity »
Bryan Conroy · Ben Singer · James Haxby · Peter J. Ramadge