Timezone: »

 
Poster
Efficient Optimization for Linear Dynamical Systems with Applications to Clustering and Sparse Coding
Wenbing Huang · Mehrtash Harandi · Tong Zhang · Lijie Fan · Fuchun Sun · Junzhou Huang

Tue Dec 05 06:30 PM -- 10:30 PM (PST) @ Pacific Ballroom #96
in Posters Tue »

Linear Dynamical Systems (LDSs) are fundamental tools for modeling spatio-temporal data in various disciplines. Though rich in modeling, analyzing LDSs is not free of difficulty, mainly because LDSs do not comply with Euclidean geometry and hence conventional learning techniques can not be applied directly. In this paper, we propose an efficient projected gradient descent method to minimize a general form of a loss function and demonstrate how clustering and sparse coding with LDSs can be solved by the proposed method efficiently. To this end, we first derive a novel canonical form for representing the parameters of an LDS, and then show how gradient-descent updates through the projection on the space of LDSs can be achieved dexterously. In contrast to previous studies, our solution avoids any approximation in LDS modeling or during the optimization process. Extensive experiments reveal the superior performance of the proposed method in terms of the convergence and classification accuracy over state-of-the-art techniques.

Keywords: Clustering · Time Series Analysis · Computer Vision · Sparse Coding and Dimensionality Expansion
[ Code]  [ Paper] 

Author Information

Wenbing Huang (Tencent AI Lab)
Mehrtash Harandi (Data61)

Mehrtash Harandi is a senior research scientist at Machine Learning Research Group (MLRG), Data61-CSIRO and a senior adjunct lecturer at Australian National University (ANU), Canberra, Australia. His main research interests are theoretical and computational methods in computer vision and machine learning with a focus on Riemannian geometry.

Tong Zhang (The Australian National University)
Lijie Fan (Tsinghua University)
Fuchun Sun (Tsinghua University)
Junzhou Huang (University of Texas at Arlington / Tencent AI Lab)

More from the Same Authors