Timezone: »

 
Poster
LLC: Accurate, Multi-purpose Learnt Low-dimensional Binary Codes
Aditya Kusupati · Matthew Wallingford · Vivek Ramanujan · Raghav Somani · Jae Sung Park · Krishna Pillutla · Prateek Jain · Sham Kakade · Ali Farhadi

Thu Dec 09 12:30 AM -- 02:00 AM (PST) @ Virtual
in Poster Session 5 »
Learning binary representations of instances and classes is a classical problem with several high potential applications. In modern settings, the compression of high-dimensional neural representations to low-dimensional binary codes is a challenging task and often require large bit-codes to be accurate. In this work, we propose a novel method for $\textbf{L}$earning $\textbf{L}$ow-dimensional binary $\textbf{C}$odes $(\textbf{LLC})$ for instances as well as classes. Our method does ${\textit{not}}$ require any side-information, like annotated attributes or label meta-data, and learns extremely low-dimensional binary codes ($\approx 20$ bits for ImageNet-1K). The learnt codes are super-efficient while still ensuring $\textit{nearly optimal}$ classification accuracy for ResNet50 on ImageNet-1K. We demonstrate that the learnt codes capture intrinsically important features in the data, by discovering an intuitive taxonomy over classes. We further quantitatively measure the quality of our codes by applying it to the efficient image retrieval as well as out-of-distribution (OOD) detection problems. For ImageNet-100 retrieval problem, our learnt binary codes outperform $16$ bit HashNet using only $10$ bits and also are as accurate as $10$ dimensional real representations. Finally, our learnt binary codes can perform OOD detection, out-of-the-box, as accurately as a baseline that needs $\approx3000$ samples to tune its threshold, while we require ${\textit{none}}$. Code is open-sourced at https://github.com/RAIVNLab/LLC.
Keywords: Machine Learning · Representation Learning

Author Information

Aditya Kusupati (University of Washington)
Matthew Wallingford (University of Washington)
Vivek Ramanujan (Department of Computer Science, University of Washington)
Raghav Somani (University of Washington)
Jae Sung Park (University of Washington)
Krishna Pillutla (University of Washington)
Prateek Jain (Google Research)
Sham Kakade (Harvard University & Microsoft Research)
Ali Farhadi (University of Washington, Allen Institute for Artificial Intelligence)

More from the Same Authors