Timezone: »

 
Spotlight
Efficient Match Kernel between Sets of Features for Visual Recognition
Liefeng Bo · Cristian Sminchisescu

Wed Dec 09 05:15 PM -- 05:16 PM (PST) @
in Spotlights »

In visual recognition, the images are frequently modeled as sets of local features (bags). We show that bag of words, a common method to handle such cases, can be viewed as a special match kernel, which counts 1 if two local features fall into the same regions partitioned by visual words and 0 otherwise. Despite its simplicity, this quantization is too coarse. It is, therefore, appealing to design match kernels that more accurately measure the similarity between local features. However, it is impractical to use such kernels on large datasets due to their significant computational cost. To address this problem, we propose an efficient match kernel (EMK), which maps local features to a low dimensional feature space, average the resulting feature vectors to form a set-level feature, then apply a linear classifier. The local feature maps are learned so that their inner products preserve, to the best possible, the values of the specified kernel function. EMK is linear both in the number of images and in the number of local features. We demonstrate that EMK is extremely efficient and achieves the current state of the art performance on three difficult real world datasets: Scene-15, Caltech-101 and Caltech-256.

Author Information

Liefeng Bo (Intel Labs)
Cristian Sminchisescu (Lund University/Google)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors