Timezone: »

 
Modeling Semantic Correlation and Hierarchy for Real-world Wildlife Recognition
Dong-Jin Kim · Zhongqi Miao · Yunhui Guo · Stella Yu · Kyle Landolt · Mark Koneff · Travis Harrison

In wildlife imagery, the main challenges for a model to assist human annotation are two-fold: (1) the training dataset is usually imbalanced, which makes the model's suggestion biased, and (2) there are complex taxonomies in the classes. We establish a simple and efficient baseline, including the debiasing loss function and the hyperbolic network architecture, to address these issues and achieve noticeable improvements in image classification accuracy compared to a naive method. Moreover, we propose leveraging the semantic correlation to train the model more effectively by adding a co-occurrence layer to our model during training. The proposed semantic correlation-based learning method significantly improves the performance. We demonstrate the efficacy of our method in both our real-world wildlife areal survey recognition dataset and the public image classification dataset, CIFAR100-LT and CIFAR10-LT.

Author Information

Dong-Jin Kim (Hanyang University)
Zhongqi Miao (Microsoft)
Yunhui Guo (University of Texas at Dallas)
Stella Yu (UC Berkeley / ICSI)
Kyle Landolt (USGS)
Mark Koneff (US Fish and Wildlife Service - Division of Migratory Bird Management)
Travis Harrison (United States Geological Survey)

More from the Same Authors

  • 2022 : Contextual Visual Feature Learning for Zero-Shot Recognition of Human-Object Interactions »
    Tsung-Wei Ke · Dong-Jin Kim · Stella Yu · Liang Gou · Liu Ren
  • 2022 : Multi-band Image Classification with Ultra-Lean Complex-Valued Models »
    Utkarsh Singhal · Stella Yu · Zackery Steck · Scott Kangas
  • 2021 Poster: The Emergence of Objectness: Learning Zero-shot Segmentation from Videos »
    Runtao Liu · Zhirong Wu · Stella Yu · Stephen Lin
  • 2019 : Poster Session »
    Jonathan Scarlett · Piotr Indyk · Ali Vakilian · Adrian Weller · Partha P Mitra · Benjamin Aubin · Bruno Loureiro · Florent Krzakala · Lenka Zdeborová · Kristina Monakhova · Joshua Yurtsever · Laura Waller · Hendrik Sommerhoff · Michael Moeller · Rushil Anirudh · Shuang Qiu · Xiaohan Wei · Zhuoran Yang · Jayaraman Thiagarajan · Salman Asif · Michael Gillhofer · Johannes Brandstetter · Sepp Hochreiter · Felix Petersen · Dhruv Patel · Assad Oberai · Akshay Kamath · Sushrut Karmalkar · Eric Price · Ali Ahmed · Zahra Kadkhodaie · Sreyas Mohan · Eero Simoncelli · Carlos Fernandez-Granda · Oscar Leong · Wesam Sakla · Rebecca Willett · Stephan Hoyer · Jascha Sohl-Dickstein · Sam Greydanus · Gauri Jagatap · Chinmay Hegde · Michael Kellman · Jonathan Tamir · Nouamane Laanait · Ousmane Dia · Mirco Ravanelli · Jonathan Binas · Negar Rostamzadeh · Shirin Jalali · Tiantian Fang · Alex Schwing · SĂ©bastien Lachapelle · Philippe Brouillard · Tristan Deleu · Simon Lacoste-Julien · Stella Yu · Arya Mazumdar · Ankit Singh Rawat · Yue Zhao · Jianshu Chen · Xiaoyang Li · Hubert Ramsauer · Gabrio Rizzuti · Nikolaos Mitsakos · Dingzhou Cao · Thomas Strohmer · Yang Li · Pei Peng · Gregory Ongie