Skip to yearly menu bar Skip to main content


Poster

Handling Learnwares from Heterogeneous Feature Spaces with Explicit Label Exploitation

Peng Tan · Hai-Tian Liu · Zhi-Hao Tan · Zhi-Hua Zhou

East Exhibit Hall A-C #3408
[ ]
Thu 12 Dec 11 a.m. PST — 2 p.m. PST

Abstract:

The learnware paradigm aims to help users leverage numerous existing high-performing models instead of starting from scratch, where a learnware consists of a well-trained model and the specification describing its capability. Numerous learnwares are accommodated by a learnware dock system. When users solve tasks with the system, models that fully match the task feature space are often rare or even unavailable. However, models with heterogeneous feature space can still be helpful. This paper finds that label information, particularly model outputs, is helpful yet previously less exploited in the accommodation of heterogeneous learnwares. We extend the specification to better leverage model pseudo-labels and subsequently enrich the unified embedding space for better specification evolvement. With label information, the learnware identification can also be improved by additionally comparing conditional distributions. Experiments demonstrate that, even without a model explicitly tailored to user tasks, the system can effectively handle tasks by leveraging models from diverse feature spaces.

Live content is unavailable. Log in and register to view live content