Timezone: »

Efficient and Accurate Lp-Norm Multiple Kernel Learning
Marius Kloft · Ulf Brefeld · Soeren Sonnenburg · Pavel Laskov · Klaus-Robert Müller · Alexander Zien

Tue Dec 08 07:00 PM -- 11:59 PM (PST) @

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations and hence support interpretability. Unfortunately, L1-norm MKL is hardly observed to outperform trivial baselines in practical applications. To allow for robust kernel mixtures, we generalize MKL to arbitrary Lp-norms. We devise new insights on the connection between several existing MKL formulations and develop two efficient interleaved optimization strategies for arbitrary p>1. Empirically, we demonstrate that the interleaved optimization strategies are much faster compared to the traditionally used wrapper approaches. Finally, we apply Lp-norm MKL to real-world problems from computational biology, showing that non-sparse MKL achieves accuracies that go beyond the state-of-the-art.

Author Information

Marius Kloft (TU Kaiserslautern)
Ulf Brefeld (Yahoo! Research)
Soeren Sonnenburg (TomTom)
Pavel Laskov (Fraunhofer FIRST)
Klaus-Robert Müller (TU Berlin)
Alexander Zien (LIFE Biosystems GmbH)

More from the Same Authors