Timezone: »
The F-measure is an important and commonly used performance metric for binary prediction tasks. By combining precision and recall into a single score, it avoids disadvantages of simple metrics like the error rate, especially in cases of imbalanced class distributions. The problem of optimizing the F-measure, that is, of developing learning algorithms that perform optimally in the sense of this measure, has recently been tackled by several authors. In this paper, we study the problem of F-measure maximization in the setting of online learning. We propose an efficient online algorithm and provide a formal analysis of its convergence properties. Moreover, first experimental results are presented, showing that our method performs well in practice.
Author Information
Róbert Busa-Fekete (UPB)
Balázs Szörényi (The Technion / University of Szeged)
Krzysztof Dembczynski (Poznan University of Technology)
Eyke Hüllermeier (Marburguniversity)
More from the Same Authors
-
2018 Poster: A no-regret generalization of hierarchical softmax to extreme multi-label classification »
Marek Wydmuch · Kalina Jasinska-Kobus · Mikhail Kuznetsov · Róbert Busa-Fekete · Krzysztof Dembczynski -
2018 Poster: Distributed Stochastic Optimization via Adaptive SGD »
Ashok Cutkosky · Róbert Busa-Fekete -
2017 Workshop: Extreme Classification: Multi-class & Multi-label Learning in Extremely Large Label Spaces »
Manik Varma · Marius Kloft · Krzysztof Dembczynski -
2015 Poster: Online Rank Elicitation for Plackett-Luce: A Dueling Bandits Approach »
Balázs Szörényi · Róbert Busa-Fekete · Adil Paul · Eyke Hüllermeier -
2014 Poster: Optimistic Planning in Markov Decision Processes Using a Generative Model »
Balázs Szörényi · Gunnar Kedenburg · Remi Munos -
2012 Poster: Label Ranking with Partial Abstention based on Thresholded Probabilistic Models »
Weiwei Cheng · Eyke Huellermeier · Willem Waegeman · Volkmar Welker -
2011 Poster: An Exact Algorithm for F-Measure Maximization »
Krzysztof Dembczynski · Willem Waegeman · Weiwei Cheng · Eyke Hullermeier