Timezone: »

A General Boosting Method and its Application to Learning Ranking Functions for Web Search
Zhaohui Zheng · Hongyuan Zha · Tong Zhang · Olivier Chapelle · Keke Chen · Gordon Sun

Tue Dec 04 10:30 AM -- 10:40 AM (PST) @

We present a general boosting method extending functional gradient boosting to optimize complex loss functions that are encountered in many machine learning problems. Our approach is based on optimization of quadratic upper bounds of the loss functions which allows us to present a rigorous convergence analysis of the algorithm. More importantly, this general framework enables us to use a standard regression base learner such as decision trees for fitting any loss function. We illustrate an application of the proposed method in learning ranking functions for Web search by combining both preference data and labeled data for training. We present experimental results for Web search using data from a commercial search engine that show significant improvements of our proposed methods over some existing methods.

Author Information

Zhaohui Zheng (Yahoo! Inc.)
Hongyuan Zha (Georgia Tech)
Tong Zhang (The Hong Kong University of Science and Technology)
Olivier Chapelle (Google)
Keke Chen
Gordon Sun

More from the Same Authors