Timezone: »
Determinantal point processes (DPPs) have recently been proposed as computationally efficient probabilistic models of diverse sets for a variety of applications, including document summarization, image search, and pose estimation. Many DPP inference operations, including normalization and sampling, are tractable; however, finding the most likely configuration (MAP), which is often required in practice for decoding, is NP-hard, so we must resort to approximate inference. Because DPP probabilities are log-submodular, greedy algorithms have been used in the past with some empirical success; however, these methods only give approximation guarantees in the special case of DPPs with monotone kernels. In this paper we propose a new algorithm for approximating the MAP problem based on continuous techniques for submodular function maximization. Our method involves a novel continuous relaxation of the log-probability function, which, in contrast to the multilinear extension used for general submodular functions, can be evaluated and differentiated exactly and efficiently. We obtain a practical algorithm with a 1/4-approximation guarantee for a general class of non-monotone DPPs. Our algorithm also extends to MAP inference under complex polytope constraints, making it possible to combine DPPs with Markov random fields, weighted matchings, and other models. We demonstrate that our approach outperforms greedy methods on both synthetic and real-world data.
Author Information
Alex Kulesza (Google)
Jennifer A Gillenwater (University of Pennsylvania)
Ben Taskar (University of Washington)
Related Events (a corresponding poster, oral, or spotlight)
-
2012 Poster: Near-Optimal MAP Inference for Determinantal Point Processes »
Thu. Dec 6th through Wed the 5th Room Harrah’s Special Events Center 2nd Floor
More from the Same Authors
-
2014 Poster: Expectation-Maximization for Learning Determinantal Point Processes »
Jennifer A Gillenwater · Alex Kulesza · Emily Fox · Ben Taskar -
2013 Poster: Learning Adaptive Value of Information for Structured Prediction »
David J Weiss · Ben Taskar -
2013 Poster: Approximate Inference in Continuous Determinantal Processes »
Raja Hafiz Affandi · Emily Fox · Ben Taskar -
2013 Spotlight: Approximate Inference in Continuous Determinantal Processes »
Raja Hafiz Affandi · Emily Fox · Ben Taskar -
2010 Workshop: Coarse-to-Fine Learning and Inference »
Ben Taskar · David J Weiss · Benjamin J Sapp · Slav Petrov -
2010 Spotlight: Structured Determinantal Point Processes »
Alex Kulesza · Ben Taskar -
2010 Poster: Structured Determinantal Point Processes »
Alex Kulesza · Ben Taskar -
2010 Oral: Semi-Supervised Learning with Adversarially Missing Label Information »
Umar Syed · Ben Taskar -
2010 Session: Spotlights Session 3 »
Ben Taskar -
2010 Session: Oral Session 3 »
Ben Taskar -
2010 Poster: Semi-Supervised Learning with Adversarially Missing Label Information »
Umar Syed · Ben Taskar -
2010 Poster: Sidestepping Intractable Inference with Structured Ensemble Cascades »
David J Weiss · Benjamin J Sapp · Ben Taskar -
2009 Poster: Adaptive Regularization of Weight Vectors »
Yacov Crammer · Alex Kulesza · Mark Dredze -
2009 Poster: Posterior vs Parameter Sparsity in Latent Variable Models »
Joao V Graca · Kuzman Ganchev · Ben Taskar · Fernando Pereira -
2009 Spotlight: Posterior vs Parameter Sparsity in Latent Variable Models »
Joao V Graca · Kuzman Ganchev · Ben Taskar · Fernando Pereira -
2009 Spotlight: Adaptive Regularization of Weight Vectors »
Yacov Crammer · Alex Kulesza · Mark Dredze -
2009 Session: Oral Session 6: Theory, Optimization and Games »
Ben Taskar -
2007 Poster: Expectation Maximization, Posterior Constraints, and Statistical Alignment »
Kuzman Ganchev · Joao V Graca · Ben Taskar -
2007 Spotlight: Expectation Maximization, Posterior Constraints, and Statistical Alignment »
Kuzman Ganchev · Joao V Graca · Ben Taskar -
2007 Spotlight: Structured Learning with Approximate Inference »
Alex Kulesza · Fernando Pereira -
2007 Tutorial: Structured Prediction »
Ben Taskar -
2007 Poster: Structured Learning with Approximate Inference »
Alex Kulesza · Fernando Pereira -
2007 Poster: Learning Bounds for Domain Adaptation »
John Blitzer · Yacov Crammer · Alex Kulesza · Fernando Pereira · Jennifer Wortman Vaughan