Timezone: »
The Hessian of a differentiable convex function is positive semidefinite. Therefore, checking the Hessian of a given function is a natural approach to certify convexity. However, implementing this approach is not straightforward, since it requires a representation of the Hessian that allows its analysis. Here, we implement this approach for a class of functions that is rich enough to support classical machine learning. For this class of functions, it was recently shown how to compute computational graphs of their Hessians. We show how to check these graphs for positive-semidefiniteness. We compare our implementation of the Hessian approach with the well-established disciplined convex programming (DCP) approach and prove that the Hessian approach is at least as powerful as the DCP approach for differentiable functions. Furthermore, we show for a state-of-the-art implementation of the DCP approach that the Hessian approach is actually more powerful, that is, it can certify the convexity of a larger class of differentiable functions.
Author Information
Julien Klaus (Friedrich Schiller University Jena)
Niklas Merk (Friedrich-Schiller Universität Jena)
Konstantin Wiedom
Sören Laue (TU Kaiserslautern)
Joachim Giesen (Friedrich-Schiller-Universitat Jena)
More from the Same Authors
-
2019 : Posters and Coffee »
Sameer Kumar · Tomasz Kornuta · Oleg Bakhteev · Hui Guan · Xiaomeng Dong · Minsik Cho · Sören Laue · Theodoros Vasiloudis · Andreea Anghel · Erik Wijmans · Zeyuan Shang · Oleksii Kuchaiev · Ji Lin · Susan Zhang · Ligeng Zhu · Beidi Chen · Vinu Joseph · Jialin Ding · Jonathan Raiman · Ahnjae Shin · Vithursan Thangarasa · Anush Sankaran · Akhil Mathur · Martino Dazzi · Markus Löning · Darryl Ho · Emanuel Zgraggen · Supun Nakandala · Tomasz Kornuta · Rita Kuznetsova -
2019 Poster: GENO -- GENeric Optimization for Classical Machine Learning »
Sören Laue · Matthias Mitterreiter · Joachim Giesen -
2019 Demonstration: GENO -- Optimization for Classical Machine Learning Made Fast and Easy »
Sören Laue · Matthias Mitterreiter · Joachim Giesen -
2018 Poster: Computing Higher Order Derivatives of Matrix and Tensor Expressions »
Sören Laue · Matthias Mitterreiter · Joachim Giesen -
2017 Demonstration: Matrix Calculus -- The Power of Symbolic Differentiation »
Sören Laue · Matthias Mitterreiter · Joachim Giesen -
2012 Poster: Approximating Concavely Parameterized Optimization Problems »
Joachim Giesen · Jens K Mueller · Sören Laue · Sascha Swiercy -
2012 Oral: Approximating Concavely Parameterized Optimization Problems »
Joachim Giesen · Jens K Mueller · Sören Laue · Sascha Swiercy