Timezone: »
Conformal inference, cross-validation+, and the jackknife+ are hold-out methods that can be combined with virtually any machine learning algorithm to construct prediction sets with guaranteed marginal coverage. In this paper, we develop specialized versions of these techniques for categorical and unordered response labels that, in addition to providing marginal coverage, are also fully adaptive to complex data distributions, in the sense that they perform favorably in terms of approximate conditional coverage compared to alternative methods. The heart of our contribution is a novel conformity score, which we explicitly demonstrate to be powerful and intuitive for classification problems, but whose underlying principle is potentially far more general. Experiments on synthetic and real data demonstrate the practical value of our theoretical guarantees, as well as the statistical advantages of the proposed methods over the existing alternatives.
Author Information
Yaniv Romano (Stanford University)
Matteo Sesia (University of Southern California)
Matteo Sesia is an assistant professor in the Department of Data Sciences and Operations, at the University of Southern California, Marshall School of Business.
Emmanuel Candes (Stanford University)
Related Events (a corresponding poster, oral, or spotlight)
-
2020 Spotlight: Classification with Valid and Adaptive Coverage »
Tue. Dec 8th 04:00 -- 04:10 PM Room Orals & Spotlights: Clustering/Ranking
More from the Same Authors
-
2021 Spotlight: Conformal Prediction using Conditional Histograms »
Matteo Sesia · Yaniv Romano -
2022 Poster: Conformal Frequency Estimation with Sketched Data »
Matteo Sesia · Stefano Favaro -
2023 Poster: Conformal Scorecasting: Anticipatory Uncertainty Quantification for Distribution Shift in Time Series »
Anastasios Angelopoulos · Ryan Tibshirani · Emmanuel Candes -
2023 Poster: Uncertainty Quantification over Graph with Conformalized Graph Neural Networks »
Kexin Huang · Ying Jin · Emmanuel Candes · Jure Leskovec -
2023 Poster: Derandomized novelty detection with FDR control via conformal e-values »
Meshi Bashari · Amir Epstein · Yaniv Romano · Matteo Sesia -
2022 Poster: Training Uncertainty-Aware Classifiers with Conformalized Deep Learning »
Bat-Sheva Einbinder · Yaniv Romano · Matteo Sesia · Yanfei Zhou -
2022 Invited Talk: Conformal Prediction in 2022 »
Emmanuel Candes -
2021 Oral: Adaptive Conformal Inference Under Distribution Shift »
Isaac Gibbs · Emmanuel Candes -
2021 Poster: Adaptive Conformal Inference Under Distribution Shift »
Isaac Gibbs · Emmanuel Candes -
2021 Poster: Improving Conditional Coverage via Orthogonal Quantile Regression »
Shai Feldman · Stephen Bates · Yaniv Romano -
2021 Poster: Conformal Prediction using Conditional Histograms »
Matteo Sesia · Yaniv Romano -
2020 Poster: Achieving Equalized Odds by Resampling Sensitive Attributes »
Yaniv Romano · Stephen Bates · Emmanuel Candes -
2019 Poster: Conformalized Quantile Regression »
Yaniv Romano · Evan Patterson · Emmanuel Candes -
2019 Poster: Conformal Prediction Under Covariate Shift »
Ryan Tibshirani · Rina Barber · Emmanuel Candes · Aaditya Ramdas -
2015 Poster: Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems »
Yuxin Chen · Emmanuel Candes -
2015 Oral: Solving Random Quadratic Systems of Equations Is Nearly as Easy as Solving Linear Systems »
Yuxin Chen · Emmanuel Candes -
2014 Poster: A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights »
Weijie Su · Stephen Boyd · Emmanuel Candes -
2014 Spotlight: A Differential Equation for Modeling Nesterov’s Accelerated Gradient Method: Theory and Insights »
Weijie Su · Stephen Boyd · Emmanuel Candes