Timezone: »
Decision-makers can reject model forecasts and steer clear of expensive blunders by being aware of when an AI model is unsure about its predictions. In general, one anticipates a prediction model’s performance to improve at the expense of lessening coverage when a reject option is made available (i.e., by predicting on fewer samples). However, such an enhancement might not be seen by all the data’s subpopulations and might even have negative effects on some of them. We’ll cover techniques to make selective classification [1] and regression [2] effective for everyone in this talk as well as current developments in trustworthy uncertainty quantification. The use of generative models to inform decision-makers about the areas of high and low confidence in AI will also be covered in this session. We will examine a few sample cases in-depth using an open-source toolkit called UQ360 (https://github.com/IBM/UQ360) to demonstrate how uncertainty relates to other principles of trustworthy AI.
Author Information
Prasanna Sattigeri (IBM Research)
More from the Same Authors
-
2022 : Physics-Constrained Deep Learning for Climate Downscaling »
Paula Harder · Qidong Yang · Venkatesh Ramesh · Prasanna Sattigeri · Alex Hernandez-Garcia · Campbell Watson · Daniela Szwarcman · David Rolnick -
2022 : Generating physically-consistent high-resolution climate data with hard-constrained neural networks »
Paula Harder · Qidong Yang · Venkatesh Ramesh · Prasanna Sattigeri · Alex Hernandez-Garcia · Campbell Watson · Daniela Szwarcman · David Rolnick -
2022 Poster: Fair Infinitesimal Jackknife: Mitigating the Influence of Biased Training Data Points Without Refitting »
Prasanna Sattigeri · Soumya Ghosh · Inkit Padhi · Pierre Dognin · Kush Varshney -
2021 Poster: Scalable Intervention Target Estimation in Linear Models »
Burak Varici · Karthikeyan Shanmugam · Prasanna Sattigeri · Ali Tajer -
2020 Poster: Optimizing Mode Connectivity via Neuron Alignment »
Norman J Tatro · Pin-Yu Chen · Payel Das · Igor Melnyk · Prasanna Sattigeri · Rongjie Lai -
2019 : Coffee Break and Poster Session »
Rameswar Panda · Prasanna Sattigeri · Kush Varshney · Karthikeyan Natesan Ramamurthy · Harvineet Singh · Vishwali Mhasawade · Shalmali Joshi · Laleh Seyyed-Kalantari · Matthew McDermott · Gal Yona · James Atwood · Hansa Srinivasan · Yonatan Halpern · D. Sculley · Behrouz Babaki · Margarida Carvalho · Josie Williams · Narges Razavian · Haoran Zhang · Amy Lu · Irene Y Chen · Xiaojie Mao · Angela Zhou · Nathan Kallus -
2019 Poster: Learning New Tricks From Old Dogs: Multi-Source Transfer Learning From Pre-Trained Networks »
Joshua Lee · Prasanna Sattigeri · Gregory Wornell -
2018 Demonstration: PatentAI: IP Infringement Detection with Enhanced Paraphrase Identification »
Youssef Drissi · Karthikeyan Natesan Ramamurthy · Prasanna Sattigeri -
2018 Poster: Co-regularized Alignment for Unsupervised Domain Adaptation »
Abhishek Kumar · Prasanna Sattigeri · Kahini Wadhawan · Leonid Karlinsky · Rogerio Feris · Bill Freeman · Gregory Wornell -
2017 Poster: Semi-supervised Learning with GANs: Manifold Invariance with Improved Inference »
Abhishek Kumar · Prasanna Sattigeri · Tom Fletcher