Timezone: »

 
Spotlight Poster
Distribution-Free Statistical Dispersion Control for Societal Applications
Zhun Deng · Thomas Zollo · Jake Snell · Toniann Pitassi · Richard Zemel

Tue Dec 12 08:45 AM -- 10:45 AM (PST) @ Great Hall & Hall B1+B2 #1907

Explicit finite-sample statistical guarantees on model performance are an important ingredient in responsible machine learning. Previous work has focused mainly on bounding either the expected loss of a predictor or the probability that an individual prediction will incur a loss value in a specified range. However, for many high-stakes applications it is crucial to understand and control the \textit{dispersion} of a loss distribution, or the extent to which different members of a population experience unequal effects of algorithmic decisions. We initiate the study of distribution-free control of statistical dispersion measures with societal implications and propose a simple yet flexible framework that allows us to handle a much richer class of statistical functionals beyond previous work. Our methods are verified through experiments in toxic comment detection, medical imaging, and film recommendation.

Author Information

Zhun Deng (Columbia University)
Thomas Zollo (Columbia University)
Jake Snell (Princeton University)
Toniann Pitassi (University of Toronto and Columbia U)
Richard Zemel (Columbia University)

More from the Same Authors