Timezone: »
We consider the task of training machine learning models with data-dependent constraints. Such constraints often arise as empirical versions of expected value constraints that enforce fairness or stability goals. We reformulate data-dependent constraints so that they are calibrated: enforcing the reformulated constraints guarantees that their expected value counterparts are satisfied with a user-prescribed probability. The resulting optimization problem is amendable to standard stochastic optimization algorithms, and we demonstrate the efficacy of our method on a fairness-sensitive classification task where we wish to guarantee the classifier's fairness (at test time).
Author Information
Songkai Xue (University of Michigan)
Education: - Ph.D. candidate, Statistics, University of Michigan, September 2020 - Present; - M.S., Applied Statistics, University of Michigan, May 2020; - B.S., Statistics, Peking University, July 2018. Research interests: - Fairness, Privacy, Robustness, and Interpretability in ML; - Learning under Distribution Shift; - Deep Learning Theory; - Statistical Network Analysis.
Yuekai Sun (University of Michigan)
Mikhail Yurochkin (IBM Research, MIT-IBM Watson AI Lab)
I am a Research Staff Member at IBM Research and MIT-IBM Watson AI Lab in Cambridge, Massachusetts. My research interests are - Algorithmic Fairness - Out-of-Distribution Generalization - Applications of Optimal Transport in Machine Learning - Model Fusion and Federated Learning Before joining IBM, I completed my PhD in Statistics at the University of Michigan, where I worked with Long Nguyen. I received my Bachelor's degree in applied mathematics and physics from Moscow Institute of Physics and Technology.
More from the Same Authors
-
2021 : Measuring the sensitivity of Gaussian processes to kernel choice »
Will Stephenson · Soumya Ghosh · Tin Nguyen · Mikhail Yurochkin · Sameer Deshpande · Tamara Broderick -
2022 Panel: Panel 2B-2: One Positive Label… & Calibrated Data-Dependent Constraints… »
Songkai Xue · Ning Xu -
2022 Poster: Domain Adaptation meets Individual Fairness. And they get along. »
Debarghya Mukherjee · Felix Petersen · Mikhail Yurochkin · Yuekai Sun -
2021 Poster: Does enforcing fairness mitigate biases caused by subpopulation shift? »
Subha Maity · Debarghya Mukherjee · Mikhail Yurochkin · Yuekai Sun -
2021 Poster: Post-processing for Individual Fairness »
Felix Petersen · Debarghya Mukherjee · Yuekai Sun · Mikhail Yurochkin -
2021 Poster: On sensitivity of meta-learning to support data »
Mayank Agarwal · Mikhail Yurochkin · Yuekai Sun -
2020 Poster: Continuous Regularized Wasserstein Barycenters »
Lingxiao Li · Aude Genevay · Mikhail Yurochkin · Justin Solomon -
2020 Demonstration: IBM Federated Learning Community Edition: An Interactive Demonstration »
Laura Wynter · Chaitanya Kumar · Pengqian Yu · Mikhail Yurochkin · Amogh Tarcar -
2019 Poster: Alleviating Label Switching with Optimal Transport »
Pierre Monteiller · Sebastian Claici · Edward Chien · Farzaneh Mirzazadeh · Justin Solomon · Mikhail Yurochkin -
2019 Poster: Hierarchical Optimal Transport for Document Representation »
Mikhail Yurochkin · Sebastian Claici · Edward Chien · Farzaneh Mirzazadeh · Justin Solomon -
2019 Poster: Scalable inference of topic evolution via models for latent geometric structures »
Mikhail Yurochkin · Zhiwei Fan · Aritra Guha · Paraschos Koutris · XuanLong Nguyen -
2019 Poster: Statistical Model Aggregation via Parameter Matching »
Mikhail Yurochkin · Mayank Agarwal · Soumya Ghosh · Kristjan Greenewald · Nghia Hoang -
2017 Poster: Conic Scan-and-Cover algorithms for nonparametric topic modeling »
Mikhail Yurochkin · Aritra Guha · XuanLong Nguyen -
2017 Poster: Multi-way Interacting Regression via Factorization Machines »
Mikhail Yurochkin · XuanLong Nguyen · nikolaos Vasiloglou -
2016 Poster: Geometric Dirichlet Means Algorithm for topic inference »
Mikhail Yurochkin · XuanLong Nguyen