Timezone: »
A machine learning model may exhibit discrimination when used to make decisions involving people. One potential cause for such outcomes is that the model uses a statistical proxy for a protected demographic attribute. In this paper we formulate a definition of proxy use for the setting of linear regression and present algorithms for detecting proxies. Our definition follows recent work on proxies in classification models, and characterizes a model's constituent behavior that: 1) correlates closely with a protected random variable, and 2) is causally influential in the overall behavior of the model. We show that proxies in linear regression models can be efficiently identified by solving a second-order cone program, and further extend this result to account for situations where the use of a certain input variable is justified as a ``business necessity''. Finally, we present empirical results on two law enforcement datasets that exhibit varying degrees of racial disparity in prediction outcomes, demonstrating that proxies shed useful light on the causes of discriminatory behavior in models.
Author Information
Samuel Yeom (Carnegie Mellon University)
Anupam Datta (Carnegie Mellon University)
Matt Fredrikson (CMU)
More from the Same Authors
-
2023 Poster: Grounding Neural Inference with Satisfiability Modulo Theories »
Matt Fredrikson · Kaiji Lu · Somesh Jha · Saranya Vijayakumar · Vijay Ganesh · Zifan Wang -
2023 Poster: Scaling in Depth: Unlocking Robustness Certification on ImageNet »
Kai Hu · Andy Zou · Zifan Wang · Klas Leino · Matt Fredrikson -
2021 Poster: Influence Patterns for Explaining Information Flow in BERT »
Kaiji Lu · Zifan Wang · Piotr Mardziel · Anupam Datta -
2021 : Exploring Conceptual Soundness with TruLens »
Anupam Datta · Matt Fredrikson · Klas Leino · Kaiji Lu · Shayak Sen · Ricardo C Shih · Zifan Wang -
2021 Poster: Relaxing Local Robustness »
Klas Leino · Matt Fredrikson -
2020 Poster: Smoothed Geometry for Robust Attribution »
Zifan Wang · Haofan Wang · Shakul Ramkumar · Piotr Mardziel · Matt Fredrikson · Anupam Datta -
2018 Workshop: Workshop on Security in Machine Learning »
Nicolas Papernot · Jacob Steinhardt · Matt Fredrikson · Kamalika Chaudhuri · Florian Tramer