Timezone: »
As algorithms are increasingly applied to screen applicants for high-stakes decisions in employment, education, lending, and other domains, concerns have been raised about the effects of "algorithmic monoculture", in which many decision-makers all rely on the same algorithm. This concern invokes analogies to agriculture, where a monocultural system runs the risk of severe harm from unexpected shocks. We present a set of basic models characterizing the potential risks from algorithmic monoculture, showing that monocultural convergence on a single algorithm by a group of decision-making agents, even when the algorithm is more accurate for any one agent in isolation, can reduce the overall quality of the decisions being made by the full collection of agents. Our results rely on minimal assumptions, and involve a combination of game-theoretic arguments about competing decision-makers with the development of a probabilistic framework for analyzing systems that use multiple noisy estimates of a set of alternatives. The talk is based on joint work with Manish Raghavan.
Author Information
Jon Kleinberg (Cornell University)
More from the Same Authors
-
2021 : Models of fairness in federated learning »
Kate Donahue · Jon Kleinberg -
2021 : Models of fairness in federated learning »
Kate Donahue · Jon Kleinberg -
2022 : Panel »
Meena Jagadeesan · Avrim Blum · Jon Kleinberg · Celestine Mendler-Dünner · Jennifer Wortman Vaughan · Chara Podimata -
2022 Poster: Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures »
Emmanuel Abbe · Samy Bengio · Elisabetta Cornacchia · Jon Kleinberg · Aryo Lotfi · Maithra Raghu · Chiyuan Zhang -
2021 : Spotlight 2: Models of fairness in federated learning »
Kate Donahue · Jon Kleinberg -
2021 Poster: Approximate Decomposable Submodular Function Minimization for Cardinality-Based Components »
Nate Veldt · Austin Benson · Jon Kleinberg -
2021 Poster: Optimality and Stability in Federated Learning: A Game-theoretic Approach »
Kate Donahue · Jon Kleinberg -
2021 Poster: Detecting Individual Decision-Making Style: Exploring Behavioral Stylometry in Chess »
Reid McIlroy-Young · Russell Wang · Siddhartha Sen · Jon Kleinberg · Ashton Anderson