Timezone: »
Machine learning algorithms are rapidly being adopted to aid pedagogical decision-making in applications ranging from grading to student placement. Are these algorithms fair? We prove that, for predicting students' math performance, the standard machine learning practice of selecting a model that maximizes predictive accuracy can result in algorithms that give significantly more benefit of the doubt to White, Asian students and are more punitive to Black, Hispanic, Native American students. This disparity is masked by comparatively high predictive accuracy across both groups. We suggest new interventions that help close this performance gap and do not require the use of a different algorithm for each student group. Together, our results suggest new best practices for applying machine learning to education-related applications.
Author Information
Haewon Jeong (Harvard University)
Michael D. Wu (Harvard University)
Nilanjana Dasgupta (University of Massachusetts, Amherst)
Muriel Medard (MIT)
Flavio Calmon (Harvard University)
More from the Same Authors
-
2022 Panel: Panel 1C-7: Beyond Adult and… & Uncalibrated Models Can… »
Kailas Vodrahalli · Flavio Calmon -
2022 Poster: Rashomon Capacity: A Metric for Predictive Multiplicity in Classification »
Hsiang Hsu · Flavio Calmon -
2022 Poster: Beyond Adult and COMPAS: Fair Multi-Class Prediction via Information Projection »
Wael Alghamdi · Hsiang Hsu · Haewon Jeong · Hao Wang · Peter Michalak · Shahab Asoodeh · Flavio Calmon -
2022 Poster: On the Epistemic Limits of Personalized Prediction »
Lucas Monteiro Paes · Carol Long · Berk Ustun · Flavio Calmon -
2021 : Poster Session 2 »
Yueqiu Sun · Haewon Jeong · Nrupatunga . · Hengyao Bao · Tongwen Huang · Debajyoti Datta -
2021 Poster: Analyzing the Generalization Capability of SGLD Using Properties of Gaussian Channels »
Hao Wang · Yizhe Huang · Rui Gao · Flavio Calmon -
2019 Poster: Same-Cluster Querying for Overlapping Clusters »
Wasim Huleihel · Arya Mazumdar · Muriel Medard · Soumyabrata Pal -
2018 : Posters 1 »
Wei Wei · Flavio Calmon · Travis Dick · Leilani Gilpin · Maroussia Lévesque · Malek Ben Salem · Michael Wang · Jack Fitzsimons · Dimitri Semenovich · Linda Gu · Nathaniel Fruchter -
2017 Poster: Optimized Pre-Processing for Discrimination Prevention »
Flavio Calmon · Dennis Wei · Bhanukiran Vinzamuri · Karthikeyan Natesan Ramamurthy · Kush Varshney