Timezone: »
Evaluating the Impact of Geometric and Statistical Skews on Out-Of-Distribution Generalization Performance
Aengus Lynch · Jean Kaddour · Ricardo Silva
Event URL: https://openreview.net/forum?id=ZweYSQ0pXmF »
Out-of-distribution (OOD) or domain generalization is the problem of generalizing to unseen distributions. Recent work suggests that the marginal difficulty of generalizing to OOD over in-distribution data (OOD-ID generalization gap) is due to spurious correlations, which arise due to statistical and geometric skews, and can be addressed by careful data augmentation and class balancing. We observe that after constructing a dataset where we remove all conceivable sources of spurious correlation between interpretable factors, classifiers still fail to close the OOD-ID generalization gap.
Author Information
Aengus Lynch (University College London, University of London)
Jean Kaddour (University College London)
Ricardo Silva (University College London)
More from the Same Authors
-
2022 : Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging »
Jean Kaddour -
2022 : Pragmatic Fairness: Optimizing Policies with Outcome Disparity Control »
Limor Gultchin · Siyuan Guo · Alan Malek · Silvia Chiappa · Ricardo Silva -
2022 : Evaluating the Impact of Geometric and Statistical Skews on Out-Of-Distribution Generalization Performance »
Aengus Lynch · Jean Kaddour · Ricardo Silva -
2022 : Partial identification without distributional assumptions »
Kirtan Padh · Jakob Zeitler · David Watson · Matt Kusner · Ricardo Silva · Niki Kilbertus -
2023 Poster: On Efficient Training Algorithms For Transformer Language Models »
Jean Kaddour · Oscar Key · Piotr Nawrot · Pasquale Minervini · Matt Kusner -
2023 Poster: Intervention Generalization: A View from Factor Graph Models »
Gecia Bravo-Hermsdorff · David Watson · Jialin Yu · Jakob Zeitler · Ricardo Silva -
2023 Poster: Towards Automated Circuit Discovery for Mechanistic Interpretability »
Arthur Conmy · Augustine Mavor-Parker · Aengus Lynch · Stefan Heimersheim · Adrià Garriga-Alonso -
2023 Poster: Evaluating Self-Supervised Learning for Molecular Graph Embeddings »
Hanchen Wang · Jean Kaddour · Shengchao Liu · Jian Tang · Joan Lasenby · Qi Liu -
2022 Poster: When Do Flat Minima Optimizers Work? »
Jean Kaddour · Linqing Liu · Ricardo Silva · Matt Kusner -
2021 : Ricardo Silva - The Road to Causal Programming »
Ricardo Silva -
2021 Poster: Causal Effect Inference for Structured Treatments »
Jean Kaddour · Yuchen Zhu · Qi Liu · Matt Kusner · Ricardo Silva -
2020 : Invited Talk: On Prediction, Action and Interference »
Ricardo Silva -
2020 Poster: Probabilistic Active Meta-Learning »
Jean Kaddour · Steindor Saemundsson · Marc Deisenroth -
2020 Poster: A Class of Algorithms for General Instrumental Variable Models »
Niki Kilbertus · Matt Kusner · Ricardo Silva -
2018 Poster: Bayesian Semi-supervised Learning with Graph Gaussian Processes »
Yin Cheng Ng · Nicolò Colombo · Ricardo Silva -
2017 Workshop: From 'What If?' To 'What Next?' : Causal Inference and Machine Learning for Intelligent Decision Making »
Ricardo Silva · Panagiotis Toulis · John Shawe-Taylor · Alexander Volfovsky · Thorsten Joachims · Lihong Li · Nathan Kallus · Adith Swaminathan -
2017 Poster: Counterfactual Fairness »
Matt Kusner · Joshua Loftus · Chris Russell · Ricardo Silva -
2017 Oral: Counterfactual Fairness »
Matt Kusner · Joshua Loftus · Chris Russell · Ricardo Silva -
2017 Poster: Tomography of the London Underground: a Scalable Model for Origin-Destination Data »
Nicolò Colombo · Ricardo Silva · Soong Moon Kang -
2017 Poster: When Worlds Collide: Integrating Different Counterfactual Assumptions in Fairness »
Chris Russell · Matt Kusner · Joshua Loftus · Ricardo Silva -
2016 Workshop: "What If?" Inference and Learning of Hypothetical and Counterfactual Interventions in Complex Systems »
Ricardo Silva · John Shawe-Taylor · Adith Swaminathan · Thorsten Joachims -
2016 Poster: Observational-Interventional Priors for Dose-Response Learning »
Ricardo Silva -
2016 Poster: Scaling Factorial Hidden Markov Models: Stochastic Variational Inference without Messages »
Yin Cheng Ng · Pawel M Chilinski · Ricardo Silva -
2014 Poster: Causal Inference through a Witness Protection Program »
Ricardo Silva · Robin Evans -
2013 Poster: Flexible sampling of discrete data correlations without the marginal distributions »
Alfredo Kalaitzis · Ricardo Silva -
2011 Poster: Thinning Measurement Models and Questionnaire Design »
Ricardo Silva -
2007 Poster: Hidden Common Cause Relations in Relational Learning »
Ricardo Silva · Wei Chu · Zoubin Ghahramani -
2007 Spotlight: Hidden Common Cause Relations in Relational Learning »
Ricardo Silva · Wei Chu · Zoubin Ghahramani