Timezone: »
Consider the problem of improving the estimation of conditional average treatment effects (CATE) for a target domain of interest by leveraging related information from a source domain with a different feature space. This heterogeneous transfer learning problem for CATE estimation is ubiquitous in areas such as healthcare where we may wish to evaluate the effectiveness of a treatment for a new patient population for which different clinical covariates and limited data are available. In this paper, we address this problem by introducing several building blocks that use representation learning to handle the heterogeneous feature spaces and a flexible multi-task architecture with shared and private layers to transfer information between potential outcome functions across domains. Then, we show how these building blocks can be used to recover transfer learning equivalents of the standard CATE learners. On a new semi-synthetic data simulation benchmark for heterogeneous transfer learning, we not only demonstrate performance improvements of our heterogeneous transfer causal effect learners across datasets, but also provide insights into the differences between these learners from a transfer perspective.
Author Information
Ioana Bica (DeepMind)
Mihaela van der Schaar (University of Cambridge)
More from the Same Authors
-
2021 Spotlight: On Inductive Biases for Heterogeneous Treatment Effect Estimation »
Alicia Curth · Mihaela van der Schaar -
2021 Spotlight: Explaining Latent Representations with a Corpus of Examples »
Jonathan Crabbe · Zhaozhi Qian · Fergus Imrie · Mihaela van der Schaar -
2021 : Really Doing Great at Estimating CATE? A Critical Look at ML Benchmarking Practices in Treatment Effect Estimation »
Alicia Curth · David Svensson · Jim Weatherall · Mihaela van der Schaar -
2021 : The Medkit-Learn(ing) Environment: Medical Decision Modelling through Simulation »
Alex Chan · Ioana Bica · Alihan Hüyük · Daniel Jarrett · Mihaela van der Schaar -
2022 : Adaptively Identifying Patient Populations With Treatment Benefit in Clinical Trials »
Alicia Curth · Alihan Hüyük · Mihaela van der Schaar -
2022 : D-CIPHER: Discovery of Closed-form Partial Differential Equations »
Krzysztof Kacprzyk · Zhaozhi Qian · Mihaela van der Schaar -
2023 : Optimising Human-AI Collaboration by Learning Convincing Explanations »
Alex Chan · Alihan Hüyük · Mihaela van der Schaar -
2023 : Shape Arithmetic Expressions »
Krzysztof Kacprzyk · Mihaela van der Schaar -
2023 : The Optimization Conundrum: Balancing Data, Speed, and Accuracy in Real-Time Machine Learnin »
Mihaela van der Schaar -
2023 : [Paper-Oral 1] Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RL »
Hao Sun · Alihan Hüyük · Mihaela van der Schaar -
2023 Workshop: Synthetic Data Generation with Generative AI »
Sergul Aydore · Zhaozhi Qian · Mihaela van der Schaar -
2023 Poster: What is Flagged in Uncertainty Quantification? Latent Density Models for Uncertainty Categorization »
Hao Sun · Boris van Breugel · Jonathan Crabbé · Nabeel Seedat · Mihaela van der Schaar -
2023 Poster: Can You Rely on Your Model Evaluation? Improving Model Evaluation with Synthetic Test Data »
Boris van Breugel · Nabeel Seedat · Fergus Imrie · Mihaela van der Schaar -
2023 Poster: Reimagining Synthetic Tabular Data Generation through Data-Centric AI: A Comprehensive Benchmark »
Lasse Hansen · Nabeel Seedat · Mihaela van der Schaar · Andrija Petrovic -
2023 Poster: Active Observing in Continuous-time Control »
Samuel Holt · Alihan Hüyük · Mihaela van der Schaar -
2023 Poster: D-CIPHER: Discovery of Closed-form Partial Differential Equations »
Krzysztof Kacprzyk · Zhaozhi Qian · Mihaela van der Schaar -
2023 Poster: Risk-Averse Active Sensing for Timely Outcome Prediction under Cost Pressure »
Yuchao Qin · Mihaela van der Schaar · Changhee Lee -
2023 Poster: Joint Training of Deep Ensembles Fails Due to Learner Collusion »
Alan Jeffares · Tennison Liu · Jonathan Crabbé · Mihaela van der Schaar -
2023 Poster: Accountability in Offline Reinforcement Learning: Explaining Decisions with a Corpus of Examples »
Hao Sun · Alihan Hüyük · Daniel Jarrett · Mihaela van der Schaar -
2023 Poster: TRIAGE: Characterizing and auditing training data for improved regression »
Nabeel Seedat · Jonathan Crabbé · Zhaozhi Qian · Mihaela van der Schaar -
2023 Poster: A U-turn on Double Descent: Rethinking Parameter Counting in Statistical Learning »
Alicia Curth · Alan Jeffares · Mihaela van der Schaar -
2023 Poster: Evaluating the Robustness of Interpretability Methods through Explanation Invariance and Equivariance »
Jonathan Crabbé · Mihaela van der Schaar -
2023 Poster: AllSim: Simulating and Benchmarking Resource Allocation Policies in Multi-User Systems »
Jeroen Berrevoets · Daniel Jarrett · Alex Chan · Mihaela van der Schaar -
2023 Poster: Synthcity: a benchmark framework for diverse use cases of tabular synthetic data »
Zhaozhi Qian · Rob Davis · Mihaela van der Schaar -
2023 Oral: A U-turn on Double Descent: Rethinking Parameter Counting in Statistical Learning »
Alicia Curth · Alan Jeffares · Mihaela van der Schaar -
2023 Tutorial: Data-Centric AI for reliable and responsible AI: from theory to practice »
Mihaela van der Schaar · Isabelle Guyon · Nabeel Seedat -
2022 : Practical Approaches for Fair Learning with Multitype and Multivariate Sensitive Attributes »
Tennison Liu · Alex Chan · Boris van Breugel · Mihaela van der Schaar -
2022 : Closing Remarks »
Cheng Zhang · Mihaela van der Schaar -
2022 : Panel Discussion »
Cheng Zhang · Mihaela van der Schaar · Ilya Shpitser · Aapo Hyvarinen · Yoshua Bengio · Bernhard Schölkopf -
2022 Workshop: Causal Machine Learning for Real-World Impact »
Nick Pawlowski · Jeroen Berrevoets · Caroline Uhler · Kun Zhang · Mihaela van der Schaar · Cheng Zhang -
2022 : Opening Remarks »
Cheng Zhang · Mihaela van der Schaar -
2022 Workshop: Synthetic Data for Empowering ML Research »
Mihaela van der Schaar · Zhaozhi Qian · Sergul Aydore · Dimitris Vlitas · Dino Oglic · Tucker Balch -
2022 Poster: Concept Activation Regions: A Generalized Framework For Concept-Based Explanations »
Jonathan Crabbé · Mihaela van der Schaar -
2022 Poster: Online Decision Mediation »
Daniel Jarrett · Alihan Hüyük · Mihaela van der Schaar -
2022 Poster: Benchmarking Heterogeneous Treatment Effect Models through the Lens of Interpretability »
Jonathan Crabbé · Alicia Curth · Ioana Bica · Mihaela van der Schaar -
2022 Poster: Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data »
Nabeel Seedat · Jonathan Crabbé · Ioana Bica · Mihaela van der Schaar -
2022 Poster: Composite Feature Selection Using Deep Ensembles »
Fergus Imrie · Alexander Norcliffe · Pietro Lió · Mihaela van der Schaar -
2022 Poster: Synthetic Model Combination: An Instance-wise Approach to Unsupervised Ensemble Learning »
Alex Chan · Mihaela van der Schaar -
2021 : Invited talk 8 »
Mihaela van der Schaar -
2021 : Invited talk #5: Mihaela van der Schaar »
Mihaela van der Schaar -
2021 : Mihaela Van Der Schaar Q&A »
Mihaela van der Schaar -
2021 : Mihaela Van Der Schaar »
Mihaela van der Schaar -
2021 Poster: Invariant Causal Imitation Learning for Generalizable Policies »
Ioana Bica · Daniel Jarrett · Mihaela van der Schaar -
2021 Poster: Explaining Latent Representations with a Corpus of Examples »
Jonathan Crabbe · Zhaozhi Qian · Fergus Imrie · Mihaela van der Schaar -
2021 Poster: Time-series Generation by Contrastive Imitation »
Daniel Jarrett · Ioana Bica · Mihaela van der Schaar -
2021 Poster: Closing the loop in medical decision support by understanding clinical decision-making: A case study on organ transplantation »
Yuchao Qin · Fergus Imrie · Alihan Hüyük · Daniel Jarrett · alexander gimson · Mihaela van der Schaar -
2021 Poster: DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networks »
Boris van Breugel · Trent Kyono · Jeroen Berrevoets · Mihaela van der Schaar -
2021 Poster: MIRACLE: Causally-Aware Imputation via Learning Missing Data Mechanisms »
Trent Kyono · Yao Zhang · Alexis Bellot · Mihaela van der Schaar -
2021 Poster: Conformal Time-series Forecasting »
Kamile Stankeviciute · Ahmed Alaa · Mihaela van der Schaar -
2021 Poster: Integrating Expert ODEs into Neural ODEs: Pharmacology and Disease Progression »
Zhaozhi Qian · William Zame · Lucas Fleuren · Paul Elbers · Mihaela van der Schaar -
2021 Poster: SurvITE: Learning Heterogeneous Treatment Effects from Time-to-Event Data »
Alicia Curth · Changhee Lee · Mihaela van der Schaar -
2021 Poster: On Inductive Biases for Heterogeneous Treatment Effect Estimation »
Alicia Curth · Mihaela van der Schaar -
2021 Poster: SyncTwin: Treatment Effect Estimation with Longitudinal Outcomes »
Zhaozhi Qian · Yao Zhang · Ioana Bica · Angela Wood · Mihaela van der Schaar -
2021 Poster: Estimating Multi-cause Treatment Effects via Single-cause Perturbation »
Zhaozhi Qian · Alicia Curth · Mihaela van der Schaar -
2020 Poster: Robust Recursive Partitioning for Heterogeneous Treatment Effects with Uncertainty Quantification »
Hyun-Suk Lee · Yao Zhang · William Zame · Cong Shen · Jang-Won Lee · Mihaela van der Schaar -
2020 Poster: Learning outside the Black-Box: The pursuit of interpretable models »
Jonathan Crabbe · Yao Zhang · William Zame · Mihaela van der Schaar -
2020 Poster: Strictly Batch Imitation Learning by Energy-based Distribution Matching »
Daniel Jarrett · Ioana Bica · Mihaela van der Schaar -
2020 Poster: Estimating the Effects of Continuous-valued Interventions using Generative Adversarial Networks »
Ioana Bica · James Jordon · Mihaela van der Schaar -
2020 Poster: Gradient Regularized V-Learning for Dynamic Treatment Regimes »
Yao Zhang · Mihaela van der Schaar -
2020 Poster: OrganITE: Optimal transplant donor organ offering using an individual treatment effect »
Jeroen Berrevoets · James Jordon · Ioana Bica · alexander gimson · Mihaela van der Schaar -
2020 : Q&A for invited speaker, Mihaela van der Schaar »
Mihaela van der Schaar -
2020 : Interpretable AutoML: Powering the machine learning revolution in healthcare in the era of Covid-19 and beyond »
Mihaela van der Schaar -
2020 Poster: CASTLE: Regularization via Auxiliary Causal Graph Discovery »
Trent Kyono · Yao Zhang · Mihaela van der Schaar -
2020 Poster: VIME: Extending the Success of Self- and Semi-supervised Learning to Tabular Domain »
Jinsung Yoon · Yao Zhang · James Jordon · Mihaela van der Schaar -
2020 Poster: When and How to Lift the Lockdown? Global COVID-19 Scenario Analysis and Policy Assessment using Compartmental Gaussian Processes »
Zhaozhi Qian · Ahmed Alaa · Mihaela van der Schaar -
2020 Oral: When and How to Lift the Lockdown? Global COVID-19 Scenario Analysis and Policy Assessment using Compartmental Gaussian Processes »
Zhaozhi Qian · Ahmed Alaa · Mihaela van der Schaar -
2019 Poster: Attentive State-Space Modeling of Disease Progression »
Ahmed Alaa · Mihaela van der Schaar -
2019 Poster: Demystifying Black-box Models with Symbolic Metamodels »
Ahmed Alaa · Mihaela van der Schaar -
2019 Poster: Time-series Generative Adversarial Networks »
Jinsung Yoon · Daniel Jarrett · Mihaela van der Schaar -
2019 Poster: Differentially Private Bagging: Improved utility and cheaper privacy than subsample-and-aggregate »
James Jordon · Jinsung Yoon · Mihaela van der Schaar -
2019 Poster: Conditional Independence Testing using Generative Adversarial Networks »
Alexis Bellot · Mihaela van der Schaar -
2019 Spotlight: Conditional Independence Testing using Generative Adversarial Networks »
Alexis Bellot · Mihaela van der Schaar -
2018 Poster: Multitask Boosting for Survival Analysis with Competing Risks »
Alexis Bellot · Mihaela van der Schaar -
2018 Poster: Forecasting Treatment Responses Over Time Using Recurrent Marginal Structural Networks »
Bryan Lim · Ahmed Alaa · Mihaela van der Schaar -
2017 : Coffee break and Poster Session II »
Mohamed Kane · Albert Haque · Vagelis Papalexakis · John Guibas · Peter Li · Carlos Arias · Eric Nalisnick · Padhraic Smyth · Frank Rudzicz · Xia Zhu · Theodore Willke · Noemie Elhadad · Hans Raffauf · Harini Suresh · Paroma Varma · Yisong Yue · Ognjen (Oggi) Rudovic · Luca Foschini · Syed Rameel Ahmad · Hasham ul Haq · Valerio Maggio · Giuseppe Jurman · Sonali Parbhoo · Pouya Bashivan · Jyoti Islam · Mirco Musolesi · Chris Wu · Alexander Ratner · Jared Dunnmon · Cristóbal Esteban · Aram Galstyan · Greg Ver Steeg · Hrant Khachatrian · Marc Górriz · Mihaela van der Schaar · Anton Nemchenko · Manasi Patwardhan · Tanay Tandon -
2017 Poster: DPSCREEN: Dynamic Personalized Screening »
Kartik Ahuja · William Zame · Mihaela van der Schaar -
2017 Poster: Deep Multi-task Gaussian Processes for Survival Analysis with Competing Risks »
Ahmed Alaa · Mihaela van der Schaar -
2017 Spotlight: Deep Multi-task Gaussian Processes for Survival Analysis with Competing Risks »
Ahmed Alaa · Mihaela van der Schaar -
2017 Poster: Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processes »
Ahmed Alaa · Mihaela van der Schaar -
2016 Poster: Balancing Suspense and Surprise: Timely Decision Making with Endogenous Information Acquisition »
Ahmed Alaa · Mihaela van der Schaar -
2016 Poster: A Non-parametric Learning Method for Confidently Estimating Patient's Clinical State and Dynamics »
William Hoiles · Mihaela van der Schaar -
2014 Poster: Discovering, Learning and Exploiting Relevance »
Cem Tekin · Mihaela van der Schaar