Timezone: »
While a typical supervised learning framework assumes that the inputs and the outputs are measured at the same levels of granularity, many applications, including global mapping of disease, only have access to outputs at a much coarser level than that of the inputs. Aggregation of outputs makes generalization to new inputs much more difficult. We consider an approach to this problem based on variational learning with a model of output aggregation and Gaussian processes, where aggregation leads to intractability of the standard evidence lower bounds. We propose new bounds and tractable approximations, leading to improved prediction accuracy and scalability to large datasets, while explicitly taking uncertainty into account. We develop a framework which extends to several types of likelihoods, including the Poisson model for aggregated count data. We apply our framework to a challenging and important problem, the fine-scale spatial modelling of malaria incidence, with over 1 million observations.
Author Information
Ho Chung Law (University of Oxford)
Dino Sejdinovic (University of Oxford)
Ewan Cameron
Tim Lucas (University of Oxford)
Seth Flaxman (Imperial College London)
Katherine Battle (University of Oxford)
Kenji Fukumizu (Institute of Statistical Mathematics)
More from the Same Authors
-
2023 Poster: Transfer Learning with Affine Model Transformation »
Shunya Minami · Kenji Fukumizu · Yoshihiro Hayashi · Ryo Yoshida -
2022 Poster: Invariance Learning based on Label Hierarchy »
Shoji Toyota · Kenji Fukumizu -
2022 Poster: Unsupervised Learning of Equivariant Structure from Sequences »
Takeru Miyato · Masanori Koyama · Kenji Fukumizu -
2021 Poster: BayesIMP: Uncertainty Quantification for Causal Data Fusion »
Siu Lun Chau · Jean-Francois Ton · Javier González · Yee Teh · Dino Sejdinovic -
2021 Poster: Deconditional Downscaling with Gaussian Processes »
Siu Lun Chau · Shahine Bouabid · Dino Sejdinovic -
2020 Poster: Bayesian Probabilistic Numerical Integration with Tree-Based Models »
Harrison Zhu · Xing Liu · Ruya Kang · Zhichao Shen · Seth Flaxman · Francois-Xavier Briol -
2020 Poster: Robust Persistence Diagrams using Reproducing Kernels »
Siddharth Vishwanath · Kenji Fukumizu · Satoshi Kuriki · Bharath Sriperumbudur -
2019 Poster: Semi-flat minima and saddle points by embedding neural networks to overparameterization »
Kenji Fukumizu · Shoichiro Yamaguchi · Yoh-ichi Mototake · Mirai Tanaka -
2019 Poster: Hyperparameter Learning via Distributional Transfer »
Ho Chung Law · Peilin Zhao · Leung Sing Chan · Junzhou Huang · Dino Sejdinovic -
2019 Poster: Tree-Sliced Variants of Wasserstein Distances »
Tam Le · Makoto Yamada · Kenji Fukumizu · Marco Cuturi -
2018 : Hyperparameter Learning via Distributional Transfer »
Ho Chung Law -
2018 Poster: Causal Inference via Kernel Deviance Measures »
Jovana Mitrovic · Dino Sejdinovic · Yee Whye Teh -
2018 Spotlight: Causal Inference via Kernel Deviance Measures »
Jovana Mitrovic · Dino Sejdinovic · Yee Whye Teh -
2018 Poster: Hamiltonian Variational Auto-Encoder »
Anthony Caterini · Arnaud Doucet · Dino Sejdinovic -
2017 : Learning on topological and geometrical structures of data. »
Kenji Fukumizu -
2017 Poster: A Linear-Time Kernel Goodness-of-Fit Test »
Wittawat Jitkrittum · Wenkai Xu · Zoltan Szabo · Kenji Fukumizu · Arthur Gretton -
2017 Oral: A Linear-Time Kernel Goodness-of-Fit Test »
Wittawat Jitkrittum · Wenkai Xu · Zoltan Szabo · Kenji Fukumizu · Arthur Gretton -
2017 Poster: Testing and Learning on Distributions with Symmetric Noise Invariance »
Ho Chung Law · Christopher Yau · Dino Sejdinovic -
2017 Poster: Trimmed Density Ratio Estimation »
Song Liu · Akiko Takeda · Taiji Suzuki · Kenji Fukumizu -
2016 Poster: Convergence guarantees for kernel-based quadrature rules in misspecified settings »
Motonobu Kanagawa · Bharath Sriperumbudur · Kenji Fukumizu -
2012 Poster: Learning from Distributions via Support Measure Machines »
Krikamol Muandet · Kenji Fukumizu · Francesco Dinuzzo · Bernhard Schölkopf -
2012 Poster: Gradient-based kernel method for feature extraction and variable selection »
Kenji Fukumizu · Chenlei Leng -
2012 Spotlight: Learning from Distributions via Support Measure Machines »
Krikamol Muandet · Kenji Fukumizu · Francesco Dinuzzo · Bernhard Schölkopf -
2012 Poster: Optimal kernel choice for large-scale two-sample tests »
Arthur Gretton · Bharath Sriperumbudur · Dino Sejdinovic · Heiko Strathmann · Sivaraman Balakrishnan · Massimiliano Pontil · Kenji Fukumizu -
2011 Poster: Kernel Bayes' Rule »
Kenji Fukumizu · Le Song · Arthur Gretton -
2011 Poster: Learning in Hilbert vs. Banach Spaces: A Measure Embedding Viewpoint »
Bharath Sriperumbudur · Kenji Fukumizu · Gert Lanckriet -
2009 Poster: Kernel Choice and Classifiability for RKHS Embeddings of Probability Distributions »
Bharath Sriperumbudur · Kenji Fukumizu · Arthur Gretton · Gert Lanckriet · Bernhard Schölkopf -
2009 Oral: Kernel Choice and Classifiability for RKHS Embeddings of Probability Distributions »
Bharath Sriperumbudur · Kenji Fukumizu · Arthur Gretton · Gert Lanckriet · Bernhard Schölkopf -
2009 Poster: Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation »
Yusuke Watanabe · Kenji Fukumizu -
2009 Spotlight: Graph Zeta Function in the Bethe Free Energy and Loopy Belief Propagation »
Yusuke Watanabe · Kenji Fukumizu -
2009 Poster: A Fast, Consistent Kernel Two-Sample Test »
Arthur Gretton · Kenji Fukumizu · Zaid Harchaoui · Bharath Sriperumbudur -
2009 Spotlight: A Fast, Consistent Kernel Two-Sample Test »
Arthur Gretton · Kenji Fukumizu · Zaid Harchaoui · Bharath Sriperumbudur -
2008 Poster: Characteristic Kernels on Groups and Semigroups »
Kenji Fukumizu · Bharath Sriperumbudur · Arthur Gretton · Bernhard Schölkopf -
2008 Oral: Characteristic Kernels on Groups and Semigroups »
Kenji Fukumizu · Bharath Sriperumbudur · Arthur Gretton · Bernhard Schölkopf -
2007 Workshop: Representations and Inference on Probability Distributions »
Kenji Fukumizu · Arthur Gretton · Alexander Smola -
2007 Spotlight: Kernel Measures of Conditional Dependence »
Kenji Fukumizu · Arthur Gretton · Xiaohai Sun · Bernhard Schölkopf -
2007 Poster: Kernel Measures of Conditional Dependence »
Kenji Fukumizu · Arthur Gretton · Xiaohai Sun · Bernhard Schölkopf -
2007 Spotlight: A Kernel Statistical Test of Independence »
Arthur Gretton · Kenji Fukumizu · Choon Hui Teo · Le Song · Bernhard Schölkopf · Alexander Smola -
2007 Poster: A Kernel Statistical Test of Independence »
Arthur Gretton · Kenji Fukumizu · Choon Hui Teo · Le Song · Bernhard Schölkopf · Alexander Smola -
2006 Poster: Kernels on Structured Objects Through Nested Histograms »
Marco Cuturi · Kenji Fukumizu