Timezone: »

 
Minimax Optimal Kernel Operator Learning via Multilevel Training
Jikai Jin · Yiping Lu · Jose Blanchet · Lexing Ying

@
in AI for Science: Progress and Promises »
Event URL: https://openreview.net/forum?id=UeB6GdQGDUJ »

Learning mappings between infinite dimensional function spaces has achieved empirical success in many disciplines of machine learning, including generative modeling, functional data analysis, causal inference, and multi-agent reinforcement learning. In this paper, we study the statistical limit of learning a Hilbert-Schmidt operator between two infinite-dimensional Sobolev reproducing kernel Hilbert spaces. We establish the information-theoretic lower bound in terms of the Sobolev Hilbert-Schmidt norm and show that a regularization that learns the spectral components below the bias contour and ignores the ones that above the variance contour can achieve optimal learning rate. At the same time, the spectral components between the bias and variance contours give us the flexibility in designing computationally feasible machine learning algorithms. Based on this observation, we develop a multilevel kernel operator learning algorithm that is optimal when learning linear operators between infinite-dimensional function spaces.

Author Information

Jikai Jin (Peking University)
Yiping Lu (Stanford University)
Jose Blanchet (Stanford University)
Lexing Ying (Stanford University)

More from the Same Authors