We present HyperBO+: a framework of pre-training a hierarchical Gaussian process that enables the same prior to work universally for Bayesian optimization on functions with different domains. We propose a two-step pre-training method and demonstrate its empirical success on challenging black-box function optimization problems with varied input dimensions and search spaces.