Bayesian Optimization: Theory and Practice Using Python

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2023

P. LiuBayesian Optimizationhttps://doi.org/10.1007/978-1-4842-9063-7_4

4. Gaussian Process Regression with GPyTorch

Peng Liu¹  

(1)

Singapore, Singapore

 

So far, we have grasped the main components of a Bayesian optimization procedure: a surrogate model that provides posterior estimates on the mean and uncertainty of the underlying objective function and an acquisition function that guides the search for the next sampling location based on its expected gain in the marginal utility. Efficiently calculating the posterior distributions becomes essential in the case of parallel Bayesian optimization and Monte Carlo acquisition functions. This branch evaluates multiple ...