Bayesian Optimization
Bayesian Hyperparameter Tuning
Bayesian optimization Suppose we want to optimize a function such as validation error (which is a function of hyperparameters) but it’s really complicated. We can approximate it with a simple function, called the surrogate function. After we have queried a certain number of points, we can condition on these point...
[Read More]