In some optimizations problems, the objective-function is just too complicated to evaluate directly at every iteration, and in this case, we use surrogate functions, functions that mimic most of the properties of the true objective-function, but that is much simpler analytically and/or computationally.
Lately, I have done some thinking about what properties a surrogate function (or surrogate model) should have to be practical.

Posted by Steven Pigeon