Hyperparameter Optimization: A Spectral Approach.
international conference on learning representations, 2018.
We give a simple, fast algorithm for hyperparameter optimization inspired by techniques from the analysis of Boolean functions. We focus on the high-dimensional regime where the canonical example is training a neural network with a large number of hyperparameters. The algorithm --- an iterative application of compressed sensing techniques...More
PPT (Upload PPT)