Taking Humans out of the Deep Learning Loop - Ryan Adams, Harvard - Deep Learning Summit 2015

Taking Humans out of the Deep Learning Loop Machine learning frequently involves careful tuning of learning parameters and model hyperparameters. Unfortunately, this tuning is often a “black art“ requiring expert experience and heuristics. This pain is particularly acute in deep learning and there is great appeal in automatic approaches that optimize learning algorithms for the problem at hand. I will discuss how this can be tackled with Bayesian optimization, surpassing human experts on many deep learning