Two+ Minute Papers - Overfitting and Regularization For Deep Learning

In this episode, we discuss the bane of many machine learning algorithms - overfitting. It is also explained why it is an undesirable way to learn and how to combat it via L1 and L2 regularization. _____________________________ The paper “Regression Shrinkage and Selection via the Lasso“ is available here: ~tibs/lasso/ Andrej Karpathy’s excellent lecture notes on neural networks and regularization: The neural network demo is