SAFARI Live Seminar: Efficient DNN Training at Scale: from Algorithms to Hardware - Gena Pekhimenko

Talk Title: Efficient DNN Training at Scale: from Algorithms to Hardware Speaker: Gennady Pekhimenko, Assistant Professor at the University of Toronto ~pekhimenko/ SAFARI Live Seminar Series Summer 2021 Talk #4 Talk slides and info page to be linked. Abstract: The recent popularity of deep neural networks (DNNs) has generated a lot of research interest in performing DNN-related computation efficiently. However, the primary focus of systems research is usually quite narrow and limited to (i) inference -- i.e. how to efficiently execute already trained models and (ii) image classification networks as the primary benchmark for evaluation. In this talk, we will demonstrate a holistic approach to DNN training acceleration and scalability starting from the algorithm, to software and hardware optimizations, to special development and optimization tools. In the first part of the talk, I will show our r