Deploying Deep Neural Networks Efficiently

(section 3.7 and section 7) More about Baidu’s efficient deep speech deployment thanks to Batching and also thanks to Forward-Only model, please see link above. 1. Deep neural networks are increasingly important for powering AI-based applications like speech recognition. 2. Baidu’s research shows that adding GPUs to the data center makes deploying big deep neural networks practical at scale. 3. Deep learning based technologies benefit from batching user requests in the data