DjiNN and Tonic: DNN as a Service and Its Implications for...
3
DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers Johann Hauswald, Yiping Kang, Michael A. Laurenzano, Quan Chen, Cheng Li, Trevor Mudge, Ronald G. Dreslinski, Jason Mars, Lingjia Tang University of Michigan — Ann Arbor, MI
Transcript of DjiNN and Tonic: DNN as a Service and Its Implications for...
![Page 1: DjiNN and Tonic: DNN as a Service and Its Implications for …web.eecs.umich.edu/~jahausw/media/djinn-lightning.pdf · DjiNN and Tonic: DNN as a Service and Its Implications for Future](https://reader031.fdocuments.net/reader031/viewer/2022022421/5a81875f7f8b9a0c748d51de/html5/thumbnails/1.jpg)
DjiNN and Tonic: DNN as a Service and Its Implications for Future Warehouse Scale Computers
Johann Hauswald, Yiping Kang, Michael A. Laurenzano, Quan Chen, Cheng Li, Trevor Mudge, Ronald G. Dreslinski, Jason Mars, Lingjia Tang
University of Michigan — Ann Arbor, MI
![Page 2: DjiNN and Tonic: DNN as a Service and Its Implications for …web.eecs.umich.edu/~jahausw/media/djinn-lightning.pdf · DjiNN and Tonic: DNN as a Service and Its Implications for Future](https://reader031.fdocuments.net/reader031/viewer/2022022421/5a81875f7f8b9a0c748d51de/html5/thumbnails/2.jpg)
1. DNN ExtractionImage Classification
Digit Recognition
Facial Recognition
Speech Recognition
Natural Language Processing
3. Server Design
Deep Neural Networks (DNN) as a Service
Integrated GPU
djinn.clarity-lab.org
CPU-Only
2. High Throughput
DisaggregatedGPU
![Page 3: DjiNN and Tonic: DNN as a Service and Its Implications for …web.eecs.umich.edu/~jahausw/media/djinn-lightning.pdf · DjiNN and Tonic: DNN as a Service and Its Implications for Future](https://reader031.fdocuments.net/reader031/viewer/2022022421/5a81875f7f8b9a0c748d51de/html5/thumbnails/3.jpg)
133x 771xReal System
4-20xTCO Improvement
First session right now
djinn.clarity-lab.org