High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017
-
Upload
continuum-analytics -
Category
Data & Analytics
-
view
258 -
download
0
Transcript of High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017
![Page 1: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/1.jpg)
DEEP LEARNINGWITH ANACONDA
PYTHON, TENSORFLOW & GPUS, OH MY!
![Page 2: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/2.jpg)
#OpenDataScienceMeans #AnacondaCON
WHAT IS DEEP LEARNING?
•The return of neural networks for machine learning•Many high profile successes with:
•Image recognition•Language translation•Speech recognition•Automated image captioning
![Page 3: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/3.jpg)
#OpenDataScienceMeans #AnacondaCON
WHAT HAPPENED?
(Much) Bigger Training Sets
Faster & Specialized Hardware
Open Source Tools
Improved Algorithms
![Page 4: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/4.jpg)
#OpenDataScienceMeans #AnacondaCON
WHAT IS A NEURAL NETWORK?
•A very simple computation unit connected in a large mesh•Very flexible•Very trainable (given sufficient training data)
![Page 5: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/5.jpg)
#OpenDataScienceMeans #AnacondaCON
NEURAL NETWORKS: NODE
![Page 6: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/6.jpg)
#OpenDataScienceMeans #AnacondaCON
NEURAL NETWORKS: LAYER
![Page 7: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/7.jpg)
#OpenDataScienceMeans #AnacondaCON
NEURAL NETWORKS: NETWORK
ReLU
ReLU
ReLU
ReLU
![Page 8: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/8.jpg)
#OpenDataScienceMeans #AnacondaCON
THE DEEP LEARNING SOFTWARE STACK
MULTI-CORE CPU GPUMANY-CORE CPU(XEON PHI)HARDWARE
MKL 2017 CUDNNPRIMITIVES
TENSORFLOWTHEANOPYTORCHTENSOR MATH
NEURAL NETWORKS KERAS TFLEARNCAFFE
...and many others
MIOPEN
![Page 9: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/9.jpg)
#OpenDataScienceMeans #AnacondaCON
DEEP LEARNING WITH ANACONDA
Available in Anaconda today:
• Theano
• TensorFlow (CPU)
Coming very soon:
• TensorFlow (GPU w/ cuDNN)
• Keras
• ...and more
![Page 10: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/10.jpg)
#OpenDataScienceMeans #AnacondaCON
DEEP LEARNING IN THE JUPYTER NOTEBOOK
Defines a simple model in Keras to recognize handwritten digits
![Page 11: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/11.jpg)
#OpenDataScienceMeans #AnacondaCON
DEEP LEARNING IN THE JUPYTER NOTEBOOK
Trained to 98% accuracy in4 minutes using a singleNVIDIA GTX 1080 GPU
![Page 12: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/12.jpg)
#OpenDataScienceMeans #AnacondaCON
DEEP LEARNING IN THE JUPYTER NOTEBOOK
Trained to 98% accuracy in4 minutes using a singleNVIDIA GTX 1080 GPU
![Page 13: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/13.jpg)
#OpenDataScienceMeans #AnacondaCON
CONCLUSION
Now is a great time to experiment with Deep Learning:
• Prepare your data with your favorite Python libraries
• Create models and run training experiments in the Jupyter Notebook
• Visualize and understand your training results right in the notebook environment
• Look for more Deep Learning packages coming to Anaconda!(GPU acceleration, Keras, and more)
![Page 14: High Performance Analytics with Dask & Tensorflow | AnacondaCON 2017](https://reader033.fdocuments.net/reader033/viewer/2022051707/58ce82581a28ab210a8b5cb1/html5/thumbnails/14.jpg)
QUESTIONS?