TensorFlow TutorialWestern New York Image and Signal Processing Workshop 2017

Syed AhmedKGCOE Computer Engineering Department

Rochester Institute of Technology

syed-ahmed.github.io/tensorflow-tutorial

Agenda

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

3

How do I learn TensorFlow?

4

● Pick a paper without code● Implement the code● Publish in GitHub● Tweet/Email to the Author

5

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

6

What’s in the name?

Tensor Flow

7

Data Flow

8

Data Flow Programming and Architecture

9

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

10

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

11

TensorFlow 101

Follow Jupyter Notebook

12

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

13

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

14

Structuring your project

15

https://github.com/tensorflow/models

Docker Containers for ReproducibilityFollow link in Jupyter Notebook

16

Debugginghttps://wookayin.github.io/tensorflow-talk-debugging/#1

17

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

18

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

19

TF ProfilerFollow on Jupyter Notebook

20

NVIDIA Visual Profiler1. nvprof -o out.nvvp python mnist_deep.py2. Open out.nvvp in NVIDIA Visual Profiler3. Optimize code to minimize gap in compute

21

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

22

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

23

Multi-GPU Training1. Documentation

24

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

25

TensorFlow Concepts

TensorFlow 101

Software Development Workflow

Profiling your code

Multi-GPU execution

Inference Pipeline

26

Inference on Android1. Google Codelabs2. TensorFlow Lite

27

Thank You!

28

sxa1056@rit.edu

Questions?