How deep is your buffer – Demystifying buffers and application performance
Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and...
Transcript of Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and...
![Page 1: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
[email protected] Application Engineer, MathWorks Benelux
[email protected] Application Engineer, MathWorks Switzerland
Demystifying Deep Learning
![Page 2: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/2.jpg)
2
▪ What’s Deep Learning and why should I care?
▪ A practical approach to Deep Learning (for images)
– Transfer the learning from an expert model to your own application
▪ Building a Deep Learning network from scratch
– Deep Learning for time series and text data
▪ Key learnings of the session and cool features
Agenda
![Page 3: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/3.jpg)
3
Deep learning with MATLAB is easy and accessible!
Use Less Data
and Less Time
with Transfer
Learning
Apply Deep Learning
not only on images but
also on text and time
series data
Automatically generate code!
Image
Pre-processingImage
Post-processingCNN
Prototype and
productize
your entire workflow on
embedded GPUs
![Page 4: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/4.jpg)
4
Why Machine Learning or Deep Learning?
Transformational technology
Close (better) than human accuracy for
specific tasks
Performance scales with data
It is hard to use, it is challenging
Enables
engineers, researchers and other domain experts
to create
products and applications with more
built-in intelligence
![Page 5: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/5.jpg)
5
Artificial Intelligence
Machine Learning
Artificial Intelligence, Machine Learning and Deep Learning
Deep Learning
Timeline
1950s Today
Applic
ation B
readth
1997 2016
![Page 6: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/6.jpg)
6
Machine Learning vs Deep Learning
Machine Learning
Deep Learning
Features
End-to-end
Learning is an iterative process
Training Data Classification Task
![Page 7: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/7.jpg)
7
Deep Learning Common Workflow
Files
Databases
Sensors
ACCESS AND EXPLORE
DATA
DEVELOP PREDICTIVE
MODELS
Hardware-Accelerated
Training
Hyperparameter Tuning
Network Visualization
LABEL AND PREPROCESS
DATA
Data Augmentation/
Transformation
Labeling Automation
Import Reference
Models
INTEGRATE MODELS WITH
SYSTEMS
Desktop Apps
Enterprise Scale Systems
Embedded Devices and
Hardware
![Page 8: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/8.jpg)
8
Deep learning is usually implemented using a neural network
architecture
▪ The term “deep” refers to the number of layers in the network—the more
layers, the deeper the network.
▪ Data flows through network in layers, which provide transformation of data
Convolutional Neural Network
![Page 9: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/9.jpg)
9
Convolutional Neural Network is a popular Deep Learning
architecture
https://nl.mathworks.com/videos/series/introduction-to-deep-learning.html
Shallow Neural Network Convolutional Neural Network
Every input neuron
Connects to every neuron
in the hidden layer
Local receptive fields
connect to neurons in the hidden layer
Translate across an image
create a feature map
efficiently with convolution
Hidden
Layer
Output
Layer
Input
Layer
𝑎 𝑏 𝑐 𝑑
𝑒 𝑓 𝑔 ℎ
𝑖 𝑗 𝑘 𝑙
𝑤 𝑥
𝑦 𝑧
Input Kernel
𝑎𝑤 + 𝑏𝑥+ 𝑒𝑦 + 𝑓𝑧
Output
![Page 10: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/10.jpg)
10
Deep Learning: different types of network architectures
TypeSeries Network
Directly Acyclic Graph Network(DAG)
Recurrent Neural Network (RNN)
Basic
Architecture
Network
ExampleAlexNet, VGG R-CNN (fast, faster), GoogLeNet, SegNet LSTM
ApplicationObject Recognition:
Cars, Lane, Pedestrian
Object Detection:
Cars, Traffic Signs, Scene (Semantic Segmentation)Sequential data: time series, signals
![Page 11: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/11.jpg)
11
▪ What’s Deep Learning and why should I care?
▪ A practical approach to Deep Learning (for images)
– Transfer the learning from an expert model to your own application
▪ Building a Deep Learning network from scratch
– Deep Learning for time series and text data
▪ Key learnings of the session and cool features
Agenda
![Page 12: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/12.jpg)
12
Deep Learning can be complex and challenging to apply
Main Challenges
▪ Capability of training with
multiple GPUs
▪ Capability of training in
the cloud
Accelerate and Scale
Training
Main Challenges
▪ Convert models to CUDA
code
▪ Compress models to fit
into embedded GPUs.
High Performance
Deployment
Main Challenges
▪ Handle large image sets
▪ Image labeling is tedious
▪ Have access to models
Design Deep Learning
& Vision Algorithms
![Page 13: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/13.jpg)
13
Object Recognition using Deep Learning in MATLABSupervised Learning
MATLAB Support Package for USB Webcams
BLACK BOX
Stapler
CoffeCoaster
Highlighter
RubikCube
AlexNetPRETRAINED MODEL
OfficeNetNEW MODEL
Transfer
Knowledge
![Page 14: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/14.jpg)
14
Where to start? Two Approaches for Deep Learning
Transfer
Learning
Train
from
Scratch
Fine - Tune
Deep Neural Network, e.g. CNN
![Page 15: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/15.jpg)
15
Why Perform Transfer Learning?
▪ Leverage best network types
from top researchers
▪ Reference models are great
feature extractors
AlexNetPRETRAINED MODEL
CaffeM O D E L S
ResNet PRETRAINED MODEL
TensorFlow/Keras M O D E L S
VGG-16PRETRAINED MODEL
GoogLeNet PRETRAINED MODEL
▪ Less data
▪ Less training time
![Page 16: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/16.jpg)
16
Transfer Learning Workflow
Early layers that learned
low-level features
(edges, blobs, colors)
Last layers that
learned task
specific features
1 million images
1000s classes
Load pretrained network
Fewer classes
Learn faster
New layers learn
features specific
to your data
Replace final layers
![Page 17: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/17.jpg)
17
Transfer Learning Workflow
Early layers that learned
low-level features
(edges, blobs, colors)
Last layers that
learned task
specific features
1 million images
1000s classes
Load pretrained network
Fewer classes
Learn faster
New layers to learn
features specific
to your data
Replace final layers
100s images
10s classes
Training images
Training options
Train network
![Page 18: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/18.jpg)
18
Transfer Learning Workflow
Early layers that learned
low-level features
(edges, blobs, colors)
Last layers that
learned task
specific features
1 million images
1000s classes
Load pretrained network
Fewer classes
Learn faster
New layers to learn
features specific
to your data
Replace final layers
100s images
10s classes
Training images
Training options
Train network
Test images
Trained Network
98 %
Predict and assess
network accuracy Probability
Car
Truck
…
Bike
Deploy results
![Page 19: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/19.jpg)
19
Transfer Learning Workflow
Early layers that learned
low-level features
(edges, blobs, colors)
Last layers that
learned task
specific features
1 million images
1000s classes
Load pretrained network
Fewer classes
Learn faster
New layers to learn
features specific
to your data
Replace final layers
100s images
10s classes
Training images
Training options
Train network
Test images
Trained Network
98 %
Predict and assess
network accuracy
Probability
Car
Truck
…
Bike
Deploy results
![Page 20: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/20.jpg)
20
Accelerate training and prediction!
Deep Learning
End-to-end
Learning is an iterative process
Prediction
More GPUs Whitepaper: Deep Learning in the Cloud
Alexnet vs Squeezenet
![Page 21: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/21.jpg)
21
Alexnet Inference on NVIDIA Titan Xp
GPU Coder +
TensorRT (3.0.1)
GPU Coder +
cuDNN
Fra
mes p
er
second
Batch Size
CPU Intel(R) Xeon(R) CPU E5-1650 v4 @ 3.60GHz
GPU Pascal Titan Xp
cuDNN v7
Testing platform
mxNet (1.1.0)
GPU Coder +
TensorRT (3.0.1, int8)
TensorFlow (1.6.0)
![Page 22: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/22.jpg)
22
Deep Learning is easy and accessible with MATLAB!
Design Deep Learning &
Vision Algorithms
Highlights
▪ Datastores for large image sets
▪ Automate image labeling
▪ Direct access to models within MATLAB with
support packages
▪ Import Tensor Flow Keras and Caffe networks
Highlights
▪ Automate compilation with
GPU Coder
▪ 1.4x speedup over C++ Caffe
on Jetson TX2
Accelerate and Scale
Training
Highlights
▪ Single line of code to:
▪ Accelerate training with
multiple GPUs or
▪ Scale to clusters
High Performance
Deployment
MKL-DNNTensorRT &
cuDNN
IN OUT
Neon
![Page 23: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/23.jpg)
23
▪ What’s Deep Learning and why should I care?
▪ A practical approach to Deep Learning (for images)
– Transfer the learning from an expert model to your own application
▪ Building a Deep Learning network from scratch
– Deep Learning for time series and text data
▪ Key learnings of the session and cool features
Agenda
![Page 24: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/24.jpg)
24
Deep Learning for Time Series, Sequences and Text
Instant Translation
Sentiment Analysis
Movie Ranking Prediction
Music Recognition
Speech-to-text
Text-to-Speech
Predictive Maintenance
![Page 25: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/25.jpg)
25
Deep Learning for Time Series
Example: Seizure prediction (time series classification)
Goal: Predict seizures in long-term
Dataset: iEGG time series
Data size: 20GB
Output: Classification before or between seizure
Link for melbourne-university-seizure-prediction
![Page 26: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/26.jpg)
26
Types of Datasets
Numeric
Data
Time Series/
Text Data
Image
Data
Long Short Term
Memory (LSTM) LSTM or CNNConvolutional Neural Networks (CNN)
Directed acyclic graph networks (DAG)
![Page 27: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/27.jpg)
27
Deep Learning for Time Series
CNN: Data for Time series = Pixel for Images
1 0 5 4
3 4 8 3
1 4 6 5
2 5 4 1
0.2 -0.5 -1 -2.1
-1.3 0.8 1.1 -2
1.2 0 1.2 1.6
0.8 0.7 -0.2 -0.4
![Page 28: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/28.jpg)
28
Deep Learning for Time Series
Long Short Term Memory (LSTM) Network
![Page 29: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/29.jpg)
29
Text Analytics
Media reported two trees
blown down along I-40 in
the Old Fort area.
Develop Predictive ModelsAccess and Explore Data Preprocess Data
Clean-up Text Convert to Numeric
media report two tree blown
down i40 old fort area
cat dog run two
doc1 1 0 1 0
doc2 1 1 0 1
• Word Docs
• PDF’s
• Text Files
• Stop Words
• Stemming
• Tokenization
• Bag of Words
• TF-IDF
• Word Embeddings
• LSTM
• Latent Dirichlet
Allocation
• Latent semantic
analysis
![Page 30: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/30.jpg)
30
Key Takeaways:
Deep Learning for Time Series and Text
▪ Applications
– Time series
▪ forecasting
▪ classification (Predictive Maintenance)
– Text
▪ classification (Sentiment Analysis, Tagging)
▪ clustering (Topic Modelling)
▪ Text Analytics: Prepend
– Text preprocessing
– Conversion to numeric
![Page 31: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/31.jpg)
31
▪ What’s Deep Learning and why should I care?
▪ A practical approach to Deep Learning (for images)
– Transfer the learning from an expert model to your own application
▪ Building a Deep Learning network from scratch
– Deep Learning for time series and text data
▪ Key learnings of the session and cool features
Agenda
![Page 32: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/32.jpg)
32
Deep learning with MATLAB is easy and accessible!
Use Less Data
and Less Time
with Transfer
Learning
Apply Deep Learning
not only on images but
also on text and time
series data
Automatically generate code!
Image
Pre-processingImage
Post-processingCNN
Prototype and
productize
your entire workflow on
embedded GPUs
![Page 33: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/33.jpg)
33
Deployment (Embedded)
Algorithm Development, Testing & VerificationNeural Network Toolbox™
GPU Coder™
~66 Fps (Tegra X1)
Semantic Scene Segmentation Acceleration (Classification)
14x with MEX
2x with MEX
Images
Time Series
![Page 34: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/34.jpg)
34
Mini-batchable datastore
Have a small number of
large high-res imagesTo train, need a large number of
pairs of images
![Page 35: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/35.jpg)
35
Ground truth labelling: attributes and sublabels
![Page 36: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/36.jpg)
36
Visualize and understand the network architecture
19-Apr-2018 10:00:00
Detect problems before wasting time training!
• Missing or disconnected layers,
• Mismatching or incorrect sizes of layer inputs,
• Incorrect number of layer inputs,
• Invalid graph structures.
Download Support Package
![Page 37: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/37.jpg)
37
Semantic Segmentation
▪ Fully convolutional networks (FCN)
▪ Segmentation Networks (SegNet)
▪ Other directed acyclic graph (DAG)
>>help semanticseg
▪ Manage connections, add and
remove layers
▪ Manage label data and evaluate
performance
![Page 38: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/38.jpg)
38
Automated Driving System Toolbox™
Computer Vision System Toolbox™
Access Data Preprocess and LabelObject
Classification
Velodyne
FileReader
Preprocessing
Clustering
LiDAR Annotation
Ground Truth
[Under Request]
PointNet
Deep Neural Network
Neural Network Toolbox™
Algorithm Development, Testing & VerificationApplicable to other sensors, e.g. LiDar
![Page 39: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/39.jpg)
40
LSTM for both Classification and Regression
Inp
ut
LS
TM
Fu
lly C
on
ne
cte
d
Re
gre
ssio
n L
aye
r
Feature extraction Classification
Time to failure
![Page 40: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/40.jpg)
41
Define new operations for deep networks with ‘Custom
Layers’
![Page 41: Demystifying Deep Learning - MathWorks · Demystifying Deep Learning. 2 What’s Deep Learning and why should I care? A practical approach to Deep Learning (for images) –Transfer](https://reader030.fdocuments.net/reader030/viewer/2022040116/5ed37154b458607d8231cbed/html5/thumbnails/41.jpg)
42
THANK YOU!
Use Less Data
and Less Time
with Transfer
Learning
Apply Deep Learning
not only on images but
also on time series data
Automatically generate code!
Image
Pre-processingImage
Post-processingCNN
Prototype and
productize
your entire workflow on
embedded GPUs