Building predictive models in Azure Machine Learning
-
Upload
mostafa-elzoghbi -
Category
Technology
-
view
449 -
download
4
Transcript of Building predictive models in Azure Machine Learning
![Page 1: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/1.jpg)
![Page 2: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/2.jpg)
![Page 3: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/3.jpg)
![Page 4: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/4.jpg)
• Cost
knowledge
scalable
![Page 5: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/5.jpg)
![Page 6: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/6.jpg)
![Page 7: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/7.jpg)
![Page 8: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/8.jpg)
Positive Negative
![Page 9: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/9.jpg)
![Page 10: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/10.jpg)
Value
![Page 11: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/11.jpg)
DATA
Business apps
Custom apps
Sensors and devices
INTELLIGENCE ACTION
People
Automated Systems
![Page 12: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/12.jpg)
R Python
APIs
![Page 13: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/13.jpg)
Fully
managed
Integrated Flexible Deploy in
minutes
No software to install,
no hardware to manage,
all you need is an
Azure subscription.
Drag, drop and connect
interface. Data sources
with just a drop down;
run across any data.
Built-in collection of best
of breed algorithms with
no coding required.
Drop in custom R or use
popular CRAN packages.
Operationalize models
as web services with a
single click.
Monetize in Machine
Learning Marketplace.
![Page 14: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/14.jpg)
Get/Prepare Data
Build/Edit Experiment
Create/Update Model
Evaluate Model Results
Publish Web
Service
Build ML Model Deploy as Web ServiceProvision Workspace
Get Azure
Subscription
Create
Workspace
Publish an App
Azure Data
Marketplace
![Page 15: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/15.jpg)
Blobs and Tables
Hadoop (HDInsight)
Relational DB (Azure SQL DB)
Data Clients
Model is now a web service that is
callable
Monetize the API through our marketplace
API
Integrated development environment for Machine
Learning
ML STUDIO
![Page 16: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/16.jpg)
![Page 17: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/17.jpg)
![Page 18: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/18.jpg)
50°F 30°F 68°F 95°F1990
48°F 29°F 70°F 98°F2000
49°F 27°F 67°F 96°F2010
? ? ? ?2020
… … … ……
Known data
Model
Unknown data
Weather forecast sample
Using known data, develop a model to predict unknown data.
![Page 19: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/19.jpg)
90°F
-26°F
50°F 30°F 68°F 95°F1990
48°F 29°F 70°F 98°F2000
49°F 27°F 67°F 96°F2010
Using known data, develop a model to predict unknown data.
Predict 2020 Summer
![Page 20: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/20.jpg)
![Page 21: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/21.jpg)
Classify a news article as (politics, sports, technology, health, …)
Politics Sports Tech Health
Using known data, develop a model to predict unknown data.
![Page 22: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/22.jpg)
Using known data, develop a model to predict unknown data.
Documents Labels
Tech
Health
Politics
Politics
Sports
Documents consist of
unstructured text. Machine
learning typically assumes a
more structured format of
examples
Process the raw
data
![Page 23: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/23.jpg)
Using known data, develop a model to predict unknown data.
LabelsDocuments
Feature
Documents Labels
Tech
Health
Politics
Politics
Sports
Process each data instance to represent it as a feature
vector
![Page 24: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/24.jpg)
Known data
Data instance
i.e.
{40, (180, 82), (11,7), 70, …..} : Healthy
Age Height/Weight
Blood Pressure
Hearth Rate
LabelFeatures
Feature Vector
![Page 25: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/25.jpg)
Using known data, develop a model to predict unknown data.
Documents Labels
Tech
Health
Politics
Politics
Sports
Training
data
Train
the
Mode
l
Feature Vectors
Base
Model
Adjust
Parameters
![Page 26: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/26.jpg)
Known data with true labels
Tech
Health
Politics
Politics
Sports
Tech
Health
Politics
Politics
Sports
Tech
Health
Politics
Politics
Sports
Model’s
Performance
Difference between
“True Labels” and
“Predicted Labels”
True
labels
Tech
Health
Politics
Politics
Sports
Predicte
d
labels
Train the Model
Sp
lit
Detac
h+/-+/-
+/-
![Page 27: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/27.jpg)
1
Problem
Framing
2
Get/Prepare
Data
3
Develop
Model
4
Deploy
Model
5
Evaluate /
Track
Performance
3.1
Analysis/
Metric
definition
3.2
Feature
Engineering
3.3
Model
Training
3.4
Parameter
Tuning
3.5
Evaluation
![Page 28: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/28.jpg)
![Page 29: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/29.jpg)
![Page 30: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/30.jpg)
![Page 31: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/31.jpg)
• Supervised learning examples
• This customer will like coffee
• This network traffic indicates a denial of service attack
• Unsupervised learning examples
• These customers are similar
• This network traffic is unusual
![Page 32: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/32.jpg)
Classification Regression Anomaly
Detection
Clustering
Supervised Supervised SupervisedUnSupervised
![Page 33: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/33.jpg)
YES|NO
numerical value
![Page 34: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/34.jpg)
Classification
![Page 35: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/35.jpg)
Clustering
![Page 36: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/36.jpg)
Regression
![Page 37: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/37.jpg)
• Regression problems• Estimate household power
consumption
• Estimate customer’s income
• Classification problems• Power station will|will not meet
demand
• Customer will respond to advertising
![Page 38: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/38.jpg)
• Binary examples• click prediction
• yes|no
• over|under
• win|loss
• Multiclass examples• kind of tree
• kind of network attack
• type of heart disease
![Page 39: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/39.jpg)
![Page 40: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/40.jpg)
accessalmost any type of application
Azure API Management + AML WS
![Page 41: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/41.jpg)
![Page 42: Building predictive models in Azure Machine Learning](https://reader034.fdocuments.net/reader034/viewer/2022042619/58b890841a28ab3e3a8b5a1d/html5/thumbnails/42.jpg)
https://mva.microsoft.com/ebooks#9780735698178
https://azure.microsoft.com/en-us/documentation/services/machine-learning/
www.edx.org
https://github.com/Azure-Readiness/hol-azure-machine-learning/