Machine Learning for Developers - Pop-up Loft Tel Aviv

40
Machine Learning for Developers Danilo Poccia, Technical Evangelist @danilop

Transcript of Machine Learning for Developers - Pop-up Loft Tel Aviv

Page 1: Machine Learning for Developers - Pop-up Loft Tel Aviv

Machine  Learning  for  DevelopersDanilo  Poccia,  Technical  Evangelist

         @danilop

Page 2: Machine Learning for Developers - Pop-up Loft Tel Aviv

Batch

Report

Real-time

Alerts

Prediction

Forecast

Page 3: Machine Learning for Developers - Pop-up Loft Tel Aviv

Predictions

Page 4: Machine Learning for Developers - Pop-up Loft Tel Aviv

Data Predictions

Page 5: Machine Learning for Developers - Pop-up Loft Tel Aviv

ModelData Predictions

Page 6: Machine Learning for Developers - Pop-up Loft Tel Aviv

ModelData

BatchPredictions

Real-timePredictions

Page 7: Machine Learning for Developers - Pop-up Loft Tel Aviv

Machine Learning

Page 8: Machine Learning for Developers - Pop-up Loft Tel Aviv

SupervisedLearning

Machine Learning

UnsupervisedLearning

The task of inferringa model

from labeledtraining data

The task of inferringa model

to describehidden structure

from unlabeled data

Page 9: Machine Learning for Developers - Pop-up Loft Tel Aviv

ClusteringUnsuperv

ised

Learning

Page 10: Machine Learning for Developers - Pop-up Loft Tel Aviv

ClusteringUnsuperv

ised

Learning

Page 11: Machine Learning for Developers - Pop-up Loft Tel Aviv

ClusteringUnsuperv

ised

Learning

Page 12: Machine Learning for Developers - Pop-up Loft Tel Aviv

Regression

Binary Classification

Multi-class Classification

Supervise

d

Learning

Page 13: Machine Learning for Developers - Pop-up Loft Tel Aviv

Validation

Supervise

d

Learning

Page 14: Machine Learning for Developers - Pop-up Loft Tel Aviv

Training from Labeled DataSuperv

ised

Learning

Training

Validation

70%

30%

Page 15: Machine Learning for Developers - Pop-up Loft Tel Aviv

Cross-ValidationSuperv

ised

Learning

Page 16: Machine Learning for Developers - Pop-up Loft Tel Aviv

Be Careful of OverfittingSuperv

ised

Learning

Page 17: Machine Learning for Developers - Pop-up Loft Tel Aviv

Be Careful of OverfittingSuperv

ised

Learning

Page 18: Machine Learning for Developers - Pop-up Loft Tel Aviv

Be Careful of OverfittingSuperv

ised

Learning

Page 19: Machine Learning for Developers - Pop-up Loft Tel Aviv

Better ModelSuperv

ised

Learning

Page 20: Machine Learning for Developers - Pop-up Loft Tel Aviv

Better ModelSuperv

ised

Learning

Page 21: Machine Learning for Developers - Pop-up Loft Tel Aviv

Adding a Test PhaseSuperv

ised

Learning

Training

Validation

Test

60%

20%

20%

Page 22: Machine Learning for Developers - Pop-up Loft Tel Aviv

?Data Model

Page 23: Machine Learning for Developers - Pop-up Loft Tel Aviv

Data Model

Resilient Distributed Datasets (RDDs)

Memory

Fast Processing

Large Quantity of Data

Disk

Hadoop

MapReduce

Spark

?

Page 24: Machine Learning for Developers - Pop-up Loft Tel Aviv

Amazon EMRwith Spark (MLib)

Data Model

Page 25: Machine Learning for Developers - Pop-up Loft Tel Aviv

<demo>...

</demo>

Page 26: Machine Learning for Developers - Pop-up Loft Tel Aviv

Amazon EMRwith Spark (MLib)

Data Model

Page 27: Machine Learning for Developers - Pop-up Loft Tel Aviv

Data Scientists“Scalability”

Page 28: Machine Learning for Developers - Pop-up Loft Tel Aviv

AmazonMachine Learning

(Amazon ML)

Data Model

Page 29: Machine Learning for Developers - Pop-up Loft Tel Aviv

Machine learning is the technology that automatically finds patterns in your data and uses them to make

predictions for new data points as they become available

Your Data + Machine Learning= Smart Applications

What is Machine Learning?

AmazonMachine Learning

(Amazon ML)

Page 30: Machine Learning for Developers - Pop-up Loft Tel Aviv

Machine learning (ML) can help you use historical data to make better business decisions.

ML algorithms discover patterns in data and construct predictive models using these patterns. Then, you can use the models to make predictions

on future data.

What is Machine Learning?

AmazonMachine Learning

(Amazon ML)

Page 31: Machine Learning for Developers - Pop-up Loft Tel Aviv

Integrated with AWS Services for Easy Data Access (Amazon S3, Amazon Redshift, Amazon RDS)

Data visualization and exploration

Model Evaluation and Interpretation Tools

Binary Attributes (Binary Classification) Categorical Attributes (Multi-class Classification)

Numeric Attributes (Regression)

Key Features

AmazonMachine Learning

(Amazon ML)

Page 32: Machine Learning for Developers - Pop-up Loft Tel Aviv

Data Transformations

Modeling APIs

APIs for Batch and Real-time Predictions

Fully Managed

Pay per Use

Key Features

AmazonMachine Learning

(Amazon ML)

Page 33: Machine Learning for Developers - Pop-up Loft Tel Aviv

AmazonMachine Learning

(Amazon ML)

Data Model

Page 34: Machine Learning for Developers - Pop-up Loft Tel Aviv

AmazonMachine Learning

(Amazon ML)

Data Model

BatchPredictions

Page 35: Machine Learning for Developers - Pop-up Loft Tel Aviv

AmazonMachine Learning

(Amazon ML)

Data Model

BatchPredictions

Real-timePredictions

Page 36: Machine Learning for Developers - Pop-up Loft Tel Aviv

<demo>...

</demo>

Page 37: Machine Learning for Developers - Pop-up Loft Tel Aviv

AmazonMachine Learning

(Amazon ML)

Data Model

BatchPredictions

Real-timePredictions

Page 38: Machine Learning for Developers - Pop-up Loft Tel Aviv

Choose Where to Spend Your Time

Page 39: Machine Learning for Developers - Pop-up Loft Tel Aviv

Pay Only For What You Use

Page 40: Machine Learning for Developers - Pop-up Loft Tel Aviv

Danilo  PocciaTechnical  Evangelit          @danilop