Download - Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

Transcript
Page 1: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

Intelligence in your SMB solution:SAP Leonardo Machine Learning Foundation and Tensorflow

Yatsea Li, SAP SMB Solution ArchitectMar, 2019

Internal | SAP Employees and Partners OnlySMB Innovation Summit 2019

Page 2: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

2Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Overview of SAP Leonardo Machine Learning Foundation

▪ Overview Introduction

▪ Intelligent Use Cases

Consuming the ready-to-use Functional Service

▪ Image, Text, Speech etc

Retraining the customizable services with your dataset

▪ Prepare and upload your dataset

▪ Submit a retraining job

▪ Deployment & Inference

Bring Your Own Model(BYOM)

▪ Tensorflow

Agenda

Page 3: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

3Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

How SAP Leonardo ML helps to deliver the Intelligent Enterprise

SAP

Intelligent

Robotic

Process

Automation

SAP

Conversatio

nal AI

Intelligent Applications

Business Outcomes

77%of the world’s

transaction revenue

touches an SAP system

26Industries

7lines of business

The world’s largest

business network

Increase revenue

Re-imagine processes

Quality time at work

Customer satisfaction

Enabling innovations

Open and flexible

building blocks

On SAP Cloud Platform & SAP HANA

Machine

Learning

Foundation

& Data

Science

Platform

Page 4: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

4Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Data Scientist

Enterprise System Developer

End User

Image Speech Text

SAP Leonardo ML Foundation

Functional Services

Core Capabilities

TrainingAPIs ConsumptionAPIs

Intelligent Applications

SAP Cloud Platform

Ready-to-Use Functional ServicesEnabling customers and partners to build the Intelligent Enterprise

4© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 5: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

5Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Ready-to-Use Functional ServicesMachine learning services portfolio

Which objects are shown in the image?

What is the text displayed in an image?

Which pictures show identical persons?

User Image Processing APIs

Customizable image classification

Customizable image object detection

Human detection; Face detection

Customizable image feature extraction

Face feature extraction

Optical character recognition (OCR);

Scene text recognition Image segmentation

Image Speech Text

Page 6: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

6Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Ready-to-Use Functional ServicesMachine learning services portfolio

Speech-to-Text

Text-to-Speech

User Speech ProcessingAPIs

Image Speech Text

How can I convert speech to written

text and vice versa?

6© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 7: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

7Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Ready-to-Use Functional ServicesMachine learning services portfolio

Customizable text classification

Text feature extraction

Topic detection

Language detection Translation

Customizable similarity scoring*

User Text ProcessingAPIs

Image Speech Text

How can I classify or match text

contents?

7© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

What are the key words and topics of

text documents?

Page 8: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

8Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Enterprise machine learning use cases

Product classificationProduct and spare part identification

Visual identity checks Master data matching Optimize transport document processing

Detection of labels

Identification of changes

in documents

Analysis of legal documents

Page 9: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

Consuming the Functional Services in MLF

Page 10: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

10Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Applications

Training

Inference

SAP Leonardo Machine Learning Foundation

Ready-to-use services

Bring your own model

Customize model

Create training

SAP Cloud Platform

Use machine learning services

▪ Consume prediction from pre-trained

models

▪ No training

Build your own model

▪ Train offline and deploy to cloud

services

▪ Train and deploy on cloud

Customize model

▪ Re-train existing models with own

data

Architecture of SAP Leonardo Machine Learning Foundation

Page 11: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

11Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Consumption, Customizable Services, and Bring-Your-Own-Model

Client Application

Use Case Business Logic

Tenant

Onboarding

SAP Leonardo ML Foundation APIs

Model Repository Big Data

Inference Training

Application Tier

Consumption via SCP

Compute Tier

Container Infrastructure

Persistence Tier

Storage

Page 12: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

12Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Option 1: SAP API Business Hub

BYOM: Bring-Your-Own-model

▪ Ready-to-use models

(Alpha & Released)

▪ For test purposes only!

▪ No retraining

▪ No BYOM

▪ No data privacy

▪ Usable via trial account

▪ Authentication per API key

Classification,

Extraction,

Detection…

In SAP API Business Hub UI In your app (coding)

Your

data

In e.g. Postman

SAP Cloud Platform

SAP LeonardoMachine Learning

Hub

▪ API endpoint:)https://sandbox.api.sap.com/ml/<servicename>

▪ Authentication: API key

ML models & services are available via REST APIs

© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

SAP API

Business Hub

(Sandbox)

Access: Trial user in API Business Hub.

Test directly in API Business Hub or in any

programming language or Postman calling

servicerequires:

Page 13: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

13Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Ready-to-Use Functional ServicesCalling REST APIs through the SAP API BusinessHub

Functional Service

13© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 14: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

14Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Consumption, Customizable Services, and Bring-Your-Own-ModelHands-on with a sandbox API endpoint

What you need to call the RESTAPIs:

▪ Get the API endpoint

http://sandbox.api.sap.com/ml/<servicename>

▪ Get API key

Getting started:

▪ Use the “Generate Code” feature for the programming

language of your choice

1

4

© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 15: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

15Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ CUSTOMER

Demo#1: Consuming the ready-to-use functional service through SAP API

Business Hub

Page 16: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

16Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ 7

Option 2: Productive Cloud Foundry usage

BYOM: Bring-Your-Own-Model

▪ Ready-to-use models

▪ Re-training

▪ BYOM

▪ Productive usage & Beta

▪ Data privacy

▪ Usable via service

entitlement

▪ Authentication per OAuth2

token

Classification,

Extraction,

Detection…

Your

data

*more data centers available

SAP Cloud Platform

SAP LeonardoMachine Learning

Productive

Cloud Foundry (e.g. AWS Frankfurt*)

ML models & services are available via REST APIs

Via sapml CLIIn e.g. Postman In your app (coding)

© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Via browser UI

Page 17: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

17Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Option 3: Trial Cloud Foundry usage

BYOM: Bring-Your-Own-Model

▪ Ready-to-use models

▪ Re-training

▪ BYOM

▪ Trial usage

▪ Data privacy

▪ Usable via service

entitlement

▪ Authentication per OAuth2

token

Classification,

Extraction,

Detection…

Your

data

SAP Cloud Platform

SAP LeonardoMachine Learning

Trial

Cloud Foundry

ML models & services are available via REST APIs

In e.g. Postman Via sapml CLIIn your app (coding) Via Browser UI

17© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 18: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

18Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Consuming the ready-to-use functional service

SAP Leonardo Machine Learning Foundation

Inference Ready-to-Use Models

SAP Cloud Platform

Your

data

Get ml-foundation entitlement for

your global account and space

Select ml-foundation

service: create service

instance and service key

Get API endpoint of the ML

service you want to use

18© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Use the SAP Cloud Platform cockpit or Cloud Foundry CLI:

Page 19: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

19Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ CUSTOMER

Demo#2: Consuming the ready-to-use functional service with CF trial

Tutorial: https://developers.sap.com/group.cp-mlf-rest.html

Page 20: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

20Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Re-training the customizable model

Training

SAP Leonardo Machine Learning Foundation

Ready to use Models

Inference

Customizable Models

SAP Cloud Platform

Your

training

data

Your

re-trained

Model

Prepare & upload

your

training data

Execute

(re-) training

job

Process:

Re-training

Model Repo

Tensor Flow

Training

Container

Deploy (re-)

trained model

20© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Tensor Flow

Serving Container

Page 21: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

21Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ CUSTOMER

Demo#4: Re-training the customizable model

Tutorial: https://developers.sap.com/group.cp-mlf-retrain.html

Page 22: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

22Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

TensorFlow and SAP Leonardo Machine Learning Foundation

TensorFlow▪ Open-source library for deep learning

▪ Define model structures, library takes care

of efficient execution

▪ Define once, run anywhere: can run on on

CPUs and GPUs, many devices

▪ Can be used in Python and many other

languages

▪ Built for large-scale machine learning

development and operations

▪ Development led by Google

Bring Your Own Model to SAP Leonardo MLF

▪ Train your own model with TensoFlow

▪ Deploy and publish your own TensorFlow

model on ML Foundation

▪ Manage your model status and monitor its

resource consumption

▪ Leverage the platform capability of ML

Foundation, such as authentication and

scalability

Play with Neural Network:

https://playground.tensorflow.org

openSAP-Enterprise Deep Learning with TensorFlow:

https://open.sap.com/courses/ml2

Page 23: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

23Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Bring-Your-Own-Model

Training

Inference

SAP Leonardo Machine Learning Foundation

Bring your own Model (BYOM)

Train your own Model (TYOM)

SAP Cloud Platform

Classifications

Extraction

Detection…

Your

data

Upload your

model

Deploy

your modelProcess:

BYOM

Model Repo Deploy your

inference

appTensor Flow

Serving Container

Test/

consume

the model

23© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 24: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

25Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

▪ SAP Leonardo Machine Learning enable the Intelligent

Enterprise

▪ 3 options to consume the MLF functional services

▪ SAP API Business Hub

▪ Productive Cloud Foundry

▪ Trial Cloud Foundry

▪ 3 usages

▪ Ready-to-use service

▪ Retraining the customizable services

▪ Bring Your Own Model

Summary

25© 2018 SAP SE or an SAP affiliate company. All rights reserved. ǀ PUBLIC

Page 25: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

26Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Materials

❑ Building Block of Machine Learning for SMB Innovation Summit Hackathon 2019

❑ Official online help of SAP Leonardo Machine Learning Foundation

❑ Try out SAP Leonardo MLF functional Services on SAP API Business Hub

❑ Videos playlist by SAP HANA Academy

❑ Tutorial about Tring Out the Machine Learning Foundation Services on Your Trial SAP Cloud Platform for

Cloud Foundry Account Using a REST Client.

https://developers.sap.com/group.cp-mlf-rest.html

❑ Tutorial about Customizing the Image Classifier Machine Learning Foundation services on your trial SAP

Cloud Platform for Cloud Foundry.

https://developers.sap.com/group.cp-mlf-retrain.html

❑ openSAP-Enterprise machine learning in a nutshell

❑ openSAP-Enterprise Deep Learning with TensorFlow

Page 26: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

27Confidential: Released for Partners© 2019 SAP SE or an SAP affiliate company. All rights reserved. ǀ

Contact information:

Twitter: @YatseaLi

Email: [email protected]

Thank you.

Page 27: Intelligence in your SMB solution: SAP Leonardo Machine … 2_1600_Bring... · TensorFlow and SAP Leonardo Machine Learning Foundation TensorFlow Open-source library for deep learning

Thank you.

Contact information:

Yatsea Li

SAP SMB Solution Architect

Twitter: @YatseaLi

Email: [email protected]

Gamification Challenge Code

BAN7g5q

By entering this SAP Breakout Session

code you will be granted 10 points

5 5