Running SAP Data Hub On Kubernetes With SUSE CaaS Platform
Transcript of Running SAP Data Hub On Kubernetes With SUSE CaaS Platform
1
Running SAP Data Hub On Kubernetes With SUSE CaaS Platform
TUT-1212
Overview, Installation & Outlook
Kevin Klinger
SAP Solutions Architect
2
Agenda
1. Introduction
2. What is SUSE Container as a Service
3. What is SAP Data Hub
4. Bring them together
5. Requirements + How to install
3
About The
• Founded in 1999
• Interdisciplinary team with employees from
SAP, hard- & software vendors
• Innovation projects
• Development support
• 3rd level customer support
• Our mission: Make Linux #1 platform
for SAP workloads 3
4
Unrivaled Relationship Making SUSE the Smart Choice for SAP Workloads
• ~90%+ of SAP HANA customers rely on SUSE Linux
• 70% of SAP NetWeaver-on-Linux customers rely on SUSE Linux
• 20 years of joint testing and development at the SAP LinuxLab
• Seamless support from SAP and SUSE
• SLES for SAP Applications is the #1 choice for SAP and SAP customers
• Joint collaboration on Cloud Foundry
• Data Hub 2 validated with SUSE Container as a Service Platform
+
5
What Is SUSE
CaaS Platform
6
3 Key Technology Components
7
Suse CaaS Platform
8
What Is SAP Data
Hub
10
10
SAP Data Hub 2 - Overview
SUSE CaaS PlatformSUSE Enterprise StorageSUSE Linux Enterprise Server
for SAP Applications
SAP S/4HANA
SAP BW/4 HANA
SAP HANA
Other Databases
SAP Cloud Applications
3rd Party Apps
Connected Apps
Data Lake,Machine Learning,Predictive Analytics
AWS S3, GCP GCSAzure ADL, WASB
SAP Data Hub
Data Discovery &Pipelines
Orchestration & Monitoring
Ingestion & Integration
Data Storage
Hadoop
Cloud Storagescontainerized
11
SAP Data Hub
+
SUSE CaaS
Platform
12
SAP Data Hub
Architectural Overview on SUSE CaaS Platform and SUSE Enterprise Storage
SAP Data Hub Foundation containerized
Tenant Applications / Services (Managed by System Management)
DiagnosticsInternal
SAP HANA
Pipeline Modeler
Database Tools
Flow Agent
Spark on K8S
Metadata Explorer
Connection Management
Vora Database
System Management
• SUSE CaaS Platform (Kubernetes)
• SUSE Enterprise Storage
not containerized
optional
Hadoop cluster
HDFS / Spark
Vora Spark Extension
Docker™ Registry
13
14
Requirements
And
Installation
15
Requirements SAP Data Hub 2.7
• 256 GB RAM
• 64 CPUs
• 2,100 GB disk (persistent volumes)
• 100 GB ephemeral disk for each of the Kubernetes worker nodes
• Container registry with at least 60 GB free space
Official sizing guide:
https://help.sap.com/doc/d48a2185992f4148aabd525f1f781606/2.7.latest/en-
US/loiod48a2185992f4148aabd525f1f781606.pdf
16
Reference Architecture
• For on-premise solutions
• Created by Lenovo, SUSE and SAP:
https://lenovopress.com/lp0897.pdf
• Valid for all Data Hub Version <= 2.6
17
17
Installation order
SUSE CaaS Platform cluster
SUSE Enterprise Storage cluster
SAP Data Hub
Linux Workstation
with Kubernetes client,Docker, Helm,
Data Hub Installer
Private Docker Registry
SLES 12/15 withDocker Registry and Portus
1
2
3
4
5
18
Setup The Workstation
• Install the operating system (e.g. OpenSUSE Leap/Tumbleweed)
• Install Docker™
• Install Kubernetes
• Install Helm
• Download SAP Data Hub
1
19
Install SUSE Enterprise Storage
• At least four nodes required
• Follow the SUSE Enterprise Storage Deployment Guide at:
https://documentation.suse.com/ses/5.5/single-html/ses-deployment/#book-storage-deployment
2
20
Install SUSE CaaS Platform
3
• Install Master & Worker Nodes
(SUSE Linux Enterprise Server)
• Install Load Balancer
(e.g. SUSE Linux Enterprise Server)
21
Install SUSE CaaS Platform
• Bootstrap the cluster using skuba:
• skuba cluster init –control-plane <LB_IP/FQDN> my-cluster
• skuba node bootstrap --user sles --sudo --target <IP/FQDN> <NODE_NAME>
• skuba node join --role <master/worker> --user sles --sudo --target <IP/FQDN> <NODE_NAME>
• skuba cluster status
3
22
Setup Your Private Docker Registry
• Install SLES with container module
• Install Docker Registry and Portus
• Generate SSL certificates for container-registry host
(Signed by a valid CA or self-signed)
• Configure Docker Registry and Portus (according to SLES installation guide)
• Distribute the root CA to all CaaSP hosts and management workstation
• Test registry (docker login https://my-registry:5000 –u <user>)
4
23
Install SAP Data Hub
2 ways to install SAP Data Hub:
1. Install.sh script
2. Maintenance Planner & Software Lifecycle Plugin
https://help.sap.com/viewer/product/SAP_DATA_HUB/
5
24
24
./install.sh \
--cert-domain=master-node.testlab.intern \--sap-registry-login-type 2 \
--sap-registry-login-username=<S-USER> \
--cert-domain=master-node.testlab.intern \--sap-registry-login-password=<password> \
--vora-admin-username=admin \
--vora-admin-password=<password> \--vora-system-password=<password> \
--extra-arg=vora-vsystem.vSystem.nodePort=32123 \--extra-arg=vora-dqp.components.txCoordinator.nodePort=30343 \
--extra-arg=vora-cluster.components.txCoordinator.hanawire.portNumber=32215 \
--namespace=datahub24 \--registry=container-registry.testlab.intern:5000 \
--interactive-security-configuration=no \
--enable-checkpoint-store=no \--image-pull-secret=regcred \
--pv-storage-class=nfs-client \--dlog-storage-class=nfs-client \
--disk-storage-class=nfs-client \
--consul-storage-class=nfs-client \--hana-storage-class=nfs-client \
--accept-license \
--confirm-settings \--install
5
Install SAP Data Hub
25
25
SUSE CaaS Platform cluster
SUSE Enterprise Storage cluster
SAP Data Hub
Data Hub Installer
Running to theManagement Workstation
Private Docker Registry
Deplo
ys w
ith H
ELM
chart
spro
vis
ions p
ers
iste
nt
volu
mes
pulls
images
pushesimages
valid
ate
s D
ata
Hub insta
llation
runs in containers / starts containers
store and pull data
SAP ContainerRegistry pulls images1.
1.
2.
2.
3.
5
Install SAP Data Hub
26
Have A Lot Of Fun!
27
SUSE CaaS Platform & SUSE Enterprise Storage
Product landing-pages
https://www.suse.com/de-de/products/caas-platform/
https://www.suse.com/de-de/products/suse-enterprise-storage/
Deployments Guides, Administration Guides & more
https://documentation.suse.com/suse-caasp/4.0/
https://documentation.suse.com/ses/5.5/
SAP Data Hub
Product landing-page
https://www.sap.com/products/data-hub.html
Installation Guide, Administration Guide & more
https://help.sap.com/viewer/product/SAP_DATA_HUB/2.7.latest/en-US
Resources
29
General Disclaimer
This document is not to be construed as a promise by any participating company to
develop, deliver, or market a product. It is not a commitment to deliver any material,
code, or functionality, and should not be relied upon in making purchasing
decisions. SUSE makes no representations or warranties with respect to the contents
of this document, and specifically disclaims any express or implied warranties of
merchantability or fitness for any particular purpose. The development, release, and
timing of features or functionality described for SUSE products remains at the sole
discretion of SUSE. Further, SUSE reserves the right to revise this document and to
make changes to its content, at any time, without obligation to notify any person or
entity of such revisions or changes. All SUSE marks referenced in this presentation are
trademarks or registered trademarks of SUSE, LLC, Inc. in the United States and other
countries. All third-party trademarks are the property of their respective owners.