SAP HANA on IBM Power and Storage Systems

Dr. Antonio Palacin

Director of ISICC

Last update: 2015-11-17

Customer Examples

Content

2

SAP HANA – Brief overview

HANA on POWER – History and current state

HANA on POWER

Summary

Customer Examples

Content

3

SAP HANA – Brief overview

HANA on POWER – History and current state

HANA on POWER

Summary

Supported databases by SAP Business Suite

4

Database Remarks

DB2 LUW It provides in-memory technology (feature BLU), row + column

store and very high data compression

DB2 for IBM i Available from IBM in combination with Power Systems running

on IBM i OS. Very high customer reputation, excellent handling

of multi-tier data levels (memory, disks, flash)

DB2 z/OS Highest degrees of RAS features. Very high acceptance at

installed base.

MS SQL Server First 3rd party in memory database supporting SAP applications

Oracle Last 3rd party in-memory databae supporting SAP applications

Oracle Extended License Package Extension e.g. to run Oracle RAC

SAP MaxDB No further development

SAP Sybase ASE Runtime Announced by SAP after having introduced HANA

SAP HANA First in-memory database supporting SAP BW and SAP BS.

Many different price metrics

SAP HANA – not only a database, but a platform

5 Source: SAP, 2015

SAP Vision on HANA

6

HOW?

From:

• One DB per application

• Point-to-point integration (e.g. ETL)

• Long running queries, e.g. in batch mode

To:

• One DB per landscape

• No integration necessary

• Real time execution

SAP on In-Memory Computing: Re-think Paradigms

7

Avoid movement of detailed data: Calculate first, then move results

AFLs require incremental organizational and technical porting efforts.

Application

Layer

Database

Layer

Calculation

Calculation

Today Future

AFL

Migration to HANA on POWER

• Many times there is a need to run a

technical upgrade on the SAP Netweaver

and SAP Business Suite stack

• SAP heterogeneous system copy

procedures apply

• Standard migrations using Software

Provisioning Manager (SWPM) and

customer R3load exports

• Software Upgrade Manager with

Database Migration Option (SUM/DMO)

8

• SAP system has to be a single ABAP stack

• non-unicode systems will become converted to Unicode

• Source system release has to be based on SAP NetWeaver 7.0 SP17 or higher.

• Target system release has to be based on SAP NetWeaver 7.31 (or higher).

Rule of thumb for data migration: 15 GB / p8 core / h

Customer Examples

Content

9

SAP HANA – Brief overview

HANA on POWER – History and current state

HANA on POWER

Roadmap and Summary

History - Development activities

August 2013 SAP initiates Product Development

Program for HANA on IBM Power technology

December 2013 HANA code optimized compiled/linked (HANA SPS08, SLES11SP2)

February 2014 All HANA Servers running, IBM code checked in, full function

testing commencing, Power 8 optimization agreed

June 2014 SaphireNow/Bernd Leukert announces “Test and Evaluation Program”

for selected customers in 3Q 2014

October 2014 SAP TechEd && d-code/Bjoern Goerke announces

HANA on POWER SAP Ramp-Up Program” beginning 1Q2015

November, 2014 BW 7.31+ TEA code ships to customers

March, 2015: SAP Ramp-up opened for customer applications

July 2015: SAP Ramp-up succesfully closed

August, 2015: GA of SAP HANA on IBM POWER

10

SAP HANA on POWER – Current Status

November 2014 – February 2015

Release to Customer

Ramp-Up Start

April 2015

Public announcement

at SAPPHIRE, May 2015

Ramp-Up

period BWoH

Customer Test and

Evaluation phase

T&EA

period SoH selected use cases

GA date

SoH

tbd

General Availability

SAP for BW

August 2015

Ramp-Up

period BWoH Closed 07/15

11

Customer Examples

Content

12

SAP HANA – Brief overview

HANA on POWER – History and current state

HANA on POWER

Summary

Power Systems

S812L •1-socket, 2U •Up to 12 cores POWER 8

•512 GB memory •6 PCI Gen3 •Linux only •PowerVM or PowerKVM

•2-socket, 2U •Up to 24 cores •1 TB memory •9 PCI Gen3 •Linux only •PowerVM or PowerKVM

•2-socket, 2U •Up to 20 cores •9 PCIe Gen 3 •AIX & Linux •PowerVM

Power Systems

S822

Power Systems

S814 •1-socket, 4U •Up to 8 cores •512 GB memory •7 PCIe Gen 3 •AIX, IBM i, Linux •PowerVM

Power Systems

S824

•2-socket, 4U •Up to 24 cores •2 TB memory •11 PCIe Gen 3 •AIX, IBM i, Linux •PowerVM

ALL systems are certified for use with SAP Business Suite ALL systems are supporting SAP HANA

Power Systems

S822L

Power Systems

E870/E880 •4-sockets per Drawer •Up to 64 / 192 cores •Max. of 8 / 16 TB memory •AIX 7.1 TL03+SP, 6.1 TL09+SP • i5OS 7.2 TR1, 7.1 TR9 • RHEL 7, 6.6 • SLES 12, 11SP3 •AIX, Linux •PowerVM

Power Systems Server Family

Power Systems

E850 •4-socket, 4U •Up to 48 cores •2 TB memory •11 PCIe Gen 3 •AIX, Linux •PowerVM

13

HANA Stack on IBM Power Systems

14

SAP HANA®

SUSE Linux Enterprise Server

Red Hat Enterprise Linux

XFS or GPFS

(scale-out-file system) POWER Linux

compliant tools

HW Platform

(Server and Storage)

Business Applications

G

BS

G

TS

/ I

TS

High Availability Solutions Automate takeover in SAP HANA system replication setups

• IBM System Automation for Multiplatforms

–New automation policy for HANA

– ibm.com/developerworks/community/groups/service/html/communityview?communityUuid=5b16a65c-5410-4b4e-b8b2-5c69053183bd

• SUSE Linux High Availability Extension

(included in SLES4SAP Applications)

SAPHanaSR resource agent

On Power Linux available with

SLES 11 SP4 scn.sap.com/docs/DOC-56278

15

TDI – Tailored Datacenter Integration

16

• Solution validation done by SAP/CSI

• Preconfigured hardware set-up

• Preinstalled software

• Installation needs to be done by customer

• Customer aligns with the hardware partner

on individual support mode

Fast Implementation

Support fully provided by SAP

More Flexibility

Save IT budget and existing investment

17

SAP HANA

Flash only pool Easy Tier pool HDD only pool

FLASH ET HDD

SVC nodes

IBM FlashSystem IBM HDD

Standard IBM Storage blue print (for HANA)

LOG DATA

Reasonable IBM storage configs for SAP HANA TDI

18

Storage Virtualization SAP HANA data SAP HANA log

Spectrum Virtualize

(SVC)

Storwize FlashSystem

XIV FlashSystem

DS8800 FlashSystem

FlashSystem FlashSystem

Storage System SAP HANA data SAP HANA log

Storwize HDD SSD

XIV Module Module

DS8800 HDD SSD (HDD)

FlashSystem Module Module

Interesting differences in CPU performance design points between Intel and IBM based on SAPS per Core

0

2000

4000

6000

X-5570 E5-2690 E7-8890

Intel x86

19

0

2000

4000

6000

p6 p7+ p8

IBM POWER

2.9 GHz 2.5 GHz 4.2 GHz 2.9 GHz 3.7 GHz 5.0 GHz

+ 213 % - 36 %

Source: www.sap.com/benchmarks, 2-tier SD

POWER8 faster memory bandwidth is ideal for in-memory applications like SAP HANA

Source: IBM CPO

POWER8

POWER7+

IvyBridge EX

IvyBridge EP

SandyBridge EP

100 200 300 400 0

Memory Bandwidth GB/s

Min / Max

Memory large, fast workspace to

maximize business insight

4X memory bandwidth vs Intel

(up to 16TB of memory)

20

SAP BW-EML Benchmark Scale-up 2 Bil. records

Source: http://global.sap.com/solutions/benchmark/bweml-results.htm

60 c

ore

s

72 c

ore

s 4

0 co

res

60 c

ore

s

60 c

ore

s

Benchmark status: June 2015

21

POWER8 MEMORY CDIMM

16MB L4 Cache + Scheduler

Up to 128GB Single-bit Correct

Double-bit Correct

DRAM Chip

Correct – up to 4 failures per DIMM

DRAM Spare

4 Chip per DIMM

Industry Standard DIMM

No L4 Cache

Up to 32GB

Standard ECC memory with parity

IBM Power Systems memory – built for high performance and resiliency

IBM Power Systems RAS Features – an ongoing development

POWER7 POWER8

1 & 2 sockets

POWER8

E850

POWER8

E870/E880

Processor soft error protection, recovery and self-healing Yes Yes, but

limited on KVM Yes Yes

Integrated PCIe controller, L2 cache column repair, integrated

Power/cooling monitor function using chip controller,

memory buffer replay

No Yes, but

limited on KVM Yes Yes

PCIe hot-plug 750/760 Yes Yes Yes

Enterprise memory with custom DIMMS, chipkill and spare DRAM,

memory buffer softerror handling No Yes Yes Yes

Active memory mirroring for the Hypervisor No No optional Yes

Can take advantange of Capacity Upgrade on Demand No Yes optional Yes

Dynamic Substitution of unused memory for predictive memory faults No Yes Yes Yes

Triple redundant ambient temperature sensors on operational panel No Yes Yes Yes

Redundant/spare voltage convertors for processor/memory voltage

levels No No

redundant

or spare Yes, both

Redundant global processor clocks No No No Yes

Redundant service processor No No No Yes

Can re-IPL other nodes when an entire node has to be deconfigured

due to fault No No No Yes

Supports Enterprise System Pools No No No Yes

23 Source: POWER8 Processor-Based Systems RAS by Daniel Henderson, IBM 2015

Power Systems RAS versus x86 POWER x86

Application/Partition RAS

Live Partition Mobility Yes Yes

Live Application Mobility Yes Yes, support issues

Partition Availability priority Yes No

System RAS

OS independent First Failure Data Capture Yes EX – MCA Recovery

Memory Keys (including OS exploitation) Yes No

Processor RAS

Processor Instruction Retry Yes No

Alternate Processor Recovery Yes No

Dynamic Processor Deallocation Yes No

Dynamic Processor Sparing Yes No

Memory RAS

Chipkill™ Yes Yes, some vendors

Survives Double Memory Failures Yes Yes, optional

Selective Memory Mirroring Yes No

Redundant Memory Yes Yes

I/O RAS

Extended Error Handling Yes No

I/O Adapter Isolation (PI-Bus and TCEs) Yes No

24

See the following URLs for addition details: http://www-03.ibm.com/systems/migratetoibm/systems/power/availability.html

http://www-03.ibm.com/systems/migratetoibm/systems/power/virtualization.html

Customer Examples

Content

25

SAP HANA – Brief overview

HANA on POWER – History and current state

HANA on POWER

Summary

SAP HANA landscape at CPFL, Brazil

VIOSERVER19

VIOSERVER20

CPSPADBIH02

CPSPAABIH01

CPSPAABIH02

IBM Power Systems E870

40 cores POWER8 4,1 GHz

2TB RAM

26 Source: CPFL, 2015 26

Partition OS Virtual

Processors Mode Weight Memory

VIO VIO 4 Uncapped 256 8

VIO VIO 4 Uncapped 256 8

HANA Linux 16 Dedicated - 512

AS server AIX 12 Uncapped 128 64

AS server AIX 12 Uncapped 128 64

Performance comparison SAP BPC Reports

Oracle environment:

BW 7.01

BPC 7.5

Oracle DB

IBM POWER7 - 32 cores

52 GB RAM

HANA environment:

BW 7.4

BPC 10.1

Hana

IBM POWER8 – 16 cores

512 GB RAM

BPC Report

BPC

on Oracle

(seconds)

BPC

on Hana

(seconds)

Time

Reduction

Real Budget Report 420 21 95,00%

Real Forecast Report 240 3 98,75%

Planning - 180 days monthly Report 60 3 95,00%

Planning - 180 days Report 50 3 94,00%

30 days Report 40 2 95,00%

27 Source: CPFL, 2015

Spectrum Protect (former TSM data protection) solution for SAP HANA on POWER TSM for ERP SAP HANA on Power is now available

A new forum has been created on the TSM 2015

developerWorks community called "TSM for ERP" for any

issues or questions you may have on this new

functionality. The direct link to this forum is:

https://www.ibm.com/developerworks/community/forums/html/fo

rum?id=804d3d90-bd38-49a8-a9ee-406cac6f5ce9

28

Architecture Overview of the SAP Infrastructure including SAP HANA @ Hamm Reno (Hamm Reno Group)

V5000 V5000

S824_1

16 (24)-Core, 768GB RAM

LP

AR

Ethernet

Fibrechannel

VIO

2

HMC_2 HMC_1

DC1 DC2

VIO

1

Ethernet

Fibrechannel

Live Partition Mobility

S824_2

16 (24)-Core, 768GB RAM

VIO

2

VIO

1

LVM Mirror

SAN Fabric 1 SAN Fabric 1 SAN Fabric 2 SAN Fabric 2

LTO Library LTO Library

4 4 4 4

S824_3

16 (24)-Core, 768GB RAM

VIO

2

VIO

1

LP

AR

LP

AR

LP

AR

LP

AR

LP

AR

LP

AR

HA

NA

De

v

LP

AR

LP

AR

LP

AR

LP

AR

S822L

20-Core, 384GB RAM

VIO

2

VIO

1

HA

NA

Pro

d

Source: HRG, 2015 29

IBM Spectrum Protect for SAP HANA Backup @ Hamm Reno

Source: HRG, 2015

SAP HANA database backup is done via GB Ethernet directly on tape

SAP HANA log files are first stored on a TSM disk pool and then migrated to Tape

30

Rule of thumb:

1 h 200 GB full backup

to tape system

CPU usage on HANA LPAR @ Hamm Reno

Source: HRG, 2015

Few peaks during overnight processing

Real-time processing during daytime hardly visible

Significantly more than 32 GB per core load-dependent is realistic, e.g. with entitlement

(guaranteed cycles) in a shared processor pool

31

de

gre

e o

f fl

exib

ilit

y

DEV/SBX/EDU/Test HANA DB >= 2xGB/core ratio

(min 2 Cores)

Pre-Prod/QA HANA DB temp. 1x PRODGB/core ratio

TDI aligned, Linux,

dedicated donating

Non-PROF systems,

Shared Pool

BW HANA PROD 32GB/core, min. 8 cores

Data

HANA SoH PROD (SoD)

BW App-Server

ERP App-Server

HANA BW Non-RROD

HANA ECC Non-PROD

HANA Analytics PROD

VIO

S

VIO

S

Sha

red

po

ol

ERP HANA PROD 96 GB/core, min. 8cores

Data

Data

Data

PROD systems,

Shared Pool

others

BW App PROD per SAP QS

ERP App PROD per SAP QS

Most advance Virtualization of productive HANA landscapes runningn on IBM PowerVM HANA multi-tenant

32

TUM - SAP UCC landscape overview

33

Technische Universität München

Source: TUM, 2015

Set-up of SAP HANA landscape on IBM Power Systems

34

HANA

LPAR 1 XIV I – 79 TB

XIV II – 79 TB

Fibre Channel

SAN-Switch

Fibre Channel

SAN-Switch

Pow

er

8 S

erv

er

S822

Pow

er

8 S

erv

er

S822

2 phys. IBM POWER8 CPUs with 12 cores each having 3,89 GHz, 512 GB RAM, internal HDDs for VIOS

Hypervisor: PowerVM

Hypervisor: PowerVM

2 phys. IBM POWER8 CPUs with 12 cores each having 3,89 GHz, 512 GB RAM, internal HDDs for VIOS

SLES 11 SP4 for PPC

2 cores, 128 GB RAM

SAP

LPAR 2

HANA

LPAR 3

SAP

LPAR 4 HANA

LPAR 5

HANA

LPAR 6

AIX 7.1 SLES 11 SP4 for PPC

AIX 7.1 SLES 11 SP4 for PPC SLES 11 SP4 for PPC

1 core, 10 GB RAM 2 cores, 128 GB RAM

0,5 cores, 128 GB RAM 1 core, 32 GB RAM 1 core, 32 GB RAM

PowerVC

LPAR 7

SAP

LPAR 8

SAP

LPAR 9 HANA

LPAR 10

SAP

LPAR 11 HANA

LPAR 12

HANA

LPAR 13

RHEL 6.5

2 cores, 10 GB RAM

AIX 7.1 SLES 11 SP 3 SLES 11 SP 4

AIX 7.1 SLES 11 SP 4 AIX 7.1

2 cores, 32 GB RAM 2 cores, 32 GB RAM 2 cores, 128 GB RAM

0,5 cores, 9 GB RAM 1 core, 256 GB RAM 0,2 core, 14 GB RAM

Technische Universität München

Source: TUM, 2015

Comparing both SAP HANA virtualized environments (1 of 2)

Noteworthy properties of x86 setup Noteworthy properties of Power setup

Not officially supported by SAP, thus we are on

our own in handling any potential issues

As we come from a POWER setup running

mostly AIX LPARs, SLES is a new stack for us,

for which we neither have lots of know-how nor

any tools which would allow for e.g. faster

deployment

x86 virtualization, at least in our scenarios,

proves to be much more unstable compared to

our POWER LPARs (frequent performance

issues, crashing HANA servers, etc.)

Management options offered by x86 systems are

not as refined as for our POWER systems (e.g.

no HMC support)

Officially supported by SAP and IBM in case of

software or hardware issues

As SLES 11 SP4 (PPC) is a prerequisite for running

SAP HANA on Power, we are not able to leverage

our previous experiences, tools and self-developed

script as we would have been with AIX

SAP HANA on POWER LPARs proved to be very

stable and worked like a charm throughout our

various setups (BW on HANA, BW on HANA w/ high

availability, SAP ERP on HANA, SAP ERP with

ERPsim game as well as standalone development

HANAs)

Even the configurations are not supported yet like

MDC or scale-out did not give us any trouble

35

Technische Universität München

Source: TUM, 2015

Comparing both SAP HANA virtualized environments (2 of 2)

Noteworthy properties of x86 setup Noteworthy properties of Power setup

x86 systems require a lot more ramp up effort as

they do not come with a built-in hypervisor

(unlike POWER systems which sport PowerVM).

Building an own, strapped-down hypervisor

Linux distro would be possible but very time-

consuming (also: additional maintenance effort)

The host OS and hypervisor require a healthy

amount of RAM and CPU, which in turn is not

available for any guest OS

We chose this setup as we could not afford a

dedicated appliance, which would have occupied

space and resources in our data center but did

not provide any scalability in terms of computing

resources or usage type (it would have only be

able to run HANA and could not share any

resources)

Management options offered by the previous

POWER generation are also available for POWER8

(HMC, VIOS, AME, and so forth)

Initial setup of a server is rather easy compared to

x86 systems due to the built-in hypervisor

As the PowerVM hypervisor has a very small

footprint and is efficiently implemented, more

system ressources can be assigned to LPARs

instead of being occupied by the hypervisor and

host OS

Ressource utilization is much more efficient due to

the whole server employing virtualization

technologies whereas a dedicated appliance could

only run a HANA workload

36

Technische Universität München

Source: TUM, 2015

Customer Examples

Content

37

SAP HANA – Brief overview

HANA on POWER – History and current state

HANA on POWER

Summary

SAP HANA on IBM POWER - Customer Value

Designed for mission critical 7 X 24 Enterprise customer operations

Not an Appliance, running on traditional Power7+ and Power8 servers

Best Reliable, Available, Serviceable (RAS) in the market

Best performance and in addition On-Demand Capacity

Customer values

Significant Power SMT throughput advantages versus Intel x86

Unique PowerVM advantages: Virtualization out of the Box, no overhead

TDI like approach re-use existing IT assets and operational patterns

Mixed workload leading to IT simplifications and better utilization

High granularity on memory and CPUs leads to cost reduction

Co-existence with established SAP landscape using AIX, and IBM i

38

HANA on POWER Technical Documentation

• Planning Guide http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102502

–ready for 2014 TEA and 2015 Ramp-Up phase

–features process/support/service guidance

• SAP Note 2055470

–HANA on POWER planning and installation specifics

• SAP Note 2133369

SAP HANA on Power: Central Release Note

• IBM Supplemental HoP Implementation Guide

–Being created now

• SLES 11.x for SAP Applications Configuration

Guide for SAP HANA (x86 and POWER)

• Administration/Troubleshooting Guide – Future plan, Includes best practices from customer implementations

39

Map SAP Sizing

results to IBM

HoP specifics

Supplemental to

SAP HANA

Master,

Installation &

Admin Guide

Addional information

on SAP HANA on Power

by

Press release and announcement materials from SAP:

– SAP Press release: http://www.news-sap.com/sapphire-now-sap-fosters-open-ecosystem-customer-innovation/

– SAP Announcement clip: http://events.sap.com/sapphirenow/en/clips.aspx?snapid=242749

– SAP GA Announcement: https://blogs.saphana.com/2015/08/21/announcing-general-availability-of-sap-hana-on-ibm-power-systems/

40

For more information on IBM SAP common activities

41

Common page of IBM and SAP: http://www.ibm-sap.com

Contact the ISICC Infoservice: isicc@de.ibm.com

42