OpenPOWER Solutions overview session from IBM TechU Rome - April 2016

© Copyright IBM Corporation 2016. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.

OpenPOWER – solutions viewDr Mandie QuartlyOpenPOWER Global Alliances, Europe, IBM@mandieq

David SpurwayPower Product Manager, UK@D_Spurway

© 2016 OpenPOWER Foundation

Vision Execution Adoption

Incorporated December 2013

Opening the door, a license to innovate

OpenPOWER Summit March 2015

Game changing solutions

OpenPOWER Summit April 2016

From proof of concept to industry revolution

OpenPOWEROpenPOWEROpen InnovationOpen Innovation

Why are we here?


Before we dive in – the disclaimer


This session….


Accelerated innovation through collaboration of

partners

Driving industry performance leadership

Vibrant ecosystem through open development

What's OpenPOWER all about?

OpenPOWER is an open development community using the POWER Architecture


This is what a revolution looks like


Speed to innovation | Standards | Choice


Open allows you to create what you need


What's the best tool for the job?


Let's talk about solutions...


Processors

Building blocks

Servers

“Bringing it all together”


POWER8 Architecture POWER9 Architecture

2014POWER8

12 cores

22nm

New Micro-Architecture

New ProcessTechnology

2016POWER8w/ NVLink

12 cores22nm

EnhancedMicro-

ArchitectureWith NVLink

2017P9 SO24 cores

14nm


Direct attachmemory


TBDP9 SUTBD cores

14nm

EnhancedMicro-

Architecture

BufferedMemory

POWER6 Architecture POWER7 Architecture

2007POWER6

2 cores

65nm



2008POWER6+

2 cores

65nm+

EnhancedMicro-

Architecture

EnhancedProcess

Technology

2010POWER7

8 cores

45nm



2012POWER7+

8 cores

32nm

EnhancedMicro-

Architecture


Focus on EnterpriseTechnology and Performance Driven

Focus on Scale-Out and EnterpriseCost and Acceleration Driven

2018 - 20P8/9 SO

10nm - 7nm

Existing Micro-

Architecture

FoundryTechnology

Partner ChipPOWER8/9

2020+

New Micro- Architecture

NewTechnology

POWER10

Future

TBD

IBM POWER Processor Roadmap


The CP1 Processor

● Announced in March 2015● General availability as of April 2016● First available in Zoom Netcom’s

RedPOWER servers

http://openpowerfoundation.org/press-releases/openpower-foundation-technology-leaders-unveil-hardware-solutions-to-deliver-new-server-alternatives/


Processors

Building blocks

Servers



Field ProgrammableGate Array

GraphicsProcessingUnit

DescriptionReconfigurable hardwareTask customized, low latency, low power

1000s of simple coresHigh bandwidth, floating point, and parallelism

ExampleUse Cases

Compression, encryption, high speed streaming, search, Monte Carlo simulations

Deep neural networks, speech recognition, chemistry, simulations, JAVA, Hadoop, graphics

Power ChipIntegration

Coherent Accelerator Processor Interface (CAPI) NVIDIA NVLink (SOD*)

*All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Workload accelerators and POWER


Non-CAPINon-CAPI

Off-ChipAccelerator

CoreCore

MemoryMemory

CAPICAPI

FPGAw/CAPI

AcceleratorP8CoreP8Core

MemoryMemory

Coherent Accelerator Processor Interface


CAPI related OpenPOWER members

© 2016 OpenPOWER Foundation19

2015 2016 2017

POWER8 POWER8 with NVLink POWER9

CAPI Interface Enhanced CAPI & NVLink

Connect-IBFDR Infiniband

PCIe Gen3

ConnectX-4EDR Infiniband

CAPI over PCIe Gen3

ConnectX-5Next-Gen Infiniband

Enhanced CAPI over PCIe Gen4

MellanoxInterconnect

IBM CPUs

NVIDIA GPUs KeplerPCIe Gen3

VoltaEnhanced NVLink

PascalNVLink

Systems

Joint roadmaps looking forward...


NVIDIA NVLink Technology

NVIDIA Tesla GPU NVIDIA Tesla GPU with NVLink

POWER8 POWER8with NVLink

80 GB/sPeak*

PCIe x16

Current GPU Attach

Graphics Memory

System Memory

Graphics Memory Graphics Memory

System Memory

40+40 GB/s

40+40 GB/s

16+16 GB/s

Future NVLink GPU Attachment


D

NVIDIA Pascal P100


Mellanox ConnectX®-4 Single/Dual-Port Adapter—Supporting 100Gb/s with CAPI

SB7800 - Switch-IB™ 2 Managed EDR SwitchMellanox SN2700 Spectrum Ethernet Switch

http://www.hpcwire.com/2016/04/12/interconnect-offloading-versus-onloading/





https://www.google.co.uk/about/datacenters/efficiency/internal/

How efficient Google is with their Data Centres




A possible solution for the rest of us!

http://openpowerfoundation.org/blogs/liquid-cooling-for-openpower-asetek-accelerates-the-performance-of-openpower-platforms/





Plus lots more...

http://openpowerfoundation.org/wp-content/uploads/2016/04/HardwareRevealFlyerFinal.pdf

http://openpowerfoundation.org/wp-content/uploads/2016/04/HardwareRevealFlyerFinal.pdf


Processors

Building blocks

Servers



All

an

d a

ny

info

rma

tion

mig

ht

cha

ng

e,

ple

ase

ch

eck

de

tails

with

re

leva

nt

pa

rtie

s!

Partner Product Size Sockets GPU? Memory Available? Further info

E4 OP205 2U 2 K80 x2 Y Based on Wistron Polaris (aka Firestone)

IBM S812LC 2U 1 N 1TB Y Based on Tyan Habenero

IBM S822LC 2U 2 1TB Y Based on Wistron Polaris (aka Firestone)

IBM 1.25 OU 2 N 2TB Based on Rackspace Barreleye

IBM Supermicro prototype 2U 2 K80 x2 512 GB Up to 12 LFF / SFF

IBM Supermicro prototype 1U 2 K80 x1 512 GB Up to 4 LFF / SFF

IBM Wistron prototype 2U 2 Based on Wistron Polaris Plus (aka Garrison)

Inventec Prototype board 1 16x DDR4

Mark III Systems 1.25 OU 2 N 2TB Based on Rackspace Barreleye

Neu Cloud NL2200 2U 2 Y 32 GB Y

Neu Cloud NL2205 2U 2 CP1 Y 32 GB Y

Penguin Computing Magna 2002 2U 2 1TB Y Based on Wistron Polaris (aka Firestone)

Penguin Computing 1.25 OU 2 N 1TB Based on Rackspace Barreleye

Penguin Computing Magna 2001 2U 2 N 2TB Y Based on Tyan Habenero

Rackspace Barreleye 1.25 OU 2 N 2TB Soon

Stack Velocity 1.25 OU Based on Rackspace Barreleye

Tyan Palmetto GN70-BP010 2U 1 N 4x DDR3 Y

Tyan Habanero GT75-BP012 1U 1 N 32x DDR3

Tyan Habanero TN71-BP012 2U 1 N 32x DDR3 Y aka Habanero

Wistron Polaris 2U 2 K80 x2 1TB Y aka Firestone

Wistron Polaris Plus 2U 2 aka Garrison

Wistron Dark King prototype board 4U 4 128x DIMMS

K80 x2 (optional)

OCP compliant server prototype

P100 x4 + NVLinkP100 x2 + NVLink


K80 x2 Or M40 x2

Magna 1015 (OCP compliant)

Partnering w ith Avago, IBM, Mellanox, PMC & Samsung


Up to 4 Pascal + NVLink


“Base” systems – where derivatives have been created

Habanero TN71-BP012

Polaris(aka Firestone)

BarreleyeOCP compliant

?Polaris Plus(aka Garrison)

GPU + NVLink

Available today Available soon, plus others….


Coming soon: Barreleye

In partnership with Avago, IBM, Mellanox, PMC & Samsung


Motherboard Chassis Rack

OpenPOWER Open Compute Project systems coming to market


Current IBM “LC” Power Systems for Linux

S812LC CPUCPU

MemoryMemory

1x POWER8 CPU 10 cores, 2.9-3.3 GHzUp to 1TB Memory

115 GB/s Memory Bandwith14 Drives (84TB, HDD, SSD)

Optimized for Hadoop, Spark

S822LC CPUCPU

MemoryMemory

Built for CPU Performance, CAPI

Differentiation

CPUCPU2x POWER8 CPU

10 cores each, 2.9-3.3 GHzUp to 1TB Memory

230 GB/s Memory BandwidthOpt. CAPI-attached accelerators

S822LCHPC

CPUCPU

MemoryMemoryBuilt for GPU Acceleration

CPUCPU 2x POWER8 CPU 10 cores each, 2.9-3.3 GHz

Up to 1TB Memory230 GB/s Memory Bandwidth

2x NVIDIA Tesla K80 GPUsGPUGPU GPUGPU


Potential new LC servers

● IBM OCP compliant server prototype– 1.25 OU, 2S, up to 2TB memory– Based on Rackspace Barreleye

● IBM Supermicro prototypes– 2U, 2S, K80 x2, 512 GB memory, up to 12 LFF / SFF– 1U, 2S, K80 x1, 512 GB memory, up to 4 LFF / SFF

● IBM Wistron prototype– 2U, 2S, NVidia P100 x4 + NVLink– Based on Wistron Polaris Plus (aka Garrison)

All

an

d a

ny

info

rmat

ion

mig

ht

cha

nge

, pl

ea

se c

he

ck d

eta

ils w

ith

rele

van

t p

art

ies!


Zaius 1.25 OU• 2 POWER9 CPUS

• 32 DDR4 DIMM SLOTS

• 2X G4 PCIE X16 FHFL

SLOTS

• 1X G4 X16 HHHL SLOT

• 1X G4 X16 OCP MEZ

• 1X M.2 SATA PORT

• 1X SATA PORT

• 15X 2.5” SAS/SATA/NVME

SLOTS

• BMC W/GBE LOM

• “DISKLESS” OPTION


Processors

Building blocks

Servers



Catalogue of CAPI Accelerators – By TypeTransparent

Erasure Code

GZIP Compression

PairHMM Accelerator

LA Library

Bitwise Encryption

Full Solution

Genomics Processing

Graph Analytics Djikstra

Fuzzy Text Search

Petascale Indexing

Integration Required

IBM Data Engine for No-SQL (“CAPI-Flash”)

Fast-Fourier Transfer

Monte Carlo Risk Analysis

CV Library

DNN Library

Key Value Store (KVS)

Dynamic Time Warp Pattern Match

L3 Order Book

Mood Detection

Object Detection

Object Recognition

Object Tracking

ibm.biz/powercapiSee the full descriptions at

With many more coming….. Want to know more?

CAPI sessions later today:1.45pm – part 1 - details3pm – part 2 - ecosystem

(Bernini 1)


Load Balancer

500GB Cache Node

10Gb Uplink

POWER8 Server

Flash Array w/ up to 40TB

After: NoSQL POWER8 + CAPI Flash

WWW

10Gb Uplink

WWW

Backup Nodes

500GB Cache Node500GB Cache

Node500GB Cache Node500GB Cache

Node

Before: NoSQL in memory (x86)

24U 4U

Less is More24:1 physical server consolidation =

6x less rack space

24:1 server consolidation

3x lower cost per user

Data Engine for NoSQL with 40TB CAPI-attached flash


Alternative to IBM Data Engine for NoSQL:● excellent performance and ● supports the same open-source

software interfaces ● costs less● plugs directly into existing servers

rather than requiring a 2U rack slot

More details

CAPI Flash card

https://forums.xilinx.com/t5/Xcell-Daily-Blog/IBM-and-Nallatech-demo-CAPI-Flash-at-OpenPOWER-Summit-in-San/ba-p/691256


The initial 64Mb device is the first product in Everspin's ST-MRAM roadmap that is planned to scale to up to gigabit density and higher speeds.

Supports Standard DDR3 SDRAM Features.Standard DDR3 SDRAM compatible footprint and pinouts.400MHz clock.512-bit Page Size.On-Device Termination.

Presentation from recent OpenPOWER Summit

More details

http://openpowerfoundation.org/wp-content/uploads/2016/02/9_Thomas.Roewer.IBM_.pdf

http://openpowerfoundation.org/wp-content/uploads/2016/02/9_Thomas.Roewer.IBM_.pdf

https://www.everspin.com/64mb-spin-torque-mram-ddr3-dram-compatible


Presentation from recent OpenPOWER Summit

Press release

http://openpowerfoundation.org/wp-content/uploads/2016/04/Edico-Genome-Corp-DRAGEN-2016_04_05.pdf

https://www-03.ibm.com/press/us/en/pressrelease/49479.wss


• In-memory distributed database using GPUs for processing

• Order of magnitude gains:• Performance over CPU

solutions• Power reduction• Cost savings

• Anticipate order of magnitude gains with POWER based NVLink solutions in 2016

GPUdb in-memory Accelerated DatabaseUltrafast ingest and analysis of billions of objects


• Over 2,300 Linux ISVs developing on Power• 50 IBM Innovation Centers • Compelling PoCs • Support for little endian applications

Accelerated software innovation

Big Data & Machine Learning

Big Data & Machine LearningCloudCloud Mobile EnterpriseMobile Enterprise

Major Linux Distros

HPCHPC

miniDFTminiDFTCTHCTH

BLASTBLASTBowtieBowtieBWABWA

FASTAFASTAHMMERHMMER

GATKGATKSOAP3SOAP3

STAC-A2STAC-A2SHOCSHOC

Graph500Graph500IlogIlog

CHARMMCHARMMGROMACSGROMACS

NAMDNAMDAMBERAMBER

RTMRTMGAMESSGAMESS

WRFWRFHYCOMHYCOMHOMMEHOMME

LESLESMiniGhostMiniGhostAMG2013AMG2013

OpenFOAMOpenFOAM


Introducing OpenPOWER Ready

● Products / solutions may display badge

● Participants request to use it● Compatibility● Not Certification or

Compliance ● OpenPOWER Ready™ List

http://openpowerfoundation.org/technical/openpower-ready/

http://openpowerfoundation.org/technical/openpower-ready/


Two tracks to challenge and win:1. The Open Road Test

– Port and optimize for OpenPOWER

– Go faster with accelerators (optional)

2. The Spark Rally– Train an accelerated DNN and recognize

objects with greater accuracy

– Show you can scale with Spark

Key Dates

Register todayopenpower.devpost.com

Sun May 1st: Submission periods opens

Tue Aug 2nd: Submission period closes

Grand prizes include a trip to Supercomputing 2016

Other prizes include iPads, Apple Watches

http://openpower.devpost.com/

http://ibm.biz/Summit2016SuperVessel


http://openpowerfoundation.org/technical/resource-catalog/

OpenPOWER Resource Catalog(ue)

● Recently announced● Technical resources● OpenPOWER Ready products● OPF solutions

– HA– Cloud– Accelerators– Big Data– Security– HPC– Systems

http://openpowerfoundation.org/technical/resource-catalog/


Interested in knowing more?

http://openpowerfoundation.org/openpower-summit-europe/

http://openpowerfoundation.org/openpower-summit-europe/


continents

60+ technologies revealed

innovations under way 100s

members 200+

24 6 countries

In summary – so much going on...


Join the rebellion!

Main website → openpowerfoundation.orgOverview → ibm.biz/openpower_overview

[email protected]

51IBM Systems Technical Events | ibm.com/training/events © Copyright IBM Corporation 2016. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.

Session Evaluations

YOUR OPINION MATTERS!

Submit four or more session evaluations by 5:30pm Wednesday

to be eligible for drawings!

*Winners will be notified Thursday morning. Prizes must be picked up at registration desk, during operating hours, by the conclusion of the event.

1 2 3 4

52IBM Systems Technical Events | ibm.com/training/events © Copyright IBM Corporation 2016. Technical University/Symposia materials may not be reproduced in whole or in part without the prior written permission of IBM.

Continue growing your IBM skills

ibm.com/training

provides a comprehensive portfolio of skills and career accelerators that are designed to meet all your training needs.

If you can’t find the training that is right for you with our Global Training Providers, we can help.

Contact IBM Training at [email protected]

Global Skills Initiative

mailto:[email protected]

Reference material


ADM-PCIE-KU3 and ADM-PCIE-7V3Applications•Data Center•Network Accelerator•High Performance Computing (HPC)•Data Processing•System Modelling•Market Analysis

ADM-PCIE-8K5Applications•Video Processing•Machine Learning•High Performance Computing (HPC)•Network Acceleration

http://www.alpha-data.com/dcp/capi.php

http://www.alpha-data.com/dcp/capi.php


XUSP3S Xilinx UltraScale 3/4-Length PCIe Board with Quad QSFP, DDR4, QDR-IV, and QDR-II+

● Application: ● Network Packet Processing, High Performance

Computing, Signal Processing● Market:

● Compute & Data Center, Government, Instrumentation & Test, Financial Services, Broadcast & Video

http://www.bittware.com/xilinx/product/xusp3s/ http://www.bittware.com/bittware-openpower-capi-devkit/

http://www.bittware.com/xilinx/product/xusp3s/

http://www.bittware.com/xilinx/product/xusp3s/

http://www.bittware.com/bittware-openpower-capi-devkit/


http://www.nallatech.com/solutions/openpower-capi-developer-kit-for-power-8/

http://www.nallatech.com/wp-content/uploads/Nallatech_CAPI_Developer_Kit.pdf

http://www.nallatech.com/solutions/openpower-capi-developer-kit-for-power-8/

http://www.nallatech.com/wp-content/uploads/Nallatech_CAPI_Developer_Kit.pdf

© 2016 OpenPOWER Foundation 57

The Mythbusters explain GPUs – click image below...

https://www.youtube.com/watch?v=-P28LKWTzrI


● Brocade 6510 Gen 5 Fibre Channel switch (16 Gbps)

● Brocade G620 Gen 6 Fibre Channel switch (32Gbps)

● Brocade VDX6740 Ethernet Fabric switch (10/40Gbps)

● Brocade ICX7750 Ethernet switch (1/10/40 Gbps)

http://community.brocade.com/t5/SDN-NFV/Brocade-joins-the-OpenPOWER-Foundation/ba-p/84972

http://www.brocade.com/en/possibilities/the-new-ip.html?intcmp=lp_hp_newip_bn_00003#

http://openpowerfoundation.org/presentations/openpower-brocade-vrouter-possibilities/




http://www.brocade.com/en/possibilities/the-new-ip.html?intcmp=lp_hp_newip_bn_00003

http://www.brocade.com/en/possibilities/the-new-ip.html?intcmp=lp_hp_newip_bn_00003




Qlogic announces 6 OpenPOWER ready adapters: http://blogs.qlogic.com/Pages/blogView.aspx?blogID=120

*Enhanced Gen 5 FC is QLogic’s most advanced set of Gen 5 FC Adapters. Providing more than just a performance increase, these adapters deliver superior reliability, power efficiency and investment protection, along with an exceptional set of data center diagnostic, orchestration and quality of service capabilities.

http://blogs.qlogic.com/Pages/blogView.aspx?blogID=120


Server reference linksE4 OP205 http://cms-it.e4company.com/media/34936/product-sheet_op205_w.pdf IBM S812LC https://www.ibm.com/marketplace/cloud/big-data-infrastructure/us/en-us IBM S822LC https://www.ibm.com/marketplace/cloud/high-performance-computing/us/en-us IBM OCP compliant server prototype http://www-03.ibm.com/press/us/en/pressrelease/49478.wss IBM Supermicro prototype http://www-03.ibm.com/press/us/en/pressrelease/49478.wss IBM Supermicro prototype http://www-03.ibm.com/press/us/en/pressrelease/49478.wss IBM Wistron prototype http://www-03.ibm.com/press/us/en/pressrelease/49478.wss Mark III Systems OCP compliant server prototypehttps://www.markiiisys.com/blog/2016/03/14/mark-iii-openpower-open-compute-project-premise-barreleye/ Neu Cloud NL2200 http://openpowerfoundation.org/?resource_lib=neu-cloud-oriental-nl2200 Neu Cloud NL2205 http://openpowerfoundation.org/?resource_lib=neu-cloud-oriental-nl2205 Penguin Computing Magna 2002http://www.penguincomputing.com/products/rackmount-servers/openpower-servers/ Penguin Computing Magna 1015 (OCP compliant)http://www.penguincomputing.com/products/rackmount-servers/openpower-servers/ Penguin Computing Magna 2001http://www.penguincomputing.com/products/rackmount-servers/openpower-servers/ Rackspace Barreleye http://openpowerfoundation.org/blogs/openpower-open-compute-rackspace-barreleye/ Tyan Palmetto GN70-BP010 http://www.tyan.com/solutions/tyan_openpower_system.html Tyan Habanero GT75-BP012 http://www.tyan.com/solutions/tyan_openpower_system.html Tyan Habanero TN71-BP012 http://www.tyan.com/solutions/tyan_openpower_system.html Wistron Polaris http://openpowerfoundation.org/?resource_lib=wistron-corp-polaris

http://cms-it.e4company.com/media/34936/product-sheet_op205_w.pdf

https://www.ibm.com/marketplace/cloud/big-data-infrastructure/us/en-us

https://www.ibm.com/marketplace/cloud/high-performance-computing/us/en-us

http://www-03.ibm.com/press/us/en/pressrelease/49478.wss




https://www.markiiisys.com/blog/2016/03/14/mark-iii-openpower-open-compute-project-premise-barreleye/

http://openpowerfoundation.org/?resource_lib=neu-cloud-oriental-nl2200

http://openpowerfoundation.org/?resource_lib=neu-cloud-oriental-nl2205

http://www.penguincomputing.com/products/rackmount-servers/openpower-servers/



http://openpowerfoundation.org/blogs/openpower-open-compute-rackspace-barreleye/

http://www.tyan.com/solutions/tyan_openpower_system.html



http://openpowerfoundation.org/?resource_lib=wistron-corp-polaris


MemoryBuffer

DRAMChips

POWER8

Up to 12 Cores, up to 96 ThreadsL1, L2, L3 + L4 CachesUp to 1 TB per socket

Up to 230 GB/s sustained memory bandwidth

POWER8 Processor – the low down...


Linux support for POWER

Same source and distribution release schedules as x86Simplified x86 application migration with little endian distributions Enterprise support for all three from IBM or distributors


http://developers.openpowerfoundation.org/

http://developers.openpowerfoundation.org/

OpenPOWER Solutions overview session from IBM TechU Rome - April 2016

Technology

Transcript of OpenPOWER Solutions overview session from IBM TechU Rome - April 2016