Improving App Performance and Protection for …...#vmworld Improving App Performance and Protection...

#vmworld

Improving App Performance and Protection for VMware:

NVMe, Cloud and BeyondColin Durocher, Dell EMC

Drew Tonnesen, Dell EMC

HYP3705BUS

#HYP3705BUS

VMworld 2018 Content: Not for publication or distribution

2

Agenda

Introduction to NVMe

Benefits of NVMe on VMware environments

2

Data protection advances for VMware environments• NVMe• Converged• Cloud


3

Introduction to NVMe


4

What is NVM and NVMeI N T R O D U C T I O N T O N V M e

NVM is non-volatile memory media

• NAND-based flash

• Storage Class Memory (SCM) media technologies such as 3D XPointTM

NVMe(Non-Volatile Memory Express)

• A set of standards which define a PCI Express (PCIe) interface used to access data on NVM

• Takes advantage of modern CPUs and SSDs

• Replaces older storage protocols

• NVMe unlocks up to 65536 queues, up to 65536 commands per queue

Standard developed by an open industry consortium

Directed by a 13 company promoter group which includes Dell

Core designobjective to achieve high levels of the following

• Parallelism

• Concurrency

• Scalability

4


5

Conceptualizing NVMeI N T R O D U C T I O N T O N V M e

Concept attribution: J Metz, “The Data Robot Parable”

Flash + SCSI/SAS

Flash: all data blocks available at the same seek time & latency

SCSI /SAS: pick & place robot w/single arm executing 1 command at a time, 1 queue

HDD + SCSI/SAS

Slower Faster

HDD: varying speed conveyer belts carrying data blocks (faster belts = lower seek time & latency)

SCSI / SAS: pick & place robot w/tracked, single arm executing 1 command at a time, 1 queue

Media

Protocol

5

Flash + NVMe

Flash: all data blocks available at the same seek time & latency

NVMe / PCIe: pick & place robot with 1000s of arms, all processing & executing commands simultaneously, over 64K queuesVMworld 2018 Content: Not for publication or distribution

6

Storage technology transitions

HDD 7K, 10K, 15K

M E D I ATransitions

D R I V E I N T E R FAC E

Transitions

H O S T I N T E R FAC E

Transitions

NAND FLASHSLC, MLC, TLC

SCMe.g. 3DXP

PARALLEL SCSI & ATA

FIBRE CHANNEL SAS & SATA NVMe

SCSI FIBRE CHANNEL NVMeoF

6


7

Addresses latency / capacity gap between DRAM and NAND SSDs

S C M F I L L S T H E G A P, N V M E I S T H E P A T H T O G E T T H E R E

10ns 1us 10us1ns 100ns 100us 1ms 10ms

HDDStorage Class

Memory (e.g., 3D XPoint)DRAMProcessor

SRAMAccessLatency

Rel

ativ

e ca

paci

ty

CAPACITY/LATENCY GAP

$$$$ $$$ $$ $ < $ << $

SSD(NAND Flash)

VOLATILE NON-VOLATILENVMe unlocks the power of SCM

7


8 Storage Class Memory*

SASDISK ERA

SAS Protocol

NVMeMODERN ERA

NVMe Protocol

SAS NAND Flash Drives

NVMe NAND Flash Drives

Multi-controller Architecture with Multi-core CPUs

Multi-controller Architecture with Multi-core CPUs

Maximizing the Performance of a Multi-Controller Architecture

N V M E U N L O C K S T H E P O W E R O F N E X T G E N M E D I A

*SCM Drive coming soon8


9

Flash becomes mainstream storage• Flash/SSD lowered cost ($/GB) over time make

AFA mainstream data center solution

• SSDs true potential not exposed because legacy protocols were designed based on older technology single core CPU, slow HDD + fast volatile memory (DRAM)

Emergence of NVMe• NVMe designed from ground to use flash.

Protocol exposes the parallel nature of NAND in SSD to increase performance and lower latency

• Common NVMe protocol & driver allow adoption of NVMe from multiple SSD suppliers and across multiple OS

Emergence of NVMeB U S I N E S S D R I V E R S

9


10

NVMe host connectivity Simplest - an NVMe card in a server, direct access to storage on the server or directly to array

NVMe over Fabric (NVMeoF)

Fabric can be any of the following:• FC (most popular)• Ethernet• RoCE (RDMA over Converged Ethernet)• iWARP• Infiniband• Next Gen Fabrics

3DXP

3DXP SSD SSD SSD SSD SSD SSD

Controller Side Transport Abstraction

Host Side Transport Abstraction

NVMe Host Software

FibreChannel

InfiniBand RoCE Next Gen

FabricsiWARP

APPOS

APPOS


11

Why NVMe over Fabric

PCIe Connections

NVMe SSDs

I M P L E M E N TAT I O NThin encapsulation, no translationUses existing Fibre Channel (32Gb/s) and co-exists with FC SCSI

U S E C A S E SIO parallelization and low latencyInvestment protection and increased scale

B E N E F I T SEnd to end performance optimizationEnabler for high performance shared storage

NVMeFC Fabric

NVMe HBA NVMe HBA

NVMe Array Controller

11


12

NVMe

NVMe over Fabric

NVMe over Fabric SWITCH

SERVER

PowerMax

*Coming early 2019

M U LT I - C O N T R O L L E R

E N D T O E N D N V M e• NVMe over Fabric Ready*• NVMe based drives (dual ported)

• NVMe based DAE

I N D U S T R Y S TA N D A R D T E C H N O L O G Y

Future Proof NVMeD E L L E M C P O W E R M A X

12

Flash SCM*


13 Slide credit: Intel and NVM ExpressSource: Storage Technologies Group, Intel. Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.

Late

ncy

E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T - 2 0 0 8

SERVER

FIBER CHANNEL

HOST

STORAGE NETWORK

VMAX1 / 2

Engine

Back End

Disk Shelf

SASHDD + SAS

Drive Latency Controller Latency(i.e. SAS HBA)

Software Latency

Flash SCM*HDDKEYVMworld 2018 Content: Not for publication or distribution

14

Late

ncy

Slide credit: Intel and NVM ExpressSource: Storage Technologies Group, Intel. Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.

HDD + SAS

E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T – 2 0 1 2

SERVER

FIBER CHANNEL

HOST

STORAGE NETWORK

VMAX3 / VMAX

All FlashV-Brick

Back End

Disk Shelf

SASNAND + SAS


Software Latency


15

Late

ncy


HDD + SAS

E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T - 2 0 1 8

SERVER

FIBER CHANNEL

HOST

STORAGE NETWORK

POWERMAX

P-Brick

Back End

Disk Shelf

NVMeNAND + SAS


Software Latency

NAND+ NVMe BE


16

Late

ncy


HDD + SAS

E N T E R P R I S E S T O R A G E S T A T E O F T H E A R T – 2 0 1 9 +

SERVER

NVMeoF

HOST

STORAGE NETWORK

POWERMAX/SCM

P-Brick

Back End

Disk Shelf

NVMeNAND + SAS


Software Latency

NAND+ NVMe BE

SCM+ NVMeEnd to end


17

R A N D O M R E A D S : P O W E R M A X 8 0 0 0 V S . V M A X 9 5 0 Fm

s R

espo

nse

Tim

e

IOs/sec

VMAX 950F

PowerMax 8000

50%More RRH IOPs!

8KRandom Read Hit

ONEEngine 950F

ONEBrick PowerMax 8000


18

D S S W O R K L O A D : P O W E R M A X 8 0 0 0 V S . V M A X 9 5 0 Fm

s R

espo

nse

Tim

e

IOs/sec

VMAX 950F

PowerMax 8000

25%More Throughput

ONEEngine 950F

ONEBrick PowerMax 8000

128KDSS


19

NVMe VMware benefits

19

v S A NNVMe controllers

available

V I R T U A L V O L U M E S

H I G H E R V M D E N S I T YConsolidation

V I R T U A L I Z E D D A T A B A S E S

B A C K U P & R E C O V E R Y


20

• Highly virtualized environments requiring high IOPS and low latency

• Large Oracle / SAP deployments• Real time data processing and analytics

– Factory control / SCADA systems– Data warehousing– High end trading applications– Oil and Gas

• Large scale web services• Less applicable

– Cache friendly workloads (higher % of read hit / write hit)– Workloads which don’t tax backend storage such as

Microsoft Exchange

Where NVMe makes sense

20

Real-time analytics

Big Data

Machine Learning


21

A D V A N C E S I N D A T A P R O T E C T I O N T O M A K E Y O U R L I F E E A S I E R

NVMe and converged


22

C H A L L E N G E S R E Q U I R E M E N T S

Cloud extensibilityIncrease in data volumes, users, apps

Do more with less

Simplicity for quick time-to-value

Low cost-to-protect

Efficient cloud enablement

High performance

State of data protection today


23

Higher performanceN V M E T M A N D D A T A P R O T E C T I O N

23

Instant Access and Restore of Virtual Machines

Fasterwith NVMeTM

flash

Use of backup storage appliance

for test dev

VM VM VM VM VM VM VM VM


Spinoff VMs directly in backup storage

Backup Storage with NVMe Flash


24

CloudDR + LTR

Search & analytics2

Backup servers & storage

NVMeflash

System management

Backup software

Days Hours

2U and 10x1 faster to deploy

Easy to deploy & upgrade

Simplicity in a Converged SolutionI N T E G R A T E D D A T A P R O T E C T I O N A P P L I A N C E D P 4 4 0 0

Highest density 2U

24TB–96TB +192TB withwithout additional HW

24

Simpler to deploy

Easier to manage

Lower total cost to protect


25

Up to

2Xfaster backups1

Boosted application-direct

protection

NVMe flash for instant access

& restore

Powered by 14G PowerEdge Server

Power is Performance & Efficiency I N T E G R A T E D D A T A P R O T E C T I O N A P P L I A N C E D P 4 4 0 0

ESG Lab Review Additional information

Source-side deduplication

Up to

98%less bandwidth required2

7Xmore backup streams1

55:1Avg dedup3

25


https://www.emc.com/collateral/analyst-reports/esg-lab-review-efficiently-protect-virtual-environments-idpa-from-dell-emc.pdf

https://www.emc.com/collateral/analyst-reports/esg-lab-review-efficiently-protect-virtual-environments-idpa-from-dell-emc.pdf

26

I N T R O D U C I N G

@ Lowest cost-to-protect.1

Guaranteed.2

26

Ideal for mid-size organizations and remote/back office environments1Dell EMC internal analysis using publically available competitive pricing, May 2018. Lowest cost-to-protect is based on $ per logical GB. Actual cost will vary.23 year satisfaction guarantee, hardware investment protection, clear price framework and up to 55:1 data protection deduplication guarantee under the Dell EMC Future Loyalty Program

Integrated Data Protection Appliance DP4400 Simply Powerful.


27

A D V A N C E S I N D A T A P R O T E C T I O N T O M A K E Y O U R L I F E E A S I E R

What about Cloud


28

DatabasesApplications Files

Public/Private/Hybrid/

DPaaS

LTR to Cloud DR to Cloud Protect in CloudBackup to Cloud

Policy

EVOLUTION OF DATA PROTECTION TO THE CLOUD

Data Protection to Cloud

Clients

VMs

S3/https Clients

VMs

S3/httpsS3/https

Current StateC O M P L E X I T Y

Multiple data siloesMultiple solutions/management consolesMultiple vendors/support organizations


29

DatabasesApplications Files

Public/Private/Hybrid/

DPaaS

Policy

Ideal StateS I M P L I C I T Y

Single solution that can span data protection from on-premises, direct to cloud, and workloads in the cloudIntegrated and optimized for in-cloud data protectionOne vendor and support organization

Transformed Data Protection

Clients

VMs

S3/https Clients

VMs

S3/httpsS3/https

LTR to Cloud DR to Cloud Protect in CloudBackup to Cloud

SINGLE MANAGEMENT INTERFACE


30

Long-term retention

Transform through the Cloud D E L L E M C D A T A P R O T E C T I O N

U P T O 192 TB w i t h C l o u d T i e r

VMware Cloud on AWSBackup/Long Term Retention Disaster Recovery In Cloud Workloads

EC2S3 Objects

+ +

Support for all phases of your journey to the cloud


31

• DD

VMware Cloud on AWS

vSphere integrated

Amazon S3 cost optimized

- plus -

Up to 96 TB withDD VE

Deduplication

Solution• Enterprise-grade data protection

for hybrid cloud workloads

• Increased resiliency for VMware workloads running on AWS cloud

Benefits• Integration with on-premises data protection

simplifies administration

• Best-in-class deduplication lowers cloud consumption costs

• Deep management tool integration automates operations

• Dell EMC Data Protection Bundle (DP Software + DD VE) makes it easy to add on to your VMware Cloud subscription

1 s tData protection solution for VMware Cloud on AWS


VMware Cloud on AWSD E L L E M C D A T A P R O T E C T I O N


32

EC2 on demandS3 Objects

+VM

+

AWS as DR SiteOn-Premises Production

Application consistent recovery to the cloudC L O U D D I S A S T E R R E C O V E R Y

Simple to operate • Existing on-prem UI

• Direct in-cloud access

Advanced Capabilities• Eliminate DR Data center costs

• Application recovery to the cloud

• Deduplication to the cloud

• Up to 96 TB

Orchestrated DR • Test and failover to AWS

• Failback on-premises

• Recovery in minutes

• Multiple VMs DR PlansVMworld 2018 Content: Not for publication or distribution

33

Simple to operate • Existing on-prem UI

• Direct in-cloud access

• Recover to VMware Cloud on AWS

Efficient with End-to-End Orchestration

Minimal cloud cost & footprint• Protect directly to S3

• Eliminate DR data center costs

• Deduplication to the cloud

• Up to 96 TB

Orchestrated DR • Recover to VMware Cloud on

AWS

• Recovery in minutes

• Multiple VMs DR Plans

VM

+

EC2 on demandS3 Objects

VMC on demand

VMware Cloud on AWS as DR SiteProtect to S3, Recover to VMware Cloud on AWS

On-Premises Production

Extend your DR to VMware Cloud on AWSN E W – C L O U D D R T O V M W A R E C L O U D O N A W S


34

On Premises• Optimized for virtual environments

• Provides application consistent backup

• Reduces backup time and network load

• Variable-length deduplication

• Daily full backups and one-step image recovery

In Cloud• Reduce backup storage 10 to 30x

• Reduce network traffic by up to 98%

• Reduce backup times by up to 50%

• Incremental forever backups

• Instant access for VM recovery

Software and Data Domain Efficient, reliable and low cost backup

D E L L E M C D A T A P R O T E C T I O N

+ +


35

In Cloud Data ProtectionG R O W T H O F D A T A P R O T E C T I O N A S A S E R V I C E ( D P A A S )

27%CAGR growth rate*

Backup & recovery 58%

Disaster/site recovery 44%

24 x 7 support 44%

Mobile services40%

Archiving 40%

The market isAC C E L E R AT I N G

24%2018 year-over-year growth rate est*

*Technavio market research global backup as a service 2018-2022Source: IDC’s Cloud and AI Adoption Survey, January 2018, N=400, Percent of Sample

Top managed services


36

R e f r e s h e d

vCloud Director Data Protection Extension

Seamless Integration• End-users can manage Data Protection for

their virtual datacenters directly from the vCD Tenant Portal, without the need to login to a separate interface

Cost effective• Industry leading deduplication minimizes

backup storage costs for service providers Performance and scale• A scale-out architecture provides unparalleled

levels of service performance

Simple, self-service data protection through an integrated tenant portal UI


37

vCloud Director Organization

vCloud Director Data Protection extensionM U L T I - T E N A N T / M U L T I - T I E R D A T A P R O T E C T I O N S E R V I C E

CLOUD ADMINDefine policy templates, publish to tenant catalogsConfigure granular quotas on protected capacity

Tenant repository assignmentConfigure backup replication

TENANT ADMINApply Policies from catalog to vApps / VMs

In-place restore of vApps or VMsRe-directed restore of vApps or VMs

Self-service file-level recoveryMonitor Backups

vDC-Iowa

vDC-Ohio

AceIndustry

vApp 2Exchange

vApp N

VM 3

VM N

VM 1Client Access Svr

VM 2DB Available Group Svr

Virtual Data Center Services

VirtualData Center

VirtualData Center


38

Seamlessly integrated tenant portal UI

Data Protection Service tab for embedded Data Protection(extension of vCD Client UI)


39

Seamlessly integrated tenant portal UI

vApp Restore Workflows• Restore to new• Restore to original

VM Restore Workflows• Restore to new• Restore to original• File-level restore


40

Power is Built For VMwareD E L L E M C D A T A P R O T E C T I O N

Comprehensive Data Protection Integration with

vSphereWeb Client

vSpherevCenter

vRealizeLog Insight

vRealizeAutomation

vCloudDirector

vRealizeOperations Manager

Protect more VMs Simple, cost effective to scale to more VMs Faster backups and recoveries

VMware Cloud on AWS


PLEASE FILL OUTYOUR SURVEY.Take a survey and enter a drawingfor a VMware company store gift card.

#vmworld #HYP3705BUS


THANK YOU!

#vmworld #HYP3705BUS


Improving App Performance and Protection for …...#vmworld Improving App Performance and Protection...

Documents

Transcript of Improving App Performance and Protection for …...#vmworld Improving App Performance and Protection...