Hyperconverged infrastructure : architecture of the...

37
© 2014 VMware Inc. All rights reserved. Stefan Verbist VMware Territory SE [email protected] IT Challenges - DC Track Hyperconverged infrastructure : architecture of the datacenter for the future

Transcript of Hyperconverged infrastructure : architecture of the...

© 2014 VMware Inc. All rights reserved.

Stefan Verbist – VMware Territory SE [email protected]

IT Challenges - DC Track Hyperconverged infrastructure : architecture of the datacenter for the future

The Convergence era

SAN

NAS

Compute

TOR Switch

Compute / Storage Combined

We finally found the Killer app ...

3

But what if we add appliance capabilties and

Policy-Based Management ...

Introducing VSAN VMware Scale-Out Storage – Radically Simple

vSphere

VSAN

Hard disks Hard disks SSD SSD Hard disks

SSD

VSAN Aggregated Datastore

Hard disks SSD

Hard disks SSD

vSphere

VSAN

VSAN Aggregated Datastore

vSphere

VSAN

VSAN Aggregated Datastore

vSphere

VSAN

VMware Virtual SAN Hypervisor-Converged Storage Platform

vSphere + Virtual SAN

• Software-defined storage software solution.

• Design to aggregates locally attached storage from each ESXi host in a cluster.

• Hybrid disk storage solution

– Magnetic disks (HDD)

– Flash based disks (SSD)

• VM-Centric data operations and policy driven management principles.

• Resilient design based on a Distributed RAID architecture

– No single points of failures

• Dynamic capacity and performance scalability

6

Two clicks to deploy!

Virtual SAN Simplifies Storage If You Know vSphere, You Know Virtual SAN

Virtual SAN Simplifies And Automates Storage Management

7

Per VM Storage Service Levels From a Single Self-tuning Datastore

Storage Policy-Based

Management

Virtual SAN

Shared

Datastore

vSphere + Virtual SAN

SLAs

Software Automates Control of Service

Levels

No more LUNs/Volumes!

Policies Set Based on Application

Needs

Capacity

Performance

Availability

Per VM Storage Policies

VM Storage Objects

A VM deployed on VSAN may have 4 different types of Storage Object

• Of course, there could be multiple VMDKs and snapshot deltas

VM Home

Namespace

VM

Swap VMDK Snapshot

Delta

Understanding Virtual SAN Objects & Components

ESXi Cluster

Components

w

Components

w

Components Components

O b j e c t s

Storage Policy

A

RAID 0

RAID 1

Reserve 20%

Cache 5%

Override No

Disk Group Disk Group Disk Group Disk Group

w w

Namespace V M D K Snapshot Swap file

Virtual SAN Datastore

Policy

A Policy

B Policy

C Policy

A

Virtual SAN Network

Why Virtual SAN?

10

• Two click Install

• Single pane of glass

• Policy-driven

• Self-tuning

• Integrated with VMware

stack

Radically Simple

• Embedded in vSphere

kernel

• Flash-accelerated

• Up to 2M IOPs from 32

nodes

• Granular and linear

scaling

High Performance Lower TCO

• Server-side economics

• No large upfront

investments

• Grow-as-you-go

• Easy to operate with

powerful automation

• No specialized skillset

De

vic

e M

gm

t.

De

vic

e M

gm

t.

De

vic

e M

gm

t.

Legacy Operational Model Creates Several Challenges

SAN NAS All-

flash

vSphere

Storage Consumer

Challenges:

• Lengthy provisioning

cycles

• Difficult to make

adjustments

• Lack of granular control

• Complex troubleshooting

• Frequent data migrations

Storage Provider

Challenges:

• Fragmented device

management

• Rigid capacity and data

services allocation

• Complex LUN/Volume

management

Snapshot

Encryption

Replication

11

The Hypervisor Opens Up New Opportunities

vSphere

The Virtualization

Platform:

• Knows the needs

of all apps in real

time

• Sits directly in the

I/O path

• Global view of

underlying

infrastructure

• Hardware agnostic

Cloud

Storage

SAN /

NAS

x86

Servers

12

Storage Policy-Based Management Simplifies Provisioning And Delivers Agility

Storage Policy-Based Management

• Application-centric

• Common management across heterogeneous devices

• Policy-based dynamic composition of services

• Granular control of data services to individual VMs

SDS

Raid

provisioning

No

overprovisioning

of resources

Efficiency through

automation

Simple change

management

Today

• Hardware centric

• Vendor specific management

• Static pre-allocation of shared storage container (LUN)

• Data services aligned to storage container

✖ Long provisioning cycles

✖ Overprovisioning of resources

Today

✖ Management complexity

✖ Frequent data migrations

Hardware Requirements

15

Any Server on VMware Compatibility Guide

Minimum 3 ESXi 5.5 Hosts, Maximum Hosts “I’ll tell you later……”

1Gb/10Gb NIC

SAS/SATA Controllers (RAID Controllers

must work in “pass-through” or RAID0”

mode

SAS/SATA/PCIe/NV

Me SSD

SAS/NL-SAS/SATA

HDD

At least 1

of each

4GB to 8GB USB, SD Cards, SATADOM

VMware Compatibility Guide – Primary Source

16

VMware SDDC Approach

End-User

Computing

Desktop Mobile

Virtual Workspace

Compute

Physical

Hardware

Policy-Based

Management &

Automation Cloud Automation Cloud Operations Cloud Business

Software-Defined Data Center

Private

Clouds

Public

Clouds

Hybrid Cloud VMware &

vCloud® Data Center

Partners

Virtualized Infrastructure Abstract & Pool

Compute

Abstraction =

Server

Virtualization

Network

Network

Abstraction =

Virtual

Networking

Storage

Storage

Abstraction =

Software-Defined

Storage

Applications Modern SaaS Traditional

The Software-Defined Data Center

Transform storage by aligning it with app demands

Management tools give way to automation

Expand virtual compute to all

applications

Virtualize the network for speed and efficiency

18

The Software-Defined Data Center

Transform storage by aligning it with app demands

19

Inside the Software-Defined Data Center

• Architectural Foundation for IT as a Service

– All infrastructure virtualized

– Delivered as a service

– Automated through software

• SDDC Implies a Fully Automated and Software Driven Operations Paradigm

• This Doesn’t Imply Scripting, It Implies Policy and Orchestration

– Scripting is too brittle

– Policy Allows for Abstraction

• SDDC Benefits Services Oriented Architectures

• This is A PATH for Implementing Clouds, Not the ONLY PATH

vSphere

Enabling Self-service Consumption

21

Storage Policy Based Mgmt. Storage Policy Based Mgmt. Storage Policy Based Mgmt.

Virtual Volumes

Cloud Storage

vCloud Air

HDD SSD

Virtual SAN Shared

Datastore

HD

D SSD HDD SSD

Virtual SAN

Virtual Datastore

SAN /

NAS

SAN /

NAS

Cloud And Management Automation vCloud

Automation

Center

OpenStack

Virtualization

Dramatically Lowers Costs

Reduces Complexity

Improves High Availability

The Next Wave

On-board the Cloud to provide agility

IT E

ffic

ien

cy

Time

Cloud Automation

Accelerates Infrastructure and

Application Service Delivery Times

Optimizes Resource Utilization to

Contain Costs

Cloud

Automation

Automate the delivery of

infrastructure,

applications and

desktops as a service

across multiple clouds

and platforms

Cloud

Operations

Manage the health, risk,

efficiency and

compliance of your

infrastructure and

applications across

structured and

unstructured data

Cloud

Business

Improve Business/IT

alignment and accelerate

IT transformation by

delivering complete

transparency into the

costs and quality of all

IT services

Cloud Management – Key Solution Areas

Simple, automated

management for

heterogeneous and

hybrid clouds

23

Any Infrastructure, Any Service, Across the Lifecycle…

Any Service

Infrastructure

Software-Defined Datacenter Services

VDC Virtual datacenter

custom services

Applications

Clou

d

Virtual

Physical

24

Te

na

nt

Tw

o

Te

na

nt

On

e

De

fau

lt T

en

an

t Tenancy in vCloud Automation Center 6.0 – Global Enterprise Customer

26

Fabric

Bu

sin

es

s G

rou

p

vCenter

Endpoint

Reservation Reservation

Endpoint

Reservation Reservation

Endpoint

Reservation Reservation

Hyper-V Any Cloud Physical

Bu

sin

es

s G

rou

p

Bu

sin

es

s G

rou

p

Bu

sin

es

s G

rou

p

Bu

sin

es

s G

rou

p

De

fau

lt T

en

an

t

Bu

sin

es

s G

rou

p

Bu

sin

es

s G

rou

p

Te

na

nt

On

e

Ad

min

Defa

ult

Te

na

nt

Iaa

S A

dm

in

Fa

bri

c A

dm

in

Each tenant can be brand have

multiple directory services

Dev/Test

vCloud Automation Center Shared Infrastructure

The VMware Personalized, Business-relevant Cloud

Provision Manage Retire Request

Desktop

Request Provision Manage Retire Archive

Production

Request Approval Provision Manage Retire Archive

Cloud

Administrator

Service Blueprints

SLA

Cost Profile

Service Tier

Security

Policies

Templates Private

Virtual

Private

Physical Public

Cloud

Fine-grained policies personalize services

to meet unique IT and business needs

Why Is Policy Critical?

• Because This Aligns To The Way Humans Interact

– As a consumer, I describe the service I want (I want a hamburger)

– As a provider, I describe the services I offer (I sell “Big Mac / Giant”)

– A marketplace brings buyers and sellers together (Restaurants)

• This model has evolved over thousands of years. It works.

• For SDDC, the Policy Framework is the marketplace that brings together providers and consumers

– This serves to isolate layers, management frameworks can be implementation agnostic

– This reduces fragility and hides infrastructure changes from automation platforms

– Application owners can define a class of service they want without knowing how to make the hamburger

• This is not well understood today, partly because we have overloaded the “Policy” term

28

What Does SDS Use Policy For?

• Placement

– Put this VMDK on a Datastore that supports encryption

– Find a VVOL provider who supports replication

• Turn Features On or Off

– Enable (or disable) specific features

– Turn replication ON, Turn Dedupe ON, Schedule Snapshots

• Monitoring

– Checking to compare running state with desired state

– I asked for “gold” service. Did I get that? How many VMDK’s asked for Gold?

• Remediation

– Fixing SLA violations based on policy

– VM x is running slow, move it to a compliant datastore

– Datastore y is running in a degraded state, evacuate it

Storage Policy Based Management (SPBM)

30

SPBM

VASA

Hard disks SSD

VSAN Virtual

volumes

vSphere API

vCAC OpenSt

ack

Script

(PS)

• Common Policy framework Across Virtual

Volumes, Virtual SAN and Legacy Storage

• Common API Layer for Cloud Management

Frameworks (vCAC, OpenStack), Scripting

users (PowerShell, JavaScript, Python, etc.)

and Orchestration Platforms (vCO)

• Represents Application and VM Level

Requirements

• Consumes Capabilities Published via VASA

Solution Overview

• Stable, Robust Automation Platform

• Shields Automation and Orchestration

Platforms from infrastructure changes by

abstracting the Underlying Storage

Implementation

Customer Value

2H2014 / 1H2015

A Practical Example: SPBM

31

vSphere

vSphere

API SPBM VASA

VASA

Block

VASA

VVOL

VASA

VSAN

VASA

File

New VM

Blueprint

Call vAPI

via vCO

Consume

Storage

Profile

Set Config

via VASA

Receive

Provisioning Create

Virtual

Disk

#1: Create

Windows VM

with “BizCrit”

Storage

#2: Add Cinder

Volume type “Dev

Gold” Cinder

Volume

Create

Call vAPI

via Cinder

Driver

Consume

Storage

Profile

Set Config

via VASA

Receive

Provisioning

Create

Virtual Disk

Set-SpbmStoragePolicy

“Geo-Replicated”

#3: Use PS to

Change Storage

Class of Service

Call vAPI via

PowerCLI

Consume

Storage

Policy

VASA Re-

Configure

Receive Re-

Configure

Activate

Replication

The “Hyperconvergence” is strong with this one ...

32

MARVIN (Modular Automated Rackable Virtual Infrastructure Node)

VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage

Policy-driven Control Plane

Virtual Data Plane

Virtual Datastores

Performance Mobility Data Protection

Virtual Data Services

Cloud Object

Storage

SAN /

NAS

x86 Servers

33

Introducing VMware EVO: Hyper-Converged Infrastructure

• Enabled by VMware Virtual SAN, the EVO product line offers:

– A single SKU for ease of procurement (e.g. design and price predictability)

– Simple, streamlined deployment and ongoing SDDC lifecycle management

– Single vendor, single support call

– Broad ecosystem of partners for broad distribution

34

Simplify How You Buy, Setup and Run Your Software-Defined Data Center

• Prescribed 2U/4N platform from qualified partners

• Automated scale out up to 4 HCIAs

– General Purpose Server workloads ~100 VMs per HCIA

– VDI ~250 VMs per HCIA

• Time to value to first VM in minutes

• Non disruptive patch & upgrade

• Primary use cases

35

Key Features

Hyper-Converged Infrastructure Appliance (HCIA)

x1

x2

x3

x4

TOR Switch

ROBO Virtual Private

Cloud VDI

General

Purpose

VMware EVO:RAIL Offers Unique Customer Value

36

• Built on core vSphere that

you already know and

use

• Built with Virtual SAN

• Highly resilient by design

• Compatible with existing

VMware infrastructure

products and ecosystem

100% Powered By

VMware

Choice of

Qualified EVO:RAIL

Partner

• Broad and expanding

partner ecosystem

• Support from your

Preferred EVO:RAIL

Partner

• Single SKU purchase for

hardware, software, and

support

• Time to Value to first VM

in minutes

• Simple configuration and

management

• Automated scale out

• Non-disruptive patching

and upgrade

Transformational

User Experience

Demo: Come and Discover yourself @ Hands On Lab

• URL: http://labs.hol.vmware.com/HOL/catalogs/

– HOL-SDC-1408 - VMware Virtual SAN 101

– HOL-SDC-1427 - VMware Software Defined Storage

– HOL-SDC-1429 - Virtual Volumes Tech Preview

38

Truly wonderful, this

Hyperconvergence is

Any questions ?