Hyperconverged infrastructure : architecture of the...
Transcript of Hyperconverged infrastructure : architecture of the...
© 2014 VMware Inc. All rights reserved.
Stefan Verbist – VMware Territory SE [email protected]
IT Challenges - DC Track Hyperconverged infrastructure : architecture of the datacenter for the future
We finally found the Killer app ...
3
But what if we add appliance capabilties and
Policy-Based Management ...
Introducing VSAN VMware Scale-Out Storage – Radically Simple
vSphere
VSAN
Hard disks Hard disks SSD SSD Hard disks
SSD
VSAN Aggregated Datastore
Hard disks SSD
Hard disks SSD
vSphere
VSAN
VSAN Aggregated Datastore
vSphere
VSAN
VSAN Aggregated Datastore
vSphere
VSAN
VMware Virtual SAN Hypervisor-Converged Storage Platform
vSphere + Virtual SAN
…
• Software-defined storage software solution.
• Design to aggregates locally attached storage from each ESXi host in a cluster.
• Hybrid disk storage solution
– Magnetic disks (HDD)
– Flash based disks (SSD)
• VM-Centric data operations and policy driven management principles.
• Resilient design based on a Distributed RAID architecture
– No single points of failures
• Dynamic capacity and performance scalability
Virtual SAN Simplifies And Automates Storage Management
7
Per VM Storage Service Levels From a Single Self-tuning Datastore
Storage Policy-Based
Management
Virtual SAN
Shared
Datastore
vSphere + Virtual SAN
SLAs
Software Automates Control of Service
Levels
No more LUNs/Volumes!
Policies Set Based on Application
Needs
Capacity
Performance
Availability
Per VM Storage Policies
VM Storage Objects
A VM deployed on VSAN may have 4 different types of Storage Object
• Of course, there could be multiple VMDKs and snapshot deltas
VM Home
Namespace
VM
Swap VMDK Snapshot
Delta
Understanding Virtual SAN Objects & Components
ESXi Cluster
Components
w
Components
w
Components Components
O b j e c t s
Storage Policy
A
RAID 0
RAID 1
Reserve 20%
Cache 5%
Override No
Disk Group Disk Group Disk Group Disk Group
w w
Namespace V M D K Snapshot Swap file
Virtual SAN Datastore
Policy
A Policy
B Policy
C Policy
A
Virtual SAN Network
Why Virtual SAN?
10
• Two click Install
• Single pane of glass
• Policy-driven
• Self-tuning
• Integrated with VMware
stack
Radically Simple
• Embedded in vSphere
kernel
• Flash-accelerated
• Up to 2M IOPs from 32
nodes
• Granular and linear
scaling
High Performance Lower TCO
• Server-side economics
• No large upfront
investments
• Grow-as-you-go
• Easy to operate with
powerful automation
• No specialized skillset
De
vic
e M
gm
t.
De
vic
e M
gm
t.
De
vic
e M
gm
t.
Legacy Operational Model Creates Several Challenges
SAN NAS All-
flash
vSphere
Storage Consumer
Challenges:
• Lengthy provisioning
cycles
• Difficult to make
adjustments
• Lack of granular control
• Complex troubleshooting
• Frequent data migrations
Storage Provider
Challenges:
• Fragmented device
management
• Rigid capacity and data
services allocation
• Complex LUN/Volume
management
Snapshot
Encryption
Replication
11
The Hypervisor Opens Up New Opportunities
vSphere
The Virtualization
Platform:
• Knows the needs
of all apps in real
time
• Sits directly in the
I/O path
• Global view of
underlying
infrastructure
• Hardware agnostic
Cloud
Storage
SAN /
NAS
x86
Servers
12
Storage Policy-Based Management Simplifies Provisioning And Delivers Agility
Storage Policy-Based Management
• Application-centric
• Common management across heterogeneous devices
• Policy-based dynamic composition of services
• Granular control of data services to individual VMs
SDS
Raid
provisioning
No
overprovisioning
of resources
Efficiency through
automation
Simple change
management
Today
• Hardware centric
• Vendor specific management
• Static pre-allocation of shared storage container (LUN)
• Data services aligned to storage container
✖ Long provisioning cycles
✖ Overprovisioning of resources
Today
✖ Management complexity
✖ Frequent data migrations
Hardware Requirements
15
Any Server on VMware Compatibility Guide
Minimum 3 ESXi 5.5 Hosts, Maximum Hosts “I’ll tell you later……”
1Gb/10Gb NIC
SAS/SATA Controllers (RAID Controllers
must work in “pass-through” or RAID0”
mode
SAS/SATA/PCIe/NV
Me SSD
SAS/NL-SAS/SATA
HDD
At least 1
of each
4GB to 8GB USB, SD Cards, SATADOM
VMware SDDC Approach
End-User
Computing
Desktop Mobile
Virtual Workspace
Compute
Physical
Hardware
Policy-Based
Management &
Automation Cloud Automation Cloud Operations Cloud Business
Software-Defined Data Center
Private
Clouds
Public
Clouds
Hybrid Cloud VMware &
vCloud® Data Center
Partners
Virtualized Infrastructure Abstract & Pool
Compute
Abstraction =
Server
Virtualization
Network
Network
Abstraction =
Virtual
Networking
Storage
Storage
Abstraction =
Software-Defined
Storage
Applications Modern SaaS Traditional
The Software-Defined Data Center
Transform storage by aligning it with app demands
Management tools give way to automation
Expand virtual compute to all
applications
Virtualize the network for speed and efficiency
18
Inside the Software-Defined Data Center
• Architectural Foundation for IT as a Service
– All infrastructure virtualized
– Delivered as a service
– Automated through software
• SDDC Implies a Fully Automated and Software Driven Operations Paradigm
• This Doesn’t Imply Scripting, It Implies Policy and Orchestration
– Scripting is too brittle
– Policy Allows for Abstraction
• SDDC Benefits Services Oriented Architectures
• This is A PATH for Implementing Clouds, Not the ONLY PATH
vSphere
Enabling Self-service Consumption
21
Storage Policy Based Mgmt. Storage Policy Based Mgmt. Storage Policy Based Mgmt.
Virtual Volumes
Cloud Storage
vCloud Air
…
HDD SSD
Virtual SAN Shared
Datastore
…
HD
D SSD HDD SSD
Virtual SAN
Virtual Datastore
SAN /
NAS
SAN /
NAS
Cloud And Management Automation vCloud
Automation
Center
OpenStack
Virtualization
Dramatically Lowers Costs
Reduces Complexity
Improves High Availability
The Next Wave
On-board the Cloud to provide agility
IT E
ffic
ien
cy
Time
Cloud Automation
Accelerates Infrastructure and
Application Service Delivery Times
Optimizes Resource Utilization to
Contain Costs
Cloud
Automation
Automate the delivery of
infrastructure,
applications and
desktops as a service
across multiple clouds
and platforms
Cloud
Operations
Manage the health, risk,
efficiency and
compliance of your
infrastructure and
applications across
structured and
unstructured data
Cloud
Business
Improve Business/IT
alignment and accelerate
IT transformation by
delivering complete
transparency into the
costs and quality of all
IT services
Cloud Management – Key Solution Areas
Simple, automated
management for
heterogeneous and
hybrid clouds
23
Any Infrastructure, Any Service, Across the Lifecycle…
Any Service
Infrastructure
Software-Defined Datacenter Services
VDC Virtual datacenter
custom services
Applications
Clou
d
Virtual
Physical
24
Te
na
nt
Tw
o
Te
na
nt
On
e
De
fau
lt T
en
an
t Tenancy in vCloud Automation Center 6.0 – Global Enterprise Customer
26
Fabric
Bu
sin
es
s G
rou
p
vCenter
Endpoint
Reservation Reservation
Endpoint
Reservation Reservation
Endpoint
Reservation Reservation
Hyper-V Any Cloud Physical
Bu
sin
es
s G
rou
p
Bu
sin
es
s G
rou
p
Bu
sin
es
s G
rou
p
Bu
sin
es
s G
rou
p
De
fau
lt T
en
an
t
Bu
sin
es
s G
rou
p
Bu
sin
es
s G
rou
p
Te
na
nt
On
e
Ad
min
Defa
ult
Te
na
nt
Iaa
S A
dm
in
Fa
bri
c A
dm
in
Each tenant can be brand have
multiple directory services
Dev/Test
vCloud Automation Center Shared Infrastructure
The VMware Personalized, Business-relevant Cloud
Provision Manage Retire Request
Desktop
Request Provision Manage Retire Archive
Production
Request Approval Provision Manage Retire Archive
Cloud
Administrator
Service Blueprints
SLA
Cost Profile
Service Tier
Security
Policies
Templates Private
Virtual
Private
Physical Public
Cloud
Fine-grained policies personalize services
to meet unique IT and business needs
Why Is Policy Critical?
• Because This Aligns To The Way Humans Interact
– As a consumer, I describe the service I want (I want a hamburger)
– As a provider, I describe the services I offer (I sell “Big Mac / Giant”)
– A marketplace brings buyers and sellers together (Restaurants)
• This model has evolved over thousands of years. It works.
• For SDDC, the Policy Framework is the marketplace that brings together providers and consumers
– This serves to isolate layers, management frameworks can be implementation agnostic
– This reduces fragility and hides infrastructure changes from automation platforms
– Application owners can define a class of service they want without knowing how to make the hamburger
• This is not well understood today, partly because we have overloaded the “Policy” term
28
What Does SDS Use Policy For?
• Placement
– Put this VMDK on a Datastore that supports encryption
– Find a VVOL provider who supports replication
• Turn Features On or Off
– Enable (or disable) specific features
– Turn replication ON, Turn Dedupe ON, Schedule Snapshots
• Monitoring
– Checking to compare running state with desired state
– I asked for “gold” service. Did I get that? How many VMDK’s asked for Gold?
• Remediation
– Fixing SLA violations based on policy
– VM x is running slow, move it to a compliant datastore
– Datastore y is running in a degraded state, evacuate it
Storage Policy Based Management (SPBM)
30
SPBM
VASA
Hard disks SSD
VSAN Virtual
volumes
vSphere API
vCAC OpenSt
ack
Script
(PS)
• Common Policy framework Across Virtual
Volumes, Virtual SAN and Legacy Storage
• Common API Layer for Cloud Management
Frameworks (vCAC, OpenStack), Scripting
users (PowerShell, JavaScript, Python, etc.)
and Orchestration Platforms (vCO)
• Represents Application and VM Level
Requirements
• Consumes Capabilities Published via VASA
Solution Overview
• Stable, Robust Automation Platform
• Shields Automation and Orchestration
Platforms from infrastructure changes by
abstracting the Underlying Storage
Implementation
Customer Value
2H2014 / 1H2015
A Practical Example: SPBM
31
vSphere
vSphere
API SPBM VASA
VASA
Block
VASA
VVOL
VASA
VSAN
VASA
File
New VM
Blueprint
Call vAPI
via vCO
Consume
Storage
Profile
Set Config
via VASA
Receive
Provisioning Create
Virtual
Disk
#1: Create
Windows VM
with “BizCrit”
Storage
#2: Add Cinder
Volume type “Dev
Gold” Cinder
Volume
Create
Call vAPI
via Cinder
Driver
Consume
Storage
Profile
Set Config
via VASA
Receive
Provisioning
Create
Virtual Disk
Set-SpbmStoragePolicy
“Geo-Replicated”
#3: Use PS to
Change Storage
Class of Service
Call vAPI via
PowerCLI
Consume
Storage
Policy
VASA Re-
Configure
Receive Re-
Configure
Activate
Replication
The “Hyperconvergence” is strong with this one ...
32
MARVIN (Modular Automated Rackable Virtual Infrastructure Node)
VMware Software-Defined Storage Bringing the Efficient Operational Model of Virtualization to Storage
Policy-driven Control Plane
Virtual Data Plane
Virtual Datastores
Performance Mobility Data Protection
Virtual Data Services
Cloud Object
Storage
SAN /
NAS
x86 Servers
33
Introducing VMware EVO: Hyper-Converged Infrastructure
• Enabled by VMware Virtual SAN, the EVO product line offers:
– A single SKU for ease of procurement (e.g. design and price predictability)
– Simple, streamlined deployment and ongoing SDDC lifecycle management
– Single vendor, single support call
– Broad ecosystem of partners for broad distribution
34
Simplify How You Buy, Setup and Run Your Software-Defined Data Center
• Prescribed 2U/4N platform from qualified partners
• Automated scale out up to 4 HCIAs
– General Purpose Server workloads ~100 VMs per HCIA
– VDI ~250 VMs per HCIA
• Time to value to first VM in minutes
• Non disruptive patch & upgrade
• Primary use cases
35
Key Features
Hyper-Converged Infrastructure Appliance (HCIA)
x1
x2
x3
x4
TOR Switch
ROBO Virtual Private
Cloud VDI
General
Purpose
VMware EVO:RAIL Offers Unique Customer Value
36
• Built on core vSphere that
you already know and
use
• Built with Virtual SAN
• Highly resilient by design
• Compatible with existing
VMware infrastructure
products and ecosystem
100% Powered By
VMware
Choice of
Qualified EVO:RAIL
Partner
• Broad and expanding
partner ecosystem
• Support from your
Preferred EVO:RAIL
Partner
• Single SKU purchase for
hardware, software, and
support
• Time to Value to first VM
in minutes
• Simple configuration and
management
• Automated scale out
• Non-disruptive patching
and upgrade
Transformational
User Experience
Demo: Come and Discover yourself @ Hands On Lab
• URL: http://labs.hol.vmware.com/HOL/catalogs/
– HOL-SDC-1408 - VMware Virtual SAN 101
– HOL-SDC-1427 - VMware Software Defined Storage
– HOL-SDC-1429 - Virtual Volumes Tech Preview