Vx Rack : L'hyperconvergence avec l'experience VCE

© Copyright 2015 EMC Corporation. All rights reserved © Copyright 2015 EMC Corporation. All rights reserved

JEUDI 19 NOVEMBRE 2015 Jean-Baptiste ROBERJOT - VCE - Software Defined Specialist

VxRACK : L’HYPER-CONVERGENCE AVEC L’EXPERIENCE VCE


Who is VCE Today?

Fastest to $1B

>50% Y/Y Growth 2014 FY

#1 Market Share &

Gartner MQ position

$2.5B+ Annualized Run-Rate

2500+ Vblock® Systems Sold

1200+ Customers

Customer Support CSAT Score

96%

© Copyright 2015 EMC Corporation. All rights reserved

IT BUDGET

70% 20% 10%

TODAY’S IT TEAMS IN SILOS

New hardware investments

New software investments

Maintaining operations cost

Compute Storage Network Virtualization Application


VCE Converged infrastructure

SUPPORTED SUSTAINED ENGINEERED MANUFACTURED MANAGED

AS ONE PRODUCT


Mobile, Cloud, Big Data, & Social Driving Change

MONOLITHIC APPS

2nd PLATFORM

Application Servers

Relational Database

Data Warehouse

OLTP

TRANSACTIONAL

COMPOSITE APPS

3rd PLATFORM

DISTRIBUTED

New/NoSQL Database

In-Memory Database

Hadoop Cluster


VCE Converged Infrastructure

BLOCKS RACKS

2nd PLATFORM 3rd PLATFORM

APPLIANCES


Top of Rack and Spine Cisco Nexus 10/40Gbps Network Dedicated management switch

VCE Vxrack™ SYSTEM—Architecture overview

RACKSCALE CORE ELEMENTS

x86 Compute (Haswell) CPU, Disk & Mem Options 10Gbps NICs

Servers Storage (SDS)

Network Switches

ScaleIO Software Defined Storage

On Rack HW Management and VCE Vision™ Unified Management Interface

System M&O


VCE VxRack™ SYSTEM is based on ScaleIO

• Modular design – Simple form factor appliance (2RU houses 4 dense or 1 regular node)

– Traditional compute (CPU & RAM) to run application workloads

• Local storage presented as shared, software defined storage array

– Flash drives as ScaleIO caching or performance storage pools

– Hard drives for scalable storage pools

RAM

Local Disk (HDD)

Local Disk (SSD)

CPU CPU

ScaleIO—Software Defined Storage (Virtualized Storage Array)

RAM

Local Disk (HDD)

Local Disk (SSD)

CPU CPU


VCE VxRack™ SYSTEM is based on ScaleIO

RAM

Local Disk (HDD)

Local Disk (SSD)

CPU CPU

RAM

Local Disk (HDD)

Local Disk (SSD)

CPU CPU

ScaleIO—Software Defined Storage (Virtualized Storage Array)

RAM

Local Disk (HDD)

Local Disk (SSD)

CPU CPU

Extensible scale Add nodes to incrementally scale the infrastructure (up to 1,000’s of ScaleIO nodes)

ScaleIO automatically balances storage resources

Node types (performance, hybrid, storage only) can be mixed for non-linear scaling or resources

Simplifies customer hardware refresh cycles (add new nodes, relocate workloads, remove legacy nodes)


B

A A

Two-Copy “Mesh” Mirroring

B

C

D D

C

E E


Data Protection

F F B

E E E

B B

F


VxRack Manager

A UNIFIED USER EXPERIENCE

Deploy • Network • VxRack System Elements

Monitor • Compute, Network, Storage & Smart cabinet

Sustain • VxRack Manager Updates • RCM

Support • Log and configuration download

• Configure network • Install base OS • Install ScaleIO

• Report on infrastructure state • Report on ScaleIO SDS state • Report on system health, performance

• Compare current to as build config • Upgrade VxRack mgmt software • Provide RCM guidance

• Log & config aggregation • Knowledge base • Contact & process information


Deployment Options

SDS Client

SDS Server

S C S C S C

S C S C S C STORAGE PLUS ADDITIONAL STORAGE

APPLICATION/ HYPERVISOR HOST

C C C

S S S

S

C

Applications and storage share the same physical node All nodes are a mix of VCE VxRack™ System 1032 node types

relevant to application workload i.e., dense compute, hybrid, dense storage

Adding more servers increases the cluster-wide storage and compute resources

Enables non-disruptive rolling hardware refresh for in-line lifecycle management

Option1: Hyper-converge

Application and storage servers installed in separate hardware tiers 1st tier predominantly dense compute and hybrid node 2nd tier predominantly hybrid and dense storage Aligned to maintain application and technology

support teams Discrete storage/network/server orgs Efficient parallelism and no single points of failure

between apps and storage

Option 2: Two-layered

A combination of option 1 and 2 is feasible


VxRack System Nomenclature

VxRack System resources are presented in ‘nodes’

VxRack System node = assembly of CPU, Memory, Storage resources

VxRack System 1032 nodes are sold in 2RU* ‘enclosures’

Dense compute enclosure = 4 nodes

Dense storage / storage only enclosure = 1 node

Dense compute enclosures initially sold fully populated

4 nodes, must be all the same configuration (no mix and match)

Long term goal is to enable configure-to-order

RAM

Local Disk (HDD)

Local Disk (SSD)

CPU CPU

* RU = Rack Unit. A unit of measure that describes the height of equipment designed to mount in a physical DC rack

2RU


VCE Vxrack™ SYSTEM enclosure types

2R

U

STORAGE ONLY 1 NODE

EACH NODE 24 DISK DRIVES

MINIMUM CPU/MEMORY CONFIG

LINUX NO VMs

DENSE STORAGE 1 NODE


BOOTS VMware

DENSE COMPUTE 1-4 NODE SLOTS


BOOTS VMware


VxRack System Nodes – Dense Compute building

blocks 2RU – 4 Node Enclosure

Total 24 Drive Slots (6 Per Node) Total 16 x10Gbp/s NICs (4 Per Node)* Total 4x100Mb/s H/ware Mngmt (1 per Node)

Memory Config Disk config

Hybrid - 1x400GB SSD + 5x1.2TB HDD (6TB)

32GB SATADOM controller, incl. CacheCade

256GB RAM (8x32GB) or 512GB RAM (16x32GB)

CPU Config

Dual CPU E5-2680v3/12c/2.5Ghz 2U4N – Hybrid high

Hybrid - 1x400GB SSD + 5x1.2TB HDD (6TB)



Dual CPU E5-2650v3/10c/2.3Ghz 2U4N – Hybrid Medium

Node Types Fast (Large) - 6x800GB SSD (4.8TB)

32GB SATADOM controller 512GB RAM (16x32GB)

Dual CPU E5-2680v3/12c/2.5Ghz 2U4N – Perf High

Fast (Large) - 6x800GB SSD (4.8TB)

32GB SATADOM controller

256GB RAM (8x32GB) Dual CPU E5-2680v3/12c/2.5Ghz 2U4N – Perf Medium


VxRack System Nodes – DENSE STORAGE building

blocks 2RU – 1 Node Enclosure

24 Drive Slots 4 x 10Gbp/s NICs 1x100Mb/s H/ware Management Port

Memory Config Disk config Hybrid - 2x400GB SSD + 22x1.2TB HDD (27.2TB)



CPU Config Node Types

Dual CPU E5-2680v3/12c/2.5Ghz 2U1N – Capacity Cached High

Hybrid - 2x400GB SSD + 22x1.2TB HDD (27.2TB)



Dual CPU E5-2650v3/10c/2.3Ghz 2U1N – Capacity Cached Med

Capacity - 24x1.2TB HDD (28.8TB)

32GB SATADOM controller 256GB RAM (8x32GB)

Dual CPU E5-2650v3/10c/2.3Ghz 2U1N – Capacity Max



256GB RAM (8x32GB) Dual CPU E5-2680v3/12c/2.5Ghz 2U1N – Capacity Mix SSD/DD


VxRack System Nodes – Storage only building

blocks 2RU – 1 Node Enclosure – Storage Only

24 Drive Slots 2 x 10Gbp/s NICs 1x100Mb/s H/ware Management Port

Memory Config Disk config CPU Config Node Types

64GB RAM (8x8GB) Single CPU E5-2650v3/10c/2.3Ghz

Capacity - 24x1.2TB HDD (28.8TB)


64GB RAM (8x8GB) Single CPU E5-2650v3/10c/2.3Ghz 2U1N – Storage only Mix SSD/HDD

2U1N – Storage only Max HDD



64GB RAM (8x8GB) Single CPU E5-2650v3/10c/2.3Ghz 2U1N – Storage only Cached




SCALE OUT

Flexible configuration option

42RU

VXRACK SYSTEM CONTROLLER

2 or 4 CISCO NEXUS TOP OF RACK SWITCHES

1 CISCO MGMT SWITCH

UP TO 16 2RU SERVER ENCLOSURES

DENSE COMPUTE

DENSE STORAGE

STORAGE ONLY

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE STORAGE

DENSE STORAGE

DENSE STORAGE

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

2 CISCO NEXUS TOP OF RACK SWITCHES

1 CISCO MGMT SWITCH

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

2 CISCO NEXUS TOP OF RACK SWITCHES

1 CISCO MGMT SWITCH

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE


VxRack – Massive ScaleOUT

http://www.esg-global.com/lab-reports/esg-lab-spotlight-emc-scaleio-proven-performance-and-scalability/

« The performance results clearly show that ScaleIO lives up to its name and continues to scale, even when nodes are populated with extremely fast storage devices. ESG Lab has no doubt that a ScaleIO cluster will continue to scale in both capacity and performance as nodes are added to hundreds or even thousands of nodes. »


























Sample Config #1 - (up to 64/108 nodes)

42RU

VXRACK SYSTEM CONTROLLER

2 x CISCO 31xx NEXUS TOP OF RACK SWITCHES

1 CISCO MGMT SWITCH

DENSE COMPUTE

DENSE STORAGE

STORAGE ONLY

DENSE COMPUTE

DENSE COMPUTE

DENSE COMPUTE

DENSE STORAGE

DENSE STORAGE

DENSE STORAGE

STORAGE ONLY

STORAGE ONLY

STORAGE ONLY

Base configuration is a single rack

Minimum configuration of 3 x enclosures

3 is minimum requirement for ScaleIO SDS deployment

Can be any mix of dense compute/storage , storage only

Management switch is Nexus3172

Connects to 1GB IPMI port on every enclosure (Out of Band)

VxRack System Controller runs M&O components

Lightweight ‘hardware bootstrap’ vs traditional Vblock System AMP

1RU server.

‘Top of Rack’ switches are Nexus 3132 or 3164 switches

Dense compute = 16x10GB per enclosure (4 NICs/Node)

Dense storage/storage only = up to 4x10GB per enclosure

Nexus 31xx provide inter-node connectivity (10GB) and also customer network uplink (10GB or 40GB)

Maximum of 108 nodes

(exact rack count depends on type of enclosures used)

# of nodes is dependent on network topology


Network Topology – Switch selection

LAN switching uses either the Cisco Nexus 3132Q-X Switch, the Cisco Nexus 3164Q Switch

or the Cisco Nexus 9332PQ Switch.

The default non-ACI (Application Centric Infrastructure) network design contains a pair of connected Cisco

Nexus 3132Q-X or Cisco Nexus 3164Q access layer switches which support a maximum of 108 nodes.

Cisco 3132Q – 32x 40G QSFP+ (or 128x 10G w/ breakout cable) Cisco 3164Q – 64x 40G QSFP+ (or 256x 10G w/ breakout cable)

Cisco 9332PQ – 32x 40G QSFP+ (or 256x 10G with breakout cable)


Network Topology - deployment

• When density exceeds 108 nodes, the switch pairs can be bundled together and attached to a pair of

Cisco Nexus 9332PQ leaf switches, supporting up to 216 nodes.

• When density exceeds 216 nodes, the 9332PQ switches can be attached into the Vscale spine to

allow for large-scale deployments.

Vscale Spine


Network Topology

ACI environments contain nodes connected directly into the 9332PQ leaf switches which

support a maximum of 48 nodes.

• When density exceeds 48 nodes, the 9332PQ switches can be attached into the Vscale

Spine to allow for large scale deployments.

While this scaling introduces multiple physical VxRack System units they can be configured

into a single logical VxRack System Cluster via these 9332PQ network connections and

the VSAN will span all the nodes in a network grouping.

Note: SDN is not supported in the initial release.

The compute layer connects to the Ethernet component of the network layer. The

southbound fabric interconnects connect to the Cisco Nexus switches in the Ethernet network

through 10GbE port channels.

Vscale Spine


VxRack Management Software

REST APIs

VCE VxRack™

Infrastructure &

Element

Management

RBAC and AD integration

API integration

VxRack System Administrator

External

Management

Tools

DATA CENTER

SYSTEM

PHYSICAL

Mixed

Virtualized

Workloads

Hybrid Cloud

2.5/3rd

Platform

Applications

Software Defined Networking (future optional)

ScaleIO* (required)

Servers Network Switches

Storage (DAS)

Smart Rack

VCE

Vision™

VCE

VxRack™

Manager

VCE Data Center Manager

VxRack Tenants

vSphere KVM (Roadmap)

* Options for non-virtualized ‘Storage only’ deployments with RHEL+ScaleIO (Q3-2015)


Si vous avez des questions sur cette présentation,

n’hésitez pas à prendre contact directement contact

avec :

Jean-Baptiste ROBERJOT

[email protected]

Vx Rack : L'hyperconvergence avec l'experience VCE

Technology

Transcript of Vx Rack : L'hyperconvergence avec l'experience VCE