Mpstor hyper converged technology webinar

36
1 © Copyright 2013 MPSTOR LTD. All rights reserved. MPSTOR Orkestra™ is a hyper converged software for X86 platforms with integrated software defined storage and scale out technologies Scaling made simple

Transcript of Mpstor hyper converged technology webinar

Page 1: Mpstor hyper converged technology webinar

1© Copyright 2013 MPSTOR LTD. All rights reserved.

MPSTOR Orkestra™ is a hyper converged software for X86 platforms with integrated software defined storage and scale out technologies

Scaling made simple 

Page 2: Mpstor hyper converged technology webinar

2© Copyright 2013 MPSTOR LTD. All rights reserved.

Useful resources

• MPSTOR website

Page 3: Mpstor hyper converged technology webinar

3© Copyright 2013 MPSTOR LTD. All rights reserved.

Hyper converged technology

• HYPER-CONVERGENCE• “Hyper-convergence (hyperconvergence) is a type of

infrastructure system with a software-centric architecture that tightly integrates compute, storage, networking and virtualization resources and other technologies from scratch in a commodity hardware box supported by a single vendor”

• Source:• http://searchvirtualstorage.techtarget.com/definition/hype

r-convergence

Page 4: Mpstor hyper converged technology webinar

4© Copyright 2013 MPSTOR LTD. All rights reserved.

Hyper converged technology

• HYPER-CONVERGED STORAGE

• Hyper-converged storage is a technology that combines storage, compute, networking and virtualization in one unit.

• Source:• http://searchvirtualstorage.techtarget.com/definiti

on/hyper-converged-storage

Page 5: Mpstor hyper converged technology webinar

5© Copyright 2013 MPSTOR LTD. All rights reserved.

Hyperconvergence solutions

• RED HAT (software)• Nutanix (Appliance) (VM + VMWARE)• Symplivity (Appliance) (VM + VMWARE)• Symplivity (Appliance) (VM + OpenStack)• Pivot (Appliance)• Atlantis Computing(VM + VMWARE)• MPSTOR (software + OpenStack) with plugins

for VMWARE, XEN

Page 6: Mpstor hyper converged technology webinar

6© Copyright 2013 MPSTOR LTD. All rights reserved.

Beyond the Hyperconvergence definition

• Hyperconvergence in many cases requires additional technologies such as 

– Automation (SDN, SDS, SDC)– Scale‐Out (Compute, storage and networking)

• The Hyperconverged appliance (that is useful) should integrate Automation (SDDC) and Scale‐Out technologies

Page 7: Mpstor hyper converged technology webinar

7© Copyright 2013 MPSTOR LTD. All rights reserved.

Why Hyper-converged technology ?

• Proprietary independent equipment silos of storage, compute and networking cannot meet the price point of utility cloud computing.

– => requirement for standard X86 hardware for everything

• Scaling the number of cloud users drives exponentially the cost of provisioning these users.

– => requirement for software defined automated provisioning technologies.

Page 8: Mpstor hyper converged technology webinar

8© Copyright 2013 MPSTOR LTD. All rights reserved.

Why Hyper-converged technology ?

• Integration of compute, storage and networking is complex and carries risk

– => requirement for hyper‐converged systems.

• Scaling an infrastructure of compute, storage and networking is complex 

– => requirement for scale out technologies

Page 9: Mpstor hyper converged technology webinar

9© Copyright 2013 MPSTOR LTD. All rights reserved.

HyperC, Automation & Scaleout forces

Web Scale &Utility cloud

CommodityX86 Hardwarefor everything

Integration of Compute, storage & networking

Provisioning costsdrives 

automation

Subscriber numbers drive 

scale out 

Capex

CapexOpex

Opex

Page 10: Mpstor hyper converged technology webinar

10© Copyright 2013 MPSTOR LTD. All rights reserved.

Designed for the Datacentre Stakeholders

Page 11: Mpstor hyper converged technology webinar

11© Copyright 2013 MPSTOR LTD. All rights reserved.

HyperConverged Software StackMPSTOR’s software integrates in a single hyper converged software suite  scale out automated provisioning of 

• Storage• Compute• Networking

Our software enables customers to build differentiated high value converged appliances.

There are three core software components:• SAM module

• transforms bare metal hardware into full featured storage arrays.

• Software defined storage module• Scale  out  automated provisioning of 

storage for a wide range of datacenter consumers

• Virtual services  module• Compute (EC2), Storage (EBS&S3) and 

Networking  compatible services delivered as a public or private cloud.

Page 12: Mpstor hyper converged technology webinar

12© Copyright 2013 MPSTOR LTD. All rights reserved.

Principal Use cases

OrkestraHyperConverged

Storagesoftware

Hyper convergedSoftware defined(public/private

Cloud)

Hyper convergedStorage All‐in‐oneappliance

Software defined Scale out storage Block, File, Object 

storage

Page 13: Mpstor hyper converged technology webinar

13© Copyright 2013 MPSTOR LTD. All rights reserved.

Use case 1: Hyperconverged Appliance

• The Hyper‐converged Appliance integrates in one physical unit a private cloud or Virtual appliance.

• Both compute and storage can be incrementally added.• End user can provision from a dashboard compute, storage and networking from a single hardware box.

• The appliance can be incrementally scaled to provide extra capacity, resiliency or both.

Sector Specific Applications• Education• Medical• POS+ Surveillance+ Digital Signage+CRM, Biz Apps 

Page 14: Mpstor hyper converged technology webinar

14© Copyright 2013 MPSTOR LTD. All rights reserved.

Use case 2: Hyperconverged cloud systemOrkestra delivers a range of end user virtualised storage, compute and networking services.

HardwareCompute Storage

MPSTOR Cloud OS

Cloud Services

e.g. Windows DropboxVideo Surveillance

ServicesHardware

Orkestra™

Page 15: Mpstor hyper converged technology webinar

15© Copyright 2013 MPSTOR LTD. All rights reserved.

Use case 3: Scale out storage

10G/16G/40G

8PB 8PB 8PB 8PB

192TB

128

1

40G/100G

Scale outcluster up to 10 proxy nodesExporting• BLOCK• FILE• OBJECT

Scale out StorageNodesUp to 128 nodesof 192TB of RAID resilient storage in single or dual controller nodes

Page 16: Mpstor hyper converged technology webinar

16© Copyright 2013 MPSTOR LTD. All rights reserved.

Hyperconverged in the datacenter OSSD

S  out‐of‐b

and control plane

Storage Providers

VBS Service Layer

Storage  Protocol

Fabrics & Protocols

MPSTOR TM 

component

Storage Consumers

Virtual Storage Array

Software Defined Storage

Storage Array Management

FC/FCoE, SAS, ISCSI CIFS/NFS S3/SWIFT STORAGEOffload Engine

Automated Provisioning

Storage SLA & Policy Mgt

FabricMgt

Single Pane Monitoring& Alerts

Data Protection & Resiliency

MPSTOR on OpenPlatform H/W Or 3rd Party Appliances

Tenants Virtual Machines Storage Services NodesSelf Servicedashboards

Snapshot, Thin provisioning, Replication, S3 backup, RAID, IOC management

OperatorToolBox

BLOCK FILE OBJECT ANALYTICS

Fabrics & Protocols

STORAGE ARRAY PROVIDERSProtocols&FabricsVolume services

IN‐BAND termination & servicesVirtual Storage Layer 

MPSTOR Delivery tools

ConsumersVirtual Machines, Nodes, Tenants

Page 17: Mpstor hyper converged technology webinar

17© Copyright 2013 MPSTOR LTD. All rights reserved.

The challenges of Hyper converged technology

• Hyper converged technologies (HCT) integrate the three core components of any IT system, this requires very high levels of functionality  and expertise in compute, storage and networking.

• Too large a gene problem !

• HCT OPEX when used in large scale infrastructure must stay flat, this means at scale HCT  requires additional frameworks;

– Framework 1: Scale‐out technology– Framework 2: Software defined automated provisioning controllers

Page 18: Mpstor hyper converged technology webinar

18© Copyright 2013 MPSTOR LTD. All rights reserved.

The challenges of Hyper converged technology

• HCT CAPEX: Utility cloud pricing requires standard hardware !

• Configuring standard hardware for resiliency and high availability is difficult as it lacks specific hardware control features.

• Requires innovative ways to achieve HA & Resiliency found in proprietary T1 appliances.

Page 19: Mpstor hyper converged technology webinar

19© Copyright 2013 MPSTOR LTD. All rights reserved.

MPSTOR background

• MPSTOR software is a hyper converged software product integrating in a single management toolset all the components to manage storage, compute and networking.

• MPSTOR Storage Array Management (SAM)• MPSTOR’s SAM software  is an enterprise class storage software compatible with standard x86 platforms. MPSTOR SAM uses scale out technologies to achieve very high BW, IO performance and storage capacity.

• MPSTOR Software defined storage (SDS)• MPSTOR’s SDS technology automates the provisioning of a pool of SAM storage arrays across multiple fabric types to all datacenter consumer types.

• MPSTOR  Hyper Converged  Infrastructure(HCI)• MPSTOR’s HCI integrates all the technologies to create Hyper‐converged storage systems.

Page 20: Mpstor hyper converged technology webinar

20© Copyright 2013 MPSTOR LTD. All rights reserved.

Thank You

Page 21: Mpstor hyper converged technology webinar

21© Copyright 2013 MPSTOR LTD. All rights reserved.

Deep Dive

Page 22: Mpstor hyper converged technology webinar

22© Copyright 2013 MPSTOR LTD. All rights reserved.

MPSTOR SoftwareMPSTOR’s Orkestra software suite integrates in a single product scale out automated provisioning of 

• Storage• Compute• Networking

Our software enables customers to build differentiated high value virtual appliances.

There are three core software components:• SAM module

• transforms bare metal hardware into full featured storage arrays.

• SDS module• Scale  out  automated provisioning of 

storage for a wide range of datacenter consumers

• IaaS module• Compute (EC2), Storage (EBS&S3) and 

Networking  compatible services delivered as a public or private cloud.

Page 23: Mpstor hyper converged technology webinar

23© Copyright 2013 MPSTOR LTD. All rights reserved.

Create unique differentiated  datacenter services 

Universal provisioning from any storage provider to any storage consumer

Provides in‐band services from managed storage pools such as data protection, SLA control, caching, security, fabric management

Orkestra Overview

Storage Array ManagementTotally new paradigm

Software Defined StorageGives SDS new dimensions

Infrastructure as a ServiceFully SDDC enabled

Unique integrated  open‐platform, open‐standard, full featured storage array management

Provides block, file and object storage with multi fabric support

Available either as a physical or virtual storage array controller with high availability

Dramatically lowers the cost of ownership

Turnkey cloud management software systems

Based around OpenStackTM, the open source cloud computing platform

Support for all industry hypervisors  (KVM, ESXi, HyperV)

Extended end user  dashboards

OrkestraTM  Software Suite

Page 24: Mpstor hyper converged technology webinar

24© Copyright 2013 MPSTOR LTD. All rights reserved.

Datacentre Stakeholders

Page 25: Mpstor hyper converged technology webinar

25© Copyright 2013 MPSTOR LTD. All rights reserved.

Commercial: Capex & Opex

Reduces overall cost by providing a single turnkey distribution for storage, compute and networking.

Enables datacenterdifferentiation of its services through  service creation tools.Reduces Opex by automating the provisioning of 

compute, storage and networking.

Reduces Capex by standard server and storage  hardware.

Page 26: Mpstor hyper converged technology webinar

26© Copyright 2013 MPSTOR LTD. All rights reserved.

Service CreationSoftware defined storage (SDS) controller ‘plug and discover’ capability automates capacity expansion. 

SDS controller aggregates raw/base provider storage into managed pools of media tiers, across different fabrics with policy driven provisioning and management

End user can  provision on demand, through end user or admin dashboards, at the required SLA for the end user workload. Storage is provisioned by the end user from scale out storage pools as block, file or object storage.

Storage is provisioned by the end user from scale out storage pools as block, file or object storage.

BASIC

PREMIUM

STANDARD

SDS automates the provisioning of storage 

per group

Orkestra – SDS AutomationCompute Containers Fabrics Storage Containers

Page 27: Mpstor hyper converged technology webinar

27© Copyright 2013 MPSTOR LTD. All rights reserved.

Cloud ServicesType Service  Description

Infrastructureservice

Compute as a service  EC2 compatible service that allows an end user to create, delete, backup virtual machines in KVM or VMWARE hypervisors.

Infrastructureservice

Elastic Block storage as a service  EBS type service that allows an end user to provision block storage at a specific SLA and QoS from the datacenter storage pools and attach to virtual machine.

Infrastructureservice

Object storage as a service  S3 compatible service that allows any S3 application to provision, upload, download object data.

Tenant services

Storage Array as a service Allows end users to manage their own storage array in their own tenant space for their virtual machines over CIFS, NFS or iSCSI. Provides a rich storage feature set of snapshot, thin provisioning, replication and backup.

Storage Centric VMs

A catalog of storage centric  virtual machines implementing drop‐box type solutions, file servers, video surveillance,  Database, LAMP

Virtual machines integrated with special purpose storage centric applications .

Page 28: Mpstor hyper converged technology webinar

28© Copyright 2013 MPSTOR LTD. All rights reserved.

The 6 big storage issues of datacentres

Page 29: Mpstor hyper converged technology webinar

29© Copyright 2013 MPSTOR LTD. All rights reserved.

Resiliency & Redundancy

• MPSTOR's software maximises resiliency by using Information Dispersal Algorithms (IDA) and data encryption when storing scale out data across storage arrays.

• MPSTOR’s unique Virtual Block Store technology (VBS) creates a Virtual Block Device (VBD) that is stripped across multiple storage arrays with additional parity.

• Depending on the amount of Parity required the VBD can sustain one or more entire storage array failures.

• Each VBD chunk is built on resilient storage array RAID6 groups, allowing each storage array to sustain multiple disk failures.

• By keeping the RAID groups to a fixed size the recovery time can be set to a known acceptable value.

Page 30: Mpstor hyper converged technology webinar

30© Copyright 2013 MPSTOR LTD. All rights reserved.

Managing the Cloud architecture

Tenant SpaceVMs

Tenant SpaceVMs

Tenant SpaceVMs

The Cloud

The UnderCloud

TunneledNetwork per Tenant Space

SANManaged  By Orkestra‐SDSOrkestra‐SAM

OpenStackPlugIn

Page 31: Mpstor hyper converged technology webinar

31© Copyright 2013 MPSTOR LTD. All rights reserved.

Cloud Operations• MPSTOR solves the BIG6 storage requirements by efficiently managing block, file and object storage with 

its Software Defined Storage (SDS) storage software. 

• MPSTOR provisions BLOCK, OBJECT and FILE storage, enabling data centres to scale UP and scale OUT block storage technology on open hardware bare metal platforms.

• Using ERASURE code technologies both within and across storage arrays, MPSTOR provides IN‐THE‐ARRAY resiliency and scale out stripes ACROSS‐THE‐ARRAYS to deliver a scale UP and SCALE‐OUT redundant storage provider pool.

• From this pool, storage can be automatically provisioned and exported to a diverse range of workloads through the user’s choice of protocol (BLOCK, FILE, OBJECT) over an end user choice of fabrics.

• MPSTOR’s single pane of management presents to the datacenter operator monitoring, diagnostic, fault finding and recovery tools for every physical and logical element captured in the datacenter CMDB (Common Management Data Base). 

• MPSTOR’s SDS toolkit tracks and monitors the datacenter usage so that accurate resource planning can be implemented.

Page 32: Mpstor hyper converged technology webinar

32© Copyright 2013 MPSTOR LTD. All rights reserved.

(1) End User Dashboard EC2 compute serviceSelect image to launch from 

service catalog

ConfigureCPU, Memory and local disk 

size

Configure security settings

Firewall/keypair

Configure options and Launch Virtual Machine in compute 

group

Manage Virtual Machine

RDP/SSH Login, Start, Stop,Backup

Delete Virtual Machine

4

1

3

26

5

Page 33: Mpstor hyper converged technology webinar

33© Copyright 2013 MPSTOR LTD. All rights reserved.

(1) End User Dashboard EBS storage service

Select storage size

Select Storage group ‐SLA/QoS 

‐Storage policy

Attach to Virtual Machine image

Manage Volume‐Snapshot‐Backup

Delete Volume

1

3

25

4

1TB

Page 34: Mpstor hyper converged technology webinar

34© Copyright 2013 MPSTOR LTD. All rights reserved.

Application server catalog• The application service 

catalog consists of a set of special purpose applications servers.

• Web & Cloud services• Lamp stack• Video surveillance• Video streaming• Dropbox type solutions• Database management• Storage Array service• File sharing as a service

Page 35: Mpstor hyper converged technology webinar

35© Copyright 2013 MPSTOR LTD. All rights reserved.

Scale ou

t Com

pute

Group

s Block and Object Storage model

BASIC

STANDARD

1GiSCSI

10GiSCSI

6G SAS

4/8/16GFC

Fabrics Storage Containers

PREMIUM

Automated EBSBlock Storage

Compute Containers

BRONZE compute GROUP

SILVER compute GROUP

Object Storage

S3

Web

1

2

Scale ou

t Storage Group

Page 36: Mpstor hyper converged technology webinar

36© Copyright 2013 MPSTOR LTD. All rights reserved.

End User Services CatalogType Service  Description

VM OS Catalog

An EC2 catalog of General purpose Windows, Centos, Ubuntu, RHEL, SLES KVM and VMWARE compatible virtual machine images

A catalog of Virtual machine images with end userconfiguration of memory, cpu and storage.

VM Applicationserver catalog

An EC2 catalog of mainly Linux based business application servers for a range of storage centric applications (e.g dropbox) 

A catalog of special purpose Virtual machine imageswith end user configuration of memory, cpu andstorage.

Storage Catalog A EBS compatible catalog of block storage volumes at specific QoS and SLA levels for specific VM workloads.

S3 compatible service that allows any S3 applicationto provision, upload, download object data

Storage Array as a service 

A special purpose VM image that provides storage array services in the customer tenant space for advanced storage management

Allows end users to manage their own storage arrayin their own tenant space for their virtual machinesover CIFS, NFS or iSCSI. Provides a rich storage featureset of snapshot, thin provisioning, replication andbackup.

Object storage An S3 object storage compatible service  Virtual machines integrated with special purposestorage centric applications