1© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
EMC ViPR and ECS: A Lap Around Software-Defined Services
EMC Forum 2014
Magnus [email protected]: @swevmBlog: purevirtual.eu
2© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Session Agenda
• Market Dynamics
• EMC ViPR Overview
• What’s New in ViPR Controller
• What’s New in ViPR Data Services
• Additional Resources
4© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
HYPERSCALE AND BIG DATA APPLICATIONS10X More Data, Accessible 24x7x365
6© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Mobile Cloud Big Data Social
MOBILE DEVICES
BILLIONSOF USERS
MILLIONSOF APPS
LAN/Internet Client/Server
PC
HUNDREDS OF MILLIONS OF USERS
TENS OF THOUSANDSOF APPS
Source: IDC, 2013
ECS Appliance ECS Appliance
7© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Commodity Hardware
New & Basic Workloads
ECS AppliancesProtect Current Investments
Performance & Mission-Critical Workloads
ViPR: SOFTWARE-DEFINED STORAGE
ViPRServices
Provisioning Self-Service ReportingAutomationViPRController
EMC Non-EMCArray
Support via OpenStack
8© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Simple, Open and Extensible ArchitecturePROVIDES UNMATCHED FLEXIBILITY & CHOICE
Automate Storage Best Practices:Orchestrates repetitive and complex tasks
100% Open & Extensible Using ViPR REST API & Java SDK
Works with EMC & Non-EMC Storage Platforms: Isilon, VMAX, VNX, XtremIO, ScaleIO, HDS, & IBM plus many others
Works with Data Protection Technologies: RecoverPoint, VPLEX, and SRDF
Works with Commodity Platforms
Integrated with Cloud Stacks: VMware, Openstack Swift and Microsoft Hyper-V
ViPRController
ApplicationAdmin
SELF–SERVICE UI
Create a Bock Volume
Snapshot a Volume
Restore from Snapshot
Mount a Volume to Host
Multi-tenant, Multi-Site Self-Service Catalog
HIGH LOWMEDIUM
EMC Non-EMCvia
OpenStack
9© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
ViPR Controller Use Cases
Storage Automation Storage-as-a-Service
Multi-tenancy Metering
Self-service access to all
storage
Universal API & Protocol support
< 60 seconds
Storage discovery and
ingestion
5 ClicksAutomated storage
provisioning
63%Average reduction
in provisioning times
VNX IsilonXtrem-IO
3rd PartyVMAX
Commodity Platforms
Simplify
10© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
ViPR 2.0 & 2.1 – ENHANCEMENTS
Controller
• Commodity Platform Support
• Geo-Distributed Data Center Support
• Enhanced Native Array Support(XtremIO, Vplex+RP)
• Expanded 3rd Party Array Support via OpenStack
• Data Protection Technology Enhancements
• Federal Compliance
11© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
EXPANDED ARRAY SUPPORT
CONTROLLER
ORACLEZFS
NetAppE-Series
Solidfire
IBMXIV
IBMSVC
IBMDS8000
Native Integration
EMC Isilon
EMCVMAX
HitachiVSP
(Block)
HitachiHUS VM
NetAppFAS
EMCScaleIO
EMC VNX
EMCVBLOCK
HP 3PARHP
Left-HandDell
Equal-Logic
XtremIO
13© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Enhanced Data Protection Functionality
• Operational Recovery of VPLEX Virtual Volumes
• SNAPs for VPLEX volumes
• Automate high availability –reduce to 5 clicks
Active Failure Domain Active Failure Domain
San Francisco San Jose
VMAX VMAX
VPLEX Metro
Passive Failure Domain
Las Vegas
VMAX
14© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
COMPLIANCE FEATURES FOR SECURE ENVIRONMENTS
• IPv6 and Dual Stack Support
– All communication to ViPR, ViPR to underlying systems and within ViPR
• Security Hardening Scans
• Compliance Certifications
– Common Criteria
– FIPS 140-2 Compliance
– Section 508 Compliant GUI
– Smaller footprint
15© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
GEO-DISTRIBUTED DATA CENTER MANAGEMENT
• Single Sign-on across Geo
• Global tenants and projects
• Reporting across ViPR instances
• Scale
Multiple ViPR Controller Deployment
Tenant 1000sVolumes 1,000,000 / ViPRFile systems 400,000 / ViPR#operations/hr 500
16© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
NEW DATA MANAGEMENT REQUIREMENTS
Documents (XLS, PPT, DOC)
Relational Databases
Rich Media (PDF, JPG, Video,
Streaming)
Sensor Data (GPS, measurements)
Unstructured Content
(Web Server Logs)
Content Repositories
Host Based Storage
Effortless ScaleUniversal Protocol Support Highly Efficient Geo-Storage
Analytics
17© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
ViPR 2.0 & 2.1 – ENHANCEMENTS
Services
• Geo-replication and geo-distribution
• ViPR Block – enabled by ScaleIO• Data services on commodity
hardware• ViPR CAS Support for Centera
workloads
18© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Geo-Replicated Data ProtectionProtection against local and global failures
• Handles local hardware and full data center failures– Disk, Node, Rack, Data Center are failure
domains
• Local hardware failure recovery requires no WAN traffic
• New Hybrid encoding approach enables low storage overhead
Site 1
Site 3
Site 2
19© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Active-Active Read/Write ArchitectureAnywhere access to content
• Single global namespace across data centers
• Strong consistency across data centers
• Optimized for minimal WAN round trips by sensing access patterns across data centers on individual entities
https://accesspoint.yourcompany.com
20© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Data AccessCompatibility with common industry APIs
• Simultaneous access to underlying data through multiple interfaces– Object, HDFS , File (Future)
• HDFS compatible with Cloudera, Hortonworks, Pivotal etc.
• Support for S3, Swift, Atmos and Centera CAS APIs object
• Extensions to APIs– Byte-Range updates, Atomic appends, Rich ACLs etc.
HDFS
21© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Data Services on Commodity Hardware
VIRTUAL ARRAY
CommodityCommodity Commodity
• Running on top commodity white boxes
• End to end commodity H/W bootstrap, setup, rolling upgrades, and configuration management.
…
22© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
ComplianceCompliance archiving and long-term retention
• Enabled at object or bucket level
• Time-based retention enforcement
• Immutability and checksum
• Platform lockdown
• Privileged delete
• SEC 17a-4f & HIPAA
23© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Software-Defined Storage – ViPR Block
ViPR BLOCK (enabled by SCALEIO)
ViPR Block delivered by Scale IO
Managed by ViPR controller similar to other ViPR data services
Can create virtual pools of storage with varying performance tiers
Scales from 3 to 1000’s of nodes
24© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Flexible Form Factors
25© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
WEB-SCALE
Exabyte+
Self-Service
Elastic
COMPLETE ANY DATA CENTER
Enterprise
ServiceProvider
THE WORLDS FIRST COMMERCIALLY AVAILABLE
COMPLETE WEB-SCALE STORAGE INFRASTRUCTURE FOR YOUR DATA CENTER
26© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
ECS Appliance Configurations
Commodity HW (Intel x86, Ethernet, SAS)
Object and HDFS Configurations @ GA
– Small = 360TB
– Medium = 1.4PB
– Large = 2.9PB
Mixed Configurations @ GA
– Small = 360TB (Object, HDFS) & 120TB (Block)
– Medium = 1.4PB (Object, HDFS) and 240TB (Block)
Racks can be clustered to scale to 100’s of PBs
27© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
The bigger picture, ITaaS – USE CASEIT-as-a-Service
Multi TenancyMulti Cloud
OrderingData Protection
SecuritySelf-Service Admin
Apps not OPSSpeed & Agility
Scalable
MeteringCost control
External Clouds
28© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
Join the ViPR Community…Learn | Try | Develop | Collaborate
Explore how-to videos, helpful guides, and training
Download ViPR FREE with no time limit – for non-production use
Access SDKs, FAQs, forums, technical documentation, sample apps, and more
Ask the experts, talk to peers, share ideas and experiences
www.emc.com/viprcommunity
30© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
VIPR Controller Starter Pack
50TB ViPR Controller
3 Year Maintenance
40 Hour Professional Services
All For$10,000*
* Limited time offer! Please talk to your EMC Account Rep today for details!
32© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
The bigger picture, ITaaS – USE CASE
Network-as-a-Service
Multi TenancyVLAN
Metering
Security policies
Load BalancerFirewall
PerformanceLAN & WAN
Compute-as-a-Service
EncapsulatedOS Images
StandardizationEncapsulation
Scalability vMotion
DRSVirtual
Network
Universal API & Protocol support & Metering
Top Related