Why Software Defined Storage is Critical for Your IT Strategy
-
Upload
andreas-kuncoro -
Category
Technology
-
view
57 -
download
2
Transcript of Why Software Defined Storage is Critical for Your IT Strategy
October 4, 2016 | Jakarta, ASEAN
WHY SOFTWARE-DEFINED STORAGE IS CRITICAL
FOR YOUR IT STRATEGY
Rahul Vijayan
Senior Solutions Architect, ASEAN, Red Hat
Development
Model
Application
Architecture
Deployment
& Packaging
Application
InfrastructureStorage
Waterfall
Agile
DevOps
Monolithic
N-tier
Microservices
Virtual Services
Containers
Bare Metal
Hosted
Hybrid Cloud
Data Center
Scale Out
Software-Defined
Storage
Scale Up
DATA CENTER EVOLUTION
Development
Model
Application
Architecture
Deployment
& Packaging
Application
InfrastructureStorage
Waterfall
Agile
DevOps
Monolithic
N-tier
Microservices
Virtual Services
Containers
Bare Metal
Hosted
Hybrid Cloud
Data Center
Scale Out
Software-Defined
Storage
Scale Up
DATA CENTER EVOLUTION
Development
Model
Application
Architecture
Deployment
& Packaging
Application
InfrastructureStorage
Waterfall
Agile
DevOps
Monolithic
N-tier
Microservices
Virtual Services
Containers
Bare Metal
Hosted
Hybrid Cloud
Data Center
Scale Out
Software-Defined
Storage
Scale Up
DATA CENTER EVOLUTION
Development
Model
Application
Architecture
Deployment
& Packaging
Application
InfrastructureStorage
Waterfall
Agile
DevOps
Monolithic
N-tier
Microservices
Virtual Services
Containers
Bare Metal
Hosted
Hybrid Cloud
Data Center
Scale Out
Software-Defined
Storage
Scale Up
DATA CENTER EVOLUTION
Development
Model
Application
Architecture
Deployment
& Packaging
Application
InfrastructureStorage
Waterfall
Agile
DevOps
Monolithic
N-tier
Microservices
Virtual Services
Containers
Bare Metal
Hosted
Hybrid Cloud
Data Center
Scale Out
Software-Defined
Storage
Scale Up
DATA CENTER EVOLUTION
EVOLUTION
Virtualize
KVM
RHV
RHV-S (Hyper-Converged)
ITaaS
OpenStack
Ansible
Cloud Forms
DevOps
Containers
OpenShift
Hybrid Cloud
Software Defined Storage
BI-MODAL
HYPERVISOR
OS
APP
OS
APP
OS
APP
Backup
OS
APP
SWIFT
REST
OBJECT
APP
CON
OS OS OS
APP
CON
APP
CON
APP
CON
APP
CON
APP
CON
iSCSI
FILE
NFS
MODE 1 MODE 2
SVR SVR SVR
NFS NFS
SVR SVR SVR
NFS NFS NFS
FILE
SDS
CIFSNFS
OSP
KVM
OS
APP
OS
SVR SVR
OS
APP APP
CLOUD FORMS / ANSIBLE – Dashboard, Self-Service, Config Management, Automation, Orchestration
RHV-S
SDS
RDB
OBJECT
iSCSI
FILE
NFS
CINDER
CAPACITY
PERFORMANC
E
NEXT-GENTRADITIONAL
WORKLOADS
FileOpenStack
Virtualization
ContainersHPC
Analytics
Object
Storage
Web Apps
DevOps
NoSQL
Hadoop
Broadcast
Content
DeliveryMedical
Imaging
CCTV
Archive
Backup
RDBM
S
RED HAT STORAGE PORTFOLIO
PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD
Red Hat Enterprise Linux + KVM
o Basic KVM hypervisor.
o No centralized management.
o Max 4 VMs per host.
o No enterprise features.
Red Hat Virtualization
o Centralized management for KVM,
compute, network, storage.
o Unlimited VMs per host.
o Enterprise features: HA, DR, Live
Migration.
WHAT IS RED HAT VIRTUALIZATION?
QUMRANET
ACQUISITION
2009 2012 2014 2016
2010 2013 2015
RHEV BEATS
VMWARE
on the
SPECvirt_sc2010
benchmark on both
speed and scale
RHEV 3.0
More solution
partners
RESTful API
Memory
overcommit
RHEV 3.1, 3.2
Windows guests
NUMA
collaboration with
HP
RHEV 3.3, 3.4
OpenStack Neutron
integration
Hot Plug CPU
Affinity
management
IBM Power support
RHEV 3.5
Integration with
Red Hat Satellite
RHV 4.0
10th product
release
RHEV 3.6
v-2-v tool, Migrate
workloads directly
from vSphere into
RHEV_M
RED HAT VIRTUALIZATION MILESTONES
RED HAT VIRTUALIZATION CUSTOMERS
o Software only with Reference
Architecture and deployment tool (L.A.)
o 3-node POD with 3-way replica, Self-
Hosted Engine
o Ansible based gdeploy tool (RHGS
3.1.3)
o Red Hat Directory Services
o Native File Server Capabilities
o Consolidated Backup to Central DC
RED HAT VIRTUALIZATION-S
HYPER-CONVERGED
RED HAT VIRTUALIZATION-S
Component Small Medium Large
Server Chassis 2u 2u 3u
CPU 2 x 6c - e5 2630 v2 2 x 6c - E5-2620 v3 2 x 8c - E5-2630 v3
RAM 64 128 256
Network 2 x 10Gb, 1 x 1Gb, 1 x IPMI 2 x 10Gb, 1 x 1Gb, 1 x IPMI 2 x 10Gb, 2 x 1Gb, 1 x IPMI
RAID RAID-6, FBWC, 1GB RAID-6, FBWC, 1GB RAID-6, FBWC, 2GB
HDD’s 8 - 6+2 12 - 8+2, 1-2HS 16 - 10+2, 1-4HS
HDD Type 3.5” SAS 7K 3.5” SAS 7K 3.5” SAS 7K
SSD/NVMe (optional) 1-2 1-2 1-2
Usable Capacity 12TB - 48TB 16TB - 64TB 20TB - 80TB
o Modular IaaS Architecture
o Easily scale-out
o 1,000's → 10,000's → 100k's of VMs
o Automation, Orchestration, Provisioning
o Public cloud-like capabilities for datacenter
o Removes vendor lock-in
WHAT IS OPENSTACK?
CEPH WITH OPENSTACK
CEPH & OPENSTACK
HYPER-CONVERGED
Server #1
KVM Hypervisor
Nova Compute
Cinder Volume
Server #2
KVM Hypervisor
Nova Compute
Cinder Volume
Server #3
KVM Hypervisor
Nova Compute
Cinder Volume
Server #N
KVM Hypervisor
Nova Compute
Cinder Volume
o 64TB Ceph included
o Cloud Forms included
o Backup snapshots
o Scaled API – Cinder backup
decoupled from Cinder volume
o Volume Replication API
o CephFS native driver - manila
RED HAT CLOUD FORMS
RED HAT CEPH
Workload IO Profiles
WorkloadExamples
Searchable Examples
Workload IOCharacteristics
HardwareCharacteristics
IOPS• MySQL
• MariaDB• PostgreSQL
• Medallia • High IOPS/GB• Low latency
• Compute servers
• 10GbE• NVMe SSD
Balanced/Throughput
• Digital media
serving
• Server virtualization(OpenStack Cinder)
• Bloomberg
• Target
• Walmart• Facebook
• High MB/s• Larger sequential IO
• Storage servers
• 10GbE to 40GbE• HDD/SSD
Capacity-Archive
• Digital media
archive
• Object archive• Big Data archive
• Yahoo• CERN
• Low cost/GB
• Sequential IO
• 90/10 write/read mix
• Dense storage servers
• 40GbE• HDD
CEPH CUSTOMER EXAMPLES
CONTAINERS (WHAT)
o Offers persistent storage to
applications running in containers
o Applications and storage can co-exist
on the same hardware
o Allows for higher server utilization and
lowers operational costs
o Storage generates only 3%–10%
overhead on converged servers
CONTAINER-CONVERGED - APLO
CONTAINERNGINIX
CONTAINERMASTER
Node 2 Node 3
Node 1
Node 4
NGINIX
CONTAINER
POSTGRES
CONTAINER
Deploys storage alongside
applications in containers
Lowers TCO by increasing
utilization of resources
Unifies container and storage
orchestration
Allows for rapid adjustments to
compute/storage ratio
IO Profile IOPS
4K 100% Random Read 1.35 Million
4K 100% Random Reads 1.15 Million
4K 100% Random Write 200K
4K 70% / 30% Read/Write OLTP Mix 452K
5* SuperMicro servers
Each with 4 NVMe cards
72 cores , 128 GB RAM
PERFORMANCE NUMBERS
IO Profile IOPS
4K Random read 1.1 Million
64K Random read 198K
256K Random read 25.9K
4K Random write 54K
Single IF100
8 OSD nodes
8 * 64 TB OSD's
0
0.01
0.02
0.03
0.04
0.05
0.06
0.07
RGT-200(SF) RGT-200(LF) RGT-400(LF) RGC-200 RGC-400
$ per GB per month
Premium Premium + QCT Standard Standard + QCT AWS Isilon VNX
STORAGE ECONOMICS
QCT: 3 year basic warranty, ex freight and tax.
Backup VOD Digitization
Medical Records Active ArchivesSync and Share
Surveillance Photos DB Dumps
GENERIC WORKLOADS
CCTV SOLUTION
Monitoring Stations
IP Cameras
Video
Management
Server
Remote MonitoringRemote Sites
Off-Site
Replica
BROADCAST SOLUTION
Satellite
Content Delivery
Server
Rendering, Compositing,
Transcoding
Mobile IPTV
WANAuto
Tiering
Playout
Servers
Content Creation and Editing
Remote Branches
Content Ingestion
Cloud
Digital TV
Workflow
Content Distribution
bit.ly/cephtestdrive bit.ly/glustertestdrive
TEST DRIVES
Point 1 on Red Hat Consulting…
Point 2 on Red Hat Partners…
VIRTUALIZATION. KVM. RHV. OPENSTACK. NFV. STORAGE. CONTAINERS.
DEVOPS.
RED HAT CONSULTING & PARTNERS
DISCOVERY SESSIONS WORKSHOPS IMPLEMENTATION
Establish a unified
culture and strategy
Construct environments
and development
pipelines
Design microservices
and containerized
applications
Establish and adapt
security, compliance,
scaling and monitoring
standards
Improve operational
efficiency, scalability and
flexibility
partner.redhat.com
plus.google.com/+RedHat
linkedin.com/company/red-hat
youtube.com/user/RedHatVideos
facebook.com/redhatinc
twitter.com/RedHatNews
THANK YOU