Red Hat Storage Day Seattle: Supermicro Solutions for Red Hat Ceph and Red Hat Gluster Storage
RED HAT STORAGE PORTFOLIO OVERVIEW - MilCIS 2017 · PDF fileRED HAT STORAGE PORTFOLIO OVERVIEW...
-
Upload
hoangxuyen -
Category
Documents
-
view
220 -
download
2
Transcript of RED HAT STORAGE PORTFOLIO OVERVIEW - MilCIS 2017 · PDF fileRED HAT STORAGE PORTFOLIO OVERVIEW...
RED HAT STORAGEPORTFOLIO OVERVIEW
Andrew HatfieldPractice Lead – Cloud Storage and Big DataMILCIS – November 2015
THE RED HAT STORAGE MISSION
To offer a unified, open software-defined storage portfolio that delivers a range of data
services for next generation workloads thereby accelerating the transition to modern IT
infrastructures.
Traditional StorageComplex proprietary silos
Open, Software-Defined StorageStandardized, unified, open platforms
Custom GUI
Proprietary Software
ProprietaryHardware
StandardComputersand DisksSt
anda
rdH
ardw
are
Ope
n So
urce
Soft
war
e
Ceph Gluster +++
Control Plane (API, GUI)
ADMIN USER
THE FUTURE OF STORAGE
ADMIN
USER
ADMIN
USER
ADMIN
USER
Custom GUI
Proprietary Software
ProprietaryHardware
Custom GUI
Proprietary Software
ProprietaryHardware
WHY BOTHER?
PROPRIETARYHARDWARE
HARDWARE-BASED INTELLIGENCE
SCALE-UPARCHITECTURE
CLOSED DEVELOPMENT PROCESS
Common, off-the-shelf hardwareLower cost, standardized supply chain
Scale-out architectureIncreased operational flexibility
Software-based intelligenceMore programmability, agility, and control
Open development processMore flexible, well-integrated technology
Open Software-Defined Storage is a fundamental reimagining of how storage infrastructure works.
It provides substantial economic and operational advantages, and it has quickly become ideally suited for a growing number of use cases.
TODAY EMERGING FUTURE
CloudInfrastructure
CloudNative Apps
Analytics
Hyper-Convergence
Containers
???
???
THE JOURNEY
THE RED HAT STORAGEPORTFOLIO
THE RED HAT STORAGE PORTFOLIO
Cephmanagement
OP
EN S
OU
RC
ESO
FTW
AR
E
Glustermanagement
Cephdata services
Glusterdata services
STA
ND
AR
DH
AR
DW
AR
E
Share-nothing, scale-out architecture provides durability and adapts to changing demands
Self-managing and self-healing features reduce operational overhead
Standards-based interfaces and full APIs ease integration with applications and systems
Supported by theexperts at Red Hat
Powerful distributed storage for the cloud and beyond
● VM Storage with OpenStack Cinder, Glance & Nova
● Object storage for tenant apps
Built from the ground up as a next-generation storage system, based on years of research and suitable for powering infrastructure platforms
TARGET USE CASES
Rich Media and Archival● S3-compatible object storage
Highly tunable, extensible, and configurable, with policy-based control and no single point of failure
Offers mature interfaces for block and object storage for the enterprise
OVERVIEW:RED HAT CEPH STORAGE
Cloud Infrastructure
Customer Highlight: CiscoCisco uses Red Hat Ceph Storage to deliver storage for next-generation cloud services
Nimble file storage for petabyte-scale workloads
● Machine analytics with Splunk● Big data analytics with Hadoop
TARGET USE CASES
Enterprise File Sharing● Media Streaming● Active Archives
Analytics
Enterprise Virtualization
OVERVIEW:RED HAT GLUSTER STORAGE
Purpose-built as a scale-out file store with a straightforward architecture suitable for public, private, and hybrid cloud
Simple to install and configure, with a minimal hardware footprint
Offers mature NFS, SMB and HDFS interfaces for enterprise use
Customer Highlight: IntuitIntuit uses Red Hat Gluster Storage to provide flexible, cost-effective storage for their industry-leading financial offerings. Rich Media & Archival
GROWING INNOVATION COMMUNITIES
● Over 11M downloads in the last 12 months
● Increased development velocity, authorship, and discussion has resulted in rapid feature expansion.
● Contributions from Intel, SanDisk, SUSE,and DTAG.
● Presenting Ceph Days in cities around the world and quarterly virtual Ceph Developer Summit events.
78 AUTHORS/mo
1500 COMMITS/mo
258 POSTERS/mo
41 AUTHORS/mo
259 COMMITS/mo
166 POSTERS/mo
SanDisk sells the InfiniFlash storage arrays, designed for use with Red Hat Ceph Storage. Optimizations contributed by SanDisk deliver high performance which allow Ceph customers to service new workloads.
Our relationship includes:
● Engineering and product collaboration
● Community thought leadership
PARTNER SOLUTIONS
All-flash arrays, optimized for Ceph
Supermicro's Red Hat Ceph Storage optimized solutions offer durable, software-defined, scale-out storage platforms in 1U/2U/4U form factors and are designed to maximize performance, density, and capacity
Customer can expect to see:
● Reference architectures, validated for
performance, density, and capacity
● Whitepapers and datasheets that support
Red Hat Storage solutions
Systems designed with storage in mind
Through silicon innovation and software optimization, Intel pushes the envelope on open, software-defined storage. A key contributor, Intel recently donated significant hardware to the Ceph project.
Intel development efforts have included:
● SSD and performance optimizations
● CephFS development
Accelerating software-defined storage
RED HAT STORAGETARGET WORKLOADS
DBaaS
VMWare
Hyper-convergence
OpenStack
Enterprisefile sharing
Analytics
Sync andshare
Objectstorage
CAPACITY PERFORMANCE
NEX
T-G
ENTR
AD
ITIO
NA
L
DIFFERENT KINDS OF STORAGE
ANALYTICSBig Data analytics with Hadoop
CLOUD INFRASTRUCTURE
RICH MEDIAAND ARCHIVAL
SYNC ANDSHARE
ENTERPRISEVIRTUALIZATION
Machine data analytics with Splunk
Virtual machine storage with OpenStack
Object storage for tenant applications
Cost-effective storage for rich media streaming
Active archives
File sync and share with ownCloud
Storage for conventional virtualization with RHEV
FOCUSED SET OF USE CASES
In-place Hadoop analytics in a POSIX compatible environment
HADOOP MAP REDUCE FRAMEWORK
● Allows the Hortonworks Data Platform 2.1 to be deployed on Red Hat Gluster Storage
● Hadoop tools can operate on data in-place● Access to the Hadoop ecosystem of tools● Access to non-Hadoop analytics tools● Consistent operating model: Hadoop can run directly
on Red Hat Gluster Storage nodes
● Flexible, unified enterprise big data repository● Better analytics (Hadoop and non-Hadoop)● Familiar POSIX-compatible file system and tools● Start small, scale as big data needs grow● Multi-volume support (HDFS is single-volume)● Unified management (Hortonworks HDP Ambari
and Red Hat Gluster Storage)
FEATURES
BIG DATA ANALYTICS
Hadoop DistributedFile System
Red Hat GlusterStorage Cluster
BENEFITS
High-performance, scale-out, online cold storage for Splunk Enterprise
Hot/warm data optimized for performance
10s of TB on Splunk server DAS
Cold optimized for cost, capacity and elasticity
Red Hat Storage Server on commodity x86 servers
● Multiple ingest options using NFS & FUSE● Expand storage pools without incurring downtime● Support for both clustered and non-clustered
configurations
● Run high speed indexing and search onSplunk’s cold data store
● Pay as you grow economics for Splunk cold data● Reduce ingestion time for data with
standard protocols● “Always online”, fast, disk-based storage pools
provide constant access to historical data
MACHINE DATA ANALYTICS
FEATURES BENEFITS
The most widely deployed 1 technology for OpenStack storage
● Full integration with Nova, Cinder and Glance● Single storage for images and ephemeral and
persistent volumes● Copy-on-write provisioning● Swift-compatible object storage gateway● Full integration with Red Hat Enterprise Linux
OpenStack Platform
● Provides both volume storage andobject storage for tenant applications
● Reduces provisioning time for new virtual machines● No data transfer of images between storage and
compute nodes required● Unified installation experience with Red Hat
Enterprise Linux OpenStack Platform
VIRTUAL MACHINE STORAGE
CEPH BLOCK DEVICE(RBD)
Keystone API Swift API Cinder APIGlance
APINovaAPI
CEPH OBJECT GATEWAY(RGW)
CEPH STORAGE CLUSTER(RADOS)
Hypervisor
OPENSTACK
1 http://superuser.openstack.org/articles/openstack-users-share-how-their-deployments-stack-up
FEATURES BENEFITS
Unstructured data storage for distributed, cloud-native applications
● Compatibility with S3 and Swift APIs● Fully-configurable replicated or erasure coded
storage backends● Cache tiering pools● Multi-site failover
● Supports broad ecosystem of tools and applications built for the S3 API
● Provides a modern hot/warm/cold storage topology that offers cost-efficient performance
● Advanced durability at optimal price
CEPH OBJECT GATEWAY(RGW)
APP APP APP APP
CEPH OBJECT GATEWAY(RGW)
RED HAT CEPH STORAGE CLUSTER
S3 API
OPENSTACK
S3 APIS3 APIS3 API
FEATURES BENEFITS
STORAGE FOR TENANT APPLICATIONS
Massively-scalable, flexible, and cost-effective storage for image, video, and audio content
Unstructured image, video,and audio content
● Support for multi-petabyte storage clusters on commodity hardware
● Erasure coding and replication for capacity-optimized or performance-optimized pools
● Support for standard file & object protocols● Snapshots and replication capabilities for high
availability and disaster recovery
● Provides massive and linear scalability in on-premise or cloud environments
● Offers robust data protection with an optimal blend of price & performance
● Standard protocols allow access to broadcast content anywhere, on any device
● Cost-effective, high performance storage for on-demand rich media content
RICH MEDIA
Red Hat GlusterStorage Cluster
Red Hat CephStorage Cluster
FEATURES BENEFITS
Open source, capacity-optimized archival storage on commodity hardware
Unstructuredfile data
● Cache tiering to enable "temperature"-based storage
● Erasure coding to support archive and cold storage use cases
● Support for industry-standard file and object access protocols
● Store data based on its access frequency● Store data on premise or in a public or hybrid cloud● Achieve durability while reducing raw capacity
requirements and limiting cost● Deploy on industry-standard hardware
ACTIVE ARCHIVES
Red Hat GlusterStorage Cluster
Red Hat CephStorage Cluster
Unstructuredobject data
Volumebackups
FEATURES BENEFITS
Powerful, software-defined, scale-out, on-premise storage for file sync and share with ownCloud
Webbrowser
● Secure file sync and share with enterprise-grade auditing and accounting
● Combined solution of Red Hat Gluster Storage, ownCloud, HP ProLiant SL4550 Gen 8 servers
● Deployed on-premise, managed by internal IT● Access sync and share data from mobile devices,
desktop systems, web browsers
● Secure collaboration with consumer-grade ease of use
● Lower risk by storing data on-premise● Conform to corporate data security and
compliance polices ● Lower total cost of ownership with standard,
high-density servers and open source
FILE SYNC AND SHARE
OWNCLOUD ENTERPRISE EDITION
Mobileapplication
DesktopOS
RED HAT GLUSTER STORAGE
FEATURES BENEFITS
The Journey to Software-Defined Storage INTERNAL ONLY22
Scalable, reliable storage forRed Hat Enterprise Virtualization
● Reliably store virtual machine images in a distributed Red Hat Gluster Storage volume
● Manage storage through the RHEV-M console● Deploy on standard hardware of choice● Seamlessly grow and shrink storage
infrastructure when demand changes
● Reduce operational complexities by eliminating dependency on complex and expensive SAN infrastructures
● Deploy efficiently on less expensive, easier to provision, standard hardware
● Achieve centralized visibility and control of server and storage infrastructure
ENTERPRISE VIRTUALIZATION
FEATURES BENEFITS
RED HAT STORAGEFUTURE WORKLOADS
USE CASES:TODAY AND FUTURE
CURRENT USE CASES TARGET USE CASES
ANALYTICS
Big Data analytics● Storage plug-in for
Hortonworks Data Platform
Big Data analytics● Persistent back-end for
Spark
Machine data analytics● Online cold storage for
IT operations data with Splunk
Machine data analytics● Storage for ELK, Solr
CURRENT USE CASES TARGET USE CASES
OPENSTACK
Virtual machine storage● Volume, ephemeral, and
image storage with Cinder, Nova, and Glance
Database storage● Storage for databases
with Trove
Object storage for tenant applications● Swift-compatible storage
for cloud applications
Storage back-end for Manila● Shared file system-as-a-
service for tenants
USE CASES:TODAY AND FUTURE
CURRENT USE CASES TARGET USE CASES
RICH MEDIA AND ARCHIVAL
Rich media streaming● Cost-effective storage for
rich media streaming
Active archives● Cost-effective online storage
for active archives
Compliant archives● Scalable, cost-effective
storage for compliance and regulatory needs
USE CASES:TODAY AND FUTURE
CURRENT USE CASES TARGET USE CASES
ENTERPRISE SYNC AND SHARE
Enterprise sync and share● Storage for Dropbox-style
shared folders (file backend)
Enterprise sync and share● Storage for shared folders
(object backend)
USE CASES:TODAY AND FUTURE
CURRENT USE CASES TARGET USE CASES
ENTERPRISE VIRTUALIZATION
Conventional virtualization storage● Integrated storage for Red Hat
Enterprise Virtualization(with separate compute and storage clusters)
Hyper-converged architectures● Hyper-converged
architectures
USE CASES:TODAY AND FUTURE