THE POWER OF RED HAT CEPH STORAGE

And how it’s essential to your software defined datacenter

WHY YOU SHOULD CARE

Essential – Critical component of software-defined datacenter

Elastic – Massively scalable for modern, next generation workloads

Economical – Runs on industry standard servers and disks

Efficient – Unifies infrastructures to support different data types

Elegant – Sophisticated & powerful – designed for IT practitioner

Easy – Included with Red Hat OpenStack Platform / Cloud Infrastructure / Cloud Suite

AGENDA

● Requirements and trends

● Software-defined storage

● Red Hat Ceph Storage 101

● OpenStack integration

● Special features

● Service offerings

● Where to go next

● Addendum - Roadmap (NDA only)

REQUIREMENTS, TRENDS, AND SOFTWARE-DEFINED STORAGE

5

DEMANDING REQUIREMENTS

Enterprises cope with an industry average 30-40% data growth every year, while 60% of storage budgets are flat or declining.

At same time, enterprises with modern applications have challenging storage demands:

• Handling of highly distributed, unpredictable usage patterns

• Near-instant provisioning of resources to match capabilities of cloud services

• Enterprise-class resilience, performance, and data protection

• Freedom from worsening labor constraints of proprietary storage

AGENDA

● Requirements and trends● Software-defined storage● Red Hat Ceph Storage 101● OpenStack integration● Product features, benefits, and

differentiation● Service offerings● Where to go next

7

STORAGE IS EVOLVING

OPEN, SOFTWARE-DEFINED STORAGEStandardized, unified, open platforms

Standard Computersand Disks

Ceph Gluster +++

Control Plane (API, GUI)

Custom GUI

Proprietary Hardware

Proprietary Software

Custom GUI

Proprietary Hardware

Proprietary Software

USER USER USER

ADMIN ADMIN ADMIN

Custom GUI

Proprietary Hardware

Proprietary Software

USER ADMIN

Stan

dar

dH

ard

war

eO

pe

n S

ou

rce

Soft

war

e

TRADITIONAL STORAGEComplex proprietary silos

8

WHY THIS MATTERS

PROPRIETARYHARDWARE

SCALE-UPARCHITECTURE

HARDWARE-BASEDINTELLIGENCE

CLOSED DEVELOPMENTPROCESS

Common,off-the-shelf hardware

Scale-outarchitecture

Software-basedintelligence

Open developmentprocess

Lower cost, standardized supply chain

Increased operational flexibility

More programmability, agility,and control

More flexible, well-integratedtechnology

9

A RISING TIDE

“By 2020, between 70%-80% of unstructured data will

be held on lower-cost storage managed by SDS.”Innovation Insight: Separating Hype From Hope for Software-Defined Storage

“By 2019, 70% of existing storage array products will

also be available as software-only versions.”Innovation Insight: Separating Hype From Hope for Software-Defined Storage

Software-Defined Storage is leading a shift in the global storage industry, with far-reaching effects.

SDS-P MARKET SIZE BY SEGMENT

Block Storage

File Storage

Object Storage

Hyperconverged

2013 2014 2015 2016 2017 2018 2019

Source: IDC

$475M

$1,395M

$1,195M

$1,029M

$859M

$705M

$592M

10

THE RED HAT STORAGE MISSION

To offer a unified, open software-defined storage portfolio

that delivers a range of data services

for next generation workloads, thereby accelerating the

transition to modern IT infrastructures.

Share-nothing, scale-out architecture provides durability and adapts to changing demands

Self-managing and self-healing features reduce operational overhead

Standards-based interfaces and full APIs ease integration with applications and systems

Supported by the experts at Red Hat

ISV

STA

ND

AR

DH

AR

DW

AR

EO

PEN

SO

UR

CE

SOFT

WA

RE

Gluster management

Ceph data service Gluster data service

Ceph management

RED HAT STORAGE ECOSYSTEM

RED HAT CEPH STORAGE 101

13

RED HAT CEPH STORAGE

Distributed enterprise-grade object storage

• Proven for large-scale, modern workloads

• Open, massively-scalable, software-defined

• Flexible, scale-out architecture on clustered industry standard hardware

• Efficient, unified storage platform (object, block, file)

• User-driven storage lifecycle management with 100% API coverage

• Integrated, easy-to-use management console

14

BUSINESS BENEFITS

OPEN SOURCE

No proprietary lock-in, with a large commercial ecosystem and broad community

PEACE OF MIND

Over a decade of active development, proven in production and backed by Red Hat

LOWER COST

More economical than traditional NAS/SAN, particularly at petabyte scale

15

TECHNICAL BENEFITS

• Massive scalability to support petabytes of data

• Relies on no single point of failure, for maximum uptime

• Self-manages and self-heals to reduce maintenance

• Data distributed among servers and disks dynamically

16

CEPH ARCHITECTURE: OBJECT-BASED

LIBRADOSA library allowing apps to directly access RADOS (C, C++, Java, Python, Ruby

RADOSA software-based reliable, autonomous, distributed object store comprised of self-healing, self-

managing, intelligent storage nodes and lightweight monitors

RBDA reliable, fully distributed block device with

cloud platform integration

RGWA web services gateway for object storage,

compatible with S3 and Swift

APP HOST/VM

RED HAT CEPH STORAGE SPECIAL FEATURES

RED HAT CEPH STORAGEDistributed, enterprise-grade object storage, proven at web scale

Open, massively-scalable, software-defined

Flexible, scale-out architecture on clustered standard hardware

Single, efficient, unified storage platform (object, block, file)

User-driven storage lifecycle management with 100% API coverage

Integrated, easy-to-use management console

Designed for modern workloads like cloud infrastructure and data lakes

RED HAT CEPH STORAGE

19

COMPLETE OPENSTACK STORAGE

• Deeply integrated with modular

architecture and components for

ephemeral & persistent storage

➢ Nova, Cinder, Manila, Glance,

Keystone, Swift

• Optimized for Database as a Service

(DaaS) with MySQL workloads

• Bundled in Red Hat OpenStack

Platform

OPENSTACK

Keystone API Swift API Cinder API Glance API Nova API

HYPERVISORCEPH OBJECT GATEWAY

Manila API

SPECIAL INTEGRATION WITH RED HAT OPENSTACK PLATFORM DIRECTOR

• Automated object and block deployment

• Automated upgrades from Red Hat Ceph Storage 1.3 to 2, including Red Hat Storage Console 2

• Support for existing Ceph Clusters

• OpenStack Manila file deployment as composable controller service via integrated CephFS driver (Tech Preview)

• Hyperconverged Red Hat OpenStack Platform 10 and Red Hat Ceph Storage 2 (Tech

Preview)

21

ADVANTAGES FOR OPENSTACK USERS

• Instantaneous booting of 1 or 100s of

VMs

• Instant backups via seamless data

migration between Glance, Cinder,

Nova

• Tiered I/O performance within single

cluster

• Multi-site replication for disaster

recovery or archivingRED HAT CEPH STORAGE

HYPERVISOR

VM

22

EFFICIENCY• Standard servers and disks• Erasure coding - reduced footprint• Thin provisioning• Traditional and containerized

deployment

SCALABILITY• Multi-petabyte support• Hundreds of nodes• CRUSH algorithm – placement/rebalancing• No single point of failure

PERFORMANCE• Client-side caching• Server-side journaling• BlueStore (tech preview)

APIs & PROTOCOLS• S3, Swift, S3A plug-in• Cinder block storage• NFS• POSIX (tech preview)• iSCSI (tech preview)

SECURITY• Pool-level authentication• Active Directory, LDAP, Keystone

v3• At-rest encryption with keys held

on separate hostsDATA SERVICES• Snapshots, cloning, and copy-on-write• Global clusters for S3/Swift storage• Disaster recovery for block and object storage

CORE PRODUCT FEATURES

23

RED HAT CEPH STORAGE 2.3

▪ NFS interface to Ceph RGW for users to transition from file-

based access to S3-compatible object storage

▪ Compatibility with Hadoop S3A filesystem client

▪ Option for deploying Ceph in a containerized format

Broader protocol support for more effective connectivity between workloads

24

NFS INTERFACE TO RGW

CLIENT KEYSTONEAPPLICATION

RADOSGW

S3/swift

NFS Interface

Object

NFS

File

Backup & Restore

BACKUP HOST

RADOSGW

RGW NFS Gateway*

ObjectFile

CLIENT

NFS

NFS

▪ NFS V4 file access on RGW object API

▪ Hosts can mount and access object namespace using NFS mount

▪ Interface does real-time translation between NFS and RGW object semantics

▪ No caching of files or data required

NFS RGW INTERFACE - BENEFITS

▪ No data caching semantics, lightweight, simple▪ Multiprotocol access extends scalability and cost benefits of object

storage to traditional filesystem workloads▪ Global data access with multisite RGW setup ▪ Extended lifetime of existing legacy NFS applications and better ROI

RADOS

RGW S3 API

OBJECT

FILE

S3A

RGW NFS Data Ingest

S3A

COMPATIBILITY WITH HADOOP S3A FILESYSTEM CLIENT

S3A

BENEFITS OF VALIDATION

▪ Use of Red Hat Ceph Storage with compatible big data analytics applications

o Apache Hadoop MapReduce, Hive, Spark, Presto

▪ Multiple ephemeral instances of elastic analytics clusters referencing single source of truth

▪ Ability to realize financial and operational benefits of object storage in big data infrastructure without changes to application

CEPH CONTAINERIZATION

▪ Alternative vehicle for deploying Red Hat Ceph Storage ▪ Single container image of product available on Red Hat Container

Registry▪ Delivers same capabilities as in traditional package format▪ Supports customers seeking to standardize orchestration and

deployment of infrastructure software in containers with Kubernetes

BENEFITS OF CEPH CONTAINERIZATION

▪ Enables installations, upgrades, and updates atomically▪ Offers reduced complexity, easier management, and faster

deployment for key use cases like telco, NFV, and mass scale edge computing

▪ Facilitates deployment and scale of complex architectures like OpenStack by containerizing individual services and managing deployments with Kubernetes scheduler

WHAT WAS NEW IN 2

1. Integrated storage management platform

2. RGW geo-clusters with single namespace

3. RBD mirroring to enable multi-site replication for disaster recovery and archival

4. Support for Active Directory, LDAP, and Keystone v3

5. Improved S3 and Swift protocol API support

31

INTEGRATED MANAGEMENT WITH RED HAT STORAGE CONSOLE

• Easy to use graphical interface to manage

storage cluster life cycle

• Ansible-based deployment tools for

installation, importation, and granular

configuration from CLI or GUI

• Monitoring and troubleshooting with

statistical and graphical information about

cluster components

RADOS. RGW, RBD, CALAMARI

RED HAT STORAGE CONSOLE 2

CLUSTER OF STANDARD SERVERS AND MEDIA

CLIENTSADMINS

Upgrades to RGW, Ceph’s object storage interface:

• Support for authentication using Active Directory, LDAP & OpenStack Keystone v3

• Greater compatibility with the Amazon S3 and OpenStack Swift object storage APIs

• AWS v4 signatures, object versioning, bulk deletes

• New NFS gateway for bulk import and export of object data (tech preview)

OBJECT STORAGE IMPROVEMENTS

Global object storage clusters with single namespace

• Enables deployment of clusters across multiple geographic locations

• Clusters synchronize, allowing users to read from or write to the closest one

Multi-site replication for block devices

• Replicates virtual block devices across regions for disaster recovery and archival

MULTISITE CAPABILITIES

STORAGE CLUSTERUS-EAST

STORAGE CLUSTERUS-WEST

PERFORMANCE BOOST WITH BLUESTORE

• New storage backend optimized for modern media - Tech preview in RHCS 2

• Replaces FileStore, optimized for HDDs – file system for object data management impacted performance

• Benefits:

• 2-3X performance • Mitigates need for underlying file system or dedicated journal device• Flexible media topologies (SSDs, K/V drives, persistent memory devices) to

help optimize data or metadata I/O• Native checksumming to detect data corruption on media

OPENSTACK FILE SUPPORT WITH CEPHFS

• POSIX-compliant file system to store data in accordance with OpenStack Manila Project

• Tech Preview RHCS 2 – Manila Tech Preview OSP 7, 8

• FUSE or kernel clients (RHEL 7.2)

• CephFS Manila driver (tech preview) with OSP 9, 10, 11

• Roadmap: robustness, hardening, then scalability

November 2015: Manila Tech

Preview in OSP 7

July/August 2016: CephFS tech preview in RHCS 2 and clients

August 2016: CephFS Manila

driver tech preview in OSP 9

January 2017: Manila production support in OSP 10

November 2017: CephFS production

support

The other guys

DescriptionSoftware-defined, unified storage and distributed

object storeTraditional NAS & SAN appliance (still

requiring two storage systems)

Capacity 1000s of nodes, limitless petabytes ~6 PBs

ScalabilityEasy to add and manage- via single nodes on

standard servers and disksDifficult - via forklift installation of

additional appliances

VM migration and backupsLive, instantaneous, for high agility in cloud

environmentsCumbersome and slow: Image pulled

from Swift for each instance

Design process Open source Proprietary

Maintenance Nodes added and removed on flyAppliance replacement impacts data

migration and downtime

CostPay-as-you-go OPEX, economical at scale Large upfront CAPEX, much (75%+) more

expensive on PB+ workloads

COMPARING AND CONTRASTING THE OPTIONS

SERVICE OFFERINGS

SERVICES AVAILABLE FROM RED HATFOR RED HAT CEPH STORAGE & RED HAT OPENSTACK PLATFORM

• Subscription Benefits – Streamlined product and resource access, lifecycle management, Knowledgebase and deployment resources, security and accountability

• Jumpstart - 3 day consulting for pre-production cluster implementation at customer site

• Health Check - 3-5 day evaluation of total solution best practice engagement

• Red Hat Storage Consulting Services - recommended for initial storage design and set-up

• Global Services and Support - production subscriptions for smooth lifecycle deployments

• Red Hat Storage training – 2 and 5 day for storage or cloud admins, including OpenStack

RED HAT CEPH STORAGE REFERENCE ARCHITECTURES • Hardware Configuration Guide for Red Hat Ceph Storage

• Hardware Selection Guide for Red Hat Ceph Storage

• Performance and Sizing Guide: Red Hat Ceph Storage on Supermicro Storage

• Performance and Sizing Guide: Red Hat Ceph Storage on QCT Servers

• Red Hat Storage on Servers with Intel Processors and SSDs

• Performance and Sizing Guide: Red Hat Ceph Storage on Samsung NVMe SSDs

• Deploying Red Hat OpenStack Platform 7 with Red Hat OSP director 7.1 (Access via customer portal)

• Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack Platform 7 Cloud (Access via customer portal)

• Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack Platform 6 Cloud (Access via customer portal)

• Deploying Highly Available Red Hat OpenStack Platform 6 with Red Hat Ceph Storage

• Deploying Red Hat OpenStack Platform 6 with Ceph Storage

• Dell Red Hat Cloud Solutions Reference Architecture Guide

• Cisco UCS C3160 High-Density Rack Server with Red Hat Ceph Storage

• Hyper-Converged Red Hat OpenStack Platform 8 and Red Hat Ceph Storage 1.3

CLOSING TIME

• Web: www.redhat.com/storage

• Blog: http://redhatstorage.redhat.com/

• Twitter: www.twitter.com/redhatstorage

• Facebook: www.facebook.com/RedHatStorage/

• YouTube: www.youtube.com/user/redhatstorage

• Slideshare: www.slideshare.net/Red_Hat_Storage

WHERE TO GO ON SOCIAL MEDIA

WHERE TO GO TO ENGAGE

➢ Red Hat Subscriptions: https://access.redhat.com/subscription-value

➢ Evaluation, Pre-production, and Production contracts available through Red Hat sales

➢ Red Hat Consulting: http://www.redhat.com/en/services/consulting/storage

➢ Red Hat Storage training: https://www.redhat.com/en/services/training

➢ Red Hat Storage test-drive: http://red.ht/cephtestdrive

➢ To engage a Territory Service Manager in your area, ask for a local Red Hat Storage sales professional at:

NORTH AMERICA: 1 (888) REDHAT-1; LATIN AMERICA: 54 (11) 4329-7300; EMEA: 00800 7334 2835

APJ: 65 6490 4200; Brazil: 55 (11) 3529-6000,; Australia: 1800 733 428; New Zealand: 0800 733 428

THANK YOU

ADDENDUM –ROADMAP (NDA ONLY)

RED HAT CEPH STORAGE 12-MONTH TRAJECTORY

Cloud Infrastructure

Data Lakes

Media Repository

Back-up and Recovery

USE

CA

SES

Flexible, unified storage for petabyte-scale workloads

• Object storage benefits extended to key use cases, data lakes and back-up, along with traditional file-based storage customers for easier adoption

• Hyperconvergence and containerization with OpenStack for NFV

• Complete unified storage with production support of CephFSvia OpenStack Manila

• Improved usability with evolution of Storage Console

• Next generation performance with BlueStore object store

Red Hat Confidential

OPENSTACK SUPPORT IN RED HAT CEPH STORAGEROADMAP FOR 2017

January 2017

Automated object and block deployment using Red Hat OpenStack Platform (OSP) 10 Director

Automated upgrades from Red Hat Ceph Storage 1.3 to 2, including Red Hat Storage Console 2

Support for existing Ceph Clusters

Full erasure coding support in OSP 10

OpenStack Manila file deployment via integrated CephFSdriver (Tech Preview)

Hyperconverged infrastructure with Nova Compute (Tech Preview – reference architecture)

May 2017

Red Hat Ceph Storage support for OSP 11 via Red Hat Ceph Storage 2.3

Telco/NFV-focused co-location of Red Hat Ceph Storage and OSP (Supported)

Multi-site support and OSP director support for RBD mirroring

October/November 2017

Containerized hyperconvergedintegration of Red Hat Ceph Storage

and OSP (single SKU, lifecycle, installation, & upgrade, with per node

pricing)

CephFS production support via Red Hat Ceph Storage 3 in OSP 12

Red Hat Confidential

RED HAT CEPH STORAGE ROAD MAP

RHCS 2.2

Mar 2017

RHCS 2.3

Jun 2017

• Swift Refcore Compliance

• Native SSL Support for RGW

• Hadoop integration via S3A

• S3 Object Expiration

• NFS Gateway for RGW (GA)

• Containerization

These capabilities are planned based on active development in upstream development communities, and will only become available once they reach the necessary level of maturity. Timelines are subject to change.

RHCS 3.0

Oct 2017

• CephFS (GA)

• iSCSI (GA)

• BlueStore (TP)

• Object Encryption

RHCS 3.x

2018

• BlueStore (GA)

Red Hat Confidential