DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

OPEN STORAGEIN THE ENTERPRISEwith GlusterFS and Ceph

Dustin L. Black, RHCAPrincipal Technical Account ManagerRed Hat Strategic Customer Engagement

2014-12-11

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Dustin L. Black, RHCAPrincipal Technical Account ManagerRed Hat, Inc

dustin@redhat.com@dustinlblack

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Wouldn't you like to have...a single named support contactwho know's your business,your technology,and your needs?

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

A trusted advisor and technical expertto analyze your configuration,

advise on your architecture,and collaborate on your strategy?

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

An advocate and liaisonconnecting you with engineers and

maintainers,within Red Hat and upstream,

ensuring your priorities are also theirs?

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

A partner who lives andbreathes open source and

transparency?

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

RED HATTechnical AccountManagementPremium named-resource proactive supportfrom your leading experts in open solutionsContact your sales team or visit

Supporting success. Exceeding expectations.

redhat.com

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Let's Talk DistributedStorage

Decentralize and Limit Failure PointsScale with Commodity Hardware and FamiliarOperating EnvironmentsReduce Dependence on SpecializedTechnologies and Skills

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

GlusterFSClustered Scale-out General Purpose StoragePlatformFundamentally File-Based & POSIX End-to-End

Familiar Filesystems Underneath (EXT4, XFS, BTRFS)Familiar Client Access (NFS, Samba, Fuse)

No Metadata ServerStandards-Based – Clients, Applications,NetworksModular Architecture for Scale andFunctionality

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Red Hat Storage ServerEnterprise Implementation of GlusterFSIntegrated Software ApplianceRHEL + XFS + GlusterFSCertified Hardware CompatibilitySubscription Model24x7 Premium Support

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

CephMassively scalable, software-defined storagesystemCommodity hardware with no single point offailureSelf-healing and Self-managing

Rack and data center awareAutomatic distribution of replicas,

Block, Object, FileData stored on common backend filesystems (EXT4,XFS, etc.)Fundamentally distributed as objects via RADOSClient access via RBD, RADOS Gateway, and CephFilesystem

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Inktank Ceph EnterpriseEnterprise Implementation of CephCombined with management and deploymenttoolsEnterprise-level support with bug escalationand hot patchesBare metal and OpenStack deploymentsTested and predefined client and serverconfigurationsSupport for block, object, and API clients

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Use Case:Media Storage via Object Interface

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

GoalsMedia file storage for customer-facing appDrop-in replacement for legacy objectbackend1PB plus 1TB/day growth rateMinimal resistance to increasing scaleMulti-protocol capable for future servicesFast transactions for fingerprinting andtranscoding

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Implementation12 Dell R710 nodes + MD1000/1200 DAS

Growth of 6 -> 10 -> 12 nodes~1PB in total after RAID 6GlusterFS Swift interface from OpenStackBuilt-in file+object simultaneous accessMulti-GBit network with segregated backend

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Use Case:Self-Service Provisioning with Accounting and

Chargeback

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

GoalsAdd file storage provisioning to existing self-service virtualization environment

Automate the administrative tasksMulti-tenancy

Subdivide and limit usage by corporate divisions anddepartmentsAllow for over-provisioningCreate a charge-back model

Simple and transparent scaling

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

ImplementationDell R510 nodes with local disk~30TB per node as one XFS filesystemBricks are subdirectories of the parentfilesystem

Volumes are therefore naturally over-provisionedQuotas placed on volumes to limit usage andprovide for accounting and charge-backOnly 4 gluster commands needed to allocateand limit a new volume; Easily automated

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Use Case:NoSQL Backend with SLA-Bound Geo-

Replication

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

GoalsReplace legacy database key/blobarchitectureDivide and conquer

NoSQL layer for key/pointerScalable storage layer for blob payload

Active/Active sites with 30-minute replicationSLAPerformance tuned for small-file WORMpatterns

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

ImplementationHP DL170e nodes with local disk~4TB per nodeCassandra replicated NoSQL layer forkey/pointerGlusterFS parallel geo-replication for datapayload site copy exceeding SLA standardsWorked with Red Hat Engineering to modifyapplication data patterns for better small-fileperformance

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Use Case:Storage & Compute Consolidation for Scientific

Research

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

GoalsScale with storage needs

Eliminate need to move data between backendsKeep pace with exponential demand

Reduce administrative overhead; Spend moretime on the scienceControl and predict costs

Scale on demandSimple chargeback model

Efficient resource consumption

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

ImplementationDell PowerEdge R720 ServersOpenStack + Ceph

HPC and Storage on the same commodity hardwareSimple scaling, portability, and tracking forchargeback and expansion

400TB virtual storage poolAmple unified storage on a flexible platform reducesadministrative overhead

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Use Case:Multi-Petabyte RESTful Object Store

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

GoalsObject-based storage for thousands of cloudservice customersSeamlessly serve large media & backup files aswell smaller payloadsQuick time-to-market and pain-free scalabilityHighly cost-efficient with minimal proprietaryrelianceStandards-based for simplified hybrid clouddeployments

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

ImplementationModular server-rack-row "pod" system

6x Dell PowerEdge R515 servers per rack10x 3TB disks per server; Total 216TB raw per rack10x racks per row; Total 2.1PB raw per row

700TB triple-replicated customer objectsLeaf-Spine mesh network for scale-out withoutbottleneck

Ceph with RADOS GatewayS3 & Swift access via RESTful APIsTiered storage pools for metadata, objects, and logs

Optimized Chef recipes for fast modularscaling

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Questions?people.redhat.com/dblack

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

Do it!Build a test environment in VMs in justminutes!Get the bits:

has GlusterFS and Ceph packages nativelyRHSS 3.0 ISO available on the Go upstream: /

Fedora 21Red Hat Portal

gluster.org ceph.com

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

RED HATTechnical AccountManagementPremium named-resource proactive supportfrom your leading experts in open solutionsContact your sales team or visit

Supporting success. Exceeding expectations.

redhat.com