OPEN STORAGE IN THE ENTERPRISE - Red...

DUSTIN L. BLACK, RHCAOPEN STORAGE IN THE ENTERPRISE

OPEN STORAGEIN THE ENTERPRISEwith GlusterFS and Ceph

Dustin L. Black, RHCAPrincipal Technical Account ManagerRed Hat Strategic Customer Engagement

2014-12-11

http://people.redhat.com/dblack


http://fedoraproject.org/


http://www.gluster.org/

http://www.ceph.com/

http://www.redhat.com/en/services/support/technical-account-management

http://access.redhat.com/


Dustin L. Black, RHCAPrincipal Technical Account ManagerRed Hat, Inc

[email protected]@dustinlblack







Wouldn't you like to have...a single named support contactwho know's your business,your technology,and your needs?



A trusted advisor and technical expertto analyze your configuration,

advise on your architecture,and collaborate on your strategy?




An advocate and liaisonconnecting you with engineers and

maintainers,within Red Hat and upstream,

ensuring your priorities are also theirs?




A partner who lives andbreathes open source and

transparency?




RED HATTechnical AccountManagementPremium named-resource proactive supportfrom your leading experts in open solutionsContact your sales team or visit

Supporting success. Exceeding expectations.

redhat.com




Let's Talk DistributedStorage

Decentralize and Limit Failure PointsScale with Commodity Hardware and FamiliarOperating EnvironmentsReduce Dependence on SpecializedTechnologies and Skills



GlusterFSClustered Scale-out General Purpose StoragePlatformFundamentally File-Based & POSIX End-to-End

Familiar Filesystems Underneath (EXT4, XFS, BTRFS)Familiar Client Access (NFS, Samba, Fuse)

No Metadata ServerStandards-Based – Clients, Applications,NetworksModular Architecture for Scale andFunctionality



Red Hat Storage ServerEnterprise Implementation of GlusterFSIntegrated Software ApplianceRHEL + XFS + GlusterFSCertified Hardware CompatibilitySubscription Model24x7 Premium Support



CephMassively scalable, software-defined storagesystemCommodity hardware with no single point offailureSelf-healing and Self-managing

Rack and data center awareAutomatic distribution of replicas,

Block, Object, FileData stored on common backend filesystems (EXT4,XFS, etc.)Fundamentally distributed as objects via RADOSClient access via RBD, RADOS Gateway, and CephFilesystem


Inktank Ceph EnterpriseEnterprise Implementation of CephCombined with management and deploymenttoolsEnterprise-level support with bug escalationand hot patchesBare metal and OpenStack deploymentsTested and predefined client and serverconfigurationsSupport for block, object, and API clients


Use Case:Media Storage via Object Interface


GoalsMedia file storage for customer-facing appDrop-in replacement for legacy objectbackend1PB plus 1TB/day growth rateMinimal resistance to increasing scaleMulti-protocol capable for future servicesFast transactions for fingerprinting andtranscoding


Implementation12 Dell R710 nodes + MD1000/1200 DAS

Growth of 6 -> 10 -> 12 nodes~1PB in total after RAID 6GlusterFS Swift interface from OpenStackBuilt-in file+object simultaneous accessMulti-GBit network with segregated backend


Use Case:Self-Service Provisioning with Accounting and

Chargeback


GoalsAdd file storage provisioning to existing self-service virtualization environment

Automate the administrative tasksMulti-tenancy

Subdivide and limit usage by corporate divisions anddepartmentsAllow for over-provisioningCreate a charge-back model

Simple and transparent scaling


ImplementationDell R510 nodes with local disk~30TB per node as one XFS filesystemBricks are subdirectories of the parentfilesystem

Volumes are therefore naturally over-provisionedQuotas placed on volumes to limit usage andprovide for accounting and charge-backOnly 4 gluster commands needed to allocateand limit a new volume; Easily automated


Use Case:NoSQL Backend with SLA-Bound Geo-

Replication





GoalsReplace legacy database key/blobarchitectureDivide and conquer

NoSQL layer for key/pointerScalable storage layer for blob payload

Active/Active sites with 30-minute replicationSLAPerformance tuned for small-file WORMpatterns





ImplementationHP DL170e nodes with local disk~4TB per nodeCassandra replicated NoSQL layer forkey/pointerGlusterFS parallel geo-replication for datapayload site copy exceeding SLA standardsWorked with Red Hat Engineering to modifyapplication data patterns for better small-fileperformance





Use Case:Storage & Compute Consolidation for Scientific

Research









GoalsScale with storage needs

Eliminate need to move data between backendsKeep pace with exponential demand

Reduce administrative overhead; Spend moretime on the scienceControl and predict costs

Scale on demandSimple chargeback model

Efficient resource consumption









ImplementationDell PowerEdge R720 ServersOpenStack + Ceph

HPC and Storage on the same commodity hardwareSimple scaling, portability, and tracking forchargeback and expansion

400TB virtual storage poolAmple unified storage on a flexible platform reducesadministrative overhead









Use Case:Multi-Petabyte RESTful Object Store










GoalsObject-based storage for thousands of cloudservice customersSeamlessly serve large media & backup files aswell smaller payloadsQuick time-to-market and pain-free scalabilityHighly cost-efficient with minimal proprietaryrelianceStandards-based for simplified hybrid clouddeployments










ImplementationModular server-rack-row "pod" system

6x Dell PowerEdge R515 servers per rack10x 3TB disks per server; Total 216TB raw per rack10x racks per row; Total 2.1PB raw per row

700TB triple-replicated customer objectsLeaf-Spine mesh network for scale-out withoutbottleneck

Ceph with RADOS GatewayS3 & Swift access via RESTful APIsTiered storage pools for metadata, objects, and logs

Optimized Chef recipes for fast modularscaling










Questions?people.redhat.com/dblack










Do it!Build a test environment in VMs in justminutes!Get the bits:

has GlusterFS and Ceph packages nativelyRHSS 3.0 ISO available on the Go upstream: /

Fedora 21Red Hat Portal

gluster.org ceph.com










RED HATTechnical AccountManagementPremium named-resource proactive supportfrom your leading experts in open solutionsContact your sales team or visit

Supporting success. Exceeding expectations.

redhat.com










OPEN STORAGE IN THE ENTERPRISE - Red...

Documents

Transcript of OPEN STORAGE IN THE ENTERPRISE - Red...