Gluster Webinar: Introduction to GlusterFS v3.3
-
Upload
glusterfs -
Category
Technology
-
view
6.318 -
download
3
description
Transcript of Gluster Webinar: Introduction to GlusterFS v3.3
Introduction To GlusterFS
Audio is available via VoIP or Landline.
For VoIP
You will be connected to audio using your
computer‟s speakers or headset.
For Landline:
Please select Use Telephone after joining the
Webinar.
US/Canada attendees dial (773) 945-1011
Access Code 584-930-717
A Better Way To Do Storage 2
Heather Wellington Marketing Manager
Gluster, Inc.
Tom TrainerDirector
Product Marketing
Gluster, Inc.
Today’s Speakers
A Better Way To Do Storage 3
History of Gluster
How it all started– Backgrounds in high performance, clustered computing
– Working at Lawrence Livermore National Labs
• AB Periasamy & Hitesh Chellani design “Thunder”
• One of the worlds fastest super computers
• On Intel commodity hardware
• Solved filesystem scalability and performance limitations
– Large customer in oil & gas persuaded them to focus on storage
– Gluster founded by Hitesh & AB to bring technology to market
Result: award winning technology
Thunder
A Better Way To Do Storage 4
What is the Gluster File System?
A scale-out file system for object and network
attached storage (NAS)
GlusterFS provides– Flexibility to deploy in ANY environment
– High availability
– Unified files and objects
– Scalability to Petabytes & beyond
– Linearly scalable performance
– Superior storage economics
A Better Way To Do Storage 5
GlusterFS Architecture Design Goals
Innovation– Eliminate metadata – improve file access time
– Unify files and objects
Elasticity – Flexibility adapt to growth/reduction
– Add, delete volumes & users
– Without disruption
Scale linearly – Multiple dimensions
• Performance
• Capacity
– Aggregated resources
Eliminate metadata– Improve file access speed
Simplicity – Ease of management
– No complex Kernel patches
– Run in user space
Capacity
Per
form
ance
A Better Way To Do Storage 6
Key Differentiators
Filesystem runs in user space
Software only
Open source
Modular, stackable storage OS architecture
Data stored in native formats
No metadata – Elastic hashing
Unified files and objects
Virtual Machine (VM) virtual motion enabler
A Better Way To Do Storage 7
User Space
Filesystem Runs in User Space
GlusterFS
Server(CPU/Mem)
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB
1 TB 1 TB
Kernel
1 TB 1 TB
Not tied to kernel
No reassemblies
Independence
A Better Way To Do Storage 8
Software Only
Hardware agnostic
Superior storage economics & flexibility – Data center / private cloud use commodity hardware
– Public cloud – i.e. AWS, RackSpace, GoGrid – pay for only what you need
No lock-in– Hardware vendors-at purchase time or in the future
– Public or private cloud
– Performance, capacity, or availability levels
– GlusterFS – not proprietary, files are stored in native formats (i.e. EXT4)
A Better Way To Do Storage 9
Open Source
200,000+ downloads– ~15,000 /month
500+ registered deployments– 45 countries
2,500+ registered users– Mailing lists, Forums, etc.
Active community– Diverse testing environments
– Bugs identification and fixes
– Code contributions
Member of broader ecosystem– OpenStack, Linux Foundation, Open
Virtualization Alliance
Global Adoption
A Better Way To Do Storage 10
Elastic Hashing
No metadata server
An algorithmic approach– Unique hash tag for each file stored
– Tags stored within the file system
– Rapid file read – low latency
Traditional Central Metadata Server
Traditional Distributed Metadata Server
Innovative Elastic Approach
A Better Way To Do Storage 11
A Standard Gluster NAS Deployment
Standard clients
running standard apps
Over any standard IP
network
Access application
data, as files & folders,
in a global namespace,
using a variety of
standard protocols
Stored in a
commoditized,
virtualized, scale-out,
centrally managed pool
DAS, SAN, NAS
Gluster Global Namespace (NFS, CIFS, Gluster Native)
Application data
Clients/Apps Clients/Apps Clients/Apps
IP Network
VMs VMDK VMDK
virtual storage pool
A Better Way To Do Storage 12
Unifying Public and Private Cloud Storage
Client/AppsClient/Apps
Private Cloud Public Cloud
Replication
Gluster Global Namespace
Client/AppsClient/Apps
Client/AppsClient/Apps
Client/AppsClient/Apps
Client/Apps
IP Network
A Better Way To Do Storage 13
Deployment Scenarios Common Solutions Built on GlusterFS
Media serving (CDN)
Large scale file storage
Unified file and object storage
Tier 2 & 3 archive
File sharing
Multi-tenant file systems
Storage for High Performance
Computing (HPC)
IaaS storage layer
Disaster recovery
Backup & restore
Private cloud
A Better Way To Do Storage 14
Introducing GlusterFS 3.3 (BETA) July 20, 2011
GlusterFS 3.3: Next generation file and object
storage– The first system for data storage that enables you to store and access data as
an object and as a file
– Flexible and powerful, it simplifies access and management of data
– Eases migration of legacy, file-based applications to object storage for use in
the cloud
Public beta availability: July 20, 2011– Broad community testing and participation
– Selected enterprise customer engagements
A Better Way To Do Storage 15
The “Traditional” Unified Approach
Proprietary
Bolt-on hardware approach
– Combined hardware raises costs
– Higher TCO
– Paying for what you many not need
Increased risk
– Common hardware elements can fail
• Power supplies
• Fans
• Cabling…lots of cabling
Files Objects DB’s
Carved Up Storage Pool
NAS Object
Traditional Monolithic Hardware
Bolt-on Approach(i.e. EMC VNX)
Block “VNX reminds me of my old VHS, DVD and cable box….
….one thing fails and I’m blown out of the water.”
Beta Customer , 2011
A Better Way To Do Storage 16
Software Approach to File and Object
Network Attached Storage (NAS)
– NFS / CIFS / GlusterFS
– POSIX compliant
– Access files within objects
Window Access
– Improves Windows performance
– Uses HTTP, not slower CIFS
– We will still support SAMBA
Object Storage
– API
– Internet Protocol (IP)
– ResTFul
– Get/Put
– Buckets
– Objects seen as files
Standards based
– Amazon S3 ReSTFul interface
compatible
– Access data as objects and a NAS
interface to access files (NFS, CIFS,
GlusterFS)
High performance storage across heterogeneous server environments
A Better Way To Do Storage 17
GlusterFS 3.3 Unified File & Object Storage
Widely deployable and extremely flexible – On-premise, virtualized and in public and private clouds
– Deep unification of file and object data storage
• Not just unified at the management layer
• Not a bolt-together hardware product
– Access data within objects as files
– Compatible with Amazon Web Services
• S3
• Create S3 on EC2 and EBS
– Back up objects from the data center to AWS
– Enable S3 functionality in the data center
– Built to run on commodity hardware
A Better Way To Do Storage 18
GlusterFS 3.3 Easing & Accelerating Legacy App Migration
Enables cloudification of applications
– Removes remaining storage hurdles related to file only
access
– Allows for gradual app migration to the cloud
– Enables moves to both private and public cloud
infrastructures
Gluster FS 3.3
Object Storage
Data Center, Virtual
Public, Private Cloud
Unified file & object storage accelerates legacy app migration to the cloud
Enterprise Apps / Enterprise Data Center
Ob
ject In
fo
A Better Way To Do Storage 19
Gluster 3.3 Unified File & Object – Use Cases
Data Center– Take control of cloud services
– Reduce AWS S3 costs
– Deliver S3 like global services in-house
– Legacy application migration
IaaS – Deliver File and S3 Services
– Unified file and object
• Competitive differentiator
– Drastically reduce storage costs
– Increase offerings, revenues and margins
Traditional Data Center
Private Cloud
IaaS
S3
Data Center: S3 in house &/ integrate with S3
IaaS: Deliver S3 to clients
A Better Way To Do Storage 20
The Gluster Connector for OpenStack – July 27, 2011
SWIFT
Enables GlusterFS to be the underlying file system
Connects GlusterFS to Xen and KVM hypervisor
– Unified File and Object storage
– Highly-available, scale-out NAS
– Alternative to SWIFT
OpenStack Imaging Services
Unified File &
Object Storage
…Compute
API Layer
Mobile Apps. Web Clients. Enterprise Software Ecosystem
OpenStack Prior to Gluster
OpenStack with Gluster
A Better Way To Do Storage 21
The Gluster Connector for OpenStack – July 27, 2011
Connector enables GlusterFS to be chosen as the filesystem
– Provides:
• Unified File and Object storage
• Highly scalable NAS
• High Availability – synchronous and asynchronous replication
• Preferred, scalable alternative to SWIFT
• Virtual motion of virtual machines (a.k.a. vmotion)
GlusterFS
Server(CPU/Mem)
Hypervisor
VM
GlusterFS
Server(CPU/Mem)
Hypervisor
VM VM VMVM
Virtual storage pool
VM VM VM
A Better Way To Do Storage 22
Pandora Internet Radio
Problem• Explosive user & title growth
• As many as 12 file formats for each song
• „Hot‟ content and long tail
Solution• Three data centers, each with a six-node
GlusterFS cluster
• Replication for high availability
• 250+ TB total capacity
Benefits• Easily scale capacity
• Centralized management; one administrator
to manage day-to-day operations
• No changes to application
• Higher reliability
• 1.2 PB of audio served
per week
• 13 million files
• Over 50 GB/sec peak
traffic
A Better Way To Do Storage 23
Brightcove
Problem• Cloud-based online video platform
• Explosive customer & title growth
• Massive video in multiple locations
• Costs rising, esp. with HD formats
Solution• Complete scale-out based on commodity
DAS/JBOD
• Replication for high availability
• 1PB total capacity
Benefits• Easily scale capacity
• Centralized management; one administrator
to manage day-to-day operations
• Higher reliability
• Path to multi-site
• Over 1 PB currently in
Gluster
• Separate 4 PB project
in the works
A Better Way To Do Storage 24
Cincinnati Bell Technology Solutions
Problem• Host a dedicated enterprise cloud solution
• Large scale VMware environment
• Need high availability
Solution• Gluster for VM storage, NFS to clients
• SAS drives on back-end
• Replication for high availability
Benefits• Storage provisioning from 6 wks to 15 min.
• Vendor agnostic storage
• Low cost of service delivery
• Elastic growth
• Large scale VM
storage
• Low cost service
delivery for enterprise
customer
• Drastic reduction in
provisioning time
A Better Way To Do Storage 25
Problem• Capacity growth from 144TB to 1+PB
• Multiple distributed users/departments
• Multi OS access - Windows, Linux and Unix
Solution• GlusterFS Cluster
• Solaris/ZFS/x4500 w/ InfiniBand
• Native CIFS/ NFS access
Benefits• Capacity on demand / pay as you grow
• Centralized management
• Higher reliability
• OPEX decreased by 10X
Partners Healthcare
• Over 500 TB
• 9 Sun “Thumper”
systems in cluster
Private Cloud: Centralized Storage as a Service
A Better Way To Do Storage 26
4 Supported Ways to Consume GlusterFS
Virtual Machines– GlusterFS deployable on the leading virtual machines
Amazon Web Services (AWS)– GlusterFS deployed within Amazon Machine Image (AMI)
RightScale Cloud Management – GlusterFS is available within a RightScale ServerTemplate
– Deployable via the RightScale Cloud Management Dashboard
Storage software appliance– Deployable on bare metal and supports any hardware on the Red Hat Hardware
Compatibility List (HCL) of certified servers and storage
A Better Way To Do Storage 27
Many Enterprises Rely on Gluster Now
A Better Way To Do Storage 28
Summary
GlusterFS – A scale-out file system– NAS
– Object
Flexibility, scalability, superior economics
OpenStack cloud – Unified file and object storage
– Virtual machine (VM) virtual motion
Innovative architecture provides a better way to do
storage
A Better Way To Do Storage 29
Your turn - ask our experts
Questions and Answers
Try Gluster for free here: http://www.gluster.com/trybuy/
Additional resources here: http://www.gluster.com/products/resources/
Join the community: http://www.gluster.org/
Follow on twitter: @gluster.
Read our blog: http://blog.gluster.com/
Contact us at: [email protected] or 1-800-805-5215