Storage Services provided by the Cloud

ProvidersAbu Sufian

Main AWS services Elastic Compute Cloud (EC2) - manages and run the virtual instance Simple Storage Services (S3) - Data Storing

5 main components of Eucalyptus

Cluster Controller (CLC) Cloud Controller (CC) Node Controller (NC) Walrus (W) - Manage the access to storage services Storage Controller (SC) - implements the amazon S3 interface

Amazon Simple Storage Service (Amazon S3)

• Storage for the internet• AWS Management Console - simple web interface• Scalable - pay only for the storage you actually use.• Range of storage classes - frequently accessed data - infrequent Access data - long-term archive•Offers configurable lifecycle policies

Object Storage• Can store unlimited object in bucket.•Object retrieved via a unique, developer-assigned key.•Object can be accessed from anywhere in the bucket’s location. • Secures data from unauthorized access.

2 OpenStack Storage Services

Object Storage (Swift) - Stores and retrieves arbitrary unstructured data objects via a RESTful, HTTP based API. - It is highly fault tolerant with its data replication and scale-out architecture.

Block Storage (Cinder) - Provides persistent block storage to running instances.

Object Storage What use-cases is Object Storage good for?

o Unstructured data /flat structureo powerful and customizable e.g. no limit on the type or amount of metadatao Media (images, music, video)o Web Contento Documentso Backups/Archiveso Archival and storage of structured

and semi-structured datao Databaseso Sensor datao Log files

What use-cases is Object Storage not suited for?

o Relational Databaseso Data requiring

random access/updates within objects

Object storage Advantages• Scalable capacity (many PB

easily)• Scalable performance

(environment-level performance scales in a linear manner)• Durable• Low cost• Simplified management

• Single Access Point• No volumes to manage/resize/etc.

Disadvantages• No random access to files• POSIX utilities do not work

directly with object-storage (it is not a filesystem)• Integration may require

modification of application and workflow logic• Typically, lower performance on

a per-object basis than block storage

Benefits [Object Storage] For Application Developers• Data stored and served directly over HTTP• Access to storage in minutes, not days• One multi-tenant storage system for all your apps• Focus on app development, not infrastructure plumbing• Rich ecosystem of tools and libraries

For IT Operations Teams• Use low-cost, industry-standard servers and drives• Manage more data and use cases with ease• Enable new applications quickly• Highly durable architecture with no single-point of failure• No vendor lock-in

Features of Block Storage1. Usable for almost any kind of application, including file storage, database storage, virtual

machine file system2. This is useful for applications with heavy random I/O, and/or applications where only small

portions of data are required.3. Block Storage is persistent storage organized into unstructured "blocks", each the same

length4. An ordinary disk drive, RAID array, or USB storage key are examples of locally attached

"block storage".5. Block storage can be either "locally attached", or it can be "network" attached, in a SAN,

speaking a network protocols such as iSCSI.6. Block storage, files are split into evenly sized blocks of data, each with its own address but

with no additional information (metadata) to provide more context for what that block of data is.

7. Block storage can be directly accessed by the operating system as a mounted drive volume8. In a nutshell, key phrases associated with block storage are granularity, great performance,

little or no metadata, and local use.

Use Case for Block Storage• Block storage is ideal for databases, since a DB requires

consistent I/O performance and low-latency connectivity.• You can use block storage for RAID Volumes, where you

combine multiple disks organized through stripping or mirroring.• Any application which requires service side processing,

like Java, PHP, and .Net will require block storage.• Running mission-critical applications like Oracle, SAP,

Microsoft Exchange, and Microsoft SharePoint.

THANK YOU