Atmos Cloud -levytilaa pilvipalveluna, Antti Mäkinen

1 © Copyright 2010 EMC Corporation. All rights reserved.

EMC ATMOS Storage Cloud today


EMC Atmos Products Deliver a Solution •  Eliminate file system limitations on namespace, size,

location

•  Make data globally available for custom or packaged applications

•  Manage 10-times more scale in less time with policy-based automation

•  Elastically deploy and manage multiple sites as one system

•  Quickly offer self-service storage to better support developers

•  Understand and reduce costs with utilization tracking


What is EMC Atmos?

SITE #1 Los Angeles

SITE #2 New York

SITE #3 London

Automated location, protection, and efficiency services

Multi-tenancy securely isolates data

No limits on namespace or location

Custom or Packaged Applications

REST, SOAP, or file services access

Available on purpose-built appliances or virtualized software Single GUI Self-Service Experience


Atmos and Atmos Cloud Delivery Platform Provide a Complete Storage Service Solution

Traditional or web scale access/management �  Web (REST/SOAP) and file services (IFS/NFS/CIFS)

�  Unlimited namespace with rich metadata

�  Multi-tenant secure isolation and metering

Operational efficiency �  Data replication, erasure coding, compression,

deduplication, Spin Down by policy

�  Advanced options for network management

Elasticity and massive scalability �  Management across sites with minimal overhead

�  Exabyte-scale, scale-out object storage available as an appliance or virtualized software

Self-service storage �  Metering for billing/chargeback; turnkey portal

Billions of objects, exabytes of capacity, multiple sites

Namespace/Multi-tenancy/ Policies/Data Services

Web Service APIs File Services

Metering Module Portal

Atmos Cloud Delivery Platform

Atmos Software

Atmos Hardware Atmos Virtual Edition

Industry-standard servers/storage

VMware vSphere and VMware-supported

servers/storage


Atmos Makes Content a Tier 1 Application Content-rich web applications

• Solves global scale and access challenges

• Reduces management, improves recovery

• Application integration in days

AT&T

Hill Air Force Base

Global Financial Services Firm

Global Pharmaceutical Firm

Infrastructure as a service • Turnkey self-service storage capabilities

• Natively isolates tenants for security and metering

• Competitive cost of service

Archiving to the cloud • Supports multiple archives/applications with multi-tenancy

• Natively provides disaster protection

• Extends to Atmos-powered clouds


Atmos Supports Custom and Packaged Apps Custom applications Packaged applications

File/block on-ramps

EMC Atmos

WAN or LAN access with lightweight Atmos REST API No limits on namespace or location

Multi-tenancy and automated management

Enables ISVs to deliver and deploy cloud-based solutions to customers with minimal infrastructure and engineering investment

File Management Appliance

E-commerce

Business collaterals

3D imaging

Medical imaging

Atmos NFS/CIFS/IFS


C A S E S T U D Y

§ Vistaprint —$500M global marketing company § Critical web application for online document creation

§ Three sites globally—Canada, U.S., EMEA

Content-Rich Web Application Challenge

• Global distribution (Canada, U.S., EMEA)

•  Increasing mix of digital media (photos)

Solution • Deploy Atmos in three sites

• Set different policies to enable different cost and margins for different types of customers:

–  isPaid N—two local replicas, no asynchronous remote –  isPaid Y—two local replicas, one asynchronous remote –  Intelligently send content to printing facilities

• Create another tenant to use Atmos as a backup target through CIFS

Benefits • Saved ~$1.4 million storage/$300,000 bandwidth

• 100% availability, meets or exceeds application latency requirements

U.S.

Canada

EMEA

Customer-Facing Web Application

Backup Application

Atmos Web Service Interfaces + Metadata

Atmos Policy “isPaid N” Atmos Policy “isPaid Y”

CIFS


C A S E S T U D Y

Infrastructure-as-a-Service Challenge

• Delivering disruptive technology as a service

Solution • Deploy Atmos in multiple datacenters

• Set policies for different levels of service

• Integrate enablement technologies –  Self-service portal –  Reporting –  Metering (Atmos Cloud Delivery Platform)

• Align with Atmos trusted ISV solutions

Benefits • New business model, self-service storage to

market in 90 days

Cloud Storage Service Portal

Atmos REST + Metadata

Atmos Policy 2 Atmos Policy 1

Atmos Site 1 Atmos Site 2

Reporting/Metering/Billing/Chargeback

§ AT&T—$100B telecommunications company § Enterprise-class hosting services and

management capabilities

§ Multiple datacenters across the globe


C A S E S T U D Y

Archiving Content to the Cloud Challenge

• Tier 1 NAS capacity reached

• Blocked by typical file system capacity limits

Solution • Deploy Atmos to support Tier 1 NAS and File

Management Appliance

• Extend Atmos to serve the archive as a new tenant—no application rewrites, no new cost

• Set policy for two synch copies on one Atmos frame and one synch copy on the other

Benefits • “Limitless” storage repository

• Multi-tenant flexibility for other uses

• Future extension to Atmos-powered external cloud service

Atmos

Internal Custom R&D Applications

File Management Appliance Policies

Atmos REST + Metadata

12TB

16TB NFS

File Management

Appliance

Celerra NSX

Celerra NFS Interface

§ $20B pharmaceutical company § Homegrown R&D applications generating

overwhelming volume of unstructured content


Atmos In The Field: Real Benefits Traditional Storage Atmos

Tens of terabytes in one namespace Several petabyte-scale systems in production

Millions of files 700 million objects in production in a single system

IOPs-oriented 9,000 objects served per second

Difficult to support multiple sites or business models

Many multi-site systems in production; millions of dollars saved with intelligent data management

Access to storage takes one month with a ticketing system and standard process

Access to storage takes minutes with a self-service process

Self-service takes months of development and deployment

Self-service production deployment in less than 90 days


Atmos-Powered Service Providers

Technology Partners

Atmos Architecture

ISV Solutions

Intel VMware RSA

Web Services

Policy Based

Global Scale

Deployment Models

File Archiving

Backup to the Cloud Database Archiving Collaboration

Content Delivery ILM

Content Management

Medical Imaging

Atmos

Atmos Virtual Edition

Atmos Developers

Building the Most Comprehensive Cloud

Unisys CBICI

Hosted Solutions

And growing…

AT&T

PEER 1

Dell .NET

PHP Java

C FX

Deploy Self-Service Storage

Atmos Cloud Delivery Platform


Hard

war

e So

ftw

are

Atmos Architecture and Topology Ap

ps/B

indi

ngs/

OS

Acce

ss

Atmos-Powered Cloud Service

Atmos Object API

Policy Engine

File Share

File Share

File Management

Appliance Archive

NetWorker Backup

Web Application

Los Angeles

Data Services

New York

Web Services File System

REST NFS

London

REST REST

TCP/IP TCP/IP TCP/IP

CIFS REST SOAP CIFS NFS IFS

Tenant 3

Tenant 1 Tenant 2

Federated Copy

.NET

PHP

Java

FX

Windows Mac

Linux

C


Applications trigger policy with metadata: “Status = inprogress”

Atmos Adaptively Automates Management Increasing operational efficiency: Accounts Payable example

Longtail Retention Status = complete

Active Workflow Status = inprogress

Business determines business objectives and value of data

Policies drive actions at the object level: Where to store information (location)

What data services to apply (Spin Down, compression, deduplication, striping) What protection techniques to use (Atmos GeoProtect)

Two synch copies, striped

Los Angeles

One asynch copy

New York

One asynch copy

London

One erasure-coded copy, spun down,

deduplicated New York

One erasure-coded copy, spun down,

deduplicated London


EMC Atmos GeoProtect Managing storage at global scale •  Optimize your performance, protection, and cost by object

•  Two policy-based techniques to choose from

•  Leverage both to support flexible business models

Synchronous or asynchronous copies

distributed across locations

Replication

Multiple encoded fragments distributed across components

for increased content durability

Erasure coding


Additional Data Services •  Compression

–  Reduction of physical space required for object storage

•  Deduplication –  Reduction of replicated identical objects

•  Spin Down –  Power-efficient method for long-term storage

•  Striping –  Data striping within nodes or across nodes for higher

throughput

•  Auto-configuration and auto-healing –  Install once—new capacity is automatically added

Object-level data services

Node-level data services

System-level auto-configuration

services


Atmos Enables Grouping and Chargeback Multi-tenancy enables:

•  Isolation of groups of users (tenants) and their data for security and utilization tracking

•  Isolation of administration

•  Optimization of policies for tenant data

•  Continued sharing of total available capacity—independent of location—for maximum utilization

NODE 5

NODE 6

NODE 7

NODE 8

CIFS Subtenant

User n User 2

NFS Subtenant

User n User 1

Atmos in Boston

NODE 1

NODE 2

NODE 3

NODE 4

NODE 5

NODE 6

NODE 7

NODE 8

Atmos in London

Tenant A: R&D Tenant B: Human Resources

Shared Atmos Capacity and Data Services

REST Subtenant

App n App 4

REST Subtenant

App n App 3

IP address: Tenant B IP address: Tenant A

NODE 1

NODE 2

NODE 3

NODE 4


Atmos Cloud Delivery Platform Radically Accelerates IT Process

IT Provider Application Developer

Sign up

Get storage

Create groups

Track utilization

Application developers/applications: • Access to storage in minutes instead of months

• Access to metadata for tagging, indexing, etc.

• Never worry about “free space” or storage again

•  Focus on development instead of IT process

IT providers: • Reduce management complexity

• Reduce bottlenecks and improve customer satisfaction

• Drive chargeback based on actual storage consumption

•  Focus on strategic projects, not mundane chores

Atmos Storage Atmos Cloud Delivery Platform


Multiple sites, multiple petabytes, managed as one system

Unified System Management •  Manage at petabyte scale

across sites as one system –  Manage by browser-based GUI

or programmable API –  Access through any Atmos

server in the cloud

•  Levels of administration with different privileges

–  SSL support encrypts access –  Integrates with customer LDAP

Los Angeles New York London

REST Management

API

Browser-Based Management GUI


Atmos Deployment Models

�  1:15 servers-to-disks �  Up to 480 TB per rack

�  1:15 servers-to-disks �  60 TB cloud entry point �  Up to 240 TB per rack

�  1:60 servers-to-disks �  Up to 720 TB per rack

WS2-240

Dense Compute

WS2-120

Small/Medium Compute

WS2-360

Capacity

VMware vSphere

NFS/FC/iSCSI Storage

Atmos Virtual Edition

Flexibility

Intel Xeon 5500 “Nehalem” Micro architecture

2 TB low-power SATA drives (lower power per BTU at two-times capacity)

Purpose-built hardware �  Standard components—factory configured, racked, and cabled �  Flexible, cost-effective service model/user-serviceable

�  Optional high availability and redundancy; 30 drives per 3U drawer

Software on VMware �  Certified with EMC Unified

Storage (NFS, FC, iSCSI); VMware-supported servers and third-party storage

�  Starts at 10 TB �  Up to 960 TB per site

Atmos Cloud -levytilaa pilvipalveluna, Antti Mäkinen

Technology

Transcript of Atmos Cloud -levytilaa pilvipalveluna, Antti Mäkinen