Transform Your Business with Big Data Storage

1 © Copyright 2013 EMC Corporation. All rights reserved.

EMC ISILON SCALE-OUT NAS Transform Your Business with Big Data Storage


Isilon Technology

Summary

Isilon Overview

Big Data in the Enterprise


What Is Big Data?

Data that challenges the capabilities of a system to capture, manage, and process it within an acceptable elapsed time

~ Wikipedia ~


0

10

20

30

40

50

60

70

80

90

2009 2010 2011 2012 2013 2014

Exabyte

s

The Big Data Challenge

By 2013, 80% of all storage capacity sold will be for file-based data Source: “Scale Out Storage in the Content Driven Enterprise: Unleashing the Value of Information Assets,” IDC White Paper (2010 Enterprise Disk Storage Consumption Model), June 2011

File based: 61.8% CAGR Block based: 23.7% CAGR

Media & Entertainment

Design & Simulation

Financial Services

Bioinformatics Oil & Gas File Shares &

Archives


Data growth

47%

CIOs Turning to Scale-Out to Deal with Massive File-Data Growth

Already using or planning to

use scale-out within the next 24 months

The#1 and#2 concerns of CIOs…

Source: Scale-out NAS Market Survey

System performance and scalability

37%

…are driving adoption of scale-out

Source: “User Survey Analysis: Key Trends Shaping the Future of Data Center Infrastructure Through 2011,” Gartner, October 2010


Isilon Technology

Summary

Isilon Overview



EMC Isilon Setting the standard for scale-out NAS

• Broad adoption across many markets

– High Performance Computing (HPC): Life Sciences, Oil & Gas,

Electronic Design Automation, Media & Entertainment, Financial Services

– Enterprise IT: Archive, File Shares, Home Directories, Hadoop Data

Analytics, Video Surveillance, Virtualization

• Over 3,000 global customers

– 60% Y/Y growth rate

• Isilon OneFS: Seventh generation, industry-proven, innovative

scale-out operating environment


Single storage pool for application consolidation

Isilon Scale-Out Innovation

Simple to scale – Manage 20 PB like a 1 TB drive

Predictable performance – Grows linearly

Efficient to operate – Maximize utilization to 80%+

– Automate tiering

Highly resilient – Survives multiple failures

Enterprise proven – Management and protection

tools that customers expect

No data migrations


The Cost Advantage of Isilon Ease of use and management simplicity

IDC: Isilon improves IT productivity by 48%, reduces OPEX*

Storage allocation

Storage provisioning

Managing capacity

Managing backup

Space reclamation

Adding new applications

Uploading of re-loading data

0.0 0.5 1.0 1.5 2.0

FTE H

ours

per

TB in U

se

Isilon Traditional

* Source: “Quantifying the Business Benefits of Scale-Out NAS Solutions,” IDC White Paper, November 2011


Reduces Big Data storage costs by 40%

The Cost Advantage of Isilon

$0

$500

$1,000

$1,500

$2,000

$2,500

Traditional Isilon

Average Annual Cost Per TB in Use

OPEX IT Staff CAPEX

Source: “Quantifying the Business Benefits of Scale-Out NAS Solutions,” IDC White Paper, November 2011


Big Data Apps Need Big Data Storage Data intensive, HPC workflows

Medical Imaging Gene Sequencing Seismic Exploration

Media & Entertainment Product Development Satellite Images


Enterprise IT workload examples

Enterprise IT Needs Big Data Storage

• Archives / Data Repositories

• File Shares & Home Directories

• Hadoop Data Analytics

• Online Filing Sharing using On-Premise Storage

• Video Surveillance Data Storage

• Large-Scale Virtualization


EMC Extends Choice & Flexibility for Online File Sharing with: • Isilon On-Premise Storage • Syncplicity Sync and Share

Enterprise Grade Single Vendor Solution

Cloud-based online file sharing with on-premise storage

designed to meet the needs of business users and IT

All EMC end-to-end infrastructure for one-stop product, install, config and

24x7 support


EMC Online File Sharing with Isilon On-Premise Storage Strong IT Control

Files Controlled by IT

On-Premise Storage

IT Control

Cloud-based solution with files stored in on-premise cloud

Full policy control over storage layer

Meets compliance and governance requirements


Isilon Technology

Summary

Isilon Overview



Isilon Scale-Out NAS Architecture

OneFS Operating Environment

Intra-cluster Communication Layer

Servers

Client/Application Layer Ethernet Layer

Servers

Servers

Sin

gle

FS/V

olu

me CIFS NFS

FTP HTTP

HDFS for

Hadoop


Isilon Core Innovation OneFS scale-out operating system

Single File System Simplicity

Leadership Efficiency

High Performance

Easy Growth

Automated Tiering

Linear Scalability


Isilon Scale-out NAS product family

Linear Scaling of Performance and Capacity

Purpose-built for IOPS-intensive, random access,

file-based applications

Flexible solution for high concurrent and sequential throughput applications

Ideal for cost-effective, large-capacity storage

S-Series

X-Series

NL-Series


Comprehensive Enterprise Software

SnapshotIQ Fast, efficient data backup and recovery

SyncIQ Fast and flexible asynchronous replication for disaster recovery protection

SmartConnect Policy-based client failover with load balancing

SmartLock Policy-based WORM data protection

SmartPools Policy-based automated tiering

SmartQuotas Quota management and thin provisioning

InsightIQ Performance monitoring and reporting to manage storage resources

Isilon for vCenter VMware integrated management features

DATA PROTECTION DATA MANAGEMENT


Isilon Simplicity and Ease of Use

Single volume spans all nodes

– Directories and files striped across the cluster

Automation:

– NO manual intervention

– NO reconfiguration

– NO server or client mount point or application changes

– NO data migrations

EFFIC

IEN

CY


More scalable than traditional storage systems

Largest and Most Scalable File System

OneFS scales from 18 TB to 20 PB in a single file system, single volume

Under 60 seconds to scale with no downtime


Gain New Levels of Efficiency

• AutoBalance automatically moves content to new storage nodes while system is online and in production

• Eliminates “hot spots”

• Enables unmatched storage capacity utilization of more than 80%

AutoBalance Automated data balancing across nodes reduces costs, complexity, and risks for scaling storage

EMPTY

EMPTY

EMPTY

EMPTY

EMPTY

FULL

FULL

FULL

FULL

BALANCED

BALANCED

BALANCED

BALANCED

BALANCED

Isilon AutoBalance


Optimize Resources with Automated Tiering

• Single point of management

– Single file system/single volume

– Multiple performance tiers

• Automatic data movement

– Policy-based tiering management

– Transparent reallocation

– NO application changes

• Optimize storage resources

– Automatically match storage resources with data requirements

– Eliminate data migration

Isilon SmartPools

S-Series Performance

NL-Series Active archives

X-Series Collaboration

Reduced c

ost/T

B

Files


SPECsfs2008 CIFS: aggregate vendor performance

World’s Fastest NAS

ISILON RECORD-BREAKING P E R F O R M A N C E

Huaw

ei

Sym

ante

c

EM

C

EM

C

EM

C

NetA

pp

NetA

pp

NetA

pp

NetA

pp

Apple

Silic

on

Gra

phic

s

Apple

Fujits

u

Apple

Fujits

u

Sie

mens

Fujits

u

Fujits

u

Sie

mens

Fujits

u

Sie

mens

Fujits

u

Sie

mens

NSPLab

Fujits

u

1,600,000

1,500,000

1,400,000

1,300,000

1,200,000

1,100,000

1,000,000

900,000

800,000

700,000

600,000

500,000

400,000

200,000

300,000

100,000

EM

C I

silo

n

CIFS

IO

PS

World Record 1.6 million CIFS OPS

126% increase over competition

Source: “All SPEC SPECsfs2008_cifs Results Published by SPEC,” October 3, 2012 (http://www.spec.org/sfs2008/results/sfs2008cifs.html)

http://www.spec.org/sfs2008/results/sfs2008cifs.html


Linear, Predictable Scalability

SPECsfs2008 performance test results

Predictable SLAs

7 14 28 56 140

1,800,000

1,600,000

1,400,000

1,200,000

1,000,000

800,000

600,000

400,000

200,000

Fil

e O

ps/

seco

nd

CIFS NFS


With N+2, N+3, and N+4 protection, data is 100% available if multiple drives or nodes fail

With N+1 protection,

data is 100% available even if a single drive or node fails

Highly resilient, clustered architecture

Unmatched Data Protection and Availability

100%

100%

100%

100%

100%

100%

100%

100%

FAILED

FAILED

And with Isilon, the more nodes in the cluster, the faster drive rebuild time


Enterprise Data Protection Options

• Isilon SyncIQ benefits

– Disaster recovery

– Business continuance

– Disk-to-disk backup

– Remote archive

– Push-button simple failover/failback

• Block efficient, file specific

• Leverages Isilon SnapshotIQ

– Per-directory policies and granularity

– Unlimited snapshots per cluster

– Minimal performance impact

– Allows tiered snapshots

SyncIQ Replication Architecture

Isilon NL-Series Cluster

Isilon S-Series and X-Series Cluster

Fast, easy backup and recovery and disaster recovery


Robust Enterprise Security Options

Secure Role Separation

– Roles-based administration

– Administration and data access separated

Secure WORM Data Protection

– Isilon SmartLock

– SEC 17a-4 Compliance option

Secure Isolation

– Authentication Zones


Interoperability for Operational Flexibility Platform REST API

– Simplify management and integration

– Third-party application integration

VMware integration

– VAAI: vStorage APIs for array integration

– VASA: vSphere APIs for storage awareness

– Virtual Server writeable clones

Multi-protocol support

– Integrated support for industry-standard protocols

– Native HDFS support


Industry’s First and Only Scale-Out Storage Solution With Native Hadoop Integration

Accelerate the benefits of Hadoop for the enterprise – Proven Hadoop solution, faster implementation

– Greater interoperability with enterprise applications and Hadoop analytics through multi-protocol parallel access from any client

Reduce risk – Eliminates Hadoop NameNode single point of failure

Enterprise data protection – Fast snapshots, backup, and recovery

– Simple, reliable data replication for disaster recovery

Ultimate flexibility – Scale compute and storage resources separately

– Supports physical and virtualized server environments


Technology Challenges of Hadoop

Hadoop DAS Environment 1

Dedicated Storage Infrastructure – One-off for Hadoop only

2 Single Point of Failure

– Namenode

3 Lacking Enterprise Data Protection

– No Snapshots, replication, backup

4 Poor Storage Efficiency

– 3X mirroring

5 Fixed Scalability

– Rigid compute to storage ratio

6 Manual Import/Export

– No protocol support

Name node


Technology Challenges of Hadoop

Hadoop DAS Environment 1

Dedicated Storage Infrastructure – One-off for Hadoop only


– Namenode




– 3X mirroring

5 Fixed Scalability




1x

1x

2x

2x

3x

2x

3x

3x

1x

Namenode


1 Scale-Out Storage Platform

– Multiple applications & workflows

2 No Single Point of Failure

– Distributed Namenode

3 End-to-End Data Protection

– SnapshotIQ, SyncIQ, NDMP Backup

4 Industry-Leading Storage Efficiency

– >80% Storage Utilization

5 Independent Scalability

– Add compute & storage separately

6 Multi-Protocol

– Industry standard protocols

– NFS, CIFS, FTP, HTTP, HDFS

The EMC Isilon Advantage for Hadoop


EMC Addresses the Hadoop Challenge

1 Dedicated Storage Infrastructure

– One-off for Hadoop only


– Namenode




– 3X mirroring

5 Fixed Scalability




1 Scale-Out Storage Platform

– Multiple applications & workflows

2 No Single Point of Failure

– Distributed Namenode

3 End-to-End Data Protection

– SnapshotIQ, SyncIQ, NDMP Backup

4 Industry-Leading Storage Efficiency

– >80% Storage Utilization

5 Independent Scalability

– Add compute & storage separately

6 Multi-Protocol

– Industry standard protocols

– NFS, CIFS, FTP, HTTP, HDFS


Flexible Packaging

Hadoop Software + Storage

Package Pivotal HD software on commodity x86 hardware

Isilon scale-out NAS

Hadoop Appliance + Storage – Q2 2013

Pivotal HD Data Computing Appliance

Isilon scale-out NAS


Isilon Technology

Summary

Isilon Overview



Isilon Scale-Out NAS Value

Scales to 20 PB in a single file system

Single file system, single volume, global namespace

Efficient backup and recovery, reliable disaster recovery, and N+1 thru N+4 redundancy

More than 80% storage utilization, and automated storage tiering

Over 100 GB/s throughput, 1.6M SPECsfs ops

Integrated support for industry-standard protocols including NFS, SMB, HTTP, FTP, and HDFS; platform REST API; VMware integration

Roles-based administration; Authentication Zones; SEC 17a-4 compliant WORM data security


Questions and Answers

To type a question via WebEx, click on the Q&A tab

Please select “Ask: All Panelists”

to ensure your questions reach us. Thank you!


Next Steps and Resources

• Get the IDG Big Data Reports – http://www.emc.com/collateral/white-papers/idg-bigdata-umbrella-wp.pdf – http://www.emc.com/collateral/white-papers/idg-bigdata-storage-wp.pdf – http://www.emc.com/collateral/white-papers/idg-bigdata-analytics-wp.pdf

• Learn more about EMC Isilon Big Data solutions – http://www.emc.com/collateral/software/white-papers/h10528-wp-hadoop-on-isilon.pdf – http://www.emc.com/big-data/index.htm

http://www.emc.com/collateral/white-papers/idg-bigdata-umbrella-wp.pdf











http://www.emc.com/collateral/white-papers/idg-bigdata-storage-wp.pdf










http://www.emc.com/collateral/white-papers/idg-bigdata-analytics-wp.pdf









http://www.emc.com/collateral/software/white-papers/h10528-wp-hadoop-on-isilon.pdf













http://www.emc.com/big-data/index.htm




THANK YOU

Transform Your Business with Big Data Storage

Technology

Transcript of Transform Your Business with Big Data Storage