Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

29
Copyright © 2010 Hitachi Data Systems. All rights reserved. November 2010 Storage Trends and Directions Hubert Yoshida Vice President and Chief Technology Officer Hitachi Data Systems

description

 

Transcript of Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Page 1: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Copyright © 2010 Hitachi Data Systems. All rights reserved.

November 2010

Storage Trends and Directions

Hubert Yoshida

Vice President and Chief Technology Officer

Hitachi Data Systems

Page 2: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Agenda

Signs of a Coming train wreck

Major new trends that impact the Data Center

Requirement for scale up and scale out storage

Dynamic Tiering

Media trends

Summary

Page 3: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Gartner – Signs of A Coming IT Train wreck

Aging IT systems and infrastructures

– Creating an increasing burden to maintain

– Switching to new systems and infrastructure

becomes more disruptive and resource intensive.

Information becomes increasingly difficult

to access and analyze

– Business is forced to work without the

information it needs to make decisions.“

New interfaces drive up transaction loads and require legacy

storage systems to scale up

– Storage systems are long term investments and changes are

increasingly painful and expensive

Compliance and regulatory pressures puts businesses with

legacy systems at risk

Power, cooling, and floor space limitations demand change

Page 4: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

$0

$50

$100

$150

$200

$250

$300

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Installed Base

(M Units)

Spending

(US$B)

New Hardware spending

Hardware spending has remained flat while overall costs continue to increase

HW mgmt. and admin costs x4

Power and cooling costs x8

0

5

10

15

20

25

30

35

40

45

50

Better

Utilization:

Reduces

Capital Costs

Better

Management:

Reduces

Operational

Costs

Trend Number 1: IT Spend Is Changing

Page 5: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

$0

$50

$100

$150

$200

$250

$300

Spending

(US$B)

New Hardware spending

HW mgmt. and admin costs

Power and cooling costs

0

5

10

15

20

25

30

35

40

45

50

Capital

Costs

Operational

costs

A Sustainable Future Requires Virtualization

Sustainable IT Requires Continuous

Reduction in Operational costs

Costs

Technologies that address operational costs: Virtualization, dynamic or

thin provisioning, archive

Page 6: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Trend Number 2: Exploding Data Growth

Compounded Annual Growth Rate of 66%

32.3%

63.7%

(Exabytes)

121.1%

43.9%

Source: IDC 2008

Understanding the types of data

will help to address costs

Page 7: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Trend Number 2: Exploding Data Growth

Compounded Annual Growth Rate of 66%

32.3% Structured

(Exabytes)

121.1% Content

43.9% Replicas

Source: IDC 2008

Understanding the types of data

will help to address costs

63.7% Unstructured

Page 8: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Application Growth is Exploding

Applications will need to offload more

work to storage systems

They will be motivated by the need to

scale

– Millions of users and exabytes of data

– Must provision new applications immediately

Examples of Application offloads

– Content Management systems offloading

data to storage systems for ingestion and

preservation

– Exchange 2010 eliminates backup by

duplicating data bases and archiving

– Symantec provides information to storage to

recover deleted files.

– VMware provides VAAI to format VMDK,

Clone vMotion VMDK, and eliminate SCSI

Reserve Bottleneck

Mobile Cloud Applications

Page 9: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Storage Can Relieve Application Bottlenecks

VMware must issue a SCSI

Reserve when one VM does an

update to VMFS.

– All other VM’s are locked out

– Affect s New VM Creation,

vMotion, Snapshots, Thin

Provisioning., Powering on VM

VAAI Atomic Test and Set

enables Storage to lock at Logical

Block Number

– Frees up other VMs to access

VMFS

– Can increase consolidation of VM

by 25% to 35%

Page 10: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Trend Number 3: A Perfect Storm In Compute

Processor technology is scaling up

– New Intel Architecture

• Multi-core – Dual, Quad,16 way

• SMT – Simultaneous Multi Thread

• L1, L2, L3 cache

Virtual Servers and hypervisors

– Multiple Virtual Machines per physical server

– Multiple VM I/O streams per physical server

• Increasing I/O load

• Increasing randomness of I/O

Network bandwidth is increasing

– FC 4Gbs going to 8Gbs to 16 Gbs

– FCoE 10Gbs to 40Gbs to 100Gbs

• Scale-up Storage is required to support virtual servers and networks

Page 11: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Loosely Coupling of Storage is Not the Answer!

Switch

Port Port

Cache

Port Port

Cache

Port Port

Cache

Port Port

Cache

This approach requires a rip and replace

of existing infrastructure

Page 12: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Transition To Virtual Servers for Production

Customer

Requirement

Integrated Storage

Virtualization

Integrated

Management

Courtesy of 451 Group

Page 13: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Scale up to meet increasing server demands

Port Port

RAID RAID

Cache

Port Port

RAID RAID

Cache

Port Port

RAID RAID

Cache

Port Port

RAID RAID

Cache

3D Scaling: Scale Up with Tight Coupling

Cache Cache Cache

Page 14: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

3D Scaling: Scale Out with Safe Multi-tenancy

Port

RAID RAID

Cache

Port Port

RAID RAID

Cache

Port

Cache

Port

RAID RAID

Cache

Port

Cache

Port

RAID RAID

Cache

Port

Scale out to meet distributed server demand

with load balancing and safe multi-tenancy

Page 15: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

3D Scaling: Scale Deep with External Virtualization

Servers are connected to storage silos

Storage resources can not be shared

Page 16: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

3D Scaling: Scale Deep with External Virtualization

A virtualization storage controller can create a common

Pool of shared storage resources

Page 17: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

3D Scaling: Scale Deep with External Virtualization

Virtualize external storage for data mobility

and storage migration

Page 18: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Virtualized vs Non-Virtualized Storage Services

Virtualized Storage Services Non-Virtualized Storage services

NAS CAS VTLVirtual

Servers

Physical

Servers

NASCAS

VTL

Enterprise

Midrange

Cloud

Page 19: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Virtualize Devices into a pool of

capacity and allocate by pages

Dynamically provision new servers

in seconds

Eliminate allocated but unused

waste by allocating only the pages

that are used

Extend Dynamic Provisioning to

external virtualized storage

Convert Fat volumes into thin

volumes by moving then into the

pool

Optimize Storage performance by

spreading the I/O across more

arms

LDEVLDEVLDEVLDEVLDEVLDEVLDEVLDEV

HDP Pool

HDP Volume

(Virtual LUN)

LDEVs

Dynamic Provisioning

Page 20: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Today: Automated Tiering of Storage Volumes

Tier 0

Tier 1

Tier 2

Multiple storage tiers in

separate pools

SSD, SAS, SATA

We assign volume to tiers

of storage based on data

classification

Use virtualization to move

volumes without disruption

Automated with policy

based management

But moving large volumes

is a heavy task

Page 21: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

SAS

SATA

EFD/Flash

Introducing Dynamic Tiering at the Page Level

TIER 1

TIER 2

TIER 0

POOL A

Last Referenced

Last Referenced

One pool of 42 MB pages

now spans multiple tiers of

storage

Volume Data is written to the

highest performance tier first

Less active volume pages

migrate to lower tiers

Pages can be promoted

Volumes no longer have to

be moved to optimize

performance

Volumes will be able to span

across tiers on external

storage

Page 22: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Cost Comparison of 36 TB Single Tier Vs Multi-Tier

Drive Type Qty Total

Cost

%

Capacity

Rack

cost

HDT

Cost

Total

cost

IOPs

300 GB

HDD

120 $145,000 100% $75,000 0 $220,000 36,000

Drive Type Qty Total

Cost

%

Capacity

Rack

cost

HDT

Cost

Total

cost

IOPs

200 GB

SSD/SAS

4 $40,000 2% $28,000 $75,000 $183,000 158.000

300 GB

HDD/SAS

10 $12,000 8%

1 TB HDD

SATA

32 $28,000 90%

Single Tier HDD

Multi-Tier SSD/SAS/SATA

Page 23: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Comparison Between FC Loops and SAS

– 4 FC Loops per controller

• Half duplex arbitrated loops

• 8 FC Loops @ 2 Gb/s

– Drawers are added to the loop

• FC and SATA drawers are separate

– 4 SAS wide cables per Controller

• 4 full duplex links per cable

• 32 SAS Links @ 3 Gb/s

– Drawers are connected point-point

• SAS and SATA can be intermixed

SATA Loop

FC Loop

Page 24: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Technology Transition Roadmap

Time

Are

al

Den

sit

y

Longitudinal

Recording

100-130

500-800

1,000-3,000

2,000-15,000

Perpendicular Recording

Patterned Media (PM)

Thermally Assisted Recording (TAR)

2006 2010 2014

50 Years

>50 Million increase in areal density

10,000 Gb/in2 = 10 Tb/in2

50 TB 3.5-inch drive

12 TB 2.5-inch drive

1 TB 1-inch drive

New Technologies will increase Densities

Will Prices decline at the same rate?

Page 25: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

Denser Packaging

13U

Standard 19” rack

• Front to back cooling

• Up to 6 racks

Dense packaging

• 13u x 19 inch

• 80 x 3.5in drives

• 128 x 2.5in drives

• SSD, SAS and SATA

Power and cooling

• 40% less power than

equivalent capacity Universal

Storage Platform® V

Page 26: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

28

Data Centres Will Need to Provide More Scale While Also Addressing:

Capital

Costs

Administrative Burdens

Availability

Power & Cooling

Courtesy of IDC 2010

Page 27: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

29

Technologies That Can Help

II: Intelligent Storage Tiers

Automated data

movement

between tiers of

storage

III: Outsourcing

Cloud

SaaS

IV: Resource Pooling

I: Storage Optimization

Dynamic

Provisioning

Thin Provisioning

Wide Striping

Storage Virtualization

Scale up, out, and

deep

D.C. DensityCourtesy of IDC 2010

Page 28: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)

• Sustainable IT costs requires

virtualization to contain

operational cost

• Sustainable IT costs can be

achieved through

– Server Virtualization for server

consolidation

– Storage and File Virtualization

for data mobility, consolidation,

migration, tiered storage

– Capacity virtualization for

dynamic provisioning,

automated performance, and

increased utilization

Summary

$0

$50

$100

$150

$200

$250

$300

$0

$50

$100

$150

$200

$250

$300

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 20101996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Installed Base

(M Units)

New Hardware spendingNew Hardware spending

Worldwide IT Spending on Hardware, Power and

Cooling, and Management/Administration

HW mgmt. and admin costsHW mgmt. and admin costsHW mgmt. and admin costs

Power and cooling costsPower and cooling costsPower and cooling costsPower and cooling costs

0

5

10

15

20

25

30

35

40

45

50

IDC 2008

Vernon Turner

Page 29: Hu Yoshida - Storage Trends and Directions (Storage Expo 2010)