Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre...

30
Solid State Storage for the Enterprise Woody Hutsell, Texas Memory Systems, Inc.

Transcript of Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre...

Page 1: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

Solid State Storage for the Enterprise

Woody Hutsell, Texas Memory Systems, Inc.

Page 2: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

2Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

SNIA Legal Notice

The material contained in this tutorial is copyrighted by the SNIA. Member companies and individuals may use this material in presentations and literature under the following conditions:

Any slide or slides used must be reproduced without modificationThe SNIA must be acknowledged as source of any material used in the body of any document containing material from these presentations.

This presentation is a project of the SNIA Education Committee.

Page 3: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

3Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Abstract

Solid State Storage for the Enterprise

This presentation will discuss the types of solid state storage systems directed at enterprise. The presentation will look at DDR-RAM and Flash based storage devices and their technical differences. The presentation will discuss the fit of various memory based storage devices with enterprise applications. Discuss the fit of solid state disk in ILM.Learning Objectives

Understand types of solid state storage available for enterprise applications.

Discuss applications for solid state storage in the enterprise.Discuss solid state storage as part of a broader ILM strategy.

Page 4: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

4Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Agenda Topics

What is a Solid State Disk?Flash and DDR Memory CharacteristicsWhy Solid State Disk?SSD Killer ApplicationsSSD and ILM

Page 5: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

5Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

What is a Solid State Disk?

“A solid state drive (SSD) is a semiconductor-based block storage device that behaves as a virtual HDD and appears to the host device as a disk drive.”

IDC, Worldwide Solid State Drive 2007-2011 Forecast and Analysis: Finding Space in the Expanding Digital Universe, Doc # 207739, July 2007.

Page 6: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

6Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

What is a Solid State Disk?

Flash Memory BasedSame class of memory used in consumer electronicsInherently non-volatileBest known for ruggedness and good random read performance.

DDR Memory BasedSame memory used in enterprise serversRequires batteries and backup hard disks for non-volatilityBest known for outstanding performance and high cost.

Cached FlashMix of DDR RAM and NAND Flash.

Page 7: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

7Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Flash Memory Characteristics

Two types of NAND Flash MemorySLC – single layer

100,000 writes per cellPrimarily used in industrial and military applicationsHigher cost1.5 millisecond erase times; 200 microsecond write times; 25 microsecond read timesHighest density – 16Gbit with 32Gbit on the waySLC memory is best suited for the enterprise

MLC – multi layer10,000 writes per cellPrimarily used in consumer electronicsLower costHalf the performance of SLCHighest density – 32Gbit with 64Gbit on the way.

Expect mixed SLC – MLC flash SSDs in the near future.

Page 8: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

8Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

The process to write data to flash follows these steps:

Determine “block” to update. NAND flash is typically divided into 128KB blocks and further subdivided into 2KB pages.Copy data from the existing “block” (if necessary)Erase the “block” and reset cell to all “1’s”Rewrite the “block”, only 0’s can be written to a flash cell.

Flash Memory Characteristics

Page 9: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

9Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

DDR RAM Characteristics

Unlimited writes per cellPrimarily used as computer memoryHigher cost and lower density than NAND flashInherently volatileHighly reliable chip design10-15 nanoseconds read and write timesHighest density 1GbitDDR RAM is well suited for the enterprise.

Page 10: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

10Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

What is a Solid State Disk?

1.8” 2.5” 3.5” JBOD Rack Mount

Flash Flash DDR/Flash DDR/Flash DDR/FlashSATAIDE

SATAIDE

SATASCSIFibre

Channel

SCSIFibre

ChannelSAS

SCSI Fibre

ChannelInfiniBandSAS

Page 11: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

11Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Converging Trends

Page 12: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

12Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Latency Matters

“Money can buy bandwidth, but latency is forever”

John R. Mashey, Chief Scientist SGI, “Big Data and the Next Wave of InfraStress”, USENIX, 1999

Page 13: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

13Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Little Change in HDD RPM

1956 RAMACthe first disk drive5 MB storage1,200 RPM

2007 Seagate Cheetah Drive400 GB storage15,000 RPM

From 1956 to 2007:12.5 times increase in RPM80,000 times increase in capacity

Page 14: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

14Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Data Access Times

4

0.2

5

0.020123456

Milliseconds

HDD Flash DDR RAM

Data Access Times(assumes a cache-miss)

ReadWrite

Page 15: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

15Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Random I/O’s

20050,000

1,000

400,000

0

100,000

200,000

300,000

400,000

I/O'sPer

Second

HDD Flash DDRRAM

Random I/O's Per Second(assumes a cache-miss)

ReadWrite

Page 16: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

16Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Rugged

Flash Hard Disk drives are rated to handle up to 1,500 G-ForcesLaptop Hard Disk drives are rated to handle up to 400 G-Forces

Page 17: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

17Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Low Power

At small capacities flash SSD offers the lowest power consumption (1/2 watt).At larger capacities (>150GB) FDD and HDD draw up to 18 watts.

Interface type impacts power consumption.

Flash SSD has the best performance/power.

Page 18: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

18Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Dropping Prices

Average Price per GB Comparison - SSD and HDD by Form Factor

$0.10

$1.00

$10.00

$100.00

$1,000.00

$10,000.00

2006 2007 2008 2009 2010 2011

Flash SSD 1.8in HDD 2.5in HDD DRAM SSDSource: IDC, Worldwide Solid State Drive 2007-2011 Forecast and Analysis: Finding Space in the Expanding

Digital Universe, Doc # 207739, July 2007.

Note: DRAM SSD include additional components (I.e. batteries, etc)

Page 19: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

19Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Low Price for Performance

Price / IOPS

$2.00

$0.84

$0.20

$- $0.50 $1.00 $1.50 $2.00 $2.50

HDD

Flash

DDR

Price per Random IOPS

Page 20: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

20Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Improving Density

Largest Hard Disk Drive:1 Terabyte

Largest Flash Disk:352GB Flash Disk Drive

Largest DDR Drive:12GB DDR SSD Disk Drive

All drives can be arrayed for larger capacities.

Page 21: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

21Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Why Solid State Disks?Small Block Random Data Accesses

Data Patterns Tend to be…

HDD CachedRAID

Flash CachedFlash RAID

DDR Solid State Disk

High writes, mostly random

High reads, mostly random

Small Block

High reads, reads quickly follow writes

Small Block

High writes,Sequential, Single Threaded

Small Block

High writes, mostly sequential

High reads, mostly sequential

Small Block

Big Block

Big Block

Page 22: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

22Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Flash SSDKiller Applications

Business notebook computer storageFaster OS startupImproved notebook read performanceLow powerRugged

Page 23: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

23Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Cached Flash RAID SSD Killer Applications

Data warehousingTerabytes of capacity needed as hot files are difficult to isolate to a small amount of dataVery read intensive applicationsCache will preserve write performance at levels the enterprise is accustomed to receiving

RenderingSmall block random I/O applicationVery read intensive applicationHot files are difficult to isolate

Page 24: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

24Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Cached Flash RAID SSD Killer Applications

Video on demandStoring frequently accessed movies requires 1TB plus capacityVery read intensive applicationsLess frequently accessed content still stored in HDD RAID

Seismic processingLarge capacity of data (4TB plus), broadly and randomly accessedVery read intensive application

Page 25: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

25Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

DDR RAM SSDKiller Applications

Write intensive OLTP environmentsHeavy writes make these environments unsuitable for flash systemsStore transaction logs, temporary space, and undo segments on SSD

Web transaction databasesExtreme concurrencyHigh read and write volumes

Single-threaded applicationsThe ultimate latency sensitive applicationOften found in the financial industry

Page 26: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

26Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

DDR RAM SSDKiller Applications

Mission critical data warehousingWhen company profitability or lives are on the line, nothing is faster than a DDR RAM based solutionData Warehouses with simultaneous high ingest rates and high query rates

Page 27: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

27Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

SSD and ILM

Page 28: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

28Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

SSD and ILM

Discussion of ILM is making people aware that different data has a different value at different times.Solid state disk sales are being driven by this awareness.Desired ILM features:

The ability to automatically migrate data between storage tiers based on frequency of data access.

Migrate data off SSD storage to lower cost storage.Migrate data onto SSD storage from lower cost storage if frequency of access is high.

ILM software and hardware needs to have as little impact as possible on latency.

Page 29: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

29Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Enterprise SSD Market Set For Growth

0M

1M

1M

2M

2M

3M

3M

4M

2006 2007 2008 2009 2010 2011

Uni

ts (M

u)

$0B

$0B

$0B

$1B

$1B

$1B

$1B

$1B

Rev

enue

($M

)

Units Revenue

200% CAGR76% CAGR

Source: IDC, Worldwide Solid State Drive 2007-2011 Forecast and Analysis: Finding Space in the

Expanding Digital Universe, Doc # 207739, July 2007.

Page 30: Solid State Storage for the Enterprise...SCSI Fibre Channel SCSI Fibre Channel SAS SCSI Fibre Channel InfiniBand SAS. ... 2007 Seagate Cheetah Drive 400 GB storage 15,000 RPM From

30Storage Performance Testing© 2007 Storage Networking Industry Association. All Rights Reserved.

Q&A / Feedback

Please send any questions or comments on this presentation to SNIA: [email protected]

Many thanks to the following individuals for their contributions to this tutorial.

SNIA Education Committee

Jamon Bowen Nathalie GonzalezIDC Jeff JanukowiczRob Peglar Brandy Barton