Enterprise Storage NAS - Dual Controller

Post on 13-Apr-2017

276 views 2 download

Transcript of Enterprise Storage NAS - Dual Controller

Internal AnnouncementEnterprise Storage NAS

Enterprise-Class, Unified, Hybrid, Optimized For VMWaterball Liu

Platform PM TeamEnterprise Storage Division

Question & Answer

Some Thinking Behind Brand New Product LineInquiring Minds Like Yours

FILEBLOCK

VMware ESX VMware ESX

VirtualizationUnified Storage

DeduplicationCompression

UnlimitedSnap Shot

Snap Sync Dual ActiveSystem

Controller

New Function Performance Off Load• WORM• Encryption• Snap Sync• Snapshot Agent

• Shared ZIL/L2ARC• Asynchronous

copy-on-write

• Microsoft ODX (NAS /iSCSI)

• VMWare VAAI (NAS / iSCSI)

New Technology For Enterprise

Only Keep In Mind• Complement Deficiency Of QTS:

– Concentrate On What Enterprise Needs– Over 256TB Storage Pool– Much Faster Snap Shot and Pool Building– High Availability For Nearly Zero Downtime– Enhanced Offload On Both VMware and Microsoft– Disaster Recovery For Ongoing Service

Same User Interface For Shortest Learning Curve

8TB 2TB

QES QTS

╳ 80 = 640 ╳ 12 = 24640 TBRAID 6

24 TBRAID 6

Building 640TB Storage Pool

Pool / IP

Server-Side Copy & Clone

Server Server Server

NAS NAS NAS

A B A B A A

Server-Side Copy Server-Side Copy + ODX(Fast Clone)

Meta Data

No Offload Offload (ODX) What We Done

100GBHost

NAS

Seeing Is Believing

Question 1: Why QES• Many of QNAP customers....

– Choose Rack-mount models for All-SSD– Major Application: VM Server, VDI– Tier 2 Storage: Highly Budget-Limited– QTS isn’t native enterprise OS for rack-

mount & datacenter Environment– Customers ask for Higher Performance

with much more Advanced Features

Question 2: Why FreeBSD• FreeBSD Is Nothing But The Best

Choice– Clarity, Performance, Reliability, Security– A complete operating system, not kernel

only with different distributions– Excellent with its network, virtual memory,

and SCSI subsystem– Leader in terms of backward compatibility

Question 3: Why ZFS• ZFS is real enterprise-class file system

– Protection against silent data corruption– Efficient data compression– Copy On Write (CoW) clones– Continuous integrity checking– Automatic repair– RAID-Z, native NFSv4 ACLs

Question 4: Differ From Nexenta• Nexenta is the center of attention in

the world of Server SAN, but some inconvenient truths emerged....– Because of Solaris, Nexenta “enjoys” the

worst hardware compatibility– Nobody could guarantee real performance– For Server SAN, software only isn’t enough

currently

What QNAP Will ProvideAll-SSD

SSD SSD SSD SSDSSD SSD SSD SSDSSD SSD SSD SSDSSD SSD SSD SSD

Unified, Hybrid StorageSSD SSD SSD SSD

NVRAMWrite

Cache

SSDReadCache

SystemController #1

SystemController #2

Much Lower TCOMuch More FlexibilitySimilar Performance

NASIP-SAN

NASIP-SANFC-SAN

All-SSDHybrid SSD / HDDAll-HDD

SystemController

QNAP Ecosystem

Data efficiency

FILEBLOCK

Unified Storage VirtualizationVMware ESX VMware ESX

disaster recoveryHigh Availability

Dual Active-Active

Data Integrlty

Enterprise-Class Storage

All New QNAP Enterprise OS Complementary with QTS

QNAP Enterprise System (QES)

Complete QNAP Storage SolutionFILEBLOCK

VMware ESX VMware ESX

QNAPTurbo NASSystem

QNAPEnterprise NASSystem

VirtualizationUnified Storage

DeduplicationCompression

UnlimitedSnap Shot

Snap Sync Dual ActiveSystem

Controller

Complementary, Not Exclusive

Multimedia, SOHOAPP Extensibility

Enterprise, SMBBusiness Continuity

New OS Built On FreeBSD & ZFS

OS KernelFile System

QNAPTurbo NASSystem

QNAPEnterprise NASSystem

QES: Key Advantage

SSD

Block Dedup

BBU

Fail Over

VDIProtection against corruption

Data Compression

Volume Management

Snapshot, CoW Clone

Integrity Check, Auto Repair

VM

RAM Cache

Compression

VM Integration

QTS UI

Data Integrity

Disaster Recovery

QTS-Like User

Interface

Fault Tolerance

High Performanc

e

High Capacity Efficiency

Application

High Availability / High Reliability

High PerformanceVirtualization

New Tech

Best File SystemBTRFS (Synology)Snapshot

QNAP QTS 4.2Snapshot

QNAP QES 1.1.2Snapshot

Technical Aspect

BTRFS255 Snapshots

EXT41024 Snapshots

ZFSUnlimited Snapshots

RAID5/6Testing

Support All RAID RAID Z

Sequential Read Speed Unstable

Stable read and write speed Best On Sophisticated HW

Real World

Might Change System Configuration

Current System Upgradeability

ES Product Line Loaded With QES

Maybe Need To Purchase New Hardware For Snapshot

Current Hardware Platform Can Use Snapshot

ES Product Line Loaded With QES

Virtualization ManagementBackup & Disaster Recovery

SMI-SVSS+Snapshot Agent

Microsoft VDI on IP-SAN iSCSI + Deduplication + ODX

Virtualization ManagementBackup & Disaster Recovery

VMware Web Plug-InSnapshot Agent/SRA

VMware VDI on IP-SANVMware VDI on NAS

iSCSI + Deduplication + VAAINFS + File Clone + VAAI-NAS

Integration With Hypervisor

Powerful, But still Easy to Use

Inherited from well-reputed QTS, the intuitive, multi-window and multi-tasking GUI make current QTS users incredibly easy to get started and then master enterprise-class storage systems along with the shortest learning curve.

Efficiency: Data DeduplicationC A B C DB A B A AD B B C A

A BC DDeduplication

Deduplication rates for VM deployments can range as high as 95% savings.

Deduplicated data is cached for much better performance by reducing disk access!

NVRAM Cache

Repeatability

Efficiency: Real-time Compression

Compression

Traditional storage

20-50%Less capacity

ES NAS

Same Capacity Could Store Much More!

High Performance NVRAM Cache

Both SSD Read Cache (RAID 0+1) and NVRAM Write Cache protected by Copy-To-Flash (C2F) provide best performance.

BBU

Read

Write C2F

Write Cache

Read Cache

Copy To Flash

mSATA / M.2SSD (32GB)

Battery Backup Unit

NVRAM

Protection From Silent Data Corruption

Data Integrity: Self-Healing

Detects Bad Data Gets Good Data from Mirror “Heals” Bad Copy

ChecksumError

Data Integrity: NVRAM MirroringBBU BBU

Mirroring

Read

Read

Read

Read

Copy To Flash Copy To Flash

Write Back Cache Write Back Cache

Power Supply Power Supply

Main Memory

Write CacheMirroring for HA

SSD Read Cache

mSATAM.2 SSD

Copy To Flash

Disaster Recovery: Snap Sync + Snap Shot Agent for VM Backup

Snap Sync

Turbo NAS

Snapshot

RSYNC

ES NAS ES NAS

File Level Block Level

Snap Agent

Enterprise-Class Storage

All New QNAP Enterprise Platform Beyond Turbo NASQNAP ES NAS Series

FILEBLOCK

VMware ESX VMware ESX

VirtualizationUnified Storage

DeduplicationCompression

UnlimitedSnap Shot

Snap Sync Dual ActiveSystem

Controller

ES NAS: Unified, Hybrid StorageQTS User InterfaceVMware

ReadyWindows

Ready

UnifiedHybrid

NVRAM SSD CacheUnlimited Snapshots

Unified

Most AffordableUnified, Hybrid Storage

SAS 12Gb/s SAS 6Gb/s

ES NAS

ES JBOD

ES1640dc

EJ1602 EJ1600

ES1642dc

QNAP ES NAS: First Wave

ES1640dc: Dual Active Controller

Redundant PSU

BBU (C2F)

PCIe x8 Slot *2(One x8, One x4 Signal)

For Optional SAS HBA, FC HBA

• 10G Base-T *2• SAS 6Gb/s *1• USB 3.0 *2• 1G Base-T *1 (Mgt)• RJ-11 *1 (Console)

Disk Interconnect Cache Processor

Host Interconnect

(iSCSI,NFS, etc.)

Processor

SAS Drives

Controller 1

PCIPCI

SAN

DMAController 2

(1) Host initiates write command

DMA

W-ack Mirror Cache

(2) Controller acknowledges successful write

SAN

W

W

Cache

Host Interconnect

(iSCSI,NFS, etc.)

Disk Interconnect

Dual Active-Active Controller

Controller BController A

Interposer

Interposer

ES1640dc: Dual Active Controller

Fault-Tolerance: Dual Path Design, Assure Data Availability

activeactiveSwitch

ES NAS

ES JBOD

ES1640dc: Hot Swappable & FRUFieldReplaceableUnit

FlashOne Specific DIMM as Write Cache

BBU

Data Integrity: Copy-To-Flash (NVRAM)

Battery Backup Unit

mSATASSD (32GB)

Thank You For Your Attention!

QES Internal ReleaseImpeccable Disaster Backup SolutionUnlimit Snapshot x SnapSync x 3rd Parties Backup Support

Ason HuApplication PM Team

Enterprise Storage Division

• QES Backup SolutionsSnapsync / Snapshot / Snapagent / Rsync

• QES compliance with 3rd party Backup Solutions

VMware Site Recovery ManagementVeeam Backup & Replication 

Fast & Efficient Data Protection

Fast Recover & Migrate Data

Snap Sync

Turbo NAS

Snapshot

RSYNC

ES NAS ES NAS

File Level Backup Block Level Backup

Snap Agent

Seeing is believing : Snapshot• Using Snapshot to recover large amounts

of data in seconds

Seeing is believing : Snapsync• Using Snapsync to backup iSCSI LUNs /

Shared Folders

Seeing is believing : Snapagent• Using QNAP Snapagent to guarantee

application consistency

Seeing is believing : Rsync• Using file level backup

Turbo NASRSYNC

ES NAS

QNAP Snapsync With VMware SRM To Make Offsite BackupEasy & Quick

ES1640DC ES1640DC

Site A (Primary) Site B (Recovery)

Exchange Server

Servers

VMware vSphere

VMware vCenter Server

Site Recovery Manager

Servers

VMware vSphere

Site RecoveryManager

VMwarevCenter Server

Exchange Server

vSphere Replication

Array Based ReplicationSnapsync

Stor

age

Repl

icat

ion

Adap

ter

(SR

A)

Stor

age

Repl

icat

ion

Adap

ter

(SR

A)

CREATE iSCSI LUN OR SHARED FOLDER SNAPSHOT

iSCSI LUN OR SHARED FOLDER REPLICATED AND STORED

SCHEDULEBACKUPS VIA

SNAPSYNC SERVER

• Snapshot : take & revert Snapshot in seconds• Snapsync : Remote backup & recover snapshot• Snapagent : Guarantee Application consistency• Rsync : file level backup from QTS to QES• 3rd party backup solution : VMware SRM,

Veeam Backup, Replication, and so on.

QES With Multiple Integration

Thank you !

Agenda• Hardware Comparison• Software Feature Comparison• Performance Compariso

47CONFIDENTIAL

QNAP ES1640dcNETAPP FAS2520AEMC VNXe 3300

Infortrend EonNAS 3016QSAN TrioNAS LX HA U600 D316

Comparison Enterprise Solution Dept.

Agenda• Hardware Comparison• Software Feature Comparison• Performance Comparison

48CONFIDENTIAL

Agenda• Hardware Comparison• Software Feature Comparison• Performance Compariso

49CONFIDENTIAL

Hardware Comparison

Hardware Comparison (1)QNAP ES1640dc

QSAN TrioNAS LX U600Q S-316

Infortrend EonNAS 3016

EMC VNXe 3300

Netapp FAS2520A

Controllers Dual Dual Dual Dual Dual

Form factor 3U 16 bay 3U 16bay 3U 16 bay 3U 15 bay 2U 12 bay

CPU Intel Xeon E5-2420 v2 2.20GHz6C12T

Intel XeonC3528 1.73GHz2C4T

Intel Xeon E3-1225 v3 3.20GHz4C4T

Intel Xeon E5-2407 v22.40GHz4C4T

Intel XeonLC3528 1.73GHz2C4T

Memory per controller

32 GB (up to 64 GB)

16 GB 32 GB (up to 64 GB)

12GB 16GB

Write Cache per controller

16G NVRAM SSD SSD 1G NVRAM 2G NVRAM

Read Cache SSD (global) SSD (dedicate) SSD (dedicate) 256M RAMFAST Cache (SSD, option)

Flash Cache (HW, option)Flash Pool (SSD)

50CONFIDENTIAL

Hardware Comparison (2)QNAP ES1640dc

QSAN TrioNAS LX U600Q S-316

Infortrend EonNAS 3016

EMC VNXe 3300 Netapp FAS2520A

Host channel per controller

10Gb port X 21Gb port X 1

10Gb port X 21Gb port X 3

10Gb port X 21Gb port X 4

1Gb port X 5 10Gb port X 4*1Gb port X 2

FC Support NO NO YES(option) NO YES (option)

40 GbE Support YES(option) NO NO NO NO

SAS expander per controller

6G SAS port X 3 6G SAS port X 1 6G SAS port X 2 6G SAS port X 2 6G SAS port X 2

Power Supply 700W X 2 550W X 2 750W X 2 875W x 2 750W x 2Front Panel LED LCD display LED LED LED * FAS2520A use two 10GbE ports as HA heartbeat

51CONFIDENTIAL

Hardware Comparison (3)QNAP ES1640dc

QSAN TrioNAS LX U600Q 316

Infortrend EonNAS 3016

EMC VNXe 3300 Netapp FAS2520A

MAX Disk Drives Up to 128 Up to 256 Up to 256 Up to 120 Up to 84

MAX Capacity (RAW)

1024 TB ?? 1536 TB 240 TB 672TB

MAX Expander 7 Expanders ?? 7 Expanders ?? 3 Expanders

MAX Pool # Up to 128 Up to 512 Up to 128 NA NA

MAX Pool Size 1024 TB ?? ?? ?? 120 TB

MAX LUN # Up to 1024 Up to 4096 Up to 1024 Up to 512 Up to 2048

MAX LUN Size 64T* ?? ?? 2TB 16T

MAX Share Folder # Up to 1024 Up to 4096 Up to 1024 Up to 512 Up to 1000

MAX Share Folder Size

1024 TB ?? ?? 16TB 60T

* Windows Server 2012 maximum support LUN size

52CONFIDENTIAL

Agenda• Hardware Comparison• Software Feature Comparison• Performance Compariso

53CONFIDENTIAL

Software FeatureComparison

Feature Comparison (1)

FeaturesQNAP ES1640dc

QSAN TrioNAS LX HA

Infortrend EonNAS 3016

EMC VNXe 3300 Netapp FAS2520A

High Availability

Controller Failover

YES YES YES YES YES

ALUA YES YES YES NO (using Failsafe Network)

YES

NIC Teaming YES YES YES YES YES

RAID 0,1,5,6,10,TP, Tipple Mirror

0, 1, 5, 6, 10 0,1,0+1,5,6,10 5, 6, 10 4, DP

Hot-Spared Global Dedicate Global/Dedicate Global Global

SMARTPredicted Data Migration

YES YES YES YES YES

54CONFIDENTIAL

Feature Comparison (2)

FeaturesQNAP ES1640dc

QSAN TrioNAS LX HA

Infortrend EonNAS 3016

EMC VNXe 3300 Netapp FAS2520A

Data Services

iSCSI YES YES YES YES YES

SMB YES YES YES YES YES

NFS YES YES YES YES YES

FTP YES YES YES YES YES

FC NO NO YES NO YES

55CONFIDENTIAL

Feature Comparison (3)

FeaturesQNAP ES1640dc

QSAN TrioNAS LX HA

Infortrend EonNAS 3016

EMC VNXe 3300 Netapp FAS2520A

Storage Efficiency

Pool Aggregate YES YES YES YES YES

Thin Provisioning YES YES YES YES YES

Thin-Prov. with reclaim

YES ?? ?? YES YES

Share Folder Quota

YES YES YES YES YES

Compression YES YES YES File Only YES

Dedupe Inline Inline Inline File Only InlineClone YES YES YES NO YES

56CONFIDENTIAL

Feature Comparison (4)

FeaturesQNAP ES1640dc

QSAN TrioNAS LX HA

Infortrend EonNAS 3016

EMC VNXe 3300

Netapp FAS2520A

Storage Management

No-StopFW Upgrade

YES YES YES YES YES

Live Expansion Disk, Pool, LUN, Shared Folder

Disk, Pool, LUN, Shared Folder

Disk, Pool, LUN, Shared Folder

Disk, Pool, LUN, Shared Folder

Disk, Pool, LUN, Shared Folder

Encryption LUNShare Folder

No Folder Self-encrypt drive

Self-encrypt drive

WORM YES NO YES YES YES

57CONFIDENTIAL

Feature Comparison (5)Features

QNAP ES1640dc

QSAN TrioNAS LX HA

Infortrend EonNAS 3016

EMC VNXe 3300

Netapp FAS2520A

Data Protection

RAID Level 0,1,5,6,10,TP, Tripple Mirror

0, 1, 5, 6, 10 0,1,0+1,5,6,10 5, 6, 10 4, DP

Hot-Spared Global Dedicate Global/Dedicate

Global Global

Snapshot YES(65536)

YES YES YES(256)

YES

Snapshot Rollback

YES YES YES YES YES*

Remote Replication

YES YES YES YES YES

Checksum YES YES YES ?? ??

Self-Healing YES YES YES ?? ??

Pool Scrub YES YES YES ?? ??

* need licence

58CONFIDENTIAL

Feature Comparison (6)

Features QNAP ES1640dc

QSAN TrioNAS LX

U600Q D-316Infortrend

EonNAS 3016EMC VNXe

3300Netapp

FAS2520A

vmWare

vmWare Ready YES YES YES YES YES

Snapshot Agent YES No No YES YES

vSphere Plugin YES No No YES YES

vSphere Web Plugin YES No No YES YES

SRA for SRM YES No No No YES

59CONFIDENTIAL

Feature Comparison (7)QNAP ES1640dc

QSAN TrioNAS LX U600Q D-316

Infortrend EonNAS 3016

EMC VNXe 3300

Netapp FAS2520A

vmWare

Block VAAI

Thin Provisioning YES No YES No YESBlock Zero YES No YES No YESFull Copy YES No YES No YESHW Assisted Locking YES No YES No YES

NAS VAAI

Space Reserve YES No No YES YESFile Cloning YES No No YES YESExtended Stats YES No No YES NoNative Snapshot for Linked Clones YES No No No YES

60CONFIDENTIAL

Feature Comparison (8)

Features QNAP ES1640dc

QSAN TrioNAS LX

U600Q D-316Infortrend

EonNAS 3016EMC VNXe

3300Netapp

FAS2520A

Windows

ODX YES No No No YES

VSS HW Provider YES No No YES YES

SMI-S Provider for SCVMM YES No No YES YES

Snapshot Agent YES No No YES YES

61CONFIDENTIAL

Agenda• Hardware Comparison• Software Feature Comparison• Performance Compariso

62CONFIDENTIAL

Performance Comparison

ES1640dc Set

63CONFIDENTIAL

4 SSD Read Cache for 2 controller (global)

6 Disks RAID 6 Pool for Controller A

6 Disks RAID 6 Pool for Controller B

QSAN/Infortrend

1 SSD Read Cache

6 Disks RAID 6 Pool for Controller A

6 Disks RAID 6 Pool for Controller B

1 SSD Write Cache(no mirror)

1 SSD Read Cache 1 SSD

Write Cache(no mirror)

16G NVRAM Write Cache per Controller

Performance SetsIOPS QNAP

ES1640dc Netapp FAS2520A EMC VNXe 3300 InfotrendEonNAS 3016

QSAN U600Q/U600HA

Drives 4 x SSD + 12 x NL-SAS

4 x SSD + 8 x 10K SAS

8 x 15K SAS +6 x NL-SAS

4 x SSD + 12 x NL-SAS

4 x SSD + 12 x NL-SAS

Pool 6 x NL-SASRAID 6

3 x SSD + 7 x 10K SAS (flash

pool)7 x 15K SAS

RAID 56 x NL-SAS

RAID 66 x NL-SAS

RAID 6

Read Cache 4 SSD Flash Pool Internal 256M RAM 1 SSD 1 SSD

Write Cache 16 G NVRAMeffective 8G

2G NVRAM + Flash Pool 1G NVRAM 1 SSD 1 SSD

Network 10GbEx2 10GbEx2 1GbEx4Trucking 10GbEx2 10GbEx2

64CONFIDENTIAL

Performance Test Bed

65CONFIDENTIAL

Performance Comparison• IOMeter Performance Test

IOPS QNAP ES1640dc

Netapp FAS2520A

EMC VNXe 3300

InfotrendEonNAS 3016

QSAN U600Q/U600HA

Random Read(normal)

40,000-42,000 12,000 3,000 8000 1,400

Random Write(normal) 4,000 14,000 1,100 800 700

Random Read(compression)

40,000-45,000 2,500 -- 2,800 2,100

Random Write(compression) 8,000 2,200 -- 1,200 400

4K block 100% R/W, 1 workers, 32 of Outstanding I/Os, Test File 50GB (4+2 RAID6, SSD cache, One Controller, One Pool)

66CONFIDENTIAL

Why ES1640dc can beat competitors• QES optimizes the ZFS data path• QES uses NVRAM instead of SSD as write cache• QES uses fast PCI-E NTB to mirror the write cache• QES fully unleash read performance by the 4x SSD global read cache• QES uses more powerful CPU and larger memory• QES performs better in compression mode because of its CPU power

and less IO transaction• NETAPP performs well in random write without compression. It is

because it directly writes to SSD in flash pool (hybrid pool) in its random write mode. However, it degrades to hard drive performance after running out SSD space.

67CONFIDENTIAL

Conclusion• ES1640dc uses very powerful hardware

design.• ES1640dc provides all enterprise software

features. User can use them without extra fee.

• ES1640dc outperforms the competitors’ storage systems.

68CONFIDENTIAL

Quick Start PoC guideEnterprise Storage NAS

Enterprise-Class, Unified, Hybrid, Optimized For VMKevin C.C. Cheng

Application PM TeamEnterprise Storage Division

• Cluster for fault tolerant• Storage Cluster• Create an ESXi datastore on ES

Storage

Agenda

Cluster for fault torent

Switch Cluster

Storage clusterES NAS

Computing Cluster

Data port IP: 10.10.10.1 10.10.20.1

Data port IP: 10.10.10.4110.10.20.41

10.10.10.4210.10.20.42

Storage Cluster Dual Path Design, Assure Data Availability

ES NAS

ES JBOD

Create an ESXi datastore on ES storage

Ethernet Switch

ES NAS

Data port IP: 10.10.10.1 10.10.20.1

Data port IP: 10.10.10.4110.10.20.41

10.10.10.4210.10.20.42

Mgt port IP: 192.168.217.1

Mgt port IP: 192.168.217.41 192.168.217.42

Computing Server