| Basel

Build an Enterprise Storage Solution with Windows Server 2012 R2Walter PitrofSr. Technology Solution ProfessionalMicrosoft SwitzerlandEmail: walterp@microsoft.com

Customers Discuss Storage•Lower the cost of storage

•Ease of File, Performance of Block

•No Downtime Servicing

•Help me secure my data

•Fully Leverage Storage Array Capabilities

•Native Access to SAN from VM with redundant IO (MPIO)

•Scalable Virtual Disks

•Storage Metering

File System

File system enhancements

• Rapid recovery from file system corruption without affecting availability

• Resilient against power outage corruption• Periodic checksum validation of file system

metadata• Improved data integrity protection• Ideal for file server volumes

NTFS improvements

• Rapid recovery from file system corruption without affecting availability

• Data corruption virtually eliminated through allocate-on-write

• Period checksum validation of file system meta-data• Seamless data integrity protection

Resilient File System (ReFS)

CHKDSK• Seconds to fix corrupted data• No offline time when used with CSV• Disk scanning process separated from repair

process• Online scanning with volume and offline repair

1 2 3050

100150200250300350400

Series1 Series2Source: “Microsoft Internal Testing"

http://blogs.msdn.com/b/b8/archive/2012/05/09/redesigning-chkdsk-and-the-new-ntfs-health-model.aspx

Storage Performance

Windows Server 2008 R2

Windows Server 2012

250,000 IOPs 1,000,000+ IOPs

Industry Leading IO Performance• VM storage performance on

par with native• Performance scales linearly

with increase in virtual processors

• Windows Server 2012 Hyper-V can virtualize over 99% of the world’s SQL Server.

Hyper-V: Over 1 Millions IOPs from a Single VM

VHDX

Features• Storage capacity up to 64 TBs• Corruption protection during power

failures• Optimal structure alignment for large-

sector disks

Benefits• Increases storage capacity• Protects data• Helps to ensure quality performance

on large-sector disks

New virtual hard disk format

VHDX

Large allocations and 1 MB aligned

Header region

Data region (large allocations and 1 MB aligned)

Metadata region (small allocations and unaligned)

Intent logBlock

Allocation Table (BAT)

Metadata table

User data blocks

Sector bitmap blocks

User metadata

File metadataHeader

VHDX Perf: 32KB Random Writes

Queue Depth 16

IOPS

10%10%

1 2 380000

90000

100000

110000

120000

130000

140000

150000

160000 Series1 Series2

Storage Spaces

New Approach to Storage

StorageSpaces

Cost-Effective Business Critical Storage

File Based

Storage

High Performance SMB Protocol for Hyper-V Storage over Ethernet networks

Strategic shifts to reducing storage costs with Windows Server 2012 Software-Defined Storage

• Virtualization of storage with Storage Pools and Storage Spaces

• Storage resilience and availability with commodity hardware

• Resiliency and data redundancy throughn-way mirroring (clustered or unclustered) or parity mode (unclustered)

• Utilization optimized through thin and trim provisioning and enclosure awareness

• Integration with other Windows Server 2012 R2 capabilities

• Serial Attached SCSI (SAS) and Serial AT Attachment (SATA) interconnects

Storage Spaces

WindowsVirtualizedStorage

Windows Application Server or File ServerPhysical or virtualized deployments

PhysicalStorage

(Shared) SAS or SATA

Integrated with otherWindows Server 2012 capabilities

Storage PoolStorage Pool

File Server Administration

ConsoleHyper-V

Cluster Shared Volume

Failover Clustering

SMB Multichannel

NFS Windows Storage Mgmt.

NTFS (3.0,4.1) SMB Direct

Storage Space Storage Space Storage Space

http://technet.microsoft.com/en-us/library/dn387076.aspx

Storage Space

Reduced Mean Time To Recovery (MTTR)

Mirror Spaces Rebuild Parallelized Recovery

Increased Throughput

Dual parity: Stores two copies of the parity information on a parity space,

which helps protect rom two simultaneous physical disk failures and optimizes storage efficiency.

Utilization of spare capacity: Hot Spare no longer necessary in R2

Automatically rebuild storage spaces from storage pool free space

Performance improvements to radically reduce MTTR

Rebuild Metric MeasurementData Rebuilt 2,400 GBTime Taken 49 minRebuild Throughput

> 800 MB/s3TB HDDs, 2-way, 4-column Mirror Space

Source: Internal Testing, No Foreground Activity

Data Deduplicati

on

Efficient storage through Data Deduplication

VHD Library

Software Deployment

ShareGeneral File

ShareUser Home Folder

(My Docs)0% 20% 40% 60% 80% 100%Average savings with Data Deduplication by workload

type

Maximize capacity by removing duplicate data• 2:1 with file shares, 20:1 with virtual

storage• Less data to back up, archive, and

migrateIncreased scale and performance• Low CPU and memory impact • Configurable compression schedule• Transparent to primary server

workloadImproved reliability and integrity• Redundant metadata and critical

data• Checksums and integrity checks• Increase availability through

redundancyFaster file download times with BranchCache

Source: “Microsoft Internal Testing"

Evaluating Deduplication

Storage tiering

Storage tieringImproved storage cost-performance with industry-standard hardwareUse solid-state drives (SSD) and hard-disk drives (HDD) in tiered storage spaceCan “pin” high priority files to the SSD tier

Hard Disk Drives (HDD)

Hot data

Cold data

Solid State Drives (SSD)

Storage Spaces

Storage tiering

Write-Back Caching

Write-Back Caching (WBC)Complements TieringTiering – Balances capacity & performanceWBC – Short-term absorption of I/O bursts

Seamless Integration & ManagementUtilizes available SSD capacity from poolWBC enabled by defaultConfigurable through PowerShell

Hyper-V Compute Nodes

Storage Space

HDD TierCold Data

SSD Tier & WBC

Hot Data

400GB EMLC SAS SSD

4TB 7200RPM SAS HDD

Reads/Writes Accumulates Data Activity

Seamless Integration

Storage Deployment Approaches

Storage Deployment Approaches

Balanced

• Mix of HDD & SSD

• High Capacity HDDs

• High Performance SSDs

• Best IOPS/$

How to build a deployment with:• 16 TB Capacity• 180,000 IOPS (4k,

random)

HDD Only Deployment• Meet Capacity with 6

HDDs• Miss IOPS by 179,100

SSD Only Deployment• Miss Capacity by 12.8

TB• Meet IOPS with 4 SSDs

Balanced Deployment:• Meet Capacity with 6

HDDs• Meet IOPS with 4 SSDs

Option Capacity IOPS Cost

SSD Only (20)

16 TB 1,000,000

$60,000

Mixed(6 + 4)

21.2 TB 200,900 $14,100

?3TB SAS HDDs, 150 IOPS, $350 MSRP

800GB SAS SSDs, 50,000 IOPS, $3,000 MSRP

DemoStorage SpacesStorage tieringDeduplication

Server Message Block

(SMB) 3.0

Top-to-bottom performance analysis and tuning

• SMB server optimization• New tracing instrumentation to identify

bottlenecks• Substantial refactoring of SBM2 client

as wellWindows Server 2012 at 98% of DAS transactional performance

• Identical servers and storage• 28 x 10KRPM HDD

SMB SMB + DAS0

500

1000

1500

2000

2500

3000

3500

4000

4500

1175 (27%)

4270 (98%) 4315 (100%)

SQL TPC-C transactions/second

SMB 3.0 Direct-attached storage (DAS) Equivalence

Network fault tolerance with SMB Multichannel

NetworkSMBclient

SMBserver

Filecopy

NIC NIC

NIC NIC

Filecopy

• Automatic detection and use of multiple network connections between SMB client and server

• Helps server applications be resilient to network failure

• Transparent Failover with recovery of network failure if another connection is unavailable

• Improved throughput• Bandwidth aggregation through NIC

Teaming• Multiple nodes/CPUs for network

processing with RSS-capable network adapters

• Automatic configuration with very little administrative overhead

DemoSMB Multichannel

File Client

SMB ClientSMBBuffe

r

File ServerApplication

NIC Driver

Transport Protocol Driver

With RDMA

Improved network performance through SMB Direct (RDMA*)

Without RDMA

Application

NIC Driver

SMB ServerSMB Client

Transport Protocol Driver

NIC Driver

TransportProtocol Driver

AppBuffe

r

SMBBuffe

r

OSBuffe

r

Driver

Buffer

SMBBuffe

r

OSBuffe

r

Driver

Buffer

SMB Server

NIC Driver

TransportProtocol Driver

AppBuffe

r

SMBBuffe

r

rNIC* rNIC* NIC AdapterBuffer NICAdapter

BufferAdapterBuffer

AdapterBuffer

iWARP

InfiniBand

• Higher performance through offloading of network I/O processing onto network adapter

• High throughput with low latency and ability to take advantage of high-speed networks (such as InfiniBand and iWARP)

• Remote storage at the speed of direct storage

• Transfer rate of around 50 Gbs on a single NIC port

• Compatible with SMB Multichannel for load balancing and failover *Remote Direct Memory Access *e.g. Intel® NetEffect™ Server Cluster Adapter Family

http://workinghardinit.wordpress.com/2013/06/14/verifying-smb-3-0-multichannelrdma-is-working-in-windows-server-2012-r2/

Hyper-V Live Migration over SMBSMB as a transport for Live Migration of VMs

Delivers the power of SMB to provide: RDMA (SMB Direct) Steaming over multiple NICs (SMB Multichannel)Provides highest bandwidth and lowest latency

Live migration can stream over multiple

networks for improved bandwidth

Live Migration can take advantage of

high speed networking

RDMA enables offloading CPU

resources to NIC during live migration

1 2 30

10

20

30

40

50

60

70

Live Migration Times

Seco

nds

SMB Direct Performance Enhancements(R2)

Scale-out File Server

SMB Direct

Hyper-V

VHD50% improvement for small IO workloads

Efficiency

Increased efficiency and density of hosting workloads with small I/O’s such as OLTP database in a VM Optimizes 40Gbps Ethernet and 56Gbps InfiniBand

Performance

50% improvement for small IO workloads with SMB over RDMAIncreased 8KB IOPs from ~300K IOPS to ~450K IOPS per interface

http://technet.microsoft.com/en-us/library/hh831474.aspx

SMB

Scale-out File Server

Hyper-V host

Optimized Rebalancing of Scale-out File Server Scale-Out File Server clients are now redirected to

the “best” node for access Avoids unnecessary redirection traffic Driven by ownership of Cluster Shared Volumes SMB connections managed per share

No longer per file server Dynamically moves as CSV volume ownership

changes Clustering is now also balancing CSV volumes automatically

Automatic behavior, no administrator action

File Server 2File Server 1Storage Spaces

\\SOFS\Share2

Share1 Share2 Share1 Share2

CSV and SMB shares automatically rebalanced

Improved network efficiency through

drastically reducing redirection traffic

DemoSMB 3.0 – File CopySMB 3.0 – IOPs

Windows File Server Cluster Solution PartnersCertified Storage Spaces HardwareHigh-Performance Servers and Storage

http://www.raidinc.com/ http://www.dataonstorage.com/http://www.fujitsu.com/fts/

http://www.quantaqct.com/

http://www.supermicro.com/

© 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a

commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.