Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use...
Transcript of Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use...
![Page 1: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/1.jpg)
Larry Zhang, PM
https://aka.ms/larryexchange
![Page 2: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/2.jpg)
Storage Spaces Direct is software-defined,
shared-nothing storage.
![Page 3: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/3.jpg)
Use industry-standard hardware to build
lower-cost alternative to traditional storage.
![Page 4: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/4.jpg)
Deployment
Storage Spaces Direct
![Page 5: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/5.jpg)
![Page 6: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/6.jpg)
Industry-standard servers with internal drives
![Page 7: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/7.jpg)
No shared storage, no fancy cables – just Ethernet
![Page 8: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/8.jpg)
![Page 9: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/9.jpg)
Let’s cluster them
![Page 10: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/10.jpg)
![Page 11: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/11.jpg)
Software-defined “pool” of storage
![Page 12: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/12.jpg)
![Page 13: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/13.jpg)
We’re ready to create volumes!
![Page 14: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/14.jpg)
![Page 15: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/15.jpg)
Scale-Out File Server (SoFS)
SMB3
File Shares
![Page 16: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/16.jpg)
Hyper-Converged
![Page 17: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/17.jpg)
![Page 18: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/18.jpg)
NEW! SQL Server 2016
![Page 19: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/19.jpg)
Scale-Out
Storage Spaces Direct
![Page 20: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/20.jpg)
![Page 21: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/21.jpg)
Add new node to cluster
![Page 22: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/22.jpg)
![Page 23: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/23.jpg)
![Page 24: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/24.jpg)
Under 00:15 of real-world time.
![Page 25: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/25.jpg)
ANNOUNCING 2-NODE SUPPORT
![Page 26: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/26.jpg)
From 2 – 16 servers, and up to over 400 drives
Over 3 PB of raw storage per cluster
Add servers to scale out
Add drives to scale up
Pool automatically absorbs new drives
Better storage efficiency and performance at larger scale
Converged design greatly simplifies procurement
No special hardware or cables – just Ethernet
Simple Scalability and Expansion
![Page 27: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/27.jpg)
From 2 – 16 servers, and up to over 400 drives
Over 3 PB of raw storage per cluster
Add servers to scale out
Add drives to scale up
Pool automatically absorbs new drives
Better storage efficiency and performance at larger scale
Converged design greatly simplifies procurement
No special hardware or cables – just Ethernet
Simple Scalability and Expansion
![Page 28: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/28.jpg)
Performance
Fault Tolerance
Efficiency
Manageability
Cost
![Page 29: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/29.jpg)
1,000,000 IOPS
Storage Spaces Direct
![Page 30: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/30.jpg)
Or
You must have some flash. Why?
All-FlashSSD Only
HybridSSD + HDD
![Page 31: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/31.jpg)
![Page 32: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/32.jpg)
Actuator
Head
Arm
Platter
Tracks
![Page 33: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/33.jpg)
Spinning rust can only do about 75 random IOs per second.
Assumes minimal queueing and industry-standard 7200 RPM devices.
![Page 34: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/34.jpg)
Random I/O
Optimized I/O
Built-In, Always-On CacheFastest media (e.g. SSD) provides caching
Each SSD dynamically binds to several HDDs
Independent of pool or volumes, no configuration
All writes up to 256KB, and all reads up to 64KB, are cached
Writes are then de-staged to HDDs in optimal order
![Page 35: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/35.jpg)
Storage Spaces Direct can achieve 600+ IOPS / HDD.
![Page 36: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/36.jpg)
Regular SSD
×
Unlocking NVMeNew class of solid-state storage devices
Sit directly on PCIe bus for direct access to chipset
Faster than SSDs behind SAS fabric
![Page 37: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/37.jpg)
Our record to date is over 6,000,000 IOPS.
100% 4k Read, N = 16, 4 X P3700 NVMe / Node, Intel Xeon E5 2699v4, Chelsio 40 GbE
![Page 38: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/38.jpg)
1 Tb/s Throughput
New Record
![Page 39: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/39.jpg)
OVER 1 TERABIT PER SECOND.
1 terabit = 125,000,000,000 bytes.
![Page 40: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/40.jpg)
Review
6,000,000 IOPS
Built-In, Always-On Cache
Unlocking NVMe
1 Tb/s Throughput
![Page 41: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/41.jpg)
Performance
Fault Tolerance
Efficiency
Manageability
Cost
![Page 42: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/42.jpg)
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 43: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/43.jpg)
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 44: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/44.jpg)
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 45: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/45.jpg)
All data remains safe and accessible
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 46: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/46.jpg)
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 47: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/47.jpg)
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 48: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/48.jpg)
Drive Fault ToleranceUp to 2 simultaneous drive failures
Data stays safe and continuously accessible
Automatic and immediate repair
Single-step replacement
![Page 49: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/49.jpg)
Drive Lifecycle
Storage Spaces Direct
![Page 50: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/50.jpg)
Server Fault ToleranceUp to 2 simultaneous failures
Copies always land in different servers
Accommodates servicing and maintenance
Data resyncs automatically
![Page 51: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/51.jpg)
Server Fault ToleranceUp to 2 simultaneous failures
Copies always land in different servers
Accommodates servicing and maintenance
Data resyncs automatically
![Page 52: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/52.jpg)
Server Fault ToleranceUp to 2 simultaneous failures
Copies always land in different servers
Accommodates servicing and maintenance
Data resyncs automatically
![Page 53: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/53.jpg)
Server Fault ToleranceUp to 2 simultaneous failures
Copies always land in different servers
Accommodates servicing and maintenance
Data resyncs automatically
![Page 54: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/54.jpg)
Server Fault ToleranceUp to 2 simultaneous failures
Copies always land in different servers
Accommodates servicing and maintenance
Data resyncs automatically
![Page 55: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/55.jpg)
Server Fault ToleranceUp to 2 simultaneous failures
Copies always land in different servers
Accommodates servicing and maintenance
Data resyncs automatically
![Page 56: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/56.jpg)
Chassis & Rack Fault Tolerance
![Page 57: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/57.jpg)
![Page 58: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/58.jpg)
![Page 59: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/59.jpg)
![Page 60: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/60.jpg)
![Page 61: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/61.jpg)
Review
Drive Fault Tolerance
One-Step Drive Replacement
Server Fault Tolerance & Maintenance
Rack/Chassis Awareness
![Page 62: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/62.jpg)
Performance
Fault Tolerance
Efficiency
Manageability
Cost
![Page 63: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/63.jpg)
Storage Efficiency
![Page 64: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/64.jpg)
Keeping 3 copies is 33.3% efficient
Compare to distributed, software-defined RAID-1
Best option for performance – read any copy, write to all copies
Mirroring Is Costly
300 TB PHYSICAL
100 TB USABLE
![Page 65: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/65.jpg)
Possible from 4+ servers
Same fault tolerance – two simultaneous drive or server failures
Compare to distributed, software-defined RAID-6
Up to 80% Efficient!
300 TB PHYSICAL
240 TB USABLE
Erasure Coding
![Page 66: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/66.jpg)
Problem 1
To rebuild from one failure, you have to read every column, which ties up valuable IOPS.×
×
Limitations
Problem 2
Every write incurs an update of the erasure encoding, which ties up valuable CPU.
Actively written data means calculating the encoding over and over again...
This easily doubles the computational work involved in every write!
![Page 67: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/67.jpg)
New technique developed at Microsoft Research
Faster recovery from single failures by reconstructing from local group only
Groups of 4 for HDDs, 6 for SSDs
Local Reconstruction Codes
0
0
0
1
1
0
1
1
0
1
0
1
0
1
0
1
0
0
1
0
1
0
0
1
0
0
1
1
1
0
0
0
0
1
1
0
1
1
0
1
0
1
0
1
0
1
0
0
1
0
1
0
0
1
0
0
1
1
1
0
0
0
0
1
1
0
1
1
0
1
0
1
0
1
0
1
0
0
1
0
1
0
0
1
0
0
1
1
1
0
1
0
1
0
1
0
Group Group Group
Global Parity
![Page 68: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/68.jpg)
Extends erasure coding to hard disks!
![Page 69: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/69.jpg)
Servers SSD + HDD All SSD
Layout Efficiency Layout Efficiency
4 RS 2+2 50% RS 2+2 50%
5 RS 2+2 50% RS 2+2 50%
6 RS 2+2 50% RS 2+2 50%
7 RS 4+2 66% RS 4+2 66%
8 RS 4+2 66% RS 4+2 66%
9 RS 4+2 66% RS 6+2 75%
10 RS 4+2 66% RS 6+2 75%
11 RS 4+2 66% RS 6+2 75%
12 LRC (8,2,1) 72% RS 6+2 75%
13 LRC (8,2,1) 72% RS 6+2 75%
14 LRC (8,2,1) 72% RS 6+2 75%
15 LRC (8,2,1) 72% RS 6+2 75%
16 LRC (8,2,1) 72% LRC (12,2,1) 80%
![Page 70: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/70.jpg)
Front erasure coded volumes with small mirror portion
Write hot data into mirror portion
As it becomes cold do parity encoding just once
This is real-time tiering, not scheduled
Accelerating Erasure Coding
ERASURECODING
MIRROR
Writes
ReFS
Data Rotation
![Page 71: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/71.jpg)
Extends erasure coding to mixed hot/cold data!
![Page 72: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/72.jpg)
Storage Efficiency
Storage Spaces Direct
![Page 73: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/73.jpg)
CPU Efficiency
![Page 74: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/74.jpg)
Storage Spaces Direct is kernel-embedded.
![Page 75: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/75.jpg)
Remote Direct Memory Access
No dedicated storage fabric – just Ethernet
Lots of “East-West” traffic to synchronize data between servers
RDMA allows this to largely bypass CPU, leaving more resources for Virtual Machines!
![Page 76: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/76.jpg)
?
50%
CPU for 400,000 IOPS, 70% Read, 30% Write, 4k Random
8 x Servers, Intel Xeon E5-2660v3 (10C/2.60GHz), 4x 800GB SSD, 12x 4TB HDD, 2x 10Gbps Mellanox ConnectX-3 Pro
![Page 77: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/77.jpg)
33%
50%
CPU for 400,000 IOPS, 70% Read, 30% Write, 4k Random
8 x Servers, Intel Xeon E5-2660v3 (10C/2.60GHz), 4x 800GB SSD, 12x 4TB HDD, 2x 10Gbps Mellanox ConnectX-3 Pro
![Page 78: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/78.jpg)
?
956,889
100% Read 4k Random IOPS at 100% CPU
8 x Servers, Intel Xeon E5-2660v3 (10C/2.60GHz), 4x 800GB SSD, 12x 4TB HDD, 2x 10Gbps Mellanox ConnectX-3 Pro
![Page 79: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/79.jpg)
1,891,946
956,889
100% Read 4k Random IOPS at 100% CPU
8 x Servers, Intel Xeon E5-2660v3 (10C/2.60GHz), 4x 800GB SSD, 12x 4TB HDD, 2x 10Gbps Mellanox ConnectX-3 Pro
![Page 80: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/80.jpg)
Review
Local Reconstruction Codes
Accelerating Erasure Coding
Kernel-Embedded
Remote Direct Memory Access
![Page 81: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/81.jpg)
Performance
Fault Tolerance
Efficiency
Manageability
Cost
![Page 82: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/82.jpg)
Storage Spaces Direct System Center 2016
![Page 83: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/83.jpg)
Deployment in
Virtual Machine Manager 2016
![Page 84: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/84.jpg)
![Page 85: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/85.jpg)
Just one checkbox to enable
Storage Spaces Direct!
![Page 86: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/86.jpg)
Monitoring in
Operations Manager 2016
![Page 87: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/87.jpg)
![Page 88: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/88.jpg)
Drive
Server
Cluster
Drive
Server
Power
Supply
Drive
Network
Adapter
Server Server
Health ServiceContinous built-in monitoring raises alerts
Severity, precise description, recommended action
Event-driven design for minimal resource usage
Root-cause analysis to merge related alerts
Extensive coverage over hardware and software stack
![Page 89: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/89.jpg)
physical disk unresponsivephysical disk lost connectivity physical disk media failure
network adapter failure network adapter disablednetwork adapter disconnected missing cluster network
node down node quarantined node isolatednode temperature sensor
enclosure lost connectivity enclosure power supply failure enclosure fan failure
enclosure current, voltage, or temperature sensor pool unrecognized metadata
volume detachedvolume limited resiliency volume low capacity
service-level agreement breachStorage QoS malformed policy
Storage Replica failure unable to meet recovery point objectiveStorage Replica metadata corruption
physical disk unrecognized metadata physical disk non-compliant physical disk firmware update unsuccessful
![Page 90: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/90.jpg)
All-Up MetricsAggregate performance, capacity, and utilization metrics
No disruption or timeout as servers join or leave
Efficient implementation minimizes resource usage
Simple access via PowerShell or API
Health Service
Server Server Server Server
Consumer
1x
![Page 91: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/91.jpg)
All-Up Metrics
Health Service
![Page 92: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/92.jpg)
Review
We ❤ System Center
Health Service
![Page 93: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/93.jpg)
Performance
Fault Tolerance
Efficiency
Manageability
Cost
![Page 94: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/94.jpg)
…included in Windows Server 2016 Datacenter!
If you run Hyper-V, you already own this!
![Page 95: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/95.jpg)
Hardware Platforms
![Page 96: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/96.jpg)
![Page 97: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/97.jpg)
DELL PowerEdge R730XD
HPE ProLiant DL380 Gen9
Cisco UCS C240 M4
Intel MCB2224TAF3
Quanta D51B-2U (MSW6000)
DataON S2D-3110
Fujitsu Primergy RX2540 M2 Inspur NF5280M4
Lenovo X3650 M5 NEC Express5800 R120f-2M
RAID Inc. Ability™ HCI Series S2D200 SuperMicro SYS-2028U-TRT+
![Page 98: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/98.jpg)
We recommend these meticulously engineered,
extensively validated platforms.
![Page 99: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/99.jpg)
Mini-ITX Motherboard
Intel Xeon D-1540 8-Core 2 GHz
or
Intel Xeon D-1587 16-core 1.7 GHz
4 x 32 GB ECC DDR4
4 x 10TB SATA HDDM.2 SSD 2 x 1.2TB SATA SSD
![Page 100: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/100.jpg)
![Page 101: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/101.jpg)
Server and drive fault tolerance
16 Cores / 32 Threads
36+ TB of mirrored storage capacity
240+ GB of memory for 30-60 mid-sized VMs
Great for remote/branch office!
![Page 102: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/102.jpg)
5028D-TN4T
2U Rack Server
3.44 in x 17.49 in x 26.92 in
11 in x 9.4 in x 8.3 in
14L X2 = 28L
Both nodes together are just
That’s 47% smaller.
![Page 103: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/103.jpg)
Both nodes in
one carry-on bag
Standard: 14 in x 9 in x 22 in2 Server: 9.4 in x 8.3 in x 22 in
![Page 104: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/104.jpg)
Use built-in SATA3 Port, No SAS Expander
Built-in 2x10Gb NIC, Can also add RDMA NIC (optional)
![Page 105: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/105.jpg)
Spaces Direct is more
high performing
resource efficient
budget friendly
![Page 106: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/106.jpg)
Spaces Direct is more high performing
resource efficient
budget friendly
![Page 107: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/107.jpg)
Spaces Direct is more
high performing
resource efficient
budget friendly
![Page 108: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/108.jpg)
Spaces Direct is more
high performing
resource efficient
budget friendly
![Page 109: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/109.jpg)
www.microsoft.com/itprocareercenter
www.microsoft.com/itprocloudessentials
www.microsoft.com/mechanics
https://techcommunity.microsoft.com
![Page 110: Larry Zhang, PM ...Storage Spaces Direct is software-defined, shared-nothing storage. Use industry-standard hardware to build lower-cost alternative to traditional storage. Deployment](https://reader034.fdocuments.net/reader034/viewer/2022043004/5f86e92d78a79c34101d5255/html5/thumbnails/110.jpg)
aka.ms/SpacesDirect