Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure...
Transcript of Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure...
![Page 1: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/1.jpg)
Storage for 2020 Technologies Shaping Storage Infrastructure [email protected] Technical Director, CTO Office
27 May, 2015
© 2015 NetApp, Inc. All rights reserved..
![Page 2: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/2.jpg)
Exponential Growth of Computing
http://www.singularity.com/charts/page70.html
Fact, or Fiction?
© 2015 NetApp, Inc. All rights reserved.
![Page 3: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/3.jpg)
© 2015 NetApp, Inc. All rights reserved. 3
![Page 4: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/4.jpg)
© 2015 NetApp, Inc. All rights reserved.
Networked Storage
![Page 5: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/5.jpg)
© 2015 NetApp, Inc. All rights reserved. 5
Object Store
NAS/ SAN
Ext-DAS
PCIe Flash
![Page 6: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/6.jpg)
Archival Drives use Shingling
http://www.slideshare.net/hgststorage/navigating-storage-in-a-cloudy-environment
Write-head wider than Read-head
© 2015 NetApp, Inc. All rights reserved. 6
![Page 7: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/7.jpg)
Archival Drives
§ Summary § ~16TB capacity through end of the decade § 30% reduction in RPM (as compared to SATA) § ½ the cost of SATA § Cannot be in continuous operation – ~30% duty cycle § 200TB Workload limit as compared to 3,000TB for NL SATA
§ Good § Very low cost, high capacities § Duty cycle will force the data center to run cooler
§ Challenges § Traditional RAID will not work; traditional scrubs and resiliency techniques will not work § Impact on storage efficiency § Typically a whole track needs to be written (~256MB); much like an extreme FTL § Random overwrites do not work – much like a Tape
© 2015 NetApp, Inc. All rights reserved 7
![Page 8: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/8.jpg)
© 2015 NetApp, Inc. All rights reserved.
![Page 9: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/9.jpg)
SCM
§ Summary § 30x better resilience (than the best Flash) § 10x the cost (of cheapest Flash) § 1/10th the media latency (of the fastest Flash)
§ Good § Opportunity to reduce the server footprint due to increased transaction rates § Run the data center cooler (no refresh)
§ Challenges § Applications/ libraries need to coordinate the data movement across volatile and
protected regions of the CPU complex. Transaction complexity? § Software overheads of IO stack are very high § New fail-safe data structure variants need to evolve § Much higher troubleshooting complexity § Will be till end of the decade before the tool-chains and ecosystem matures
© 2015 NetApp, Inc. All rights reserved. 9
![Page 10: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/10.jpg)
© 2015 NetApp, Inc. All rights reserved
![Page 11: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/11.jpg)
Persistence Moves to Host
§ Non-MPHA hardware
§ Distributed shared-nothing architecture is mandated
§ RDMA starts to be really needed … finally! § Also leveraged by NVMe over Fabrics
© 2015 NetApp, Inc. All rights reserved. 11
![Page 12: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/12.jpg)
© 2015 NetApp, Inc. All rights reserved.
![Page 13: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/13.jpg)
Where are we today?
§ Performance: NVMe devices on the PCIe bus § 600K sustained Read IOPs § Soon at 10us access latency § Will incumbent applications be able to leverage this?
§ Capacity Flash: cMLC § ~2K Program-Erase cycles § Need to dramatically reduce the write-amplification
© 2015 NetApp, Inc. All rights reserved. 13
![Page 14: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/14.jpg)
Virtualization 2.0?
§ Application-granular data management
§ Actually, “application container” driven
§ Different approaches – much higher application density § VVOL (VMware) like approach § Docker/ CoreOS (Linux Namespace and Cgroups)
§ Evolution of Virtio based IO § The control point is compelling for low latency media operations
© 2015 NetApp, Inc. All rights reserved. 14
![Page 15: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/15.jpg)
Scale as a “Data Management” Attribute
§ On the scale that Moore’s Law is linear, the data growth is on an exponential trajectory § Only way to offset it is to scale-out
§ Leverage Server Supply Chain to lower cost § Even then so, there would be “Performance Blades” and “Capacity Blades”
§ Too many moving parts § Increases management complexity § Troubleshooting § Unless …
© 2015 NetApp, Inc. All rights reserved. 15
![Page 16: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/16.jpg)
Pack in the Intelligence of a Human
§ Autonomic Data Management @Scale § Capacity Balancing § Hot-spot elimination § Auto Recovery § Service-level Restoration § De-clustered “RAID” § Topology aware data placement
§ Simplified Namespaces § No storage-admin visible containers § Single large data pools
§ Also enables migration into the Public Infrastructure (aka Cloud)
© 2015 NetApp, Inc. All rights reserved 16
![Page 17: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/17.jpg)
Before Security comes Provenance!
§ Tracking data and lineage – tagging volumes, VMs, LUNs, Objects
§ Allows one to enforce data migration compliance across the data fabric § Restricting data movement across Geo boundaries § Restricting certain kinds of data to be moved outside the Data Center § That will also help to determine what is being stored
§ This tagging provides explicit information about data objects to storage § Only economics can drive this behavior § Implicit information has been available through system metadata and access patterns
© 2015 NetApp, Inc. All rights reserved. 17
![Page 18: Storage for 2020 · Storage for 2020 Technologies Shaping Storage Infrastructure Gaurav.Makkar@netapp.com Technical Director, CTO Office 27 May, 2015 © 2015 NetApp…](https://reader031.fdocuments.net/reader031/viewer/2022013014/5af69ff47f8b9a8d1c8f21a3/html5/thumbnails/18.jpg)
In Closing …
§ Best of breed storage will continue to evolve – one size does not fit all
§ Latency sensitive IOPs will be served closer to the host
§ Virtualization will evolve into making protocols irrelevant
§ Autonomic operations help simplify storage, reduce cost
§ Cloud economics will drive explicit intelligence about data
© 2015 NetApp, Inc. All rights reserved. 18