Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and...
Transcript of Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and...
![Page 1: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/1.jpg)
Virtualization and containerizationThomas Berreis
![Page 2: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/2.jpg)
Outline
2 / 35
Virtualization
Definition
Advantages / Features
Performance
Lightweight virtualization: Container
Features
Performance
Conclusion
![Page 3: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/3.jpg)
Introduction
3 / 35
RANK SITE SYSTEM
1 National Super Computer Center in GuangzhouChina
Tianhe-2 (MilkyWay-2) - TH-IVB-FEP Cluster, Intel Xeon E5-2692 12C 2.200GHz, TH Express-2, Intel Xeon Phi 31S1PNUDT
2 DOE/SC/Oak Ridge National LaboratoryUnited States
Titan - Cray XK7 , Opteron 6274 16C 2.200GHz, Cray Gemini interconnect, NVIDIA K20xCray Inc.
3 DOE/NNSA/LLNLUnited States
Sequoia - BlueGene/Q, Power BQC 16C 1.60 GHz, CustomIBM
4 RIKEN Advanced Institute for Computational Science (AICS)Japan
K computer, SPARC64 VIIIfx 2.0GHz, Tofu interconnectFujitsu
5 DOE/SC/Argonne National LaboratoryUnited States
Mira - BlueGene/Q, Power BQC 16C 1.60GHz, Custom IBM
Fig: http://www.top500.org/lists/2015/11/
![Page 4: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/4.jpg)
Introduction
4 / 35
global sharing
validation checks
portability
scalability
Fig: http://www.calvertonconsulting.com/wp-content/uploads/2011/12/clear-cloud-computing-diagram.jpg
![Page 5: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/5.jpg)
Definition
5 / 35
technology to split physical environment into logical units
possible for hardware and software
hypervisor as abstraction layer
less of bare-metal
![Page 6: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/6.jpg)
Definition
6 / 35
HypervisorVirtual Machine File System
Fig: http://www.catbird.com/sites/default/files/catbird_threat-surface.jpg
![Page 7: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/7.jpg)
Advantages
7 / 35
energy-saving
space-saving
faster provisioning
isolated applications
environments for developing and testing
Fig: http://www.pressetext.com/news/photo/medium/20081112011/0
![Page 8: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/8.jpg)
Advantages
8 / 35
higher availability
virtual disaster recovery
easier administration
intelligent management of resources
enormous hardware compatibility
VMware Compatibility Guidehttp://www.vmware.com/resources/compatibility/search.php
![Page 9: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/9.jpg)
Techniques - RDMA
9 / 35
RDMA (Remote Direct Memory Access)
Allows to exchange data in main memory without
involving processor, cache or operating system
Minimizes overhead
Improves performance
![Page 10: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/10.jpg)
Techniques - RDMA
10 / 35Fig: http://blogs.vmware.com/cto/files/2014/11/ndm2014-sc14-simons.pdf
![Page 11: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/11.jpg)
Techniques - SR-IOV
11 / 35
SR-IOV (Single Root I/O Virtualization)
presents single I/O device as multiple separate devices
each virtual device has its own
Configuration space, base address registers
Send/receive queues with own interrupts
Specific NIC driver needed
![Page 12: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/12.jpg)
Techniques - DirectPath I/O
12 / 35
Passthrough / VMDirectPath
allows direct and exclusive access to I/O
devices by bypassing the virtualization layer
Incompatibility with many virtualization features
Fault Tolerance
Snapshots
Live Migration
![Page 13: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/13.jpg)
Performance
13 / 35
VMware Test Configuration
4x HP DL380p G8 (3.3 GHz, 128 GB RAM)
Hypervisor: VMware vSphere
ConnectX-2 QDR InfiniBand 10 Gb / RDMA
![Page 14: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/14.jpg)
Performance - Bandwidth
14 / 35
READ WRITE
Fig: https://blogs.vmware.com/cto/running-hpc-applications-vsphere-using-infiniband/
![Page 15: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/15.jpg)
15 / 35
READ WRITE
Performance - Latency
Fig: https://blogs.vmware.com/cto/running-hpc-applications-vsphere-using-infiniband/
![Page 16: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/16.jpg)
Performance - Summary
16 / 35
Virtualized HPC performance close to bare-metal
Fig: http://blogs.vmware.com/cto/files/2014/11/ndm2014-sc14-simons.pdf
![Page 17: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/17.jpg)
Performance - Summary
17 / 35
Latency almost identical in future releases(?)
Fig: http://blogs.vmware.com/cto/files/2014/11/ndm2014-sc14-simons.pdf
![Page 18: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/18.jpg)
Celebrities
18 / 35
ESX (VMware)
Hyper-V (Microsoft)
KVM (Red Hat)
XEN (Citrix)
![Page 19: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/19.jpg)
19 / 35
International work …
Reconstruct some Chinese research findings …
红旗 Linux … what the heck?!
Fig (l): https://pixabay.com/static/uploads/photo/2013/07/13/09/41/communist-155926_640.pngFig (r): http://english.cas.cn/images/en_pol_02_2014en.png
Use Case - Problem
![Page 20: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/20.jpg)
20 / 35
Strange operating system?
Incompatible system libraries?
Virtualization!
Use of independent well-known environments
Of course compatible with our software
Easy to provide and remove
Use Case - Solution
![Page 21: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/21.jpg)
Container
21 / 35Fig: http://s.sk-gaming.com/image/album/633800/e5dd665af4c1b7ff_large.jpg
![Page 22: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/22.jpg)
Container
22 / 35
without hypervisor but also with virtualization layer
uses system libs and kernel (limited to host ecosystem)
non virtualized drivers
namespaces to isolate processes
CGroups to isolate or limit resource usage
partly layered file systems
![Page 23: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/23.jpg)
Container
23 / 35Fig: http://www.spantree.net/blog/2015/04/29/10-things-to-know-about-docker.html
![Page 24: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/24.jpg)
Performance
24 / 35
NASA Advanced Supercomputing Parallel Benchmarks(Hypervisor: QEMU KVM)
Fig: http://en.community.dell.com/techcenter/high-performance-computing/b/general_hpc/archive/2014/11/04/containers-docker-virtual-machines-and-hpc
![Page 25: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/25.jpg)
Performance
25 / 35
Other high performance applications
Fig: http://en.community.dell.com/techcenter/high-performance-computing/b/general_hpc/archive/2014/11/04/containers-docker-virtual-machines-and-hpc
![Page 26: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/26.jpg)
Performance
26 / 35
SYSBENCH OLTP with Red Hat 7 & Docker
Fig: https://s3.amazonaws.com/media-p.slid.es/uploads/jeremyeder/images/536393/bare-metal-vs-docker-sysbench-oltp.png
![Page 27: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/27.jpg)
Celebrities
27 / 35
Docker
LXC
OpenVZ
Solaris Zones
FreeBSD Jails
![Page 28: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/28.jpg)
Use Case - Problem
28 / 35
Develop an application that fits in your HPC environment …
You have to test your application in this environment …
You cannot virtualize this damn special OS …
Developing on your client is pointless …
![Page 29: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/29.jpg)
Use Case - Solution
29 / 35
Multitenancy architecture
Work in a container within this environment
Independent to other applications / containers
Test, QA and Production possible in same environment
Without any overhead
![Page 30: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/30.jpg)
Conclusion
30 / 35
each kind of virtualization has pros and cons
container not replacing virtual machines
containerization is not only a passing fad
requirements are crucial
containerization quite adapted for HPC
![Page 31: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/31.jpg)
Conclusion
31 / 35Fig: http://www.spantree.net/blog/2015/04/29/10-things-to-know-about-docker.html
![Page 32: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/32.jpg)
Conclusion – a fusion?
32 / 35
basically possible
but
advantages gets lost
bottleneck effect
Fig: https://mydigitalworkplace.files.wordpress.com/2012/05/bottleneck.gif
![Page 33: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/33.jpg)
Conclusion
33 / 35Fig: http://blogs.vmware.com/performance/files/2014/10/linpack.png
![Page 34: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/34.jpg)
Customers
34 / 35
PayPal Groupon Uber eBay Spotify BBC News yelp
Deutsche Telekom Beiersdorf Symantec Adobe SAP Vodafone HP
![Page 35: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/35.jpg)
Conclusion
35 / 35
Much more about virtualization we cannot discuss today:
The UberCloud Experiment
AWS | Amazon Elastic Compute Cloud
OpenStack Open Source Cloud Computing Software
Apache CloudStack Open Source Cloud Computing
VMware vSphere Big Data Extensions
Virtualized InfiniBand
Kubernetes by Google
…
![Page 36: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/36.jpg)
![Page 37: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/37.jpg)
References https://en.wikipedia.org/wiki/Hypervisor Slides 5 - 8 | 11.2015
https://en.wikipedia.org/wiki/Virtual_machine Slides 5 - 8 | 11.2015
http://www.tecchannel.de/server/virtualisierung/2029842/faq_alles_ueber_virtualisierung_varianten_und
_unterschiede/ Slides 5 - 8 | Bertram Wöhrmann, 03.09.2012
http://www.infoworld.com/article/2621446/server-virtualization/server-virtualization-top-10-benefits-of-
server-virtualization.html Slides 5 - 8 | David Marshall, 02.11.2011
https://www.vmware.com/de/products/vsphere/features/vmfs Slide 6 | 11.2015
https://www.vmware.com/de/business-continuity/disaster-recovery Slide 8 | 11.2015
http://glennklockwood.blogspot.de/2013/12/high-performance-virtualization-sr-iov.html
Slide 11 | Glenn K. Lockwood, 03.12. 2013
![Page 38: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/38.jpg)
References http://blogs.vmware.com/cto/hpc-update/ | Josh Simons, 31.10.2014
http://blogs.vmware.com/cto/files/2014/11/ndm2014-sc14-simons.pdf Slides 10, 16, 17 | Josh Simons, 11.2014
https://www.thomas-krenn.com/de/wiki/VMware_VMDirectPath_zum_Durchreichen_von_PCI_Karten
Slide 12 | Werner Fischer, 18.05.2015
https://blogs.vmware.com/cto/running-hpc-applications-vsphere-using-infiniband/
Slides 13 - 15 | Josh Simons, 22.12.2014
http://www.rdmamojo.com/2014/03/31/remote-direct-memory-access-rdma/ | Dotan Barak, 31.03.2014
https://en.wikipedia.org/wiki/Red_Flag_Linux Slide 19 | 11.2015
http://www.spantree.net/blog/2015/04/29/10-things-to-know-about-docker.html
Slides 22, 23, 31 | Cedric Hurst, 29.04.2015
![Page 39: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/39.jpg)
References https://en.wikipedia.org/wiki/UnionFS Slide 22 | 11.2015
http://sleekd.com/servers/docker-vs-virtualization/ Slide 22 | Razvan, 29.09.2014
https://access.redhat.com/documentation/en-
US/Red_Hat_Enterprise_Linux/6/html/Resource_Management_Guide/ch01.html Slide 22 | 11.2015
http://www.nas.nasa.gov/publications/npb.html Slide 24 | 11.2015
http://en.community.dell.com/techcenter/high-performance-
computing/b/general_hpc/archive/2014/11/04/containers-docker-virtual-machines-and-hpc
Slides 24, 25 | Nishanth Dandapanthula, 04.11.2014
http://developerblog.redhat.com/2014/08/19/performance-analysis-docker-red-hat-enterprise-linux-7/
Slide 26 | Jeremy Eder, 19.08.2014
![Page 40: Virtualization and containerization - Scientific Computing ... · PDF fileVirtualization and containerization Thomas Berreis. Outline. 2 / 35 Virtualization Definition Advantages](https://reader031.fdocuments.net/reader031/viewer/2022013006/5aa3ccb57f8b9a80378eb5e7/html5/thumbnails/40.jpg)
References https://de.wikipedia.org/wiki/Online_Transaction_Processing Slide 26 | 11.2015
http://blogs.vmware.com/performance/2014/10/docker-containers-performance-vmware-vsphere.html
Slide 33 | Banit Agrawal, 15.10.2014
http://www.top500.org/project/linpack/ Slide 33 | 11.2015
http://www.vmware.com/a/customers/customer Slide 34 | 11.2015
https://www.docker.com/customers Slide 34 | 11.2015
http://www.mellanox.com/page/virtualization | 11.2015
http://nowlab.cse.ohio-state.edu/static/media/publications/abstract/huangwei-ics06.pdf
| Wei Huang, 06.2006