Operating Systems Virtualization mechanisms · 2020. 11. 26. · 1 Introduction 2 Hardware...

35
Operating Systems Virtualization mechanisms René Serral-Gracià Xavier Martorell-Bofill 1 1 Universitat Politècnica de Catalunya (UPC) May 26, 2014

Transcript of Operating Systems Virtualization mechanisms · 2020. 11. 26. · 1 Introduction 2 Hardware...

  • Operating Systems Virtualization mechanisms

    René Serral-Gracià Xavier Martorell-Bofill1

    1Universitat Politècnica de Catalunya (UPC)

    May 26, 2014

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Contents

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud Computing

    5 Management

    6 Practical Tips

    7 Examples

    R. Serral-Gracià, et. al OS Virtualization 2

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud Computing

    5 Management

    6 Practical Tips

    7 Examples

    R. Serral-Gracià, et. al OS Virtualization 3

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Objectives

    Knowledge

    What is virtualizationWhich uses has virtualizationWhich uses does NOT have virtualizationVirtualization solutions

    Abilities

    Create/delete virtual machinesManagement capabilities for virtual machinesVirtual Machine Administration

    R. Serral-Gracià, et. al OS Virtualization 4

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    What is virtualization...

    An abstraction mechanism to manage(by partitioning, by merging,...) physical resources

    Virtualization is based on the creation of one (or more)virtual representations of a particular resourceExamples

    Local Area Network (VLAN)Web Virtual HostsStorage Virtualization (e.g., LVM, Cloud storage)Data Virtualization (e.g., seamless access to information)Hardware Virtualization

    R. Serral-Gracià, et. al OS Virtualization 5

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Hardware Virtualization

    The virtualization affects the whole machine where new“virtual” instance is/are createdThe original OS is called host OSThe other “virtual” OS(s) is/are named guest OSsThe new instances work autonomously and use the hostOS as proxy with the hardwareTypes of Hardware Virtualization

    Full VirtualizationParavirtualizationPartial virtualization

    R. Serral-Gracià, et. al OS Virtualization 6

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanismsFull VirtualizationParavirtualizationOS virtualization

    3 Applications

    4 Cloud Computing

    5 Management

    6 Practical Tips

    7 ExamplesR. Serral-Gracià, et. al OS Virtualization 7

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Full Virtualization – Overview

    Complete emulation of hardware componentsUsing the legacy OS as proxy to the hardware

    Transparent for guest OS

    Hardware

    Standard Host OS

    Virtual Machine Layer

    Virtual Hardware Virtual Hardware Virtual Hardware

    Virtual Machine 1

    Guest OS

    Virtual Machine 2

    Guest OS

    Virtual Machine 3

    Guest OS

    Virtual Machine Manager

    R. Serral-Gracià, et. al OS Virtualization 8

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Full Virtualization – Functionalities and Examples

    Functionalities

    Memory reservationCPU virtualizationVirtual Network Interfaces

    Examples

    MultiplatformVMWareVirtualBox

    LinuxQEmu/KVM

    WindowsMicrosoft R© Hyper-V Server 2008

    MacOSParallels

    R. Serral-Gracià, et. al OS Virtualization 9

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Paravirtualization

    Concurrent execution of different OSManagement Domain controls the rest of OS

    Requires support of the hardware and the OS

    Hardware

    Hypervisor enabled OS

    Hypervisor Management Domain

    Virtual Hardware Virtual Hardware Virtual Hardware

    Virtual Machine 1

    Guest OS

    Virtual Machine 2

    Guest OS

    Virtual Machine 3

    Guest OS

    Hypervisor Manager

    R. Serral-Gracià, et. al OS Virtualization 10

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Paravirtualization – Functionalities and Examples

    Functionalities

    Memory partitioningCPU partitioningNetwork card separationControlled bus access

    ExamplesXenUML

    R. Serral-Gracià, et. al OS Virtualization 11

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    OS Virtualization

    Collaboration between host and guestsDirect access to the hardware form the guestsCan run in userspace

    Requires support of the OSHost and guests use the same OS

    Hardware

    Host OS

    Virtual OS 1 Virtual OS 2 Virtual OS 3

    Concurrent running OS

    R. Serral-Gracià, et. al OS Virtualization 12

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    OS virtualization – Functionalities and Examples

    Functionalities

    Concurrent execution of various instances of the operatingsystem

    ExamplesOpenVZSolaris ContainersBSD JailsLinux Containers

    LXCDocker.io

    R. Serral-Gracià, et. al OS Virtualization 13

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud Computing

    5 Management

    6 Practical Tips

    7 Examples

    R. Serral-Gracià, et. al OS Virtualization 14

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Applications

    Useful for....Energy savingSpace savingLightweight processesService aggregation

    Should not be used for...Heavyweight processesComputational power

    R. Serral-Gracià, et. al OS Virtualization 15

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Applications

    Useful for....Energy savingSpace savingLightweight processesService aggregation

    Should not be used for...Heavyweight processesComputational power

    R. Serral-Gracià, et. al OS Virtualization 15

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Main Functionalities

    Machine level backup/restorationSnapshotsRegular backups

    Machine Pause/SuspendService IsolationResource limitation (CPU, Memory, I/O, Networking)Machine teleporting

    Memory teleportingFull machine teleporting

    CloningCentralized management

    R. Serral-Gracià, et. al OS Virtualization 16

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud ComputingRationaleDelivered Services

    5 Management

    6 Practical Tips

    7 Examples R. Serral-Gracià, et. al OS Virtualization 17

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Rationale under Cloud Computing

    Offer computation, storage, and servicesOutsourcing of IT local resources through well definedAPIsEasy adoption for customers

    Masking operational detailsLess management overheadIncrease in resourcesIncrease in performanceLow cost

    R. Serral-Gracià, et. al OS Virtualization 18

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Delivered services

    Software as a Service

    Software licensed on a subscription based fee modelThrough periodic feesThrough advertisement

    Mostly web basedExamples

    GMailFacebookWhatsapp

    R. Serral-Gracià, et. al OS Virtualization 19

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Delivered services

    Platform as a Service

    Computing platformCustomer deploys application using service providerfeatures into the provider’s premisesProvider offers storage, computation, memory, networks,and other necessary facilitiesExamples

    Amazon Web Services (AWS)Rackspace

    R. Serral-Gracià, et. al OS Virtualization 20

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Delivered services

    Infrastructure as a Service

    Lowest levelProviding hypervisor, networking, storageThe customer is in charge of configuring and administeringeverythingExamples

    Amazon Web Services (AWS)Rackspace

    R. Serral-Gracià, et. al OS Virtualization 21

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud Computing

    5 ManagementVM Creation and DeletionIntegrated Management SolutionsBackups

    6 Practical Tips

    7 ExamplesR. Serral-Gracià, et. al OS Virtualization 22

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    VM Creation

    Required steps to create a VM

    Create system hard driveDynamically allocated – Less space / SlowerStatically allocated – More space / Faster

    Create hardwareCPU(s)MemoryDisk(s)...

    Install the operating systemConfigure services

    R. Serral-Gracià, et. al OS Virtualization 23

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    VM Deletion

    Required steps to delete a VM

    Backup user/shared dataDisable/ban usersStop all the servicesUnregister virtual machineRemove the hard drive

    R. Serral-Gracià, et. al OS Virtualization 24

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    VM Resources Management

    Resource enhancementsMore CPU(s)Memory increaseHard disk resizing

    Different from Filesystem resizing

    System administrationUse passwordless remote administration (ssh, pssh)Create management scripts

    Send command to allInstall to all

    R. Serral-Gracià, et. al OS Virtualization 25

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    VM Resources Management

    Resource enhancementsMore CPU(s)Memory increaseHard disk resizing

    Different from Filesystem resizing

    System administrationUse passwordless remote administration (ssh, pssh)Create management scripts

    Send command to allInstall to all

    R. Serral-Gracià, et. al OS Virtualization 25

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Integrated Management Solutions

    libvirt: virsh, virt-manager http://www.libvirt.orgVMWare vSphere http://www.vmware.com/products/vsphereOpenNebula: http://www.opennebula.org/OpenStack: http://www.openstack.org/

    R. Serral-Gracià, et. al OS Virtualization 26

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Backup mechanisms

    Full Hardware backupUse available facilities within the Virtualization SoftwareUse a master copy of the system

    Regular backup

    Similar to the legacy caseBackup shared storage area

    R. Serral-Gracià, et. al OS Virtualization 27

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Backup mechanisms

    Full Hardware backupUse available facilities within the Virtualization SoftwareUse a master copy of the system

    Regular backup

    Similar to the legacy caseBackup shared storage area

    R. Serral-Gracià, et. al OS Virtualization 27

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud Computing

    5 Management

    6 Practical Tips

    7 Examples

    R. Serral-Gracià, et. al OS Virtualization 28

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Practical Tips

    GUI are evilUse headless setups

    Monitor resource usageUse shared storage for user dataClone the VMsUse different servers

    ResilienceLoad balancing

    R. Serral-Gracià, et. al OS Virtualization 29

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Outline

    1 Introduction

    2 Hardware Virtualization mechanisms

    3 Applications

    4 Cloud Computing

    5 Management

    6 Practical Tips

    7 Examples

    R. Serral-Gracià, et. al OS Virtualization 30

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Management Interface – virt-manager

    Aggregated management and monitoringCreate/Delete/Modify VMsConnect/Disconnect removable media

    R. Serral-Gracià, et. al OS Virtualization 31

  • Introduction Hardware Virtualization mechanisms Applications Cloud Computing Management Practical Tips Examples

    Management Interface – VirtualBox

    Aggregated management and monitoringCreate/Delete/Modify VMsConnect/Disconnect removable media

    R. Serral-Gracià, et. al OS Virtualization 32

    IntroductionHardware Virtualization mechanismsFull VirtualizationParavirtualizationOS virtualization

    ApplicationsCloud ComputingRationaleDelivered Services

    ManagementVM Creation and DeletionIntegrated Management SolutionsBackups

    Practical TipsExamples