Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor:...

73
© 2006 IBM Corporation Open Computing @ IBM Innovation that matters Virtualization and Xen Jim Elliott Advocate – Infrastructure Solutions Manager – System z Operating Systems IBM Canada Ltd.

Transcript of Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor:...

Page 1: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

© 2006 IBM Corporation

Open Computing @ IBM

Innovation that matters

Virtualization and Xen

Jim ElliottAdvocate – Infrastructure SolutionsManager – System z Operating SystemsIBM Canada Ltd.

Page 2: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

© 2006 IBM Corporation

Open Computing @ IBM

Innovation that matters

An Introduction to VirtualizationWhat is it, and why is it important to you?

Page 3: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

3 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Today’s business challenges

Control and reduce corporate operating costsInvest in innovation that delivers business value in shorter cyclesMaximize the return on past investments including ITImprove management of corporate risks

How to do more with less

Page 4: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

4 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Technology implications

CEO agenda– Control and reduce corporate

costs– Innovation now– Maximize return on past

investment– Manage corporate risksCIO agenda– Control and reduce IT costs– Leverage new technologies which improve time to market

business value– Maximize return on past infrastructure investments– Improve IT resilience and security

Page 5: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

5 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

The simplification imperative

“Our infrastructure grew organically over the years without a master plan –things got bolted on – and now we are stuck where we are.”– CIO from a Fortune 1000 company

“Data centers have become so fragile that administrators are fearful to touch the existing infrastructure, since any changes may set off a series of events that can bring a company to its knees. Consequently, many enterprises are restricted in deploying innovative applications that could potentially create competitive advantage.”– The Yankee Group January 2005

Page 6: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

6 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Complexity is driving costs

Cost of mgmt and admin 10% CAGRNew server spending (USM$) 3% CAGR

Spending (USB$) Installed Base (M Units)

$0

$20

$40

$60

$80

$100

$120

$140

$160

$180

$200

1996 ’97 ’98 ’99 2000 ’01 ’02 ’03 ’04 ’05 ’06 ’07 ’08

5

10

15

20

25

30

35

Source: IDC

Cost of people versus spending on new systems

Page 7: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

7 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Virtualization is a fundamental imperative

“Virtualization is the process of presenting computing resources in ways that users and applications can easily get value out of them, rather than presenting them in a way dictated by their implementation, geographic location, or physical packaging. In other words, it provides a logical rather than physical view of data, computing power, storage capacity, and other resources.”– Jonathan Eunice, Illuminata Inc.

Page 8: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

8 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Value of a virtualized infrastructure

Increase utilization– Most practical choice to achieve full consolidation– Capability to pool resources to service a workload – Can improve availability and reliability (LPAR, SAN, Clustering)Improve productivity– Creates virtualized infrastructure for test and development– Improves rapid deployment and scaling of workloads– Use common tools across many systems, simplified resource

managementLink infrastructure performance to business goals – Use policy to adjust resources based on requirements of the business– Analyze application performance based on business policy– Improve business resilience

Page 9: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

9 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Top virtualization motivators

9.0%

9.2%

9.2%

10.2%

10.9%

10.9%

12.6%

13.1%

14.6%

51.7%

More efficient environment

Hardware costs

Performance

Reliability

Scalability

Reduce floor space

Reduce maint / Mgmt / Admin

Flexibility

Simplify mgmt / Maint

Cost savings

IDC Server Virtualization Multi-Client Study, 2005 “Question: What are the top 3 reasons that your organization virtualized servers?” Multiple responses allowed, therefore percentages may exceed 100% of the sample. Sample size = 420

Page 10: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

10 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Sources:http://www.liebert.ws/liebertmadara/liebertmadara_files/Default.htm#nopreload=1 Datacom Equipment Power Trends and Cooling Applications, ASHRAE 2005* http://www.ibm.com/press/us/en/pressrelease/7775.wss

Power and coolingInstallation heat and power levels are major concern

1%

1%

6%

7%

10%

13%

13%

14%

17%

18%

23%

39%

57%

78%

Other

Software issues

Staffing/Training

Service delivery

Sarbanes Oxley

Hardware reliability

Datacenter consolidations

Justifying expenditures

Security

Monitoring

Technology changes

Space constraints

Availability

Heat/Power density

Demands are doubling every 4 years

Page 11: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

12 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Source: STG MI (Winter 2006)

0%

10%

20%

30%

40%

50%

3Q04 4Q04 1Q05 2Q05 3Q05 4Q05

Implemented Plan to Extend Plan in 1 Year

29% of sites implemented

49% of sites have or plan to implement

Virtualization momentum

Page 12: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

13 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Logical representation of resources not constrained by physical limitations– Create many virtual resources within single physical

device– Reach beyond the box – see and manage many virtual

resources as one– Dynamically change and adjust across the infrastructure

What is virtualization?

Page 13: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

14 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

* Resources include: processors, memory, I/O adapters and devices, networking interfaces, co-processors

Partitioning is the division of a single server’s resources* into multiple, independent, isolated systems capable of running theirown operating systemThree types of partitioning:– Hardware – resources are allocated to partitions on a one-to-one

basis with the underlying physical hardware (no sharing among partitions)

– Logical – resources are managed by hardware firmware and allocated to partitions with a finer granularity than hardware partitioning (resource sharing among partitions)

– Software – resources are managed by a software layer, aggregated into shared resource pools, and apportioned to users as virtual system resources, separating the presentation of the resources from theactual physical entities

What is partitioning?

Page 14: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

15 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Hardware partitioning subdivides a server into fractions, each of which can run an OSHypervisors use a thin layer of code to achieve fine-grained, dynamic resource sharingType 1 hypervisors with high efficiency and availability will become dominant for serversType 2 hypervisors will be mainly for clients where host OS integration is desirable

Hypervisor software/firmwareruns directly on server

Hypervisor software runs ona host operating system

System z PR/SM and z/VMPOWER HypervisorHP Integrity VMVMware ESX Server

VMware GSXXen HypervisorMicrosoft Virtual ServerUser Mode Linux

Sun Domains, HP nPartitions

Logical partitioning

Physical partitioning

System p LPAR, HP vPartitions

Adjustablepartitions

PartitionController

...

SMP Server

OS

Apps

OS

Apps

Hypervisor

SMP Server

...OS

Apps

OS

Apps

Host OS

SMP Server

Hypervisor

...OS

Apps

OS

Apps

Hardware Partitioning Hypervisor: Type 1 Hypervisor: Type 2

Server Virtualization Approaches

Page 15: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

16 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

“Trapping and mapping” methodHypervisor technologies

Guest operating system runs in user modeHypervisor runs in privileged modePrivileged instructions issued by guest operating system(s) are trapped by hypervisorIA-32 (Intel) complications:– Some instructions behave differently in privileged and user modes

• For example, “POPF” treatment of the interrupt enable flag– User mode instructions that access privileged resources/state cannot

be trapped; instruction must be changed to something that can betrapped

Some guest kernel binary translation may be requiredOriginally used by mainframes in 1960s and 1970s (VM/370)Used today by VMware, Microsoft VS, …

Page 16: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

17 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Hypervisor call method (“paravirtualization”)Hypervisor technologies

Guest operating system runs in privileged modeHypervisor runs in super-privileged modeGuest operating system kernel (e.g., AIX, i5/OS, Linux) is modified to do hypervisor calls for I/O, memory management, yield rest of time slice, etc.Memory mapping architecture is used to isolate guests from each other and to protect the hypervisorUsed by XEN and POWER5 today

Page 17: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

18 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Direct hardware support methodHypervisor technologies

Guest operating system runs in privileged modeGuest operating system can be run unmodified, but can issue some hypervisor calls to improve performance or capability– I/O (z/VM) or yield time slice (PR/SM and z/VM)Extensive hardware assists for hypervisor (virtual processor dispatching, I/O pass-through, memory partitioning, etc.)Used by System z (PR/SM and z/VM) today– Used by VMware and Xen with Intel VT and AMD Pacifica

in the future

Page 18: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

19 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Intel and AMD software solutions Platform overview of virtualization technology

Microsoft Virtual Server 2005Xen VMware ESX ServerOthers (e.g., SWsoft Virtuozzo, QEMU, Virtual Iron, …)Hardware architecture enhancements are arriving now– Intel: Virtualization Technology (Silverdale/Vanderpool) –

“With enhancements to Intel’s various platforms, Intel Virtualization Technology can improve the robustness and performance of today’s software-only solutions.”

– AMD: Pacifica – “Pacifica is designed to provide foundation technologies to deliver IT resource utilization advantages through server consolidation, legacy migration and increased security.”

Page 19: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

20 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Microsoft Virtual Server 2005

Allows multiple operating systems to run simultaneously on the same processorEach independent virtual machine functions as a self-contained computerVirtual machines are encapsulated in portable Virtual Hard Disks(VHDs)– Up to 32 VHDs can connect to a single virtual machine– VHDs can expand as data is added and “differenced”Virtual networking options are availableRequires a hosting operating system (Windows Server 2003)– No charge for MS VS, but you need a WS2003 license for every four

guestsWell suited for hosting unsupported Windows NT environmentsNative Windows Server 2003 environment still recommended for many workload deployments

Page 20: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

21 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Microsoft Virtual Server 2005 – architecture

Optimized for 2 to 8 way serversScales up to 32 CPUs and up to 64 GB

Server hardware

Windows Server 2003 32-bit supported hostBroad device compatibility

Windows Server 2003

Multithreaded virtual machine monitor (VMM)provides isolation

Virtual Server 2005

1 CPU per virtual machineUp to 3.6 GB of memory per virtual machine

Virtual hardware

Virtual hardware

Windows NT 4 Server, Windows 2000 Server, Windows Server 2003

Guest operating

system and applications

Guest operating

system and applications

Page 21: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

22 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Xen 3.0

Open Source virtualization software solution based on LinuxUses paravirtualization to abstract CPU, memory, and I/O resourcesGuest operating systems are responsible for allocating and managing page tablesManagement and control software runs in Domain 0Currently does not support Windows (kernel modification required)Intel Virtualization Technology (IVT) will enable hosting of unmodified guest operating systemsIBM is actively contributing to the Xen open source project

Page 22: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

23 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

z86 partitioning with VMware Infrastructure 3

VMware Infrastructure 3 runs directly on the hardware– No hosting operating system required (as is the case with VMware Server)Supports blade servers as well as standalone Intel serversCreates multiple virtual machines on a single Intel system – Supports a maximum of 80 virtual machines per VMware image

(depending on system resources)Manages resource allocations– Strong fault and security isolation (uses CPU hardware protection)– Virtual networking support available (MAC or IP addressing)– Direct I/O passthroughShared data cluster-readyScalable to large virtual machines and high (Intel) performanceVMware File System allows multiple virtualdisks to be stored on a single LUN or partitionVirtual machines are encapsulatedAdd-on products available– VMware Virtual SMP allows virtual machines

to be configured with up to 4 CPUs– VMware VirtualCenter

Page 23: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

24 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Non-x86 software solutions Platform overview of virtualization technology

HP– Node Partitions (nPARs) – hardware partitioning solution– Virtual Partitions (vPARs) – software solution that only supports

HP/UX– Virtual Server Environment (VSE) – for HP Integrity and HP 9000

serversSun– Dynamic Domains – hardware partitioning solution– Solaris Containers – all containers (“zones”) share the same copy of

SolarisIBM POWER5– LPAR-like solution with I/O and network sharing accomplished via

hosted partitions– Supports AIX, Linux, and i5/OSIBM System z– LPAR and hypervisor solutions

Page 24: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

25 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

HP virtualization / partitioning capabilities

nPars: PA-RISC servers with HP-UX, IPF servers with HP-UX, Linux, Windows and in the future OpenVMSvPars: PA-RISC only, not currently supported on IPF (but imminent)Resource partitions: HP-UX only (similar to Solaris “containers”)Partition management software:– Parmgr: basic nPar

management for PA-RISC and IPF servers

– vParmgr: basic vParmanagement within nPars for PA-RISC servers

Physical (nPARs)

VirtualizationMax 16

Model

dependent

Virtual (vPARs)

Max 4Per nPar

All commentary on this page is based upon IBM’s view.

Page 25: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

26 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

All commentary on this page is based upon IBM’s view.

Sun virtualization / partitioning capabilities

Solaris containers– Solaris containers are NOT a virtualization capability.– Enables multiple applications to run on a single OS instance, claiming:

• Application independence and isolation• Managed resources via Solaris resource manager• High server utilization

Sun domains– Allows blended technology (mixed CPUs)

and electrical isolation between system boards– Partitioning granularity at the board level

• CPUs and memory move together

• I/O moved in four slot increments

• Sub processor allocation not possible

• Partitioning is not available on V480, V490, V880, V890, V1280 or V2900

Physical (DSDs)

VirtualizationMax 18

Model

dependent

Dynamic System

Domains

Page 26: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

27 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Dynamic logical partitioning– Minimum 1/10 of a CPU– Dedicate or share processors– Dedicate or share I/O adaptersVirtual I/O*– Virtual SCSI– Shared Ethernet– Clients: AIX 5.3, LinuxVirtual Ethernet– In memory cross partition network– Clients: AIX 5.3, Linux, i5/OSDynamic operations– AIX, i5/OS, SLES 9– Can be automatedPartition security– POWER4: EAL4+– Statement of direction for POWER5

Virtual Ethernet

Virtual I/O

POWER Hypervisor

I/O I/O I/O I/O

CPU CPU CPU CPU CPU

i5/OS AIXLinuxVirtual*

I/O

* Provided by Virtual I/O Server on System p and i5/OS hosting partition on System i

IBM Advanced Power Virtualization (APV)

Page 27: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

28 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

System z virtualization / partitioning

IFL Processors

Memory

z/VM

Linux Linux CMS Linux

L P A R

Memory

z/OS

L P A R

Control Program

WebSphere

Memory

L P A R

Processor Resource / System Manager (PR/SM)

Traditional OLTP and

BatchApacheSysAdmin

Tools

WebSphere

Test

HiperSockets & Virtual Networking and Switching

WLM WLM

I/O & Network

Processors

z/OS

z/VM

Linux

FTP

z/OS

Test

Memory

L P A R

System z provides two levels of partitioning– PR/SM

enablesscalablevirtual serverhosting for LPAR environments

– z/VM provides hypervisor function for highly scalable virtualization

Page 28: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

29 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Logical Partitions (LPARs)

z/VM 5.2 – 64-bit support –real and virtual

Virtual Servers z/VM

z/VM – Unlimited virtualization

Mature technology – z/VM introduced in 1967 Software Hypervisor integrated in hardware– Sharing of CPU, memory and I/O resources– Virtual network – virtual switches/routers – Virtual I/O (mini-disks, virtual cache, …)– Virtual appliances (SNA/NCP, etc.)Easy management– Rapid install of new servers – cloning or IBM

Director task z/VM Center– Self-optimizing workload management– Excellent automation and system

management facilities– Flexible solution for test and development

systems

Page 29: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

31 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Key points to remember about virtualization

Virtualization is not about higher performance– Applications are not going to run faster on servers engaged in application

consolidation. It is very important, though, that applications not run perceptibly slower. Increased efficiency and simplified management is the objective.

Higher utilization (virtualization) is directly proportional to available server throughput– All virtualization technologies must work within resource constraints of server

infrastructure. (All servers have a finite throughput capability.)– Throughput potential can best be identified with “changed data” benchmarks.Virtualization will not overcome a weak server architecture– Virtualization introduces mixed / random / unpredictable behavior. Applications

have different instruction and data working sets, putting dynamic pressure on the server interconnect.

– Customers cannot afford to consolidate applications on low reliability servers!A history with virtualization matters– Virtualization on IBM System z and POWER is an integration of hardware,

firmware and software. All other architectures are physical and/or software implementations.

– Security, isolation, fair-share scheduling are not buzzwords. Common criteria certification.

Page 30: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

© 2006 IBM Corporation

Open Computing @ IBM

Innovation that matters

Xen and the Art of Virtualization

Page 31: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

36 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Outline

Xen ArchitectureNew Features in Xen 3.0VM RelocationXen RoadmapQuestions

Thanks to Ian Pratt of the Xen project and XenSourcefor permission to use his presentation as a base for this section

Page 32: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

37 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

X

Consolidate under-utilized servers

Avoid downtime with VM Relocation

Dynamically re-balance workload to guarantee application SLAs

X Enforce security policyX

Virtualization in the Enterprise

Page 33: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

38 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Xen 2.0 2005-11-05

Secure isolation between VMsResource control and QoSOnly guest kernel needs to be ported– User-level apps and libraries run unmodified– Linux 2.4/2.6, NetBSD, FreeBSD, Plan9, Solaris x86

Execution performance close to nativeBroad x86 hardware supportLive relocation of VMs between Xen nodes

Page 34: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

39 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Para-Virtualization in Xen

Xen extensions to x86 arch – Like x86, but Xen invoked for privileged ops– Avoids binary rewriting– Minimize number of privilege transitions into Xen– Modifications relatively simple and self-contained

Modify kernel to understand virtualised environment– Wall-clock time vs. virtual processor time

• Desire both types of alarm timer– Expose real resource availability

• Enables operating system to optimise its own behaviour

Page 35: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

40 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Xen 2.0 Architecture

Event Channel Virtual MMUVirtual CPU Control IF

Hardware (SMP, MMU, physical memory, Ethernet, SCSI/IDE)

NativeDeviceDrivers

Guest OS(XenLinux)

Device Manager &

Control software

VM0

Guest OS(XenLinux)

UnmodifiedUser

Software

VM1

Front-EndDevice Drivers

Guest OS(XenLinux)

UnmodifiedUser

Software

VM2

Front-EndDevice Drivers

Guest OS(Solaris)

UnmodifiedUser

Software

VM3

Safe HW IF

Xen Virtual Machine Monitor

Back-Ends

Front-EndDevice Drivers

Page 36: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

41 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Xen 3.0 Architecture

Event Channel Virtual MMUVirtual CPU Control IF

Hardware (SMP, MMU, physical memory, Ethernet, SCSI/IDE)

NativeDeviceDrivers

Guest OS(XenLinux)

Device Manager &

Control software

VM0

Guest OS(XenLinux)

UnmodifiedUser

Software

VM1

Front-EndDevice Drivers

Guest OS(XenLinux)

UnmodifiedUser

Software

VM2

Front-EndDevice Drivers

UnmodifiedGuest OS(WinXP))

UnmodifiedUser

Software

VM3

Safe HW IF

Xen Virtual Machine Monitor

Back-End

VT-x

x86_32x86_64

IA64

AGPACPIPCI

SMP

Front-EndDevice Drivers

Page 37: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

42 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

I/O Architecture

Xen IO-Spaces delegate guest operating systems protected access to specified hardware devices– Virtual PCI configuration space– Virtual interrupts– (Need IOMMU for full DMA protection)Devices are virtualized and exported to other VMs via Device Channels– Safe asynchronous shared memory transport– ‘Backend’ drivers export to ‘frontend’ drivers– Net: use normal bridging, routing, iptables– Block: export any blk dev e.g. sda4,loop0,vg3(Infiniband / “Smart NICs” for direct guest IO)

Page 38: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

43 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

System Performance

L X V U

SPEC INT2000 (score)

L X V U

Linux build time (s)

L X V U

OSDB-OLTP (tup/s)

L X V U

SPEC WEB99 (score)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

1.1

Benchmark suite running on Linux (L), Xen (X), VMware Workstation (V), and UML (U)

Page 39: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

44 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Scalability

L X2

L X4

L X8

L X16

0

200

400

600

800

1000

Simultaneous SPEC WEB99 Instances on Linux (L) and Xen(X)

Page 40: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

45 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

ring

3

x86_32

Xen reserves top of VA spaceSegmentation protects Xen from kernelSystem call speed unchanged

Xen 3 now supports PAE for >4GB mem

Kernel

User

4GB

3GB

0GB

Xen

S

S

U ring

1rin

g 0

Page 41: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

46 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

x86_64

Large VA space makes life a lot easier, but:No segment limit support

Need to use page-level protection to protect hypervisor

Kernel

User

264

0

Xen

U

S

U

Reserved247

264-247

Page 42: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

48 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

x86 CPU virtualization

Xen runs in ring 0 (most privileged)Ring 1/2 for guest OS, 3 for user-space– GPF if guest attempts to use privileged instr

Xen lives in top 64MB of linear addr space– Segmentation used to protect Xen as switching page

tables too slow on standard x86Hypercalls jump to Xen in ring 0Guest OS may install ‘fast trap’ handler– Direct user-space to guest OS system calls

MMU virtualisation: shadow vs. direct-mode

Page 43: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

56 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

MMU Micro-Benchmarks

L X V U

Page fault (µs)L X V U

Process fork (µs)

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1.0

1.1

lmbench results on Linux (L), Xen (X), VMware Workstation (V), and UML (U)

Page 44: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

57 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

SMP Guest Kernels

Xen extended to support multiple VCPUs– Virtual IPI’s sent via Xen event channels– Currently up to 32 VCPUs supported

Simple hotplug/unplug of VCPUs– From within VM or via control tools– Optimize one active VCPU case by binary patching

spinlocksNote: Many applications exhibit poor SMP scalability –often better off running multiple instances each in their own operating system

Page 45: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

58 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

SMP Guest Kernels

Takes great care to get good SMP performance while remaining secure– Requires extra TLB synchronization IPIsSMP scheduling is a tricky problem– Wish to run all VCPUs at the same time– But, strict gang scheduling is not work conserving– Opportunity for a hybrid approachParavirtualized approach enables several important benefits– Avoids many virtual IPIs– Allows ‘bad preemption’ avoidance– Auto hot plug/unplug of CPUs

Page 46: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

59 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

VT-x / Pacifica : hvm

Enable guest operating systems to be run without modification– e.g. legacy Linux, Windows XP/2003CPU provides vmexits for certain privileged instrsShadow page tables used to virtualize MMUXen provides simple platform emulation– BIOS, apic, iopaic, rtc, Net (pcnet32), IDE emulationInstall paravirtualized drivers after booting for high-performance IOPossibility for CPU and memory paravirtualization– Non-invasive hypervisor hints from OS

Page 47: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

60 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

NativeDevice Drivers

Control

Panel (xm

/xend)

Front end Virtual D

rivers

Linux xen64

Xen Hypervisor

Guest BIOS

Unmodified OS

Domain N

Linux xen64

Callback / Hypercall

VMExit

Virtual Platform0D

Guest VM (VMX)(32-bit)

Backend

Virtual driver

Native Device Drivers

Domain 0

Event channel0P

1/3P

3P

I/O: PIT, APIC, PIC, IOAPICProcessor MemoryControl Interface HypercallsEvent Channel Scheduler

FE Virtual D

rivers

Guest BIOS

Unmodified OS

VMExit

Virtual Platform

Guest VM (VMX)(64-bit)

FE Virtual D

rivers3D

IO Emulation IO Emulation

Page 48: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

63 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

VM Relocation : Motivation

Xen

Xen

VM relocation enables:– High-availability

• Machine maintenance– Load balancing

• Statistical multiplexing gain

Page 49: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

64 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Assumptions

Xen

Xen

Storage

Networked storage– NAS: NFS, CIFS– SAN: Fibre Channel– iSCSI, network block dev– drdb network RAIDGood connectivity– common L2 network– L3 re-routeing

Page 50: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

65 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Challenges

VMs have lots of state in memorySome VMs have soft real-time requirements– e.g. web servers, databases, game servers– May be members of a cluster quorum

Minimize down-timePerforming relocation requires resources

Bound and control resources used

Page 51: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

66 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Stage 0: pre-migration

Stage 1: reservation

Stage 2: iterative pre-copy

Stage 3: stop-and-copy

Stage 4: commitment

Relocation Strategy

VM active on host ADestination host selected(Block devices mirrored)Initialize container on

target host

Copy dirty pages in successive rounds

Suspend VM on host ARedirect network trafficSynch remaining stateActivate on host B

VM state on host A released

Page 52: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

67 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 1

Page 53: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

68 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 1

Page 54: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

69 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 1

Page 55: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

70 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 1

Page 56: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

71 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 1

Page 57: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

72 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 2

Page 58: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

73 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 2

Page 59: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

74 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 2

Page 60: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

75 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 2

Page 61: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

76 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Round 2

Page 62: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

77 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Pre-Copy Migration: Final

Page 63: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

80 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Elapsed time (secs)0 10 20 30 40 50 60 70 80 90 100 110 120 130

Thr

ough

put (

Mbi

t/sec

)

0

200

400

600

800

1000Effect of Migration on Web Server Transmission Rate

Sample over 100ms

Sample over 500ms

512Kb files100 concurrent clients

1st precopy, 62 secs further iterations9.8 secs

765 Mbit/sec

870 Mbit/sec

694 Mbit/sec

165ms total downtime

Web Server Relocation

Page 64: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

81 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

52s

Iterative Progress: SPECWeb

Page 65: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

83 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Quake 3 Server relocation

Elapsed time (secs)0 10 20 30 40 50 60 70

Pac

ket f

light

tim

e (s

ecs)

0

0.02

0.04

0.06

0.08

0.1

0.12

Packet interarrival time during Quake 3 migration

Mig

ratio

n 1

dow

ntim

e: 5

0ms

Mig

ratio

n 2

dow

ntim

e: 4

8ms

Page 66: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

85 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Current Status

Driver Domains

VT

>4GB memory

Save/Restore/Migrate

SMP Guests

Guest Domains

Privileged Domains

PowerIA64x86_64x86_32px86_32

Page 67: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

86 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

3.1 Roadmap

Improved full-virtualization support– Pacifica / VT-x abstraction– Enhanced IO emulation

Enhanced control toolsPerformance tuning and optimization– Less reliance on manual configuration

NUMA optimizations Virtual bitmap framebuffer and OpenGL Infiniband / “Smart NIC” support

Page 68: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

87 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

IO Virtualization

IO virtualization in software incurs overhead– Latency vs. overhead tradeoff

• More of an issue for network than storage– Can burn 10-30% more CPU

Solution is well understood– Direct hardware access from VMs

• Multiplexing and protection implemented in h/w– Smart NICs / HCAs

• Infiniband, Level-5, Aaorhi etc• Will become commodity before too long

Page 69: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

88 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Research Roadmap

Whole-system debugging– Lightweight checkpointing and replay– Cluster/distributed system debugging

Software implemented hardware fault tolerance– Exploit deterministic replay

Multi-level secure systems with XenVM forking– Lightweight service replication, isolation

Page 70: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

89 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

IBM and Xen

IBMers on the Xen development team– Tony Breeds – Canberra– Sean Dague – Poughkeepsie– Todd Deshane – Poughkeepsie– James Dykman – Poughkeepsie– Jerone Young – AustinIBM contributions to the Xen project– Research Hypervisor – rHype has been developed to validate

virtualization features in new hardware architectures (such as x86, Cell BE and POWER) and to study fundamental research issues in virtualization

– Secure Hypervisor – sHype is a hypervisor security architecture in various stages of implementation in several hypervisors

Page 71: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

90 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Conclusions

Xen is a complete and robust hypervisorOutstanding performance and scalabilityExcellent resource control and protectionVibrant development communityStrong vendor support

Try the demo CD to find out more!(or Fedora 4/5, OpenSUSE 10.x)

http://xensource.com/xen/

Page 72: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

91 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Jim Elliott– Advocate – Infrastructure Solutions and

Manager – System z Operating Systems– IBM Canada Ltd.– [email protected] – 905-316-5813

Linux at IBM ibm.com/linuxSystem z ibm.com/systems/zMy web site ibm.com/vm/devpages/jelliottMy blog linux.ca/drupal/blog/58

Contact info

Page 73: Virtualization and Xen - VM · Virtualization and Xen Jim Elliott Advocate ... Type 1 Hypervisor: Type 2 Server Virtualization Approaches. 16 Kitchener Waterloo Linux Users Group

92 Kitchener Waterloo Linux Users Group 2006-06-05

Open Computing @ IBM Innovation that matters

Notices

© Copyright IBM Corporation 2000, 2006. All rights reserved.This document contains words and/or phrases that are trademarks or registered trademarks of the International Business Machines Corporation in the United States and/or other countries. For information on IBM trademarks go to http://www.ibm.com/legal/copytrade.shtml.The following are trademarks or registered trademarks of other companies.– Java and all Java-related trademarks and logos are trademarks of Sun Microsystems, Inc., in the United States

and other countries.– UNIX is a registered trademark of The Open Group in the United States and other countries.– Microsoft, Windows and Windows NT are registered trademarks of Microsoft Corporation.– Red Hat, the Red Hat "Shadow Man" logo, and all Red Hat-based trademarks and logos are trademarks or

registered trademarks of Red Hat, Inc., in the United States and other countries. – Linux is a trademark of Linus Torvalds in the United States, other countries, or both.All other products may be trademarks or registered trademarks of their respective companies.Notes: – This publication was produced in Canada. IBM may not offer the products, services or features discussed in this

document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.

– All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

– Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

– Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.