Virtual I/O Server - gomitec.com Presentations/James... · Virtual I/O Server Topics ... VIO Server...
Transcript of Virtual I/O Server - gomitec.com Presentations/James... · Virtual I/O Server Topics ... VIO Server...
© 2011 IBM Corporation
James Nash
Advanced Technical Skills
MITEC 2011 W 210 C-4
Virtual I/O Server Beyond the Basics
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Trademarks
22
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.
The following are trademarks or registered trademarks of other companies.
* All other products may be trademarks or registered trademarks of their respective companies.
Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel
Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.
For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:
*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®
Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not
actively marketed or is not significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
3
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Agenda
4
Virtual I/O Server Topics
• Networking
─ Shared Ethernet Adapters
─ Integrated Virtual Ethernet
─ MAC Addresses
• Virtual Storage
─ N_Port Id Virtualization
• Live Partition Mobility
─ Boot from SAN?
• Infrequently used alternatives
─ Virtual Media Library
─ backupios vs viosbr
─ Dynamic VLAN
─ Quality of Service
─ WWN Management
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
5
Virtual Networking - Overview
─ Shared Ethernet Adapters Options
─ SEA Failover
─ Network Interface Backup
─ Link Aggregation
─ Integrated Virtual Ethernet Changes
─ Advanced Virtual Ethernet Adapters
─ Dynamic VLAN
─ User-defined MAC Address
─ Quality of Service
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Shared Ethernet Adapters
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Integrated Virtual Ethernet
7
FC 5636, 2 x 1Gb
FC 5637, 4 x 1Gb FC 5639, 2 x 10Gb
POWER6 Options
Up to 16 Logical Ports per
Port Group
Up to 2 Port Groups per HEA
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
IBM
Pow
IVE Options with POWER7
POWER7 770 (9117-MMB)– FC 1803 Integrated, 4-port- 1Gb Virtual Ethernet, I/O ports
– FC 1804 Integrated, 4-port (2x1Gb and 2x10Gb SFP+ Optical ports)
– FC 1813 Integrated, 4-port (2x1Gb and 2x10Gb SFP+ Copper twinax
ports)
• Each of these cards contains 4 port groups because it combines
two P5IOC2 chips
• 4 port groups allows for up to 64 logical ports per controller
(assuming the MCS value for each port group is set to 1)
POWER 750 (8233-E8B)– FC 5613 Integrated, Dual-port- 10Gb Virtual Ethernet Daughter Card
– FC 5624 4-port 1Gb Integrated Virtual Ethernet Daughter Card
• Same rules that apply to POWER6 systems
• 2 port groups with up to a total of 32 logical ports per controller
(also assuming the MCS value is set to 1)
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Integrated Virtual Ethernet
9
– FC 1803 Integrated, 4-port – 1Gb Virtual Ethernet, I/O ports
– FC 1804 Integrated, 4-port (2 x 1Gb and 2 x 10Gb SFP+ Optical ports)
– FC 1813 Integrated, 4-port (2 x 1Gb and 2 x 10Gb SFP+ Copper ports)
– FC 1824 Integrated, 4-port – 1Gb Virtual Ethernet, I/O ports
– FC 1825 Integrated, 2-port – 2 x 10Gb (Fiber)
– FC 1826 Integrated, 4-port – 2 x 10Gb (Copper)
– FC 1832 Integrated, 4-port - 1Gb Virtual Ethernet, I/O ports
– FC 1833 Integrated, 2-port – 2 x 10Gb (Fiber)
– FC 1837 Integrated, 4-port – 2 x 10Gb (Copper)
– FC 5613 Integrated, 2-port – 10Gb (SR Fiber)
– FC 5623 Integrated, 2-port – 2 x 1Gb
– FC 1826 Integrated, 4-port – 2 x 1Gb
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Integrated Virtual Ethernet
10
Machine FC FC FC Note
710 1832 1833 1837 2U
720 1824 1825 1826 4U
730 1832 1833 1837 2U
740 1824 1825 1826 4U
750 5613 5623 5624 2 Port Groups
755 5613 5624 2 Port Groups
770 1803 1804 1813 4 Port Groups
780 1803 1804 1813 4 Port Groups
795 N/A
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Dynamic VLANs
11
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Other Dynamic Options
12
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Specify a MAC Address
13
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Specify a MAC Address
14
1 2 3 4 5 6 7 8 9 0 A B
octet: 1st 2nd 3rd 4th 5th 6th
Most Least
Significant Significant
0 0 0 1 0 0 1 0bit 8 bit 7 bit 6 bit 5 bit 4 bit 3 bit 2 bit 1
0: globally unique (OUI enforced)
1: locally administered
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
15
Virtual Networking – Specify a MAC Address
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Networking – Quality of Service
16
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Double Check Yourself
You can select one of the following values
for the priority level:
0 - best effort; lowest priority
1 - background
2 - spare
3 - excellent effort
4 - controlled load
5 - video (less than 100 ms latency and jitter)
6 - voice (less than 10 ms latency and jitter)
7 - network control; highest priority
17
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
18
Virtual Storage - Overview
─ The vSCSI Conundrum
─ Virtual Storage with Live Partition Mobility
─ Hub-and-spoke
─ N_Port Id Virtualization
─ WWN Management
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
19
Client LPAR
vscsi0 vscsi1
VIO
Server 1
vhost0 vhost0 VIO
Server 2
fcs0 fcs1
SAN
Switch #1
SAN
Switch #2
SAN Storage
fcs0fcs1
VIO Server
POWER Hypervisor (PHYP)
Client
LPAR
Client
LPAR
Client
LPAR
Virtual Storage - vSCSI
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
20
Where did that disk go?
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
At one point the disks had to
be configured with a
reserve_policy = no_reserve
PR_shared supported at
VIO v2.1.2
Keep a spreadsheet
Check all the VIO servers
Consider NPIV
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
21
Consider a Hub and Spoke Design
VIO Server Client
LPARClient
LPAR
Client
LPAR
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
VIO Server
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
NPIV - Virtual FC Server/Client Overview
22
VIO Server
POWER Hypervisor (PHYP)
Client
LPAR
Client
LPAR
Client
LPAR
Physical 8Gb
NPIV Adapter
Virtual FC
Server Adapter
Virtual FC
Client Adapter
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Storage – NPIV Configuration
23
hscroot@hmc:~> lssyscfg –r prof –m FieldSystem1 \
–F lpar_name,virtual_fc_adapters
fs5,"""20/client/1/fs6vio2/20/c050760061590000,c050760061590001/0"",
“"21/client/2/fs6vio3/21/c050760061590002,c050760061590003/0""“
fs6,"""22/client/1/fs6vio2/22/c050760061590004,c050760061590005/0"",
""23/client/2/fs6vio3/23/c050760061590006,c050760061590007/0""“
fsios71,none
fsios61,none
fs6vio3,"21/server/7/fs5/21//0,23/server/6/fs6/23//0“
fs6vio2,"20/server/7/fs5/20//0,22/server/6/fs6/22//0"
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Storage – WWN Management
24
# lscfg -vpl fcs0
fcs0 U8203.E4A.06EB1C4-V8-C26-T1 Virtual Fibre Channel Client Adapter
Network Address.............C05076006159000CROS Level and ID............
Device Specific.(Z0)........
Device Specific.(Z1)........
Device Specific.(Z2)........
Device Specific.(Z3)........
Device Specific.(Z4)........
Device Specific.(Z5)........
Device Specific.(Z6)........
Device Specific.(Z7)........
Device Specific.(Z8)........C05076006159000CDevice Specific.(Z9)........
Hardware Location Code......U8203.E4A.06EB1C4-V8-C26-T1
PLATFORM SPECIFIC
Name: vfc-client
Node: vfc-client@3000001a
Device Type: fcp
Physical Location: U8203.E4A.06EB1C4-V8-C26-T1
# fcstat fcs0FIBRE CHANNEL STATISTICS REPORT: fcs0
Device Type: FC Adapter (adapter/vdevice/IBM,vfc-client)
Serial Number: UNKNOWN
Option ROM Version: UNKNOWN
Firmware Version: UNKNOWN
World Wide Node Name: 0xC05076006159000D
World Wide Port Name: 0xC05076006159000D
FC-4 TYPES:
Supported: 0x0000010000000000000000000000000000000000000000000000000000000000
Active: 0x0000010000000000000000000000000000000000000000000000000000000000
Class of Service: 3
Port Speed (supported): UNKNOWN
Port Speed (running): 2 GBIT
Port FC ID: 0x6D071D
Port Type: Fabric
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
25
Virtual Storage – WWN Management
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Activate the LPAR
Activate LPAR and select
Boot Mode to be Open
Firmware OK prompt
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
ioinfo Menus
Enter the
command
ioinfo at
the OK
prompt
Select
option 6
for
FCINFO
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
ioinfo Menus
Select your
vfcs adapter
This verifies
your WWPN
and logs the
adapter into
the switch
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Manual Step?
29
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
30
Anywhere to Anywhere
VIO Server Client
LPARClient
LPAR
Client
LPAR
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
VIO Server Client
LPAR
Client
LPAR
Client
LPAR
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Storage – NPIV simplify management?
31
VIO Admin
I. Fewer Devices on VIO Server
II. Minimize Risk for disk theft
III. Less setup needed for LPM
IV. Easier to replace failed FC
adapter
V. Could make DR easier
VI. Advanced Multi-Path
Options
SAN Admin
I. Many more WWNs to
manage
II. Creating Zoneset more
complicated
III. Once configured,
fewer changes needed
for LPM
IV. Nothing needed when
FC adapter is replaced
Single Admin?
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Live Partition Mobility - Overview
32
─ Moving from POWER6 to POWER7
─ Requirements
─ In the Zone
─ Port ID Binding
─ Boot from SAN?
─ Port Security
─ Disaster Recovery
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
33
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
34
Moving to POWER7
Set processor
compatibility mode
P7 features are not
available while
running in P6 mode– Active Memory Expansion
– Virtual Ethernet QoS
“Default” sets the
current mode to the
most fully featured
mode supported by
the operating
environment.
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Live Partition Mobility - Zoning
3535
VIO Server
POWER Hypervisor (PHYP)
Client
LPAR
Client
LPAR
Client
LPAR
Physical 8Gb
NPIV Adapter
Virtual FC
Server Adapter
Virtual FC
Client Adapter
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Live Partition Mobility – Boot from SAN?
Do you want SDDPCM or PowerPath managing
rootvg?– What does your storage vendor recommend
– What are the requirements to update the MP software
– What are the required steps for partition recovery
Can you split MP software by drive?SDD # excludesddcfg –l hdisk0 (querysn older
versions)
HDLM # vi
/usr/DynamicLinkManager/drv/dlmfdrv.unconf
PowerPath # pprootdev on36
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Live Partition Mobility – Security
37
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Some advantages of Virtual Optical Media Library With read-only virtual media the same virtual optical device can be
presented to multiple client partitions simultaneously
You could easily boot from and install partitions remotely without having
the need to swap out physical CD/DVDs or setup Network Installation
Manager (NIM) server
Easier to boot a partition into maintenance mode to repair problems
Easier to maintain a complete library of all the software needed for the
managed system. Various software packages as well as all the
necessary software levels to support each partition
Client partitions could use blank file-backed virtual optical media for
backup purposes (read/write devices)
These file-backed optical devices could then be backed up from on the
VIO server to other types of media (tape, physical CD/DVD, TSM server,
etc.)
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Add Media – within IVM
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Optical Media on HMC Managed Systems
Managing the Virtual Media Repository
Managing Virtual Optical Media
VIO
Command
Description
$ mkrep Create a Virtual media repository
$ lsrep Display information on a Virtual Media Repository
$ chrep Change characteristics of a Virtual Media Repository
$ rmrep Remove a Virtual Media Repository
VIO
Command
Description
$ mkvopt Creates a new virtual optical disk in the Virtual Media
Repository
$ lsvopt Displays information about file backed virtual optical
devices
$ chvopt Change the characteristics of a virtual optical media disk
within the Virtual Media Repository
$ loadopt Load a virtual optical media disk from the Virtual Media
Repository into a virtual optical device
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
Virtual Optical Media
Create an ISO file from CDROM$ mkvopt -name dvd.AIX_6.1.iso -dev cd0
-ro
–You choose the name for this file, so make it meaningful
–Creates an ISO image from the media in /dev/cd0
After the .iso file is in your /var/vio/VMLibrary
directory, run: $ mkvdev -fbo -vadapter vhost4
vtopt0 Available
–Replace vhost4 with your Virtual SCSI server adapter
name.
–This mkvdev command creates your virtual optical target
device.
$ loadopt -vtd vtopt0 –disk
dvd.AIX_6.1.iso
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command – viosbr (with VIO 2.1.2)
42
$ viosbr
Too few parameters.
Usage: viosbr -backup -file FileName [-frequency
daily|weekly|monthly [-numfiles fileCount]]
viosbr -nobackup
viosbr -view -file FileName [-type devType] [-detail]
viosbr -view -file FileName -mapping
viosbr -view -list [UserDir]
viosbr -restore -file FileName [-validate] [-type devType]
[-inter]
viosbr -restore -file FileName [-type devType] [-force]
$ viosbr -backup -file nash-backup
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
43
$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz
Controllers:
============
Name Phys Loc
---- --------
iscsi0
sissas0 U5802.001.00H1395-P1-C1-T1
sissas1 U5802.001.00H1395-P1-C2-T1
sissas2 U78C0.001.DBJ0426-P2-T3
sissas3 U78C0.001.DBJ0426-P2-C9-T1
pager0 U9117.MMB.100414P-V1-C32769-L0-L0
pager1 U9117.MMB.100414P-V1-C32773-L0-L0
vasi0 U9117.MMB.100414P-V1-C32769
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
44
Physical Volumes:
=================
Name Phys Loc
---- --------
hdisk20 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-
L12000000000000
hdisk21 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-
L1B000000000000
hdisk22 U78C0.001.DBJ0426-P2-C9-D1
hdisk23 U78C0.001.DBJ0426-P2-C9-D4
hdisk0 U5802.001.00H1395-P3-D1
hdisk1 U5802.001.00H1395-P3-D2
hdisk2 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L0
hdisk3 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-
L1000000000000
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
45
Ethernet Interfaces:
====================
en0
en1
en2
en3
en4
Shared Ethernet Adapters:
=========================
Name Physical Adapter Default Adapter Virtual Adapters
---- ---------------- --------------- ----------------
ent4 ent0 ent1 ent1
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
46
Virtual Server Adapters:
========================
SVSA Phys Loc VTD
---- -------- ---
vhost0 U9117.MMB.100414P-V1-C5 rg103_gambs
vhost1 U9117.MMB.100414P-V1-C6 rg104_gambs
vhost2 U9117.MMB.100414P-V1-C7 rg105_gambs
vhost3 U9117.MMB.100414P-V1-C8 rg106_gambs
vhost4 U9117.MMB.100414P-V1-C2 mob29_target
vhost5 U9117.MMB.100414P-V1-C4 vtscsi1
vtscsi0
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
47
Virtual Server Adapters:
========================
SVSA Phys Loc VTD
---- -------- ---
vhost0 U9117.MMB.100414P-V1-C5 rg103_gambs
vhost1 U9117.MMB.100414P-V1-C6 rg104_gambs
vhost2 U9117.MMB.100414P-V1-C7 rg105_gambs
vhost3 U9117.MMB.100414P-V1-C8 rg106_gambs
vhost4 U9117.MMB.100414P-V1-C2 mob29_target
vhost5 U9117.MMB.100414P-V1-C4 vtscsi1
vtscsi0
This is NOT even the detailed view
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
48
$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \
-detail
..............hdisk21 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L1B000000000000
Attribute Name Attribute Value
-------------- ---------------
device_mode 10
queue_depth 32
message_no 105
hcheck_interval 60
hcheck_cmd inquiry
unique_id 3E213600A0B80001132D00000F2F94B7E72800F1815 FAStT03IBMfcp
scsi_id 0x611400
lun_id 0x1b000000000000
ww_name 0x201800a0b81132d0
node_name 0x200800a0b81132d0
ses_attach yes
pvid 00c23c9f212cf8880000000000000000
reserve_policy no_reserve
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
New command - viosbr
49
$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \
–mapping
..............
Name Physloc ClntID ClntName ClntOS
------------- -------------------------------- ------ ------------- -------
vfchost0 U9117.MMB.100414P-V1-C16 29 mob29_lpm AIX
ClntOS AIX
Status LOGGED_IN
FC name fcs0
Ports logged in 3
Flags a
VFC client name fcs0
FC loc code U78C0.001.DBJ0426-P2-C2-T1
VFC client DRC U9117.MMA.1023C9F-V29-C3-T1
© 2011 IBM Corporation
MITEC 2011 W 210 C-4
viosbr or backupios