UCS System Architecture Overview BRKCOM-1005

2013 Cisco and/or its affiliates. All rights reserved. BRKCOM-1005 Cisco Public

UCS System Architecture Overview Tommi Salli

BRKCOM1005


Cisco Unified Computing System

3

SAN B Any ANSI T11 Compliant SAN

Mgmt

SAN A Any ANSI T11 Compliant SAN

LAN Any IEEE Compliant LAN

One Logical Chassis to Manage 160 Servers

LAN Connectivity

SAN Connectivity

Multiple Chassis

Blade & Rack Servers

Server Identity Management

Monitoring, Troubleshooting


Cisco UCS Architecture

4

UCS Manager

XML API Standard APIs

APIs

Fabric Extenders

Compute

UCS Manager

Fabric Interconnects


Unified Management

A Single Unified System

For Blade and Rack Servers

UCS Manager

C-Series Rack Optimized Servers

B-Series Blade Servers

Service Profile: HR_App1

VNIC1

MAC: 08:00:69:02:01:2E

HR_WEB_VLAN (ID=50)

VNIC2

MAC: 08:00:69:02:01:2F

HR_DB_VLAN (ID=210)

HBA 1 and 2

WWN: 5080020000075740

WWN: 5080020000075741

VSAN ID: 12

Boot Order: SAN

BIOS Settings:

Turbo On

HyperThreading On

Integral part of UCS system

Manages all aspects of the UCS

Single point of management for UCS

Open API

Integrated Automation

Add capacity without complexity

UCS Service Profile Unified Device Management

Network Policy

Storage Policy

Server Policy

Unified Management

5


UCS Benefits

6

Highest Scale Unified Fabric

Virtual

Adapters

Fabric

Extenders

Fabric Interconnects

UCS C-series

UCS B-Series

Unified Management

Industry-leading compute without compromise

Unified Management

High Performance

Virtual Networks


UCS Manager

Embedded manages entire UCS Domain

Fabric Interconnect

10GE unified fabric switch

Chassis IO Module

Remote line card

Blade Server Chassis

Flexible bay configurations

Blade and Rack Servers

x86 industry standard

Patented extended memory

I/O Adapters

Choice of multiple adapters

Building Blocks of Cisco UCS

An Integrated System Optimizes Data Center Efficiency

7


System Component Connectivity

8

Compute Chassis

x86 Computer x86 Computer

X

I I

x8 x8 x8 x8

B

MGMT

S S

B

X X X X X

C C

A

G G

G G

SAN

G

R

A

G

G G

G

R

G

P M P

SAN LAN

Fabric

Interconnect

Fabric

Interconnect

Fabric

Extender

Fabric

Extender

Compute Blade

(Half slot)

Adapter

Compute Blade

(Full slot)

Adapter Adapter

Fabric Interconnect

32 Fixed Unified Ports + 4 or 1 Expansion slots to a maximum of 48 or 96 Unified Ports

Chassis

Upto 8 half width blades or 4 full width blades

Fabric Extender

Host to uplink traffic engineering

Up to 160Gb Flexible bandwidth allocation

Adapter

Virtualized adapter for single OS and hypervisor systems

Compute Blade


Wire for Bandwidth, Not Connectivity

Wire Once Architecture

All links can be active all the time

Policy-driven bandwidth allocation

Virtual interface granularity

9

20G per Chassis 40G per Chassis 80G per Chassis 160G per Chassis


UCS Manager Embedded in Fabric Interconnect

UCS Fabric Interconnects 6100 6200

UCS Fabric Extenders Logically part of Fabric Interconnect Inserts into Blade Enclosure

UCS Blade Server Chassis Flexible bay configurations Logically part of Fabric Interconnect

UCS Blade Servers Different blade types Mix blade types within enclosure

UCS Rack Servers

Different server types

Standalone or UCSM integrated

UCS Adapters Three adapter options Mix adapters within blade

Building Blocks

10


Embedded device manager for family of UCS components

Enables stateless computing via Service Profiles

Efficient scale: Same effort for 1 to N blades

APIs for integration with new and existing data center infrastructure

Unified Computing System Manager

11


UCS Manager

12

UCS Manager

GUI Custom Portal or Tools

Systems Management Software

CLI

Single point of management for UCS system of

components

Adapters, blades, chassis, fabric extenders, fabric

interconnects

Embedded device manager

Discovery, Inventory, Configuration, Monitoring,

Diagnostics, Statistics Collection

Coordinated deployment to managed endpoints

APIs for integration with new and existing data

center infrastructure

SMASH-CLP, IPMI, SNMP

XML-based SDK for commercial & custom

implementations


Management Protocols

13

Call-home

SMASH CLP

Remote KVM UCS CLI and GUI

UCS XML API

CIM XML

IPMI

SNMP

Serial Over LAN

syslog


UCS Centrale

14

UCS Manager UCS Manager

Data Center 1

UCS Manager UCS Manager

Data Center 2

UCS Manager

Data Center 3

Multi-UCS Manager

Unifies management of multi UCS

domains

Leverages UCS Manager technology

Simplify global operations with centralized

inventory, faults, logs, and server consoles

Delivers global policies, service profiles, ID

pools, and templates

Foundation for high availability, disaster

recovery, and workload mobility

Model based API for large scale

automation







UCS Rack Servers




Building Blocks

15


UCS 6248UP Fabric Interconnect

16

High Density 48 ports in 1RU

1Tbps Switching capability

All ports can be used as uplinks or downlinks

All ports can be configured to support either 1Gb or 10Gb speeds

Unified Ports

1 Expansion slots

2us Latency

80 PLUS Gold PSUs

Backward and forward Compatibility

Feature details


UCS 6296UP Fabric Interconnect

17

High Density 96 ports in 2RU

2Tbps Switching capability

All ports can be used as uplinks or downlinks

All ports can be configured to support either 1Gb or 10Gb speeds

Unified Ports

4 Expansion slots

2us Latency

80 PLUS Gold PSUs

Backward and forward Compatibility

Feature details


Unified Ports

Dynamic Ports Allocation: Lossless Ethernet or Fibre Channel

18

Unified Port

Use-cases

Native Fibre Channel

Flexible LAN & storage convergence based on business needs

Service can be adjusted based on the demand for specific traffic

Convert protocol support on the

same port dynamically

All ports on UCS 6200 Series

16-port Expansion Module for

6248UP and 6296UP

Lossless Ethernet:

1/10GbE, FCoE, iSCSI, NAS

Benefits

Simplify switch purchase - remove ports ratio guess work

Increase design flexibility

Remove bandwidth bottlenecks


UCS 6200 Expansion Module

19

UCS-FI-E16UP

Ports can be configured as either

Ethernet or Native FC Ports

Ethernet operations at 1/10 Gigabit

Ethernet

Fibre Channel operations at 8/4/2/1G

Uses existing Ethernet SFP+ and

Cisco 8/4/2G and 4/2/1G FC Optics


Unified Port Management

20







UCS Rack Servers




Building Blocks

21


UCS 2204XP I/O Module

22

Increased uplink bandwidth

4 x 10 Gig network-facing ports

Double the server-facing bandwidth

16 x 10 Gig = 4 per half width slot

Two I/O Modules per chassis

40Gbps to a single half-width blade (20Gbps left and right)

80Gbps to a full-width blade

Built in chassis management

Fully managed by UCSM

Feature details


UCS 2208XP I/O Module

23

Double the uplink bandwidth

8 x 10 Gig network-facing ports

Quadruple the server-facing bandwidth

32 x 10 Gig = 4 per half width slot

Two I/O Modules per chassis

80Gbps to a single half-width blade (40Gbps left and right)

160Gbps to a full-width blade

Built in Chassis Management

Fully Managed by UCSM

Feature details







UCS Rack Servers




Building Blocks

24


UCS 5108 Blade Chassis

25

Chassis

Up to 8 half slot blades

Up to 4 full slot blades

4x power supplies, N+N grid redundant

8x fans included

2x UCS 2104 Fabric Extender

All items hot-pluggable


4 to 8 Blades

4 Power

Supplies

8 Fan Modules

4 Power

Connectors

2 Fabric

Extenders

UCS 5108 Blade Chassis Parts

26


Redundant data and management paths

I/O Modules

Blade Connectors PSU Connectors

UCS 5108 Blade Chassis Backplane

27







UCS Rack Servers




Building Blocks

28


Blade Overview

B22 M3 B200 M3 B250 M2 B420 M3 B230 M2 B440 M2

Slots 1 1 2 2 1 2

CPU E5-2400 E5-2600 Xeon 5600 E5-4600 E7-2800 E7-4800

Cores 16 16 12 32 20 40

DIMMs 12 24 48 48 32 32

Max GB 192GB 768GB 384GB 1.5TB 512GB 1TB

Disk 2 4 x 2.5 2 SSD

Raid 0/1 0/1 0/1 0/1/5/10 0/1 0/1/5/6

mLOM Dual 20Gb Dual 20Gb No Dual 20Gb No No

Mezz 1 1 2 2 1 2

29


B22 M3 Blade

30

2 Socket

Intel E5-2400

12 DIMM slots

Maximum memory speed 1333MHz

2 Internal HDDs

SFF - SAS, SATA and SSD options

LSI 2002 RAID Controller

Supports RAID 0 and 1

1 Mezzanine card slot

PCIe 3.0 x16 mezzanine connector

mLOM option


B200 M3 Blade

31

2 Socket

Intel E5 series CPUs

24 DIMM slots


2 Internal HDDs






mLOM option


B250 M2 Blade

32

2 Socket

Intel 55xx and 56xx series CPUs

48 DIMM slots


2 Internal HDDs







B420 M3 Blade

33

4 Socket

Intel E5-4600 CPUs

48 DIMM slots


4 Internal HDDs


LSI 2208R RAID Controller

Supports RAID 0, 1, 5 and 10



mLOM option


B230 M2 Blade

34

2 Socket

Intel E7 CPUs

32 DIMM slots


2 Internal HDDs

2.5 inch low profile SSD options






B440 M2 Blade

35

4 Socket

Intel E7 CPUs

32 DIMM slots


4 Internal HDDs

SFF SAS, SATA and SSD options


1GB write cache

Battery Backed cache option





B200 M2 and B250 M2 Blade Server CPU options

PID CPU Cores QPI Speed Architecture

Support 1333Mhz Memory Speed

N20-X00001 2.93GHz Xeon X5570 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X

N20-X00002 2.53GHz Xeon E5540 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP


N20-X00004 2.26GHz Xeon L5520 60W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP

N20-X00006 2.66GHz Xeon X5550 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X


A01-X0100 3.33GHz Xeon X5680 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X



A01-X0106 2.26GHz Xeon L5640 60W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP X

A01-X0107 2.13GHz Xeon L5630 40W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP

A01-X0108 1.86GHz Xeon L5609 40W CPU/12MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP

A01-X0109 2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP


A01-X0113 2.13GHz Xeon E5506 80W CPU/4MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP



A01-X0120 2.53GHz Xeon E5649 80W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP x


36


B200 M3 Blade Server CPU options

37



UCS-CPU-E5-2690 2.90 GHz E5-2690/135W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X

UCS-CPU-E5-2680 2.70 GHz E5-2680 130W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x

UCS-CPU-E5-2665 2.40 GHz E5-2665/115W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x

UCS-CPU-E5-2650 2.00 GHz E5-2650/95W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x

UCS-CPU-E5-2640 2.50 GHz E5-2640/95W 6C/15MB Cache/DDR3 1333MHz 6 7.2 GT/s Xeon E5

UCS-CPU-E5-2620 2.00 GHz E5-2620/95W 6C/15MB Cache/DDR3 1333MHz 6 7.2 GT/s Xeon E5




B230 and B440 Blade Server CPU options

38

PID CPU Cores QPI Speed Architecture B230M1 B440M1 B230M2 B440M2

A01-X0308 2.00GHz Xeon X6550 130W CPU/18MB cache 8 6.4 GT/s Nehalem-EX 2S

Yes No No No

A01-X0304 2.00GHz Xeon E6540 105W CPU/18MB cache 6 6.4 GT/s Nehalem-EX 2S

Yes No No No

A01-X0302 1.73GHz Xeon E6510 105W CPU/12MB cache 4 4.8 GT/s Nehalem-EX 2S

Yes No No No

A01-X0200 2.26GHz Xeon X7560 130W CPU/24MB cache 8 6.4 GT/s Nehalem-EX

Yes Yes No No


No Yes No No

A01-X0206 1.86GHz Xeon L7555 95W CPU/24MB cache 8 5.8 GT/s Nehalem-EX

Yes Yes No No


No No No No

A01-X0203 2.00GHz Xeon E7540 105W CPU/18MB cache 6 6.4 GT/s Nehalem-EX

No Yes No No


No Yes No No

UCS-CPU-E74870 2.4 GHz E7-4870 130W 10C CPU / 30M Cache 10 6.4 GT/s Westmere EX

No No No Yes

UCS-CPU-E74860 2.26 GHZ E7-4860 130W 10C CPU / 24M Cache 10 6.4 GT/s Westmere EX

No No No Yes

UCS-CPU-E74850 2 GHz E7-4850 130W 10C CPU / 24M Cache 10 6.4 GT/s Westmere EX

No No No Yes


No No No Yes

UCS-CPU-E74807 1.86 GHz E7-4807 95W 6c CPU / 18m Cache 6 4.8 GT/s Westmere EX

No No No Yes

UCS-CPU-E72870 2.4 GHz E7-2870 130W 10C / 30M Cache 10 6.4 GT/s Westmere EX

No No Yes No


No No Yes No

UCS-CPU-E72850 2 GHz E7-2850 130W 10C /24M Cache 10 6.4 GT/s Westmere EX

No No Yes No


No No Yes No


No No Yes No

UCS-CPU-E78867L 2.13 GHz E7-8867L 105W 10C / 30M Cache 10 6.4 GT/s Westmere EX

No No Yes Yes


Drives Supported

39

B200 B250 B230 B440 146GB 6Gb SAS 15K X X X

300GB 6Gb SAS 15k X X X




500GB SATA 7.2k X

1TB SATA 7.2k X

100GB SATA SSD X X X

200GB SATA SSD X

100GB Low Height 7mm

SATA SSD X

200GB Low Height 7mm SATA

SSD X

300GB Low Height 7mm SATA

SSD

X







UCS Rack Servers




Building Blocks

40


C22 M3 C24 M3 C220 M3 C240 M3 C260 M2 C420 M3 C460 M2

RU 1 2 1 2 2 2 4

Cores 16 16 16 16 20 32 40

DIMMs 12 12 16 24 64 48 64

Max GB 192GB* 192GB* 512GB 768GB 1TB 1,5TB 512GB

Disk

4

24

4

SSD

LoM 2 x 1Gb 2 x 1Gb 2 x 1Gb 4 x 1Gb 2 x 1Gb + 2 x

10Gb 2 x 10Gb

2 x 1Gb +

2 x 10Gb

PCIe Slots 2 x PCIe

3.0

5 x PCIe

3.0

2 x PCIe

3.0

5 x PCIe

3.0 6 x PCIe 2.0 6 x PCIe 3.0 10 x PCIe 2.0

Internal

Storage USB Port USB Port

USB Port

FlexFlash

USB Port

FlexFlash

USB Port

FlexFlash

USB Port

FlexFlash eUSB

*384GB w/ 32GB DIMMs

41


Rack Mount Server Overview

C22 M3 C24 M3 C220 M3 C240 M3 C260 M2 C420 M3 C460 M2

RU 1 2 1 2 2 2 4

Cores 16 16 16 16 20 32 40

DIMMs 12 12 16 24 64 48 64

Max GB 192GB* 192GB* 512GB 768GB 1TB 1,5TB 512GB

Disk

4

24

4

SSD

LoM 2 x 1Gb 2 x 1Gb 2 x 1Gb 4 x 1Gb 2 x 1Gb + 2 x

10Gb 2 x 10Gb

2 x 1Gb +

2 x 10Gb

PCIe

Slots

2 x PCIe

3.0

5 x PCIe

3.0

2 x PCIe

3.0

5 x PCIe

3.0 6 x PCIe 2.0 6 x PCIe 3.0 10 x PCIe 2.0

Internal

Storage USB Port USB Port

USB Port

FlexFlash

USB Port

FlexFlash

USB Port

FlexFlash

USB Port

FlexFlash eUSB

*384GB w/ 32GB DIMMs 42


C200 M2 Rack Server

43

2 Socket

Intel 55xx and 56xx CPUs

12 DIMM slots


4



Built in Intel ICH10 SW Raid


650W PSUs

2 PCIe slots

Height 1RU

Integrated CIMC and KVM


UCS C200 M2

44

PSUs VGA, Serial, USB and

Management LAN

Internal LAN

DVD Power button, Status LEDs and KVM connector

Internal HDDs


UCS C200 M2

45


IOH

Slot A

Slot B

X8

X16

Height

Length

Full Height

Length

SLOT

A SLOT

B

UCS C200 M2

46


C210 M2 Rack Server

47

2 Socket


12 DIMM slots


16 Internal HDDs



Built in Intel ICH10 SW Raid


650W PSUs

5 PCIe slots

Height 2RU



UCS C210 M2

48


Management LAN Internal LAN


UCS C210 M2

49


UCS C210 M2

50

IOH

PCIe

Switch

Slot A

Slot B

Slot C

Slot D

Slot E

X8

X8

x8

x8

x8

x8

SLOT A

SLOT B

SLOT C

SLOT D

SLOT E

Full Height

Length

Full Height

Length

Full Height

Length

Full Height

Full Length

Full Height

Full Length


C220 M3 Rack Server

51

2 Socket

Intel E5-2600

16 DIMM slots


8 or 4 Internal HDDs



650W PSUs Platinum Rated

2 PCIe slots

Height 1RU



C220 M3

52

PSUs VGA Serial and CIMC

interfaces

Integrated 1Gb LOM

Intel i350

USB


C220 M3

53


C220 M3

54

CPU

#1

CPU

#2

PCIe 3.0 x16 Slot A Full height, length

PCIe 3.0 x8 Slot B height, length

PCIe 3.0 x8 RAID Mezz

SLOT A SLOT B


C240 M3 Rack Server

55

2 Socket

Intel E5-2600

24 DIMM slots


24 or 12 Internal HDDs



650W and 1200W PSUs Platinum Rated

5 PCIe slots GPU ready

Height 2RU



C240 M3

56


Management LAN Integrated 1Gb LOM

Intel i350


C240 M3

57


C240 M3

58

CPU

#1

CPU

#2

PCIe 3.0 x8 Slot C Full height, Length

PCIe 3.0 x8 Slot D height, length

PCIe 3.0 x8 RAID Mezz

PCIe 3.0 x8 Slot A Full height, Length

PCIe 3.0 x16 Slot B Full height, Length

PCIe 3.0 x16 Slot E Full height, length, GPU ready

SLOT A

SLOT B

SLOT C

SLOT D SLOT E


C250 M2 Rack Server

59

2 Socket


48 DIMM slots


8 Internal HDDs



850W PSUs

5 PCIe slots

Height 2RU



UCS C250 M2

60

PSUs

Internal LAN VGA, Serial and USB Management

ports

Hot Pluggable FANs


UCS C250 M2

61


UCS C250 M2

62

IOH

PCIe

Switch

PCIe

Switch

Slot D

Slot E

Slot A

Slot B

Slot C

x16

x8

x8

x16

x8

x8

x8

Slot A

Slot E

Slot D Slot B

Slot C

Full Height

Length

Full Height

Length

Height

Length

Height

Length

Height

Length


C260 M2 Rack Server

63

2 Socket

Intel E7 CPUs

32 or 64 DIMM slots


16 Internal HDDs



1200W PSUs

Internal Flash Storage

6 PCIe slots

Height 2RU



UCS C260 M2

64

Management ports Internal LAN Flex LOM


UCS C260 M2

65


UCS C260 M2

66

CPU

#1

CPU

#2

IOH

#1

IOH

#2

x16

x8

x8

x8

x8

x4

x16

Raiser A

Raiser B

Slot A

Slot B

Slot C

Slot D

Flex LOM

Height

Length

Height

Length

Height

Length

Height

Length

Full Height

Length

Full Height

Length

S

L

O

T

A

S

L

O

T

B

S

L

O

T

C

S

L

O

T

D

F

L

E

X

L

O

M

RAISER A RAISER B


C460 M2 Rack Server

67

4 Socket

Intel E7 CPUs

64 DIMM slots


12 Internal HDDs



850W PSUs

Internal Flash Storage

10 PCIe slots

Height 4RU



UCS C460 M2

68

Management ports

Internal LAN

Internal 10GbE LAN Base-T and SFP


UCS C460 M2

69


UCS C460 M2

70

IOH

#1

Slot #9

length x8 physical

Gen1 x4

Gen2 x16 lanes

CPU

#3

CPU

#1

CPU

#2

CPU

#4

IOH

#2

QPI Link

Slot #8

Slot #6

Slot #7

Slot #5

SAS Riser (occupied)

Slot #1

Slot #2

Slot #3

Slot #4

Slot #10

length x8 physical

Slot #1

Slot #2

Slot #3

Slot #4

Slot #8

length x8 physical

Slot #6 (Hot Swap)

length x8 physical

Slot #7 (Hot Swap)

length x8 physical

Slot #5

length x16 physical

Slot #1 (Hot Swap)

length x8 physical

Slot #2 (Hot Swap)

length x8 physical

Slot #3

length x8 physical

Slot #4

length x8 physical

ICH 10

(shared) Gen1 x4

Gen2 x8 lanes

Gen2 x8 lanes

Gen2 x4 lanes

Gen1 x4 lanes

Gen2 x8 lanes

Gen2 x8 lanes

Gen2 x8 lanes

Gen2 x4 lanes

Gen2 x4 lanes


UCS C460 M2

71

SA

S R

iser

Slo

t #

1

Slo

t #

2

Slo

t #

3

Slo

t #

4

Slo

t #

5

Slo

t #

6

Slo

t #

7

Slo

t #

8

Slo

t #

9

Slo

t #

10


C200, C210 and C250 Rack Server CPU options

72



C200 C210 C250

N20-X00001 2.93GHz Xeon X5570 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X Yes Yes Yes

N20-X00002 2.53GHz Xeon E5540 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP Yes Yes Yes

N20-X00003 2.26GHz Xeon E5520 80W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP Yes Yes No

N20-X00004 2.26GHz Xeon L5520 60W CPU/8MB cache/DDR3 1066MHz 4 5.86 GT/s Nehalem-EP Yes Yes No

N20-X00006 2.66GHz Xeon X5550 95W CPU/8MB cache/DDR3 1333MHz 4 6.4 GT/s Nehalem-EP X Yes Yes Yes

N20-X00009 2.00GHz Xeon E5504 80W CPU/8MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP Yes Yes No

A01-X0100 3.33GHz Xeon X5680 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X No No Yes

A01-X0102 2.93GHz Xeon X5670 95W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X Yes Yes Yes


A01-X0106 2.26GHz Xeon L5640 60W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP X Yes Yes No

A01-X0107 2.13GHz Xeon L5630 40W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP Yes Yes No

A01-X0108 1.86GHz Xeon L5609 40W CPU/12MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP Yes Yes No

A01-X0109 2.66GHz Xeon E5640 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP Yes Yes Yes

A01-X0111 2.40GHz Xeon E5620 80W CPU/12MB cache/DDR3 1066MHz 4 5.86 GT/s Westmere-EP Yes Yes Yes

A01-X0113 2.13GHz Xeon E5506 80W CPU/4MB cache/DDR3 800MHz 4 4.8 GT/s Nehalem-EP Yes Yes No

A01-X0115 3.46GHz Xeon X5690 130W CPU/12MB cache/DDR3 1333MHz 6 6.4 GT/s Westmere-EP X No No Yes


A01-X0120 2.53GHz Xeon E5649 80W CPU/12MB cache/DDR3 1333MHz 6 5.86 GT/s Westmere-EP x Yes Yes Yes

A01-X0123 2.13GHz Xeon E5606 80W CPU/8MB cache/DDR3 1066MHz 4 4.8 GT/s Westmere-EP Yes Yes No


C220 and C240 Rack Server CPU Options

73



C220 C240

UCS-CPU-E5-2690 2.90 GHz E5-2690/135W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X Yes Yes

UCS-CPU-E5-2680 2.70 GHz E5-2680 130W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x Yes Yes

UCS-CPU-E5-2665 2.40 GHz E5-2665/115W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x Yes Yes

UCS-CPU-E5-2650 2.00 GHz E5-2650/95W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 x Yes Yes

UCS-CPU-E5-2640 2.50 GHz E5-2640/95W 6C/15MB Cache/DDR3 1333MHz 6 6.4 GT/s Xeon E5 Yes Yes

UCS-CPU-E5-2630 2.30 GHz E5-2630/95W 6C/15MB Cache/DDR3 1333MHz 6 4.8 GT/s Xeon E5 Yes Yes

UCS-CPU-E5-2620 2.00 GHz E5-2620/95W 6C/15MB Cache/DDR3 1333MHz 6 Xeon E5 Yes Yes

UCS-CPU-E5-2609 2.4 GHz E5-2609/80W 4C/10MB Cache/DDR3 1066MHz 4 Xeon E5 Yes Yes

UCS-CPU-E5-2643 3.30 GHz E5-2643/130W 4C/10MB Cache/DDR3 1600MHz 4 8 GT/s Xeon E5 X Yes Yes

UCS-CPU-E5-2650L 1.8GHz E5-2650L/70W 8C/20MB Cache/DDR3 1600MHz 8 8 GT/s Xeon E5 X Yes Yes

UCS-CPU-E5-2630L 2.00 GHz E5-2630L/60W 6C/15MB Cache/DDR3 1333MHz 6 Xeon E5 Yes Yes


C260 and C460 Rack Server CPU options

74

PID CPU Cores QPI Speed Architecture B440M1 C260M2 C460M2


Yes No No


Yes No No

A01-X0206 1.86GHz Xeon L7555 95W CPU/24MB cache 8 5.8 GT/s Nehalem-EX

Yes No No


Yes No No


Yes No No


Yes No No


No No Yes

UCS-CPU-E74860 2.26 GHZ E7-4860 130W 10C CPU / 24M Cache 10 6.4 GT/s Westmere EX

No No Yes

UCS-CPU-E74850 2 GHz E7-4850 130W 10C CPU / 24M Cache 10 6.4 GT/s Westmere EX

No No Yes


No No Yes

UCS-CPU-E74807 1.86 GHz E7-4807 95W 6c CPU / 18m Cache 6 4.8 GT/s Westmere EX

No No Yes


No Yes No


No Yes No

UCS-CPU-E72850 2 GHz E7-2850 130W 10C /24M Cache 10 6.4 GT/s Westmere EX

No Yes No


No Yes No


No Yes No

UCS-CPU-E78867L 2.13 GHz E7-8867L 105W 10C / 30M Cache 10 6.4 GT/s Westmere EX

No Yes Yes

UCS-CPU-E78837 2.67 GHz E7-8837 130W 8C / 30M Cache 8 6.4 GT/s Westmere EX No No Yes


Rack Mount RAID Controllers

75

Max # drives SAS or

SATA RAID BBC C200 C210 C220 C240 C250 C260 C460

ICH10 4 SATA SW 0 and 1 x x

LSI 1064 4 SAS/SATA HW 0 and 1 x x

LSI 3081E 8 SAS/SATA HW 0 and 1 x

LSI 9240-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x

LSI 9260-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x x x

LSI 9261-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x x x x

LSI 9280-4i4e 4 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x x

LSI 2008-8i 8 SAS/SATA HW 0, 1, 5, 10 and 50 X X

LSI 9266-8i 8 SAS/SATA HW 0, 1, 5, 6, 10, 50 and 60 x X X







UCS Rack Servers




Building Blocks

76


High Performance 10Gbps per port maximum throughput for high bandwidth SAN and LAN traffic

Full hardware offload for FCoE protocol processing

250,000 IOPS per port deliver high I/O

Up to 8Gb FC throughput

Full support for TCP/IP and Ethernet with enhancements

Priority-based Flow Control (802.1Qbb)

Jumbo frames

Checksum offloads

Segmentation offloads

Common driver for CNAs and HBAs

Low power ~ 5W

Adapters for B-Series M72KR-Q

77


I/O Adapters for B-Series M72KR-E

78

Full 10Gbps network performance

with support both LAN and SAN traffic

Full hardware offload for FCoE

protocol processing

PCIe Express 2.0 (x8, 5GT/s), MSI-X support

Integrated data buffer and code space memory

Theoretical 10Gb FC throughput

Common driver for UCNAs and HBAs

Support for Jumbo frames

Cannot do per priority pause on Ethernet traffic.


I/O Adapters for B-Series M61KR-I

79

Interface Type PCIe v2.0 (5.0GT/s)

Intel VT-dVMDq, SR-IOV

Full support for TCP/IP and Ethernet with enhancements:

Priority-based Flow Control (802.1Qbb)

Jumbo frames

Checksum offloads

Segmentation offloads

Low power ~7W


I/O Adapters for B-Series M51KR-B

80

Broadcom NetXtreme II 57711 Dual-Port 10 Gigabit Ethernet PCIe Adapter

x8 PCI Express base specifications v2.0 and v1.1

iSCSI offload

Virtual LANs (VLANs), IEEE 802.1q

IEEE 802.3x flow control

TCP, IP, UDP checksum offload - TCP segmentation

iSCSI Boot capable


UCS 1280 VIC

81

Dual 4x10 Gbps port-channel to a single slot

Host connectivity PCIe Gen2 x6

HW Capable of 256 PCIe devices

OS restriction apply

PCIe virtualization OS independent

Single OS driver image for both VICs

FabricFailover supported

No user configuration required for 4x10Gb port channel

Not limited to 10Gig bandwidth per vNIC

Flows from each vNIC can be load balanced

80 Gb I/O connectivity per adapter

VM-FEX scale to 116 VM

Customer benefits

Feature details


I/0 Adapters:

N2XX-ABPCI02 - Broadcom BCM57711, 10 GbE Dual Port NIC (TwinAx Cable Only)

N2XX-ABPCI03 - Broadcom BCM5709, GbE Quad Port GE NIC

N2XX-ABPCI01 - Broadcom BCM5709, GbE Dual Port GE NIC

UCSC-PCIE-BSFP - Broadcom BCM57712, 10GbE Dual Port NIC

N2XX-AEPCI01 - Emulex OneConnect OCe10102-F FCoE CNA (TwinAx Cable Only)

N2XX-AEPCI03 - Emulex LPE 11002 4Gb Dual Channel FC HBA

N2XX-AEPCI05 - Emulex Lpe 12002 8Gb Dual Port FC HBA

N2XX-AIPCI01 - Intel Ethernet X520 10GbE Dual Port Server Adapter (TwinAx Cable Only)

N2XX-AIPCI02 - Intel Quad Port GE NIC

N2XX-AQPCI01 - Qlogic QLE 8152 (FCoE) 10 Gb 2-port CNA (TwinAx Cable Only)

N2XX-AQPCI03 - Qlogic 2462 4Gb Dual-Channel FC HBA

3rd Party Adapters for UCS C-Series

82

Connectivity


UCS FI Operating Modes

84

External LAN sees UCS 6100 as an end-host

with multiple adapters (no STP)

Active/Active use of uplinks by pinning

Single upstream L2 domain

More scalable than switch mode

External LAN sees UCS 6100 as a traditional

Ethernet switch (STP = PVST+)

Some uplinks blocked by STP (no pinning)

Single or disjoint L2 domains

MAC learning on uplink/server interfaces

End Host Switch


UCS Ethernet Connectivity

85

appliance

monitor

LAN IP Storage FCoE Storage

UCS 6100 UCS 6100

Nexus 2248 Nexus 2248

storage target uplinks


Port Types Vs. FI Operating Mode

86


From Chassis to Fabric Interconnect

87

UCS 2104

10Gb Mezz

IOH

CPU CPU

x16 Gen 2

x16 Gen 2

Mezz

Server Blade

Midplane

IO Modules UCS 2104

SFP+ Module Fabric

Interconnects SFP+ Module

IO Module to 61XX Blades pinned to uplink based On Slot number

Blade Chassis

(UCS 61XX)


From Chassis to Fabric Interconnect - New

88

UCS 2208

UCS 1280

IOH

CPU CPU

x16 Gen 2

x16 Gen 2

Mezz

Server Blade

Midplane

IO Modules UCS 2208

16x

SFP+

16x

SFP+ Module Fabric

Interconnects

16x

SFP+

16x

SFP+ Module

4x10 Gbps Ether channel from VIC-2 to 2208 IO Modules

No user configuration required

vNIC flows are 5-tuple LB across links

Each individual flow limited to 10Gb

Fabric Failover available

IO Module to 6248 links user configuration Ether channel

Blade Chassis

(UCS 6248)

(UCS 2208)

(UCS 1280)


UCS Connectivity Summary

89

SAN Switch

LAN Switch

LAN CLOUD FC STORAGE

NAS STORAGE UCS Fabric Interconnect

Access Layer LAN & SAN Unified Fabric (FCoE)

UCS FC in NPV Mode

Upstream Switch in NPIV Mode

UCS Ethernet in EHM
http://www.emc.com/products/detail/hardware/celerra-ns960.htmhttp://www.emc.com/products/detail/hardware/celerra-ns960.htm


UCS B-Series

UCS 6100 UCS 6100

FCoE Storage FC Storage

Fibre Channel

Ethernet

Unified I/O

FCoE

Core

Fabric A Fabric B

SAN Fabric Storage Arrays

SAN Edge A SAN Edge B

Direct Attach

Must have connection to MDS FC Switch or N5K

FC switch or N5K

Only works with Cisco FC Switches or N5K

FC Switch Mode

90


CIMC

GE LOM PCIe Adapter

OS or Hypervisor

Nexus

2232

Mgmt Traffic

Data Traffic

Nexus

2232

UCS 6100 or 6200 UCS 6100 or 6200

Reduce cost of deployment

Scale and performance

Choose from 5 servers

Scale to 160 C-Series per domain

UCS C-Series Integration to UCSM

91

VM-FEX and Adapter FEX


Different FEX technologies

93

Features:

Adapter FEX split a physical NIC into multiple logical NICs

VM-FEX extends Adapter FEX technology to virtual machine

Based on open Standards

Benefits:

Same functionality in Physical and Virtual environments

Increased bandwidth utilization by sharing physical interface to multiple Applications and/or VMs

Improved Performance and dynamic network & security policy mobility during VM migration with VM-FEX

Adapter FEX

VM FEX


Emulated Mode VMDirectPath

Standard Mode

12%-15% CPU performance improvement

vMotion supported

High Performance Mode

Co-exists with Standard mode

Bypasses Hypervisor layer

30% improvement in I/O performance

vMotion supported with ESX 5.0

Modes of VM-FEX

94


VM-FEX with VMware

95

VMW ESX

Server

vCenter

VMW ESX

Server

UCS DVS (PTS)

VM #1

VM #4

VM #3

VM #2

VM #5

VM #8

VM #7

VM #6

Port Profiles

Defined in UCS

WEB Apps

HR

DB

Compliance

I/O profiles defined in UCS & applied in vCenter

UCS exports Port

Profiles to VC

VC Deploys VMs

with UCS policies

UCS


VM-FEX with VMware

96

Integrated Mobility with VMotion

VMW ESX

Server

vCenter

VMW ESX

Server

UCS DVS (PTS)

VM #1

VM #4

VM #3

VM #2

VM #5

VM #8

VM #7

VM #6

UCS VN-Link Property Mobility VMotion for the network

Ensures VM security

Maintains connection state

VM #1

VM #4

VM #3

VM #2

UCS System Architecture Overview BRKCOM-1005

Documents

Transcript of UCS System Architecture Overview BRKCOM-1005