QFABRIC DEEP DIVE Masum Mir Director, Product Line Management Campus & Data Center Business Unit

2 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

AGENDA

Vitalizing the DC network for Virtualized servers

How do we design DC network with QFabric

3 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

NETWORK & RESOURCE POOLS IN DATA CENTER

USERS/TENANTS

Tenant-1

Tenant-2

Tenant-3

Tenant-450

Compute & data pools Virtualized workloads

Servers & compute capacity outpacing infrastructure growth Network needs to enable flexible resource pools and scale on the same time

Core IT System

4 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

PERFORMANCE OBSTACLES IN THE ARCHITECTURE

Ethernet

Servers NAS

Multi Tier Architecture

Scale

Latency Scale vs. Latency

Scale

Bandwidth Scale vs. Bandwidth

Location dependent adjacencies & tenancy Silo of compute, storage & service resources

1 2 3 4

1 2

1 2

1 3

1 3

1 4

1 4

>100 µSec

100:1 OS Red Network

Green Network

5 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

IMPROVING APPLICATION PERFORMANCE AT SCALE

Scale

Latency

Scale

Bandwidth

Traditional design

QFabric

Traditional design

QFabric

Ethernet

Servers NAS

Multi Tier Network>100 µSec

100:1 OS

<5 µSec

Wirespeed 3:1 OS 6:1 OS

Servers NAS

1 2 3 4

1 2

1 2

1 3

1 3

1 4

1 4

1 2

1 2

1 3

1 3

1 4

1 4

Scale vs. Latency

Scale vs. Bandwidth

6 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC MAINTAINING NETWORK BOUNDARY & ISOLATION

VM VM VM

VM VM VM

VM VM VM

Tenant B

VM VM VM

VM VM VM

VM VM VM

Tenant A

VM VM VM

VM VM VM

VM VM VM

Tenant C

Blue Network

Red Network

Green Network

QFabric Director

DB

Fabric Admin

Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>

TOR:Rack23xe-0/0/47 {unit 0 {

family inet {address 10.1.1.254/24;}

}}

7 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC EFFICIENCY GAIN WITH LARGER & AGILE COMPUTE POOL

VMVM VM

VMVM VM

VMVM VM

Tenant B

VMVM VM

VMVM VM

VMVM VM

Tenant A

VMVM VM

VMVM VM

VMVM VM

Tenant C

Blue Network

Red Network

Green Network

VR-A

VR-B

VR-C

Servers Storage Idle Servers Can optimize Power

8 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC EFFICIENCY GAIN WITH STORAGE CONVERGENCE

VMVM VM

VMVM VM

VMVM VM

Tenant B

VMVM VM

VMVM VM

VMVM VM

Tenant A

VMVM VM

VMVM VM

VMVM VM

Tenant C

Blue Network

Red Network

Green Network

VR-A

VR-B

VR-C

Servers NAS FC Storage

FC SAN -A

FC SAN -B

FC

FC

FCoE

FCoE

9 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC SIMPLIFYING NETWORK OPERATION AT SCALE

Traditional QFabric

Aggregation Switches

Core Switch

Generic Switch …

..…

Management System Management System

Many devices to manage Multiple OS to manage

Many device and OS to integrate & orchestrate

Single system to manage Single OS

Single system to integrate & orchestrate

OS 4.0 OS 5.0

OS 4.0 OS 5.0

OS 12.3 OS

12.4

OS 12.2 OS

12.4 OS 4.0 OS 5.0

OS 12.3 OS

12.4

11.3

OS 12.3 OS

12.4

OS 12.3 OS

12.4 OS

12.3 OS

12.4

QFabric Director

DB

Fabric Admin

Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>

TOR:Rack23xe-0/0/47 {unit 0 {

family inet {address 10.1.1.254/24;}

}}

10 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION

Network Application Platform

QFabric Director

Standard API (SNMP, Syslog, NETCONF, etc)

Management System (3rd Party)

Management Client

Management Console

Admin

Admin

CLI/GUI

GLI/GUI

VM1 VM2

Virtual n/w

VM2 VM3VM1Server Admin

Network Admin

Virtual Control

11 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC END TO END INFRASTRUCTURE DESIGN

vGW

SRX

MX

QFabric

SRX

MX

VRF-A

VRF-B VRF-C

VMVM VM

VMVM VM

VMVM VM

VR-A

VMVM VM

VMVM VM

VMVM VM

VR-B

VMVM VM

VMVM VM

VMVM VM

VR-C

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

vGW

12 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

DATA CENTER INTERCONNECT

WAN & Core

SRX5800

MX Series

Servers NAS FC Storage

SRX5800

MX Series

Servers NAS FC Storage

SRX5800

MX Series

Servers NAS FC Storage

SRX5800

MX Series

Servers NAS FC Storage

13 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC : QFX3000-M VS QFX3000-G

Latency ~3us end-end Latency ~5us end-end

768-6,144 10G ports 48-768 10G ports

Small QFabric/Interconnect Modular chassis QFabric/Interconnect

Managed & operated as 1 switch

Runs Junos

Common QFabric/Node (QFX3500, QFX3600) & Director (QFX3001)

Storage Convergence: Lossless & DCB supported. FCoE & FC-Gateway

14 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC FUNCTIONAL ELEMENTS

Interconnect

Fabric switches

Node

I/O devices

Director

Control devices

15 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC DATA & CONTROL PLANE

QFabric Data Plane QFabric Control Plane

16 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QF/Director (QFX3100)

CPE CPE

8 x 10GbE LAG

DESIGN EVOLUTION WITH QFABRIC

QFX3500

QFX3500

40G Fabric Links

QFX3500 QFX3500

Dual Homed Server Active-Active

17 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QF/Director (QFX3100)

CPE CPE

DESIGN EVOLUTION WITH QFABRIC

QFX3500

QFX3500

40G Fabric Links

QFX3500 QFX3500

Dual Homed Server Active-Active

QFX3500 QFX3500

40GbE

18 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QF/Director (QFX3100)

CPE CPE

DESIGN EVOLUTION WITH QFABRIC

QFX3500

QFX3500

40G Fabric Links

QFX3500 QFX3500

Dual Homed Server Active-Active

QFX3500 QFX3500 QFX3500 QFX3500

40GbE

19 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

ARCHITECTURE MIGRATION TO QFABRIC

QFX3500

QFabric

Pod 1 Pod 2 4

20 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

DESIGN EXAMPLE (5K PORTS, 75% GBE, 25% 10GBE)

EX4200 #1

EX4200 #10

EX4200 #79

3,750 x 1GbE @ 2:1 OS 1,250 x 10GbE @ 3:1 OS

MX

Security/Services

MPLS

QFabric

VC#1 VC#8

12 x 10GbE

21 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

DESIGN EXAMPLE (5K PORTS, 25% GBE, 75% 10GBE)

EX4200 #1

EX4200 #10

EX4200 #26

1,250 x 1GbE @ 2:1 OS 3,750 x 10GbE @ 3:1 OS

MX

Security/Services

MPLS

QFabric

VC#1 VC#3

32 x 10/40GbE

23 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

SLIDE TITLE HERE, ALL CAPS, WITH ENOUGH ROOM FOR TWO LINES

Click to edit Master text styles Second level Third level

– Fourth level - Fifth level