QFABRIC DEEP DIVE - Home - J-Net...

24
QFABRIC DEEP DIVE Masum Mir Director, Product Line Management Campus & Data Center Business Unit

Transcript of QFABRIC DEEP DIVE - Home - J-Net...

Page 1: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

QFABRIC DEEP DIVE Masum Mir Director, Product Line Management Campus & Data Center Business Unit

Page 2: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

2 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

AGENDA

Vitalizing the DC network for Virtualized servers

How do we design DC network with QFabric

Page 3: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

3 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

NETWORK & RESOURCE POOLS IN DATA CENTER

USERS/TENANTS

Tenant-1

Tenant-2

Tenant-3

Tenant-450

Compute & data pools Virtualized workloads

Servers & compute capacity outpacing infrastructure growth Network needs to enable flexible resource pools and scale on the same time

Core IT System

Page 4: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

4 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

PERFORMANCE OBSTACLES IN THE ARCHITECTURE

Ethernet

Servers NAS

Multi Tier Architecture

Scale

Latency Scale vs. Latency

Scale

Bandwidth Scale vs. Bandwidth

Location dependent adjacencies & tenancy Silo of compute, storage & service resources

1 2 3 4

1 2

1 2

1 3

1 3

1 4

1 4

>100 µSec

100:1 OS Red Network

Green Network

Page 5: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

5 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

IMPROVING APPLICATION PERFORMANCE AT SCALE

Scale

Latency

Scale

Bandwidth

Traditional design

QFabric

Traditional design

QFabric

Ethernet

Servers NAS

Multi Tier Network>100 µSec

100:1 OS

<5 µSec

Wirespeed 3:1 OS 6:1 OS

Servers NAS

1 2 3 4

1 2

1 2

1 3

1 3

1 4

1 4

1 2

1 2

1 3

1 3

1 4

1 4

Scale vs. Latency

Scale vs. Bandwidth

Page 6: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

6 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC MAINTAINING NETWORK BOUNDARY & ISOLATION

VM VM VM

VM VM VM

VM VM VM

Tenant B

VM VM VM

VM VM VM

VM VM VM

Tenant A

VM VM VM

VM VM VM

VM VM VM

Tenant C

Blue Network

Red Network

Green Network

QFabric Director

DB

Fabric Admin

Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>

TOR:Rack23xe-0/0/47 {unit 0 {

family inet {address 10.1.1.254/24;}

}}

Page 7: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

7 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC EFFICIENCY GAIN WITH LARGER & AGILE COMPUTE POOL

VMVM VM

VMVM VM

VMVM VM

Tenant B

VMVM VM

VMVM VM

VMVM VM

Tenant A

VMVM VM

VMVM VM

VMVM VM

Tenant C

Blue Network

Red Network

Green Network

VR-A

VR-B

VR-C

Servers Storage Idle Servers Can optimize Power

Page 8: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

8 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC EFFICIENCY GAIN WITH STORAGE CONVERGENCE

VMVM VM

VMVM VM

VMVM VM

Tenant B

VMVM VM

VMVM VM

VMVM VM

Tenant A

VMVM VM

VMVM VM

VMVM VM

Tenant C

Blue Network

Red Network

Green Network

VR-A

VR-B

VR-C

Servers NAS FC Storage

FC SAN -A

FC SAN -B

FC

FC

FCoE

FCoE

Page 9: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

9 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC SIMPLIFYING NETWORK OPERATION AT SCALE

Traditional QFabric

Aggregation Switches

Core Switch

Generic Switch …

..…

Management System Management System

Many devices to manage Multiple OS to manage

Many device and OS to integrate & orchestrate

Single system to manage Single OS

Single system to integrate & orchestrate

OS 4.0 OS 5.0

OS 4.0 OS 5.0

OS 12.3 OS

12.4

OS 12.2 OS

12.4 OS 4.0 OS 5.0

OS 12.3 OS

12.4

11.3

OS 12.3 OS

12.4

OS 12.3 OS

12.4 OS

12.3 OS

12.4

QFabric Director

DB

Fabric Admin

Admin A Admin Broot@qfabric> show chassis hardwareBBAK0421:--------------------Hardware inventory:<details>

TOR:Rack23xe-0/0/47 {unit 0 {

family inet {address 10.1.1.254/24;}

}}

Page 10: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

10 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION

Network Application Platform

QFabric Director

Standard API (SNMP, Syslog, NETCONF, etc)

Management System (3rd Party)

Management Client

Management Console

Admin

Admin

CLI/GUI

GLI/GUI

VM1 VM2

Virtual n/w

VM2 VM3VM1Server Admin

Network Admin

Virtual Control

Page 11: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

11 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC END TO END INFRASTRUCTURE DESIGN

vGW

SRX

MX

QFabric

SRX

MX

VRF-A

VRF-B VRF-C

VMVM VM

VMVM VM

VMVM VM

VR-A

VMVM VM

VMVM VM

VMVM VM

VR-B

VMVM VM

VMVM VM

VMVM VM

VR-C

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

THE vGW ENGINE

VM VM1 VM2 VM3

VMWARE DVFILTER

VMWARE VSWITCH OR CISCO 1000V

ESX Kernal

ES

X H

ost

vGW

Page 12: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

12 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

DATA CENTER INTERCONNECT

WAN & Core

SRX5800

MX Series

Servers NAS FC Storage

SRX5800

MX Series

Servers NAS FC Storage

SRX5800

MX Series

Servers NAS FC Storage

SRX5800

MX Series

Servers NAS FC Storage

Page 13: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

13 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC : QFX3000-M VS QFX3000-G

Latency ~3us end-end Latency ~5us end-end

768-6,144 10G ports 48-768 10G ports

Small QFabric/Interconnect Modular chassis QFabric/Interconnect

Managed & operated as 1 switch

Runs Junos

Common QFabric/Node (QFX3500, QFX3600) & Director (QFX3001)

Storage Convergence: Lossless & DCB supported. FCoE & FC-Gateway

Page 14: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

14 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC FUNCTIONAL ELEMENTS

Interconnect

Fabric switches

Node

I/O devices

Director

Control devices

Page 15: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

15 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QFABRIC DATA & CONTROL PLANE

QFabric Data Plane QFabric Control Plane

Page 16: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

16 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QF/Director (QFX3100)

CPE CPE

8 x 10GbE LAG

DESIGN EVOLUTION WITH QFABRIC

QFX3500

QFX3500

40G Fabric Links

QFX3500 QFX3500

Dual Homed Server Active-Active

Page 17: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

17 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QF/Director (QFX3100)

CPE CPE

DESIGN EVOLUTION WITH QFABRIC

QFX3500

QFX3500

40G Fabric Links

QFX3500 QFX3500

Dual Homed Server Active-Active

QFX3500 QFX3500

40GbE

Page 18: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

18 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

QF/Director (QFX3100)

CPE CPE

DESIGN EVOLUTION WITH QFABRIC

QFX3500

QFX3500

40G Fabric Links

QFX3500 QFX3500

Dual Homed Server Active-Active

QFX3500 QFX3500 QFX3500 QFX3500

40GbE

Page 19: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

19 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

ARCHITECTURE MIGRATION TO QFABRIC

QFX3500

QFabric

Pod 1 Pod 2 4

Page 20: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

20 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

DESIGN EXAMPLE (5K PORTS, 75% GBE, 25% 10GBE)

EX4200 #1

EX4200 #10

EX4200 #79

3,750 x 1GbE @ 2:1 OS 1,250 x 10GbE @ 3:1 OS

MX

Security/Services

MPLS

QFabric

VC#1 VC#8

12 x 10GbE

Page 21: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

21 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

DESIGN EXAMPLE (5K PORTS, 25% GBE, 75% 10GBE)

EX4200 #1

EX4200 #10

EX4200 #26

1,250 x 1GbE @ 2:1 OS 3,750 x 10GbE @ 3:1 OS

MX

Security/Services

MPLS

QFabric

VC#1 VC#3

32 x 10/40GbE

Page 22: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform
Page 23: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform

23 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

SLIDE TITLE HERE, ALL CAPS, WITH ENOUGH ROOM FOR TWO LINES

Click to edit Master text styles Second level Third level

– Fourth level - Fifth level

Page 24: QFABRIC DEEP DIVE - Home - J-Net Communityforums.juniper.net/jnet/attachments/jnet/BAJUG/9/1/bajug...QFABRIC AUTOMATION NETWORK & SERVER VIRTUALIZATION Network Application Platform