SmartX Automation Center for OF@TEIN Multi-point International OpenFlow Islands

2014 HPC Summer School

2014. 07. 15

thna@nm.gist.ac.kr

Taeheum Na

Networked Computing System Laboratory

School of Information & Mechatronics

Gwangju Institute of Science & Technology (GIST)

DevOps?

Zero-touchConfiguration

FlexibleControl

(forwarding,…)

Instant Visibility

AgileDevelopment

AgileOperation

DevOpsFeedback Release

OF@TEIN: OF-based SDN Testing Infrastructure

(2012~2013, GIST Consortium & KOREN/TEIN)

•SmartX Racks (Type A/B/C) in 5 domestic and 7 international sites•Providing software-driven virtual playground for agile and economic service realization

NIA(Seoul)

OF@TEIN Infrastructure (2012~2014)

3

Indonesia

Malaysia

(UM)

Vietnam

Philippines

Networked

Tiled Display

SmartX Box

(Type B+)

EU (SmartFIRE)

Japan or USA

OF@TEINOpenFlow Switch

Exp. Node (with HD camera)

Exp. Node (traffic generator)

Exp. Node

OpenFlow Production Switch

OpenFlow FlowVisor

OpenFlow Controller

OF@TEIN Portal

OF@TEIN SDN Tools

SmartX Rack (Box)

Jeju (Jeju)

Thailand

GIST (Gwangju)

VoD

Korea U

(Seoul)

Postech

(Pohang)

OF@KOREN

SmartX

Box

(Type C)

Last Update: 2014-05-01

Malaysia

(MYREN)

Pakistan

Problem?

SmartX Box

(Type B+)

OVSOF

Switch

OVSCapsulator

OVS OF

Switch

VM

VM

VM

Int-Bridge

5 Virtual bridges20 Physical/Virtual ports

2 NVGRE TunnelsETC

More than 50 commands

X 9 sites >=

SmartX Box

(Type B+)

=

450!!

Solution

Can be Automated!!

Django WebserverPython

Automation Center

OVSDB

REST API

Cron tab

BASH

OVSOF

Switch

OVSCapsulator

OVS OF

Switch

VM

VM

VM

Int-Bridge

SmartX Box

(Type B+)

ConfigurationControlVisibility

SmartX Automation Center

Automation Center

Ops Dev

Making Network GraphTriggering User Script (Experiment)

Design ExperimentConfiguring Box/Function/Topology

Making Network GraphTriggering Admin Script

Bare-metal installationAssign Chef recipeTriggering Chef Script

Single Box (server)

REST APIor

Common Gateway Interface

BASH Script(OVSDB, Chef, MaaS, Juju)

Visualize Experiment

Automating Tunneling-based Inter-connections (Operator view)

VM

VM

VM

VM

OF_Switch

VM

VM

VM

VM

VM

VM

VM

VM

OVS

Automation Center for TypeB+

Current Bridge stateCurrent Tunnel state

Add_gre_tunnel()Add_flow_table()Clear_site()

Set_DPID()Set_controller()

InformationController list

DPID listSite-Capsulator list (IP, PORT)

Allowed flows-tunnel mapping list

ManagementOVS-Bridge information

Capsulator Flow tableGRE Tunnel information

Tunnel list

OVS

Put Shape of vSWInterconnection Info.

Port nameFlowVisor Info.Set fail-mode

Add_bridge()Set_FlowVisor()Patch_port()

Automation Tools for Inter-connection

Tunnel Status Visualization

VM to VMTCP

Throughput

Site to SiteTCP

Throughput

Site Overlay vNetworking: NVGRE Tunneling

& Tagging/Steering/Mapping

WAN

NVGRE

Tunnels *An OpenFlow Network

Island

HP

OF

Switch

OVSOF

Switch

OVSCapsulator

OVS OF

Switch

Narinet

Capsulator

VM

VM

VM

VM

VM

VM

Gateway

Router

Flow Mapping with

Admin SDN Controller

Flow Steering with

User SDN Controllers

OVS

OF Switch

Flow VLAN-ID Tagging for Hypervisor VMs

Inter-Connection SmartX Racks (Type B+)

WAN

OpenFlow Network

SmartX Rack (Type B+) Site

VM

VM

VM

OVS

Gateway

Router

SmartX Rack (Type B+)

Site

Admin SDN Controller (Overlay Networking via

OpenFlow + OVSDB, Closed, Floodlight)

User SDN Controllers(OpenFlow + OVSDB, Any under

FlowVisor)

FlowSpace-UI SDN Controller (Closed, NOX

under FlowVisor)

VM

VM

VM

FlowVisor

Last Update: 2013-10-31

User #1 User #2 User #n

NVGRE

tunnels*

OVS

OVS

(L2/L3 Network) Capsulator

OpenFlow Switch

Virtual Switch

OVSOVS

OVS

OVS

SmartX Rack (Type B+)

Site

VM

VM

VM

OVS

OVS

FlowVisor (v1.4)OF@TEIN

Admin Script

VL

AN

-ba

sed

Flo

wR

an

ge

VL

AN

-ba

sed

Flo

wR

an

ge

VL

AN

-ba

sed

Flo

wR

an

ge

VL

AN

-ba

sed

Flo

wR

an

ge

NOXController

FloodlightController

FloodlightController

FlowSpace

ManagementFloodlightController

OF Switch

OF Switch

OF Switch

DPID-PortRanges FlowRanges

OF@TEIN Networking & FlowSpace Resources

VLAN ID

Supporting Multiple SDN Users with their own Controllers via FlowVisor

Verification over OF@TEIN Testbed

1st Developer utilizes Networking resources through NOX controller

2nd Developer utilizes Networking resources through OpenDaylightcontroller

Each developer can do their own experiment!!

KVM KVM

Open vSwitch

KVM

Open vSwitch Open vSwitch

L2

A Virtual Playground

L2

L3

Overlay Tunnels

Hardware

Software

Configuration

Narinet Open vSwitch

Control

OpenvSwitch

VM VM VM

Neutron Swift Cinder

NOVA Glance

OF@TEIN Virtual Playground Creation: Autonomic Installation & Configuration with Templates

SmartX Box (Type C)

SSD/HDDs

CPUs/GPUs

Box Template A

OpenvSwitch

VMVM

Neutron Swift Cinder

NOVA Glance

SSD/HDDs

CPUs/GPUs

Box Template B

VM

VM

Box

Coord

inator

Com

puting

Default

Role

CCN

X

Web

S

erve

r

Traffic

gene

rator

Topology

VM Images

NodeGraphs

Visibility

VM VM VM VM

Topology for CCN Experiment (Openstack Icehouse)

Full mesh GRE Tunnel

Layer 2 Network

or

Br-int VM

Virtual) Network(APP Topo.: CCN)

Virtual)Network(User Topo.)

Physical)Network(Admin Topo.)

Application Topology of CCNX

200 CCNX Nodes

Full mesh GRE Tunnel

Br-int VM

Dev

Ops

Openstack Network Topology

CCNX Topology

Actual Network

vUnderlay Network

DEMO-CCNX Experiment on SmartX Box TypeC-

http://youtu.be/4n76VtMMkbM

Q&Athna@nm.gist.ac.kr