[OpenStack Day in Korea 2015] Track 2-5 - Building Software-Defined Infrastructure with...

Building Software-Defined Infrastructure with

SDN/NFV/Cloud Integration

OpenStack Day in Korea 2015

Dr. JongWon Kim

Networked Computing Systems Laboratory

School of Information and Communications

Gwangju Institute of Science & Technology (GIST)

Date: 2015. 2. 5 Place: Seoul, Korea

http://www.gist.ac.kr/

Contents

• Building Software-Defined

Infrastructure with SDN/NFV/Cloud

Integration & Hyper-convergent

SmartX Boxes

• Realizing Smart Services with

Provisioning/Orchestration/Governance

1


Building Software-

Defined Infrastructure

with SDN/NFV/Cloud

Integration & Hyper-

convergent SmartX Boxes

2


Human-Defined Services over Software-Defined

Infrastructure

Open Platforms

(Tools)

Open

Software

(Services)

Open Infrastructure

(Resources)

Big

Data

Industrial

Internet

of Things

Open Data

Cloud

Open API

Software-Defined Infrastructure (SDN/NFV integrated Mobile+Cloud)


Industrial Internet

of Things (I2oT)


http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=yHgBLJM5_g-lYM&tbnid=fYVjtPP_4vYOOM:&ved=0CAUQjRw&url=http://wikibon.org/wiki/v/The_Industrial_Internet_and_Big_Data_Analytics:_Opportunities_and_Challenges&ei=9BpcUvHXAo60iQfI-YGQBg&bvm=bv.53899372,d.aGc&psig=AFQjCNEjmEsl_EvYIXuorRXKxGpvFrnqQw&ust=1381854009873734

Convergent

Software-Defined

Infrastructure (SDN/NFV/Cloud

Integration)

Cloud WAN Fabric

(IP+Optical Integration)

Wireless

+ Mobile

Wireless +

Mobile Wireless + Mobile

Cloud Data

Centers

Cloud Data

Centers

Service-aware Edge (MiddleBox, …)

Cloud DC

Cloud DC

Cloud Data

Centers

IP??, More Switching + Simpler Routing?

• Amazon AWS

• Microsoft Azure

• Google Cloud Engine

• VMware Hybrid

• OpenStack (IBM, HP, Cisco,

RackSpace, …) + Network

Operator Cloud (AT&T.

Verizon, NTT, …)


Convergence

@ Carriers

• AT&T Network

Cloud (Domain 2.0,

Open/Simple/Scale/Secure)

• NTT Seamless

Cloud for the World

• Huawei SoftCom &

Cloud Edge


Convergence @ Hyper-scale Cloud DCs

7

Google

Virtualized

SDN:

Andromeda

Microsoft

Host SDN


SDN: OpenFlow-

based SDN and

Others

- 8 -


NFV Architecture Framework & Use Cases


Mobile + Cloud: SDN/NFV/Cloud Integration

Network Service Providers (+ Multi-campus Enterprises)

Content/Application Service Providers

Cloud

Data Center Networking

Mobile Wireless

Networking

Network Functions Virtualization

Inter-DC / Multi-layer Optical Networking

vSwitch/vRouter &

Overlay Virtual Networking

Secure

Networking


- 11 -

Convergent

Software-

Defined

Infrastructure

Carrier-Grade NFV? Five 9’s Small VNF Paradigm assisted by

“magical” virtual networking of distributed flow-steering at scale

> 160Gbps


SmartX Box: Inter-Connected

Functions inside Boxes/Sites

Box Functions

Inter-Connect

Site

Resources – Workloads - Services


Templates

Convergent Software-Defined

Infrastructure: Programmable, Virtualized, Hyper-

convergent SmartX Boxes


Computer

Systems

Boxes?

14

CoreLink: on a single die (i.e., chip)


Open-Source Hardware (Computers, Switches, …)

- 15 -


• Nutanix, Simplivity, …

• Pluribus Freedom Server-Switch

• VMware Project Mystic

Evo: Rails, Evo: Racks

Hyper-Convergence

Boxes


Realizing Smart Services

with Provisioning /

Orchestration /

Governance


- 18 -

Prepare SmartX Boxes &

Realize Smart Services

Architecture Your Smart Things with

API Tools

Converged (C/N/S)

SmartX Box with Program-

mable & Virtualized Resources

Build Open APIs with Inter-connected Functions


19

Learning & Playing with Open-Source

Hardware/Software Building Blocks


Software Lifecycle and CI (Continuous

Integration) / CD (Continuous Deployment)

Software Lifecycle: Development

Testing (Staging) / QA

Production / Deployment 20

Master Software

Coding (for Cloud

OS Kernel + Service

Frameworks and

Tools) and Execute

Continuous

Integration for

Agile and

Economic Service

Realization


Testbed: Wild &

Organized Playground DevOps


SmartX Box: Design and Prototyping

with SDN/NFV/Cloud Leverage Simplified SmartX Rack

SmartX Box

Pools of SmartX Boxes: Massive scalability and pay-as-

you-grow flexibility

CPUs / GPUs

SSD / HDDs

Open vSwitch / NICs

VM VM VM VM VM

COMPUTE NETWORKING

STORAGE


http://openclipart.org/people/ilnanny/Hard_Disk.svg

http://www.google.co.kr/url?sa=i&rct=j&q=nic+card&source=images&cd=&cad=rja&docid=vkecJWsPjdLFvM&tbnid=VA1r6EpKR5szNM:&ved=0CAUQjRw&url=http://www.entaonline.com/product/StarTechcom-4-Port-PCI-Express-Gigabit-Ethernet-NIC_STH-ST1000SPEX4.htm&ei=Dc2lUdSIFoPhlAWfjoDICw&bvm=bv.47008514,d.dGI&psig=AFQjCNGzoj9v4wiGUJftTngbAVPoTogXtA&ust=1369906659834026

23

COMPUTE

NETWORKING

STORAGE


http://www.google.co.kr/url?sa=i&rct=j&q=openstack+&source=images&cd=&cad=rja&docid=Taz7e8VPqpfYDM&tbnid=s7KAugSB1vvgcM:&ved=0CAUQjRw&url=http://www.siliconloons.com/?p=343&ei=7rw0UZPuK82ciAfRhYHwCQ&bvm=bv.43148975,d.aGc&psig=AFQjCNGpBNIuOUGsiKO_hZqOZjRR7cQ0Qg&ust=1362496783039070

Playing with Converged Software-Defined

Infrastructure (SDN/NFV/Cloud)


http://www.google.co.kr/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=qjjSOiJQUMELkM&tbnid=PuoHZJANPQ2VjM:&ved=0CAUQjRw&url=http://blog.naver.com/PostView.nhn?blogId%3D6inboon%26logNo%3D110111314170&ei=yJWTUYi2MI-ViQfGyoGADQ&bvm=bv.46471029,d.aGc&psig=AFQjCNFQIvODqj4WQT8bJICPgHverfEfwA&ust=1368713016093828

http://www.google.co.kr/url?sa=i&rct=j&q=korea+university+logo&source=images&cd=&cad=rja&docid=Jam6Lg-Ddn7neM&tbnid=zWoyOq0CkK7D_M:&ved=0CAUQjRw&url=http://biel.korea.ac.kr/&ei=l5yRUePUGsffkAX50YDgBA&bvm=bv.46471029,d.dGI&psig=AFQjCNEq490Tg4trm-3VOrS4-og28bmDnQ&ust=1368583666150911

http://www.google.co.kr/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=Js0QUz9Fht2OBM&tbnid=Hk059SIuwm_G-M:&ved=0CAUQjRw&url=http://www.postech.ac.kr/image/postech/logo.html&ei=HJeTUauEDsSeiAeB7oDgCg&bvm=bv.46471029,d.aGc&psig=AFQjCNHG6WpvLJ-cj_4V23EDsxIrcuWA-g&ust=1368713342622094


http://www.gstep.re.kr/eng/html/main/main.asp

TEIN

OF@KOREN & OF@TEIN (2012~2014)

Auto

Center

EU

(SmartFIRE)

OF@TEIN

Last Update: 2014-07-12

SmartX Rack

OpenFlow FlowVisor

SDN Controller

Korea U (Seoul)

Jeju U (Jeju) Postech (Pohang)

SKKU (Suwon)

Indonesia

Malaysia

(UM)

Vietnam

Philippines

Thailand

Malaysia

(MYREN)

Pakistan

KOREN NOC

(Seoul)

GSTEP (Pangyo?)

GIST (Gwangju)

OF@KOREN


Networking

Compute

Storage

X

Zero-touch Configuration

Flexible Control

Instant Visibility

Collective Intelligence

DevOps

SmartX Provisioning: Configuration /

Control / Visibility Challenges


http://www.google.co.kr/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&docid=KEyHRXB9sVJvJM&tbnid=KKFHm8grJamDuM:&ved=0CAUQjRw&url=http://androidapp.lisisoft.com/apps-android-phone/108401-com.mobilerise.smartcube.html&ei=l4zHUeWDG6XliAemtYCABw&bvm=bv.48293060,d.aGc&psig=AFQjCNGgeMSJ_vxHSEvCM2fKMIfyEI0xtg&ust=1372118422330266

SmartX Provisioning: Inter-Connected

Functions inside Boxes/Sites

Box Functions

Inter-Connect

Site

P+M, C, D ports

Normal Secured Tag/Steer/Mapped


Physical Network

Overlay Tunnels

VM VM VM

L2

A Virtual Playground

L2

L3

VM

Configuration

Control Visibility

Open vSwitch

VM VM VM

Neutron Swift Cinder

NOVA Glance

SmartX Provisioning: Virtual Playgrounds

via Automated Zero-touch Configuration

SmartX Box

SSD/ HDDs

CPUs/ GPUs

Box

Coord

inator

Com

puting

Default

Funct

CCN

X

Web

S

erve

r

Traffic

gene

rator

Inter-C

VM Images

Node Graphs

Templates Templates Templates


http://en.wikipedia.org/wiki/File:NetworkTopology-FullyConnected.png

Cloud OS Installation Tools Baremetal Provisioning Tools

SmartX Provisioning: Automated

Configuration Tools for SmartX Boxes

Linux Distribution

A Virtual Playground with OpenStack Cloud OS OS Installed Boxes

Distributed White Boxes


SmartX Provisioning: Automated

Configuration of SmartX Boxes


SmartX Provisioning: Configuration of

Inter-Connected SmartX Sites (Boxes)

WAN

A OpenFlow Site with SmartX Box and others

VM VM VM

(L2/L3 Network)

OpenFlow Switch

Virtual Switch

OVS

HP

HP

NVGRE/ VXLAN Tunnels + IPsec

Inter-connected Sites

OVS

OVS

Capsulator

OVS

OVS

Capsulator

OVS

OVS

Capsulator

+

A Site only with

SmartX Boxes


Enable Flexible

Control with

Diverse SDN

Controllers

32


• Application Visibility

– Resource-awareness for Service Composition Application

Performance Management

– Service Metric Visibility; Workload Benchmarking & Profiling;

• System/Network Resource Visibility

– Underlay-awareness for Overlay Virtual Networking

– Instantaneous Micro/Macro Benchmarking of Resource

Capability

Instant Visibility for

SDN-enabled

Infrastructure &

SDN-coordinated

Services


- 34 -


White Boxes

A set of VMs with images

Bare metal Provisioning tools

A set of Containers

Automated OpenStack Installation tool

Containerization

Placing Application/Service Functions

with Virtual Machines & Containers

Virtualization

Application/Service Functions


VM Functions with Hyper-

visor-based Virtualization


Container

Functions:

Docker,

Rocket, …

Lightweight packaging for

workloads &

Scaling …


- 38 -

Inter-Connecting VM

Functions via Overlay

vNetworking


http://www.google.co.kr/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&docid=03xdd3vLH3_rvM&tbnid=pVk1mHVOD3Lr_M:&ved=0CAUQjRw&url=http://networkheresy.com/2013/08/15/network-virtualization-gets-physical/&ei=B4okUtPhD4a8kgW7ooDIDg&bvm=bv.51495398,d.dGI&psig=AFQjCNEqnTWUCFl2Sc2tqRKRHhlpVd2n-Q&ust=1378212426501297

SDN-coordinated End-to-end Inter-

connection for Mobile Cloud Services

Overlay

vNetworking @ DC

SDN-Coordinated Flow

Steering with NFV @ Edge

Flow Tag/Steer/Map


http://cdn.sdncentral.com/wp-content/uploads/2013/03/3-tier.jpg

SmartX Orchestration: Service Function

Chaining

Micro Services


SmartX Orchestration: Resource-aware

Service Function Chaining


Cloud Datacenter as a BIG Computer

- 42 -

SmartX Orchestration:

Distributed Resource Scheduling


http://www.google.co.kr/url?sa=i&rct=j&q=openstack+&source=images&cd=&cad=rja&docid=Taz7e8VPqpfYDM&tbnid=s7KAugSB1vvgcM:&ved=0CAUQjRw&url=http://www.siliconloons.com/?p=343&ei=7rw0UZPuK82ciAfRhYHwCQ&bvm=bv.43148975,d.aGc&psig=AFQjCNGpBNIuOUGsiKO_hZqOZjRR7cQ0Qg&ust=1362496783039070

http://www.google.co.kr/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=http://qiita.com/kazunori279/items/ebe8ea24601e606f8048&ei=3352VM7LNcLVmAXp-4GQAw&bvm=bv.80642063,d.dGY&psig=AFQjCNH6QYZLs6_2hoH5c0MDTwvp99e-0g&ust=1417138263329605

https://www.google.co.kr/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRw&url=https://twitter.com/docker&ei=Nn92VPjTFcH4mAW5moLYBA&bvm=bv.80642063,d.dGY&psig=AFQjCNGF5eesQyo6FxoZzPYHz0-MN3N85Q&ust=1417138352864575

SmartX Orchestration: Container-based Services over Resource-shared Clusters

SmartX Automation Center

(Exp. UI including orchestration tools)

Cloud Infrastructure

Marathon/Kubernetes

Docke

rizing

Service

Docke

rizing

Service

Docke

rizing

Service

Docke

rizing

Service

Mesos Cluster

Docke

rizing

Service

SFC


SmartX Provisioning & Orchestration: Converged Resources - Workloads – Diversified Functions

44 Zero-touch Configuration

Flexible Control

Instant

Visibility

Auto Scaling

Continuous

Integration

Service

Chaining


Governing Service Realization: Data (Policy – Service – Function) & Resource

(Converged, Programmable, Virtualized)

Data Service

Engine

Data Model


Preparing Virtual Playgrounds

for Industrial Internet of Things (On-going)


Human-Defined Services over Software-

Defined Infrastructure

SmartX Boxes


Balanced Service Composition based on

Programmable (and Virtualized) Resources

- 48 -

Networked Computing

Systems Lab (2011~)


Thank you!

Send Inquiry to [email protected]

http://netmedia.gist.ac.kr

Gwangju Institute of

Science & Technology

Thank you!

[email protected]

49


[OpenStack Day in Korea 2015] Track 2-5 - Building Software-Defined Infrastructure with...

Software

Transcript of [OpenStack Day in Korea 2015] Track 2-5 - Building Software-Defined Infrastructure with...