Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking...

29
1 ©2013 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm Network Virtualization: Network Virtualization: Recent Developments Recent Developments Washington University in Saint Louis Saint Louis, MO 63130 [email protected] CSE 770 Networking Research Seminar at WUSTL January 28, 2013 These slides and audio/video recordings are available at: http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Transcript of Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking...

Page 1: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

1©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Network Virtualization: Network Virtualization: Recent DevelopmentsRecent Developments

Washington University in Saint LouisSaint Louis, MO 63130

[email protected] 770 Networking Research Seminar at WUSTL

January 28, 2013These slides and audio/video recordings are available at:

http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Page 2: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

2©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

OverviewOverview

1. Virtualization: Why, How?

2. Recent Networking Virtualization Technologies

3. Software Defined Networking

4. Our Research: Open Application Delivery

Note: References to sources are either on the same slide or at the end.

Page 3: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

3©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Virtualization of LifeVirtualization of Life Internet Virtualization

Virtual Workplace Virtual Shopping Virtual Education Virtual Sex Virtual Computing

No need to get out for Office Shopping Entertainment Education

Page 4: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

4©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Why Virtualize?Why Virtualize?1. Sharing: Break up a large resource

Large Capacity or high-speed2. Isolation: Protection from other

tenants3. Aggregating: Combine many

resources in to one4. Dynamics: Fast allocation,

Change/Mobility, load balancing5. Ease of Management

Cost Savings6. Mobility for fault tolerance

10Gb

SwitchSwitch

Switch Switch

Page 5: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

5©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Virtualization in ComputingVirtualization in Computing Storage:

Virtual Memory L1, L2, L3, ... Recursive Virtual CDs, Virtual Disks (RAID), Cloud storage

Computing: Virtual Desktop Virtual Server Virtual Datacenter

Thin Client VMs Cloud Networking: Plumbing

Virtual Channels, Virtual LANs, Virtual Private Networks Networks consist of: Hosts - L2 Links - L2 Bridges - L2

Networks - L3 Links - L3 Routers - L3 Networks – L4 Transports – L5 Applications

Each of these can be/need to be virtualized Quick review of recent technologies for network virtualization

Page 6: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

6©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

vNICsvNICs

Each VM needs its own network interface card (NIC)

vM1 vM2

vNIC1 vNIC2

vSwitch

pNIC

pSwitch

pM

Hypervisor

pNICp = Physicalv = VirtualM = Machine

Page 7: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

7©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

vNICs (Cont)vNICs (Cont)

1. VM vendors: S/W NICs in Hypervisor w Virtual Ethernet Bridge (VEB)(overhead, not ext manageable, not all features)

2. NIC Vendors: NIC provides virtual ports using Single-Route I/O virtualization (SR-IOV) on PCI bus

3. Switch Vendors: Switch provides virtual channels for inter-VM Communications using virtual Ethernet port aggregator (VEPA): 802.1Qbg (s/w upgrade), 802.1Qbh (new switches)

vM1 vM2

vNIC1 vNIC2

vSwitchpNIC

HypervisorpM

vM1 vM2

vNIC1 vNIC2

VEPA

pNIC

pM

pSwitch

vM1 vM2

vNIC1 vNIC2

vSwitch

pNIC

pM

Page 8: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

8©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Bridge Port ExtensionBridge Port Extension Multiple physical bridges to make a single virtual

bridge with a large number of ports Easy to manage and configure

IEEE 802.1BR

Bridge

BridgeBridge

BridgeBridge BridgeBridge

Bridge

Page 9: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

9©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

MultiMulti--TenantsTenants

1. Virtual Extensible Local Area Networks (VXLAN)2. Network Virtualization using Generic Routing Encapsulation

(NVGRE)3. Stateless Transport Tunneling Protocol (STT)Network Virtualization over L3 (NVO3) group in IETF

VM1-1VNI 22

VM1-2VNI 34

VM1-4VNI 98

VM1-3VNI 74

Hypervisor VTEP IP1

VM2-1VNI 34

VM2-2VNI 74

VM2-4VNI 22

VM2-3VNI 98

L3 Networks

Server 1 Server 2

Hypervisor VTEP IP2

Each tenant needs its own networking domain with its VLAN IDs

Page 10: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

10©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

MultiMulti--Site Site

Better to keep VM mobility in a LAN(IP address changes if subnet changes)

Solution: IP encapsulation Transparent Interconnection of Lots of Links

(TRILL)

Page 11: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

11©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Clouds and Mobile Apps Clouds and Mobile Apps Global Virtual Net Global Virtual Net

June 29, 2007: Apple announced iPhone Birth of Mobile Internet, Mobile Apps Almost all services are now mobile apps: Google,

Facebook, Bank of America, … Almost all services need to be global (World is flat) Almost all services use cloud computing

August 25, 2006: Amazon announced EC2 Birth of Cloud Computing in reality(Prior theoretical concepts of computing as a utility)

Web Services To Drive Future Growth For Amazon ($2B in 2012, $7B in 2019) - Forbes, Aug 12, 2012

Networks need to support efficient service setup and delivery

Page 12: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

12©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Application Delivery EvolutionApplication Delivery Evolution

Global Internet

Load Balancers

1. Single Server1. Single Server 2. Data Center2. Data Center

SSL Off loaders3. Global Clouds3. Global Clouds

Need to make the global Internet look like a data center

Page 13: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

13©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Google WANGoogle WAN

Google appliances in Tier 3 ISPs Details of Google WAN are not public ISPs can not use it: L7 proxies require app msg reassembly

Access ISP

Google L7 Proxy

Network POP

Access ISP

Google L7 Proxy

Google WAN

Google Data Center #1

Google Data Center #2

Page 14: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

14©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Our Solution: OpenADNOur Solution: OpenADN Open Application Delivery Networking Platform

Platform = OpenADN aware clients, servers, switches, and middle-boxes

Allows Application Service Providers (ASPs) to quickly setup services on Internet using cloud computing Global datacenter

Access ISP Access ISP

Servers A1, B1

Clients Clients

Internet

OpenADNSwitchesLegacy Routers

ServersA2

OpenADNmiddle-box

Page 15: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

15©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Development 1: Centralization of Control PlaneDevelopment 1: Centralization of Control Plane

Control = Prepare forwarding table Data Plane: Forward using the table Forwarding table is prepared by a

central controller Protocol between the controller and

the forwarding element: OpenFlow Centralized control of policies Switches are simple.

Controller can be complexCan use powerful CPUs

Lots of cheap switches = Good for large datacenters

Ref: [MCK08] ``OpenFlow: Enabling Innovation in Campus Networks," OpenFlow Whitepaper, March 2008http://www.openflow.org/documents/openflow-wp-latest.pdf

Control

DataSwitch

Forwarding Element

Forwarding Element

Forwarding Element

Forwarding Element

OpenFlow

Page 16: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

16©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Centralized vs. DistributedCentralized vs. Distributed

Fully centralized is not scalable. Fully distributed is not manageable.Hierarchy

Page 17: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

17©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Development 2: Standardized AbstractionsDevelopment 2: Standardized Abstractions The routers are expensive because there is no standard

implementation. Every vendor has its own hardware, operating/ management

system, and proprietary protocol implementations. Similar to Mainframe era computers.

No cross platform operating systems (e.g., Windows) or cross platform applications (java programs).

Proprietary fast forwarding hardware

Network Operating SystemOSPF BGP DHCP

Cisco IOSJuniper JUNOS

Ref: http://www.itc23.com/.../K1_McKeown-ITC_Keynote_Sept_2011.pdf

Page 18: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

18©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Example: PC Paradigm ShiftExample: PC Paradigm Shift Computing became cheaper because of clear division of

hardware, operating system, and application boundaries with well defined APIs between them

Virtualization simple management + multi-tenant isolation

IBM 360 HW, Storage, …OS360 Operating SystemScientific Business Batch

IntelWindowsAMD ARM

LINUXMSOffice OpenOffice

Physical HWHypervisor

VM1 VM2 VM3

1981DOS

1998

Page 19: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

19©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Software Defined NetworkingSoftware Defined Networking

Forwarding HW Forwarding HW

Forwarding HW Forwarding HW

Network Virtualization

Network OS1

Multicasting

Network OS2

Mobility

Network OS3

App1 App2

Forwarding

Virtualization

Network OS

ApplicationsEnterprise 1 Enterprise 2 Enterprise 3

Layered abstractions with standardized APIs

Ref: http://opennetsummit.org/archives/oct11/shenker-tue.pdf

Page 20: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

20©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

SDNSDN’’ss Layered AbstractionLayered Abstraction

SDN provides standardized mechanisms for distribution of control information

Network Virtualization

Network OS1 Network OS2

Net App1

Network OS3

Net App2 Net App3

Forwarding

Virtualization

Network OS

Network Level Control (ISP)

ASP1 ASP2 ASP3

OpenADN OpenADN OpenADN

OpenFlow

Application Level Control (ASP)

Forwarding HW Forwarding HW

Forwarding HW

Northbound

Southbound

Page 21: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

21©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

SDN Architecture Component ExamplesSDN Architecture Component Examples

Juniper Pronto

HP NEC

FlowVisor

NOX

Multicasting Mobility

Maestro

Forwarding

Virtualization/Slicing

Network OS/Controller

Control Applications

Beacon Helios

oftrace openseer oflops Monitoring/Debugging

Netgear

CienaOpenFlow

Ref: https://courses.soe.ucsc.edu/courses/cmpe259/Fall11/01/pages/lectures/srini-sdn.pdf

Floodlight

Open-VSwitch

ofmonitor

Page 22: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

22©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

SDN ImpactSDN Impact Why so much industry interest?

Commodity hardware Lots of cheap forwarding engines Low cost

Programmability Customization Those who buy routers, e.g., Google, Amazon, Docomo,

DT will benefit significantly

Tsunami of software defined devices: Software defined wireless base

stations Software defined optical switches Software defined routers

Page 23: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

25©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Life Cycles of TechnologiesLife Cycles of Technologies

Potential

TimeResearch Hype Dis

illusionmentSuccess orFailure

ATMSDN

MPLS

Page 24: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

26©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Industry Growth: Formula for SuccessIndustry Growth: Formula for Success

Paradigm Shifts Leadership Shift Old market leaders stick to old paradigm and loose Mini ComputersPC, PhoneSmart Phone, PCSmart Phone

Time

Number ofCompanies

NewEntrants

Consoli-dation

StableGrowth

Innovators Startups TechnologyDifferentiation

Big CompaniesManufacturing Price differentiation

Page 25: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

27©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

OpenADN in OpenADN in SDNSDN’’ss Layered AbstractionLayered Abstraction

SDN provides standardized mechanisms for distribution of control information

Network Virtualization

Network OS1

App1

Network OS2

App2

Network OS3

App3 App4

Forwarding

Virtualization

Network OS

Network Level Control (ISP)

ASP1 ASP2 ASP3

OpenADN OpenADN OpenADN

OpenADN Aware OpenFlow

Application Level Control (ASP)

Forwarding HW Forwarding HW

Forwarding HW

Page 26: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

28©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

Key Features of OpenADNKey Features of OpenADN1. Edge devices only.

Core network can be current TCP/IP based, OpenFlow or future SDN based

2. Coexistence (Backward compatibility): Old on New. New on Old

3. Incremental Deployment4. Economic Incentive for first adopters5. Resource owners (ISPs) keep complete control

over their resources

Most versions of Ethernet followed these principles. Many versions of IP did not.

Page 27: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

29©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

SummarySummary

1. Cloud computing Virtualization of computing, storage, and networkingNumerous recent standards related to networking virtualization both in IEEE and IETF

2. Recent Networking Architecture Trends:1. Centralization of Control plane2. Standardization of networking abstractions

Software Defined Networking (SDN)3. Most networking devices will be software defined

3. OpenADN enables delivery of applications using North-bound SDN API

Page 28: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

30©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

ReferencesReferences Subharthi Paul, Raj Jain, "OpenADN: Mobile Apps on Global Clouds Using

OpenFlow and Software Defined Networking," First International workshop on Management and Security technologies for Cloud Computing (ManSec-CC) 2012, Decenber 7, 2012, in conjunction with IEEE Global Communications Conference (Globecom) 2012, Anaheim, CA, December 3-7, 2012, http://www.cse.wustl.edu/~jain/papers/adn_gc12.htm

Intel, “Simplifying the management of network elements in Telecom,”White paper, http://www.intel.com/content/www/us/en/communications/communications-management-solutions-telecom-paper.html

Nicira, “Networking in the era of virtualization,” White paper, http://nicira.com/sites/default/files/docs/Networking%20in%20the%20Era%20of%20Virtualization.pdf

OpenStack Object Storage Developers Guide, http://docs.openstack.org/api/openstack-object-storage/1.0/os-objectstorage-devguide-1.0.pdf

OpenStack Community Welcome Guide, http://www.openstack.org/assets/welcome-guide/openstack-welcome-guide.pdf

Page 29: Network Virtualization: Recent Developmentsjain/cs770-13/ftp/virtual.pdf · CSE 770 Networking Research Seminar at WUSTL January 28, 2013 ... Note: References to sources are either

31©2013 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/cs770-13/virtual.htm

References (Cont)References (Cont) Juniper Networks, “The important role of the network in a virtualized world,”

http://www.netutils.com/documents/networking/whitepapers/roleNetwork.pdf Juniper Networks, “Solutions for deploying server virtualization in Datacenters,”

http://www.juniper.net/us/en/dm/simplify/virtualization/ Joe Pellisier and Guru Chahaal, (Cisco) “Virtualization Convergence over Ethernet,”

http://www.ethernetsummit.com/English/Collaterals/Proceedings/2012/20120223_T2-2A_Pelissier_Chahal.pdf

HP, “Virtual networking technologies at the server network edge,”http://h20000.www2.hp.com/bc/docs/support/SupportManual/c02044591/c02044591.pdf

HP, “Facts about IEEE 802.1Qbg proposal,”http://h20000.www2.hp.com/bc/docs/support/SupportManual/c02877995/c02877995.pdf

Emulex, “Optimizing virtualized servers with SR-IOV,”http://www.emulex.com/artifacts/885edbe0-85e7-4c4d-875a-04b89d798a78/elx_wp-all_srv-iov.pdf