Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication...

24
1 ©2015 Raj Jain Washington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm Application Deployment in Application Deployment in Future Global Multi Future Global Multi - - Cloud Cloud Environment Environment Washington University in Saint Louis Saint Louis, MO 63130 [email protected] OIN Workshop, Saint Louis, MO October 20, 2015 These slides are available on-line at: http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Transcript of Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication...

Page 1: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

1©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Application Deployment in Application Deployment in Future Global MultiFuture Global Multi--Cloud Cloud EnvironmentEnvironment

Washington University in Saint LouisSaint Louis, MO 63130

[email protected] Workshop, Saint Louis, MO

October 20, 2015These slides are available on-line at:

http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Page 2: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

2©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

OverviewOverview

Recent Trends in Networking: Trend 1: Computation in the Edge Trend 2: Hierarchical Computation Trend 3: Liquid Applications

Solution: Generalized Application Delivery Networking

This research was made possible by NPRP grant # 6-901-2-370 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the author[s].

Page 3: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

3©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Users

Network

Service/Content hosted on w

eb servers

Distributed Content Caches

3

Trend: Content Distribution Networks (CDN) Trend: Content Distribution Networks (CDN) ––Evolution of a DataEvolution of a Data--Centric Internet Centric Internet

To serve world-wide users, latency was critical and so the data was replicated and brought to edge

Page 4: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

4©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Users

Network

Micro-Clouds

Trend 1: Computation in the EdgeTrend 1: Computation in the Edge To service 5G smart phone users, the computation needs to

come to edge Micro-cloud on the tower

Page 5: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

5©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Larger and infrequent jobs serviced by local and regional clouds

Users

Network

Micro-Clouds

LocalClouds

RegionalClouds

Trend 2: Hierarchical ComputationTrend 2: Hierarchical Computation

Page 6: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

6©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

MMERNC IMS

Hardware

Hardware

Set Top BoxCGNAT

ResidentialGateway

Hardware

MMERNC IMS

ResidentialGateway CGNAT

Set Top Box

MMERNC IMS

MMERNC IMS

Trend 3: Liquid ApplicationsTrend 3: Liquid Applications Current networks designed for voice applications

Network function virtualization (NFV) is looking at functions that are designed for voice applications

Future 5G Mobile networks need a more general functional decomposition and architecture

Page 7: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

7©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

ServiceService--Infrastructure Separation Infrastructure Separation With cloud computing, anyone can super-compute on demand.

Physical infrastructure is owned by Cloud Service Provider (CSP). Tenants get virtual infrastructure

Win-Win combination With virtualization, an ISP can set up all virtual resources on

demand Physical Infrastructure owned by NFV infrastructure service

provider (NSP) and tenant ISPs get virtual NFVI services Win-Win combination

Page 8: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

8©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

HighHigh--Level RequirementsLevel Requirements Automatic provisioning and deployment Automatic runtime control

Elastic load balancing Handling failures

Dynamically change the application’s distributed footprint Launch application on new sites Shutdown existing sites

8

Page 9: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

9©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

HighHigh--level Challengeslevel Challenges

Massively distributed: Virtual resources distributed geographically Virtual resources from multiple providers

Common platform for: Different device types – Application servers, middleboxes,

routers, switches, etc. Different service types: Voice, Video, IoT, Gaming, Apps

Inter-Cloud is of interest in 5G as well as in other applications Cisco announced $1B investment in inter-cloud

9

Ref: Network World, “Cisco pumping $1 billion more into Inter-Cloud,” September 29, 2014,http://www.networkworld.com/article/2688819/cloud-computing/cisco-pumping-1-billion-more-into-intercloud.html

Page 10: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

10©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Any Function Virtualization (FV)Any Function Virtualization (FV) Network function virtualization of interest to Network service

providers But the same concept can be used by any other industry, e.g.,

financial industry, banks, stock brokers, retailers, mobile games, …

Everyone can benefit from: Functional decomposition of there industry Virtualization of those functions Service chaining those virtual functions (VFs) A service provided by the next gen ISPs

Page 11: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

11©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Carrier App Market: Lower CapExCarrier App Market: Lower CapEx

Virtual IP Multimedia System

Page 12: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

12©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Trend: MultiTrend: Multi--CloudsClouds

Ref: http://www.rightscale.com/blog/cloud-industry-insights/cloud-computing-trends-2014-state-cloud-survey

Most companies use more than one cloud.

Page 13: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

13©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Northbound Interface

Cloud Datacenter

OpenStack EC2OpenDaylight

EnterpriseDatacenter

ISP Network

Virtual Hosts

Virtual Network

Virtual WAN Services

Virtual Storage

Southbound Interface

Resource Providers

ApplicationService Providers

MCAD Application Service (AAS) abstraction

MCAD Application Workflow (AAW) abstraction

MCAD Application Cloud (AAC) abstraction

MCAD Platform

MCAD Resource Driver(OpenStack)

MCAD Resource Driver(OpenDaylight)

MCAD Resource Driver(EC2)

Virtual Hosts

Virtual Storage

Virtual Network

Network POP Micro-Datacenters

Application Deployment Administrators

Application Architects

Application Service Developers

Services in a Cloud of CloudsServices in a Cloud of Clouds

Page 14: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

14©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

MCAD FeaturesMCAD Features

Automate the entire process of creating new workflows and installing them, managing them during runtime, uninstalling them as necessary Allow Deployment Administrators specify policies for

quantity and location of resources inside various clouds. Workflow creation includes virtual networks, computers,

storage inside the clouds as well as the network between the clouds

WAN bandwidth and latency is the key to placement. Allows manual approval and override.

Physical infrastructure owners keep complete control over their resources while the tenant service providers can deploy their applications according to their desired policies

All communication is via APIs. All interfaces initially XML based. GUI based in future.

Page 15: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

15©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Resource ControlResource Control Tenants keep complete control of their data.

NSP does not have to look at the application data to enforce application level policies

NSPs keep complete control of their equipment. tenants communicate their policies to NSP’s control plane

VFs and Middle boxes can be located anywhere on the global Internet (Of course, performance is best when they are close by)

Tenants or NSPs can own OpenADN modules. NSPs can offer “Service Chaining” service

Page 16: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

16©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Application Delivery for the EnterpriseApplication Delivery for the Enterprise MCAD is of interest to 5G Mobile carriers But the same concept can be used by any other industry, e.g.,

financial industry, banks, stock brokers, retailers, mobile games, …

Everyone can benefit from: Functional decomposition of their industry Virtualization of those functions Service placement of those virtual functions (VFs) A service provided by the next gen ISPs

Page 17: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

17©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Mobile Healthcare Use Case Mobile Healthcare Use Case

Home sensors for patient monitoring

Body Area Network for mobile patient

Mobile Doctor

HospitalCloud

Insurance CoCloud

Multi-Cloud Mobile Application Deployment and Optimization Platform

Medical ApplicationService Provider

5G Carrier

SDNController…

Page 18: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

18©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

sensors, active/passive tags, etc.

factory floor, house, car, etc.

network POPs. pico-cells, etc.

Con

trol

The

ory

(Rea

l-tim

e)A

naly

tics,

BI

Realm A

enterprise/cloud DCs

Big

“ger

”D

ata

Inter-realm data sharing

(analytics data)

Dat

a

Device‐facing interface

Node‐facing interface

E - W Interface

Nea

r Rea

l-tim

e A

naly

tics

Hug

e da

ta

E - W InterfaceThings Social Network (Collaborative Apps)

Distribution

Aggregation Realm B

Use Case 1: Internet of ThingsUse Case 1: Internet of Things Computing everywhere or Fog computing. Data aggregation and analytics at various levels

Page 19: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

19©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Cloud

Cloud

Cloud

Cloud

Cloud

Cloud

Cloud

Cloud

MCAD

MultiMulti--Cloud SecurityCloud Security Can one cloud provider be trusted by another?

Would Google trust Microsoft, Amazon, or Apple?

Page 20: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

20©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

SummarySummary1. To meet the quality of experience (QoE) for future 5G mobile

applications, the computation will need to come to edge. Computation will be hierarchical with micro-Clouds on Towers, Local Clouds, and Regional Clouds

2. Need software defined inter-cloud management and ability to create/deploy/move applications and functions among clouds while maintaining the required QoE

3. Mobile multi-Cloud Application Delivery (MCAD) platform will solve the problem of optimal application placement. WAN link capacity, utilization, and latency are key to the placement of VMs.

4. Infrastructure owners keep complete control over their resources. Tenants keep complete control over their traffic.

5. Same solution is application to numerous other applications such as enterprises, internet of things, and apps.

Page 21: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

21©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Recent PapersRecent Papers Subharthi Paul, Raj Jain, Mohammed Samaka, Jianli Pan,

"Application Delivery in Multi-Cloud Environments using Software Defined Networking," Computer Networks Special Issue on cloud networking and communications, Available online 22 Feb 2014, http://www.cse.wustl.edu/~jain/papers/comnet14.htm

Raj Jain and Subharthi Paul, "Network Virtualization and Software Defined Networking for Cloud Computing - A Survey," IEEE Communications Managzine, Nov 2013, pp. 24-31, http://www.cse.wustl.edu/~jain/papers/net_virt.htm

Page 22: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

22©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Recent TalksRecent Talks Raj Jain, "Smart Cities: Technological Challenges and Issues," IEEE CS

Keynote at 21st Annual International Conference on Advanced Computing and Communications (ADCOM) 2015, Chennai, India, September 19, 2015, Chennai, India, September 18, 2015, http://www.cse.wustl.edu/~jain/talks/smrtcit.htm

Raj Jain, "Internet of Things: Challenges and Issues," IEEE CS Keynoteat 20th Annual Conference on Advanced Computing and Communications (ADCOM 2014), Bangaluru, India, September 19, 2014, http://www.cse.wustl.edu/~jain/talks/iot_ad14.htm

Raj Jain, "AppFabric: Application Deployment and Service Chaining in Future NFV Cloud WAN Environments," Cisco Research Seminar, San Jose, CA, May 15, 2014, http://www.cse.wustl.edu/~jain/talks/apf_csc.htmRaj Jain, "SDN and NFV: Facts, Extensions, and Carrier Opportunities," AT&T Labs SDN Forum Seminar, April 10, 2014, http://www.cse.wustl.edu/~jain/papers/adn_att.htm

Raj Jain, "Networking for Big Data," IEEE CS Keynote at 19th Annual International Conference on Advanced Computing and Communications (ADCOM) 2013, Chennai, India, October 22, 2013. http://www.cse.wustl.edu/~jain/talks/adcom13.htm

Page 23: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

23©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

AcronymsAcronyms ATM Asynchronous Transfer Mode ECN Explicit congestion notification EFCI Explicit Forward Congestion Indication FECN Forward Explicit Congestion Notification GB Gigabyte IEEE Institution of Electrical and Electronic Engineering IETF Internet Engineering Task Force IoT Internet of Things IP Internet Protocol IRTF Internet Research Task Force ITU International Telecommunications Union LAN Local Area Network LTE Long Term Evolution MHz Mega Hertz OpenADN Open Application Delivery Networking SDN Software Defined Networking

Page 24: Application Deployment in Future Global Multi-Cloud …jain/talks/ftp/apf_oin.pdfApplication Deployment in Future Global Multi-Cloud Environment Washington University in Saint Louis

24©2015 Raj JainWashington University in St. Louis http://www.cse.wustl.edu/~jain/talks/apf_oin.htm

Acronyms (Cont)Acronyms (Cont) TCP Transmission Control Protocol TV Television VM Virtual Machine WAN Wide Area Network WiFi Wireless Fidelity WiMAX Worldwide Interoperability for Microwave Access