A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang,...

26
A MULTI CLOUD SERVICE CO- DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science & Engineering The Chinese University of Hong Kong Hong Kong, China

Transcript of A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang,...

Page 1: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

A MULTI CLOUD SERVICE CO-

DEPLOYMENT MECHANISM

Yu Kang, Zibin Zheng, and Michael R. Lyu{ykang, zbzheng, lyu}@cse.cuhk.edu.hk

Department of Computer Science & EngineeringThe Chinese University of Hong Kong

Hong Kong, China

Page 2: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

Back Ground

Independent Deployment of Single Service

Co-deployment of Multi-service

Experiment and Discussion

Conclusion and Future Work

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

2

Page 3: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

BACK GROUND

Rapid growing of cloud-based services

Different cloud-based services may cooperate YouTube & Facebook Google Doc & Gmail Taobao & Alipay

Necessary to deploy together Interactions between services Independent deployment is not enough Critical to make global decisionCLOUD 2012, Hawaii, USA, June 24 - 29, 2012

3

Page 4: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

MOTIVATION EXAMPLE

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

4

Page 5: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

MULTI-SERVICE CO-DEPLOYMENT PROBLEM

Independent services with different target users (may overlap)

Interactions between services Deployed in different data centers even

different clouds for users One company to host and deploy

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

5

Page 6: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

Back Ground

Independent Deployment of Single Service

Co-deployment of Multi-service

Experiment and Discussion

Conclusion and Future Work

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

6

Page 7: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

INDEPENDENT DEPLOYMENT OF SINGLE SERVICE

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

7

Page 8: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

SINGLE SERVICE DEPLOYMENT

Indicator whether VM j is used

Indicator whether user i is

connected to VM j

Times of user i call service

Distance between user i

and VM j

Minimize total distance for all user requests

Every user i can only connect to

one VM

Can only connect to open VMs

Open at most k VMs

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

8

Page 9: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

INDEPENDENT DEPLOYMENT OF SINGLE SERVICE

yj = 1

xij = 1

Every user i can only connect to

one VM

×

Can only connect to open VMs

×

Open at most k VMs

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

9

Page 10: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

Back Ground

Independent Deployment of Single Service

Co-deployment of Multi-service

Experiment and Discussion

Conclusion and Future Work

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

10

Page 11: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

MULTI CLOUD SERVICE CO-DEPLOYMENT

Times of user i call service h

connect at most one VM

Times of interaction between service q

service s for request of user i

Limit number of instances every

serviceboth VMs should be selected

at most one connection

indicator whether interaction between services q and s go

through VM p to r for requests of user i

indicator whether VM j

for service h is used

indicator whether user i would use VM j

for service h

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

11

Page 12: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

MULTI CLOUD SERVICE CO-DEPLOYMENT

Open at most kh VMs for service h

xhij = 1

yipqrs = 1

zhj = 1

connect at most one VM

Can only connect to open VMs

×

First VM is chosen by user i

for service h, next is open

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

12

Page 13: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

ITERATIVE SEQUENTIAL CO-DEPLOYMENT ALGORITHM

First Generate Random

Deployment

Sequentially improve the deployment of

each service

Treat requests from other services the same

as these from users

Record the best till now

Disturb and do local search

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

13

Page 14: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

Back Ground

Independent Deployment of Single Service

Co-deployment of Multi-service

Experiment and Discussion

Conclusion and Future Work

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

14

Page 15: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

OBTAIN THE DATASET

1. Conduct the experiment on 597 planetlab instances

2. Ping 2,213 web-services and all other planetlab peers in random order

3. Delete records of several instances and web-services to obtain two non-negative matrices, finally 307 * 1,881 remains

4. Mapping: Planetlab nodes -> available data centers Web-services -> users

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

15

Page 16: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

DATASET STATISTICS

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

16

Page 17: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

EXPERIMENT SETTING

Above 106 decision variables Use the tool Ilog CPLEX to solve the MIP

problems Randomly generate user log and calling

sequences as: User id -> service si1 -> service si2 -> … ->

service sim

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

17

Page 18: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

DEFAULT EXPERIMENT SETTING

1881 users 10 services Deploy10 service VMs among a candidate set

in 100 data centers A user of service would have 5 request logs𝑠 One request of a service would involve on

average 5 requests of other services

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

18

Page 19: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

EXPERIMENT (ALGORITHM SPECIFICS)

Convergence of Iterative Sequential Procedure

Number of Disturbs

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

19

Page 20: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

EXPERIMENT (NUMBER OF SERVICES)

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

20

Page 21: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

EXPERIMENT (NUMBER OF SERVICE VMS)

Size of Candidate Set of Service VMs

Number of Service VMs to Deploy

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

21

Page 22: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

EXPERIMENT (SERVICES LOGS)

Number of Service Users

Average Call Length of Service

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

22

Page 23: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

EXPERIMENT (SERVICES LOGS)

Number of Logs

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

23

Page 24: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

Back Ground

Independent Deployment of Single Service

Co-deployment of Multi-service

Experiment and Discussion

Conclusion and Future Work

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

24

Page 25: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

CONCLUSION AND FUTURE WORK

Conclusion Model the latency-aware cloud-based multiple

services co-deployment problem Give a new iterative algorithm to solve the

problem Conduct experiments on real world data set

Limitation of model No limitation on requests to one service VM Computation time is not constant in real world Possible solution: add a term of computational

time in the model

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

25

Page 26: A MULTI CLOUD SERVICE CO-DEPLOYMENT MECHANISM Yu Kang, Zibin Zheng, and Michael R. Lyu {ykang, zbzheng, lyu}@cse.cuhk.edu.hk Department of Computer Science.

Q & A

CLOUD 2012, Hawaii, USA, June 24 - 29, 2012

26