Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction...

59
Cloud computing 101 Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting from 2017 1

Transcript of Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction...

Page 1: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Cloud computing101

Fabien Hermenier a.k.a Guillaume Urvoy-Keller

…..starting from 2017

1

Page 2: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources that can be rapidly provisioned and released with minimal management effort or service provider interaction.

2011

“”2

Page 3: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

1 self-provisioning,no human intervention

On-demand self-services

3

Page 4: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

4

Page 5: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

2availability over the

networkstandard mechanisms

broad network access

5

Page 6: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

3multi-tenant

virtual or physical resourceson-demand allocation

location independance

resource pooling

6

Page 7: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

reserved instances (yearly based)on-demand instances (hourly based)

hotspot instances (market based)7

Page 8: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Amazon EC2HotSpot instances

bid over the market price to get the instance8

Page 9: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

4fast (de-)allocation of resourcesscale to infinity

rapid elasticity

9

Page 10: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

verti

cal

elas

ticity

Tiers 1

Tiers 2

Tiers 3

10

Page 11: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

horizontal elasticity

Tiers 1

Tiers 2

Tiers 3

11

Page 12: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

5 metering capabilitiestransparent reporting

measured service

12

Page 13: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

13

Page 14: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

and I will call it cloud computing

14

Page 15: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Cloud Computingorigins

15

Page 16: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

If computers of the kind I have advocated become the computers of the future, then computing may someday be organized as a public utility just as the telephone system is a public utility... The computer utility could become the basis of a new and important industry.

John McCarthy, 1961

“”

16

Page 17: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

cluster computing

loosely coupled co-located serverssingle tenant

non-interactive workload rigid jobs

80s17

Page 18: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud o

r no

t ? on demand self-services

broad network access

resource pooling

rapid elasticity

measured service18

Page 19: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud o

r no

t ? on demand self-services

broad network access

resource pooling

rapid elasticity

measured service19

Page 20: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

ApplicationService

Provider

service oriented

pay as you go

95+1

Client2

Client3

Client

remote access todedicated applications

20

Page 21: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud o

r no

t ? on demand self-services

broad network access

resource pooling

rapid elasticity

measured service21

Page 22: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud o

r no

t ?

on demand self-services

broad network access

resource pooling(not real hw resources)

rapid elasticity

measured service22

Page 23: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

computers on demand.2002Deploy full custom stacks (OS to applications)

23

Page 24: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

to (re)deploy reproduciblenetwork experiments

multi-tenant,(limited on purpose) resource pooling

24

Page 25: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

to (re)deploy reproduciblenetwork experiments

100Mb/s10ms

10ms50ms,

5% loss

25

Page 26: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud o

r no

t ? on demand self-services

broad network access

resource pooling

rapid elasticity

measured service26

Page 27: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud o

r no

t ? on demand self-services

broad network access

resource pooling

rapid elasticity

measured service27

Page 28: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

S O Aervice

orientedrchitecture

2001+

composable unassociated, loosely coupled units

28

Page 29: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

exponential grows since 2001 private and public services to support its

growth

29

Page 30: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

800 x

tons of API, mini-services devoted to automation, flexibility, on-demand services for public and private use

30

Page 31: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

2006

scalable web services for other websites or client-

side applications31

Page 32: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

SOAP & REST over HTTPpay as you goelastic *-oriented services

*data, network or computation32

Page 33: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Clo

ud !

on demand self-services

broad network access

resource pooling

rapid elasticity

measured service33

Page 34: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

?aaS34

Page 35: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

web access to commercial sw.“one to many” model

customers don’t handle upgradesAPI for integration

Softwareas a ServiceS

aaS

35

Page 36: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

36

Page 37: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

37

Page 38: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

jailed runtime available to host applicationsgeneric or provider-specific APIsno control over the environment

Platformas a ServiceP

aaS

38

Page 39: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

39

$ heroku login…

$ git clone https://github.com/heroku/java-getting-started.git$ cd java-getting-started

$ heroku createCreating warm-eyrie-9006... done, stack is cedar-14http://warm-eyrie-9006.herokuapp.com/ | [email protected]:warm-eyrie-9006.gitGit remote heroku added

$ git push heroku master… http://warm-eyrie-9006.herokuapp.com/ deployed to Heroku

$ heroku ps:scale web=1

Page 40: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Infrastructureas a Service

low-level resources to deploy arbitrary software stackscomplete control over its network, storage and OS

IaaS

40

Page 41: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

41

Page 42: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

42

Things will crash. Deal with it!

Assume you could start with super reliable servers (MTBF of 30 years)Build computing system with 10 thousand of thoseWatch one fail per day

Dean Keynote, LADIS 2009

Page 43: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

43

~0.5 overheating (power down most machines in <5 mins, ~1-2 days to recover)~1 PDU failure (~500-1000 machines suddenly disappear, ~6 hours to come back)~1 rack-move (plenty of warning, ~500-1000 machines powered down, ~6 hours)~1 network rewiring (rolling ~5% of machines down over 2-day span)~20 rack failures (40-80 machines instantly disappear, 1-6 hours to get back)~5 racks go wonky (40-80 machines see 50% packetloss)~8 network maintenances (4 might cause ~30-minute random connectivity losses)~12 router reloads (takes out DNS and external vips for a couple minutes)~3 router failures (have to immediately pull traffic for an hour)~dozens of minor 30-second blips for dns~1000 individual machine failures~thousands of hard drive failuresslow disks, bad memory, misconfigured machines, flaky machines, etc.Long distance links: wild dogs, sharks, dead horses, drunken hunters, etc.

Typical first year for a new google cluster

Page 44: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

44

Building fault tolerant

services

deal with failuresdeal with inconsistency

be pessimistic

at every level

Page 45: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

45

October, 21th 2016: dynDNS targeted by a DDoS

Affected services:

1.2 Tb/s of DNSlookups

Page 46: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

46

Page 47: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

applicationsruntimes

integration/security

databaseservers

virtualisationserver HW

storagenetwork

you

man

age

ol’school IT

47

Page 48: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

SaaSapplications

runtimesintegration/security

databaseservers

virtualisationserver HW

storagenetwork

man

aged

by

vend

or

48

Page 49: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

PaaSapplications

runtimesintegration/security

databaseservers

virtualisationserver HW

storagenetwork

you manage

man

aged

by

vend

or

49

Page 50: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Open-source PaaS stacks

Page 51: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

IaaSapplications

runtimesintegration/security

databaseservers

virtualisationserver HW

storagenetwork

you

man

age

man

aged

by

vend

or

51

Page 52: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Open-source IaaS stacks

(2008+)

cloudstack

(2008+)

(2010+) (2012+)

52

Page 53: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

53

vendor lock-in

IaaS PaaS SaaS

Page 54: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

Deployment models

54

Page 55: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

public cloudgeneral availability to

everyone

the “real” cloudreduced coststrust issues ?

55

Page 56: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

56

Trust in megive me your code & data

Page 57: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

private cloudself hosted cloudworldcompany SA

might reduce TCOstronger trust

better manageability

57

Page 58: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

worldcompany SA hybrid cloud

58

Page 59: Fabien Hermenier a.k.a Guillaume Urvoy-Keller …..starting ...urvoy/docs/VICC/vicc-introduction 2017.pdf · On-demand self-services 3. 4. 2 availability over the network standard

multi-cloudsyou spread your application

avoid Single Point of Failures*take the benefits of each cloud

LB

59