Microservices and the Cloud - DevOps Cardiff Meetup

46
Marc Cluet https://www.flickr.com/photos/zachd1_618/5344850282

description

In this talk I cover my experiences with microservices in cloud environments, also talk about service discovery and orchestration.

Transcript of Microservices and the Cloud - DevOps Cardiff Meetup

Page 1: Microservices and the Cloud - DevOps Cardiff Meetup

Marc  Cluet  

https://www.flickr.com/photos/zachd1_618/5344850282  

Page 2: Microservices and the Cloud - DevOps Cardiff Meetup

Who am I?!

Marc  Cluet  (@lynxman)    Head  of  Operations  at  <redacted>  17  years  of  experience  as  a  SysAdmin  Founding  member  of  Juju  and  MAAS  while  at  Canonical  Built  a  DevOps  Engineering  Team  at  Rackspace  Been  DevOps’in  for  the  last  5  years  

Page 3: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

https://www.flickr.com/photos/wintermute2600/4056854111  

Page 4: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

Microservices are not new!!!

Page 5: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

Page 6: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

https://www.flickr.com/photos/marfis75/3279307888  

Page 7: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

Microservices are reliant!!!

Page 8: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

https://www.flickr.com/photos/5wa/8593739154  

Page 9: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

Microservices force you to!Design for Failure!!

!!

Page 10: Microservices and the Cloud - DevOps Cardiff Meetup

So… Microservices!!

Page 11: Microservices and the Cloud - DevOps Cardiff Meetup

Recommendations!

https://www.flickr.com/photos/sarunas_b/9630357613  

Page 12: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Fitting!

https://www.flickr.com/photos/egs/183990473  

Page 13: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Fitting!

Orchestration!Cost Control!Anti-Fragile!Security in all Layers!!!

Page 14: Microservices and the Cloud - DevOps Cardiff Meetup

Orchestration!

https://www.flickr.com/photos/foilman/3295092874  

Page 15: Microservices and the Cloud - DevOps Cardiff Meetup

Orchestration!

1.  Autoscaling!2.  Self Healing!3.  Cost Forecast!4.  Predictive!!

Page 16: Microservices and the Cloud - DevOps Cardiff Meetup

Service Discovery!

Service  Node  A  

Service  Publication  

Service  Node  B  

Service  Node  C  

Page 17: Microservices and the Cloud - DevOps Cardiff Meetup

Service Discovery!

Service  Node  A  

Health  Check  

Discovery  Agent  

Discovery  Agent  

Service  Node  B  

Health  Check  

Service  Publication  

Page 18: Microservices and the Cloud - DevOps Cardiff Meetup

Cost Control!

Page 19: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Architecture!

Web  Frontend  

Web  Mobile  App  

Data  Backend   Workers  

API  Service  

Page 20: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Architecture!

Router  

API  Server  

Scheduler  

MQ  

Worker  

Page 21: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Architecture!Load  

Balancer  

API  Server  API  Server  API  Server  API  Server  

MQ  Worker  Worker  Worker  Worker  

Scheduler  

Page 22: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Architecture!

Orchestration  

Provisioning   Config  Mgmt  Metrics  

Page 23: Microservices and the Cloud - DevOps Cardiff Meetup

Cloud Fitting!Orchestration! Metrics!

Provisioning! Config Mgmt!

cloud-init!

Page 24: Microservices and the Cloud - DevOps Cardiff Meetup

Recommendations!

https://www.flickr.com/photos/mdpettitt/4818781521  

Page 25: Microservices and the Cloud - DevOps Cardiff Meetup

1 Server per Service!

https://www.flickr.com/photos/90994070@N00/4700774401  

Page 26: Microservices and the Cloud - DevOps Cardiff Meetup

Do your HA right!https://www.flickr.com/photos/daverugby83/4583767689  

Page 27: Microservices and the Cloud - DevOps Cardiff Meetup

Containers!

https://www.flickr.com/photos/gcwest/281385801  

Page 28: Microservices and the Cloud - DevOps Cardiff Meetup

Containers!

Page 29: Microservices and the Cloud - DevOps Cardiff Meetup

Containers!

<3!!!

Page 30: Microservices and the Cloud - DevOps Cardiff Meetup

Containers!

<3!!!

Page 31: Microservices and the Cloud - DevOps Cardiff Meetup

Containers!

Page 32: Microservices and the Cloud - DevOps Cardiff Meetup

API Versioning!

https://www.flickr.com/photos/kevinbyrom/5027408898/  

Page 33: Microservices and the Cloud - DevOps Cardiff Meetup

API Versioning!

https://www.flickr.com/photos/kevinbyrom/5027408898/  

Version  1  /servers?image=imageId&  flavor=flavorId&  name=serverName&  status=serverStatus&  marker=markerID&  limit=int&changes-­‐since=dateTime&  RAX-­‐SI:image_schedule=boolean    

Version  2  /v2/{tenant_id}/servers�{?changes-­‐since,�image,�flavor,�name,�marker,�limit,�status,�host}    

Version  3  /v3/servers/{server_id}/action�{?changes-­‐since,�image,�flavor,�name,�marker,�limit,�status,�host}    

Page 34: Microservices and the Cloud - DevOps Cardiff Meetup

Sync vs Async!

https://www.flickr.com/photos/beate_meier/8337014543  

Page 35: Microservices and the Cloud - DevOps Cardiff Meetup

Sync vs Async!

Action  1   Action  2   Action  3  

Page 36: Microservices and the Cloud - DevOps Cardiff Meetup

Sync vs Async!

Action  1   Action  2  

Action  2b  

Action  3  

Page 37: Microservices and the Cloud - DevOps Cardiff Meetup

Sync vs Async!

Router  

API  Server  

Scheduler  

MQ  

Worker  

Page 38: Microservices and the Cloud - DevOps Cardiff Meetup

Dark Side of Microservices!

https://www.flickr.com/photos/kalexanderson/7556757396  

Page 39: Microservices and the Cloud - DevOps Cardiff Meetup

Costs!

https://www.flickr.com/photos/amagill/3366720659  

Page 40: Microservices and the Cloud - DevOps Cardiff Meetup

Concentration!

https://www.flickr.com/photos/z_wenjie/5602616401  

Page 41: Microservices and the Cloud - DevOps Cardiff Meetup

Network Fragmentation!

https://www.flickr.com/photos/small_realm/6898449633  

Page 42: Microservices and the Cloud - DevOps Cardiff Meetup

Dark Side of Microservices!

Page 43: Microservices and the Cloud - DevOps Cardiff Meetup

Learn from your peers!Jos  Boumans  

Page 44: Microservices and the Cloud - DevOps Cardiff Meetup

Break things!!

http://bethesignal.org/blog/2008/07/22/fail-­‐we-­‐can-­‐believe-­‐in/  

Page 45: Microservices and the Cloud - DevOps Cardiff Meetup

Have fun!

http://geek-­‐and-­‐poke.com/geekandpoke/2013/12/3/yesterdays-­‐regex  

Page 46: Microservices and the Cloud - DevOps Cardiff Meetup

https://www.flickr.com/photos/mikko_luntiala/12691267935  

https://www.flickr.com/photos/dullhunk/202872717  

@lynxman!

http://slideshare.net/lynxmanuk/!

!