Orienting yourself to continuous delivery & microservices
-
Upload
michael-cote -
Category
Technology
-
view
984 -
download
1
Transcript of Orienting yourself to continuous delivery & microservices
![Page 1: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/1.jpg)
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.
Orienting yourself to continuous delivery & microservicesPivotal Cloud Roadshow, March 2015
1
[email protected] - @cote
Download the slides: http://cote.io/cdtalk
![Page 2: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/2.jpg)
© Copyright 2014 Pivotal. All rights reserved. 2
Hello!• @cote – Director, Technical Marketing at Pivotal
• Former industry analyst at 451 Research and RedMonk
• Corporate Strategy & M&A at Dell
• Recovering code monkey
• More: http://cote.io or [email protected]
![Page 3: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/3.jpg)
© Copyright 2014 Pivotal. All rights reserved. 3
Conclusions• The business goal is to learn your way to a better product that
establishes competitive advantage, leading to profit
• “Continuous delivery” is the IT process that enables this goal. It’s a horribly leaky abstraction that requires much change.
•Microservices is one of these changes, one of the larger ones
• “A lot of effort went into making this effortless” - look into an operationalized architecture
• The build is not not done until a customer is using it
![Page 4: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/4.jpg)
© Copyright 2014 Pivotal. All rights reserved. 4
In case you missed breakfast
![Page 5: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/5.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Your company is probably not going to last
5
“At the current churn rate, 75% of the S&P 500 firms in 2011 will be replaced by new firms entering the S&P500 in 2027.”
Source: “Creative destruction in the S&P500 index,” Jan 2014.
![Page 6: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/6.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Achieving the right mixture of risk and agility
6
![Page 7: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/7.jpg)
© Copyright 2014 Pivotal. All rights reserved. 7
Q: How can IT help? A: Continuous Delivery
![Page 8: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/8.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Operating on Internet Time
8
![Page 9: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/9.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Gathering specifications…
9
11:18am
![Page 10: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/10.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Fail fast…
10
~11:30am
![Page 11: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/11.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Learning, feedback…
11
11:33am
![Page 12: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/12.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Success! Customer value creation!
12
11:39am
![Page 13: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/13.jpg)
© Copyright 2014 Pivotal. All rights reserved. 13
The IT cycle is too for slow concept to cash
$Busin
ess
Devel
opm
ent
QA
Ope
ratio
nsCu
stom
er
![Page 14: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/14.jpg)
© Copyright 2014 Pivotal. All rights reserved. 14
Continuous delivery aims to shorten it
$
![Page 15: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/15.jpg)
© Copyright 2014 Pivotal. All rights reserved. 15
Keep the pipeline flowing!
Design Develop
Test
Customer Feedback Customer
Delivery
Analytics
![Page 16: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/16.jpg)
© Copyright 2014 Pivotal. All rights reserved. 16
Warner Music: Software Factories
New applications and major updates - Before: 6 months, team of 10 developers - After: 6 weeks, same team - Speed/Agility: 400% faster on new platform - HR Hard Savings: $1.1M per application update
delivered
See more background in the Cloud Foundry 2013 talk and 2014 interview.
Jonathan Murray, a real person!
![Page 17: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/17.jpg)
© Copyright 2014 Pivotal. All rights reserved. 17
But things are not so nifty…
![Page 18: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/18.jpg)
© Copyright 2014 Pivotal. All rights reserved. 18
Usage is low, but improving
DIY 36%
CI Products 28%
Other 8%
None 28%
What build automaton or CI/CD tools are you using? (451 Research study)
50%
18%
41%
8%
Believe doing CD
Doing textbook CD
Use of CD is growing (DZone studies)
2015 2014
Sources: 2014Q1 451 Research DevOps Study, n=201. In second study (n=300), 38% used “build and continuous integration tools”; "DZone's 2014 Guide to Continuous Delivery," n=500; The [DZone] Guide to Continuous Delivery, Vol. 2," Feb, 2015, n=900.
![Page 19: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/19.jpg)
© Copyright 2014 Pivotal. All rights reserved.
We’ve trained IT to be paranoid & slow
19
Project Mgmt UX Dev QA DBA Sys
AdminNet
AdminStorage Admin
Adapted from: http://www.slideshare.net/adriancockcroft/goto-berlin
MONOLITHIC DELIVERY
![Page 20: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/20.jpg)
© Copyright 2014 Pivotal. All rights reserved. 20
So let’s re-train them…
Product Mgr UX Dev QA DBA Sys
AdminNet
AdminStorage Admin
BUSINESS CAPABILITY TEAMS USING MICROSERVICES
PLATFORM OPERATIONS TEAM
Adapted from: http://www.slideshare.net/adriancockcroft/goto-berlin
![Page 21: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/21.jpg)
© Copyright 2014 Pivotal. All rights reserved. 21
De-coupling: it actually works this time!
Product Mgr UX Dev QA DBA Sys
AdminNet
AdminStorage Admin
BUSINESS CAPABILITY TEAMS USING MICROSERVICES
PLATFORM OPERATIONS TEAM
Adapted from: http://www.slideshare.net/adriancockcroft/goto-berlin
Self Service
API
![Page 22: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/22.jpg)
© Copyright 2014 Pivotal. All rights reserved. 22
INVENTORY
Prod Release
Prod Release
Prod Release
CATALOG
Prod Release
Prod Release
Prod Release
REVIEWS
Prod Release
Prod Release
Prod Release
SHIPPING
Prod Release
Prod Release
Prod Release
![Page 23: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/23.jpg)
© Copyright 2014 Pivotal. All rights reserved. 23
InfrastructureApplications
Monoliths Microservices
Pivotal CF
Continuous Delivery
Software Factories
Feedback
Rapid Iteration
Horizontal Scale
Diversity of Clients
Physical/Virtual
Goals & Needs Supporting Changes
![Page 24: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/24.jpg)
© Copyright 2014 Pivotal. All rights reserved. 24
Microservices overview
![Page 25: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/25.jpg)
© Copyright 2014 Pivotal. All rights reserved. 25
DEFINE: Microservice
Loosely coupled service oriented architecture with bounded contexts
Adrian Cockcroft Technology Fellow, Battery Ventures Former Netflix Chief Cloud Architect
![Page 26: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/26.jpg)
© Copyright 2014 Pivotal. All rights reserved. 26
DEFINE: Microservice
Loosely coupled service oriented architecture with bounded contexts
If every service has to be updated in concert, it’s not loosely coupled!
If you have to know about surrounding services you don’t have a bounded context.
![Page 27: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/27.jpg)
© Copyright 2014 Pivotal. All rights reserved. 27
Not Monoliths
Relational Database
Data Access
Service
HTML JavaScript MVC
Service
Monolithic ApplicationBrowser
![Page 28: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/28.jpg)
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved. 28
WS -
![Page 29: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/29.jpg)
© Copyright 2014 Pivotal. All rights reserved. 29
Not Traditional (ESB-centric) SOA
Enterprise Service Bus
Service Service Service Service
Service Service Service Service
UI UI
![Page 30: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/30.jpg)
© Copyright 2014 Pivotal. All rights reserved. 30
Microservice Architecture
…
HTTP
HTTP
HTTP
HTTP
HTTP
HTTP
AMQPAMQP
Relational DB
Key/Value Store
Graph DB
![Page 31: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/31.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Normally, here, you’d see some awesome code…
31
(This is me.)
![Page 32: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/32.jpg)
© Copyright 2014 Pivotal. All rights reserved. 32
Time to freak out ops…
![Page 33: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/33.jpg)
© Copyright 2014 Pivotal. All rights reserved. 33
What we’re telling ops…
1. Draw some circles 2. Draw the rest of the owl.
![Page 34: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/34.jpg)
© Copyright 2014 Pivotal. All rights reserved. 34
This is what ops sees!
![Page 35: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/35.jpg)
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved. 35
http://highscalability.com/blog/2014/4/8/microservices-not-a-free-lunch.html
![Page 36: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/36.jpg)
© Copyright 2014 Pivotal. All rights reserved. 36
Paying for your lunch…• Significant Operations Overhead
• Substantial DevOps Skills Required
• Implicit Interfaces
•Duplication of Effort
•Distributed System Complexity
•Asynchronicity is Difficult!
• Testability Challenges
![Page 37: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/37.jpg)
© Copyright 2014 Pivotal. All rights reserved. 37
Source: “Microservice Prerequisites,” Martin Fowler, August 2014.
https://www.flickr.com/photos/gusset/3723961589
You must be this tall to use Microservices…
• Rapid provisioning
•Basic monitoring
• Rapid application deployment
•DevOps culture
![Page 38: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/38.jpg)
© Copyright 2014 Pivotal. All rights reserved. 38
It takes a platform…
http://techblog.netflix.com/2013/01/optimizing-netflix-api.htmlhttp://techblog.netflix.com/2014/03/the-netflix-dynamic-scripting-platform.html
![Page 39: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/39.jpg)
© Copyright 2014 Pivotal. All rights reserved.
It takes a platform…
39
Cloud Foundry Trellis
![Page 40: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/40.jpg)
© Copyright 2014 Pivotal. All rights reserved. 40
Platform Features• Environment Provisioning
•On-Demand/Automatic Scaling
• Failover/Resilience
• Routing/Load Balancing
•Data Service Operations
•Monitoring
![Page 41: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/41.jpg)
© Copyright 2014 Pivotal. All rights reserved.
Trellis Services Suite
41
Trellis for Pivotal Cloud Foundry
Config Server for Pivotal Cloud Foundry
Service Registry for Pivotal Cloud Foundry
Circuit Breaker Dashboard for Pivotal Cloud Foundry
![Page 42: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/42.jpg)
© Copyright 2014 Pivotal. All rights reserved. 42
It seems like a lot…but it’ll be fun (and valuable)
![Page 43: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/43.jpg)
© Copyright 2014 Pivotal. All rights reserved. 43
Supporting Rapid Change
Microservices is the first architectural style developed:
POST
POST&
Continuous Delivery
DevOps∆
![Page 44: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/44.jpg)
© Copyright 2014 Pivotal. All rights reserved. 44
Architecture is abstract until it is operationalized.
Neal Ford
Architectures that aren’t operationalized exist only on whiteboards. Matt Stine
![Page 45: Orienting yourself to continuous delivery & microservices](https://reader030.fdocuments.net/reader030/viewer/2022032420/55a525111a28abd90e8b4610/html5/thumbnails/45.jpg)
© Copyright 2014 Pivotal. All rights reserved. 45
An operationalized architecture
Microservices
Cloud Foundry
Trellis