From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is...
Transcript of From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is...
![Page 1: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/1.jpg)
San Francisco 2009
From Agile Development to Agile Operations
November, 2009
© 2009 Elastra Corporation, licensed under a Creative Commons Attribution-No Derivative Works 3.0 Unported License
Stuart Charlton, CTO, Elastra
![Page 2: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/2.jpg)
Objectives
• Reflecting on how cloud computing is changing the game between development & operations
•
San Francisco 2009 2
• Suggested design goals for cloud computing technology, to help bridge these worlds
• Characterizing an integrated approach to application design, development, and operations
2
![Page 3: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/3.jpg)
About Your Presenter
Stuart Charlton• Canadian,
now in San FranciscoCTO, ElastraIn prior lives... • BEA Systems,
San Francisco 2009 3
• BEA Systems, Rogers Communications,Infusion Development,global training & consulting
RESTafarian and Data geekStu Says Stuffhttp://stucharlton.com/blog
![Page 4: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/4.jpg)
The Dev / Ops Game
San Francisco 2009 4
![Page 5: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/5.jpg)
The Realities
• Organizationally & Geographically DistributedDesign and Operations (The Cloud)
• Performance, Scale, and Availability are due to a
San Francisco 2009 5
• Performance, Scale, and Availability are due to a complex combination of design and operational decisions
• Application and infrastructure management is complex and inter-disciplinary
5
![Page 6: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/6.jpg)
The World of Design & OperationsHP IBM MSFT ORCL BMC VMW
Architecture, Development
Rational Visual Studio
Jdeveloper Spring
Application LifecycleManagement
Mercury Rational Visual Studio Team System
IT Automation OO TPM Systems Oracle EM Atrium Vcenter
San Francisco 2009 66
IT Automation OO TPM Systems Center CM
Oracle EM Atrium VcenterOrch.,vApps
Operations and System Management
SA, NA, CMDB
Tivoli Systems Center
Oracle EM PatrolRemedyBlade Logic
vCenter
Virtualization, Operating Systems
HPUXNonStop
z/OS,LPARAIX
Windows,Azure,Hyper-V
Oracle VM, Linux, Solaris
vSphere
Hardware, Network, Storage
ProliantIntegrityProCurve
System x, 1, p, z
Sun
![Page 7: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/7.jpg)
HP IBM MSFT ORCL BMC VMW
Architecture, Development
Application LifecycleManagement
IT Automation
A Major Cultural Split
Delivery OrientationBig Culture and
Tool Gaps!
San Francisco 2009 7
IT Automation
Operations and System Management
Virtualization, Operating Systems
Hardware, Network, Storage
7
Operations Orientation
![Page 8: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/8.jpg)
Applying Agile Practices to Operations?
Some can remain auseful guide…
• Value expressed through functionality
• Automated Build, Test,
…But development practices don’t always translate well
• Greater value is placed on continuity and risk
• What’s the test environment?
San Francisco 2009
• Automated Build, Test, Integration
• Autonomous teams• Continuous integration of
source
• What’s the test environment?» More like ”rehearsal”
• Legacy dependencies» Need for situational awareness
• Where’s the source?
![Page 9: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/9.jpg)
Example:Why can’t these two servers communicate?Possible areas of problems
• Security» Bad credentials
• Server Configuration
San Francisco 2009
» Wrong IP or Port» Bad setup to listen or call
• Network Configuration» Wrong duplex» Bad DNS or DHCP
• Firewall Configuration» Ports or protocols not open
![Page 10: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/10.jpg)
Example:What do I need to do to make this change?Desired Change
• Scale-out this cluster
But…
• Impacts on other systems» Security Systems» Load Balancers
Monitoring
San Francisco 2009
» Monitoring» CMDB / Service Desk
• Architecture issues» Stateful or stateless nodes» Repartitioning?» Limits/constraints on
scale out?
10
![Page 11: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/11.jpg)
Example:What is the authoritative reality?
Desired State
• Configuration Template• Model• Script
Current State
• On the server» Might not be in a file» Might get changed at runtime
• And when you do change…
San Francisco 2009
• Script• Workflow• CMDB• Code
• And when you do change…» It may not actually change» It might change to an
undesirable setting» It might affect other settings
that you didn’t think about
11
![Page 12: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/12.jpg)
Cloud Computing to the Rescue?What Exists, What is Missing
• What we have now:» On Demand Provisioning of Commodity Infrastructure
� OS-level down registration, launch, attachment
» On Demand Provisioning of Constrained Applications
San Francisco 2009 12
» On Demand Provisioning of Constrained Applications� Works for some cases, not integrated cases (yet)
• What we still need to consider:» Configuration as data and as code» Collaboration on design and operations» Accounting for the full value stream of the system
![Page 13: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/13.jpg)
Suggested Design Goals for Cloud Computing
• Separate Applications from Infrastructure» How far can Black-Box PaaS really go?
• Enabling Computer-Assisted Design and Operations
San Francisco 2009 13
» IT complexity is getting overwhelming» Can machine reasoning and planning help?
• Explicit Collaboration» Both design and operations suggest are
highly collaborative work» But in operations, not traditionally supported by most tooling
13
![Page 14: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/14.jpg)
An Approach to Integrated Design and Ops
San Francisco 2009 1414
![Page 15: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/15.jpg)
Configuration Code, Config, and Models,or What is the Source?Bottom Up
• Scripts & Recipes» Hand-grown automation
• Runbooks
Top Down
• Modeled Viewpoints» E.g. Microsoft Oslo, UML,
Enterprise Architecture
• Modular Containers
San Francisco 2009
» Workflow, policy
• Frameworks» Chef» Puppet, Cfengine
• Build Dependency Systems» Maven
• Modular Containers» E.g. OSGi, Spring, Azure roles
• Configuration Models» SML, CIM» ECML , EDML
![Page 16: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/16.jpg)
Modeled Collaboration & Change Management
San Francisco 2009 16
![Page 17: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/17.jpg)
On the other hand…
• “All Modeling is Programming and All Programming is Debugging” - Neil Gunther
• Need visibility into what the model implies
San Francisco 2009 17
• Need visibility into what the model implies» Solutions don’t seem completely satisfactory…
� Code generation?� Plan generation?� Runtime adjustment?
17
![Page 18: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/18.jpg)
Accounting Barriers to Agile/Lean Operations
• Cost Attribution» Capex vs. Opex
� Lots of heat, little light
» Fixed vs. Variable Cost
San Francisco 2009 18
» Fixed vs. Variable Cost� Maybe? Still HW focused
• As opposed to» Looking at the end-to-end
system as a value stream» Costing based on time calculations for repeatable
activities: Time-Driven Activity Based Costing
![Page 19: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/19.jpg)
San Francisco 2009
AN APPROACHCloudy, with a chance of …
![Page 20: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/20.jpg)
Characterizing an Integrated Approach to Cloud Application Design, Dev & Operations
• Distributed, Autonomous Control» Ownership & stewardship of artifacts and systems are
normally decentralized
• Open Document-Exchange Describing a System
San Francisco 2009 20
• Open Document-Exchange Describing a System» The trouble with APIs» Today’s attempts: model marts, CMDBs, scripts, POMs» Contrast to the success of the Web
• Hyperlinked Web Architecture» No monolithic documents
20
![Page 21: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/21.jpg)
Characterizing an Integrated Approach to Integrated Cloud App Design & Operations
• Model-Driven» Make documents conform to a logical framework and
visual notation
• Goal and Policy Driven
San Francisco 2009 21
• Goal and Policy Driven» “What, not How”: Declarative specifications» Allow for automated planning of operational steps
• Viewpoint-Based» Extensible modeling languages & constraints
21
![Page 22: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/22.jpg)
Characterizing an Integrated Approach to Integrated Cloud App Design & Operations
• Collaborative» Leveraging social computing» Faster decision making to enact changes to a system
• Governable
San Francisco 2009 22
• Governable» Access control & entitlement enforcement
22
![Page 23: From Agile Development to Agile Operations...Objectives • Reflecting on how cloud computing is changing the game between development & operations • San Francisco 2009 2 Suggested](https://reader034.fdocuments.net/reader034/viewer/2022050411/5f880040d308191d97045be4/html5/thumbnails/23.jpg)
Elastic Modeling Languages – A Beginning
San Francisco 2009 2323