Pulse 2013: DevOps Review and Roadmap

© 2012 IBM Corporation

CDO-1884: DevOps Review and Roadmap Daniel Berg, Chief Architect for DevOps Ruth Willenborg, DE, Cloud and DevOps Andrew Hans, Senior Dev Manager DevOps

1

Please note

IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

2

experience delays in integration, configuration

and testing of applications*

41% experience delays

due to troubleshooting and fine-tuning issues

in production*

45% applications rolled back due to quality issues escaping into production*

51%

Up to to deliver a simple code change**

4-6 Weeks

Businesses are challenged to meet time pressures with quality software ….34% of all new IT Projects deploy late*

* Forrester/IBM Study: A New View of IBM’s Opportunity for Integrated Op>mized Systems Address , 2011 ** Forrester “Five Ways To Streamline Release Management”, 2011

GAP GAP

Business Owners Customers IT Operations Development

& Test Line of

Business

3

Patterns of challenges

Differences in dev and ops environments cause failures

Backlog of agile releases that Ops cannot handle

Manual (tribal) processes for release lack repeatability/

speed

Lack of feedback and quality metric leads to missed service level

targets

Daily Build

Monthly Delivery

Who did this last time?

Dave…

Dave’s not here man…

Dev

Prod

4

Software delivery is at the heart of today’s top technology trends

Mobile Apps Modern workforce expects

constantly updated software to connect to

enterprise systems

Cloud High application demand requires

fast, scalable environments for development / testing

Intelligent/ Connected Systems

The software component in smart products drives value and competitive differentiation

Collaboration Development and Operations teams

work in continuous application delivery cycles

Big Data New applications provide insights by interpreting

massive quantities of data

Software Delivery!

5

Our view of DevOps

A core enterprise capability for…

§  Continuous delivery of software to

§  Seize market opportunities and

§  Make rapid improvements based on customer

feedback while

§  Balancing speed, quality, and costs

People

Process

Tools

6

Cultural challenges adopting DevOps

Developer Operator

Why does it take so long to get a test environment?

I like using new open source libraries.

I’ve checked in my code now it just needs to be deployed (easy).

Application deployment failed again because of new libraries.

Our processes ensure environment stability.

Development is always making bad operational decisions.

CDO-‐1511: How IBM Leverages SmartCloud Con>nuous Delivery to Streamline DevOps CDO-‐1741: ShadowOps versus DevOps

7

DevOps Principles and Values

§  Develop and test against a production-like system

§  Iterative and frequent deployments using repeatable and reliable processes

§  Continuously monitor and validate operational quality characteristics

§  Amplify feedback loops

People

Process

Tools

8

Ra#onal Team Concert

Agile Development

Deployment of Virtual Systems

Provisioning

Standardize Automate Delivery Feedback Manage Changes Plan & Track

IBM Workload Deployer

IBM PureApplication Systems

9

Standardize Communicate and share environment patterns

Issues §  Dev environments different

from production environments §  Difficult to provision test

environments §  Environment provisioning

creates new “snowflakes”

Solution §  Define standard Virtual System

Patterns for environments §  Share patterns between Dev

and Ops to improve communications

§  Repeatable and reliable process to provision base environments (rubber stamps)

Func>onal Verifica>on

Test Environment

User Acceptance Test Environment

10

Plan and Track Common tools to plan and track changes across Dev and Ops

Issues §  Configuration tasks are not

planned or tracked §  Different tools/processes for

tracking work

Solution §  Use collaborative development

tools to track and plan application and configuration changes

§  Ensures work is properly planned in the proper order

§  Ensures audit trail for planned changes to environments

10

11

Manage Changes Version and manage application and configuration changes

Issues §  Configuration changes vary

between environments §  Configuration changes are not

well managed §  Release artifacts are randomly

created and applied

Solution §  Version control configuration

changes as code in an SCM close to the application changes

§  Version and track release artifacts in an Artifact Library

§  Track release dependencies

12

Automate Delivery Repeatable and reliable processes

Issues §  Application deployment is

generally an unreliable, manual process

§  Difficult to replicate §  Slow to execute §  Long delays between

deployments increases size of change sets making problem determination difficult

Solution §  Tooling to define and configure

an automated delivery process §  Reliable and repeatable

delivery process §  Deploy early and often to “fail

fast” and resolve even faster

13

Feedback Immediate feedback of changes

Issues §  Weeks, months pass before

getting any feedback of a change (if any)

§  Often cannot determine where/if a build was deployed

§  Long delays in feedback makes problem determination more difficult

Solution §  Report results of automated

delivery process directly in context of development tools

§  Preserve traceability of delivery output with build process

§  Report automated tests results in a timely fashion

14

Enterprise capability for continuous delivery of software innovation

Open Lifecycle Integration Platform

Continuous Delivery

Continuous Monitoring

Collaborative Development

Continuous Testing

Continuous Release

Business Planning

DevOps Lifecycle

Continuous Feedback and Improvements

Operations/Production Development/Test Customers Business Owners

15

Applica>on Release

Automa>on

Environment Provisioning

Quality Management

Test Automa>on

Open Lifecycles Integration Platform

Continuous Delivery


Change Management

Source Control Management

Build Automa>on

Delivery Pipeline

Applica>on Performance Monitoring

Continuous Release Continuous Testing Collaborative Development

DevOps capabilities for continuous testing

Service Virtualiza>on

16

Applica>on Release

Automa>on

Environment Provisioning

Quality Management

Test Automa>on

Open Lifecycles Integration Platform

Continuous Delivery


Change Management

Source Control Management

Build Automa>on

Delivery Pipeline

Applica>on Performance Monitoring

Continuous Release Continuous Testing Collaborative Development

DevOps tool chain for continuous testing

Service Virtualiza>on

IBM Ra>onal Team Concert

IBM Ra>onal Build Forge Jenkins

IBM Ra>onal Quality Manager

IBM Ra>onal Test Workbench

IBM SmartCloud Provisioning

IBM

Workload Deployer

IBM Pure Systems

IBM Ra>onal Automa>on Framework

Chef

IBM SmartCloud Applica>on Performance Management

IBM SmartCloud Con>nuous Delivery

17

IBM SmartCloud Continuous Delivery flow

Artifact Library

Cloud Platform Provider

Automation Agent (execute delivery process)

17

Deliver changes

Post changes

Post results

Publish packages

Request cloud resources

Provision resources

Retrieve packages

Developer Tools

Source Control and Change Management server

Test Automation

Execute tests

Build Server

Publish packages

Virtual System

Trigger delivery

18

Discover where we are going next

19

Business Planning Development Planning

Application Release Management

SmartCloud Continuous Delivery

Focal Point Team Concert

Quality Manager Requirements Composer

New Feature!

End-to-end release planning Real-time feedback for the delivery of business value

Project Business Need

Requirement

Dev Release Plan Story

Build

Test Plan Test Case

Application Release Environment

SmartCloud Orchestrator

Virtual System

New integration

New

20

Continuous testing with virtualized services Avoid testing bottlenecks due to dependencies on external services

•  Automate setup and management of test virtualization server in the cloud

•  Automates configuration of virtualized services for an application under test

•  Automate setup of production-like test environments with low cost

Databases Mainframe applications

Third-party Services

Rational Test Virtualization Server

Continuous Delivery



Continuous Testing

Continuous Release

Business Planning


SmartCloud Continuous Delivery

Rational Test Workbench Application changes being tested

virtualized services

IBM SmartCloud Provisioning

IBM Workload Deployer

IBM PureApplication System

NEW! Continuous testing using

Green Hat virtualized services in the Cloud

21

Multi-stage Continuous Delivery Pipelines

Delivery Pipeline

Build Stage

SCM (Source code & configurations)

QA Stage

Artifact Library

Performance Stage

Pre-Production Stage

Promote to Production

Changes trigger pipeline execu>on

Each stage defines tasks to provision an environment with entrance and exit

criteria

Approval gates with automated/manual approvals provide

compliance checking Stages can be run in parallel

Pipeline dashboards provide feedback for the flow of changes through the

pipeline

Business Owners Customers

22

Rational Development and Test Environment for System z Continuous build and test of distributed systems

COBOL, PL/I, C++, Java, EGL, Batch, Assembler, Debug Tool

x86 PC running Linux

IMS

z/OS

WAS

DB2

MQ CICS

Note: This Program is licensed only for development and test of applications that run on IBM z/OS. The Program may not be used to run production workloads of any kind, nor more robust development workloads including without limitation production module builds, pre-production testing, stress testing, or performance testing.

22

DevOps Lifecycle



IBM Ra>onal Test Workbench

IBM Con>nuous Integra>on Solu>ons

for System Z


New integraDon

23

Open Lifecycle Integration Platform

Continuous Delivery



Continuous Testing

Continuous Release

Business Planning

DevOps Lifecycle



Continuous delivery for mobile

§  Device fragmentation §  Additional governance required §  Curated app-stores impose review processes §  Device testing is difficult

§  Builds are pulled from app-stores vs push §  Injection of app-store feedback into delivery

process §  Native plus back-end services required for

mobile applications

There are mobile-specific challenges in achieving continuous delivery

Device Anywhere Mobile simulator

AppCenter IBM Mobile Development

Lifecycle Solu>on


IBM Ra>onal Test Workbench for Mobile

March BETA

New integraDon

24

Open, dynamic orchestration of resources, workloads and services

Reduce >me-‐to-‐market to deliver new business services

Improve administrator produc>vity

•  Fully automates the deployment and lifecycle management of cloud services across resources, workloads and services"

•  Built on a foundation of open standards – TOSCA, OpenStack, OSLC"

•  Accelerated deployments with reusable workload patterns and Chef recipes"

•  Unified management of heterogeneous environments"

•  Supports deployment of hybrid & public clouds"

•  Works with SmartCloud Continuous Delivery to provide extended DevOps platform"

Continuous delivery pipeline

Orchestrator Open Beta

© 2013 IBM Corporation | IBM Confidential until 11am ET March 4th, 2013

New

25

Orchestration Engine

Network Domain"

Storage Domain"

IT Management"Monitoring

Domain"Data

Availability Domain"

Compute Domain

!Monitoring !

IT Asset Management!

Service Desk!

Storage Domain!

Change Management!

Provision Pattern

Network Domain!

Workload Orchestration

Workload aware placement, optimization and operation

Resource Orchestration!Onboard, provision, manage

CPU, Storage and Network

Service Orchestration Manage the lifecycle of business applications

DB App Web

Managing workloads across the lifecycle requires orchestration

26

Ra#onal Team Concert

Agile Development

IBM SmartCloud Orchestrator

Extended platforms

More clouds More patterns

EC2

TOSCA Virtual Applications

27

OpsCode Chef Chef Server Hosted Chef

Your Infrastructure

QA

SmartCloud Orchestrator Promotion Control

PROD

inst

Retrieve list of builds Change environment mappings

Change instance

environments

DEV

inst inst

Deliver and test new builds

Orchestrator

Integrated Approval

Processing

Drive Build Promotion

Pedestal 74: Marrying Apps & Infrastructure: Deliver Working Code More Quickly and with Greater Consistency than Ever Before

Continuous Delivery

28

How we plan to get there …

Con>nuous tes>ng with Service Virtualiza>on New Placorms: Openstack & SmartCloud Orchestrator

End-‐to-‐end release planning Mul>-‐stage pipelines Con>nuous delivery for Mobile and Mainframe

Simplified developer experience for building engaging systems

Phase 1 Phase 2 Future

29

Summary

§  Challenges to deliver software-driven innovation

§  Disruptive technologies driving greater need to innovate

§  DevOps is critical to your success

§  IBM has first class DevOps solutions and is continuing to invest and improve upon these solutions

30

We want to hear you!

Workshop: DevOps / Continuous Delivery •  60-minute, small group discussion (fewer than 10) •  Hosts:

•  Neeraj Chandra, VP - Strategy •  Randy Newell, Director - Capabilities Marketing

Tuesday, March 5, 5:15 – 6:15 pm pt Pulse Expo Hall - Marquee Ball Room, Room B5 Limited seats – please RSVP: [email protected] or 203-521-9157

30

The IBM Technical Summit

Register by March 15 and save $300!

Top Five Reasons to Attend Learn how you can make the most of Agile, DevOps, Cloud, Mobile, Big Data, Social Business and other key trends to release products faster, improve processes, increase quality, and meet business objectives.

Get detailed Rational technical training trough hundreds of breakouts, hands-on technical workshops, open labs and a wide variety of certification testing

Explore Innovation Labs, observe interoperability in action and meet face to face with experts in a high-energy Exhibit Hall.

Network with over 4000 attendees from around the world and collaborate with your peers from a wide variety of roles, industries and locations.

Enjoy top-notch keynotes and entertainment, including strategic presentations, dynamic guest speakers and customer success stories.

Innovate 2013: The IBM Technical Summit is the event for software practitioners and product developers. Attendees will learn to

improve the practices, predictability and economics of software delivery through detailed education and insights into key

technical trends!

ibm.com/innovate

32

Acknowledgements and Disclaimers:

© Copyright IBM Corporation 2013. All rights reserved.

§  U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

§  Please update paragraph below for the particular product or family brand trademarks you mention such as WebSphere, DB2, Maximo, Clearcase, Lotus, etc

IBM, the IBM logo, ibm.com, [IBM Brand, if trademarked], and [IBM Product, if trademarked] are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml If you have mentioned trademarks that are not from IBM, please update and add the following lines: [Insert any special 3rd party trademark names/attributions here] Other company, product, or service names may be trademarks or service marks of others.

Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.

The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are

provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.

All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.

Pulse 2013: DevOps Review and Roadmap

Technology

Transcript of Pulse 2013: DevOps Review and Roadmap