Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... ·...

31
Tech Talk - IBM SmartCloud Continuous Delivery Kimi Cousins Tivoli Product Management Cloud & DevOps

Transcript of Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... ·...

Page 1: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Tech Talk - IBM SmartCloud Continuous Delivery Kimi Cousins Tivoli Product Management Cloud & DevOps

Page 2: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Requirements

Delivery Challenges

Development Team

Operations Team

Line of Business

2nd

gap

1st

gap

Customers

Desire

for fast and

continuous

innovation

Complexity Scale Time

Pressures Technical Challenges

Technical Trends Social Cloud Mobile

Today’s business and technical needs are pushing traditional delivery approaches to

the breaking point

2

Code & Tests Business Services

Page 3: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Software Delivery Customer Challenges

Applications have too many performance

problems

Too much manual effort to integrate builds of heterogeneous environments (e.g DB2, Java, WebSphere)

Excessive time spent to manually set up diverse testing production environments

Long time to complete builds

Inability to deploy and install software due to configuration issues

3

Page 4: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

With only Agile Development improvements…

Agile

Dev

CI builds are piling up

Functional

Testing

Acceptance

Testing

Production Operator

Setup

(weeks)

…Test and Ops can appear to be the bottlenecks

4

Page 5: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Requirements

Addressing the Gaps

Development Team

Operations Team

Line of Business

1st

gap

Customers

Desire

for fast and

continuous

innovation Code & Tests Business Services

DevOps Agile

Dev

2nd

gap

5

Addressed by: Addressed by:

Page 6: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Lifecycle Integration for DevOps

Automation

Integration

Visibility Operational

Models, Assets,

Data and Stores

Development

Models, Assets, Data

and Stores

Dev

Tools

Ops

Tools

People

Technology

Culture

Collaboration

Communication

Process

Management

Accountability

Integration

6

Page 7: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

How do we make this happen?

Automate Everything

Version Everything

Test Everything

Track and Plan Everything

Audit and Monitor Everything

Dashboard Everything

Application Artifacts

Application

Code

Instrumentation

and

Configuration

Runtime

Environment

Definition

Dev Test

Ops

Version

Automate

Test

Track and

Plan

Audit and

Monitor

Dashboard

7

Page 8: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Automate Everything

Application

Install & Config

Infrastructure Developer

Developer

Tester

Rogue Troubleshooting “Hero”

Ma

nu

al

Ch

an

ge

s Repeatability

Reliability

Consistency

Automation

8

Page 9: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Installation Instructions

RedHat Linux

Apache Web Server

Python

1. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod

tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,

quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo

consequat.

2. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu

fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in

culpa qui officia deserunt mollit anim id est laborum.

1. Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium

doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo

inventore veritatis et quasi architecto beatae vitae dicta sunt explicabo.

2. Nemo enim ipsam voluptatem quia voluptas sit aspernatur aut odit aut

fugit, sed quia consequuntur magni dolores eos qui ratione voluptatem sequi

nesciunt. Neque porro quisquam est, qui dolorem ipsum quia dolor sit amet,

consectetur,

3. adipisci velit, sed quia non numquam eius modi tempora incidunt ut labore

et dolore magnam aliquam quaerat voluptatem.

1. Ut enim ad minima veniam, quis nostrum exercitationem ullam corporis

suscipit laboriosam, nisi ut aliquid ex ea commodi consequatur?

2. Quis autem vel eum iure reprehenderit qui in ea voluptate velit esse quam

nihil molestiae consequatur,

3. vel illum qui dolorem eum fugiat quo voluptas nulla pariatur?

Manual Configuration

9

Page 10: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

10

Patterns

Link to System Pattern & Deployment Automation demo

Page 11: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

11

Virtual System Patterns in

SmartCloud Provisioning

Page 12: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

12

Continuous Delivery script

Virtual System Patterns

Page 13: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Problem: Disparate change management

But…

If everything is code, then everything is editable.

If everything is editable, then everything is versionable.

If you want sanity, version everything together

Infrastructure Developer Developer

13

Page 14: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Version Everything: Unified Change Management of “Source”

Source Control

Deliver Application

Code

Infrastructure Developer

Developer

Tester

Fetch Automation

14

Page 15: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Version Everything: Library of Deployable Artifacts

Deliver

Application Code

Infrastructure Developer

Developer

Tester

Automate

Library

Deployable

Artifacts

Source

Artifacts

Fetch

Source Control

15

Build

Page 16: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Continuous Delivery Assets

Link to Change Mgmt demo

16

Page 17: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

17

RTC Continuous Delivery Project

Page 18: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

18

Developers linked specific

Virtual System Patterns to

this build definition

Developers define the

Infrastructure as code the

is required to deploy an

application

Continuous Delivery Project Source View

Page 19: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

19

Application assets are stored

and any dependencies for

continuous delivery are

linked

Continuous Delivery Project Deployment View

Page 20: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

But…

If everything is automatic, then everything can have bugs.

If everything can have bugs, then everything needs to be tested.

So…

20

Page 21: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Test Everything

Application

Install & Config

Infrastructure Developer/ Ops

Developer

Tester

Did deployment succeed?

Are transactions succeeding?

Is performance OK?

Any new errors in the logs?

Did the application compile?

Is the Build OK?

Did the Unit Tests Pass?

Can I get the build installed?

Did my functional tests pass?

21

Page 22: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Build

Test Everything: Continuous, automatic testing across the lifecycle

Source Control

Deliver

Application Code

Infrastructure Developer

Developer

Tester

Library

Fetch

Did the app compile?

Did unit tests pass?

Did the app get packaged OK?

Automate

Did deployment succeed?

Did BVT/Smoke test succeed?

Did system tests succeed?

Are performance tests succeeding?

Are there any new errors in the logs?

Are transactions succeeding?

22

Page 23: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Test Automation

Link to Validate and Test demo

23

Page 24: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

24

JUnit tests and

Cucumber tests

Continuous Delivery Project Test Artifacts

Page 25: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

25

Tests are run at every build

and shown with build results

Continuous Delivery Project Test Results

Page 26: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Bob

(Operator)

Track and Plan Everything

Marco (Developer)

Deb

(Tester)

26

Page 27: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Instrument and Audit Everything

Monitoring agents instrument the application; audit logs capture instrumentation of the deployment actions; work

items instrument people’s activities

This helps us track who did what to whom, and gathers the data that we need so that we can report on everything.

27

Page 28: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Foundation Services

Automation

Engine

Library

Services

Delivery

Pipeline

Services

Delivery

Dashboard

Reporting &

Analytics

Instrumentation

& Auditing

Inte

gra

tion

Fa

bric u

sin

g O

SL

C

Op

en

Se

rvic

es L

ife

cycle

fo

r C

olla

bo

ratio

n

Logging Rules Licensing Security Storage

Continuous Delivery Services

Built on open standards allowing plug-in components from IBM

products, open source, and third party

Continuous Delivery Reference Architecture

28

Page 29: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Quality

Managers

IT Managers Developers

Rational Team Concert Provisioning1

Continuous Delivery

Business Value

Delivers higher value services on Cloud with an increase in quality

Simplifies the delivery process

Reduces cycle times and improves delivery throughput

Realizes the true value of end-to-end Agile best practices

1Supported as well: • PureApplicationSystem • IBM WorkLoad Deployer

BETA

IBM SmartCloud Continuous Delivery Extending Agile disciplines through delivery

29

Page 30: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

Where to get more DevOps information?

Enterprise DevOps blog

– http://ibm.co/JrPVGR

6 Ways for Enterprises to Adopt DevOps blog

– http://ibm.co/xq71xY

Pulse 2012 DevOps Interview

– http://ibm.co/OBqS2z

Innovate 2012 DevOps Interview

– http://ibmurl.hursley.ibm.com/2YM0

Cloud/ Virtualization Blog

– http://ibmurl.hursley.ibm.com/2YM1

30

Page 31: Tech Talk - IBM SmartCloud Continuous Deliverypublic.dhe.ibm.com/software/dw/cloud/techtalks/... · Delivery Pipeline Services Delivery Dashboard Reporting & Analytics Instrumentation

31