The Devops Scorecard A unique, holistic, scientific tool to drive IT

performance improvement in your company

Gene Kim Dr Nicole Forsgren Jez Humble

Problem

How can IT organizations get objective information on how they are performing relative to the industry, make effective investment decisions when developing the capacity of their teams, and find out if those investments paid off?

Purpose

• Help organizations benchmark their current IT performance against the industry

• Quantify the state of existing capabilities within teams

• Show which capabilities will provide the greatest impact if developed

• Help teams understand how to develop these capabilities

Methodology

• We have several years of industry data on IT performance and practices, spanning 14,000+ respondents, ~2,000 organizations, and many industries worldwide

• We benchmark your overall performance and the effectiveness of your capabilities against the industry

• We use statistical analysis to determine which capabilities will have the biggest impact on IT performance if developed.

Not another survey

• “Maturity models” are based on anecdote*. Our peer-reviewed research shows which practices actually matter.

• Using statistical analysis, we can show you which capabilities you should invest in to get the biggest return on investment

• We provide expert knowledge from industry leaders on how to develop these capabilities

* We should know, we have created several of them!

How it works

• First, identify product / service value streams within the organization. The people involved in this value stream form a “team”.

• Email everyone on these teams to take our survey

• Once we have at least 25 responses across all functions, we can benchmark teams against the organization as a whole, and the organization against the industry

What you get

• A report for each team, benchmarking their performance against the organization

• A report for the organization, benchmarking it against the industry

• Customized content created by Gene Kim, Jez Humble and other industry leaders on how to develop your capabilities

• Report detail is shown on following slides

Capabilities

Capability name

Current performance

Median performance within the industry*

Which industry performance category you fall into (high, medium, low)*

* Unique to our tool

Four categories of capability: Technical practices Culture Feedback loops Management practices

Example survey questions

Determining capability in test automation

Performance Metrics

• Your performance in these critical outcomes • Benchmarked against your cohort in industry

Performance/Impact matrix

This matrix is unique to our tool. It tells you, based on statistical analysis, how you are doing in the various capabilities (performance, y-axis), and which capabilities will have the biggest impact on IT performance (x-axis). Thus you can determine where you should invest your capability development budget to get the biggest return — the capabilities with the highest impact and lowest performance, in the lower right quadrant.

Customized contentWe provide custom content on developing the identified capabilities, curated by industry leaders Gene Kim and Jez Humble