Metrics Program Implementation: Pitfalls and Successes

4/27/2015

jksdksd jh jhfkjhfsd 1

METRICS PROGRAM

IMPLEMENTATION:

PITFALLS AND SUCCESSES

By Kris Kosyk

HOW MUCH DO WE RELY ON DATA TODAY IN

PERSONAL LIFE AND BUSINESS?

� Productivity/Efficiency?

� Quality?

� Predictability?

4/27/2015


• Measure (Data Point) – Quantitative indication of

the extent, amount, dimension, capacity or size of

some attribute of a product or process

• Measurement – The act of determining a measure

• Metric – A quantitative measure of a degree to

which system, component, or process possesses a

given attribute

• Indicator (KPI) – A metric or combination of metrics

that provide insight into the software process,

project or product.

DEFINITIONS

WHY DO MEASURE?

OPERATIONAL

METRICS

SDLC

METRICS

PROJECT GOALS

PROJECT

IMPLEMENTATION

4/27/2015


WHY NOTMEASURE?

ANALYZE

RESEARCH OCEAN

OFMETRICS

SELECT

METRICS

BASELINE

NORMALIZE

START

COLLECTING

METRICS

WHY NOTMEASURE?

Data Points?

Who?

How many? Technology?

Format?

Process?Training?

Usage?

ANALYZE

RESEARCH OCEAN

OFMETRICS

SELECT

METRICS

BASELINE

NORMALIZE

START

COLLECTING

METRICS

4/27/2015


ANALYZE

RESEARCH OCEAN

OFMETRICS

SELECT

METRICS

BASELINE

NORMALIZE

START

COLLECTING

METRICS

WHY NOTMEASURE?

Data Points?

Who?

How many? Technology?

Format?

Process?Training?

Usage?

Adoption?

Support and Maintain?

4/27/2015


SOFTSERVE METRICS PROGRAM CASE STUDY

200+ PROJECTS

I AM VERY

UNIQUE!

60+ CLIENTS

3000+

ENGINEERS

IN 3

COUNTRIESGLOBALOUTSOURCING COMPANY

WORKING ON PROJECTS FROM

START-UPS TO ENTERPRISE

LESSONS LEARNT FROM

IMPLEMENTING COMPANY-WIDE

METRICS PROGRAM IN 9 MONTHS

WITH NO INVESTMENT BUDGET

4/27/2015


MAIN LESSON LEARNT:

DO NOT OVERCOMPLICATE!

LESSON #1: DON’T BE DISCOURAGED BY

PREVIOUS MISTAKES

“It still works in theory!”

4/27/2015


I AM VERY

UNIQUE!

What is our PERFORMANCE?

Do we deliver high QUALITY service?

Can we PREDICT our releases?

Can we COMPARE our projects/teams?

LESSON #2: START WITH YOUR GOALS AND

METRICS WILL FOLLOW


METRICS WILL FOLLOW

4/27/2015



METRICS WILL FOLLOW

Structure your metrics in logical

way that works for you


METRICS WILL FOLLOW

Have this information available to

everyone at any time

Provide layers of information

4/27/2015



METRICS WILL FOLLOW

Revisit list if necessary

LESSON #3: WHEN EXPLAININGMETRICS START

WITH DATA POINTS

4/27/2015


LESSON #4 DEFINE TECHNOLOGY TO COLLECT

AND ANALYZE METRICS EARLY. TRY TO WORK WITH

WHAT YOU HAVE

DATA POINTS METRICSCALCULATION REPORT/DASHBOARD<flexible> <automated> <clear and beautiful>

LESSON #5: USE METRICS FOR UNDERSTANDING,

NEVER FOR PUNISHMENT

4/27/2015






4/27/2015


LESSON #6: FOCUS A LOT ON ADOPTION

LESSON #6: FOCUS A LOT ON ADOPTION

� Ensure INFORMATION

availability on metrics

� Pay attention to USABILITY AND

ACCESSIBILITY of your technology that is used by users

� Have TRAININGS for all stakeholders (project team, management, executive management) on how to use metrics for their decision making. Prepare for many trainings and mentorship in the beginning

4/27/2015


LESSON #7: INTRODUCE GOVERNANCE AROUND

THE METRICS PROGRAM

Plan for dedicated person/team to support the program

� Continue trainings, mentorship and advisory

� Maintain metrics list

� Ensure data is valid

� Maintain report/dashboard

� Look for improvements

And Don’t Forget That…

4/27/2015


TRANSFORMATION IS AN ERA, NOT ANEVENT!

ROLL-OUT IN AGILE FASHION, CONTINUOUSLY IMPROVE!

4/27/2015


Thank you!

Kris Kosyk

[email protected]

Metrics Program Implementation: Pitfalls and Successes

Software

Transcript of Metrics Program Implementation: Pitfalls and Successes