Moving the Needle by Measuring What Matters · 4x better Quality 2x faster Time to market But...

Copyright© Agile Transformation Inc.

Moving the Needle by Measuring What Matters

www.AgilityHealthRadar.com


Roles

About Me – Sally Elatta

Developer > Architect > Trainer & Coach > EntrepreneurBusiness Agility Transformation Strategist

Public Speaker | World Traveler [email protected]


mailto:[email protected]


Larry MaccheroneLinkedIn.com/in/LarryMaccherone


Roles

Transformation Challenges

The goal of measurement should be to enable growth, not for judgment, reward or punishment.

• What problem or area are we transforming? What’s the maturity roadmap? Do we have a common definition?

Clarity & Alignment

• How do you measure alignment? How do you know you’re improving? What metrics really matter?

Measurement

• Measurement with no action is worthless data. How do you become intentional about growth and improvement? Where is help needed?

Intentional Growth


Presenter

Presentation Notes

Sally to lead Larry to share two stories about rewarding and punishing


Roles

Alignment | Measurement | Intentional Growth

Clarity & Alignment

Measurement

Intentional Growth



Roles

Business Agility


Presenter

Presentation Notes

Larry to lead


Enterprise Business Agility https://agilityhealthradar.com/EBA

Presenter

Presentation Notes

Sally to lead the EBA Model

https://agilityhealthradar.com/EBA


Roles

Workshop : What Metrics Matter?



Roles

The THREE Metrics that Matter

Key Metrics

Team Health & Maturity

(qualitative)

Delivery /Performance (quantitative)

Business Outcomes

(results)

AgilityHealth is a single source of record for your enterprise teams and their maturity, performance and outcomes



Roles

Visualizing Your AgilityHealth By LOB, Portfolio or Program

Maturity

PerformanceCRAWL

1-2

WALK3-5

RUN6-8

FLY9-10

PRE-CRAWL

0-2

CRAWL3-4

WALK5-6

RUN7-8

FLY9-10

C

F

N M55%

N60%

R

T70%

Maturity: 9 (Fly)Perf: 8 (Run)

Outcomes: 70%

O

Maturity: 7 (Run)Perf: 9 (Fly)

Outcomes: 60%

Outcome %



Roles

Visualizing Your AgilityHealth Growth By Quarter

Maturity

PerformanceCRAWL

1-2

WALK3-5

RUN6-8

FLY9-10

PRE-CRAWL

0-2

CRAWL3-4

WALK5-6

RUN7-8

FLY9-10

T10%

T70%


Outcomes: 70%

Outcome %

T40%

Q1

Q2

Q3



Delivery and Performance Quantitative Metrics

LinkedIn.com/in/LarryMaccherone

10,000Teams

Scientifically Derived

With Carnegie

Melon


SDPI Balanced ScorecardProductivityThroughput

PredictabilityStability of Throughput

Time to ValueTime in Process (TiP)

QualityDefect Density/Aging


SDPI Uses

Research

Benchmarking

Trending for a Team/Org


SDPI Research Findings

Teams with low WiP have up to:● 4x better Quality● 2x faster Time to market● But potentially 34% worse productivity

Stable teams result in up to:● 60% better Productivity● 40% better Predictability

Dedicated teams: Teams made up of people who only work on that one team have double the Productivity

Team size:● Smaller teams have better Productivity● Larger teams have better Quality

Iteration length● Teams using two-week iterations have the

best balanced performance● Longer iterations correlate with higher

Quality● Shorter iterations correlate with higher

Productivity and Responsiveness

Ratio of testers to developers:● More testers lead to better Quality● More testers lead to worse Productivity and

Responsiveness● Teams who collectively own ‘quality’

have:● The best Productivity● Almost as good Quality ● But much wider variation in Quality

And more on Kanban vs Scrum, co-location, Big bang agile, Gender diversity, etc.


Other SDPI Dimensions

Customer/Stakeholder SatisfactionNPS Survey

Employee Engagement/Satisfaction

Employee Survey

Build-The-Right-ThingEngagement, Churn, ARR

Code QualityStatic Analysis &

Test Coverage


Percentiles

What is it?Ranking in a population

Where is it useful?Compare one to many


Team Performance MetricsReview “just enough” Quantitative Metrics

Escaped Defects

25www.AgilityHealthRadar.com

Feature Cycle Time

6 weeks


Release Health MetricsFeatures Delivered

85%Value

Delivered

237%Escaped Defects

12Target Date6/09/2015

Actual Date6/19/2015



Team Health & Maturity Qualitative Metrics

Copyright© Agile Transformation Inc. Copyright© Agile Transformation Inc

Team

Hea

lthCRAWLWALKRUNFLY


Copyright© Agile Transformation Inc. Copyright(c) Agile Transformation In. | www.AgileTransformation.com | Building Healthy High Performing Teams!


http://www.agiletransformation.com/


Business Outcomes


Outcome Definition | Team LevelObjective

Title:Hypothesis Statement/Description:

Key Results / Metrics:Title Progress Metric Now Goal By

DateGroups/Team(s)

# of Weeks(est)

Increase checkout conversion

Checkout completion

50% 70% May 302018

Mktg

Reduce time to find relevant product.

Time between Search to Add to Cart

2min 30 sec

Dec 312017

BACA Team 4 Sprints (8 Weeks)

Increase customer conversion

We believe that by improving the usability of Product search and browse pages on our site, we will increase conversions from shopping cart to checkout.

Overall Progress:

60%

20%55%

40%

Estimated Capacity Cost:

Calculated based on # of weeks per team, X avrg. cost per team 20k/week

$160,000

Customer/org Impact metric

Estimated ROI:

$500,000



Continuous Improvement & Intentional Growth


Visualizing Your AgilityHealth By LOB, Portfolio or Program

Maturity

PerformanceC

F

N

M55%

N60%

R

T70%


Outcomes: 70%View Details

O

Dim Maturity Growth Items

Growth Progress

Leadership 60% | Run |10% 15/30

Foundation 35% | Walk | 5% 5/15

50%

30%

CRAWL1-2

WALK3-5

RUN6-8

FLY9-10

PRE-CRAWL

0-2

CRAWL3-4

WALK5-6

RUN7-8

FLY9-10

Maturity: 7 (Run)Perf: 9 (Fly)

Outcomes: 60%



Agility Health AgilityHealth Growth Framework



AgilityHealth Explainer Video

Watch the 3min Explainer: www.AgilityHealthRadar.comwww.AgilityHealthRadar.com

Presenter

Presentation Notes

Play 3 min video on: www.agilityhealthradar.com

http://www.agilityhealthradar.com


AgilityHealth is a powerfulmeasurement & continuous growth

platform designed for companies that want to accelerate the growth and business agility of their organization.

AgilityHealth Overview



Where We can Help

Existing customers: Consultation call around measurement.

New customers: Overview of AgilityHealth and EBA

Building Measurable Business Outcomes workshop

Measuring What Matters seminar for executives.



Roles

YOUR Questions?

Bit.ly/agilityhealthseminar

Provide feedback + download slides:

Enter Promo Code: LarrySallyFor 15% discount on AgilityHealth Certification

Want to get in touch?Email: [email protected]: [email protected]




Moving the Needle by Measuring What Matters · 4x better Quality 2x faster Time to market But...

Documents

Transcript of Moving the Needle by Measuring What Matters · 4x better Quality 2x faster Time to market But...