Agile Base Camp - Agile metrics
-
Upload
serge-kovaleff -
Category
Technology
-
view
2.096 -
download
3
description
Transcript of Agile Base Camp - Agile metrics
![Page 1: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/1.jpg)
Agile Metrics
SergeKovaleff @gmail.com
.blogspot.com
linkedin.com/in/
facebook.com/
![Page 2: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/2.jpg)
What is a Metric?
![Page 3: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/3.jpg)
Process Improvement Cycle
PDCA (plan-do-check-act) by Dr. W. Edwards Deming DMAIC (Define-Measure-Analyze-Improve-Control) in Six Sigma
Improve
Process
Define Process
Execute
Process
Control ProcessMeasure
Process
![Page 4: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/4.jpg)
A lot of Metrics different ...
• Business metrics – RTF (Running Tested Features) – Earned Business Value (EBV) – Net Present Value (NPV) – Internal Rate of Return (IRR) – Return of Investment (ROI)
• Code Metrics – Cyclomatic complexity – Best practices violation – Coding standards violation – Possible bugs – Code duplication – Code coverage – Dead code – Test Quality
• Design Metrics – Code dependencies
• Incoming (Affering Coupling) • Outgoing (Efferent Coupling)
– Abstractness • Number of abstract clases and interfaces • Number of concrete classes
• Process metrics – Agile practice maturity – Impediments cleared per iteration – Impediments carried over the next iteration – User stories carried over the next iteration – User stories done per iteration – Defects carried over the next iteration – Defects carried over the next iteration – Team member loading – Velocity of development – Backlog size
• Automation Metrics – Code coverage – Number of builds per day – Time taken per build – Number of failed/success builds – Trends in code metrics
• Testing Metrics – Acceptance tests per story – Defects count per story – Test time to run – Tests run frequency – Manual tests per story – Automation percent – Time to fix tests
This slide is not for human reading
![Page 5: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/5.jpg)
![Page 6: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/6.jpg)
Thermometer measures a temperature of the thermometer
![Page 7: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/7.jpg)
There is no spoon THE METRIC
![Page 8: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/8.jpg)
The single metric to control • Quality • Speed • Productivity • Customer satisfaction • Etc.
… is still being looked for :)
![Page 9: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/9.jpg)
Metrics improve productivity?
Myth
![Page 10: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/10.jpg)
Myth: bigger velocity is better
Myth
![Page 11: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/11.jpg)
WILL ACCURACY OF ESTIMATES
INCREASED
Myth
IF REQUIRE COMMITTED
= 100% DELIVERED?
![Page 12: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/12.jpg)
Choosing a GOOD metric
![Page 13: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/13.jpg)
Encourage target behaviour
![Page 14: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/14.jpg)
Measure trend
![Page 15: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/15.jpg)
Easy to collect and measure
![Page 16: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/16.jpg)
Inspire useful discussions (what have learnt)
![Page 17: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/17.jpg)
Gives periodic feedback
![Page 18: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/18.jpg)
Can make conclusions
and fix the process
![Page 19: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/19.jpg)
Measurement effect
Tell me how you will measure me and I’ll tell you how I will behave.
Eli Goldratt “The Goal” (2004)
![Page 20: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/20.jpg)
Leading vs. Lagging
Leading Lagging
![Page 21: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/21.jpg)
Leading vs. Lagging
Leading Lagging
![Page 22: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/22.jpg)
What to measure?
• Productivity metrics
• Predictability metrics
• Quality metrics
• Value metrics
Predict
Quality
Value
Productivity
![Page 23: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/23.jpg)
And now ...
The Metrics!
![Page 24: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/24.jpg)
Productivity metrics Productivity
![Page 25: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/25.jpg)
Velocity Leading
Productivity
Myth
![Page 26: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/26.jpg)
Risk of Story Points inflation
![Page 27: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/27.jpg)
Truth: Story points are relative
![Page 28: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/28.jpg)
Work In Progress Leading
Productivity
![Page 29: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/29.jpg)
Story Cycle Time
Leading
Productivity
![Page 30: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/30.jpg)
Predictability metrics Predict
![Page 31: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/31.jpg)
Sprint Burn Down Chart Leading
Predict
![Page 32: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/32.jpg)
![Page 33: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/33.jpg)
Release Burn Down Chart Leading
Predict
![Page 34: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/34.jpg)
Burn Up Chart
Leading
Predict
![Page 35: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/35.jpg)
ROI (Return-on-Investment)
• Backlog item - Business-Value • Value in $
![Page 36: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/36.jpg)
Quality metrics
![Page 37: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/37.jpg)
Technical Debt
• Backlog
– Inner vs. External quality
– Testing Automation
– Reengineering
– Maintainability
– Documentation
Leading
Quality
![Page 38: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/38.jpg)
![Page 39: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/39.jpg)
Running Automated Tests
• Amount of tests
– Functional
– Unit
• Code Coverage
• Must be increasing
• Tests must pass
Leading
Quality
![Page 40: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/40.jpg)
Post Sprint Defect Arrival
Quality
Lagging
![Page 41: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/41.jpg)
Post Release Defect Arrival
THE SAME
Lagging
Quality
... after global Release
![Page 42: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/42.jpg)
The ONLY valid Quality metric Lagging
Quality
![Page 43: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/43.jpg)
Value Metrics
![Page 44: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/44.jpg)
Customer Satisfaction Survey
The best way to find out whether your customers are
satisfied is to ask them
Lagging
Value
![Page 45: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/45.jpg)
How satisfied are you with your purchase? the service you received? with our company overall?
Basic satisfaction
![Page 46: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/46.jpg)
Customer loyalty
How likely are you to buy from us again? recommend our product/service to others? recommend our company to others?
![Page 47: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/47.jpg)
TotalDetractorsomotersPr
![Page 48: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/48.jpg)
Customer Satisfaction Survey
Lagging
Value
![Page 49: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/49.jpg)
![Page 50: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/50.jpg)
Lagging
Value
How often: “So often, that get more information, But not so often that annoy”
![Page 51: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/51.jpg)
Key Drivers of satisfaction: • Conflicting goals • What does Client feel important • Scatter diagram (Key Driver Chart)
![Page 52: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/52.jpg)
Employee Satisfaction Survey Lagging
Value
![Page 53: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/53.jpg)
Lagging
Value
![Page 54: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/54.jpg)
Short Summary ∑® • Goal
– Why do you want to measure?
– What would be the result of the intrusion?
• Classification – Time
• Leading
• Lagging
– Subject • Productivity
– Story Cycle Time
• Predictability – Burn up Chart
• Quality – Tech Debt
• Value – Net promoters
![Page 55: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/55.jpg)
Questions time
![Page 56: Agile Base Camp - Agile metrics](https://reader031.fdocuments.net/reader031/viewer/2022012405/554f6733b4c905bb178b4b7e/html5/thumbnails/56.jpg)
Links • http://agilebasecamp.org/
• http://blog.scrumtrek.ru/2010/01/wip-story-cycle-time.html
• http://blog.scrumtrek.ru/2010/01/velocity.html
• http://www.scrum.org.za/uploads/2009/09/measuring-for-results-2-small.pdf
• http://scrumorlando09.pbworks.com/Scrum-Metrics-and-Myths
• http://www.slideshare.net/petebehrens/measuring-agility-top-5-metrics-and-myths
• http://www.slideshare.net/alimenkou/agile-metrics-2725666
• http://management.about.com/od/competitiveinfo/a/CustomerSatSurv.htm
• http://en.wikipedia.org/wiki/Net_Promoter