Lean Quality Assurance v3
-
Upload
sergio-ruiz -
Category
Documents
-
view
229 -
download
0
Transcript of Lean Quality Assurance v3
-
8/3/2019 Lean Quality Assurance v3
1/50
www.Gilb.com 1Version 8- Sep. 2010
LeanQuality Assurance
by Gilb
Copyright: Gilb 2010,
Slide owner: [email protected] @kaigilb
[email protected] @imtomgilbwww.gilb.com
These slides will be at:
http://www.gilb.com/tiki-download_file.php?fileId=392
-
8/3/2019 Lean Quality Assurance v3
2/50
www.Gilb.com 2Version 8- Sep. 2010
Main Take-away Points
Quality Assurance is far more than test,and it can be far more cost-effective
Quality is far more than bugs
You probably have a lot to learn,if you want real competitive quality
-
8/3/2019 Lean Quality Assurance v3
3/50
www.Gilb.com 3Version 8- Sep. 2010
Quality Assurance
is far more than test
and it can be far more cost-effective
-
8/3/2019 Lean Quality Assurance v3
4/50
www.Gilb.com 4Version 8- Sep. 2010
a story
-
8/3/2019 Lean Quality Assurance v3
5/50
www.Gilb.com 5Version 8- Sep. 2010
Inspection Effectiveness
Capers Jones
-
8/3/2019 Lean Quality Assurance v3
6/50
www.Gilb.com 6Version 8- Sep. 2010
-
8/3/2019 Lean Quality Assurance v3
7/50
www.Gilb.com 7Version 8- Sep. 2010
-
8/3/2019 Lean Quality Assurance v3
8/50
www.Gilb.com 8Version 8- Sep. 2010
-
8/3/2019 Lean Quality Assurance v3
9/50
www.Gilb.com 9Version 8- Sep. 2010
-
8/3/2019 Lean Quality Assurance v3
10/50
www.Gilb.com 10Version 8- Sep. 2010
All Defects
Desi
gn
Best Practice TestingCombined
Remaining Defects
-
8/3/2019 Lean Quality Assurance v3
11/50
www.Gilb.com 11Version 8- Sep. 2010
Little hope of zero defectsBetween
8 and10defect removal
stages requiredto achieveremovaleffectiveness of
95%
-
8/3/2019 Lean Quality Assurance v3
12/50
www.Gilb.com 12Version 8- Sep. 2010
Testing Capability (C. Jones)
0
20
40
60
80
100
120
1st year 2nd year 5th year
Test
In Field
%
-
8/3/2019 Lean Quality Assurance v3
13/50
www.Gilb.com 13Version 8- Sep. 2010
Defect Detection Capability (C. Jones)
0
20
40
60
80
100
120
1st year 2nd year 5th year
Inspection
Test
In Field
%
-
8/3/2019 Lean Quality Assurance v3
14/50
www.Gilb.com 14Version 8- Sep. 2010
IBM Defect Avoidance Experience
0
20
40
60
80
100
120
1st year 2nd year 5th year
Defect Prevention Effectiveness
Inspection
Test
In Field
%
-
8/3/2019 Lean Quality Assurance v3
15/50
www.Gilb.com 15Version 8- Sep. 2010
Design Quality In
-
8/3/2019 Lean Quality Assurance v3
16/50
www.Gilb.com 16Version 8- Sep. 2010
-
8/3/2019 Lean Quality Assurance v3
17/50
www.Gilb.com 17Version 8- Sep. 2010
but by Engineering Quality In
Reliability
Performance
Security
Usability
Maintenance
Work hours
$ Kr.
-
8/3/2019 Lean Quality Assurance v3
18/50
www.Gilb.com 18Version 8- Sep. 2010
Setting Quality Goals
Usability.LearnScale: average time to Learn how tooperate the computer, from .. to ..
Status [today] 3 hours
Goal [next year] 10 min.
-
8/3/2019 Lean Quality Assurance v3
19/50
www.Gilb.com 19Version 8- Sep. 2010
Designing to meet Quality within Costs
Qu
alities
$
Design Ideas
-
8/3/2019 Lean Quality Assurance v3
20/50
www.Gilb.com 20Version 8- Sep. 2010
Quality Assurance
is far more than test
and, QA can be far more cost-effective
-
8/3/2019 Lean Quality Assurance v3
21/50
www.Gilb.com 21Version 8- Sep. 2010
Quality is far more than bugs
-
8/3/2019 Lean Quality Assurance v3
22/50
www.Gilb.com 22Version 8- Sep. 2010
a story
-
8/3/2019 Lean Quality Assurance v3
23/50
www.Gilb.com 23Version 8- Sep. 2010
System Performance
Q u a l i t y
How Well
Resource
SavingEfficiency
Capacity
HowMuch
-
8/3/2019 Lean Quality Assurance v3
24/50
www.Gilb.com 24Version 8- Sep. 2010
Qualities are many and variable
Learning Doing Error RateUsability Portability Enhancability CompatibilityAdaptability
Threat Type and Frequency Security MitigationIntegrity
Reliability Maintainability (fault fix speed)Availability
-
8/3/2019 Lean Quality Assurance v3
25/50
www.Gilb.com 25Version 8- Sep. 2010
Quantify the Quality to Assure It
I often say that
when you can measurewhat you are speaking about,
and express it in numbers,
you know something about it;
but when you cannot measure it,
when you cannot express it in numbers,
your knowledge is of a meagre and unsatisfactorykind;
- Lord Kelvin, 1893
-
8/3/2019 Lean Quality Assurance v3
26/50
www.Gilb.com 26Version 8- Sep. 2010
Quality is far more than bugs
-
8/3/2019 Lean Quality Assurance v3
27/50
www.Gilb.com 27Version 8- Sep. 2010
7Competitive Lean
QA methods
to Learn
-
8/3/2019 Lean Quality Assurance v3
28/50
www.Gilb.com 28Version 8- Sep. 2010
Stakeholders Decide Qualities
Suzanne Robertson &James Robertson
1.
-
8/3/2019 Lean Quality Assurance v3
29/50
www.Gilb.com 29Version 8- Sep. 2010
2.
-
8/3/2019 Lean Quality Assurance v3
30/50
www.Gilb.com 30Version 8- Sep. 2010
Assuring that Designs give Qualities3.
Usability
-
8/3/2019 Lean Quality Assurance v3
31/50
www.Gilb.com 31Version 8- Sep. 2010
Measure Quality Levels in
Specifications with Inspection4.
-
8/3/2019 Lean Quality Assurance v3
32/50
www.Gilb.com 32Version 8- Sep. 2010
Numeric Quality Gateways5a.
-
8/3/2019 Lean Quality Assurance v3
33/50
www.Gilb.com 33Version 8- Sep. 2010
Numeric Quality Gateways
Improve Quality of work
80 Majors Found (~160-240 exist!)
40
23
800
20
40
60
80
100
0 1 2 3 4 5
Defects/Page
February April
Inspections of Garys Designs
Gary atMcDonnell-Douglas
5a.
-
8/3/2019 Lean Quality Assurance v3
34/50
www.Gilb.com 34Version 8- Sep. 2010
DPP Improves Quality by 10x: Raytheon
CONC
Cost of Rework
(non-conformance)
COC
Cost of
Conformance
43%
www.sei.cmu.edu/publications/%20documents/95.reports/95.tr.017.html
40%
35%
30%
25%
20%
15%
10%
5%
0%
5%
1st year 2nd year 4rd year 5th year 6th year 7th year 8th year
% CONC% COC
Start of Effort
The individuallearning curve ??
Bad ProcessChange
6
-
8/3/2019 Lean Quality Assurance v3
35/50
www.Gilb.com 35Version 8- Sep. 2010
Frequent feedback and improvement
assure quality
2 Kinds of Feedback from Stakeholders, when value increment is reallyexploited in practice after delivery. Combined with other information from the relevant environment. Like budget, deadline, technology, politics, laws,
marketing changes.
Stake-
holdersPotentialValue
Plan Do
Act Study Perceived-ValueInfo
Realized
Value Stake-holders
Realized-ValueInforma5on
Stake-
holders
Stake-
holders
Stake-
holders
Stake-
holders
Other
Cri5calFactors
7a
-
8/3/2019 Lean Quality Assurance v3
36/50
www.Gilb.com 36Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
Value
ManagementProcess
-
8/3/2019 Lean Quality Assurance v3
37/50
www.Gilb.com 37Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
38/50
www.Gilb.com 38Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
39/50
www.Gilb.com 39Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
40/50
www.Gilb.com 40Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
41/50
www.Gilb.com 41Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
42/50
www.Gilb.com 42Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
43/50
www.Gilb.com 43Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
44/50
www.Gilb.com 44Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
-
8/3/2019 Lean Quality Assurance v3
45/50
www.Gilb.com 45Version 8- Sep. 2010
Stakeholders
Values
Solutions
DecomposeDevelop
Deliver
Measure
Learn7b
Value
ManagementProcess
-
8/3/2019 Lean Quality Assurance v3
46/50
www.Gilb.com 46Version 8- Sep. 2010
7Competitive Lean
QA methods
to Learn
-
8/3/2019 Lean Quality Assurance v3
47/50
www.Gilb.com 47Version 8- Sep. 2010
What you can do immediately
Identify the 5 most critical qualities ofyour system.
Quantify the 5 qualities.For each quality, set a Current level and a Goal level
-
8/3/2019 Lean Quality Assurance v3
48/50
www.Gilb.com 48Version 8- Sep. 2010
Main Take-away Points
Quality Assurance is far more than test,and it can be far more cost-effective
Quality is far more than bugs
You probably have a lot to learn,if you want real competitive quality
-
8/3/2019 Lean Quality Assurance v3
49/50
www.Gilb.com 49Version 8- Sep. 2010
Thanks!
Thanks!Questions: now, briefly
After lecture, all during the conference.
[email protected] [email protected]: +47 920 66 705
www.Gilb.com
Copy of these slides will be in Downloads/Slides:
http://gilb.com/tiki-list_file_gallery.php?galleryId=14
-
8/3/2019 Lean Quality Assurance v3
50/50
www.Gilb.com 50Version 8- Sep 2010
The Lean Quality Assurance Methods
EverythingnotaddingvaluetotheCustomerisconsideredtobewaste.Thisincludes:
unnecessarycodeandfunc?onality DelayinthesoAwaredevelopmentprocess Unclearrequirements Bureaucracy Slowinternalcommunica?on
mplifyLearning Thelearningprocessisspedupbyusageofshortitera?oncycleseachonecoupledwithrefactoringandintegra?ontes?ng.Increasingfeedbackviashortfeedback
sessionswithCustomershelpswhendeterminingthecurrentphaseofdevelopmentandadjus?ngeffortsforfutureimprovements.
Decideaslateaspossible DeliverasfastaspossibleEmpowertheteamBuildintegrityin
separatecomponentsworkwelltogetherasawholewithbalancebetweenflexibility,maintainability,efficiency,andresponsiveness.Seethewhole
Thinkbig,actsmall,failfast;learnrapidly