Why would you want to improve your test process using TPI or TMMi?

Restricted © Siemens AG 2014. All rights reserved

Why Would You Want to Improve Your Process?

13th Exchange of Experience: Testing | Nuremberg, March 13, 2014

Rik Marselis (Sogeti) Geoff Thompson (Experimentus)

Restricted © Siemens AG 2014. All rights reserved March 13, 2014 Rik Marselis, Geoff Thompson

Introducing Rik & Geoff

NL UK ISTQB

Passion for quality and for “doing IT right”

Enjoy sharing knowledge:

presenting and writing

Projectleader TPI NEXT

3 daughters 2 daughters

1962 1961

Co Founder TMMi

Director of Experimentus Fellow of

Sogeti-Labs

Happily married Founder ISTQB Vice-chairman TestNet


What is “success”?

Wikipedia: Achievement of a Goal; the opposite of Failure When is your business successful? Project ready in time? IT Quality meets standards? Business value is created? Clients are happy!!


Why do we need to improve?

Because software fails

and we need to be as

efficient as possible in

trying to stop these!

London Stock Exchange

LA Airport flights grounded

AT&T take out ⅓ of US ‘phones

London Underground free travel with Oystercard

British Passport failure

Intel Pentium chip maths division wrong

Software failure at Stanstead closed check in

Therac 25 radiation overdosing

Airbus A380 incompatible software

Patriot Missile System – Dhahran

Mars Climate Orbiter & Polar Lander


We want to do the right thing in the right way


To do the right thing in the right way can mean...

•  Saving money both in the short and long term

•  Better risk management

•  Accelerated time to market

•  Reduction in delays to the software development life cycle

•  Better career opportunities

•  Improved working life of employees


Business drivers

Source - IT priorities for battling the economic slowdown: UK CEO Survey | 2008 – BearingPoint/HP


To avoid going the wrong way!


Opening the gate – getting rid of barriers to quality work


Is your process this sort of Ferrari?


When you would like it to be this sort?


V-model, outdated?

•  Start/stop model •  Create in one go (no increments) •  Doesn’t stimulate collaboration


Application Lifecycle model

Most people accept “Testing” as a fact of life But often they are not happy about it

All activities are relevant, they may be

done sequential or

in parallel

Applies to both Waterfall

and Agile


So we performed an assessment to assess the test maturity Conclusion: There’s nothing really wrong with testing

The fixing and rework is the real problem!

Example; Client said: “Testing costs too much time & money”


We introduced: “the fixing-phase”

Now something interesting happened; the stakeholder asked:

“Why do we need a fixing phase”? “Can’t they build it right first time”?

Fixing phase

Source: Jerry Weinberg


Why do we need this fixing? Defect injection

58% of defects originate from early lifecycle activities !!


What often happens

Requirements Design Development Testing Acceptance Implementation Maintenance


Defect inserted in activity

Defect detected and fixed in activity


The right quality, not too less, not too much

Three key principles

Frontload the process with quality measures; methods, tools, training, reviews, …

People are fallible early reviews

And remember: Quality can’t be ‘tested in’ at the end


No faults forward to the next activity



Defect inserted in activity

Defect detected and fixed in activity


When and What to improve When:

As soon as you can

The next new project Something that is big enough (and

important enough) to make a difference

Does timing even matter?

Everything A bit at a time What someone else tells me needs to change!

Use a model to help understand what's needed

On the next business critical project

Just tinker

Something that gives the biggest bang for the buck

Once you have a business case

Only what you have a business case for

What:


To model or not to model that is the question?

Non-model based approach involves process

improvements by adapting what already exists and

augmenting with process components picked up at

conferences/training. These processes typically

tend to be home grown untried and untested.

Model based process improvement incorporates process improvement with international standards and

frameworks such as the SEI’s CMMI frameworks, ISO

frameworks, ITIL, TPI, TMMi, PCMM and various others. Using such models allows

organisations to compare their practices with internationally

recognized industry good practices.


Do you feel lucky...


How!

Measure

Prioritise & Plan

Define / Re-define

Operate

Validate

Evolve

Initiate

•  Action Planning •  Target Setting

•  New process definition/refinement

•  Training •  Pilot

•  Full deployment

•  Monitoring of results against targets

•  Evolution of programme approach & targets

•  Assess Process/monitor against plan

•  Obtain agreement to progress


But this success is not just process….

Measure/Prioritise and Plan/ Define and

Redefine Operate/Validate Evolve

Enth

usia

sm Maximum

Hype

Actual Use Disillusionment

Practical Benefit

RIP


It takes time before the actual improvements are realized

When ambitions for change are set high, It takes too

much time before the actual savings are realized


Improve gradually

parallel and step-by-step improvement, with small but measurable effects


Improve where it helps most

Don’t elevate the peaks; start improving by filling the valleys


The basic assumption for process improvement

+ = People Process Result

+ + +

= = =


So why would you improve? Measure increased success!!


Thank you !!


The models compared

http://www.nl.capgemini.com/bronnen/models-to-improve-your-test-process www.istqb.org


Comparison

TMMi TPI


Comparisons

TMMi Staged model

Advantage of staged: simplicity

TPI Continuous and staged model

Advantage of continuous: specific improvement focus


Comparison - differences

TMMi •  Managers Model •  Developed by over 500 resources

worldwide

•  Uses ISTQB terminology – which includes TMap terminology

•  Aligned to CMMI

•  Accreditation of methods and assessors •  Metrics and full lifecycle focussed •  Defect Prevention and Quality control

focus

•  Potential improvement recomendations •  Free download of model

(www.tmmifoundation.org)

TPI NEXT •  Engineers Model •  One organization in different countries

•  Uses TMap terminology

•  Independent of (but usable with) SPI-models

•  Business Driven approach

•  Improvement suggestions & enablers •  Free Excel-tool (www.tpinext.com)


Similarities

•  Books •  Certification

•  TMMi professional •  TPI NEXT certified

•  Certification of organizations •  Referenced in ISTQB Advanced

& Expert level •  Fit well with CMMI •  Encourage structured

improvement of test processes


Ask Geoff and Rik (now is your chance!)

Q & A

Why would you want to improve your test process using TPI or TMMi?

Technology

Transcript of Why would you want to improve your test process using TPI or TMMi?