New Model for Testing

@paul_g

erra

rd

Paul Gerrardpaul@gerrardconsulting.com

gerrardconsulting.com

Programme Chair 2014

Agenda

• A New Model for Testing

• What does the Model imply with regards to skills?

• Where next?

Overview

• In this session, Paul will present a refined list of both technical and impersonal skills and map these to the capabilities that testers in the new world must have

• The goal of the session is to discuss and refine this list of skills and mappings to capabilities to create perhaps a new 'Tester Skills Manifesto'.

The old ways won't work in the future

We need a New Model of Testing (free from logistics)

Forget Logistics(for the time being)

Document or not?Automated or manual?

Agile v waterfall?Planned v exploratory?This technology v that

technology?

ALL Testing is Exploratory

We explore sources of knowledge ...

... to build test models ...... that inform our testing.

All Testing is Based on Models

Examples of models

Models are innate, essential, human

Judgement, exploring and testing

Testing(the system)

Our model(s) are adequate

Our model(s) are not adequate

Exploring (sources) Judgement

Creates testmodels

Uses testmodels

We explore sources of knowledge to build test models that inform our testing

BTW – Do Developers explore the same way? I think so.

Exploration process

ExplorationDefinitions specs/stories

People(& you)

Sources

Require-ments

TestModels

Enquiring

Challenging

Sources:People, documents,experience, system under test

Modelling

Test Models:Can be documented

or mental models

Predicting

System under test

Testing process

TestingSystem

Under Test

Refining

Informing Applying

Interpreting

TestModels

Revise the System

Logging Revi

sing

More exploring Reporting

New Model Testing

Paper: http://dev.sp.qa/download/newModel

Consequences of the model

• ALL technologies, methods and logistics• Aligns with/supports (tentatively):

– Waterfall, Agile, Continuous Delivry, TDD/BDD etc.

– The Context-Driven View– Functional, (Possibly all) Non-Functional types

• A different perspective on:– "Testing v Checking"– Developer Testing, Embedded Testers, Shift Left– Test automation– Skills, capabilities and Certification

Capabilities

Enquiring, Modelling, Predicting, Challenging

Informing, Applying, Interpreting, Refining

Reporting and Logging

Some Possible 'Structures' for Capabilities and

Skills

New Model and Skills

• The 'New Model suggests that the core skills of testers are somewhat different– Somewhat different to those promoted

by 'thought leaders'– Very different to those promoted by the

certification schemes

• Of course interpersonal skills are, perhaps, the most critical.

• Analysis, enquiry and elicitation• Modelling• Creation of custom models, using

heuristics, guesses, brainstorming, ideation, creative thinking

• Custom test design techniques• Comparison of models, value,

advantages, disadvantages, compromises

• Identification, validation and use of oracles

• Predicate logic and proof• Hypothesis and inference• Socratic method• Rapid Review and Inspection

techniques• Test case design• Test models and the meaning of

coverage• Testing as controlled experiment• Observation, Note taking,

recording

A very different skillset• Basic data analysis and statistics• Decision-making with

incomplete data• Computer forensics• Fault tree analysis• Failure diagnosis• Bug advocacy, triage processes

and negotiation• Meaningful software and test

metrics• Visual presentation of data• Reporting and presentation skills• Understanding stakeholders• Test analytics• Risk management, risk-based

testing and decision-making• Critical Thinking• Interpersonal skills• Dealing with

uncertainty/fallibility

Testing Career Development(speculative)

Foundations

Technical

Management

Strategic

Test Strategy Project Intelligence

Test Assurance

Exploration Forensics Interpretation

Scripting/Programming

Test Automation Technical (Excel, SQL, OS utils etc)

Stakeholder management

Analytics & visualisation

Managing uncertainty

Critical Thinking

ISTQB etc...

Supplier Management

Test Process Management

Methodology

People Skills for Better BusinessSusan Windsor's interpersonal skills perspective (susan@wmhl.co.uk)

Foundations

Specialist

Management

Strategic

Critical Thinking

Supplier Selection and Management

Stakeholder Identification

Creating Shared Goals

Collaborative Team Working

Managing Cultural Differences

Managing Challenging Conversations

Enhance Your Communication Style

Managing Self Assessment

Define Team Qualities and Competencies

Implementing Assurance

Karen Johnson (US)EuroSTAR Tutorial

Thinking Skills - Bridging Skills from Theory to Practical Use, © 2014, Karen Johnson

What could we do now?

• Abandon. Nooooo! • Create a "Skills Framework", "Tester

Development Scheme", whatever...• Use TMF as a vehicle to develop and promote

a Skills Framework and "open source" it– Put pressure on Certification Schemes– (Training providers) Build courses to align

• Create a competitive Certification Scheme???

• Other ideas?