© 2014 imbus AG www.imbus.de

Agile Testing

Workshop

Tilo Linz, imbus AG

© 2014 imbus AG www.imbus.de Agile Testing Folie 2 von 20

Tilo Linz

CoFounder and member of managing board imbus AG

President ISTQB (2002-2005)

Chairman German Testing Board e.V. (2002-2013)

Author

Softwaretest Foundations

Software Testing Practice

Testing in Scrum

© 2014 imbus AG www.imbus.de Agile Testing Folie 3 von 20

Why Agile ? Agile vs. Traditional

Agile project management is based on the assumption that the team learns from every Iteration. The objective is to enable a project team to react quickly, simply and appropriate instead of wasting time and energy maintaining outdated plans.

© 2014 imbus AG www.imbus.de Agile Testing Folie 5 von 20

Why Agile ? Objectives

Reduced Time-to-Market most valuable requirements first short iterations resulting in shippable product

Improved Software Quality right requirements implemented implemented right (done product)

© 2014 imbus AG www.imbus.de Folie 5

Agile Testing Definition

Agile testing is testing of software within an agile development

project. … Agile testing follows the principles laid out in the

Agile Manifesto and applies the principles of agile methodology

to software testing.

[URL: agiles Testen]

Agile Testing

© 2014 imbus AG www.imbus.de Agile Testing Folie 6 von 20

Agile Testing Objectives

Sprints & Timeboxing Testing driven by iterations Generating fast feedback

Product & Sprint Backlog

Requirements understood (DoR) Requirements testable (DoD) Done product

Transparency

Daily feedback on product quality Input for retrospectives (process quality)

© 2014 imbus AG www.imbus.de

Testing

manual

Exploratory specification based

automated

GUI testing Behavior Driven xUnit

Agile Testing Folie 8 von 20

Agile Testing Methods

of more importance

(maybe) of reduced importance

© 2014 imbus AG www.imbus.de Folie 8

Agile Testing Exploratory Testing

Exploratory Testing

= Mission + Timebox

Session Based Testing

= Mission + Timebox + Report + Debriefing

Test Tours

= Mission + Timebox + Tour (Route/Taktik)

Bug Hunting

= Mission + Timebox +

Competition/Gameification

[Exploratory Testing]

© 2014 imbus AG www.imbus.de Agile Testing Folie 9 von 20

Agile Testing Test Pyramid

System Test Cases

Integration Test Cases

Unit Test Cases

(typical) V-Model Project (ideal) agile Project

© 2014 imbus AG www.imbus.de Agile Testing Folie 10 von 20

Agile Testing Test First

Test First is one of the most fundamental agile practice. Like many agile practices, the origin is the world of XP:

turns the traditional sequence ‘program test’ upside down to ‘test program’ tests are ‚driving‘ the developers: ‚test-driven development‘, - ‚test-first programming‘, - ‚Test First‘ xUnit – Tools (s. [URL: Toolliste])

write test

run test

change code

© 2014 imbus AG www.imbus.de Agile Testing Folie 11 von 20

Agile Testing Behavior Driven Development & Testing

A test automation approach:

to draft and automate tests in a natural-language-style

(domain specific language, DSL)

leveraging BDT frameworks

can partially replace (traditional) system test cases

See also: http://en.wikipedia.org/wiki/Behavior-driven_development

© 2014 imbus AG www.imbus.de Folie 12 von 20

Agile Testing Test First – Benefits

Testing replaces trials

Test cases provide objective feedback on progress

Tests replace written specifications

Test First improves the quality of public interfaces (APIs)

Test First improves testability

Agile Testing

© 2014 imbus AG www.imbus.de Folie 13 von 20

Agile Testing Challanges

Done product for every increment

Shippable = tested = working = „done“

Fast daily feedback: Testers Team

Frequent feedback: Users/Customers Team

Agile Testing

© 2014 imbus AG www.imbus.de Folie 14 von 20

Agile Testing „System Test Sprint“ ?

System Testing Bugfixing Development

…

Agile Testing

© 2014 imbus AG www.imbus.de Folie 15 von 20

Agile Testing „End of Sprit Testing“ ?

Agile Testing

… Dev Bugf

Sys Test

Dev Bugf

Sys Test

Dev Bugf

Sys Test

© 2014 imbus AG www.imbus.de

System test

Regression tests

System test

New

New Regression tests

System test

New

…

Regression tests New

New

New

Automated tests

Manual tests

Folie 16 von 20

Agile Testing Nonstop !

Agile Testing

© 2014 imbus AG www.imbus.de Agile Testing Folie 17 von 20

Agile Transition Challanges

From „Push“ to „Pull“ From Config. Management

to Continuous Integration

From Test Phases to Test Nonstop

© 2014 imbus AG www.imbus.de Agile Testing Folie 18 von 20

Agile Transition Success factors

Agile mindset / ‚Whole Team‘

Coaching, Scrum Master

Training (key methods)

Test Automation

Exploratory Testing

Testing-Experts within each team

(CI, Test First, Test design, …)

© 2014 imbus AG www.imbus.de Agile Testing Folie 19 von 20

Literature and Sources

Mike Cohn: Agile Estimating and Planning

Lisa Crispin: Agile Testing

Markus Gärtner: ATDD in der Praxis

Tilo Linz: Testen in Scrum-Projekten / Testing in Scrum

Robert C. Martin: Clean Code

Roman Pichler: Scrum

Ralf Wirdemann: Scrum mit User Stories

James Whittaker: Exploratory Software Testing

http://de.wikipedia.org/wiki/Agiles_Testen

https://www.testtoolreview.com/de/

https://www.scrum.org/Scrum-Guide

http://agilemanifesto.org

© 2014 imbus AG www.imbus.de

info@imbus.de www.imbus.de

imbus AG imbus AG Kleinseebacher Str. 9 Balanstr. 73 // Gbd. 21a 91096 Möhrendorf 81541 München DEUTSCHLAND DEUTSCHLAND Tel. +49 9131 7518-0 Tel. +49 89 3219909-0 Fax +49 9131 7518-50 imbus AG Rathausallee 70 22846 Norderstedt DEUTSCHLAND Tel. +49 40 3085426-0

imbus Rhein-Main GmbH Kirschgartenstr. 15 65719 Hofheim DEUTSCHLAND Tel. +49 6192 92192-0 imbus Rheinland GmbH Maternusstr. 44 50996 Köln DEUTSCHLAND Tel. +49 221 998788-0 imbus Shanghai IT Co., Ltd. Shanghai 201203 P.R. CHINA www.imbus.cn imbus Tunisia S.À.R.L

4000 Sousse TUNESIEN www.imbus.tn

Folie 20 von 20 Agile Testing