.getmore .getmore ----The Test Case GeneratorThe Test Case...

.getmore .getmore .getmore .getmore ---- The Test Case GeneratorThe Test Case GeneratorThe Test Case GeneratorThe Test Case Generator

Eclipse Testing Day 2010Darmstadt, 08.09.2010

Florian Prester sepp.med gmbh

.getmore @ Eclipse Testing Day 2010

[email protected]

2© sepp.med GmbH

Agenda

Introduction� What is sepp.med?� What is MBT?

.mzT – model centric testing� A best-practice approach 4 MBT� Tooling chain

.getmore� Architecture� Features

Projects� Scientific Projects� Industrial Projects

Discussion


[email protected]

3© sepp.med GmbH

sepp.med gmbh

Medium-sized IT Service Provider

30 years industrial experience

Our services� Development� QA & Test� Consulting� Training Provider

Expertise: complex and safety critical systems

3


[email protected]

4© sepp.med GmbH

Our Domains

Safety critical and regulated environment� Medical

� Pharmacy

� Automotive

� Automation & Systems

Complexity� Workflows & business processes

� Distributed development� Products / systems with many subcomponents� Product families, system engineering� Testing Facilities

4


[email protected]

5© sepp.med GmbH

What is model based testing?

How do I get the path?

Using different Strategies!

Using a „model“ for

testing!

What is a Test Case?

A valid path through the

Graph!

A model describing the

System under Test!


[email protected]

6© sepp.med GmbH

Main MBT-Workflow

Editor

Generator

Test Management

Test Cases


[email protected]

7© sepp.med GmbH

Design - Model

Limited to functionality

.mzT- Model

„All“ possibilities of interaction

plus

Test Management Information

What is a .mzT – Model?


[email protected]

8© sepp.med GmbH

Priority

.mzT – Model: (Test Management-) Information

Test StepVerification PointExpected ResultPrioritiesHierarchical ModelsDifferent Strategies for Sub DiagramsTest DataRequirements


[email protected]

9© sepp.med GmbH

.mzT – Model: hierarchical Model


[email protected]

10© sepp.med GmbH

„What is model centric testing used for?“

Systematic test case creation/design/generation

Review of requirements and Inspection of completeness and Testability

Reduction of efforts � Concentrating on one model – generate Test Cases� Test results are “built-in“� Maintenance of models is much more efficient than single

test cases� Review of Models is much more efficient � Choosing test cases depending on test target


[email protected]

11© sepp.med GmbH

Available Tool Chains

Sparx Systems

Enterprise Architect

IBM Rational

Rose

HP TestDirector/

QualityCenter

Polarion

IBM Rational

TestManager

ARTiSAN

Studio

MS

Excel/

Word

Test coverage

metrics

Borland

Segue

SilkTest

C/C++/C#

Java

TTCN-3ARTiSAN

Studio

Borland

Together

MID

Innovator

.getmore

MS TFS

Modeling

Guidelines


[email protected]

12© sepp.med GmbH

.getmore: Facts

Model editor independentVarious strategiesVarious test execution languagesVarious metricsPython for internal logic engine (e.g. Guard Conditions)Eclipse based (RCP/PlugIn)supporting� Each phase of development� Process conformance� Requirements, times, costs metrics


[email protected]

13© sepp.med GmbH

.getmore: Facts

Strategy types� Coverage strategies� Guided strategies� Random� Filter

Hierarchically ModelsConfiguration:� Loop delimiter� Test Case Length� Guard Conditions� TM Information


[email protected]

14© sepp.med GmbH

.getmore: Strategies

Full Path CoverageFull Function CoverageFull Test Step / Verification Point CoverageFull Transition CoverageFull Node CoverageFeature / Requirements CoverageNamed Path / Guided PathRandomBest-N Test Cases (Filter)…

14


[email protected]

15© sepp.med GmbH

An Example: Testing a Website


[email protected]

16© sepp.med GmbH

Model

Workflow:Open Start PageChoose SiteTest loginLog offClose Browser


[email protected]

17© sepp.med GmbH

Model

Requirements


[email protected]

18© sepp.med GmbH

Test Execution Information


[email protected]

19© sepp.med GmbH

ImportImportImportImportGenerateTest Case TreeFilter

ExportTest Case Tree

Execute

Generation Workflow


[email protected]

20© sepp.med GmbH

ImportGenerateGenerateGenerateGenerateTest Case TreeFilter


Execute

Generation Workflow


[email protected]

21© sepp.med GmbH

ImportGenerateTest Test Test Test CaseCaseCaseCase TreeTreeTreeTreeFilter


Execute

Generation Workflow


[email protected]

22© sepp.med GmbH

ImportGenerateTest Case TreeFilterFilterFilterFilter


Execute

Generation Workflow


[email protected]

23© sepp.med GmbH

ImportGenerateTest Case TreeFilter

ExportTest Test Test Test CaseCaseCaseCase TreeTreeTreeTree

Execute

Generation Workflow


[email protected]

28© sepp.med GmbH

Results / Export Formats

Text � manual test executionAutomatic execution (per Template)� C, C++, Java,…� Perl, Python� TTCN-3

Models� Sequence diagrams

Test Management� TestDirector, TestManager, QualityCenter, EXAM

2.0� ….

28


[email protected]

30© sepp.med GmbH

Scientific Projects

30

TestNGMed� www.testngmed.org� Medical HL7 Scenarios

GETTEMO� www.gettemo.de� Test Information Visualization� Graph layout/ Model Verification/ Markov Engine /

SimulationEMOTE� Embedded industries� Source Code Coverage <-> Test Coverage


[email protected]

31© sepp.med GmbH

Industrial Projects

31

TestNGMost� Automotive Industries� TTCN-3

CETES� www.cetes.eu� Embedded Industries� Eclipse based Tool Suite

MID Innovator 4 Testing � SOA & Business Workflows� BPMN

On-the-fly-Testing


[email protected]

32© sepp.med GmbH

Marketing

Community:� www.modellzentriertestesten.de� www.xing.com/net/mbt

Conquest 2010, Dresden� Tutorial: .mzT� 20.9.2010 (nachmittags)

Expert Symposium� March, 17th 2011 in Herzogenaurach� www.expertensymposium.de

Thank you for your attention,Thank you for your attention,Thank you for your attention,Thank you for your attention,

any questions?any questions?any questions?any questions?

Tel.: Tel.: Tel.: Tel.: +49 (0) 91 95 +49 (0) 91 95 +49 (0) 91 95 +49 (0) 91 95 ---- 9 31 9 31 9 31 9 31 ---- 0 0 0 0 Fax: Fax: Fax: Fax: +49 (0) 91 95 +49 (0) 91 95 +49 (0) 91 95 +49 (0) 91 95 ---- 9 31 9 31 9 31 9 31 ---- 300300300300EEEE----Mail: Mail: Mail: Mail: [email protected]@[email protected]@seppmed.deWeb: Web: Web: Web: www.seppmed.dewww.seppmed.dewww.seppmed.dewww.seppmed.de

.getmore .getmore ----The Test Case GeneratorThe Test Case...

Documents

Transcript of .getmore .getmore ----The Test Case GeneratorThe Test Case...