TTCN-3 @ · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The...

37
TTCN-3 @ Ericsson or… How to get 1500 TTCN-3 users?

Transcript of TTCN-3 @ · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The...

Page 1: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

TTCN-3 @ Ericssonor…

How to get 1500 TTCN-3 users?

Page 2: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

Make sure you have the right tools!

Page 3: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-153

Make sure you have the right tools!

Page 4: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-154

Make sure you have the right tools!

Page 5: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-155

Make sure you have the right tools!

Page 6: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-156

Make sure you have the right tools!

Page 7: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-157

Make sure you have the right tools!

Page 8: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-158

Make sure you have the right tools!

Page 9: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-159

Make sure you have the right tools!

Page 10: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1510

Make sure you have the right tools!

Page 11: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1511

Make sure you have the right tools!

Page 12: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1512

Make sure you have the right tools!

Page 13: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1513

Make sure you have the right tools!

Page 14: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

Some about Ericsson…

Page 15: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1515

Technology Leadership for 130 years

Page 16: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1516

Ericsson history 130 years of leadership

1878 Telegraph to telephone1923 Manual to automatic1968 Electro mechanics to computer control1978 AXE first deployment1981 Fixed to mobile1991 1G analog to 2G digital mobile technology1998 Converge telecom and data in fixed and mobile networks1999 Moving toward 3G and mobile Internet2000 First large scale layered architecture2001 First 3G WCDMA call on public network, operator Vodafone2002 Carrier class IP DSLAM 2003 First mobile softswitch deployment2004 Breakthrough of WCDMA2005 Mobile Broadband with HSDPA2006 First field deployment of VDSL2 in Europe

Page 17: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1517

Ericsson drives telecommunication evolutionEricsson drives telecommunication evolution

1878 1880 1910 19471986-96

2001

2002

2003

2004

2005

2006

Page 18: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1518

ITU-R, -T, -D

TTCTTC

Standardization Landscape

Page 19: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

Some about Testing…

Page 20: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520

The testing challengeTTCN-3 @ Ericsson

A lot more to test…Telecom represents an ever increasing network complexity

Test are expected under customer like (load test) behaviour

Agile development methods drives more testing (daily test)

New platforms and processors (multi-core) are non-deterministic

…in a lot less time!Ericsson R&D are on the path to reduce lead-time by 50%

Page 21: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1521

The test tool challengeTTCN-3 @ Ericsson

Once upon a time…Lack of good tools for test automation (true automation)Several scripting languages with different logics, capabilities and syntaxEach tool had its own user interface, formats of logging and configurationTools were stand alone monoliths incapable of communicating

…but now with !One scripting languageOne user interfaceOne logging formatOne configuration formatOne tool integration technology

Page 22: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

TTCN-3

Page 23: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1523

HistoryTTCN-3 @ Ericsson

1992 Development start of a TTCN-2 toolset, the System Certification System (SCS),at Ericsson, Finland

1993 First release of SCS1997 Development responsibility of SCS is moved from Finland to the Test Competence

Center (TCC) at Ericsson, Karlskrona, Sweden. The Conformance Test Lab(research) is established in Ericsson, Hungary

2000 As a part of a master thesis the Conformance Test Lab develops a TTCN-3 tool prototype called TITAN

2002 The TITAN tool is presented at the ETSI launch event of TTCN-3 as the only functional tool

2003 The whole TCC operation and SCS responsibility is moved from Sweden to Ericsson, Hungary, and the first official TITAN release is made

2004 No further development of the SCS tool, full focus on TITAN.2006 First TITAN load solution launched.2007 The SCS tool is put at end-of-life, while TITAN has gained 1500+ Ericsson

users, provided solutions for large number of Protocol and Test Ports with supports for multiple platforms and supplied an Eclipse IDE and log viewer

Page 24: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1524

Sweden Finland

Japan

China

Hungary

Italy

GermanyCanada

USA

NorwayDenmark

Netherlands

Brazil

Ireland

Spain

UK

India

R&D centres in 17 countriesTTCN-3 deployed in 15 R&D centres + 4 other centresR&D centres in 17 countriesTTCN-3 deployed in 15 R&D centres + 4 other centres

# Licenses

<2525-4950-7475-99

100-149

150-249

250-399

>400

Croatia (other)

Greece (other)

Poland (other)

Australia (other)

Deployment geographicallyTTCN-3 @ Ericsson

Page 25: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1525

Deployment over timeTTCN-3 @ Ericsson

Number of active TTCN-3 licenses

0

500

1000

1500

1 jul

2001

1 jan

2002

1 jul

2002

1 jan

2003

1 jul

2003

1 jan

2004

1 jul

2004

1 jan

2005

1 jul

2005

1 jan

2006

1 jul

2006

1 jan

2007

Date

Num

ber o

f lic

ense

s

Active

Page 26: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1526

Unitlevel

Functionlevel

Systemlevel

Networklevel

Deployment in test phasesTTCN-3 @ Ericsson

Design Test

Pilots inModel based

testing

Used as one out of several unit (basic) testing techniques

The #1 most used function

testing method in Ericsson

Key usage in load and performance testing

Used in end-2-end testing scenarios

Page 27: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1527

StandardizationTTCN-3 @ Ericsson

Ericsson/TCC actively participates in– TTCN-3 language specification (standards making)– TTCN-3 language maintenance (decision of CR)– TTCN-3 language usage (writing standard test suites in TTCN-3)

Others11%

Telelogic1%

Strategic Test Solutions3%

Motorola1%

Nokia6%

TestingTech/Fokus36%

Ericsson40%

Accepted CRs to TTCN-3 ed.3 in the parts (part 1, 4 and 7) where Ericsson is active - Core language, Operational semantics and mapping TTCN-3 to ASN.1

Page 28: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

TITAN

Page 29: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1529

What is TITAN?TTCN-3 @ Ericsson

World’s first fully functional TTCN-3 test tool!– Was the only one supporting edition 1 of the language (2000-2002)– The only functional tool presented at the TTCN-3 Launch event of

ETSI (2002)

A software test tool capable of load– Supports multiple platforms: Solaris, Linux SUSE9.x, SLES8,

RedHat9, FreeBSD, Windows (cygwin) and proprietary platforms– Load capabilities thanks to an efficient (C/C++) run-time-environment

An Ericsson proprietary tool, not available outside Ericsson*

* Except ETSI and BUTE

Page 30: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1530

More than just a test toolTTCN-3 @ Ericsson

TTCN-3 Executor (compilers, RTE,Developer GUIs, Execution GUIs, utilities)

TTCN-3 Executor (compilers, RTE,Developer GUIs, Execution GUIs, utilities)

Test Ports (adapters)60+

Test Ports (adapters)60+

Protocol support120+

Protocol support120+

Servers8

Servers8

Protocol emulations2

Protocol emulations2

Libraries(useful functions, load)

Libraries(useful functions, load)

Test Suites(ETSI SIP CTS)

Test Suites(ETSI SIP CTS)

Applications(ready load tools)

Applications(ready load tools)

Page 31: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1531

Efficient test design and executionTTCN-3 @ Ericsson

Page 32: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1532

Efficient test result analysisTTCN-3 @ Ericsson

Page 33: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1533

Load capabilitiesTTCN-3 @ Ericsson

The load solution, TITANsim, is tailored to different telecom system characteristics

example from anexisting load solution

Page 34: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

Successes

Page 35: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1535

How to get 1500 TTCN users?TTCN-3 @ Ericsson

Long TTCN history generating high maturity – Research even before commercial vendors

Pushing for the use of a standard test notation– Easy reuse, competence build-up, a single tool

Active participation in ETSI– To grant the Ericsson needs

In-house tools development– For fast provisioning, test port development, training, etc

Dedicated support group– The Test Competence Centre and local groups

Reference network– Truly committed TTCN champions, yearly internal TTCN conference

An R&D all management commitment– Long term granted funding

Page 36: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1536

ContactTTCN-3 @ Ericsson

Contact personAnette Kjellströmmailto:[email protected]+46-13-284162

Presenter

Mats BerglundTools Architect

R&D Process, Methods & ToolsGroup Function Technology

Datalinjen 3P.O. Box 1248SE-581 12 LinköpingSweden

Mats BerglundTools Architect

R&D Process, Methods & ToolsGroup Function Technology

Datalinjen 3P.O. Box 1248SE-581 12 LinköpingSweden

Phone +46 13 287464Mobile +46 13 [email protected]

Page 37: TTCN-3 @  · PDF file© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1520 The testing challenge TTCN-3 @ Ericsson A lot more to test Telecom represents an ever

© Ericsson AB 2007 R&D PM&T EAB/OEP/H Mats Berglund 2007-05-1537