“Create Tests Automatically? It’s possible!” Practical Model-Based Testing
-
Upload
natalia-meergus -
Category
Software
-
view
115 -
download
0
Transcript of “Create Tests Automatically? It’s possible!” Practical Model-Based Testing
![Page 1: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/1.jpg)
ALM User Group
© Copyright SELA software & Education Labs Ltd. | 14-18 Baruch Hirsch St Bnei Brak, 51202 Israel | www.selagroup.com
May 2016
Natalia Meergus, Ilia German
“Create Tests Automatically? It’s possible!”Practical Model-Based Testing
![Page 2: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/2.jpg)
AgendaMBT in a nutshell
Demo with Conformiq Creator
Q&A
![Page 3: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/3.jpg)
Test automation evolutionManual
Automatic
Testdesign
Testexecution
Testing skills + Scripting skills + Modeling skills
Trad
ition
al m
anua
l te
stin
g
Trad
ition
al a
utom
atic
test
ing
Mod
el-
base
d te
stin
g
![Page 4: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/4.jpg)
MBT idea
![Page 5: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/5.jpg)
MBT output
Test SUT
Test Step
Expected Result
Test Step
Test Step
…Expected Result
![Page 6: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/6.jpg)
A model
![Page 7: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/7.jpg)
A model and testsvoid test1(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}
![Page 8: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/8.jpg)
A model and testsvoid test1(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}
void test3(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Close();}
void test2(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Close();}
void test4(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}
![Page 9: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/9.jpg)
MBT workflow
![Page 10: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/10.jpg)
MBT tools
MaTeLo Conformiq Designer TestOptimal Atos TEMPPO Smartesting CertifyIt Conformiq Creator Elvior MOTES/TestCast MBTReactis MBTsuite Bender RBTGraphWalker NModel Microsoft SpecExplorer
![Page 11: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/11.jpg)
ISTQB Certification MBT Extension
![Page 12: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/12.jpg)
MBT benefits/ROIOrganizations using MBTreport reduction of:
escaped bugs by 27%testing costs by 35%testing duration by 31%
(on average, source: MBT User Survey 2014 by Robert Binder)
![Page 13: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/13.jpg)
Demo
![Page 14: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/14.jpg)
Main pointsTests can be automatically generated (given a model of the system and a test harness)MBT is finding bugs missed by manually designed testsMBT makes test coverage systematic, visible and measurableMBT takes an upfront modeling effort but considerably accelerates extension of test suites and their maintenanceMaintaining a system model improves overall process and benefits all disciplines
![Page 15: “Create Tests Automatically? It’s possible!” Practical Model-Based Testing](https://reader036.fdocuments.net/reader036/viewer/2022062412/58cef5431a28abab738b4d2b/html5/thumbnails/15.jpg)
[ ]/Thanks;