Key Factors To Ensure Test

Automation Framework Success

NOVEMBER | 2015

THIEP TRUONG

My Background

• Thiep, Truong Xuan – QA Architect at KMS Technology VN

• 3 yrs+ experience in software development

• 10 yrs+ experience in software testing

• BS in Mathematics and Computer Sciences, major: Abstract Analysis

• Hobbies: Martial Art, Foosball, Motorcycle, etc.

• Contact:

• Personal email: truongxuanthiep@gmail.com

• Skype: truongxuanthiep

• Mobile: 0902 862 622

2

AGENDA

• Test Automation Framework (TAF)

• Application Support

• Key Features

• Summary

• Q&A

3

4

Key Elements To Setup A Solid TAF

Test Automation Framework

• Needs

• Intermediate &

Advanced Users

• Architecture: File

system & Database

• Application Support:

Web, API, Mobile,

etc.

• Features:

keyword/data driven,

distributed

execution, etc.

5

http://www.zenqconnect.com/services/TestAutomation.aspx

6

Application Support

Web Application Testing

• Libraries selection

• Across browsers (desktop only)

• M dot sites (mobile only)

7

http://static.thetechjournal.net/wp-content/uploads/2011/05/online-tools.jpg

Mobile Native Apps

• Libraries selection

• User defined controls

• MDM integration

8

http://kochartech.com/blog/2013/05/13/mobile-device-management-cloud-or-on-premise/

Web Services

• Libraries selection

• Algorithms to extract/validate data from responses

• Security

9

http://di-side.com/it/di-side/services/web-solutions/rest-webservice-symfony/

DB Accessing

• Libraries selection

• Format, store and manage result sets

10

11

Key Features

Object Inspectors

• Desktop browsers

• Mobile browsers

• Mobile native applications

12

Keyword, Data Driven

• Built-in keywords

• User defined keywords

• Data: location, formats

• Data population, looping and filtering

13

http://www.ranorex.com/blog/keyword-driven-test-automation-framework

Flow Controls

• Controlling test steps

• Error handling

• Condition & loop expressions

• Invoke test script

14

15

Key Indicator For Execution &

Historical Reports

Execution & Historical Reports

• Needs

• Information

• Rerun Failed

Cases

• Bug tracking

system integration

16

Import & Export

• Test script/suite/project/workspace

• Executable exported files

17

18

Why & How To Automatically

Execute A Test Suite

Scheduling

• Automatically detect changes and start running your test

suite

• OS native scheduling tools

• Leverage CI systems like Jenkins

19

20

Why & How To Setup The

Notification

Notification

• We will be automatically informed when running a test

suite is completed

• Leverage CI systems like Jenkins

• Implement a feature for email notification

21

22

How To Save Execution Time Of

Your Test Suite

Distributed Execution

• Selenium Grid

• Suggested solution

23

http://www.codeproject.com/Articles/9415/Distributed-Command-Pattern-an-extension-of-comman

24

Why & How To Setup Test Load

Balancer

Load Balancing

• Save execution time and leverage all idle systems

• Suggested solution (for DB only)

25

CI Integration

• Scheduling & Notification

• Command line mode

26

Code Generation

• Needs

• Scripting mode

27

Summary

• TAF supports applying automation testing

• TAF’s users define how a TAF looks like

• Application types: Web/API/Mobile, etc.

• File system versus Database

• Necessary features

• Evaluate and select appropriate tools/libraries

28

29

Q&A

© 2014 HCMC Software Testing Club

THANK YOU