Automation in testing

How to tackle it

Presenter: Mirek RakowskiDate: 13/11/2014

Goals

Automation in testing

S o ft w a r e t e s ti n g

Apr 15, 2023 4Source: http://danspira.com/2011/06/

• Manual testing takes too much time

• Manual testing is error prone

• Release of key resources

• Regression testing as a ‘safety net’

• Test automation as a source of feedback

• Test driven develpoment

• Automated tests as a live documentation

• Automation – good return of investment

W h y t o a u t o m a t e ?

Apr 15, 2023 5Source: http://media.gamerevolution.com/images/misc/Image/cat-nap-on-comp.jpg

• Developers’ approach

• Hump of pain

• Initial costs

• Constantly changed code

• Legacy software

• Fear

• Bad habbits

• Wrong assumptions

I m p e d i m e n t s f o r t e s t a u t o m a ti o n

Apr 15, 2023 6Source: http://librairie.immateriel.fr/baw/9780596159818/httpatomoreillycomsourceoreillyimages329397.png

• Team work

• Transparent goals

• Well defined test strategy

O v e r c o m m i n g o b s t a c l e s

Apr 15, 2023 7

Scope

Automation in testing

W h a t c a n w e a u t o m a t e ?

Apr 15, 2023 10Source: http://coding-is-like-cooking.info/wp-content/uploads/2013/07/agile-testing-quadrants.009.jpg

Unit TestsComponent

Tests

Functional TestsExamples

Story TestsPrototypesSimulations

Exploratory Testing

Usability TestsUAT

Alpha / Beta

Performance Tests

Security Testing„ility” Testing

Automated

Automated & Manual Manual

Tools

W h a t c a n w e a u t o m a t e ?

Apr 15, 2023 11

Manual tests

GUI tests

Functional / API tests

Unit tests

• Code analysis

• Builds and deployment, Continous Integration

• Unit and component tests

• API / Web services tests

• Business layer tests

• Presentation layer tests

• Load, performance, stress tests

• Results comparison

• Repetable activities

• Data / configuration setup

W h a t c a n b e a u t o m a t e d ?

Apr 15, 2023 12Source: http://blog.typemock.com/wp-content/uploads/2012/04/crash-test-dummies.jpg

• Usability tests

• Exploratory tests

• Tests that will always pass

• Tests that are executed only once

W h a t s h o u l d n ’ t b e a u t o m a t e d

Apr 15, 2023 13

• Code that was not designed to be tested automatically

• Software that doesn’t have clear separation between layers

• Tests when requirements constantly changes

W h a t c a n b e h a r d t o a u t o m a t e ?

Apr 15, 2023 14

Test strategy

Automation in testing

Te s t s t r a t e g y

Apr 15, 2023 17Source: http://4.bp.blogspot.com/_S3TFiuLoYtg/S_PdfSptbZI/AAAAAAAAAMk/nRrI4LB-3dc/s1600/Where%20to%20start.jpg

• Aim where it hurt most

• Multilayer approach

• Properly designed tests structure and maintenance

• Correct tools selection

• Do it agile

Te s t s t r a t e g y

Apr 15, 2023 18

A u t o m a ti o n i n t e s ti n g

Apr 15, 2023 19Source: http://sd.keepcalm-o-matic.co.uk/i/keep-calm-and-automate--20.png

Q / A

Thank you!