Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick &...
Transcript of Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick &...
![Page 1: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/1.jpg)
Test automation in an agile context
Guy Van Put
![Page 2: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/2.jpg)
Test strategy determination
► Which levels of testing to automate?
► Which parts of the application NEEDS TO / CAN / COULD be automated?
► Which tool and frameworks to use?
► How much test coverage is needed?
• Device, OS, browser, screen resolution, language, network
► Strategy for maintaining the scripts?
► How to structure and organize the test code?
► How to deal with the test data?
► What is the starting information for test automation?
► How are the execution results reported and analyzed?
► How is the automation process linked to the manual testing process?
► Who will do the automation?
2
Manual testing or automated testing?
![Page 3: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/3.jpg)
Configuration madness
![Page 4: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/4.jpg)
What to automate?
4
![Page 5: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/5.jpg)
Where to automate?
5
Non linear Traditional
Triangle of Mike Cohn
![Page 6: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/6.jpg)
Traditional automation
• Quick & dirty
• Standard functionalities
• High maintenance (hard coded, redundancy,…)Record & playback
• Separate data from script
• Minimal coding skills needed
• Test data maintainable by non-technical profileData driven
• More control on script itself
• Lower maintenance
• Maximum reuse, avoiding redundancyFunction driven
• Call to functions
• Building test cases by non-technical profiles
• High modularityKeyword driven
6
![Page 7: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/7.jpg)
Test automation in agile context
7
The need for SPEED
The need for REPEATABILITY
The need for an AUTOMATION APPROACH
![Page 8: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/8.jpg)
Marick Test Matrix
8
TDD
BDD
![Page 9: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/9.jpg)
Test Driven Development (TDD)
► Ensure developed code is without defects
► Technical, unit level
► Developer
9
Code of the testSource code
![Page 10: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/10.jpg)
Behavior Driven Development (BDD)Update account info
As a user
I want to fill in my profile details
In order to use more features of the
app
10
Scenario: update account profile
Given I am a authenticated user
When I update my provide details
Then I should see my profile details
are updated
• Behavior driven• Bridging the gap between business (problem
domain) and IT (solution domain)• Verifiable business value
![Page 11: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/11.jpg)
Example of logical build pipeline
11
DEV TEST ACC PROD
Unittest
System
Systemintegration
QG1 QG2 QG3 QG4
AcceptanceTest
Unitintegration
ManualAutomated
Functional RegressionUsabilityCompatibilityNon-functional
FRUCN
F
F
R
RU
CC
N
N
F R N F R N
![Page 12: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/12.jpg)
Maturity of development proces
Au
tom
ati
on
level
Maturity
![Page 13: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/13.jpg)
Best practices
• If it hurts, do it often
• 80% - 20% capacity aim
• Target velocity
• Be clear on the value of a metric
• Pushing down the triangle of Mike Cohn
• “A fool with a tool is still a fool”
• Be transparent
• Respect the methodology
• Automating manual tasks
• Time to market
• Continuous delivery is a mindset
13
![Page 14: Test automation in an agile context - Sogeti Belgium€¦ · Traditional automation •Quick & dirty •Standard functionalities •High maintenance (hard coded, redundancy,…) Record](https://reader033.fdocuments.net/reader033/viewer/2022050305/5f6d4eba54f66e629e4795d6/html5/thumbnails/14.jpg)
Q&A
14