Testing in DevOps: UKStar conference
-
Upload
laurent-py -
Category
Software
-
view
79 -
download
3
Transcript of Testing in DevOps: UKStar conference
![Page 1: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/1.jpg)
Test value first before correctness
27-28 February 2017LONDON
Laurent Py
@[email protected]://hiptest.net
![Page 2: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/2.jpg)
PLAN
2
The match: quality VS speed
Step 1: Testing the idea
Step 2: Testing first increment in production
Step 3: General availability of the feature
Benefits of a progressive approach to quality
![Page 3: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/3.jpg)
27-28 February 2017LONDON
QUALITY VS SPEED
![Page 4: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/4.jpg)
WE HAVE SPEED
4
Between 5 to 10 deployments/day
Our DevOps
teamDevs/testers
Ops
Product manager
Users
Marketing
Support
4
![Page 5: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/5.jpg)
WHAT ABOUT THE USER?
5
Speed of development feedback and learning
Value VS Quality
5
![Page 6: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/6.jpg)
27-28 February 2017LONDON
STEP 1: TESTING THE IDEA
![Page 7: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/7.jpg)
8
• Use personae • Capture the expected behavior with BDD • Define business assumptions
Benefits
Support
Devs/testeurs
Marketing
Ops
Product manager
WHAT VALUE DO WE WANT TO DELIVER?
8
![Page 8: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/8.jpg)
9
• Create a shared understanding with examples• Based on a common business language• Definition of stop• When tests are automated → living
documentation
BDD AT A GLANCE
9
![Page 9: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/9.jpg)
1111
![Page 10: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/10.jpg)
27-28 February 2017LONDON
STEP 2: TESTING FIRST INCREMENT IN PRODUCTION
![Page 11: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/11.jpg)
13
1. After step 1, we have our definition of success
2. We develop a first increment, do ET
3. We deploy it in production
FEATURE IS DEVELOPED
13
![Page 12: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/12.jpg)
14
• Based on usage- NB users, clicks- NB requests…
• Impact on- Sign-up- Revenue- Retention…
LET’S MEASURE THE IMPACT
14
![Page 13: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/13.jpg)
15
EXAMPLES OF METRICS
15
Notification feature• Usage
- NB clicks NB of notifications- NB of users
• Business: none
Test refactoring• Usage
- NB of refactoring actions- NB of impacts
• Business: Retention
![Page 14: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/14.jpg)
16
LIVE CHAT TO GET REAL TIME FEEDBACK
16
![Page 15: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/15.jpg)
1717
![Page 16: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/16.jpg)
27-28 February 2017LONDON
STEP 3: FEATURE FULLY AVAILABLE
![Page 17: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/17.jpg)
19
1. The impact has been validated
2. Investment on performance and non regression (checks are fully automated)
3. Feature made available to all users with a switch
FEATURE BECOMES FULLY AVAILABLE
19
![Page 18: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/18.jpg)
20
Appsignal, Pingdom, Scalingo et Logmatic
MONITORING PERFORMANCE AND BUSINESS
20
![Page 19: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/19.jpg)
2121
![Page 20: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/20.jpg)
27-28 February 2017LONDON
CONCLUSION
![Page 21: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/21.jpg)
23
•Test the value first• Invest progressively on quality•Create intimacy with the users•Create a suitable environment for experimentations
KEY TAKEAWAYS
23
![Page 22: Testing in DevOps: UKStar conference](https://reader034.fdocuments.net/reader034/viewer/2022052706/58ef6be51a28aba3618b4587/html5/thumbnails/22.jpg)
Thank you!
27-28 February 2017LONDON
https://hiptest.net