EXTENT-2016: Realisation of a Collaborative Approach to Test Automation
-
Upload
iosif-itkin -
Category
Technology
-
view
1.391 -
download
0
Transcript of EXTENT-2016: Realisation of a Collaborative Approach to Test Automation
![Page 1: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/1.jpg)
Duncan Brigginshaw
Co-Founder and
Technical DirectorOdin Technology Ltd
Realisation of a
Collaborative
Approach to Test
Automation
![Page 2: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/2.jpg)
Realisation of a Collaborative Approach to Test
Automation
www.odintech.com
A case study in post-trade
settlement and reconciliation at Clearstream
Duncan Brigginshaw
Co-Founder and Technical Director, Odin
![Page 3: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/3.jpg)
www.odintech.com
Agenda
• Introduction
• Background and Business drivers
• Defining a collaborative approach to functional test
automation
• ClearstreamXact Portal and 1CSR Project
• Lessons and Conclusions
Duncan Brigginshaw
Technical Director - Odin
![Page 4: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/4.jpg)
www.odintech.com
Introduction
• Deutsche Börse AG
• Diversified exchange organisation with wide range of products and services
– Listing and Trading, Clearing, Post-Trading, Market-Data and Services
• International Central Securities depository (ICSD) -Luxembourg
• Post-Trade Infrastructure and Securities service provider
• Central Securities Depository (CSD) – Frankfurt
• QA Software Vendor
• Providers of the Axe Enterprise Test Automation Platform
![Page 5: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/5.jpg)
www.odintech.com
Background and Business drivers
Duncan Brigginshaw
Technical Director - Odin
• Functional GUI Automation key to achieving business goals
• History:
• Isolated GUI Automation in Business Units– Primarily HP Products
– Technical in Nature
• Centralised Automation framework developed in-house– Expensive to build and maintain
– In-Flexible – Proprietary to HP
– Not-Business Oriented
• GUI Automation rates not inline with Business goals
![Page 6: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/6.jpg)
A collaborative test automation approach
www.odintech.com
![Page 7: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/7.jpg)
www.odintech.com
Stages
Duncan Brigginshaw
Technical Director - Odin
• High Level Vision – Define a Collaborative Automation Methodology
• “Involve Functional Analysts/Testers in Automation”
• Requirements– Script-less business focussed automation architecture
– Execution Tool Independent (HP + Selenium)
– Future Proof
– Compatible with current HP ALM Infrastructure
• Process– Initial Research and RFP
– Matrix Scoring on Requirements
– Shortlisted Vendor Proof of Concept
– Vendor Selection
– Rollout Methodology Defined with Vendor Support
– Initial project identified to prove and refine the approach
![Page 8: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/8.jpg)
www.odintech.com
Teams and Geography
BusinessUnits
Technical Test and
Tools
ToolVendors
FunctionalTesters
(Offshore)
ApplicationDevelopment
(Offshore)
FunctionalTesters
(Nearshore)
![Page 9: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/9.jpg)
www.odintech.com
• Functional Acceptance Criteria (FAC)• Test Cases
• Test Design
• Technical Tool Support
• Supporting Tool Infrastructure
Skill sets and Asset Focus
![Page 10: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/10.jpg)
www.odintech.com
Clear Matrix of Roles and Responsibilities
![Page 11: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/11.jpg)
www.odintech.com
HP ALM Central to Test Asset Mgmt.
HP ALM
BusinessUnits
Technical Test and
Tools
FunctionalTesters
(Offshore)
FunctionalTesters
(Nearshore)
![Page 12: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/12.jpg)
BusinessUnits
www.odintech.com
Asset Creation
• Functional Acceptance Criteria (FAC) + Test Case / Condition Design
Excel Template
• Import Creates linked Requirements and Tests in HP ALM automatically
HP ALM
Import
![Page 13: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/13.jpg)
Technical Test and
Tools
www.odintech.com
Asset Creation
Technical Test Assets Creation
Axe Automation Platform
• Project Setup• Supporting Custom Code• Added to ALM Test Resources
HP ALM HP UFT
![Page 14: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/14.jpg)
www.odintech.com
Asset Creation
Functional Test Design / Definition
FunctionalTesters
(Offshore)
FunctionalTesters
(Nearshore)
Axe Automation Platform
• Test Design Steps and Automation Code generated automatically
HP ALM
![Page 15: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/15.jpg)
www.odintech.com
Test Execution
• Automated Tests Scheduled and Executed
HP ALM
• Results and Acceptance Criteria Coverage Captured
HP UFT
![Page 16: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/16.jpg)
The Initial Project:
ClearstreamXact
Web Portal
www.odintech.com
![Page 17: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/17.jpg)
www.odintech.com
ClearstreamXact WebPortal
Duncan Brigginshaw
Technical Director - Odin
• ClearstreamXact– Framework for access to Clearstream
ICSD and CSD Services
– Settlement, Cash Management, Asset Servicing, Collateral Management, Securities Lending, Fund Services
• Xact Automated access
• Xact Web Portal (GUI)
• Clearstream Settlement and Reporting– TARGET2 and Global Securities
– Instructions, Positions, Cash and Securities
![Page 18: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/18.jpg)
www.odintech.com
Project Snapshot
Total
75%
Manual
Automation
Functional Acceptance Criteria
Automated
NotAutomated
64.4% of Target
(45% of Total)
U
Completed
35%
NotCompleted
ForecastTarget
![Page 19: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/19.jpg)
www.odintech.com
Project Timeline & Progress
Completed
NotAutomated
Automated64.4%
Month 1 Month 2 Month 3 Month 4 Month 5
![Page 20: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/20.jpg)
www.odintech.com
Duncan Brigginshaw
Technical Director - Odin
• Application Build and Delivery– Daily Updates
– Weekly Delivery
• Testing– Subset of Tests Run Daily
– Full Regression Pack of Tests run Weekly
– 12hr Execution Across 12 Machines
Application Build and Test Regime
![Page 21: EXTENT-2016: Realisation of a Collaborative Approach to Test Automation](https://reader033.fdocuments.net/reader033/viewer/2022050614/587c97b71a28abfa5e8b665d/html5/thumbnails/21.jpg)
www.odintech.com
Lessons and Conclusions
Duncan Brigginshaw
Technical Director - Odin
• Lessons Learned - Refinements:– Requirement for automated test failure triage process
– Defect management for automation (separate to development)
– Asset naming conventions needed early in the project
– New functionality found more challenging for automation than regression
• Collaboration was key in automation success
• Important to define clear roles and responsibilities
• Leveraging relevant skills and expertise in the appropriate Mix
• Collaborative methodology and selected tooling is proving successful over manual testing and previous automation