Enterprise Test Automation for SAP and Beyond
Transcript of Enterprise Test Automation for SAP and Beyond
Enterprise Test Automation for SAP and BeyondVÅRIMPULS ONLINE | April 20, 2021
Who is Worksoft?
66%
of FORTUNE 50 customers use
Worksoft
400
of the world’s top global companies across
industries use Worksoft
6
of the Global 10 largest organizations use
Worksoft
TELECOM UTLITIES MANUFACTURING TECHNOLOGY PUBLIC SECTOR HEALTHCARE ENERGY
The market’s platform of choice for automating complex applications like SAP and beyond, offering seamless end-to-end automation from process intelligence to testing to RPA.
CHALLENGES FACING GLOBAL 5000 COMPANIES
MITIGATE RISKMitigate technology risk associated with increased reliance on enterprise apps to run the business
EMBRACE MODERN DELIVERYTransform to modern delivery with Agile and DevOps practices
INNOVATE FASTERInnovate faster in a fragmented
application landscape with geographically distributed,
socially distanced teams.
DELIVER PREMIUM EXPERIENCESContinuously improve end user experience for both customers
and employees.
“We really can’t deliver speed to market if we don’t have test automation. It’s an enabler.”
- Worksoft Customer Jennifer Mazon, CHEP
Innovation in a Fragmented Environment
SAPSA
Test Automation Journey
20 April, 2021
UNRESTRICTED 4
22 April, 2021 UNRESTRICTED 5
Metso Outotec in briefMetso Outotec is a frontrunner in sustainable
technologies, end-to-end solutions and services for
the aggregates, minerals processing, metals refining
and recylcing industries globally.
By improving our customers’ energy and water
efficiency, increasing their productivity and reducing
environmental risks with our process and product
expertise, we are the partner for positive change.
Metso Outotec is committed to limiting global warming
to 1.5°C with Science Based Targets. We ranked 8th
on the 2021 Global 100 list of the World’s most
sustainable companies
22 April, 2021 UNRESTRICTED 6
Metso Outotec’s businesses
22 April, 2021 UNRESTRICTED 7
Drivers for Test Automation @Metso
Weekly Release
Monthly Releases
Projects, Mergers / Demergers
System upgrades, Carve outs, Main Projects
• More than 02 weeks of Regression Testing
• Monthly testing cost >10K €
• Manual Testing Errors, issues in Production
• Improving the test coverage
• Providing quick reports and results
• Improve Collaborations between teams, avoid
dependency on various processes
22 April, 2021 UNRESTRICTED 8
Test Automation Project @MetsoFrom beginning to present• Test Automation project was initially launched in Feb 2014. Initial target was to
automate all manual SAP related testing scripts
• Currently, test automation is used in weekly as well as monthly SAP releases for
Regression Testing and unit testing for new development & projects
• Test automation also been utilized for Futurus Project UAT testing cycles, BI
reports MD creation, and SAP SP upgrade projects
• Expanding the Test Automation scope to automate other application processes:
Pool4Tool, SuccessFactors, Sydle etc...
22 April, 2021 UNRESTRICTED 9
Test Automation Journey
Feb 2014Mar –May 2014
May - Jun 2014
Jul – Aug 2014
Sep –Nov 2014
Sep –Jan 2015
Jan –Dec 2015
Jan 2016Jan 2018
Jan 2019Jan 2020
Project Kickoff
Project Preparations:• Proof of concepts• Contracts with
selected vendor• Acquiring licenses
Contract finalizingServers, database and
client installations
Preparations for Workshop weeksTest Case Scoping (SD)
Inhouse Workshops
Integration of Worksoft Certify& Solution Manager
Document business processesData maintenance migrated to SolMan
Training and build of testcases for other functional areas
Continuing maintenance effort from each functional area
Continue extended the scope tokey / critical business processes
Maintenance of Data for multiple countries
Futurus S4 Hana ProjectSAP SP Upgrade
Initiating RPAExpanding to multiple application areas
Piloting SuccessFactorsRPA journey
Test Automation using in main & patch release regression testing
22 April, 2021 UNRESTRICTED 10
Current Level of Test AutomationAmount of Test Scripts• More than 180 E2E test scripts• E2E scenarios include:
- More than 5000 transactional processes
- More than 100,000 process steps
• Full scope regression testing for weekly as well as monthly releases
• Regression testing also performed based on Impact Analysis as per requirement
• E2E processes from different modules:- Controlling (CO)
- Customer Services (CS)
- Financial Accounting (FI)
- Material Management (MM)
- Plant Maintenance (PM)
- Production Planning (PP)
- Quality Management (QM)
- Sales & Distribution (SD)
- Warehouse Management (WM)
- Principal Company Model (PCM)
2
9 8
20
4
10
28
36
42
47
0
5
10
15
20
25
30
35
40
45
CO CS FI MM PM PP QM SD WM PCM Form Dev
E2E Processes
22 April, 2021 UNRESTRICTED 11
Why Worksoft Certify• Test automation solution for enterprise applications including SAP, Salesforce, Oracle,
and Web Apps• Worksoft Certify can be used on multiple non-SAP and SAP platforms
- An example of this is Metso’s WM E2E scenarios, Pool4Tool, and M3
• Scripting methodology is easy to learn and use – easier than programming but still needs a certain mindset to use it efficiently
• Easy to run, take screenshots, easily scalable, and easy to integrate with many applications including HP QC, RQM, SAP SolMan, and others
• Test Automation scripts are easily maintained- Possibilities to copy & paste, record new steps to anywhere in the test scripts- Test scripts are easy to read which facilitates efficient maintainability and issue recognition- Application/Process changes, no need to re-record the scripts, open the existing one and add/modify/delete steps
- Process comparison and merge
22 April, 2021 UNRESTRICTED 12
Test AutomationKey benefits and achievements
More than 80% test coverage of core business processes
Almost 100% automated Tests for Regression testing
Testing for multiple datasets for multiple geographic locations
Shortened development lead time and accelerated release to production
Improve Quality and reducing the test costs
Repeatability and transparency of test management
Quick results and reports to management
22 April, 2021 UNRESTRICTED 13
Quality Review Process
Metso Regression
quality review
process
Issues Resolution
post regression
cycle
Impact Analysis –
for identifying new scripts
needed to be
Test datasets update twice a year / on
demand
Continuos improvement
and maintenance
22 April, 2021 UNRESTRICTED 14
Key Success Factors
• Maintenance plan• Continuos
improvement & quality review
• Test data refreshes
• Clear vision and scope
• Define process blueprint
• Critical business case• Repetitive process
• Sandbox environment • Test scripts reusability• Testing & validation
• Team members collaborations
• Configuration / module owners training
• Team for Regression testing
01 People
03 Approach
04Maintenance
02 Process
22 April, 2021 UNRESTRICTED 15
Worksoft Support
• University portal for learning and certifications• Worksoft community portal
- Discussions with other customers / worksoft gurus- Ideas / feedback- Open cases
• Webinars & Live events• Bi-weekly catch-up• User group meeting
22 April, 2021 UNRESTRICTED 16
Solution Manager & Certify IntegrationProcess Description• Tests are monitored and performed via SAP Solution manager which launches the external testing
tool Worksoft Certify
• Integration works in the following way:1. Tests are scheduled in Solution Manager for LOT (Lights Out Testing)
2. Once the scheduled test package starts execution, Solution Manager launces Worksoft Certify
3. Worksoft Certify launches the specified SAP client and starts executing the test script
4. Once test script has been executed, test results are automatically uploaded to Solution Manager and Worksoft Certify
Solution Manager
Test ManagementTest Plan
Test PackageTester AssignmentTest Configuration
Test Data ContainerScheduling
Worksoft Certify
Test Script GenerationExecutionReporting
Error Correction
Execution Manager
LOT (Lights Out Testing)
Remote loggingLaunching Test
Reporting Results
22 April, 2021 UNRESTRICTED 17
Worksoft Execution Manager
• Centralized control for running worksoft scripts remotely
• Automated advance scheduling – order of tasks and dependencies
• Managing the remote testing resources from anywhere
• Lights Out Testing
• Control, Manage, and Accelerate test cycles
22 April, 2021 UNRESTRICTED 18
Worksoft Impact Analysis
• SAP Solution Manager BPCA difficult to operate and required more time
• Optimizing the test scope by ensuring test coverage
• Identification of critical business transactions
• Make easier to adopt Regression testing for weekly releases
• Create Analysis• Provide details
Analysis
• Desired SAP System• SAP systems
maintained in Management Studio
SAP system• Multiple Transport
No.• Description• Dates criteria
Transport Criteria
• Selecting Transports• Include customizing
objects
Transports• Define Certify Project
for analysis
Certify Project
• Transactions / program NOT having coverage
• ST03 usage data
Test Coverage • Resource for
execution• Scheduling
Execution
22 April, 2021 UNRESTRICTED 19
Robotics Process Automation (RPA)• Master Data Creation for BI Reports
• Process for creating Purchase Order and Sales Order for MD
• Using data from Recordsets / excel sheets
• User Experience Management
• Data collection basis of the user’s experience
• Calculating differences between recorded data
• Scheduling the process and running on hourly basis
• Process for downloading Custom Development and
Functional Development Docs
• Manually downloading and saving the docs on local drive will take
days or months for the end users so created a robotic process
Robotics
• A robot to emulate and integrate the actions of a human
Process
• A sequence of steps that leads to a meaningful activity
Automation
• Tasks carrying out without human intervention
22 April, 2021 UNRESTRICTED 20
Testing Environment
Management Studio
Execution Manager
Impact
Certify
Database SQL Server&
License Server
License Server
Application Server(Windows Azure Machine)
TCP 50530
TCP 1433 (Configure)
Certify version 11.0.0.148(10 licenses: 5 perpetual & 5 runtime)
Worksoft Impact Perpetual (Including Execution Manager)
Certify Execution Manager Version 10.0
Certify Impact version 10.0.12.5
Management Studio 10.0.24.28
03 Windows Azure machines & 01 Windows Machine(Windows Server 2012, 2016 and Windows 10 machines)
Test EMs
mogroup.com
Thanks for listening