7561 how to automate testing for people soft applications
-
Upload
sun-kim -
Category
Technology
-
view
49 -
download
0
description
Transcript of 7561 how to automate testing for people soft applications
How to Automate Testing for your PeopleSoft Applications
John L. Montgomery Test Tools & Automation Services, PeopleSoft
Shawn Smith Senior Systems Engineer, Mercury Interactive
Session Number 7015
Why Automate?
Page 2
Reduce test cycle time
Repeatability of testing
Parallel client OS testing
Parallel browser testing
Regression testing for upgrades/patches
Eliminate boring work
Increase return on investment
Better coverage
Internationalization & localization testing
Page 3
Automation’s Impact at PeopleSoft
Full regression test , 30 person days, completed for CRM8.4 in 8 hours
Return on investment of 15,000 resource hours for Financials 8.4
100% of automation updated prior to QA receiving a new build
95% of showstoppers found prior to QA receiving a new build
Proposed Automation Process
Page 4
Pre-BuildDBAs Populate
test floor
SQL/NT SQL/NT
Development Test Repot
Test Floor Test Repot
DB2/OS390
Oracle/Sol
Other
Test Floor DatabasesAutomation Database
~~
Within 24 hrs
Within12 hrs
The Keys to PeopleSoft’s Testing Automation Success
Page 5
Appropriate combination of testing tools, skilled resources, and process to deliver higher quality applications and reduce time to production
Automation best practices Dedicated automation teams Centralized test management Automation centric methodology
Tips maintenance and recording
How to Automate Testing for your PeopleSoft Applications
John L. Montgomery Test Tools & Automation Services, PeopleSoft
Shawn Smith Senior Systems Engineer, Mercury Interactive
Session Number 7015
Page 7
What is a Dedicated Automation Team?
Dedicated automation team Develops and executes automated scripts Has separate objectives from Dev and QA Owns automation, but not bugs Minimum of 1 automator to 3 QA engineers Never re-purposed for QA
Benefits of a dedicated automation team Increased automation coverage Specialization of labor In house support for tools Maintainable scripting Customization of tools
What is Centralized Test Management?
Page 8
The “QA Workbench” Manage creation & storage of test requirements,
test cases, test scripts, & execution results Executes manual & automated scripts Associate defects & results to requirements Integrates with internal automation tools
Benefits of centralized test management Common view for Dev and QA Central point of access for management Source control integration Common metrics for release health & planning Manage geographically distributed teams
Page 9
Mercury TestDirector Requirements Mgmt Test Mgmt Execution Mgmt
PSScript Enterprise PeopleSoft Application Testing
Mercury WinRunner-QuickTest Pro PeopleTools Automation PeopleSoft Application Testing 3rd Party Automation
Application Under Test
Source Control
Centralized Test Management - PeopleSoft’s Model
DefectTracking
Metrics Process
Page 10
Auto Team
Test Requirements
Test Management Test ResultsTest Execution
Tes
t D
irec
tor
QA Team QA Manager
DevelopmentM
anua
l Cas
es
Req
uire
men
ts
Man
ual C
ases
Aut
omat
ed C
ases
Application UnderTest
•Creates Test Requirement•Creates Manual Test Cases•All Reside in TestDirector
•Use PSScript Enterprise•Use Automation Tools•All Reside in TestDirector
QA Team
Run
Rep
ort
Exe
cute
s T
ests
•Executes Manual Cases•Executes Automated Cases•All Run Through TestDirector
Run
s T
ests
Ret
urns
Log
Tes
t Res
ults
•Track Manual Testing•Track Automated Testing•All Results in Same Report
•View Test Results Real-time
DevelopmentQA Manager
•Review Requirements•Validate Test Coverage
QA Manager
•Track Test Creation•Track Automation Creation
Man
agem
ent
Tes
t P
roce
ssCentralized Test Management - TestDirector
Page 11
Metrics Collection and Reporting - PeopleSoft’s Model
PeopleTools DB for Metrics
HCM
Fin
SCM
LS
CRM
EPM
Crystal Reports Metrics
Test Execution Test Coverage Automation
PTools
Report GenerationData StorageAutomation Tracking
What is an Automation Centric Methodology?
Automation centric methodology Pre-build regression/acceptance test process Pre-build maintenance process Post release test process Process for automating bug replication
Benefits of automation centric methodology Showstoppers found in pre-build Automation remains up to date Automation runs consistently Post release testing in less than 1 day Regression bed grows
Page 12
Page 13
Lessons Learned - Keys to Success
Centralized automation support organization
Auto team does not QA
QA team creates cases and tracks bugs
Automation used during all phases
Test cases written for automation
Automation team executes automation
Return on investment must be tracked
Automation perceived as critical by upper management
Page 14
The Tangibles
Best Practice - Managing Script Maintenance
Automation team’s responsibility
Create common functions
Record using stable properties
Data-driven testing
Maintain scripts against pre-build
Identify UI changes first
Develop Customizations to address application specific issues
Script modularization methodology
Page 15
Page 16
Tips and Tricks
Set config.properties file Testing=True
Get patch to support field validation event trigger upon field exit
Check VBS limitations in the VBScript Programmer’s Reference Appendix B
Take advantage of regular expressions in checkpoints
Page 16
Best Practices for Testing PeopleSoft Applications
Q&A
Page 18
Support Slides
Page 19
Analysis & Design
Gather Requirements
Analysis & Design
Implementation
System Platfor
mPost GA
Performance Test
Pre-System
Development of unit test cases Requirements Approvals Creation Source control
Tracking unit test development metrics
Page 20
Implementation
Gather Requirements
Analysis & Design
Implementation
System Platfor
mPost GA
Performance Test
Pre-System
Unit test execution & automation
Acceptance & system test development
Automation of acceptance tests
Performance test requirements
Regression test execution
Tracking of creation & execution metrics
Page 21
Pre-System Test and Performance Test
Gather Requirements
Analysis & Design
Implementation
System Platfor
mPost GA
Performance Test
Pre-System
Execution of acceptance tests
Automation of system tests
Automation of performance tests
Tracking of execution metrics
Page 22
System & Platform Test and Performance Test
Gather Requirements
Analysis & Design
Implementation
System Platfor
mPost GA
Performance Test
Pre-System
Execution of system tests
Execution of performance tests
Tracking of defects
Tracking of execution & coverage metrics
Page 23
Post GA
Gather Requirements
Analysis & Design
Implementation
System Platfor
mPost GA
Performance Test
Pre-System
Certification of new OS & platform combo’s
Regression test patches & upgrades
Regression test customizations
Localization & internationalization testing
Tracking ROI & execution metrics
Tracking of defects
Page 24
Navigation Utility
Build utility to query PSPRSMDEFN to build portal navigation lookup spreadsheet
Build function to: Find correct entry in spreadsheet, based on
Component name and user role Click through links of portal menu path
Re-run utility to build spreadsheet for each new build
Page 25
Navigation Utility
PeopleTools Database
URLNavigation PathComponentRole
Navigation Path Spreadsheet
Navigation Extraction Utility
Automation Scripts
Navigation information retrieved from spreadsheet