Berlin QA - Performance Testing
-
Upload
globe-testing -
Category
Technology
-
view
683 -
download
4
description
Transcript of Berlin QA - Performance Testing
Performance testing & beers
Berlin QA // Because blame doesn´t fix bugs
José Aracil // Operations Manager // Globe Testing
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
About usWe are fun!
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
About us Focussed on Software Testing and ALM
Knowledgeable and experienced staff
Innovation: in the forefront of our services
Obsessed with excellence and attention to detail
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Our services
Functional Testing Performance Testing Performance Management
Test Execution(manual or automated)
Test managementPerformance, load,stress,
soak…
System optimization
Availability and
performanceUnderstand
end user experience
Proactive problem
resolution
Foundation
Traceability & Control Vision & ReportingProcess Standardization (i.e. Waterfall, Agile)
DevOps
Application Lifecycle Management
Training & Coaching Outsourcing & turnkey projects
Diagnostics
Consulting ServicesQA Tools Deployment
Current situationWhere we stand right now
Confidential & Proprietary
Application evolution
• Valuable, but growth is capped• Costly, brittle, monolithic and
proprietary• Must change structure to evolve
• Next generations of SAP and Oracle based on SOA
• SOA driving new custom applications and legacy integrations
• New Web 2.0 models• “Mashups” in the enterprise
New and Agile Business CapabilitiesShared Services / Composite Apps
Yesterday’s applications: Today’s applications:
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
The challenges of our modern world
Composite Applications
Service oriented applications
Modern, mobile applications
Agile & Modern business require MODERN and FAST applications
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
The challenges of our modern worldAgile & Modern business require MODERN and FAST applications
Application Unavailable
10x more performance risks
Functional defects
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Performance Testing
Performance• Optimal application performance is in the
experience of the end user.
Why is my application not performing?• Looks simple, if we optimize all layers in
isolation, the resulting system should perform.
Performance is in the eyes of the beholder
Performance• Optimal application performance is in the
experience of the end user.
Why is my application not performing?• Looks simple, if we optimize all layers in
isolation, the resulting system should perform.
Performance is in the eyes of the beholder
Performance• Optimal application performance is in the
experience of the end user.
Why is my application not performing?• Looks simple, if we optimize all layers in
isolation, the resulting system should perform.
Performance is in the eyes of the beholder
Probably a MEMORY leak…
or may be a CODE issue…
I guess it is NETWORK!
Does your application have performance issues?
It is probably a memory leak issue!
No, it may be a CODE issue!
I guess is Network related!
We are not ready for the 100, 1000, 100000 users!
We SHOULD haveTESTEDPerformance!
How HP LoadRunner Works
5 Analysis, diagnostics and reporting
DatabaseInternet/WANMiddle Tier
(HTTP, WebSphere, Server, Network)Applicatio
nEnd user
Thousands of users are simulated
Transaction recording
“Transfer Funds”
“Check Balance”
“Pay Bills”
Scripting1
Test Scenario
Test planning2
Load generation
3 Monitorization4
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Recipe for successTest Strategy
•Set expectations•Project planning•Environment description•Responsible people•Test scenario definition•Test case definition•Monitors to be used•“Live” document
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Test Env. + Data
Recipe for successTest Strategy
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
•Env. Setup (pre-prod)•Data load to resemble prod.
Planning
Preparation
Tool setup
Recipe for successTest Strategy
Test Env. + Data •Performance testing tools•Monitorization tools•Other tools (reporting,…)
12/04/2023
Planning
Preparation
Test case design
•Transactions•Image and text checks•Test data
Recipe for successTest Strategy
Tool setupTest Env. + Data
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Monitor config.
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design•Select any “interesting” metrics that should be monitored•Identify advanced metrics
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Scripting
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config.
•Turn test cases into automated scripts•Complexity changes depending on the tool used
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Smoke Test
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
•Check that previous phases have been done properly•It doesn´t add value to carry on if there are pending items
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Execution
Baseline
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
Smoke Test
•Obtain a standard for comparison•If performance is not good, it doesn´t add value to carry on with other test
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Execution
Performance Testing
•Iterative process•Minimum 2 iterations
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
Smoke Test
Baseline
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Execution
SOAK Test
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
Smoke Test
Baseline
Performance Testing
Análisis +
Changes
+ R
eport
Other tests
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Load Testing
Planning
Preparation
Execution
Stress
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
Smoke Test
Baseline
Soak Test Load Testing Other tests
Performance Testing
Análisis +
Changes
+ R
eport
•Optional test•Only if previous test are successful
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Execution
Reporting
Final report
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
Smoke Test
Baseline
Soak Test Load Testing Other tests
Stress
Performance Testing
Análisis +
Changes
+ R
eport
•Summary of the test executed, problems found and solutions applied•Too much detail doesn´t add value to the project
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Execution
Reporting
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Monitor config. Scripting
Smoke Test
Baseline
Soak Test Load Testing Other tests
Stress
Final report
Performance Testing
Análisis +
Changes
+ R
eport
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Planning
Preparation
Execution
Reporting
Final reportStressSOAK TestPerformance TestingBaselineSmoke TestScriptingMonitor config.Test case designTool setupTest Env. + Data
•Transactions•Image and text checks•Test data
•Iterative process•Minimum 2 iterations
Recipe for successTest Strategy
Tool setupTest Env. + Data Test case design
Test Strategy
Monitor config. Scripting
Smoke Test
Baseline
Soak Test Load Testing Other tests
Stress
Final report
Performance Testing
Análisis +
Changes
+ R
eport
•Set expectations•Project planning•Environment description•Responsible people•Test scenario definition•Test case definition•Monitors to be used•“Live” document
•Performance testing tools•Monitorization tools•Other tools (reporting,…)
•Select any “interesting” metrics that should be monitored•Identify advanced metrics
•Turn test cases into automated scripts•Complexity changes depending on the tool used
•Check that previous phases have been done properly•It doesn´t add value to carry on if there are pending items
•Obtain a standard for comparison•If performance is not good, it doesn´t add value to carry on with other test
Other tests
•Optional test•Only if previous test are successful
•Summary of the test executed, problems found and solutions applied•Too much detail doesn´t add value to the project
12/04/2023Confidential and Propietary // All rights reserved // Globe Testing
Load Testing•Env. Setup (pre-prod)•Data load to resemble prod.
Success Guaranteed!
Confidential and Propietary // All rights reserved // Globe Testing
Thank you for your timeJosé Aracil // [email protected]