Performance Testing webinar

TenXLabsPerformance Testing: Harnessing the Cloud

-Shuchita Ahuja Kaushik

www.tenxlabs.com 2

Agenda

What is Performance Testing1Cloud- Concept and Capability2Performane Testing – On Premises: Challenges3Performance Testing - A Cloud Service Offering4Cloud Load Testing – Demo with Visual Studio Online5

www.tenxlabs.com 3

Agenda

What is Performance Testing1Cloud- Concept and Capability2Performane Testing – On Premises: Challenges 3Performance Testing - A Cloud Service Offering4Cloud Load Testing – Demo with Visual Studio Online5

www.tenxlabs.com 4

What is Performance TestingIn software engineering, performance testing is the testing performed to determine how a system performs in terms of responsiveness and stability under a particular workload. Performance testing is an Integral component of Quality Assurance

Volume Testing

Scalability Testing

Endurance Testing

Longevity Testing

Spike Testing

• Performance is a common term – Used in different flavours

• Check performance from different aspects – different organizations can have different performance indicators that they might want to performance test the application against and attain.

5

What is Performance Testing

Other tests falling under

bigger umbrella of

performance -

Capacity Testing

Endurance Testing

Spike Testing

Image Source - http://www.qualitykiosk.com/www.tenxlabs.com

www.tenxlabs.com 6

Typical Performance Test ProcedureTypically all performance testing activities follow a particular

sequence of steps at the execution level.

Image Source - http://www.sabritech.com//

There is a very close analogy between a performance testing process and a functional testing process – the difference being the clarity of the expected behavior.

www.tenxlabs.com 7

Performane Testing ToolsBoth Commercial and open source tools are available

•JMeter•OpenSTA•Grinder•Silk Performer•Load Runner•Rational Performance Tester•Microsoft VSTS•Fiddler•WebLoad

www.tenxlabs.com 8

Agenda


www.tenxlabs.com 9

Cloud – Concept and Capability

• Cloud computing is defined as a type of computing that relies on sharing computing resources rather than having local servers or personal devices to handle applications. Cloud computing is comparable to grid computing, a type of computing where unused processing cycles of all computers in a network are harnesses to solve problems too intensive for any stand-alone machine

• A concept of systems, infrastructures and software being dynamically available to users in a real time while being present on Virtual machines located somewhere on the globe.

• Choosing to use the cloud frees the user from setting up, installing and maintaining the resources.

• Using Cloud is like using mobile phone in a tariff plan. You pay for as much as you use, you pay for as long as you use.

Definition and Usage Models

www.tenxlabs.com 10

Cloud – Concept and CapabilityCloud Computing – All Offerings are services

The service is managed by a Cloud portal where the user can choose, manage and pay for the units he consumes and also that he plans to consume.

www.tenxlabs.com 11

Commercial Services Offerings

www.tenxlabs.com 12

Types of Cloud

www.tenxlabs.com 13

Agenda


www.tenxlabs.com 14

Performance Testing – On Premises: ChallengesSome challenges for Realistic tests executed on premises-

• Lab Set-up – Hardware, software and tools installation and up keeping - Infrastructure is one of the biggest challenges with performance and load testing.

• Testing large numbers of virtual users - scalability• Testing outside the firewall • Testing from multiple geographical locations• There might be a need to execute performance test for many builds.

Some issues commonly heard –• It just takes too much time to configure the tool • Site works fine in US, but does not work from EU• It’s too expensive to setup, maintain and update a test lab• It takes too much time and effort to setup a test lab • Test phases last for only 2 months: Underutilized Test Boxes• I don’t have a snap shot of test environment in case it crashes

www.tenxlabs.com 15

Agenda


www.tenxlabs.com 16

Performance Testing - A Cloud Service OfferingMove the performance testing lab to cloud

• Organizations have changed the way they offer performance testing solutions!

• Organizations have changed the way they buy performance testing solutions!

• Performance labs are available on the cloud

• Customers can use the labs on demand and pay for the usage and scalability.

www.tenxlabs.com 17

Performance Testing - A Cloud Service Offering

To overcome the issues discussed, the availability of cloud is being harnessed to run routine tests

Lab up-keeping and maintenance is no more a challenge with the organization.

Scalable virtual systems are available to host the performance lab – with latest tool, system perquisites, and hardware configuration

Scripts reusability is offered by most performance testing cloud services. Uniformity can be attained on tool behavior and application response across the globe.

Load can be generated from different geographical locations across the globe. On demand high scalability with respect to

load generation can be achieved.

Advantages

Pre-launch performance testing rounds can be performed

www.tenxlabs.com 18

Performance Testing - A Cloud Service OfferingAdvantages - Summary

• Infinite computing power• Affordable• Pay as you scale and go model• Saving the cost of software licenses• Quick and easy set up• Ready to use environment• Ability to simulate multiple geographies

www.tenxlabs.com 19

Performance Testing with Cloud – Tools available

• Visual Studio Online – by Microsoft• SandStorm from Impetus• LoadStorm • Grinder In The Cloud • CloudTest by SOASTA • VMLogix and Skytap • BrowserMob• KeyNote• Pylot - Web Load Testing from Amazon Elastic Compute Cloud • HP LoadRunner• Xceptance LoadTest • Load-Intelligence• TrafficSpike from Intechnica

www.tenxlabs.com 20

Performance Testing with Cloud – Cloud Model

www.tenxlabs.com 21

Performance Testing with Cloud – Hybrid Model

www.tenxlabs.com 22

Cloud Based performance Testing - Challenges

• Data Security

• Intranet Applications• Access • Network Latency

• Monitoring and diagnostic tools

• Test Data Management

• Test Script creation and validation

www.tenxlabs.com 23

Recommended -

• Performance goals are uncertain• Actual user base is globally distributed• Performance-centric development is required• Source builds are located on cloud• Costs of set ups are unconvincing to budgets!

Choosing to go the cloud way still recommended when-

www.tenxlabs.com 24

Agenda


www.tenxlabs.com 25

Visual Studio Online

• Quick: Just one click gets a performance lab in the cloud, no setup needed. Scale up or down based on your needs.

• Free load testing: Gives 20,000 virtual user minutes every month to load test at no extra charge.

• Real-time charts and graphs: Application's performance can be watched while the tests run. Results can be shared when your tests are done.

• Test where the users are: Test from different locations to reduce latency and simulate local conditions.

• Capacity on demand: Load testing service is elastic and dynamic. E.g. weather for a load requirement of 200 concurrent virtual users or 20,000 – one will be able to queue a test as per his requirements.

• Same tests work on premises and on the cloud: The tests authored on-premises just run on the service

Cloud Performance Testing Solution with many advantages

www.tenxlabs.com 26

Visual Studio Online

• A quick demo to execute tests on cloud

www.tenxlabs.com 27

Q & A

TenXLabsBlock B6, Vindhya C6IIIT Campus, GachibowliHyderabad, 500032Indiawww.tenxlabs.com

Performance Testing webinar

Technology

Transcript of Performance Testing webinar