Preview the new HP LoadRunner and HP Performance Center 12 · • Add performance tests as build...

© Copyright 2014 Vivit Worldwide © Copyright 2014 Vivit Worldwide

Preview the new HP LoadRunner and HP Performance Center 12.0

April 24, 2014

© Copyright 2014 Vivit Worldwide

Brought to you by


Hosted by

Megan Shelton

Vivit Performance Engineering SIG Leader

Vivit Ohio Chapter Leader


Today’s Speakers

Mukulika Kapas

Senior Product Manager

HP

Colin Griffiths

NFT Team Leader

Platform Performance Engineering Team

BSkyB

Shane Evans

Senior Product Manager

HP


Housekeeping

• This “LIVE” session is being recorded

Recordings are available to all Vivit members

• Session Q&A:

Please type questions in the Questions Pane


Webinar Control Panel

Questions

Toggle View Window between

Full screen/window mode.

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

What is new v 12 HP LoadRunner HP Performance Center

Shane Evans – Product Manager

Mukulika Kapas - Product Manager

Colin Griffiths – BSkyB Team Leader, Platform Performance Engineering Team

© Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8

We enable you to deliver high performance applications with unprecedented velocity and

uncompromising quality.

HP Apps 12 Application Delivery Management in the new style of IT


Market trends Delivering applications faster and with quality


A radically different kind of user

Mainframe Client/Server Web Devices

System-centric User-centric

Users born after 1980


All trends bend to the user Wanted: constant access to feature-fresh apps running on the device of choice.

Mobile apps

Native PC apps

Mobility

Time

Volume

Velocity

Time

Volume

Rate of release per app per month

Hybrid environments

On premise

Cloud

Time

Volume


Change is accelerating

Pace of Change

Application Development Trends

WAN LAN

WAN WAN WAN WAN

Web Web Web Web

Composite Apps

Composite Apps

Composite Apps

Cloud Cloud

Mobile


Application complexity drives user experience

Performance testing and virtualization reduce risk and total cost of ownership

Mainframe

Storage

DB

servers

Web

services

App

servers

Web

servers

Load

balancers

Mobile

components

Major ISP

3rd party

cloud services

Content

delivery

networks

Mobile carriers

& ISPs

Browsers&

devices

Customers

Employees

© Copyright 2012 Hewlett-Packard Development Company, L.P.

The information contained herein is subject to change without notice.

Survey Questions


Performance Testing Version 12 Cloud, mobile, continuous testing, user experience and price simplification


Introducing Performance testing v12

Flexible Delivery

Get started quickly and economically, with community edition

User Experience & Community

Ease of use from any platform. Share and connect with users and partners

Cloud Testing

Maximum performance and scale

Support a wide range of technologies, methodologies and environments that represent the new style of IT

Enhanced Mobile Testing

Realistic performance mobile testing

Continuous Testing

Continuous integration with DevOps

Build, test and deliver with breakthrough speed and quality


HP Performance Testing components

Virtualize the network 4

Analysis, diagnostics and reporting

Database Internet/WAN Application server(s) Client(s) End user

Measure impact

6

Generate load 3 Author scripts 1

Plan and execute tests 2 HP Live Network 7

5


HP Performance Testing components

Virtualize the network 4

Analysis, diagnostics and reporting

Database Internet/WAN Application server(s) Client(s) End user

Measure impact

6

Generate load 3 Author scripts 1

Plan and execute tests 2 HP Live Network 7

5

Performance Center

Trend reporting

Performance

lifecycle

Centralized assets

Global

collaboration


Spotlight Cloud testing Maximum performance and scale


Customer-centric enhancements to performance testing, in the cloud

Cloud testing / maximum performance and scale

Scale without the overhead using automated, worldwide provisioning of load generators in the cloud

Simplify administration by defining cloud accounts, manage cloud host usage

Save time/effort by leveraging and sharing cloud testing configurations and resources across teams


AUT

AUT

• Scale up and down based on test requirements

• Geographical distribution

• Share cloud environments in between tests

Value: Elastically scale up to meet demands reducing cost and overhead of managing dedicated infrastructure

LoadRunner or Performance Center

Connect securely on standard ports

Scale without the overhead


LG

LG LG LG

HP Performance Center and HP LoadRunner seamlessly leverage public Cloud infrastructure to deploy LoadGenerators (LGs)

No separate LR/PC licensing needed for cloud testing. Customers need to use their cloud accounts within LR/PC


Add multiple Cloud accounts and manage Network Profiles for connecting to your various LGs

• Manage cloud accounts

• Provision multiple LoadGenerators (LGs)

• Run test with Cloud LGs

• Review provisioning reports

Share cloud testing configurations and resources across teams


Value: Significantly reduces provisioning time of performance testing, while maintaining security and control


Easy administration of a shared cloud performance test environment using My Performance Center

• Allow PC testers to create test sets within MY PC

• Easier Test Creation via “Test Express”

• Provide visibility into LAB Management

• Ease of access of ALM feature set

Simplify cloud administration with My Performance Center


Value: Reduce time of administration of performance testing shared environment


Cloud Testing / User flow

Manage Cloud accounts

Provision multiple LGs

Run load test with cloud LGs

Create Cloud accounts

Provisioning LGs starts

Cloud usage report








Cloud usage report


Cloud testing / benefits

Reduces cost

Elastically scale up to meet demands reducing cost and overhead of managing dedicated infrastructure

Reduces time, deliver apps faster

Significantly reduces provisioning time of performance testing, while maintaining security and control

Reduce time of administration of performance testing shared environment


Spotlight Enhanced mobile testing experience Bringing network virtualization to HP Software portfolio


Test mobile performance the way you need

Complete mobile testing / performance testing

Test performance the way you need for all Mobile app delivery models with new recording

Realistic end-to-end mobile test HP Mobile TruClient or HP LR Mobile App Protocol integrated with HP Network characteristics

Value: Complete mobile performance test


The complete solution for performance testing mobile apps:

• Identify bottlenecks before end users do

• Testing both good and BAD network connections

• Understand impact of mobile on entire system

• HP Mobile TruClient or HP Mobile Application Protocol

• Advanced: HP Network Virtualization emulates true network conditions

Value: Realistic mobile performance testing

HP Network Virtualization

Complete mobile testing / performance testing The complete solution for performance testing… with network characteristics


Mobile applications protocol

• Supports native and hybrid apps

• Real and emulated devices (proxy)

On device recording

• Android available

Mobile TruClient protocol

• Emulates true User Experience

• Supports Web based Mobile apps

• Ideal for Agile development

SMP – SAP Mobile Platform

Complete mobile testing / performance testing New recording options


Include network characteristics in automated performance tests

• Today’s composite apps are distributed– the network and it’s erratic behavior is a constant!

• Emulate multiple networks on each Load Generator from within LoadRunner and Performance Center

• Full integration of HP Network Virtualization with HP Service Virtualization

• Define and control network parameters

• With the industry’s most comprehensive library of Network Model definitions

Value: Avoid “it was the network” to ensure uncompromised quality

Complete mobile testing / redefine performance In all testing scenarios


Spotlight Continuous testing Continuous integration with Dev/Ops


3 Keys to better performance

• Test early

• Test often

• Monitor and leverage data from monitoring as baseline for test

Continuous testing / redefine performance Performance management across the application lifecycle


Helping Dev/Test load test in Continuous Integration (CI): HP LoadRunner provides developers with tools and APIs to infuse performance testing earlier

• Build load test scripts during development integrating with Visual Studio or Eclipse

• Run Unit tests in Load Scenarios

• Support for nUnit, jUnit and Selenium tests as part of LoadRunner scenarios

• Add performance tests as build steps in Jenkins

• REST API to support Continuous Delivery processes

Value: Accelerate application delivery by integrating performance testing in Agile and hybrid environments

Test

Visual Studio or Eclipse

Selenium, jUnit, nUnit

Jenkins

Continuous testing / redefine performance Integration with Dev tools


Add LoadRunner APIs to Unit Tests in Visual Studio or Eclipse

Integration with Jenkins: Automate test scheduling, execute tests and view results as part of the build plan

Verify Output within the IDE

Execute Unit Tests using the LoadRunner Engine

Create LoadRunner scenario from the IDE

Integration with Dev tools – Unit test

Continuous testing / redefine performance








Continuous testing / redefine performance Integration with Dev tools – Unit test



Available only on LoadRunner









Available with LoadRunner and Performance Center






Continuous testing / redefine performance Integration with Dev tools – Jenkins



REST API to support Continuous Delivery processes: • Schedule, Run, Stop, Collate,

Analyze tests via REST API • Create Monitors, Topologies • Connect to Continuous

Integration solutions

Continuous testing / redefine performance Integration with Dev tools



Web and Mobile applications are increasingly built using common components, which are driven by fast-moving standards such as SPDY (pronounced “Speedy”), Navigation Timing, and HTML5.

Continuous testing / redefine performance Support for SPDY and WebSockets


Refine load test details

Collect & analyze production data

Analyze and tune load test data

Load test Compare production and load test data

Continuous testing / performance application lifecycle Accurate, realistic, reliable testing


Bringing production data into performance testing as baseline

• Collect, analyze and compare performance data from production

• Updated log file analysis of production data for IIS

• Integration with Google Analytics

Performance application lifecycle

Continuous testing / redefine performance

Value: Performance testing closer to reality with accurate, realistic, reliable test: reduce risk and improve test results


Spotlight Remarkable end user experience Ease of use from any platform


Performance testing with relentless efficiency

• Analysis templates

• Support additional languages

• TruClient Web/HTTP converter utility

• Reuse of test data via new VTS

• UI improvements

• Updated integrations with HP products

• ALM, UFT, SV, Diagnostics and Sitescope

Easy Value: Slash time to test applications for continuous high performance

Remarkable end user experience / test express UI and automation features


Execute performance test faster

within HP Performance Center test lab

• 3 simple quick steps

• Add script to the designer

• Design your test

• Run test

Easy

Mukulika/Shane, do we need this slide? We have a similar slide

#17 in the cloud area

Remarkable end user experience / ease of use UI and automation features


• Windows 8 • Internet Explorer 10 • Google Chrome • SAPGUI 7.3 • Java 1.7 • Oracle Forms 11 • New Linux Load Generator support:

• Ubuntu • Amazon Linux • Oracle Enterprise Linux

Remarkable end user experience / keeping current Updated protocols / new platforms


HP Live Network (HPLN) Integration with VuGen

• Automated content delivery

• HP, Partner and Community developed Function Libraries, Correlation Rules and Data Format Extensions

• Connected to HP Passport

Partner-developed Protocols

• Planned sale/delivery via HPLN

Remarkable end user experience / building community HP Live Network


Spotlight Flexible delivery Get started quickly and economically


Offerings to get you started:

• Loadrunner Community

• Performance Center “smoke testing”

Flexible delivery

Free offers and trials

Value: Flexible ways to get started and keep going on your path to velocity and quality

Pricing and licensing simplicity

Controller cost has been removed

New price points

Various delivery options:

• Permanent and term licenses

• Performance Center on SaaS

• LoadRunner in the Cloud

• Professional services, support, education, and global partners

Delivery your way


Quality and performance is imperative for BSkyB

"At British Sky Broadcasting, customer experience is fundamental to delivering the expansive entertainment and technology services we offer, making quality and performance imperative for speeding innovation and business growth,”

“With HP Performance Center, using new enhancements including REST API support, we can now continuously integrate performance testing across development and Agile teams to deliver superior content and services that continue to excite our customers and scale based on demand.”

—British Sky Broadcasting


Customer case: BSkyB

Skyfall

Performance Engineering at Sky

58 Who are Sky?

• Sky is the largest digital satellite broadcaster in UK.

– Original programming content

– Leading original sports content on Sky Sports and movie content on Sky Movies

• Broadband and Telephony provider.

• Wifi hot spots with “The Cloud”

• Video streaming content using Sky Go

59 Customer Business Systems

• Customer Business Systems

– Internal applications used by agents to service customer accounts

– Support CRM platform

– Support the back end sub systems

– 2 full volume production replica environments for NFT.

- Testing 24 x 7

– 100’s of projects a year require NFT.

– Being a media company

- We frequently work to deadlines that would be un-realistic in other industries, finance etc.

- Deadlines often driven by Marketing campaigns and events which cannot move!

- Very visible and public when we get things wrong!

60 HP Tools at Sky • We are large HP software customers

• We depend on HP tools to deliver our software releases

• HP Quality Center users

• HP UFT users

• HP Performance Center users since PC 8

– Large PC estate

– Enterprise ELA all protocols

– 30 controllers, 10 Analysis servers

– 40000 concurrent users

– 200+ load generators

• HP Diagnostics users, 280 J2EE probes

• HP Sitescope users

– 15K of Sitescope points for testing over 4 Sitescope instances

61

Delivery at Sky • The old world

– Platform releases every 6 weeks to production

– CRM platform with variety of agent applications

– CRM application uses java thick client

– Number of back end systems, Billing, Debt, Broadband and Telephony, Supply Chain etc.

– Waterfall delivery

– Up to 20 projects delivering in a release

• NFT large platform PRD simulations run in the last week of release

– Simulating 6500 agents interacting with a number of applications

– Up to 10 controllers used concurrently to run 1 platform test

– Batch schedules tested concurrently using Control M

62 Delivery at Sky

• The new world

– Move to Agile and SOA model

– 15 Agile teams delivering change weekly to production

– Requirement to test more often

– Test smarter!

– PC 12 helps us do this

63 Agile Testing – migrating from JMeter to

Performance Center 12 • We have a nightly CI run of our SOA services orchestrated using Jenkins running JMeter

– Compare component versions with functional test environment

– Deploy latest code versions and cutover to this

– Smoke test

– Run load test based on smoke results

– Automated results by email

– Revert code back to previous version

• PC 12 Rest API now provides the ability for us to do this with PC.

– We have the ability to remove JMeter given new rest API’s in PC 12

– We have started doing this and have successfully started tests & pulled down test results

– Will be integrated into our nightly CI runs

64

Performance Center 12 Beta • The beta experience

– Our experience with PC was very positive

– We liked the new look and feel

– Improvements to My Performance Center

- A big improvement for performance testers!

– Analysis templates

- A very useful feature we’ve been looking for some time

– REST API enhancements

- Enables our Agile CI efforts!

• Beta Achievements

– Successfully delivered and installed HP Performance Center 12 environment using IOD kit

– Successfully migrated and upgraded three projects small and medium scaled projects

– SKY raised 8 defects, 6 enhancements and 4 new feature requests during the beta release testing

– Workshop session with HP R&D lab via conference call to discuss our use of Performance Center


To learn more…

Additional resources • What is new v 12: HP LoadRunner and HP Performance Center datasheet

• Performance Management across the application lifecycle Infographic

• System requirements: www.hp.com/go/pclr_sysreq

• Webinars:

• May 21st: Why real network behavior is important when testing performance

• June 18th: Continuous Integration & Performance testing (Agile)

• Web and Social Media:

• Learn more at HP LoadRunner and HP Performance Center Blog.

• www.hp.com/go/performancecenter

• www.hp.com/go/loadrunner

http://www.hp.com/go/pclr_sysreq

http://h30499.www3.hp.com/t5/HP-LoadRunner-and-Performance/bg-p/sws-585

http://h30499.www3.hp.com/t5/HP-LoadRunner-and-Performance/bg-p/sws-585

http://www.hp.com/go/performancecenter

http://www.hp.com/go/loadrunner


Questions

www.hp.com/go/loadrunner

www.hp.com/go/performancecenter

67 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP Discover is the ultimate showcase technology event for

business and IT professionals to learn about solutions for

the new style of IT. Choose from hundreds of sessions on key

topics like Cloud, Security and Risk Management, Mobility,

and dozens targeted at your key business priorities.

When: June 10–12, 2014

Where: The Venetian | The Palazzo, Las Vegas, Nevada

Register now at hp.com/go/Discover

68 © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

HP LoadRunner: hp.com/go/loadrunner

HP Performance Center : hp.com/go/performancecenter

HP Software’s premier customer event: hp.com/go/discover

HP Software’s Community of IT Professionals: hp.com/go/swcommunity

HP Software Education Services: hp.com/software/education

HP Software Support Services: hp.com/go/hpswsupport

HP Software Professional Services: hp.com/go/hpswprofessionalservices

For more information: [email protected]

Additional resources





http://www.hp.com/go/discover

http://www.hp.com/go/discover

http://www.hp.com/go/swcommunity


http://www.hp.com/software/education

http://www.hp.com/software/education

http://www.hp.com/go/hpswsupport

http://www.hp.com/go/hpswsupport

http://www.hp.com/go/hpswprofessionalservices

http://www.hp.com/go/hpswprofessionalservices


Thank you


HP Discover Las Vegas 2014

• Vivit needs your assistance. We would like to be one of the largest

groups with members attending this event.

• Here’s how you can assist:

– Register now and enter code swvivit to enjoy a $400 discount until

April 30 and ensure that you receive Discover information tailored to

your needs. After April 30, you will only receive $300 off the entrance

price of $1795.

– Please encourage all Vivit members to use code swvivit when

registering.

https://h30496.www3.hp.com/portal/newreg.ww?jumpID=em_CID-368395_AID-368702/ww/SW//SS/Vivit/swvivit_emails

https://h30496.www3.hp.com/portal/newreg.ww?jumpID=em_CID-368395_AID-368702/ww/SW//SS/Vivit/swvivit_emails


News from HP Software

• Visit the HP IT Experts Community for forums, blogs, upcoming

events and to register for monthly newsletter.

• Participate in upcoming Online Expert Days.


http://support.openview.hp.com/event_details.jsp


Thank you

• Complete the short survey and opt-in for more

information from HP.

www.hp.com

www.vivit-worldwide.org

http://www.hp.com/

http://www.vivit-worldwide.org/



Preview the new HP LoadRunner and HP Performance Center 12 · • Add performance tests as build...

Documents

Transcript of Preview the new HP LoadRunner and HP Performance Center 12 · • Add performance tests as build...